At the end of September 2021, the PCI Council released a Guidelines and Procedures document on conducting Remote Assessments for PCI and card brand assessments. Most of this document is a rehash of previous Council statements and guidance. However, there is one new element in this document that all QSAs will need to read and comply with and that is the requirement of documenting a feasibility analysis to justify conducting a remote assessment.
Some of the examples the Council gives as valid reasons that an on-site assessment may not be feasible includes:
- Restrictions on the ability to travel or meet in person due to health and safety concerns or government advisories. We are all familiar with the COVID-19 pandemic and its impact on travel, particularly international travel. However, I encountered this a while back due to a volcanic eruption in Iceland that cancelled my trip to Europe. Since we had no way of knowing how long the eruption would cause travel disruptions and we were on a tight timeline, we conducted video conferences rather than travel.
- Geographic locations that are physically inaccessible or difficult to reach. I personally ran into this situation one several years ago when a data center in Europe that was supposed to be decommissioned before the next assessment remained operational. The company I worked for had shut down their EU operations and there was no way to justify 16 hours of flight time for a two-hour data center walk through. We held meetings with the data center operator via video conference and did a virtual walk through.
- Testing required at a location is limited to documentation and interviews and no observations of processes, systems or physical environment apply.
- The entity operates a virtual environment without physical premises or facilities. This has become more and more common with entities that operate in The Cloud. Why rent expensive office space when there is not need for it? This situation only got more prevalent with the pandemic and will likely only increase in the future.
As the Council states in their guidance,
“For many assessments, a combination of onsite and remote testing may provide a suitable balance, as it allows for increased efficiencies in the assessment process while enabling an appropriate level of assurance to be achieved in the assessment result. For example, documentation reviews can often be performed remotely without significant loss of assurance, whereas observations of processes and environmental characteristics will generally require an onsite review.”
Regardless of whether the assessment fits into one of the bullets above, the Council wants QSAs to formally document their analyses of why the onsite assessment cannot be performed and the risks that may present to meeting the assessment objectives. This analysis needs to be completed prior to starting any testing and is supposed to be a joint effort between the assessor and the client.
Topics that the Council recommends be addressed include, but are not limited to:
- Confidentiality, security, and data protection requirements.
- Availability and effectiveness of the remote assessment technologies.
- Effects on entity’s personnel.
- Effects on operation support.
- Assessment scope and completeness.
- Quality and reliability of digital evidence.
The Council further states:
“During the analysis, the entity and assessor should identify any challenges and potential risks associated with the remote testing and determine whether it is feasible for testing to be thoroughly completed to produce a high level of confidence in the assessment results.
The results of the feasibility analysis—including the risks and challenges associated with use of the remote testing methods, and any mitigating controls for overcoming the risks and challenges—should be documented and agreed upon by both the entity and assessor. A copy of the feasibility analysis results should be included with the applicable ROC/ROV. Entities and assessors may be required to produce the analysis upon request by the PCI SSC or applicable compliance-accepting entity.”
The key points from that statement above is that: (1) the feasibility analysis needs to be submitted with the ROC/ROV and, (2) if requested by the PCI SSC or compliance accepting entity (i.e., Brand or bank), the QSA is required to produce the analysis. As a result, this is a non-optional exercise.
The feasibility analyses must document that:
- The assessment is feasible to be fully completed at this time using onsite methods, remote methods, or a combination of onsite and remote methods.
- The assessment is only feasible to be partially completed at this time.
- The assessment is not feasible currently.
According to the guidance, it is only those assessments that are completely feasible that can be conducted.
The Council includes a very important note regarding the analyses.
“The feasibility analysis determines whether the use of remote testing methods is feasible for a particular assessment. Determining that a remote testing method is feasible does not guarantee that use of the testing method will produce the level of assurance needed for the assessor to reach a finding; this will depend on how the remote testing method is implemented and used, whether the testing can be completed for all applicable components and areas, and whether sufficient evidence is provided for the assessor to make a determination. Assessors and entities should continue to monitor and evaluate the effectiveness of the remote testing methods throughout the assessment to confirm whether the testing methods are performing as intended and whether additional testing may be needed.”
This concept of “assurance” appears to all be in the eye of the beholder. Meaning, if the Council, Brands or Banks determine, in their opinion, that the remote methods are not providing appropriate levels of assurance, the ROC/ROV can be rejected. Not that a lot of banks are going to reject ROCs/ROVs on this, but I can see the Council’s AQM reviews and Card Brands rejecting ROCs/ROVs on analyses that they deem flawed or incomplete. The AQM process is the most concerning because a QSAC could end up in remediation due to a failure to appropriately document the remote assessment feasibility.
As with most edicts issued by the Council, they should have produced a form for this feasibility analysis so that everyone understands what is required from these feasibility analyses. Can the feasibility analysis be documented in section 1.2 of the reporting template or is a separate document required? I would recommend this for the obvious remote assessments of COVID and everything in The Cloud. I would recommend a separate document for feasibility analyses that are longer in discussion.
Sadly, I foresee a lot of confusion and heartache in the QSAC community as we move through this new requirement. That is because I see a lot of assessments that are blocked due to COVID travel restrictions or the assessed entity having no physical offices being rejected for “flawed” feasibility analyses when it should just be allowed with no further documentation or discussion.
It will take time to see how this shakes out.
UPDATE 11/29/2021 – I received a comment on this post (see below) and the confusion is beginning. A service provider has had one of their customers request the documentation regarding what is provided in Appendix A of the remote assessment guidance document as well as the remote assessment feasibility study. Since these are ROC documents, there is no requirement from the Council that requires any organization to turn over their ROC to any third party other than their acquiring bank or the card brands. The AOC is the communication document to third parties. If an organization wishes to turn over Appendix A from the guidance, that is the organization’s decision, but it is NOT mandatory nor it is required by the Council.
Hi,
This remote assessment guideline indeed is bit confusing. We are a service provider. Our assessment was conducted remotely due to Covid-19. One of our customers is now claiming that the assessment is not valid, because the ROC does not have the remote assessment appendix with it. The remote assessment procedures have been documented in the ROC section 1.2 though and it contains also feasibility analysis.
Do you know if it is now mandatory to have this appendix in our ROC or is this just optional method to document the remote assessment procedures? I do understand that the remote assessment procedures should be documented somehow, but I am fairly confident that the ROC section 1.2 fulfils this.
Thanks!
-Mike
What your customer wants is the Appendix A from the Guidance document. It is up to you as to whether or not to release that as it is part of the ROC, not part of the AOC. As a service provider (or even a merchant), you NOT required to release your ROC to anyone other than your acquiring bank or the card brands.
The Council’s guidance is that a QSA needs to document the remote assessment process in either section 1.2 or in the new document in Appendix A of the remote assessment guidance. However, nowhere in that guidance is anything stating that a customer has any right to see it.
There’s another hidden issue with this new guidance. It states that onsite assessment should be the primary method for all types of PCI assessments. However, for standards like PA-DSS, there has not been any previous requirement or expectation of performing onsite activities. The guidance effectively indicates a complete change of policy from PCI SSC there.
I have asked PCI SSC about this and the promised to consider it and return to me…
If you think about the SSF (formerly PA-DSS) it is a lab exercise like the PTS work. Under the standard, the PA-QSA tests the application, independent of the manufacturer, in their own lab and makes sure that it securely processes SAD/CHD by testing it in a heavily monitored and pristine environment. Why the need to do all of that work at the client when it is done in The Cloud or physically in the PA-QSACs facilities? It is the exception when testing is done on the client’s site and there are a whole bunch of special rules that must be followed that complicate using a client’s facilities for testing. Never mind the fact that most of these solutions are in The Cloud to begin with so it’s easy to test them in the PA-QSAC’s cloud.