PECB ISO-IEC-42001-Lead-Auditor - ISO/IEC 42001:2023 Artificial Intelligence Management System Lead Auditor Exam

Question:

A multinational technology corporation has initiated an audit process to assess compliance with ISO/IEC 42001. The audit team drafted an audit schedule after the initiation of the audit.

Which aspect of the audit schedule prepared by the audit team is NOT correct?

Scenario 2 (continued):

Empsy HR Solutions is a human resources consulting company that provides innovative HR solutions to diverse industries. Recognizing the significant impact of artificial intelligence Al in HR processes, including its ability to automate repetitive tasks, analyze vast amounts of data for insights, improve recruitment and talent management strategies, and personalize employee experiences, the company has initiated the implementation of an artificial intelligence management system AIMS based on ISO/IEC 42001.

Initially, the top management established an Al policy that was aligned with the company's objectives. The Al policy provided a framework for defining Al objectives, a commitment to meeting relevant requirements, and a dedication to continually improve the AIMS. However, it

did not refer to other organizational policies, although some were relevant to the AIMS. Afterward, the top management documented the policy, communicated it internally, and made it accessible to interested parties.

The top management designated specific individuals to ensure that the AIMS meets the standard's requirements. Additionally, they ensured that these individuals were responsible for overseeing the AIMS, reporting its performance to the top management, and facilitating continual improvement. Moreover, in its awareness sessions, the company focused exclusively on ensuring that all personnel

were informed about the Al policy, emphasizing their role in ensuring the effectiveness of the AIMS and the benefits of enhanced Al performance.

The company also planned, implemented, and monitored processes to meet AIMS requirements. Additionally, it set clear criteria and implemented controls based on them, ensuring effective operation, alignment with organizational objectives, and continual improvement. Empsy HR Solutions decided to implement strict measures to control changes to documented information within the AIMS. To ensure the integrity and accuracy of documentation, the company adopted version control practices. Each document update was tracked using a versioning system, with clear records of what was modified, who made the changes, and when the updates occurred. Access to make changes was restricted to authorized personnel, and any proposed modifications required approval from the designated management team before being implemented.

Moreover, considering past experiences where the company encountered unforeseen risks, Empsy HR Solutions established a comprehensive Al risk assessment process. This process involved identifying, analyzing, and evaluating Al risks to determine if it is necessary to implement additional controls than those specified in Annex A. The company also referred to Annex B for guidance on implementing controls and, ultimately, produced a Statement of Applicability So A. The SoA contained the necessary controls, including all the controls of Annex A and justifications for their inclusion or exclusion.

Lastly. Empsy HR Solutions decided to establish an internal audit program to ensure the AIMS conforms to both the company's requirements and ISO/IEC 42001. It defined the audit objectives, criteria, and scope for each audit, selected auditors, and ensured objectivity and impartiality during the audit process. The results of the first audit were documented and reported only to the top

management of the company.

Question:

Based on Scenario 2, has Empsy HR Solutions established a suitable internal audit program?

Did the audit team leader thoroughly review all essential components before deciding to close the nonconformity? Refer to scenario 9.

Scenario 9: ImoAl, headquartered in California. USA, provides Al solutions for various industries such as finance, healthcare, retail, and manufacturing. Its clients

include major financial institutions seeking Al powered fraud detection systems, healthcare providers leveraging Al for diagnostics and patient care, retailers

optimizing supply chain management with Al forecasting, and manufacturers enhancing production efficiency through Al-driven automation.

ImoAl has recently undergone a certification audit to ensure that its artificial intelligence management system AIMS is in compliance with ISO/IEC 42001. During the

audit, a major nonconformity related to data security protocols was identified, requiring urgent resolution. ImoAl swiftly initiated corrective actions to address the

major nonconformity. The audit follow-up, in agreement with the auditee, was scheduled six weeks after the initial audit. As part of exploring alternatives to audit

follow-up, the audit team leader chose to verify the effectiveness of the actions taken by the auditee by scheduling a specific visit to ImoAI's premises.

The follow-up audit involved a thorough evaluation of the effectiveness of these actions. The audit team leader thoroughly examined the corrections, corrective actions,

and root cause analysis conducted by ImoAl to assess whether they adequately addressed the nonconformity identified during the initial audit.

In conjunction with the external audit follow-up, ImoAl engaged its internal auditing team to oversee the progress of corrective actions. The AIMS manager of ImoAl

updated Ms. Rebecca Hayes, the internal auditor, on the status of corrections and corrective actions prompted by the nonconformity identified during the external

audit. Subsequently, Ms. Hayes thoroughly reviewed these measures, analyzing the corrections, root causes, and effectiveness of the implemented actions.

Upon satisfactory validation of the action plans, ImoAl was recommended for certification.

Question:

What is a significant drawback of using judgment-based sampling in audits?

Auditors use the ______ as a benchmark to determine conformity.

Question:

While auditing a company’s AIMS, the audit team reviewed policies, objectives, and communications to evaluate the involvement of top management. They also conducted interviews with staff to assess the engagement of leaders at various levels in ensuring the system’s effectiveness.

Based on this approach, what level of management should the auditors prioritize when assessing leadership and commitment?

At which stage of the audit process is materiality assessed and determined?

Scenario 6 (continued):

Scenario 6: HappilyAI is a pioneering enterprise dedicated to developing and deploying artificial intelligence Al solutions tailored to enhance customer service experiences across various industries. The company offers innovative products like virtual assistants, predictive analytics tools, and personalized customer interaction platforms. As part of its commitment to operational excellence and innovation, HappilyAI has implemented a robust Al management system AIMS to oversee its Al operations effectively. Currently. HappilyAI is undergoing a comprehensive audit process of its AIMS to evaluate its compliance with ISO/IEC 42001.

Under the leadership of Jess, the audit team began the audit process with meticulous planning and coordination, setting the groundwork for the extensive on-site activities of the stage 1 audit. This initial phase was marked by a comprehensive documentation review. The audit scope encompassed a critical review of HappilyAI's core departments, including Research and Development (R&D), Customer Service, and Data Security, aiming to assess the conformity of HappilyAI's AIMS to the requirements of ISO/IEC 42001.

Afterward, Jess and the team conducted a formal opening meeting with HappilyAI to introduce the audit team and outline the audit activities. The meeting set a collaborative tone for the subsequent phases, where the team engaged in information collection, executed audit tests, identified findings, and prepared draft nonconformity reports while maintaining a strict quality review process.

In gathering evidence, the audit team employed a sampling method, which involved dividing the population into homogeneous groups to ensure a comprehensive and representative data collection by drawing samples from each segment. Furthermore, the team employed observation to deepen their understanding of the Al management processes. They verified the availability of essential documentation, including Al-related policies, and evaluated the communication channels established for reporting incidents.

Additionally, they scrutinized specific monitoring tools designed to track the performance of data acquisition processes, ensuring these tools effectively identify and respond to errors or anomalies. However, a notable challenge emerged as the team encountered a lack of access to documented information that describes how tasks about AIMS are executed. In addition to this, the team identified a potential nonconformity within the Sales Department. They decided not to record this as a nonconformity in the audit report but only communicated it to the HappilyAI's representatives.

During the stage 2 audit, the certification body, in collaboration with HappilyAI, assigned the roles of technical experts within the audit team. Recognized for their specialized knowledge and expertise in artificial intelligence and its applications, these technical experts are tasked with the thorough assessment of the AIMS framework to ensure its alignment with industry standards and best practices, focusing on areas such as data ethics, algorithmic transparency, and Al system security.

Question:

Which observation types did the audit team use to enhance their understanding of the AI management processes?

Scenario 2: OptiFlow is a logistics company located in New Delhi, India. The company has enhanced its operational efficiency and customer service by integrating AI across various domains, including route optimization, inventory management, and customer support. Recognizing the importance of AI in its operations, OptiFlow decided to implement an Artificial Intelligence Management System (AIMS) based on ISO/IEC 42001 to oversee and optimize the use of AI technologies.

To address Clauses 4.1 and 4.2 of the standard, OptiFlow identified and analyzed internal and external issues and needs and expectations of interested parties. During this phase, it identified specific risks and opportunities related to AI deployment, considering the system's domain, application context, intended use, and internal and external environments. Central to this initiative was the establishment and maintenance of AI risk criteria, a foundational step that facilitated comprehensive AI risk assessments, effective risk treatment strategies, and precise evaluations of risk impacts. This implementation aimed to meet AIMS’s objectives, minimize adverse effects, and promote continuous improvement. OptiFlow also planned and integrated strategies to address risks and opportunities into AIMS’s processes and assessed their effectiveness.

OptiFlow set measurable AI objectives aligned with its AI policy across all organizational levels, ensuring they met applicable requirements and matched the company’s vision. The company placed strong emphasis on the monitoring and communication of these objectives, ensuring they were updated annually or as needed to reflect changes in technology, market demands, or internal processes. It also documented the objectives, making them accessible across the company.

To guarantee a structured and consistent AI risk assessment process, OptiFlow emphasized alignment with its AI policy and objectives. The process included ensuring consistency and comparability, identifying, analyzing, and evaluating AI risks.

OptiFlow prioritizes its AIMS by allocating the necessary resources for its comprehensive development and continuous enhancement. The company carefully defines the competencies needed for personnel affecting AI performance, ensuring a high level of expertise and innovation.

OptiFlow also manages effective internal and external communications about its AIMS, aligning with ISO/IEC 42001 requirements by maintaining and controlling all required documented information. This documentation is meticulously identified, described, and updated to ensure its relevance and accessibility. Through these strategic efforts, OptiFlow upholds a commitment to excellence and leadership in AI management practices.

To comply with Clause 9 of ISO/IEC 42001, the company determined what needs to be monitored and measured in the AIMS. It planned, established, implemented, and maintained an audit program, reviewed the AIMS at planned intervals, documented review results, and initiated a continuous feedback mechanism from all interested parties to identify areas of improvement and innovation within the AIMS

Which of OptiFlow’s implemented requirements is NOT included in Clause 9 (Performance Evaluation) of ISO/IEC 42001? Refer to Scenario 2.

Why is it important to have a clear and agreed audit scope?