Summer Sale Limited Time 65% Discount Offer - Ends in 0d 00h 00m 00s - Coupon code: ecus65

Isaca AAIA - ISACA Advanced in AI Audit (AAIA)

Page: 1 / 3
Total 90 questions

When utilizing a machine learning (ML) model to predict whether a wind turbine electricity generator will fail, which model evaluation metric should be the PRIMARY focus?

A.

Precision

B.

Specificity

C.

Accuracy

D.

Recall

An IS auditor is evaluating an organization's incident management program to ensure it is sufficiently prepared to manage AI-related incidents. Which of the following is MOST important for the auditor to validate?

A.

The program mandates retraining AI systems after incidents are investigated.

B.

The program uses past AI-related incidents and resolutions to categorize current incidents.

C.

The program includes processes to respond to AI model drift and data integrity attacks.

D.

The program prioritizes incidents based on alignment with industry leading practices.

Which of the following strategies used by modelers to enhance data accuracy has the GREATEST risk of bias and information loss?

A.

Filling blank attributes in records with the mean, median, or mode within a grouping

B.

Identifying and deleting duplicate entries in the data set

C.

Separating multiple data attributes within one field into individual attribute columns

D.

Placing numerical data into bins or buckets for a manageable quantity of correlations and result analyses

Which of the following controls helps mitigate the risk of competitors poisoning data utilized by a machine learning (ML) model performing sentiment analysis of product reviews?

A.

Peer reviewing code that acquires product reviews from social media posts

B.

Hiring a marketing firm to text links to customers requesting product reviews for monetary compensation

C.

Augmenting the unbalanced product review data set with the use of oversampling by the model developer

D.

Requiring customers to authenticate access to their accounts prior to writing product reviews

A car manufacturer uses an AI model to predict maintenance needs for its vehicles. Which of the following techniques can an IS auditor apply to MOST effectively verify the AI model's decisions to stakeholders?

A.

Using neural network visualization to show how the AI model processes data through its layers

B.

Using K-means algorithms to group vehicles based on mileage or engine temperature for maintenance patterns

C.

Utilizing support vector machines (SVM) to classify vehicles based on maintenance urgency

D.

Using local interpretable model-agnostic explanation (LIME) to analyze how specific features contribute to predictions

Which of the following is MOST important to review in order to gain assurance that an AI model is performing without biases?

A.

AI training data

B.

AI development environment

C.

AI model adaptability

D.

AI model temperature

An IS auditor is auditing an organization’s data governance framework. The primary objective is to provide assurance that data management practices are standardized to support a trustworthy AI system. Which of the following should be the auditor's MOST important consideration?

A.

Retention of stored data

B.

Portability of data

C.

Data practices for training models

D.

Accountability for data management

The BEST way to prevent sensitive information disclosure by large language model (LLM) chatbots is through:

A.

Manual monitoring

B.

Access controls

C.

Data sanitization

D.

Data masking

A retail organization uses an AI model to analyze customers' purchase history in order to offer personalized discounts. Which of the following practices represents the MOST ethical use of customer data?

A.

Utilizing customer purchase data only after obtaining explicit consent and allowing customers to opt out

B.

Retaining and analyzing all available customer data to ensure unbiased recommendations

C.

Providing the public with access to review and audit the data set of collected customer information

D.

Sharing customer purchase data with third-party vendors to improve advertising and communication

An IS auditor is auditing a financial system in which a generative AI tool is used to identify trends in batches of 4,000 rows, while the generative AI tool has a limit of 3,000 tokens. Which of the following is the GREATEST concern?

A.

The AI will process only a portion of the data set.

B.

The AI will prioritize high-value entries.

C.

The AI will reject the data set and not analyze the data.

D.

The AI output will be biased toward the first 3,000 tokens.