Amazon Web Services AIF-C01 - AWS Certified AI Practitioner Exam

ï‚· Block input prompts or model responses that contain harmful content such as hate, insults, violence, or misconduct:Content filters

ï‚· Avoid subjects related to illegal investment advice or legal advice:Denied topics

ï‚· Detect and block specific offensive terms:Word filters

 Detect and filter out information in the model’s responses that is not grounded in the provided source information:Contextual grounding check

The company is using a generative AI model on Amazon Bedrock and needs to mitigate undesirable and potentially harmful content in the model’s responses. Amazon Bedrock provides several guardrail mechanisms, including content filters, denied topics, word filters, and contextual grounding checks, to ensure safe and accurate outputs. Each mitigation action in the hotspot aligns with a specific Bedrock filter policy, and each policy must be used exactly once.

Exact Extract from AWS AI Documents:

From the AWS Bedrock User Guide:

*"Amazon Bedrock guardrails provide mechanisms to control model outputs, including:

Content filters: Block harmful content such as hate speech, violence, or misconduct.

Denied topics: Prevent the model from generating responses on specific subjects, such as illegal activities or advice.

Word filters: Detect and block specific offensive or inappropriate terms.

Contextual grounding check: Ensure responses are grounded in the provided source information, filtering out ungrounded or hallucinated content."*(Source: AWS Bedrock User Guide, Guardrails for Responsible AI)

Detailed Explanation:

Block input prompts or model responses that contain harmful content such as hate, insults, violence, or misconduct: Content filtersContent filters in Amazon Bedrock are designed to detect and block harmful content, such as hate speech, insults, violence, or misconduct, ensuring the model’s outputs are safe and appropriate. This matches the first mitigation action.

Avoid subjects related to illegal investment advice or legal advice: Denied topicsDenied topics allow users to specify subjects the model should avoid, such as illegal investment advice or legal advice, which could have regulatory implications. This policy aligns with the second mitigation action.

Detect and block specific offensive terms: Word filtersWord filters enable the detection and blocking of specific offensive or inappropriate terms defined by the user, making them ideal for this mitigation action focused on specific terms.

Detect and filter out information in the model’s responses that is not grounded in the provided source information: Contextual grounding checkThe contextual grounding check ensures that the model’s responses are based on the provided source information, filtering out ungrounded or hallucinated content. This matches the fourth mitigation action.

Hotspot Selection Analysis:

The hotspot lists four mitigation actions, each with the same dropdown options: "Select...," "Content filters," "Contextual grounding check," "Denied topics," and "Word filters." The correct selections are:

First action: Content filters

Second action: Denied topics

Third action: Word filters

Fourth action: Contextual grounding check

Each filter policy is used exactly once, as required, and aligns with Amazon Bedrock’s guardrail capabilities.

Amazon SageMaker Clarify provides built-in tools to detect bias in data and models, and to generate detailed explainability reports for model predictions, including SHAP values and feature importance.

A is correct:

“Amazon SageMaker Clarify provides bias detection, explainability for ML models, and comprehensive reports to satisfy regulatory and ethical requirements.”

(Reference: Amazon SageMaker Clarify Overview)

B (Data Wrangler) is for data preparation, not bias/explainability.

C (Model Cards) document models, but don’t detect bias or explain predictions.

D (AI Service Cards) provide transparency for AWS AI services, not custom model explainability.

The company is building a chatbot using an LLM on Amazon Bedrock, and the chatbot needs to use content from previous customer messages to resolve requests. Adding previous messages to the model prompt (also known as providing conversation history) enables the LLM to maintain context across interactions, allowing it to respond coherently based on the ongoing conversation.

Exact Extract from AWS AI Documents:

From the AWS Bedrock User Guide:

"To enable a large language model (LLM) to maintain context in a conversation, you can include previous messages in the model prompt. This approach, often referred to as providing conversation history, allows the LLM to generate responses that are contextually relevant toprior interactions."

(Source: AWS Bedrock User Guide, Building Conversational Applications)

Detailed Explanation:

Option A: Turn on model invocation logging to collect messages.Model invocation logging records interactions for auditing or debugging but does not provide the LLM with access to previous messages during inference to maintain conversation context.

Option B: Add messages to the model prompt.This is the correct answer. Including previous messages in the prompt gives the LLM the conversation history it needs to respond appropriately, a common practice for chatbots on Amazon Bedrock.

Option C: Use Amazon Personalize to save conversation history.Amazon Personalize is for building recommendation systems, not for managing conversation history in a chatbot. This option is irrelevant.

Option D: Use Provisioned Throughput for the LLM.Provisioned Throughput in Amazon Bedrock ensures consistent performance for model inference but does not address the need to use previous messages in the conversation.

Amazon SageMaker Ground Truth is designed to support human evaluation and labeling workflows using both internal teams and external workforces. AWS documentation states that Ground Truth enables organizations to build high-quality labeled datasets and conduct human reviews using private workforces, vendor-managed workforces, or third-party providers.

In this scenario, the company needs to evaluate toxicity in foundation model outputs, which requires nuanced human judgment. AWS highlights that Ground Truth supports tasks such as content moderation, sentiment analysis, and safety evaluation, making it well suited for assessing harmful or toxic content generated by models.

Ground Truth provides managed tooling for task distribution, reviewer instructions, quality control, and auditability. It allows companies to seamlessly scale operations by combining internal reviewers for sensitive data with external reviewers for higher-volume workloads, while maintaining consistent review standards.

The other options do not meet the requirement. Amazon Bedrock Agents orchestrate interactions with foundation models but do not manage human review workflows. Amazon Comprehend Custom focuses on training NLP models, not evaluating FM outputs. Amazon SageMaker JumpStart provides pretrained models and solutions, not human evaluation pipelines.

AWS positions SageMaker Ground Truth as a core service for human-in-the-loop machine learning and responsible AI, making it the correct choice for toxicity evaluation using both internal and external reviewers.

Amazon Transcribe is the correct solution for converting audio from customer calls into text, allowing the company to analyze and extract key information from the conversations.

Amazon Transcribe:

It is a fully managed automatic speech recognition (ASR) service that converts speech into text, making it easier to perform text-based analysis on audio data.

After transcribing the audio, further analysis can be performed using other AWS services like Amazon Comprehend to extract insights such as sentiment, key phrases, or entities.

Why Option B is Correct:

Conversion to Text: Transcribing audio recordings is the first step in gaining insights from spoken conversations, allowing for further processing.

Enables Further Analysis: Once the audio is transcribed into text, other tools and services can be used to analyze the content more deeply.

Why Other Options are Incorrect:

A. Amazon Lex: Is used for building conversational interfaces, not for transcribing or analyzing audio from customer calls.

C. Amazon SageMaker Model Monitor: Monitors ML models for bias and data drift, not for audio analysis.

D. Amazon Comprehend: Can analyze text but cannot transcribe audio; it would be used after transcription is completed.

Generative Pre-trained Transformers (GPT) are suitable for building an AI-based application that can generate SQL queries from natural language input provided by employees.

GPT for Natural Language Processing:

GPT models are designed for understanding and generating human-like text based on natural language input.

They can be fine-tuned to interpret specific tasks, such as converting natural language queries into SQL queries.

Why Option A is Correct:

Natural Language Understanding: GPT is highly effective for tasks that require understanding of human language and generating structured outputs like SQL.

User-Friendly: Requires minimal technology experience from employees, as they provide simple text input.

Why Other Options are Incorrect:

B. Residual neural network: Typically used in computer vision tasks, not for natural language-to-SQL conversion.

C. Support vector machine: Used for classification tasks, not for generating structured queries from text.

D. WaveNet: A deep generative model for audio data, unrelated to text-to-SQL tasks.

The ecommerce company’s chatbot, powered by AI, automates customer order submissions and is accessible 24/7 via the website. Prompt injection is an AI system input vulnerability where malicious users craft inputs to manipulate the chatbot’s behavior, such as bypassing safeguards or accessing unauthorized information. This vulnerability must be resolved before the chatbot is made available to ensure security.

Exact Extract from AWS AI Documents:

From the AWS Bedrock User Guide:

"Prompt injection is a vulnerability in AI systems, particularly chatbots, where malicious inputs can manipulate the model’s behavior, potentially leading to unauthorized actions or harmful outputs. Implementing guardrails and input validation can mitigate this risk."

(Source: AWS Bedrock User Guide, Security Best Practices)

Detailed Explanation:

Option A: Data leakageData leakage refers to the unintended exposure of sensitive data during model training or inference, not an input vulnerability affecting a chatbot’s operation.

Option B: Prompt injectionThis is the correct answer. Prompt injection is a critical input vulnerability for chatbots, where malicious prompts can exploit the AI to produce harmful or unauthorized responses, a risk that must be addressed before launch.

Option C: Large language model (LLM) hallucinationsLLM hallucinations refer to the model generating incorrect or ungrounded responses, which is an output issue, not an input vulnerability.

Option D: Concept driftConcept drift occurs when the data distribution changes over time, affecting model performance. It is not an input vulnerability but a long-term performance issue.

Retrieval-Augmented Generation (RAG) integrates external knowledge sources (databases, vector stores, document repositories) with LLMs, enabling them to generate contextually accurate and up-to-date responses without retraining.

B is incorrect: RAG does not speed up training; it improves inference results.

C is incorrect: speech recognition is not an RAG use case.

D is incorrect: computer vision augmentation is unrelated to RAG.

📖 Reference:

AWS Documentation – Knowledge Bases for RAG in Amazon Bedrock

A summarization chatbot is ideal for extracting key points from legal documents. Large language models (LLMs) can be used to summarize complex texts, such as legal documents, making them more accessible and understandable.

Option C (Correct): "Develop a summarization chatbot": This is the correct answer because a summarization chatbot uses LLMs to condense and extract key information from text, which is precisely the requirement for reading and summarizing legal documents.

Option A: "Build an automatic named entity recognition system" is incorrect because it focuses on identifying specific entities, not summarizing documents.

Option B: "Create a recommendation engine" is incorrect as it is used to suggest products or content, not summarize text.

Option D: "Develop a multi-language translation system" is incorrect because translation is unrelated to summarizing text.

AWS AI Practitioner References:

Using LLMs for Text Summarization on AWS: AWS supports developing summarization tools using its AI services, including Amazon Bedrock.

Amazon Bedrock offers an on-demand pricing model that provides flexibility without long-term commitments. This model allows companies to pay only for the resources they use, which is ideal for a limited budget and offers flexibility.

Option A (Correct): "On-Demand": This is the correct answer because on-demand pricing allows the company to use Amazon Bedrock without any long-term commitments and to manage costs according to their budget.

Option B: "Model customization" is a feature, not a pricing model.

Option C: "Provisioned Throughput" involves reserving capacity ahead of time, which might not offer the desired flexibility and could lead to higher costs if the capacity is not fully used.

Option D: "Spot Instance" is a pricing model for EC2 instances and does not apply to Amazon Bedrock.

AWS AI Practitioner References:

AWS Pricing Models for Flexibility: On-demand pricing is a key AWS model for services that require flexibility and no long-term commitment, ensuring cost-effectiveness for projects with variable usage patterns.