Amazon Web Services MLA-C01 - AWS Certified Machine Learning Engineer - Associate

When GPU resources are limited and the hyperparameter search space is large, AWS documentation strongly recommends Bayesian optimization combined with early stopping. Bayesian optimization uses past evaluation results to intelligently select the next set of hyperparameters to test, focusing exploration on promising regions of the search space rather than testing all combinations.

In Amazon SageMaker, Bayesian optimization is the default and recommended strategy for hyperparameter tuning jobs. It significantly reduces the number of training runs required compared to grid or random search, making it highly cost-efficient for deep learning workloads.

Early stopping further improves efficiency by terminating training jobs that show poor validation performance in early epochs. This prevents wasted GPU time on configurations that are unlikely to perform well. AWS explicitly documents early stopping as a key feature for controlling training cost and duration.

Grid search and exhaustive search are computationally expensive and impractical for large hyperparameter spaces. Manual tuning is slow, error-prone, and does not scale.

By combining Bayesian optimization with early stopping, the company can rapidly converge on high-performing hyperparameter configurations while minimizing resource usage.

Therefore, Option B is the correct and AWS-aligned solution.

The described behavior—strong performance on training data but poor performance in production—is a classic sign of overfitting. AWS documentation for Amazon SageMaker Object2Vec highlights early stopping as a key regularization technique to prevent models from learning noise in the training data.

The early_stopping_patience hyperparameter controls how many additional epochs the training job will run after the validation loss stops improving. Decreasing this value causes training to stop earlier, reducing the chance that the model overfits to the training dataset.

Option B increases batch size, which may improve training efficiency but does not directly address overfitting. Option C decreases the dropout rate, which actually increases overfitting risk, since dropout is a regularization mechanism. Option D increases epochs, which further worsens overfitting.

AWS best practices emphasize early stopping combined with validation metrics as one of the most effective ways to maintain generalization performance in neural embedding models such as Object2Vec.

Therefore, Option A is the correct and AWS-aligned solution.