Confluent CCDAK - Confluent Certified Developer for Apache Kafka Certification Examination

The Apache Kafka documentation states that consumer offsets are stored per consumer group and must be explicitly reset if an application needs to reprocess data from an earlier position. The officially supported and safest way to reset offsets for an existing consumer group is by using the kafka-consumer-groups CLI tool with the --reset-offsets option and the --to-earliest flag.

Setting auto.offset.reset=earliest (Option D) only applies when no committed offset exists for a partition. Since this consumer is already running in production, offsets are already committed, making this option ineffective. Option C does not change offsets because Kafka identifies consumers by group ID, not application instance. Option B is extremely dangerous and incorrect, as setting retention.ms=0 deletes data for all consumers and impacts other applications.

Therefore, using the CLI to reset offsets for the specific consumer group ensures controlled, auditable, and targeted offset management without affecting other consumers or the topic itself. This approach is explicitly documented in Kafka’s consumer group administration tools.

=========================

For proper delivery handling with acks=all:

Use callback to log or act on success/failure.

Use try/catch to handle synchronous exceptions like serialization errors or network failures.

From Kafka Producer Documentation:

“Errors can be caught either via the returned Future or via the callback interface. For fatal errors, use a try/catch block around the send call.”

Option B is incorrect because send() returns a Future, not RecordMetadata directly.

Option D is invalid — ProducerRecord has no method called status().

According to the official Apache Kafka consumer documentation, the auto.offset.reset configuration is only applied when a consumer has no valid committed offset for a partition. In this scenario, the consumer last committed offset 217, but the topic’s earliest available offset is now 318. This means the previously committed offset is out of range, most likely due to topic retention cleanup.

When a committed offset is out of range, Kafka treats it as invalid and applies the auto.offset.reset policy. Since the consumer is configured with auto.offset.reset=latest, it will start reading from the end of the log, not from the earliest available offset.

Kafka defines the “latest” offset as the log end offset, which is the offset of the next message to be written. Given that the topic’s offsets end at 588, the next offset is 589.

Therefore, the consumer will start reading from offset 589, skipping all existing records in the topic, which aligns with the documented Kafka consumer behavior.

=========================

The batch.size config sets the maximum number of bytes to batch per partition before sending. This allows Kafka producers to amortize I/O and improve throughput.

From Kafka Producer Configuration Docs:

“batch.size is the maximum amount of data per partition the producer will batch before sending.”

buffer.memory sets total memory for the producer, not per-batch.

send.buffer.bytes is a TCP socket buffer, not a Kafka config.

max.block.ms controls blocking time, not size.

Table → Product, Customers

Stream → Orders_Placed, Shipment_Of_Orders

Tables represent slowly changing, reference data — e.g., customer profiles, product info.

Streams represent real-time event data — e.g., orders placed, shipments processed.

From Kafka Streams Documentation:

“Use KTable for reference datasets, and KStream for event-based processing such as orders or logs.”

fetch-rate: Measures how frequently consumers fetch data — critical for monitoring throughput.

incoming-byte-rate: Shows how much data is being written to the broker per second — a key producer-side metric.

From Kafka JMX Metrics Guide:

“fetch-rate, incoming-byte-rate, request-latency are key performance metrics for producers and consumers.”

B, C, E, and F are application-layer business metrics, not Kafka performance metrics.

RetriableException is a subclass of KafkaException, indicating transient issues that might succeed if retried. Examples include:

LeaderNotAvailableException: Happens when metadata is not yet propagated or leader election is in progress.

NotEnoughReplicasException: Happens when the number of in-sync replicas is insufficient. This can be transient if replicas come back online.

From the Apache Kafka Java Client documentation:

"These exceptions (like LeaderNotAvailableException, NotEnoughReplicasException) are transient and the client will retry them automatically depending on retry configuration."

RecordTooLargeException and AuthorizationException are non-retriable as they indicate client-side or permission errors.