Skip to content
Advertisement

Tag: apache-kafka-connect

Confused with encoding and decoding with Kafka connect

Here’s a high-level view of my pipeline: MQTT -> Kafka/MQTT bridge [producer] -> Kafka connect -> AWS Kinesis data stream -> Lambda function (decode Kinesis.record.data) -> store DynamoDB Basically, the full flow is working properly but I’m getting a weird “json” format when I’m trying to read the kinesis.record.data. It isn’t utf8. It includes utf8-encoded quoted-string-encoded-JSON records separated by a

Advertisement