Here’s a high-level view of my pipeline: MQTT -> Kafka/MQTT bridge [producer] -> Kafka connect -> AWS Kinesis data stream -> Lambda function (decode Kinesis.record.data) -> store DynamoDB Basically, the full flow is working properly but I’m getting a weird “json” format when I’m trying to read the kinesis.record.data. It isn’t utf8. It includes utf8-encoded quoted-string-encoded-JSON records separated by a
Tag: amazon-kinesis
Terraform: Validation error … Member must satisfy regular expression pattern: arn:aws:iam::
I’m trying to stream rds through kinesis data stream but it is giving me this error: botocore.exceptions.ClientError: An error occurred (ValidationException) when calling the PutRecord operation: 1 validation error detected: Value ‘arn:aws:kinesis:us-west-2:xxxxxxxxxx:stream/rds-temp-leads-stream’ at ‘streamName’ failed to satisfy constraint: Member must satisfy regular expression pattern: [a-zA-Z0-9_.-]+ What can I do to fix this? Answer remove ‘arn:aws:kinesis:us-west-2:xxxxxxxxxx:stream/rds-temp-leads-stream’ this from stream name. Just