Skip to content Skip to sidebar Skip to footer
Showing posts with the label Apache Kafka
Not Able To Access Messages From Confluent Kafka On Ec2

Not Able To Access Messages From Confluent Kafka On Ec2

Post a Comment
Confluent Kafka 5.0.0 has been installed on AWS EC2 which has Public IP say 54.XX.XX.XX Opened port… Read more Not Able To Access Messages From Confluent Kafka On Ec2
Spark Streaming: Read Csv String From Kafka, Write To Parquet

Spark Streaming: Read Csv String From Kafka, Write To Parquet

Post a Comment
There are lots of online examples of reading json from Kafka (to write to parquet) - but I cannot f… Read more Spark Streaming: Read Csv String From Kafka, Write To Parquet
Kafka Consumer Losing State Of Messages After Shutdown

Kafka Consumer Losing State Of Messages After Shutdown

Post a Comment
Thanks for taking time to answer the question. I am using kafka with a python consumer. Everything … Read more Kafka Consumer Losing State Of Messages After Shutdown
How To Connect Python Consumer To Aws Msk

How To Connect Python Consumer To Aws Msk

Post a Comment
I'm trying to connect my python consumer to AWS MSK cluster. how can I do that? Have an AWS MSK… Read more How To Connect Python Consumer To Aws Msk
Kafka-python Consumer Start Reading From Offset (automatically)

Kafka-python Consumer Start Reading From Offset (automatically)

Post a Comment
I'm trying to build an application with kafka-python where a consumer reads data from a range o… Read more Kafka-python Consumer Start Reading From Offset (automatically)
Adding Custom Jars To Pyspark In Jupyter Notebook

Adding Custom Jars To Pyspark In Jupyter Notebook

Post a Comment
I am using the Jupyter notebook with Pyspark with the following docker image: Jupyter all-spark-not… Read more Adding Custom Jars To Pyspark In Jupyter Notebook
Pyspark Structured Streaming From Kafka Does Not Output To Console For Debugging

Pyspark Structured Streaming From Kafka Does Not Output To Console For Debugging

Post a Comment
Below is my code. I have tried many different select variations, and yet the app runs, but without … Read more Pyspark Structured Streaming From Kafka Does Not Output To Console For Debugging
How To Produce A Tombstone Avro Record In Kafka Using Python?

How To Produce A Tombstone Avro Record In Kafka Using Python?

Post a Comment
my sink properties : { 'name': 'jdbc-oracle', 'config': { 'conn… Read more How To Produce A Tombstone Avro Record In Kafka Using Python?
Apache Flink: Kafka Connector In Python Streaming Api, "cannot Load User Class"

Apache Flink: Kafka Connector In Python Streaming Api, "cannot Load User Class"

Post a Comment
I am trying out Flink's new Python streaming API and attempting to run my script with ./flink-1… Read more Apache Flink: Kafka Connector In Python Streaming Api, "cannot Load User Class"
Kafka Replays Messages Over And Over - Heartbeat Session Expired - Marking Coordinator Dead

Kafka Replays Messages Over And Over - Heartbeat Session Expired - Marking Coordinator Dead

Post a Comment
Using python kafka api to read messages from a topic with only a handful of messages in it. Kafka k… Read more Kafka Replays Messages Over And Over - Heartbeat Session Expired - Marking Coordinator Dead
Kafka Replays Messages Over And Over - Heartbeat Session Expired - Marking Coordinator Dead

Kafka Replays Messages Over And Over - Heartbeat Session Expired - Marking Coordinator Dead

Post a Comment
Using python kafka api to read messages from a topic with only a handful of messages in it. Kafka k… Read more Kafka Replays Messages Over And Over - Heartbeat Session Expired - Marking Coordinator Dead
Apache Flink: Kafka Connector In Python Streaming API, "Cannot Load User Class"

Apache Flink: Kafka Connector In Python Streaming API, "Cannot Load User Class"

Post a Comment
I am trying out Flink's new Python streaming API and attempting to run my script with ./flink-1… Read more Apache Flink: Kafka Connector In Python Streaming API, "Cannot Load User Class"