Skip to content Skip to sidebar Skip to footer
Showing posts with the label Apache Kafka
Not Able To Access Messages From Confluent Kafka On Ec2

Not Able To Access Messages From Confluent Kafka On Ec2

Post a Comment
Confluent Kafka 5.0.0 has been installed on AWS EC2 which has Public IP say 54.XX.XX.XX Opened port… Read more Not Able To Access Messages From Confluent Kafka On Ec2
Spark Streaming: Read Csv String From Kafka, Write To Parquet

Spark Streaming: Read Csv String From Kafka, Write To Parquet

Post a Comment
There are lots of online examples of reading json from Kafka (to write to parquet) - but I cannot f… Read more Spark Streaming: Read Csv String From Kafka, Write To Parquet
Kafka Consumer Losing State Of Messages After Shutdown

Kafka Consumer Losing State Of Messages After Shutdown

Post a Comment
Thanks for taking time to answer the question. I am using kafka with a python consumer. Everything … Read more Kafka Consumer Losing State Of Messages After Shutdown
How To Connect Python Consumer To Aws Msk

How To Connect Python Consumer To Aws Msk

Post a Comment
I'm trying to connect my python consumer to AWS MSK cluster. how can I do that? Have an AWS MSK… Read more How To Connect Python Consumer To Aws Msk
Kafka-python Consumer Start Reading From Offset (automatically)

Kafka-python Consumer Start Reading From Offset (automatically)

Post a Comment
I'm trying to build an application with kafka-python where a consumer reads data from a range o… Read more Kafka-python Consumer Start Reading From Offset (automatically)
Adding Custom Jars To Pyspark In Jupyter Notebook

Adding Custom Jars To Pyspark In Jupyter Notebook

Post a Comment
I am using the Jupyter notebook with Pyspark with the following docker image: Jupyter all-spark-not… Read more Adding Custom Jars To Pyspark In Jupyter Notebook