Questions
Linux
Laravel
Mysql
Ubuntu
Git
Menu
HTML
CSS
JAVASCRIPT
SQL
PYTHON
PHP
BOOTSTRAP
JAVA
JQUERY
R
React
Kotlin
×
Linux
Laravel
Mysql
Ubuntu
Git
New posts in spark-structured-streaming
How to handle bad messages in spark structured streaming
Sep 21, 2025
apache-spark
apache-kafka
error-handling
spark-structured-streaming
How structured streaming dynamically parses kafka's json data
Sep 20, 2025
json
apache-spark
spark-structured-streaming
Mixing Spark Structured Streaming API and DStream to write to Kafka
Sep 19, 2025
apache-spark
spark-streaming
spark-structured-streaming
Structured Streaming error py4j.protocol.Py4JNetworkError: Answer from Java side is empty
Sep 18, 2025
apache-spark
pyspark
apache-kafka
spark-structured-streaming
Convert Spark Structure Streaming DataFrames to Pandas DataFrame
Sep 15, 2025
python
pandas
apache-spark
pyspark
spark-structured-streaming
TypeError: Object of type StructField is not JSON serializable
Sep 14, 2025
pyspark
databricks
spark-structured-streaming
azure-eventhub
Read data from Kafka and print to console with Spark Structured Sreaming in Python
Sep 13, 2025
apache-spark
pyspark
apache-kafka
apache-spark-sql
spark-structured-streaming
How to avoid empty files while writing parquet files?
Sep 13, 2025
apache-spark
pyspark
spark-structured-streaming
Shutdown spark structured streaming gracefully
Sep 13, 2025
apache-spark
apache-spark-sql
spark-streaming
spark-structured-streaming
How to write stream to S3 with year, month and day of the day when records were received?
Sep 09, 2025
scala
apache-spark
spark-structured-streaming
spark structured streaming: not writing correctly
Sep 05, 2025
python
apache-spark
spark-structured-streaming
How to use from_json standard function (in select) in streaming query?
Sep 05, 2025
java
json
apache-spark
apache-spark-sql
spark-structured-streaming
Spark structured streaming query always starts with auto.offset.rest=earliest even though auto.offset.reset=latest is set
Mar 08, 2023
scala
apache-spark
kafka-consumer-api
spark-structured-streaming
Spark-Streaming hangs with kafka starting offset at earliest (Kafka 2, spark 2.4.3)
Mar 05, 2023
apache-spark
apache-kafka
kafka-consumer-api
spark-structured-streaming
Structured Streaming exception: Append output mode not supported for streaming aggregations
Jan 31, 2023
scala
apache-spark
spark-structured-streaming
How to use a external trigger to stop structured streaming query?
Jan 26, 2023
apache-spark
spark-structured-streaming
Kafka Structured Streaming checkpoint
Jan 05, 2023
hadoop
pyspark
spark-structured-streaming
How pass Basic Authentication to Confluent Schema Registry?
Jan 03, 2023
apache-spark
databricks
spark-structured-streaming
confluent-platform
confluent-schema-registry
How to change the location of _spark_metadata directory?
Dec 25, 2022
apache-spark
amazon-s3
parquet
spark-structured-streaming
TypeError: 'Builder' object is not callable Spark structured streaming
Dec 16, 2022
apache-spark
apache-spark-sql
spark-structured-streaming
Older Entries »