These topics can help you with Structured Streaming and Spark Streaming (the legacy Spark streaming feature).
- Streaming with File Sink: Problems with Recovery if you Change Checkpoint or Output Directories
- How to Set up Apache Kafka on Databricks
- Handling Partition Column Values While Using an SQS Queue as a Streaming Source
- How to Restart a Structured Streaming Query From Last Written Offset
- How to Switch a SNS Streaming Job to a New SQS Queue