PySpark on Arjun Sajeevanhttps://arjunsajeevan.com/tags/pyspark/Recent content in PySpark on Arjun SajeevanHugo -- 0.156.0en-usThu, 26 Feb 2026 00:00:00 +0000PySpark DataFrames vs. Spark SQL: Which One Should You Use?https://arjunsajeevan.com/posts/spark-api-vs-sql/Thu, 26 Feb 2026 00:00:00 +0000https://arjunsajeevan.com/posts/spark-api-vs-sql/A deep dive into performance, dynamic queries, and reusability to help you choose the right tool for your Spark pipelines.Real-Time Streaming Analytics: Kafka & PySparkhttps://arjunsajeevan.com/projects/streaming-analytics/Sun, 22 Feb 2026 00:00:00 +0000https://arjunsajeevan.com/projects/streaming-analytics/A deep dive into building an event-driven data pipeline using Python, Docker, Apache Kafka, and PySpark Structured Streaming.