Big Data on Arjun Sajeevanhttps://arjunsajeevan.com/tags/big-data/Recent content in Big Data on Arjun SajeevanHugo -- 0.156.0en-usThu, 26 Feb 2026 00:00:00 +0000PySpark DataFrames vs. Spark SQL: Which One Should You Use?https://arjunsajeevan.com/posts/spark-api-vs-sql/Thu, 26 Feb 2026 00:00:00 +0000https://arjunsajeevan.com/posts/spark-api-vs-sql/A deep dive into performance, dynamic queries, and reusability to help you choose the right tool for your Spark pipelines.Modernizing Architecture: Migrating from Hadoop to Data Lakehousehttps://arjunsajeevan.com/posts/hadoop-to-datalakehouse/Wed, 25 Feb 2026 00:00:00 +0000https://arjunsajeevan.com/posts/hadoop-to-datalakehouse/A deep dive into why enterprises are moving away from legacy Hadoop systems toward a unified Data Lakehouse architecture.