Rishabh Mehta (fin1te) builds data platforms and cloud infrastructure at Jio Platforms. Rust, ClickHouse, Spark, Kubernetes and zero-trust networking.https://fin1te.com/https://fin1te.com/writing/dstream-to-structured-streaming/https://fin1te.com/writing/dstream-to-structured-streaming/A naive port made our hardest job twice as slow and quietly lost data. Here is what it took to reach parity and then pull ahead: bounded batches, fewer scheduling waves, a watermark guard, two timezone bugs and one very deep query plan.Mon, 17 Aug 2026 00:00:00 GMTSparkStructured StreamingKafkaScalahttps://fin1te.com/writing/a-spark-ui-for-structured-streaming/https://fin1te.com/writing/a-spark-ui-for-structured-streaming/The stock Spark UI forgets a streaming query the moment it stops, and it cannot tell you how far behind Kafka you are. So I built a Streaming Stats tab into our framework: a SparkPlugin, a query listener, a ring buffer and server-rendered SVG.Tue, 04 Aug 2026 00:00:00 GMTSparkStructured StreamingKafkaObservabilityhttps://fin1te.com/writing/spark-to-rust/https://fin1te.com/writing/spark-to-rust/How the MyJio log parser went from 120 Spark executors to a single pod, what parity testing looked like, and the thread-count bug that almost made it look worse than it was.Thu, 02 Apr 2026 00:00:00 GMTRustKafkaSparkPerformancehttps://fin1te.com/writing/clickhouse-sort-keys/https://fin1te.com/writing/clickhouse-sort-keys/Subscriber lookups went from full-partition scans in the hundreds of milliseconds to under 20 ms reading three granules. The fix was one line of DDL, and the reasons it works are worth knowing properly.Fri, 06 Mar 2026 00:00:00 GMTClickHouseDatabasesPerformancehttps://fin1te.com/writing/the-497-day-bug/https://fin1te.com/writing/the-497-day-bug/Healthy switches and routers were showing up as down in SLA reports. The common factor was uptime: about 497 days of it, which is exactly where a 32-bit counter of hundredths of a second runs out.Thu, 20 Nov 2025 00:00:00 GMTSNMPCiscoMonitoringSparkhttps://fin1te.com/writing/how-cloud-slas-are-calculated/https://fin1te.com/writing/how-cloud-slas-are-calculated/99.95% availability leaves about 22 minutes of downtime a month. Deciding which minutes count is the hard part: HA pairs, reboots nobody saw, outages that span a weekend, maintenance windows and assets that did not exist yet.Sun, 07 Sep 2025 00:00:00 GMTSLASparkScalaMonitoring