Stack
What I work with, and how well I know it.
64 tools in 7 groups. A long list means little without depth, so each one is marked by how I have actually used it.
- Production, daily
- Shipped
- Built with / evaluated
Languages
Rust for anything hot. Scala and Python for the data platform. Bash for glue.
- Production, dailyRusttokio, rdkafka, serde, channels, custom allocators
- Production, dailyScalaSpark jobs, framework internals, scala-reflect
- Production, dailyPythonPySpark, FastAPI services, tooling
- Production, dailySQLClickHouse, Oracle, Spark SQL, Trino
- Production, dailyBash
- ShippedKotlinAndroid, 2020–2023
- ShippedJava
- Built with / evaluatedGo
- Built with / evaluatedPerlmostly reading it in order to delete it
Data engineering
Batch, streaming and the frameworks around them.
- Production, dailyApache SparkStructured Streaming, migrated 400+ jobs off DStreams, dynamic allocation, JDBC partitioning
- Production, dailyApache KafkamTLS, consumer-group tuning, lag monitoring, partition balancing
- Production, dailyDataCraftRust ETL framework and SDK, my own design
- Production, dailyGeneric Parserin-house Scala Spark ETL framework, 400+ jobs, embedded Spark UI
- Production, dailyPySpark
- ShippedVector
- ShippedFluent Bit
- ShippedLogstash
- Built with / evaluatedKSQL
- Built with / evaluatedAirflow
Databases & analytics
Mostly columnar and mostly large.
- Production, dailyClickHousemulti-cluster, Keeper, MergeTree key and partition design, TTLs
- Production, dailyElasticsearch
- Production, dailyOracle
- ShippedMySQL
- ShippedPostgreSQL
- ShippedTrino
- ShippedApache Superset
- Built with / evaluatedMongoDB
Kubernetes & platform
Where everything above runs.
- Production, dailyKubernetesRBAC, storage, ConfigMaps, CronJobs, resource tuning
- Production, dailyDockerimage hardening and CVE remediation
- Production, dailyAzure DevOpspipelines, releases, wiki
- ShippedHelm
- ShippedJFrog Artifactoryset up the first Cargo registry
- ShippedHashiCorp Vault
- ShippedPrometheusrecording rules, remote_write to Kafka
- ShippedGrafana
- ShippedZabbix
- Built with / evaluatedKubeVirt
Infrastructure & networking
Bare metal, overlays and the automation that drives them.
- ShippedNVIDIA BlueField-3DPU as an ARM64 Kubernetes worker
- ShippedNVIDIA DPFDOCA Platform Framework operator
- ShippedRedfish / BMCout-of-band provisioning
- ShippedWireGuard
- ShippedHeadscaleself-hosted control plane, DERP relays
- ShippedF5 BIG-IProute domains, ACLs, forward proxy
- ShippedTemporal
- ShippedCrossplanecompositions and XRs
- ShippedOpenTofu / Terraform
- ShippedAPIGEE
- Built with / evaluatedOVN-Kubernetesuser-defined networks, BGP/VNI
- Built with / evaluatedCalico
- Built with / evaluatedMetalLB
- Built with / evaluatedEnvoySNI routing
- Built with / evaluatedNetBox
- Built with / evaluatedGuacamole / Warpgate / JumpServer
Cloud
Public and private.
- Production, dailyJio Cloud
- ShippedAzureBlob storage, PaaS metrics
- ShippedGoogle CloudGCS, earlier Firebase and GCP APIs
- Built with / evaluatedAWScatalog and pricing APIs
Tooling & AI
- Production, dailyGit
- Production, dailyLinux
- Production, dailyClaude / Cursor
- Production, dailyFastAPI
- ShippedModel Context Protocolbuilt an internal MCP server
- ShippedAndroid / JetpackCompose, ViewModel, Navigation, 2020–2023
- ShippedFirebase