khushal.chouhan
Khushal Chouhan

Khushal Chouhan

Data Platform Engineer

11 years of software engineering experience - the last 3 building cloud data platforms and pipelines on GCP with Python and SQL.

PythonSQLTerraformGCPBigQuery

Building and operating cloud data platforms - serverless pipelines on GCP (BigQuery, Cloud Run, Terraform) ingesting and enriching regulatory and financial data.

Primary - Data Engineering & Cloud Platforms

  • Serverless pipelines on GCP - Cloud Run Jobs, Cloud Workflows, BigQuery, AlloyDB/Postgres
  • ETL/ELT - ingestion, enrichment, validation, idempotent merges, atomic table swaps
  • Infrastructure as code - Terraform, GitHub Actions CI/CD
  • Third-party data integration - REST APIs, caching & fallback logic

Secondary - Backend Engineering

  • Microservices in Python (FastAPI, Django), Node.js (NestJS), Go (Echo)
  • Event-driven & streaming - Kafka, Redis pub/sub
  • PostgreSQL, MongoDB modeling & optimization
  • Docker, Kubernetes, AWS

SEC Filings Data Platform

Serverless data platform on GCP · Cognitosoft

Solo-built platform that ingests, enriches and loads SEC Form 13F filings end to end, replacing a prior Airflow/Cloud Composer setup. Integrates SEC EDGAR, OpenFIGI, Nasdaq and Yahoo Finance with validation gates, idempotent merges and atomic table swaps - including a fix for a bug that had overstated portfolio values ~1000x.

BigQueryCloud RunTerraformGCP

InsightFulIOT ↗ live

AI analytics platform for IoT · Cognitosoft

Natural-language analytics over ~10,000 daily equipment records. Kafka ETL, TimescaleDB and Druid storage, FastAPI services with a GPT layer that turns questions into executable queries.

KafkaETLTimescaleDBFastAPI

SingleRuleBook ↗ live

RegTech platform · Cybernetic Controls

Real-time data streaming and middleware services in Go for regulatory data, with a Python pipeline for regulatory PDF processing.

GoStreamingETL

Atlas

Multi-tenant RAG & knowledge platform · proprietary

Four microservices for ingestion, generation, config and memory. LangGraph pipeline with hybrid BM25 + semantic retrieval over OpenSearch, RRF + cross-encoder reranking, SSE streaming, Redis semantic caching. Serving 50 tenants with ~5,000 documents each in production.

LangGraphRAGOpenSearchAWS

Claude Code and Cursor are part of my daily engineering workflow, not autocomplete. I treat them as a system I engineer:

skills/

Custom skills

Engineering roles encoded as layered skill documents: scope, phasing, ticket decomposition, architecture and code layout.

agents/

Multi-agent harness

Work broken into atomic tickets with objective acceptance criteria, each implemented by a worker agent starting fresh, gated by review and capped retries.

CLAUDE.md

Rules & plugins

Project conventions enforced through Claude rules and reusable plugins, so every agent session follows the same standards.

cursor/

Hands-on editing

Cursor as the daily driver for interactive editing and refactoring alongside the agent workflow.

Data Platform Engineer - Cognitosoft

2023 - present · SEC data platform, IoT analytics

Designing and operating a serverless SEC filings data platform on GCP (BigQuery, Cloud Run Jobs, Terraform), plus Kafka-based ETL pipelines for IoT analytics.

Cybernetic Controls - SingleRuleBook

2023 · Go streaming & RegTech

Designed real-time streaming and middleware Go services for regulatory data processing.

Tech9 - Truvoice, Blip Billboards

2021 - 2022 · NestJS, Django

Built NestJS and Django REST APIs powering competitive analysis and digital billboard platforms.

Andrade Investment Group

2019 - 2021 · Node.js microservices, fintech

Developed Node.js microservices for clients and transactions, and led a Rails to Node.js migration.

Earlier - 22feet Tribal Worldwide, Angstle, Dartweb

2014 - 2019 · Node.js APIs, Android, chatbots

Shipped Node.js APIs, Android apps and chatbots for consumer brands including the Virat Kohli official app.

© 2026 Khushal Chouhan · hand-sketched, single HTML file, no framework