I'm a Forward Deployed Engineer at TrueFoundry (Bengaluru), helping customers turn LLM platforms into production systems that hold up under real traffic.
Before that I was an ML Engineer at Chubb, shipping GenAI at scale — fine-tuning, agents, RAG, and high-throughput inference.
I also build open-source agent tooling (tracesage) and publish NLP research on evaluation, multilingual systems, and code-switching.
📈 Production impact (Chubb)
| Signal | Result |
|---|---|
| LLaMA-3.1 70B + LoRA/QLoRA + RAG | +25% accuracy · −15% drift |
| Multi-agent planner / retriever / verifier | +18% factual grounding |
| vLLM on AKS (A100/H100) | −40% p95 · +50% throughput · 10K+/day |
| HawkHire | Explainable AI hiring copilot (internal) |
Local-first observability for LangChain & LangGraph. Drop in one callback — watch every run as a live graph + timeline. No cloud account. No Docker. Featured in Python Weekly #750.
pip install "tracesage[langchain]"
tracesage demo # opens the live UI — no API key neededDocs · GitHub · PyPI · Substack
MCP-aware tool attribution · crash-safe handler · pytest fixture · optional OpenTelemetry export · MIT
Models & agents PyTorch · Transformers · LoRA/QLoRA · RAG · Multi-agent
LangChain / LangGraph · Hugging Face · OpenTelemetry
Serving & infra vLLM · Kubernetes · AKS · Azure · AWS · Docker
Databricks · CI/CD · MLOps
Research NLP · Code-switching · Eval benchmarks
| Role | Org | When | |
|---|---|---|---|
| 🟢 | Forward Deployed Engineer | TrueFoundry | Jun 2026 – Present |
| 🔵 | Machine Learning Engineer | Chubb | Jul 2023 – May 2026 |
| 🟣 | NLP Research Intern | Speech Lab · NTU Singapore | 2022 – 2023 |
| ⚪ | B.E. Electrical & Electronics | BITS Pilani | 2019 – 2023 |
| Paper | Venue | |
|---|---|---|
| WhoDunit — culprit detection in mystery stories | arXiv · Dec 2024 | abs |
| MALM — mixing-augmented LMs for zero-shot MT | AACL-IJCNLP 2022 | paper |
| Code-switching LM adaptation (statistical augmentation) | ACIIDS 2023 | paper |
| Singaporean English–Malay code-switching points | IALP 2023 | paper |
| Data augmentation for transformer AES | AISC 2023 | paper |
- You Don't Need LangSmith to Trace LangGraph — local-first tracing pitch
- tracesage: See Inside Your LangGraph Agents — product walkthrough
- Mentioned in Python Weekly Issue 750
Full portfolio: kjgpta.github.io
LLM-friendly profile: llms.txt · Markdown
Open to collaborations on LLM tooling, production AI, agent observability, and applied NLP.
