Krish Puvvada Austin · Building at webAI

I build AI products at the layers where they have to work. Retrieval, inference, and the evaluation that decides what ships.

Director, Applied AI Product at webAI. I own an LLM product line end to end: what we build, where AI engineering effort goes, and what “good” looks like when it ships. Previously: Microsoft, Meta, Bank of America.

Austin

Now

I own webAI Frontline, our document AI product. It puts 80,000+ pages of aviation and manufacturing manuals on a single iPad and answers with a citation to the page, at 85% citation accuracy and 1.86s to first token. Phase 1 shipped in March 2026. Phase 2, a model swap to Gemma 4, is live.

I wrote the RAG evaluation strategy and built the harness behind it, which engineering now runs before any model or retrieval change ships. I also authored our company‑wide product vision and set its North Star metric.

If the product only gets better when the model maker ships a new checkpoint, you don’t have a product. You have a wrapper. The product is the harness.

From “The Model Is the Substrate”
Work

Selected projects

webAI Frontline

2025 → now
webAI · Director, Applied AI Product

Document AI for aviation and manufacturing technicians, running on the tablet in their hands. I own the product line and wrote the evaluation strategy behind it: 90 golden questions across three manuals, four retrieval metrics, and a harness engineering adopted as the regression gate for every change. For the Gemma 4 swap I ran the bake-off against Qwen 3.5 and ColGemma and wrote the decision rule that settled it. 85% citation accuracy, 1.86s to first token.

Clippy

2026 → now
webAI · Internal agent, built and run solo

Most of my week happens in Slack, and the agents were already doing the drafting. So the artifact should get made where the team is, not written alone and circulated for comment afterward. Clippy drafts specs and code in a public channel, so teammates shape the work while it is forming instead of reviewing a finished blob. It spread company‑wide; our CEO turned out to be the heaviest user, and the product team runs on it daily. I built it on an open‑source agent base and own the durable execution layer that keeps a shared thread trustworthy. A duplicated answer costs more trust than a slow one, so that is where most of the ~400 commits went.

Aurora

2023 → 2025
Microsoft · AI Product Lead

ML‑driven power allocation across Microsoft’s $4.5B Energy portfolio. The model found capacity we already owned but could not see, and row‑level monitoring caught rack clusters drawing over their allocation before they turned into outages. 1 MW of stranded capacity recovered in the pilot, $20M in new customer revenue within three months, 30% fewer outages, and 99.999% availability held throughout.

ML platform unification

2021 → 2023
Meta · Product TPM, AI & ML Platforms

Consolidated feature engineering across Meta’s Integrity org: 30 enforcement teams, shared ML representations for 5B+ entities, 200+ models. Engineers chose to build on it, hitting 85% adoption against a 50% target, and once it crossed that line I sunset the legacy platform. Model development time down 25%, $60M saved. Most of the value came from removing infrastructure, not adding it.

Writing

Selected essays

Long‑form on AI strategy, on‑device intelligence, and how AI products actually ship. Published in webAI’s internal Collective; available on request.

2025.12 · Mission & Culture

Sovereignty Is Architecture, Not a Feature

Every cloud vendor will slap “sovereign” on their product. But sovereignty isn’t a checkbox you bolt on, it’s the assumption that shapes every design decision you make. Either foundational, or theater.

2026.02 · Learnings

The Model is Substrate

The model is just substrate, a commodity layer like electricity. If your product only gets better when the model maker ships a new checkpoint, you don’t have a product, you have a wrapper. The product is the Harness.

2026.03 · Tech Insights

The Capability Conveyor

Open‑source models lag the frontier by three to six months. Most see a constraint. I see a crystal ball: design for what frontier models do today, ship by the time local catches up.

2026.01 · Learnings

The Sledgehammer Fallacy

The future of enterprise AI isn’t trillion‑parameter god‑models running in someone else’s data center. It’s domain‑specific specialists, fine‑tuned and locally deployed, with orchestration as the real moat.

Shorter takes, on LinkedIn

Background

Career timeline

Education

MS, Computer Science (Data Science), NC State University.
BE, Computer Science, BITS Pilani.

Contact

Let’s talk

Open to conversations on on‑device AI, retrieval at the edge, or anything I’ve written about above. Email is the fastest way to reach me.