Engineering Lead · Distributed Data Systems · Query Engines · Zero-to-One Platforms
Building across three of Microsoft's most distinct data universes — Consumer, Commercial, and Hardware.
Engineering lead and senior software engineer with 13+ years building distributed systems, query engines, and zero-to-one platforms — equally effective designing service architecture and communicating technical direction to executive audiences.
Consumer data is massive. Commercial data is deep. Hardware data isn't forgiving — and that's exactly where I operate.
- CEO-recognized engine leadership — Drove a deep performance analysis of Fabric SQL against Trino — an engine that had never competed at this level — directly shaping the engine roadmap. After my sign-off, executive reports migrated onto Fabric SQL. Reusable benchmarks adopted by multiple platform-engineering teams; work recognized up to the Azure Data President and CEO Satya Nadella.
- Engineering lead — IDEAS-Fabric partnership — The lead engineer behind Microsoft's IDEAS journey onto Fabric — from the initial Trino-vs-Fabric evaluation to the semantic model strategy powering analytics at scale. Designed the Direct Lake semantic model approach, the Fabric development lifecycle for compliance and reliability, and the SQL performance work. Architecture published on Microsoft Learn as the reference for Fabric adoption at enterprise scale. Automated production promotion (-80% manual time), drove deployment regressions to zero, and halved global report first-render time (~15s -> ~7s).
- Data security & compliance at platform scale — Surfaced data exfiltration risk, authored the end-to-end remediation, and presented the required API changes to the platform team. Design adopted as a native Fabric capability. Laid foundational standards for EUDB-compliant data handling.
- The platform behind competitive strategy — Architected the competitive-intelligence platform powering the M365 Copilot analytics plane — spanning the GenAI landscape, security positioning, and cross-portfolio product analysis. Sub-5s query performance, serving 600+ teams with 100% metric parity across executive scorecards.
- Zero-to-one IoT fleet orchestration — Designed and built a real-time platform for autonomous fleet management from scratch; cutting incident response to under ~10 minutes, architected to scale to N devices, monitoring petabyte-scale telemetry (billions of rows daily) across global sites.
- Leadership: Zero-to-one builds, executive communication, mentoring, cross-geo leadership, navigating ambiguity, open source
- Distributed Systems: MPP query engines, columnar storage, vectorized execution, partitioning strategies, async job systems, IoT orchestration
- Data Architecture: Lakehouse design, semantic models, telemetry pipelines, stream/batch, Medallion architecture, data governance, exfiltration prevention, EUDB compliance, Cosmos DB
- Query Engines: Fabric SQL, Presto / Trino, StarRocks, ClickHouse, Apache Kylin
- Languages: C#, .NET, Python, TypeScript, JavaScript, SQL, T-SQL, KQL, SCOPE
- Platform & Reliability: Azure, security, governance & zero-trust, CI/CD automation, performance engineering, IoT Hub, FastAPI, React, Node.js
Forge — The Core Data Engineering Platform Scalable compute · reliable orchestration · governed analytics. An end-to-end data engineering platform taking raw ingestion to governed, serving-ready data with lineage tracking and data quality. Two-cluster model (compute + orchestration) built on Azure (Bicep) · AKS · Apache Spark · Trino · Airflow · Delta Lake.
Lens — Self-Hosted Analytics & BI
A self-hosted enterprise analytics platform — a private data command centre where teams query live data, build charts, assemble dashboards, and use AI to accelerate analysis. Multi-provider auth (Local · Azure AD · Google), configurable entirely from the UI. Built on Next.js · TypeScript · Python · FastAPI, over Microsoft Fabric SQL, Azure SQL, PostgreSQL, MySQL, Trino, StarRocks. MIT
Trino C# .NET Client — Open-source contributor Contributed use-case design and integration engineering for the official Trino .NET client library — an ADO.NET-compatible C# client open-sourced from Microsoft under the trinodb organization. Acknowledged at Trino Summit 2024.
- How Fabric SQL AEP Outperforms Trino Across Real-World Workloads
- The Importance of Versioning in the Fabric Semantic Model
- Microsoft Fabric Direct Lake with CI/CD
- Direct Lake Semantic Model Mastery with Fabric Spark and SemPY
- Microsoft Fabric Direct Lake Semantic Models — Best Practices
- Best Practice Analyzer in Microsoft Fabric
Full portfolio & more at pruthviprodduturi.github.io
- Portfolio: pruthviprodduturi.github.io
- Medium
- Redmond / Seattle, WA
- M.S. Digital Sciences, Kent State University