The Practitioner-to-Architect Ladder: 7 Skills Nobody Teaches
Planned post
A placeholder for the skills and judgment that help engineers grow into architecture roles.
From Pipelines to Platforms
Start here: from data engineer to architect
I’m Nitesh Sharma, a Data & AI Solution Architect. This site is for experienced data engineers ready to move beyond building pipelines and grow the judgment to shape trusted data platforms.
Expect practical guidance grounded in trade-offs, delivery experience, and the decisions behind the diagrams.
The 5 posts to read first
-
-
Lakehouse vs Warehouse vs Mesh in 2026: A Decision Framework
Planned post
A placeholder for a practical framework to choose an approach based on constraints and outcomes.
-
How I Cut £53K/Year With Report Automation
Planned post
A placeholder for a real-world automation case study and the value behind the numbers.
-
What “AI-Ready Data” Actually Means (10-Point Audit)
Planned post
A placeholder for a concrete assessment of data foundations for AI workloads.
-
Architecture Decision Records for Data Teams
Planned post
A placeholder for a lightweight way to make data architecture decisions explainable and durable.
From the archive
A snapshot of recent posts already published on The Data Arch—useful if you want to skim what I write about before diving deeper.
Exploring the '17x Error Trap' in Early Multi-Agent System Deployments
Discover why adding more AI agents often degrades performance. Learn how unstructured 'bags of agents' amplify errors by 17x and how orchestrated hierarchies solve the problem.
Read postFrom Fascination to Functionality: The Shift from Large Language Models to Multi-Agent Systems
Explore the transformative shift from single LLMs to collaborative Multi-Agent Systems. Learn how autonomous agents are reshaping enterprise AI with real-world examples, architecture patterns, and measurable ROI.
Read postComprehensive Guide to LLM Fundamentals for Data Professionals
A deep dive into Large Language Models for data architects and engineers. Learn tokenization, transformer architecture, attention mechanisms, and practical prompt engineering techniques.
Read postIs Traditional Data Architecture Dying?
A deep, architectural walkthrough of what actually breaks — and what replaces it — in the GenAI era
Read postThe Architect's Dilemma: Redefining the Data Solution Architect in the Age of GenAI
Why I'm spending the next 10+ weeks relearning my job — and why you might want to follow along
Read postSeries Preview: The AI-First Data Architect
Why this series exists — and why now. A 10+ week journey exploring the architectural shift happening between data and AI.
Read postThe Data Arch Weekly
One practical lesson a week on becoming a data & AI architect — trade-offs, decisions, and the numbers behind them. Subscribe and get The Data Engineers’ Field Guide free.
Learn with peers
Join ArchitectLab
Continue the conversation with practitioners working through architecture decisions, platform trade-offs, and career growth.
ArchitectLab is in the works. Community access is coming soon.