Engineering Blueprint
AI-Augmented Data Engineering with Azure Medallion Architecture
A data engineer at a semi-government social housing organization in the Netherlands shares how they use GitHub Copilot as a coding assistant within a Microsoft-first Azure data stack. AI helps a small
What problem does this solve?
A small team needed to deliver more data engineering output than their headcount allowed. The engineer saw AI as a way to extend the team's capacity and as a personal growth opportunity to bring new knowledge back to the broader team.
How does it work?
The medallion architecture provides a clean, layered structure for data quality. Copilot is embedded in VS Code and assists with writing efficient notebook code — particularly useful for creating replicable patterns across the pipeline. The team used an AI agent trained on Azure and data engineering to accelerate their own learning before applying AI to production work.
What's the biggest win?
With only two core developers, the team is delivering output equivalent to a larger team. AI assistance saves 4–8 hours of development time per week.
What should I know technically?
Prompts are carefully written with full context. The team used an AI agent trained on data engineering and Azure to build up internal knowledge before applying it to production work — using AI as a learning accelerator first, then a production tool.
What are the constraints?
Vendor lock-in is a real concern — Microsoft-first creates dependency the engineer would prefer to reduce. Security matters more given the semi-government nature of the org. Don't just use AI — understand it. Always ask AI to explain what it did so you can answer questions yourself. Over-reliance without understanding creates AI slop.
Tools in this Blueprint
About This Blueprint
- Industry
- Data Engineering / Non-Profit / Social Housing