Skip to main content

AI/ML Engineering, Built in Public

Technical deep-dives on building AI/ML systems: LLM fine-tuning, computer vision, NLP, and production ML, with the metrics, trade-offs, and failures behind each project.

Building an Urdu LLM: From Data Curation to Deployment
Machine Learning

Building an Urdu LLM: From Data Curation to Deployment

A technical deep-dive into fine-tuning Qwen 2.5 7B for Urdu across three versions: curating a bilingual Urdu/Roman-Urdu corpus, QLoRA training on a rented H100, diagnosing and fixing catastrophic forgetting, building a blinded multi-judge evaluation harness (including a free Claude-Code-CLI judge), fixing the regressions a data change caused, RAG-aware retraining that fixed retrieval's structural failure without turning it into a blanket win, and shipping a live demo on Gradio + Modal.

20 min read
Machine Learning+8