Machine Learning ·
Fine-Tuning an Urdu LLM: Data Curation to Deployment
Fine-tuning Qwen 2.5 7B for Urdu across three versions: a bilingual Urdu/Roman-Urdu corpus, QLoRA on a rented H100, catastrophic forgetting diagnosed and fixed, a blinded multi-judge evaluation harness, RAG-aware retraining, and a live Gradio + Modal demo, all for about $60.
20 min read