Fine-tuning a Language Model for Text-to-SQL with Constrained Decoding
I fine-tuned Qwen3-4B with QLoRA and combined structural supervision, constrained decoding and one repair attempt. On 100 BIRD development questions, execution accuracy rose from 36% to 44% and the share of executable queries from 71% to 77%.
2026.09 — 2026.10 · Qwen3-4B / BIRD
