AWS Distills GLM-5.3 Into a Qwen3.5-4B Shopping Agent—Near the Teacher, With Tradeoffs
AWS Machine Learning Blog (02 NOV 2026; Zappia et al.) shows SeqKD of a shopping agent: Bedrock GLM-5.3 teacher → ShoppingBench rejection sampling → LoRA SFT on Qwen3.5-4B (SageMaker AI). Held-out 324 problems, single LoRA run: student ASR 0.541 vs greedy teacher 0.540 vs base 0.297; tool-only 0.415; IFEval ≈6–8 pts down. No per-task cost/latency published. AWS-reported; we haven't retested.
