arxivcs.CLcs.AI2026-07-23
Data Quality over Capacity: Internalizing Documents into LoRA Adapters for Closed-Book QA
We study baking documents directly into the weights of a 4-bit Gemma-4-e4b model via LoRA, so a system can answer questions about a corpus closed-book: no retrieval and no context-window budget. Across roughly 100 training runs from single documents to a 99-document corpus, we fi…