General
The LoRA won on its own moods, and the held-out tradeoff stayed visible
0 views

I wanted a small answer to a practical question: can two topic-specific LoRA adapters improve
perplexity on their own topic without simply making the model better at everything?
The experiment used two specialists, guitar and sourdough. The base model and each adapter
were evaluated on both held-out topic sets after a fresh train/eval run.
guitar-ppl sourdough-ppl
base 18.2 19.4
lora-guitar 11.3 15.4
lora-sourdough 13.7 12.2
The intended effect is visible: each adapter is best on its own topic. The cross-topic numbers
also make the tradeoff visible. lora-guitar improves sourdough over base, but not nearly as much
as the sourdough specialist; lora-sourdough behaves symmetrically. That is a narrower claim than
"the adapters improve the model." They improve the measured topic, with specialization still in
the result.
The run was not accepted on perplexity alone. The independent verification recorded safety
decisions at 4/4 and operator adversarial cases at 14/14. It also checked that exact text overlap
between train and held-out was zero, and exact JSON overlap between train/held-out and adversarial
data was zero. The three dataset hashes and both adapter hashes are in the verification artifact,
so the inputs and outputs can be checked without trusting this table.
There was one operational footnote: unrelated GPU residents left little free VRAM and produced
CUDA allocator warnings. Training and evaluation still completed with exit status 0, and both
runtime-generated adapters were present. I am keeping that warning in the report because a green
exit does not turn a constrained runtime into an unconstrained one.
The complete run record is coordination-mood-lora-runtime-rerun-20260907.md, and the independent checks are in
coordination-mood-lora-verify-20260907.md.
The result is useful precisely because it is modest: the adapters moved the held-out scores in the
expected direction, the safety and adversarial checks passed, and the specialization tradeoff did
not disappear when the table got summarized.
Read original: https://dev.to/ilya_mozerov_867dbdd91feb/the-lora-won-on-its-own-moods-and-the-held-out-tradeoff-stayed-visible-khk
PreviousThe Local LLM Weight Classes, September 2026: What Actually Fits on Your MachineNextThe macOS play/pause key goes to the wrong app, so I built a router for it
Related posts
Device mockups and animated launch videos in your browser, no account needed.
0dev.to Design
Vellinko – Sign PDFs in the browser without uploading them
0Hacker News New
Show HN: Vivio House, an interactive 3D headquarters
0Hacker News New
Pushover – Simple Notifications
0Hacker News New
The Gift of It's Your Problem Now (2021)
0Hacker News New
Implied News: News X Prediction Markets
0Hacker News New