absorb.md

Gammalora

1 mentions across 0 people

Unknown speaker
paper · 2026-06-11
Recommended

“Comparing per-user gamma-LoRA (a small LoRA adapter trained on each user's history; gamma denotes per-user, not per-task) against BGE-large dense top-K retrieval on a controlled 50-user synthetic corpus and a real-data probe (LaMP-3), we find gamma-LoRA decisively wins behavioral style while RAG decisively wins factual absence -- and the same query-projection cells in attention layers 21-35 causally load-bear both effects in opposite directions (zeroing those LoRA weights raises absence-probe TP”

Decomposing LLM User-Side Memory: Behavioral vs. Factual Components and Substrat ↗