minus-squareflamdragparadiddle@sh.itjust.workstoLocalLLaMA@sh.itjust.works•is the 4k context length of llama2 for real?linkfedilinkEnglisharrow-up0·1 year agoLost in the middle: https://arxiv.org/abs/2307.03172 Happens for all models, not just Llama and it is really frustrating to deal with. linkfedilink
minus-squareflamdragparadiddle@sh.itjust.workstoMemes@lemmy.ml•slurp slurplinkfedilinkarrow-up3·1 year agoWe call it “glopping” linkfedilink
Lost in the middle: https://arxiv.org/abs/2307.03172
Happens for all models, not just Llama and it is really frustrating to deal with.