• Trimatrix@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    4 months ago

    Check the UGI leader board on hugging face and select the highest ranking model your local GPU can run on a minimum Q4_K_M quantization level.

  • VioneT@lemmy.worldM
    link
    fedilink
    English
    arrow-up
    0
    ·
    4 months ago

    Almost all AI Text on Perchance uses the same model. Some are calling other through external API. But based on both that you’ve linked, yes, they are using the same LLM. From what we know from the plugin page ai-text-plugin it is a LLaMa based model, but the specific model is unknown.