• irate944@piefed.social
    link
    fedilink
    English
    arrow-up
    3
    ·
    1 month ago

    How much RAM do you have and which version of the model did you run?

    Local LLMs can be just as fast as long your device clears the requirements. If you noticed a huge difference, there’s a really good chance that you tried to use a model that requires more RAM than you have