Wondering about services to test on either a 16gb ram “AI Capable” arm64 board or on a laptop with modern rtx. Only looking for open source options, but curious to hear what people say. Cheers!

  • acockworkorange@mander.xyz
    link
    fedilink
    English
    arrow-up
    0
    ·
    2 days ago

    I am curious about trying an application specific AI. Like just for coding, for instance. I assume the memory requirements would be much lower.

    • kiol@lemmy.worldOP
      link
      fedilink
      English
      arrow-up
      0
      ·
      2 days ago

      afaik Ollama would fit that bill, but perhaps others can chime in. You could probably run it on your local computer with a small model based on CPU alone.