• yeehaw@lemmy.ca
      link
      fedilink
      English
      arrow-up
      2
      ·
      5 hours ago

      This is cool, are there any decent ones that run in docker and have a web UI?

      • rebelsimile@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        1
        ·
        2 hours ago

        I’ve been using open webui (search for it with those terms) to run local models in a docker container served from Llama for the last few months and I love it.