Literally just switched to pass and was hoping to see a desktop app. AUR peeps, let’s get it on arch.

Do we think they are going to charge for this once out of beta? Even though they have done great work on making it anonymous, I don’t see anything about them not using the input/output as data to “better” their service. So perhaps it would remain free?

I am using this: https://github.com/oobabooga/text-generation-webui … It is running great with my AMD 7900XT. It also ran great with my 5700xt. It sets up itself within a conda virtual environment so it takes all mess out of getting the packages to work correctly. It can use NVIDIA cards too.

Once you get it installed you can then get your models from huggingface.co

I’m on arch, btw. ;)

Edit: I just went and reinstalled it and saw it supports these gpus

Same. Genuinely impressed

I use mixtral8x7b locally and it’s been great. I am genuinely excited to see ddg offering it and the service in general. Now I can use this service when not on my network.

Now that you mention it… Yeah! I rename the icons to just “Mail, Calendar, Etc…”