Why Would You Want Your Own Local AI Chatbot?
You’ll also need a fairly recent GPU, ideally one from NVIDIA, for maximum compatibility.
To run text-generation-web-ui-docker in Docker,download and install Docker on your Windows system.
Lucas Gouveia / Hannah Stryker / How-To Geek
Docker can run on Windows in one of two ways: WSL or Hyper-V mode.
WSL is recommended for most users, so you may need toenable itbefore installing Docker.
The screenshot below shows you where to find this on the GitHub page.
Extract the downloaded ZIP fileinto its own folder, and then kick off the folder containing the unzipped files.
This is an older version of GPT than you get when you use ChatGPT on the internet.
This might take a few minutes.
This model works out of the box, and doesn’t require any signup.
Hoo boy, while it got the right answer, this AI chatbot needs a bit of fine-tuning.
