It supports Windows, macOS, and Linux.
You just need at least 8GB of RAM and about 30GB of free storage space.
Chatbots are all the rage right now, and everyone wants a piece of the action.
Google hasBard, Microsoft hasBing Chat, and OpenAI’sChatGPTis practically synonymous with AI at this point.
But what if you don’t want to rely on a cloud service for your chatbot?
We’ve got a ChatGPT-like AI you might download — an Alpaca.
What Is Alpaca?
Alpaca is a language model (a chatbot, basically), much likeChatGPT.
Alpaca was created byStanford researchersby fine-tuningFacebook’s LLaMA.
Unlike ChatGPT, and most other chatbots available today, Alpaca runs completely on your own PC.
You’re only limited by your hardware and your programming chops.
How Does Alpaca Compare with ChatGPT?
Slower PCs with fewer cores will take longer to generate responses.
There are three main variants of Alpaca currently, 7B, 13B, and 30B.
Generally speaking, the larger the number, the smarter the chatbot will be.
Alpaca, especially the 7B model, is noticeably “dumber” than ChatGPT is.
It doesn’t reason as well and will certainly notpass the Turing test.
7B is still great if you wanta recipe suggestion, however.
The 13B and 30B models are quite another story.
13B is capable of providing a coherent, human-like conversation, and can answer complex questions.
It’ll wax on philosophically or make a joke without missing a beat if prompted.
What Do you should probably Run Alpaca?
Alpaca has pretty flexible system requirements.
These guidelines are above the bare minimum but are good guidelines.
We’re also going to be installing this on Windows.
There is currently no reason to suspect this particular project has any major security faults or is malicious.
We’ve been through the code and launch the software ourselves and found nothing concerning.
That does not mean it is or will remain safe.
Always be cautious with things you find on internet and reevaluate the safety periodically.
Docker will probably break if you don’t, requiring a complete reinstall of both WSL2 and Docker.
It has a low overhead and is really handy in a lot of cases.
Docker for Windows relies on WSL2, so we need to install WSL2 first.
If you already have WSL2 installed just run wsl –update in PowerShell to verify everything is updated.
You must reset your PC after the installation is complete.
You also don’t need to install Ubuntu in particular.
you might install any distro you like, Ubuntu is just the default.
Serge uses Docker to make installation super convenient.
First, download theDocker installerfrom the Docker website.
If you’re going to berunning Docker on Linuxor macOS be sure you grab the appropriate installer.
launch the installer and be prepared to wait a few minutes.
Docker will take a while and set up a bunch of stuff behind the scenes.
Once it is done, you’ll want to power cycle your PC.
After restarting, open PowerShell and run
again.
This time you should see some entries related to Docker as well.
Head over to the Git website anddownload the right versionfor your operating system.
Windows users just need to trigger the executable.
verify to at least look at the installation options instead of Just clicking rapidly through all of the options.
One, shown in the screenshot below, is absolutely critical.
Once Git is done installing, you’re ready to install Serge and Alpaca.
Install Serge and Alpaca
First, ensure that Docker Desktop is running.
Then run:
Docker composeties together a number of different containers into a neat package.
There are three different variants you might download: 7B, 13B, and 30B.
7B is the simplest and “dumbest” model, whereas 30B is the most sophisticated and smartest.
13B is the middle ground.
You should probably start with the 7B variant first since it is the least demanding option.
you’ve got the option to always download 13B or 30B later if you want.
fire off the following command to download the 7B model (or substitute 13B or 30B).
Be prepared to wait, especially if you opt for the 30B variant.
To do that, just open up Docker Desktop and poke the small triangular buttons.
The icons to the left of the “Name” column turn green when the containers are running.
Everything is installed and ready to go at this point.
Here is a sample of how the conversation went.
It remains on your gadget, under your control at all times.
Their tendency to make things up has been dubbed “hallucinating.”
Do not rely on them for anything essential, especially not something critical to your job or health.
They should only be used for entertainment or experimental purposes at this time.
Further refinement will also result in faster, more accurate models that can run on weaker hardware.
