Skip to content

Instantly share code, notes, and snippets.

@contactsamie

contactsamie/gist:0e97498b0473cd1564d87e408549701e

Forked from mberman84/gist:9e008131d96af27256cc9cb53ad834cf
Created September 6, 2023 15:49
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save contactsamie/0e97498b0473cd1564d87e408549701e to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save contactsamie/0e97498b0473cd1564d87e408549701e to your computer and use it in GitHub Desktop.
Download ZIP
Code LLaMA Installation
Raw
gistfile1.txt
# Make sure you have Anaconda installed
# This tutorial assumes you have an Nvidia GPU, but you can find the non-GPU version on the Textgen WebUI github
# More information found here: https://github.com/oobabooga/text-generation-webui
conda create -n textgen python=3.10.9
conda activate textgen
pip3 install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu117
git clone https://github.com/oobabooga/text-generation-webui
cd text-generation-webui
python -m pip install -r requirements.txt
python -m torch.utils.collect_env # optional, checks that you have CUDA enabled
# if you have trouble with CUDA being enabled in torch, try this:
conda install pytorch torchvision torchaudio pytorch-cuda=11.7 -c pytorch -c nvidia
# if you run into the chardet and cchardet issues I did, try this:
python -m pip install chardet
python -m pip install cchardet
python server.py
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment