1
mirror of https://github.com/cocktailpeanut/dalai synced 2024-11-23 04:16:53 +01:00

Alpaca 13B

This commit is contained in:
cocktailpeanut 2023-03-20 13:40:47 -04:00
parent 6378f8d060
commit 1742b73dd4
4 changed files with 9 additions and 3 deletions

View File

@ -10,7 +10,7 @@ Run LLaMA and Alpaca on your computer.
## JUST RUN THIS
<img src="npx.png" class='round'>
<img src="npx2.png" class='round'>
## TO GET
@ -52,13 +52,19 @@ According to [a llama.cpp discussion thread](https://github.com/ggerganov/llama.
### Alpaca
Currently only the 7B model is available via [alpaca.cpp](https://github.com/antimatter15/alpaca.cpp)
Currently 7B and 13B models are available via [alpaca.cpp](https://github.com/antimatter15/alpaca.cpp)
#### 7B
Alpaca comes fully quantized (compressed), and the only space you need for the 7B model is 4.21GB:
![alpaca_spec.png](alpaca_spec.png)
![alpaca_7b.png](alpaca_7b.png)
#### 13B
Alpaca comes fully quantized (compressed), and the only space you need for the 13B model is 8.14GB:
![alpaca_13b.png](alpaca_13b.png)
### LLaMA

BIN
docs/alpaca_13b.png Normal file

Binary file not shown.

After

Width:  |  Height:  |  Size: 197 KiB

View File

Before

Width:  |  Height:  |  Size: 278 KiB

After

Width:  |  Height:  |  Size: 278 KiB

BIN
docs/npx2.png Normal file

Binary file not shown.

After

Width:  |  Height:  |  Size: 103 KiB