naye meta-llama
Llama 3.2 1B Instruct
meta-llama/Llama-3.2-1B-Instruct
Nhamba dzese ndezvekufungidzira. Kushandiswa chaiko kwendangariro nekukurumidza kunoenderana nema driver enyu, zvamunosetinga nemamwe maprogiramu ari kushanda.
- Parameters
- 1.2B
- Rezinesi
- llama3.2
- Yakabudiswa
- Sep 18, 2024
Rezinesi ndere mugadziri wemhando. Tarisai mitemo yaro musati mashandisa mhando iyi.
Hugging Face inokumbira kuti mubvume mitemo yemugadziri musati makopodha mhando iyi. Hapana kiti inotengeswa yayo.
Original paHugging Face ↗Ndangariro inodiwa nequantization
Pamatokeni 8,192 econtext, kusanganisira 0.8 GB yeruntime.
| Quantization | Faira remhando | Zvese |
|---|---|---|
| Q4_K_M | 0.7 GB | 1.6 GB(zvekufungidzira) |
| Q5_K_M | 0.9 GB | 1.8 GB(zvekufungidzira) |
| Q6_K | 1.0 GB | 1.9 GB(zvekufungidzira) |
| Q8_0 | 1.3 GB | 2.2 GB(zvekufungidzira) |
| F16 | 2.5 GB | 3.5 GB(zvekufungidzira) |
Hardware inoishandisa pakadhi yemifananidzo
PaQ4_K_M nematokeni 8,192 econtext.
- NVIDIA GeForce RTX 3060 (12 GB)
- NVIDIA GeForce RTX 3070
- NVIDIA GeForce RTX 3080 (10 GB)
- NVIDIA GeForce RTX 3090
- NVIDIA GeForce RTX 4070
- NVIDIA GeForce RTX 4070 Ti SUPER
- NVIDIA GeForce RTX 4080 SUPER
- NVIDIA GeForce RTX 4090
- NVIDIA GeForce RTX 5060 Ti (16 GB)
- NVIDIA GeForce RTX 5070
- NVIDIA GeForce RTX 5070 Ti
- NVIDIA GeForce RTX 5080
- NVIDIA GeForce RTX 5090
- AMD Radeon RX 7600
- AMD Radeon RX 7700 XT
- AMD Radeon RX 7800 XT
- AMD Radeon RX 7900 XT
- AMD Radeon RX 7900 XTX
- AMD Radeon RX 9070 XT
- Apple M1 Pro
- Apple M1 Max
- Apple M2
- Apple M2 Pro
- Apple M2 Max
- Apple M3
- Apple M3 Pro
- Apple M3 Max (30-core GPU)
- Apple M3 Max (40-core GPU)
- Apple M4
- Apple M4 Pro
- Apple M4 Max (32-core GPU)
- Apple M4 Max (40-core GPU)
- Apple M5
- AMD Ryzen AI Max+ 395
Mhando imwe cheteyo kuburikidza neAPI
Anotengesa nemutengo wakaderera: Inference, $0.09 pamwedzi pakushandisa kwakajairika (zvikumbiro 200 pazuva).
Tarisai mitengo paModel Price MapRuzivo rwemhando runobva pamarondedzero eruzhinji eHugging Face (mazita, saizi, marezinesi). Peji yemhando imwe neimwe ine chinongedzo chinoenda kuyeoriginari.