naye meta-llama
Llama 3.3 70B Instruct
meta-llama/Llama-3.3-70B-Instruct
Nhamba dzese ndezvekufungidzira. Kushandiswa chaiko kwendangariro nekukurumidza kunoenderana nema driver enyu, zvamunosetinga nemamwe maprogiramu ari kushanda.
- Parameters
- 71B
- Rezinesi
- llama3.3
- Yakabudiswa
- Nov 26, 2024
Rezinesi ndere mugadziri wemhando. Tarisai mitemo yaro musati mashandisa mhando iyi.
Hugging Face inokumbira kuti mubvume mitemo yemugadziri musati makopodha mhando iyi. Hapana kiti inotengeswa yayo.
Original paHugging Face ↗Ndangariro inodiwa nequantization
Pamatokeni 8,192 econtext, kusanganisira 0.8 GB yeruntime.
| Quantization | Faira remhando | Zvese |
|---|---|---|
| Q4_K_M | 42.8 GB | 47.9 GB(zvekufungidzira) |
| Q5_K_M | 50.2 GB | 56.0 GB(zvekufungidzira) |
| Q6_K | 57.9 GB | 64.4 GB(zvekufungidzira) |
| Q8_0 | 75.0 GB | 83.3 GB(zvekufungidzira) |
| F16 | 141.1 GB | 156.0 GB(zvekufungidzira) |
Hardware inoishandisa pakadhi yemifananidzo
PaQ4_K_M nematokeni 8,192 econtext.
Hapana hardware yatinoronga inoishandisa yese pakadhi yemifananidzo pachisetiwa ichi.
Tarisai pakomputa yenyuMhando imwe cheteyo kuburikidza neAPI
Anotengesa nemutengo wakaderera: NanoGPT, $0.99 pamwedzi pakushandisa kwakajairika (zvikumbiro 200 pazuva).
Tarisai mitengo paModel Price MapRuzivo rwemhando runobva pamarondedzero eruzhinji eHugging Face (mazita, saizi, marezinesi). Peji yemhando imwe neimwe ine chinongedzo chinoenda kuyeoriginari.