na meta-llama
Llama 3.3 70B Instruct
meta-llama/Llama-3.3-70B-Instruct
Imibare yose ni ibigereranyo. Ububiko bukoreshwa n'umuvuduko nyakuri biterwa na drivers zawe, ibyo wahisemo n'izindi porogaramu zikorera icyarimwe.
- Parameters
- 71B
- Uruhushya
- llama3.3
- Yasohotse
- Nov 26, 2024
Uruhushya ni urw'uwakoze moderi. Soma amabwiriza yarwo mbere yo gukoresha moderi.
Hugging Face irabasaba kwemera amabwiriza y'uwakoze moderi mbere yo gukuramo iyi moderi. Nta kit iyigenewe igurishwa.
Urwa mbere kuri Hugging Face ↗Ububiko bukenewe hakurikijwe quantization
Ku mvugo ya tokens 8,192, harimo GB 0.8 z'ibikorwa by'ikoreshwa.
| Quantization | Dosiye ya moderi | Hamwe |
|---|---|---|
| Q4_K_M | 42.8 GB | 47.9 GB(igereranyo) |
| Q5_K_M | 50.2 GB | 56.0 GB(igereranyo) |
| Q6_K | 57.9 GB | 64.4 GB(igereranyo) |
| Q8_0 | 75.0 GB | 83.3 GB(igereranyo) |
| F16 | 141.1 GB | 156.0 GB(igereranyo) |
Ibikoresho bayikoresha ku karita y'ibishushanyo
Kuri Q4_K_M no ku mvugo ya tokens 8,192.
Nta gikoresho mu byo tugaragaza kiyikoresha yose ku karita y'ibishushanyo kuri ubu buryo.
Genzura kuri mudasobwa yaweModeri imwe binyuze kuri API
Uwayigurisha ku giciro gito: NanoGPT, $0.99 ku kwezi ku ikoreshwa risanzwe (ibisabwa 200 ku munsi).
Reba ibiciro kuri Model Price MapAmakuru ya moderi akomoka ku mpapuro rusange za Hugging Face (amazina, ubunini, uruhushya). Buri rupapuro rwa moderi rufite aho rujya ku rwa mbere.