na meta-llama
Llama 3.2 1B Instruct
meta-llama/Llama-3.2-1B-Instruct
Imibare yose ni ibigereranyo. Ububiko bukoreshwa n'umuvuduko nyakuri biterwa na drivers zawe, ibyo wahisemo n'izindi porogaramu zikorera icyarimwe.
- Parameters
- 1.2B
- Uruhushya
- llama3.2
- Yasohotse
- Sep 18, 2024
Uruhushya ni urw'uwakoze moderi. Soma amabwiriza yarwo mbere yo gukoresha moderi.
Hugging Face irabasaba kwemera amabwiriza y'uwakoze moderi mbere yo gukuramo iyi moderi. Nta kit iyigenewe igurishwa.
Urwa mbere kuri Hugging Face ↗Ububiko bukenewe hakurikijwe quantization
Ku mvugo ya tokens 8,192, harimo GB 0.8 z'ibikorwa by'ikoreshwa.
| Quantization | Dosiye ya moderi | Hamwe |
|---|---|---|
| Q4_K_M | 0.7 GB | 1.6 GB(igereranyo) |
| Q5_K_M | 0.9 GB | 1.8 GB(igereranyo) |
| Q6_K | 1.0 GB | 1.9 GB(igereranyo) |
| Q8_0 | 1.3 GB | 2.2 GB(igereranyo) |
| F16 | 2.5 GB | 3.5 GB(igereranyo) |
Ibikoresho bayikoresha ku karita y'ibishushanyo
Kuri Q4_K_M no ku mvugo ya tokens 8,192.
- NVIDIA GeForce RTX 3060 (12 GB)
- NVIDIA GeForce RTX 3070
- NVIDIA GeForce RTX 3080 (10 GB)
- NVIDIA GeForce RTX 3090
- NVIDIA GeForce RTX 4070
- NVIDIA GeForce RTX 4070 Ti SUPER
- NVIDIA GeForce RTX 4080 SUPER
- NVIDIA GeForce RTX 4090
- NVIDIA GeForce RTX 5060 Ti (16 GB)
- NVIDIA GeForce RTX 5070
- NVIDIA GeForce RTX 5070 Ti
- NVIDIA GeForce RTX 5080
- NVIDIA GeForce RTX 5090
- AMD Radeon RX 7600
- AMD Radeon RX 7700 XT
- AMD Radeon RX 7800 XT
- AMD Radeon RX 7900 XT
- AMD Radeon RX 7900 XTX
- AMD Radeon RX 9070 XT
- Apple M1 Pro
- Apple M1 Max
- Apple M2
- Apple M2 Pro
- Apple M2 Max
- Apple M3
- Apple M3 Pro
- Apple M3 Max (30-core GPU)
- Apple M3 Max (40-core GPU)
- Apple M4
- Apple M4 Pro
- Apple M4 Max (32-core GPU)
- Apple M4 Max (40-core GPU)
- Apple M5
- AMD Ryzen AI Max+ 395
Moderi imwe binyuze kuri API
Uwayigurisha ku giciro gito: Inference, $0.09 ku kwezi ku ikoreshwa risanzwe (ibisabwa 200 ku munsi).
Reba ibiciro kuri Model Price MapAmakuru ya moderi akomoka ku mpapuro rusange za Hugging Face (amazina, ubunini, uruhushya). Buri rupapuro rwa moderi rufite aho rujya ku rwa mbere.