← Run Locally · Fa'ata'ita'iga uma
na gaosia e meta-llama
Llama 3.2 1B Instruct
meta-llama/Llama-3.2-1B-Instruct
O fuainumera uma o fa'atusatusaga lea. O le fa'aaogāina moni o le mea e teu ai faamatalaga ma le saoasaoa e fa'alagolago i au draiva, au seti, ma isi polokalame o loo faagaoioia.
- Parameter
- 1.2B
- Laisene
- llama3.2
- Lomia
- Sep 18, 2024
O le laisene o le laisene a le na gaosia le fa'ata'ita'iga. Siaki ona aiaiga a'o le'i fa'aaogā le fa'ata'ita'iga.
Ua fai atu Hugging Face ia e talia aiaiga a le gaosi a'o le'i la'u mai lenei fa'ata'ita'iga. E leai se kit e faatauina mo ia.
Uluai tala i Hugging Face ↗Mea e teu ai faamatalaga e manaomia e tusa ai ma le quantization
I le 8,192 token o le tulaga o le tala, e aofia ai le 0.8 GB mo le runtime.
| Quantization | Faila o le fa'ata'ita'iga | Aofa'i |
|---|---|---|
| Q4_K_M | 0.7 GB | 1.6 GB(fa'atusatusa) |
| Q5_K_M | 0.9 GB | 1.8 GB(fa'atusatusa) |
| Q6_K | 1.0 GB | 1.9 GB(fa'atusatusa) |
| Q8_0 | 1.3 GB | 2.2 GB(fa'atusatusa) |
| F16 | 2.5 GB | 3.5 GB(fa'atusatusa) |
Mea faigaluega e faagaoioia ai i le kata fa'akalafi
I le Q4_K_M ma le 8,192 token o le tulaga o le tala.
- NVIDIA GeForce RTX 3060 (12 GB)
- NVIDIA GeForce RTX 3070
- NVIDIA GeForce RTX 3080 (10 GB)
- NVIDIA GeForce RTX 3090
- NVIDIA GeForce RTX 4070
- NVIDIA GeForce RTX 4070 Ti SUPER
- NVIDIA GeForce RTX 4080 SUPER
- NVIDIA GeForce RTX 4090
- NVIDIA GeForce RTX 5060 Ti (16 GB)
- NVIDIA GeForce RTX 5070
- NVIDIA GeForce RTX 5070 Ti
- NVIDIA GeForce RTX 5080
- NVIDIA GeForce RTX 5090
- AMD Radeon RX 7600
- AMD Radeon RX 7700 XT
- AMD Radeon RX 7800 XT
- AMD Radeon RX 7900 XT
- AMD Radeon RX 7900 XTX
- AMD Radeon RX 9070 XT
- Apple M1 Pro
- Apple M1 Max
- Apple M2
- Apple M2 Pro
- Apple M2 Max
- Apple M3
- Apple M3 Pro
- Apple M3 Max (30-core GPU)
- Apple M3 Max (40-core GPU)
- Apple M4
- Apple M4 Pro
- Apple M4 Max (32-core GPU)
- Apple M4 Max (40-core GPU)
- Apple M5
- AMD Ryzen AI Max+ 395
O le fa'ata'ita'iga lava lea e ala i se API
O le faatau sili ona taugofie: Inference, $0.09 i le masina i le fa'aaogāga masani (200 talosaga i le aso).
Va'ai i tau i le Model Price MapO faamatalaga o fa'ata'ita'iga e mai i lisi lautele a Hugging Face (igoa, lapopo'a, laisene). O itulau uma o fa'ata'ita'iga e fesoʻotaʻi i le uluai tala.