← Run Locally · Dhammaan moodooyinka
by meta-llama
Llama 3.3 70B Instruct
meta-llama/Llama-3.3-70B-Instruct
Tirooyinka oo dhan waa qiyaas. Isticmaalka dhabta ah ee xusuusta iyo xawaaraha waxay ku xiran yihiin darawalladaada, dejimahaaga iyo barnaamijyada kale ee socda.
- Halbeegyada
- 71B
- Shati
- llama3.3
- La daabacay
- Nov 26, 2024
Shatigu waa kan soo saaraha moodalka. Hubi shuruudihiisa ka hor intaadan isticmaalin moodalka.
Hugging Face waxay ku weydiisaa inaad aqbasho shuruudaha soo saaraha ka hor intaadan soo dejin moodalkan. Kit looma iibiyo.
Asalka Hugging Face ↗Xusuusta loo baahan yahay marka loo eego quantization-ka
Marka macnaha guud yahay 8,192 tokens, oo ay ku jirto 0.8 GB deegaanka socodsiinta.
| Quantization | Faylka moodalka | Wadarta |
|---|---|---|
| Q4_K_M | 42.8 GB | 47.9 GB(qiyaas ah) |
| Q5_K_M | 50.2 GB | 56.0 GB(qiyaas ah) |
| Q6_K | 57.9 GB | 64.4 GB(qiyaas ah) |
| Q8_0 | 75.0 GB | 83.3 GB(qiyaas ah) |
| F16 | 141.1 GB | 156.0 GB(qiyaas ah) |
Qalabka ku socodsiiya kaarka garaafiga
Marka quantization-ku yahay Q4_K_M iyo macnaha guud 8,192 tokens.
Qalabka aan liis gareyno midkoodna ma socodsiiyo gebi ahaanba kaarka garaafiga dejintan.
Ka hubi kombiyuutarkaagaIsla moodalkan oo loo maro API
Iibiyaha ugu jaban: NanoGPT, $0.99 bishii marka isticmaalka caadiga ah (200 codsi maalintii).
Eeg qiimaha Model Price MapFaahfaahinta moodooyinka waxay ka timaaddaa liisaska guud ee Hugging Face (magacyada, cabbirrada, shatiyada). Bog moodal kasta wuxuu ku xiran yahay asalka.