ka meta-llama
Llama 3.3 70B Instruct
meta-llama/Llama-3.3-70B-Instruct
Lipalo tsohle ke likhakanyo. Tšebeliso ea sebele ea mohopolo le lebelo li ipapisitse le li-driver tsa hau, litlhophiso le mananeo a mang a sebetsang.
- Li-parameter
- 71B
- Laesense
- llama3.3
- E phatlalalitsoe
- Nov 26, 2024
Laesense ke ea moetsi oa mofuta. Hlahloba lipehelo tsa eona pele u sebelisa mofuta.
Hugging Face e kopa hore u amohele meeli ea moetsi pele u khoasolla mofuta ona. Ha ho kit e rekisoang bakeng sa oona.
Ea mantlha ho Hugging Face ↗Mohopolo o hlokahalang ho latela quantization
Ka li-token tse 8,192 tsa moelelo, ho kenyelletsa 0.8 GB bakeng sa sebaka sa ho sebetsa.
| Quantization | Faele ea mofuta | Kakaretso |
|---|---|---|
| Q4_K_M | 42.8 GB | 47.9 GB(khakanyo) |
| Q5_K_M | 50.2 GB | 56.0 GB(khakanyo) |
| Q6_K | 57.9 GB | 64.4 GB(khakanyo) |
| Q8_0 | 75.0 GB | 83.3 GB(khakanyo) |
| F16 | 141.1 GB | 156.0 GB(khakanyo) |
Lisebelisoa tse o sebelisang khadi ea litšoantšo
Ka Q4_K_M le li-token tse 8,192 tsa moelelo.
Ha ho sesebelisoa se ka lenaneng la rona se o sebelisang ka ho feletseng khadi ea litšoantšo ka tlhophiso ena.
Hlahloba ho komporo ea hauMofuta o le mong ka API
Morekisi ea theko e tlase ka ho fetisisa: NanoGPT, $0.99 ka khoeli ka tšebeliso ea kamehla (likopo tse 200 ka letsatsi).
Bona litheko ho Model Price MapLintlha tsa mefuta li tsoa lenaneng la sechaba la Hugging Face (mabitso, boholo, litokelo tsa tšebeliso). Leqephe leleng le le leng la mofuta le hokahane le la mantlha.