크기가 작은 LLM 모델들
Tiny Llama 1.1B
https://github.com/jzhang38/TinyLlama
GitHub - jzhang38/TinyLlama: The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.
The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens. - jzhang38/TinyLlama
github.com
tiny llama 1.1b onnx
https://github.com/wangzhaode/llm-export/releases
Releases · wangzhaode/llm-export
llm-export can export llm model to onnx. Contribute to wangzhaode/llm-export development by creating an account on GitHub.
github.com
Microsoft Phi-2 (2.7B)
https://huggingface.co/microsoft/phi-2
microsoft/phi-2 · Hugging Face
Model Summary Phi-2 is a Transformer with 2.7 billion parameters. It was trained using the same data sources as Phi-1.5, augmented with a new data source that consists of various NLP synthetic texts and filtered websites (for safety and educational value).
huggingface.co