BitNet-Transformers
0๏ธโฃ1๏ธโฃ๐ค BitNet-Transformers: Huggingface Transformers Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch with Llama(2) Architecture
Documentation
- https://arxiv.org/pdf/2402.17764.pdf
- The Era of 1-bit LLMs - All Large Language Models are in 1.58 Bits