Difference Between GGUF and GGML



AI Summary

  • GGUF and GGML
    • Binary formats for distributing large language models (LLMs)
    • Implemented as C libraries for machine learning
  • Origin
    • GG: Initials of the creator, Georgia
  • GGML
    • Replaced by GGUF
    • No longer supported by llama.cpp team
  • GGUF
    • Introduced by llama.cpp team
    • Extensible, future-proof format
    • Stores additional model metadata
    • Improved tokenization code for better model performance