LongLLaMA
A LLM with extensive text contexts and long context understanding.
Last updated
Features
- Processes and generates text with contexts up to 256k tokens
- Built on OpenLLaMA with the Focused Transformer method
- Retrieves passkeys reliably in very long inputs
- Includes pre-training and instruction-tuning code
- Provides inference examples in PyTorch and JAX/Flax
- Integrates with Hugging Face
Pricing Details
💰 Pricing Model:
Fully open-source under Apache 2.0 license — no commercial or paid model available.
🆓 Free Plan Details:
• Entirely free for research and commercial use.
• Includes base model weights, FoT pretraining, and instruction-tuning code without restrictions .
💳 Paid Plan Details:
None — no enterprise or premium options exist.
Tips for LongLLaMA
Related Tips
- Head-to-head comparison: Amazon SageMaker or IBM Watson Studio? · Business Operations, Programming & Development…
- Head-to-head comparison: Afforai or Recall? · Audio & Voice, Video Generation & Editing…
- You want to create a website for your business... but you don't know anything about coding? 😩 · Editing, Enhancement & Upscaling, Programming & Development
- Wasting your time among dozens of AI tools... and not knowing where to start? 🤯 · Content Management, Audio & Voice…