Default model
Supported models
Any model available through the AI21 API:jamba-1.6-large(default, long context)jamba-1.6-mini- Any other model ID the API accepts
Authentication
Environment variable:Example usage
Tool-use support
No. Single-turn and multi-turn attacks work.Notes
- Jamba models combine Transformer + Mamba (SSM) architecture for very long context
- The provider uses the OpenAI SDK pointed at AI21’s API (
base_url="https://api.ai21.com/studio/v1") - Max output tokens per request: 4,096
- Retry with exponential backoff is automatic on API failures (3 attempts)