INFERENCE PROVIDER
Together AI
Together AI is a fully integrated inference provider and execution environment in which language models run. Together AI allows developers to run open-source models like Llama2 on one of the fastest inference stacks available.
UNIQUE BENEFITS
Together AI Integration with Composable
The integration with Together AI offers unique benefits for Composable users
-
Supports JSON constraints
-
Fine-tune models with your data
FEATURES
Composable Environments
Environments are the execution runtime environment for the generative model.
Portable Task Model
Execute a task on any model and inference provider with zero changes
Single Execution Interface
For all models and providers, including streaming
Virtualization Layer
Integrate different models and providers into a single virtualized environment
Fine-Tuning
Fine-tune everything! Fine-tune your prompts, interactions, or LLM environments based on your runs.
Load-Balancing
Distributed tasks on models, based on weights
Storage, Indexing & Search
TAKE THE NEXT STEP