INFERENCE PROVIDER

Together AI

Together AI is a fully integrated inference provider and execution environment in which language models run. Together AI allows developers to run open-source models like Llama2 on one of the fastest inference stacks available.

TogetherAI-600x240
UNIQUE BENEFITS

Together AI Integration with Composable

The integration with Together AI offers unique benefits for Composable users
  • Supports JSON constraints

  • Fine-tune models with your data

FEATURES

Composable Environments

Environments are the execution runtime environment for the generative model.

Portable Task Model

Execute a task on any model and inference provider with zero changes

Single Execution Interface

For all models and providers, including streaming

Virtualization Layer

Integrate different models and providers into a single virtualized environment

Fine-Tuning

Fine-tune everything! Fine-tune your prompts, interactions, or LLM environments based on your runs.

Load-Balancing

Distributed tasks on models, based on weights

Storage, Indexing & Search
TAKE THE NEXT STEP

Get a Demo of Composable

Experience a live demo, ask questions, and discover why Composable is the right choice for your organization.