Vertex AI
Google's Vertex AI is a fully integrated inference provider and execution environment in which language models run. Vertex AI is a machine learning (ML) platform that enables developers to customize large language models (LLMs) for use in AI-powered applications.
By connecting to the Vertex AI environment in Composable Studio, you will have access to over 150 foundation models including Gemini, Imagen, Codey, Anthropic's Claude Model Family, Gemma, and Llama 3.
Google Vertex AI Integration with Composable
The integration with Vertex AI offers unique benefits for Composable users
-
Single API for all of Google’s models instead of the 3 different APIs for PaLM, Bison, and Gemini
-
Easy to use prompt studio Access to Google's Gemini multimodal models
Composable Environments
Environments are the execution runtime environment for the generative model.
Portable Task Model
Execute a task on any model and inference provider with zero changes
Single Execution Interface
For all models and providers, including streaming
Virtualization Layer
Integrate different models and providers into a single virtualized environment
Fine-Tuning
Fine-tune everything! Fine-tune your prompts, interactions, or LLM environments based on your runs.
Load-Balancing
Distributed tasks on models, based on weights