LLMaaS (Large Model as a Service)
AWS bedrocks simplifies working with LLMs via SDK and API and also with third party such as lang chain and Llama index
Features
- Model catalog
- Custom models - Fine tuning,
- Playgrounds - chat, completion
- Prompt Management - store prompt templates
- Knowledge Base - RAG + Search
- Prompt Flows - Statemachine (overlaps langchain and llmaa index)
- Agents for Agentic workloads
- Guardrails - Pre and Post filters
- Inference
- Eval Assessment
- Bedrock studio