OPEA – Open Platform for Enterprise AI

OPEA, the Open Platform for Enterprise AI, is a new project with Linux Foundation it provides a framework of composable microservices for state-of-the-art Gen AI systems including LLMs, data stores and prompt engines to expedite enterprise adoption. It provides blueprints of end-to-end workflows for popular use-cases such as ChatQnA, CodeGen and RAG systems. OPEA offering from Infosys includes ARM templates for deploying the RAG services on Azure AKS. This offering will enable organizations to setup and create RAG applications and bootstrap common design patterns up and running.

• The project supports framework of composable building blocks for state-of-the-art generative AI systems including LLMs, Vector stores, and prompt engines. • It provides scalable document ingestion pipelines which support PDF, word, HTML documents. OPEA code is licensed under Apache 2, so organizations can quickly customize their index design, search and filtering techniques. • Provides support for industry leading hardware providers for adopting Open source models as well as proprietary models for implementing RAG applications • A four-step assessment for grading generative AI systems around performance, features, trustworthiness, and enterprise-grade readiness • It provides ready-made recipes and deployment scripts to deploy solutions in cloud-native fashion • Other than common RAG patterns it supports Agent service, Avatar Animation service and technical services like Telemetry, Feedback management, prompt management and Guardrail services to deploy innovative and secure microservices