Red Hat OpenShift AI Unleashes the Power of Generative AI Across Hybrid Clouds
Image credit: Red Hat (logo)
Overview
Red Hat, Inc., the world-renowned open source solution provider, has unveiled new capabilities for Red Hat OpenShift AI, focused on simplifying the adoption of generative AI across hybrid cloud environments. The new AI-oriented portfolio builds upon the existing features of Red Hat OpenShift and Red Hat OpenShift Data Science to provide IT operations leaders with a scalable and reliable open source technology foundation.
The new Red Hat OpenShift AI promises to drive AI innovation by fostering a specialized partner ecosystem. Prominently, it powers IBM’s watsonx.ai - a next-gen AI platform designed to scale intelligent applications and services across every facet of an enterprise. Red Hat OpenShift AI is well-equipped to harness the potential of Large Language Models (LLMs) like GPT-4 and LLaMA, which are becoming mainstream.
Despite the vast potential of AI models, their initial training poses a considerable challenge, requiring specialized platforms and tools. OpenShift AI addresses these demands by providing infrastructure consistency across training, deployment, and inference, unlocking the potential of AI for organizations.
Streamlining AI Adoption with OpenShift AI
OpenShift AI aids in creating production AI/ML models and running the resulting applications. It features the consistency, user-friendliness, and cloud-to-edge deployment options of Red Hat OpenShift. This enables platform engineers to tailor scalable configurations that meet the needs of their data scientists and developers.
The solution comes with several optional offerings from technology partners like Anaconda, IBM Watson Studio, Intel OpenVINO, NVIDIA AI Enterprise, and Starburst. Moreover, it offers access to an extensive ecosystem of 30 additional AI/ML certified partners.
For customers with stringent regulatory and compliance requirements, OpenShift AI serves as a unique, hybrid MLOps environment that fosters collaboration between IT operations, data science, and application developers. This enables customers to train foundation models reliably, either on-premises or via a cloud service.
Recent Advancements in OpenShift AI
The recent upgrades to Red Hat OpenShift AI include deployment pipelines for AI/ML experiment tracking, automated ML workflows, GPU support for inference, custom model serving runtimes, and model monitoring capabilities. These additions empower data scientists and intelligent application developers to iterate on machine learning projects more quickly and build automation into application deployment and updates.
Notably, OpenShift AI powers IBM watsonx and Ansible Lightspeed, which utilize IBM Watson Code Assistant to deliver domain-specific AI to IT organizations and developer teams. This integration enables users of all skill levels to write Ansible Playbooks with AI-generated recommendations, providing a productivity boost for Ansible users.
Enterprises Already Reaping Benefits
Several enterprises have already started leveraging Red Hat OpenShift AI to fuel AI/ML innovation. Atruvia, Clalit Health Care Services, Guidehouse, Tirando X Colombia, and Veripark are amongst the organizations that have incorporated OpenShift AI into their AI/ML workflows, achieving remarkable results.
Industry Voices
Chris Wright, CTO and Senior Vice President, Global Engineering at Red Hat, asserted that while foundation models provide tangible benefits to enterprises, they require an investment in training and fine-tuning to cater to the unique needs of an enterprise. He emphasized that OpenShift AI provides a flexible and scalable foundation to use foundation models in production.
Expressing satisfaction with OpenShift, Liora Shechter, CIO at Clalit, and Sebastian Jaramillo, Social Innovation Manager at Tirando x Colombia, lauded the platform's capabilities, emphasizing how OpenShift has significantly improved their respective operations and societal impact. Source