It’s time to celebrate the incredible women leading the way in AI! Nominate your inspiring leaders for VentureBeat’s Women in AI Awards today before June 18. Learn More
Kong Inc., the cloud connectivity company, has announced the general availability of Kong AI Gateway, providing enterprises with an AI-native API gateway to govern and secure generative AI workloads across any cloud environment. The product, first released in beta in February, has already seen significant adoption as organizations rush to operationalize generative AI technology.
The Kong AI Gateway offers a suite of infrastructure capabilities tailored for AI, including support for multiple large language models (LLMs), semantic caching, semantic routing, semantic firewalling, and model lifecycle management. Crucially, it integrates seamlessly with Kong’s existing API platform, allowing enterprises to manage their AI alongside traditional APIs.
“Organizations and developers are building new gen AI use cases to create better user experiences and customer experiences. But like every technology in the world, in the early days of starting something new with cutting edge technology, it is very hard to scale that in production without having proper infrastructure,” explained Marco Palladino, CTO and co-founder of Kong, in an exclusive interview with VentureBeat.
According to Palladino, the Kong AI Gateway is “probably the most capable AI infrastructure technology in the world,” due to being built on top of Kong’s existing gateway features while providing deep AI-specific capabilities. He drew parallels to the early days of APIs, noting that APIs only truly exploded at scale once the right infrastructure emerged to support developers.
VB Transform 2024 Registration is Open
Join enterprise leaders in San Francisco from July 9 to 11 for our flagship AI event. Connect with peers, explore the opportunities and challenges of Generative AI, and learn how to integrate AI applications into yo …
Article Attribution | Read More at Article Source
It’s time to celebrate the incredible women leading the way in AI! Nominate your inspiring leaders for VentureBeat’s Women in AI Awards today before June 18. Learn More
Kong Inc., the cloud connectivity company, has announced the general availability of Kong AI Gateway, providing enterprises with an AI-native API gateway to govern and secure generative AI workloads across any cloud environment. The product, first released in beta in February, has already seen significant adoption as organizations rush to operationalize generative AI technology.
The Kong AI Gateway offers a suite of infrastructure capabilities tailored for AI, including support for multiple large language models (LLMs), semantic caching, semantic routing, semantic firewalling, and model lifecycle management. Crucially, it integrates seamlessly with Kong’s existing API platform, allowing enterprises to manage their AI alongside traditional APIs.
“Organizations and developers are building new gen AI use cases to create better user experiences and customer experiences. But like every technology in the world, in the early days of starting something new with cutting edge technology, it is very hard to scale that in production without having proper infrastructure,” explained Marco Palladino, CTO and co-founder of Kong, in an exclusive interview with VentureBeat.
According to Palladino, the Kong AI Gateway is “probably the most capable AI infrastructure technology in the world,” due to being built on top of Kong’s existing gateway features while providing deep AI-specific capabilities. He drew parallels to the early days of APIs, noting that APIs only truly exploded at scale once the right infrastructure emerged to support developers.
VB Transform 2024 Registration is Open
Join enterprise leaders in San Francisco from July 9 to 11 for our flagship AI event. Connect with peers, explore the opportunities and challenges of Generative AI, and learn how to integrate AI applications into yo …nnDiscussion:nn” ai_name=”RocketNews AI: ” start_sentence=”Can I tell you more about this article?” text_input_placeholder=”Type ‘Yes'”]