View: Conversational GenAI training and inference on private data

An Intellyx Brain Candy Brief by Jason English, from KubeCon NA 2024

View.io Logo Intellyx BCView allows organizations to build GenAI capabilities atop their internal databases, file systems, knowledge stores and communications with a trainable conversational AI that can be managed through a low-code, drag and drop interface. 

By ingesting data through policy-based crawling and recognition of data and object storage within on-prem or secure network environments according to regulatory and compliance policies, private and proprietary data is never used as an unintended trainer for an LLM project in someone else’s cloud.

Data gleaned from the organization’s documents is stored in S3 buckets or an intermediate database, which allows natural language queries, but the real power happens when you bring your own AI model (HuggingFace, Llama, Gemini, etc.) and let it work safely using internal company data without outside exposure.

The resulting AI query and inference workloads are often much leaner than expected, and are demonstrated to run on CPUs nearly as fast as GPUs.

 

Copyright ©2024 Intellyx B.V. Intellyx is an industry analysis and advisory firm focused on enterprise digital transformation. Covering every angle of enterprise IT from mainframes to artificial intelligence, our broad focus across technologies allows business executives and IT professionals to connect the dots among disruptive trends. At the time of writing, View is not an Intellyx customer. No AI was used to write this article. To be considered for a Brain Candy article or event visit, email us at pr@intellyx.com.

SHARE THIS:

Principal Analyst & CMO, Intellyx. Twitter: @bluefug