3LC: Workflow and Visualization for Fine Tuning LLMs

An Intellyx Brain Candy Brief 

The neural networks that power LLM training models are expensive to build and maintain, and only a few companies have the resources to invest in them.

Anyone wishing to use their own data with generative AI bots, however, has to fine tune the models created using public data to meet their specific requirements.

That’s where 3LC (three lines of code) comes in. Founded by former video game developers, 3LC offers a unique 3D visualization to illustrate problems that occur in fine tuning LLMs. 3LC can immediately correct issues with quality or accuracy of data, and feed the updated data back through the training process.

For example, an electric utility company uses drones to photograph their towers for bird nests. Fine tuning the model based on the photographs typically produces false positives. 3LC can detect and eliminate such false positives and immediately verify the results.

3LC integrates the major aspects of the LLM tuning pipeline, which typically operate in silos: pre-training (i.e. data cleansing), training, and post-training validation. Integrating the pipeline allows them to quickly fix and validate the quality of the training data, which is the key to improving accuracy.

They can discover where the model learned something incorrect, and get the model to “unlearn” the error.

3LC illustrates their findings using an interactive 3D visualization dashboard that allows you to select and drill down on errors, false positives, and indications of bias and improve the quality of the data fed into training the model.

The first version of the product was released in May and is currently in beta with early adopters. The product runs in your data center, using your data.

The product name derives from the three lines of code that integrates their package into your code.

Copyright © Intellyx BV. Intellyx is an industry analysis and advisory firm focused on enterprise digital transformation. Covering every angle of enterprise IT from mainframes to artificial intelligence, our broad focus across technologies allows business executives and IT professionals to connect the dots among disruptive trends. None of the organizations mentioned in this article is an Intellyx customer. No AI was used to produce this article. To be considered for a Brain Candy article, email us at pr@intellyx.com.