The Solution
We implemented a generative AI feature that translates the raw SQL of a component into a natural language description. The AI-generated text lives directly in the existing description field, making it seamless with the platform.
The feature is optional, discoverable, and editable. Users can regenerate descriptions or make their own edits. The AI interface was designed to be flexible, allowing deployment wherever a description field exists and ensuring it has access to the component’s SQL. The interface also clearly communicates that the text is AI-generated.
User Feedback
We conducted a test with 10 participants familiar with the platform. Each ran the AI on 10 different Audiences and evaluated accuracy, completeness, and business readability.
Results showed that the AI performed well on accuracy but sometimes missed on completeness, failing to describe all aspects of the Audience. Some outputs were too technical for business users, describing some lines in SQL terms. Despite this, participants found the interface intuitive and seamless. Users who previously wrote descriptions manually described the feature as “magical” and appreciated the time savings.