At Denodo, we have always believed that AI-based assistance holds tremendous potential to simplify and democratize data management. With the development of large language models (LLMs) and other generative AI (GenAI) technologies in recent years, we have doubled our efforts to create the best AI-powered assistance features and experiences for our users. With the release of Denodo Platform 9.1, we are excited to announce the launch of Denodo Assistant, which consolidates and extends our efforts in this area, showcasing and unleashing the true potential of intelligent data fabric.
Denodo Assistant is a set of next-generation assistive features, powered by AI, built right into the Denodo Platform. By leveraging internal algorithms developed by Denodo and integrating with powerful LLMs offered by industry leaders, Denodo Assistant works alongside users, helping them by intelligently answering questions, offering suggestions, and recommending optimal solutions.
Not only are we consolidating and improving previously released AI-powered features under the umbrella of Denodo Assistant, but with Denodo Assistant we are also releasing brand new features powered by the most advanced GenAI technologies on offer today.
Simplify and accelerate the data product life cycle
The ultimate goal of Denodo Assistant is to accelerate the data product development life cycle. By simplifying traditionally tedious data management tasks and automating manual-intensive steps, Denodo Assistant will remove the current hurdles and frictions that slow down the data deployment process, and it will empower more personas throughout the data management process. From the enterprise perspective, this means reduced costs, increased innovations, and ultimately. shortened time-to-insight and time-to-market.
We have spent years learning and understanding the individual personas and unique challenges involved throughout the data product development lifecycle. Denodo Assistant features have been designed and developed from these deep insights to help augment and assist our users with their unique needs and challenges.
The power of AI, unleashed with a semantic layer
Although all technology vendors today assert that their CoPilot or Assistant is the most intelligent, we contend that Denodo Assistant holds the key to true intelligent assistance that is game-changing. What distinguishes it is not merely its use and integration of LLMs, which is a common feature, but rather the extensive semantic layer it utilizes.
Denodo Assistant leverages the rich semantic layer and active metadata offered by the Denodo Platform. Artificial intelligence (AI) and machine learning (ML) techniques use this data to dynamically train, guide, and empower Denodo Assistant features, given the context. With the right metadata being applied to the right task, we are amplifying the power and value of AI techniques and delivering massive productivity gains to users. This combination of cutting-edge AI techniques and the rich semantic layer makes Denodo Assistant uniquely placed to tackle some of the most difficult challenges in data management today.
Denodo Assistant automates metadata enrichment
A great example of how Denodo Assistant can use the rich technical metadata stored within the Denodo Platform is the creation of new logical data views and metadata.
On the one hand, creating new views and metadata can often be the most time-consuming, and tedious task in a data management project. On the other hand, without good, accurate metadata, such as view descriptions, it’s very difficult for business-oriented data consumers to find and use relevant data sets.
With Denodo 9.1, we are releasing a new Denodo Assistant feature that can automatically suggest view and column descriptions based on sample data and metadata associated with the data view. By leveraging LLMs and highly optimized pre-built prompts, users who know nothing about a new Denodo data view can easily create an accurate and relevant view description with a click of a button.
And yes, Denodo Assistant can generate view and column descriptions in multiple languages!
To extend the power of this Denodo Assistant feature, and scale the automatic generation of metadata even further, we are also shipping new stored procedures that enable developers to generate and populate empty view and column descriptions in batches. This feature will not only simplify the creation of new views and metadata but it will also help increase the adoption and utilization of existing Denodo Platform data views.
Denodo Assistant as your SQL Ninja friend
For more advanced users, who use SQL for advanced data management tasks, it can often be helpful to get some just-in-time SQL help (I include myself in that category!). During those times when you can’t find that friend who is a “SQL Ninja,” Denodo Assistant is here to help you during those stressful moments now.
The new Denodo Assistant for VQL shell feature works alongside users to help explain and diagnose SQL in an interactive way. We believe that the true power of technology such as LLMs is not to replace data developers but to augment and amplify what they do best. The Denodo Assistant for VQL shell is a great example of this, and we have big plans for future iterations of Denodo Assistant to take data developer productivity to an even higher level.
Denodo Assistant helping to improve system performance
Query performance tuning and optimization is another data management task that is critically important, yet difficult to execute. Denodo Assistant is ready to help here, with Automatic Summary Recommendations features.
In this case, the active or operational metadata stored by the Denodo Platform provides Denodo Assistant with the necessary insights to recommend summary views to cache. The Smart Query Acceleration engine uses these cached summary views to make massive improvements to query performance, especially against large data tables and complex queries.
While the automatic summary recommendations feature can potentially make massive improvements to query performance, the analysis of query logs and the identification of the correct summary view to cache have been difficult and time-consuming tasks for our customers. But as you can see from the screen grab below, Denodo Assistant makes it as easy as clicking a button! Not only is it much easier and faster to identify the correct summary view to cache, but by leveraging ML techniques and statistics, Denodo Assistant will also help identify the best summary view to cache, based on previous query logs and performance.
The power of intelligent data fabric
Denodo Assistant represents a comprehensive re-development of our AI-powered features and capabilities and will form the foundation of our intelligent data fabric strategy going forward. By seamlessly integrating advanced AI capabilities with the Denodo Platform’s robust semantic layer, we are delivering a truly intelligent data fabric that empowers users at every stage of the data product life cycle.
With Denodo 9.1, we are only at the beginning of this exciting journey. We invite you to explore the full spectrum of Denodo Assistant features and experience firsthand how they can accelerate data delivery and improve developer productivity in your enterprise.
Welcome to the new era of intelligent data fabric, with Denodo Assistant!
- Welcome to the Era of Denodo Assistant - November 20, 2024
- Unlocking the Power of Generative AI: Integrating Large Language Models and Organizational Knowledge - February 22, 2024
- The Key Components of a Successful Data Lake Strategy - March 16, 2023