As data platform scenarios continue to expand, database compatibility and post-deployment experience are becoming increasingly important for developers. Platforms need to let existing data sources participate in more functions, and they also need to consider how to clean up the demo environment after product experience is complete.
qData Data Middle Platform Open-Source Edition v1.6.5 is officially released. This update focuses on enhanced Apache Doris data source adaptation and a new demo data cleanup script, improving data management and development capabilities as well as the data cleanup process for demo environments.
- Expanded Doris Data Source Support to Improve Data Management and Development
Apache Doris is an open-source analytical database for real-time analytics, commonly used in data analysis, report queries and other business scenarios. Previously, qData Open-Source Edition already supported Doris data source connection, data query and data integration. Based on that, v1.6.5 further extends Doris data source support to metadata management and data development, enabling it to participate in more daily data management and development processes.
Metadata management now supports Doris data sources
In enterprise data platforms, data tables and fields continue to increase as business grows. Beyond connecting to and querying data, the platform also needs to understand the structure and basic information of data resources for subsequent data management. After this update, the metadata management module of qData Open-Source Edition supports Doris data sources. Users can bring relevant Doris data resources into the platform’s metadata management process, further improving unified management of data resources. This update complements Doris adaptation in metadata management scenarios, allowing it to be used for data resource management within the platform in addition to existing connection, query and data integration capabilities.
Data development now supports Doris data sources
In actual data processing, Doris can serve not only as a target for data storage and query, but also be used directly for data processing and SQL development. Therefore, whether a data source can be used in the data development module is also part of database compatibility. v1.6.5 also expands support for Doris data sources in the data development module. Users can use Doris data sources in the qData data development module for relevant data development work. Through this expansion, the application scope of Doris data sources in qData Open-Source Edition is further complemented, and existing capabilities such as data connection, data integration, metadata management and data development can form a more complete connection.
- New Demo Data Cleanup Script for More Convenient Environment Data Management
To help developers quickly get familiar with product functions, qData Open-Source Edition provides demo data so users can experience data integration, data development and other functions after deployment. However, demo data is mainly for product experience. After the experience is complete, users may need to clean up related data and organize the environment according to their actual needs. Manually cleaning table by table is relatively cumbersome and prone to omissions.
For this scenario, qData Data Middle Platform Open-Source Edition v1.6.5 adds a demo data cleanup SQL script, making it easier for users to centrally clean up related data in the demo environment.
How does the script clean demo data?
The script mainly uses DELETE FROM statements to delete records in specified data tables. While cleaning the corresponding data, it retains the table structure, reducing repeated manual SQL execution table by table. For developers who want to experience the product first and then configure data according to their own needs, this update makes subsequent cleanup of demo data more convenient and further improves the workflow from product experience to environment organization.
Please note that before executing the cleanup script, users should confirm that the corresponding data tables do not contain business data that needs to be retained, and make necessary backups in advance to avoid accidentally deleting important records. Especially in data environments already used for actual business, the cleanup scope should be checked before executing related operations.
- Continuous Improvement of Data Source Adaptation and Open-Source Product Experience
The two updates in qData Data Middle Platform Open-Source Edition v1.6.5 focus on data management capabilities and environment experience. On one hand, Doris data source support is further extended to metadata management and data development modules, complementing Doris usage in daily data management and development workflows. On the other hand, the new demo data cleanup SQL script provides a more convenient way to organize data after product experience is complete.
For developers who continue to use qData, continuous supplementation of data source adaptation helps more existing databases participate in the platform’s data management and development processes, while improved demo data cleanup makes environment organization after product experience clearer. Continuous iteration of open-source products is reflected not only in new features, but also in ongoing improvements to existing functions, database adaptation and usage details.
In the future, qData will continue to focus on developers’ actual needs and community feedback, and continue to optimize core capabilities such as data integration, data development and data governance to provide users with a more flexible and easy-to-use open-source data middle platform.
Welcome to download and experience qData Data Middle Platform Open-Source Edition v1.6.5, and provide feedback on issues and suggestions through Gitee Issues or community channels.
Project addresses:
Gitee: https://gitee.com/qiantongtech/qData GitHub: https://github.com/qiantongtech/qData
Let’s work together to support the continuous improvement of qData Open-Source Edition and make data management and development simpler and more efficient.
Top comments (0)