qData Professional Edition V2.6.0 brings adjustments to core capabilities including data lineage, data integration, data development, data services, full-database synchronization, and data connections.
It also introduces online API testing, data source diagnostics, and a built-in Help Center, expands multi-source data adaptability, and further optimizes task logs, job management, data standards, and global interaction.
From "Connect, Compute, Use" to Traceable, Debuggable, and Troubleshootable
Once an enterprise data middle platform enters sustained use, daily work goes beyond simply "bringing data in." A piece of data typically flows through: Data Source Connection → Data Sync/Integration → Data Development → Data Processing → Data Services → API Calls.
Alongside this, a parallel R&D and O&M chain exists: Is the connection normal? How are tasks running? Where are the logs? Where does the data come from? Who uses it downstream? Is the API available? How to locate anomalies? As sources, tasks, and services grow, the challenge shifts from "Do we have the feature?" to "Can different capabilities connect seamlessly?"
Therefore, qData V2.6.0 is not a single-module enhancement but a comprehensive upgrade to the manageability, traceability, and debuggability of the entire data lifecycle.
1. Data Lineage Extended: Covering Full-Database Sync & Data Services
Real-world data chains are complex. qData V2.6.0 expands lineage coverage to include full-database synchronization tasks and data service nodes.
- Full-Database Sync Lineage: Previously, lineage might only show Source Table → Target Table. Now, the specific synchronization task is visualized as an independent node (Source Table → Sync Task → Target Table). These nodes are fully integrated into the Lineage Map, Lineage Maintenance, Impact Analysis, and Source Analysis, helping teams trace exactly how data enters the platform.
- Data Service Lineage: The system now tracks how result tables are consumed. By establishing the relationship between Source Tables and Data Services, users can trace upstream dependencies and downstream usage directly within the lineage map, facilitating interface adjustments and dependency analysis.
2. Restructured Task Entry: Separating Offline and Real-Time Workflows
Managing batch and real-time tasks in a single entry point increases complexity as scale grows. V2.6.0 restructures the menus for both Data Integration and Data Development:
- Data Integration: Split into distinct "Offline Tasks" and "Real-Time Tasks" entries.
- Data Development: Similarly separated into "Offline Development" and "Real-Time Development."
This classification aligns management interfaces with execution modes, simplifying task retrieval and O&M for enterprises handling both ETL and real-time processing.
3. Flink/Spark Cluster Mode & Expanded Data Source Support
Cluster Mode: Flink and Spark tasks are now adjusted to run in cluster mode, optimizing execution architecture.
New Adapters: Data development capabilities have been verified and expanded to include Dameng Database, ODPS, and Hive. This reduces fragmentation for enterprises using domestic databases, cloud platforms, and data warehouses.
- Relational DB Lineage: Lineage parsing is now supported for relational database development tasks, bringing traditional SQL development relationships into the unified lineage view.
4. Optimized ETL Architecture & Task Logs
- ETL Architecture: Internal code structures and dependencies have been streamlined to reduce redundancy, providing a cleaner foundation for future maintenance.
- Task Logs: Log displays for Data Development and Job Management have been optimized. Users now get clearer visibility into execution stages, status, and exception details, reducing the time spent searching for failure points.
5. Online API Testing: Debug Directly in the Platform
Developers no longer need to switch to external tools like Postman. The new Online API Testing feature allows you to:
- Support Multiple HTTP Methods: GET, POST, PUT, PATCH, DELETE, HEAD, OPTIONS.
- Configure Requests: Set Params, Body, Headers, Cookies, and Auth details directly.
- Multi-Tab Debugging: Open multiple interface test tabs simultaneously for parallel debugging and comparison.
- Comprehensive Response View: Inspect Response Body, Cookies, Headers, Status Codes, Latency, and Data Size.
6. Full-Database Sync: OceanBase & TiDB Support
To support diverse database stacks, full-database synchronization now supports OceanBase and TiDB.
This is particularly valuable for database migration and ODS layer construction, reducing the repetitive work of configuring table-by-table sync tasks.
7. Data Connection Diagnostics
"Connection Failed" is often too vague. The new Diagnostics feature breaks down the failure point by checking:
- Network address resolution and port connectivity.
- Account authentication and permissions.
- Database/Schema accessibility and metadata reading capabilities.
This allows teams to pinpoint whether an issue lies with the network, credentials, or permissions.
8. Expanded Logical Model Publishing
Logical model publishing now supports Kingbase, PostgreSQL, and Oracle.
Users can choose between "Drop and Recreate" (for rebuilding structures) and "Incremental Publishing" (for syncing changes), offering flexibility for different production environments.
9. Built-in Help Center
A Help Center is now embedded directly into the platform interface (drawer style).
Users can access user manuals and feature documentation without leaving their current workflow, covering modules from Data Modeling to Data Governance.
10. Job Management UI & Global UX Improvements
- Job Management: The UI for complex task orchestration has been upgraded, optimizing the canvas layout, node display, and configuration entry points for better clarity.
- Data Standards: "Standard Data Elements" and "Code Tables" are now managed as separate, independent menus to clarify management boundaries.
- Global Validation: Unified input validation (e.g., preventing empty or whitespace-only inputs) and a compact left-side category tree style improve overall usability and data entry consistency.
Release Value: From Capability to Synergy
qData V2.6.0 focuses on the synergy between data ingestion, development, governance, services, and O&M.
By extending lineage, separating offline/real-time workflows, adding online debugging, and expanding heterogeneous data source support, this release ensures that the data middle platform is not just a collection of tools, but a cohesive, traceable, and efficient ecosystem.
These enhancements provide a stronger foundation for enterprise data governance and continuous operation, reducing information breakpoints and streamlining the path from data ingestion to service delivery.
Top comments (0)