DEV Community

Cover image for Introduction to Qlik Replicate & Architecture
Srinivasulu Paranduru
Srinivasulu Paranduru

Posted on

Introduction to Qlik Replicate & Architecture

#qlik #architecture #qliksense

Table of Contents

  1. Introduction
  2. Two modes of replication
  3. Qlik Replicate Architecture
  4. Agent Information
  5. Multiple Options in CDC
  6. Supported Environment

Introduction:

Qlik Replicate is a Client-managed log based data replication tool. That access the transaction logs from the source and applies changes to target.

Two modes of replication

  • Full Load Replication
  • Change Data Capture(CDC)

Full Load Replication: Takes every thing from source and replicates to target
Change Data Capture : Its runs continuously for the changes in the source and then propagates the changes to the download stream to target in near real time

Examples

  1. Replicate cloud to cloud
  2. Onprem to onprem databases
  3. Onprem to cloud and visa versa

Qlik Replicate Architecture

Qlik Replicate Architecture consists of 4 components

  1. Filter
  2. Transform
  3. File-Channel
  4. In-Memory
  • You can enhance the data using Filter and Transform
  • During the transformation from source to destination and some of the data exists In-Memory and Other data may exists in File Channel.
  • File Channel: File-based directory containing task defintions, metadata and other replication artifacts

Some important points:

  • Qlik CDC Replication task initially executes a full load sequence
  • Task continues running, looks for changes made to source and replicating changes to target
  • Qlik - Web-based Designer and Management console
    • Configure the environment
    • Create and configure tasks
    • Gather environmental statistics
    • Debug the environment-
  • Persistent Store : Qlik Replicate writes information from with in platform environment to external storage

Agent Information:

  • No software agents on sources and targets for mainstream databases
  • Replicate data from 100s of source systems with easy configuration
  • No software upgrades required at each database source or target

Multiple Options in CDC

  1. Transactional CDC
  2. Batch CDC
  3. Data Warehouse Ingest-Merge
  4. Message Encoded CDC

Supported Environment

Conclusion: Introduction to Qlik Replicate & Architecture

💬 If you enjoyed reading this blog post and found it informative, please take a moment to share your thoughts by leaving a review and liking it 😀 and follow me in dev.to , linkedin, github

Top comments (0)