How to define constaints and enable CKM check for non fatal ODI error?

Rajneesh shukla — Tue, 28 Apr 2020 15:20:20 +0000

How to define constaints and enable CKM check for non fatal ODI error?

Apr 25 '20 Comments: 1 Answers: 0

I was wondering about some examples of enabling checks at CKM for routing non fatal errors into E$ table.

I wanted to invite some examples on -how to set/enable CKM checks/few examples of conditions to capture non fatal errors?
If there is data type mismatch between source and target and

…

Open Full Question

Apache Kafka tool evaluation related queries

Rajneesh shukla — Mon, 06 Apr 2020 14:45:22 +0000

Hello All,

I need below information about Apache Kafka tool for data integration and ETL needs:

Development effort:

The development effort , time and complexity is more in general?

Maintainability:

Is it less maintainable?

Error Handling:

Only possesses a single log file? or possesses a log and error port in every transform?
What kind of errors can be handled?

Various teams needed:

Separate Administration team or Unix or NT Admin will suffice needed works. hence it does not need a dedicated administer?

File Structure:

Only able to read record with single type of delimiter?

Data Integration Capability:

ODI boasts comparatively lesser range of Data Integration Products and capability which includes many related functions such as profiling and data quality ? Also, if it offers these capabilities then these are more mainstream in nature?

Market Segments:

Serves medium to large scale companies?

Debugging:

Is it offer easy debugging? Example -just place some watchers on required places and intermediate data will be saved in temporary files for easy viewing. or complex debugging process through debugger?

Company Strategy:

You can download a scaled down free version of their software and plenty of free documents available on internet?

Go live rate:

High “GO Live” success? any know issue during deployment?

Scalability:
Is there any issue with stability? If yes then why is the issue and what is impact?
Which kind of scalability is supported- horizontal, vertical?

Performance:
Can it supports High volume of data movement, transformation and integration (ETL operations)?
How about parallelism - mapping level parallelism, session level parallelism, supports multiple parallel source and multiple target data loads?

Heterogeneous system:
It integrates data from various heterogeneous systems like multiple variety of databases (SQL server, Oracle, DB2 etc), files (XML, XLS, CSV, text etc)?
Targets can be any type of DB , file etc.?

Big Data support:
It can be integrated and used for Big Data?

On cloud solution:
It is available for both- on cloud and on premises platforms?

Pricing:
Is it free ware - open source? Does it come in basic, standard and enterprise editions flavors? If yes , all flavors are free?

Repository:
Does it offers repositories ? Those repositories are for metadata?
Host for repositires should be relational database?

Push down mechanism:
Do we have pushdown optimization concepts, where it can generate SQL statements from the workflow/mapping which can be directly executed on database?
It is ETL or ELT tool?

Job scheduling:
Does it come with in-built scheduler?

Version controlling:

Does it offer version controlling?
If yes then it is tightly controlled or moderate?

Tool Bugs:
Any known tool bugs? Any issue due to those bugs?

Anything else you want to highlight?

Thanks,

Rajneesh

I need to discuss regarding RESTful API for accessing oracle database tables.

Rajneesh shukla — Sat, 28 Mar 2020 19:26:06 +0000

Hello All,

I need to discuss regarding RESTful API for accessing oracle database tables.
API was created using Oracle Rest Data Services (rest data enable at SQL developer).
I am getting error : 401 unauthorized while doing query through post man as below:

GET http://localhost:8080/ords/autodemo2/metadata-catalog/

However below is working fine (code 200 OK):
http://localhost:8080/ords/autodemo2/open-api-catalog/

Not sure why metadata query is facing authorization issue while swagger(open API) one is giving response without issue at postman.

I tried for other schema alias autodemo and here both are giving proper response:
http://localhost:8080/ords/autodemo/metadata-catalog/
http://localhost:8080/ords/autodemo/open-api-catalog/

Thanks,
Rajneesh

DEV Community: Rajneesh shukla

How to define constaints and enable CKM check for non fatal ODI error?

How to define constaints and enable CKM check for non fatal ODI error?

Apache Kafka tool evaluation related queries

I need to discuss regarding RESTful API for accessing oracle database tables.