Align Merge Two CSV Files according to Namesake Fields #eg64

#beginners #programming #devops #opensource

Problem description & analysis

We have a txt file data1.txt, as shown below:

ID,Name,LastName,Department

12345,John,Samon,Computer Science

14524,David,Souza,Electric and Electronic

And another txt file data2.txt, as shown below:

ID,Q1,Q2,Q3,Midterm,Final

12345,100,90,75,89,100

14524,80,70,65,15,90

The two files associate through their IDs in a one-to-one relationship. We are trying to generate a new text file as follows:

ID,Name,avgQ_Average,Midterm,Final,Department

12345,John,88.33,89,100,Computer Science

14524,David,71.67,15,90,Electric and Electronic

Solution

Write the following script p1.dfx in esProc:

Explanation

A1 Import data1.txt.

A2 Import data2.txt.

A3 Join A1 and A2 through ID field in a one-to-one relationship.

A4 Create the result table sequence according to the specific structure.

A5 Export the result table sequence to mergedFile.txt.

Find how to integrate the script code with a Java program in How to Call an SPL Script in Java.

SPL open source address

Download

How to Diagram Your Cloud Architecture

Cloud architecture diagrams provide critical visibility into the resources in your environment and how they’re connected. In our latest eBook, AWS Solution Architects Jason Mimick and James Wenzel walk through best practices on how to build effective and professional diagrams.

Download the Free eBook