DEV Community: Naveen

STRUGGLING WITH IRREGULAR CSV FILES IN OIC? HERE’S THE NXSD SOLUTION

Naveen — Wed, 10 Jun 2026 17:14:01 +0000

Handling non-uniform CSV/TXT files in Oracle Integration Cloud (OIC) is a common real-time integration challenge. These files often contain inconsistent structures like headers, mixed record types, or variable columns. This blog explains how to process such files using NXSD (Native Format Schema Definition) and trigger notifications effectively.

UNDERSTANDING THE CHALLENGE

Below is csv/txt file, which is Variable number of columns

Code,Message,Date
F,Hello,nj@gmail.com,957351,01-06-2026
S,Hey,ab@gmail.com,45466,02-06-2026
P,Bye,ck@gmail.com,87979,03-06-2026

This kind of files we need to process in OIC with most effectively.

STEP 1: CREATE FLEXIBLE NXSD SCHEMA
NXSD enables parsing flat files into structured XML.

Note: Observe & understand the below script with respective the challenge mentioned.

<?xml version="1.0" encoding="UTF-8" ?>
<xsd:schema xmlns:xsd="http://www.w3.org/2001/XMLSchema"
            xmlns:nxsd="http://xmlns.oracle.com/pcbpel/nxsd"
            xmlns:tns="http://TargetNamespace.com/fileReference/read"
            targetNamespace="http://TargetNamespace.com/fileReference/read"
            elementFormDefault="qualified"
            attributeFormDefault="unqualified"
            nxsd:version="NXSD"
            nxsd:stream="chars"
            nxsd:encoding="UTF8">

    <xsd:element name="Root-Element">
        <xsd:complexType>
            <xsd:sequence>

                <xsd:element name="headerset">
                    <xsd:complexType>
                        <xsd:sequence>
                            <xsd:element ref="tns:header"/>
                        </xsd:sequence>
                    </xsd:complexType>
                </xsd:element>

                <xsd:element name="lineset">
                    <xsd:complexType>
                        <xsd:sequence>
                            <xsd:element ref="tns:line" minOccurs="1" maxOccurs="unbounded"/>
                        </xsd:sequence>
                    </xsd:complexType>
                </xsd:element>

            </xsd:sequence>
        </xsd:complexType>
    </xsd:element>
    <xsd:element name="header" type="tns:headerType"/>
    <xsd:element name="line" type="tns:lineType"/>
    <xsd:complexType name="headerType">
        <xsd:sequence>
            <xsd:element name="C1" type="xsd:string"
                         nxsd:style="terminated"
                         nxsd:terminatedBy=","
                         nxsd:quotedBy="&quot;"/>
            <xsd:element name="C2" type="xsd:string"
                         nxsd:style="terminated"
                         nxsd:terminatedBy=","
                         nxsd:quotedBy="&quot;"/>
            <xsd:element name="C3" type="xsd:string"
                         nxsd:style="terminated"
                         nxsd:terminatedBy="${eol}"
                         nxsd:quotedBy="&quot;"/>
        </xsd:sequence>
    </xsd:complexType>
    <xsd:complexType name="lineType">
     <xsd:sequence>
            <xsd:element name="C1" type="xsd:string"
                         nxsd:style="terminated"
                         nxsd:terminatedBy=","
                         nxsd:quotedBy="&quot;"/>
            <xsd:element name="C2" type="xsd:string"
                         nxsd:style="terminated"
                         nxsd:terminatedBy=","
                         nxsd:quotedBy="&quot;"/>
            <xsd:element name="C3" type="xsd:string"
                         nxsd:style="terminated"
                         nxsd:terminatedBy=","
                         nxsd:quotedBy="&quot;"/>
            <xsd:element name="C4" type="xsd:string"
                         nxsd:style="terminated"
                         nxsd:terminatedBy=","
                         nxsd:quotedBy="&quot;"/>
            <xsd:element name="C5" type="xsd:string"
                         nxsd:style="terminated"
                         nxsd:terminatedBy="${eol}"
                         nxsd:quotedBy="&quot;"/>               
        </xsd:sequence>
    </xsd:complexType>
</xsd:schema>

Save the above script as XX_FILENAME.xsd

STEP 2: BUILD OIC INTEGRATION

Create Application Based Integration which accepts the request body as Binay Format.

Read file using stage action as below

Remember to upload your XSD file here as below in the stage read file operation

STEP 3: Write the file for Notification

Using stage action with Write Operation , write a file which has been read in the early step
make sure upload the same XSD file for sample data.

STEP 4: SEND NOTIFICATIONS

Hope we are familiar with OIC notification as below map data from write operation.

Finally, we read & write the non-uniform csv file in OIC successfully.

Note: ORACLE DOC reference for XSD Script

Calling OIC Integration from Oracle Fusion via HTTPS

Naveen — Mon, 08 Jun 2026 02:37:20 +0000

Oracle Fusion Applications often require integration with external or internal services to extend business capabilities. Oracle Integration Cloud (OIC) serves as a powerful middleware platform to orchestrate such integrations.

One of the most common patterns is invoking an OIC integration from Fusion using an HTTPS connection, ensuring secure and reliable communication.

In this blog, we'll walk through the end-to-end process, including setup, configuration, and best practices

Step 1: Create an OIC Integration

Login to Oracle Integration Cloud
Navigate to Integrations → Create
Choose:REST Adapter (recommended for HTTPS calls)

Configure:

 * Resource URI (e.g., /customer/update)
 * HTTP Method (POST/GET)
 * Request/Response payload (JSON/XML)

Reference

Request Payload:

Make sure you selected
What is the media-type of Request Body? (Content-Type Header)
URL-encoded for https call acceptance

Response Payload:
I drop the xml reference here for response payload

<?xml version="1.0" encoding="UTF-8"?>
<xm:schema xmlns:xm="http://www.w3.org/2001/XMLSchema">
<!-- Root element-->
<xm:element name="root" type="root"/>
<!-- Complex type-->
    <xm:complexType name="root">
      <xm:sequence>
        <xm:element name="outcome" type="xm:float"/>
        <xm:element name="Instance_ID" type="xm:string"/>
              </xm:sequence>
            </xm:complexType>
</xm:schema>

Step 2: Create an JavaScript function using libraries

Navigations

Under Design -->libraries-->upload your js function

Step 3:Call Js function in integration

call Js function in your designing & map respective inputs to your function

Step 4: Map the response of integration

As below maps the final response.

Map the primary business identifiers
Active the Integration
Try to run & collect your endpoint Metadata

Step 5: Fusion BIP https connection configuration
Now we will map the integration connection details in fusion .

So for that we will login fusion/analytics-->Under profile Icon right side [Administration]-->Publisher[Manage Publisher]

Under HTTP creation data source with OIC login details

Step 6: Fusion BIP Data Model creation

Now choose the Data Source as HTTPS connection

fill respective details as below

Step 7: Testing

Run the data model with passing parameters , it will hit the integration as Input which we earlier given as request payload.
The response will display as below, which is back from integration.

Now we will see the Integration track Instance

By following the steps above setting up OIC, configuring HTTPS calls, handling authentication, and securing communication you can build reliable and scalable integrations.

Change VBCS Default Oracle Background to a Custom Image

Naveen — Sat, 06 Jun 2026 16:01:02 +0000

Oracle Visual Builder Cloud Service (VBCS) provides a clean default UI, but often, applications require branding or a more personalized look and feel. One simple yet effective customization is replacing the default background with a custom image.

In this blog, we'll walk through how to change the default Oracle VBCS background to a custom image in a few easy steps.

Step 1: Upload Your Custom Image

By default, applications have UI like below

Let's upload your custom image in VBCS application

Using Control & Navigation will upload image

Now we will upload image in data as below

Theme also choose here

Run Preview of your application page & Inspect image for entire VBCS Url

Step 2: Add Custom CSS

Make sure you will remove the image component from the page after you got the Url

Step 3: Final Preview

Note: Use optimized images (for faster loading)

Agentless Polling in Oracle Integration Using Public Gateway and ATP

Naveen — Fri, 05 Jun 2026 15:13:41 +0000

Enabling Secure Inbound Polling Without Connectivity Agent

In Oracle Integration (OIC), polling-based integrations are a common way to process database-driven events. This blog walks through a simple and practical polling use case using the classic EMP table, enhanced with a custom column to control processing.

Use Case Overview
We want to:

Add a column to track whether a record needs processing
Use OIC to poll records from EMP table
Process only specific rows
Update status after processing

Step 1: Create ATP Connection
The Below is Reference for Oracle ATP connection in OIC.

Step 2: Create Integration

I Prefer the Application Integration, Polling mechanism will work in the Initial Endpoint in the Integration.
Call ATP Here as like below.

Make sure choose the Review the polling strategy and specify polling options

Note: Apply your requirement handling in the read & unread value W.R.T perform on the Column [HIKE is a column for my case]

Whenever I update in HIKE column to "NO", The integration polling happens using ATP Polling Event & It will update the respective rows to "YES"

The Final Integration Design as below
I mapped EMPNAME as Primary Business identifier for track.

Step 3:TEST
I will update as below

Step 4:Integration Observation

It will automatically calls & update the field to "YES"

Full Flow Summary

DB Record Update → HIKE = 'NO'
OIC Polling Query Runs
Record is Picked
Integration Logic Executes
Record Updated → HIKE = 'YES'

Conclusion

This EMP table polling example demonstrates a lightweight and efficient pattern for OIC integrations:

Add a flag column
Poll using a filter condition
Process and update status

Combined with OIC Public Gateway and ATP Adapter, this becomes a fully cloud-native solution without any Connectivity Agent dependency.

OIC Developer Guide to Create AR Customer Contact Email & Phone in Oracle Fusion Using SOAP (mergePerson)

Naveen — Thu, 04 Jun 2026 16:01:53 +0000

In Oracle Fusion, AR Customer Contacts are stored as Party Relationships. Adding or updating contact details such as phone number and email address requires interaction with the Foundation Person Service SOAP API.
This guide walks you through:

Identifying required data (PartyId & RelationshipId)
Using SOAP API to create contact points
Verifying data in backend tables

Step 1: Identify Customer Contact Details
Relationship Information

select * from fusion.hz_relationships where relationship_id=300000159607279

Party Information

select * from fusion.hz_parties where party_id= 300000159607277

Step 2: Use SOAP API to Create Contact Details
WSDL Endpoint:
Use SOAP API /crmService/FoundationPartiesPersonService to add new phone number and email for this AR Customer Contact

Operation:mergePerson
This API is used to update or merge person-related information, including contact points.

Step 3: Sample SOAP Request
Below is a working payload to create both email and phone:

<soapenv:Envelope xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/"
                  xmlns:typ="http://xmlns.oracle.com/apps/cdm/foundation/parties/personService/applicationModule/types/"
                  xmlns:per="http://xmlns.oracle.com/apps/cdm/foundation/parties/personService/"
                  xmlns:rel="http://xmlns.oracle.com/apps/cdm/foundation/parties/relationshipService/"
                  xmlns:con="http://xmlns.oracle.com/apps/cdm/foundation/parties/contactPointService/">
   <soapenv:Header/>
   <soapenv:Body>
      <typ:mergePerson>
         <typ:personParty>
            <per:PartyId>300000159607277</per:PartyId>

            <per:Relationship>
               <rel:RelationshipId>300000159607279</rel:RelationshipId>

               <!-- Email Creation -->
               <rel:Email>
                  <con:OwnerTableName>HZ_PARTIES</con:OwnerTableName>
                  <con:CreatedByModule>HZ_WS</con:CreatedByModule>
                  <con:ContactPointPurpose>BUSINESS</con:ContactPointPurpose>
                  <con:EmailAddress>Addtest@test.com</con:EmailAddress>
               </rel:Email>

               <!-- Phone Creation -->
               <rel:Phone>
                  <con:OwnerTableName>HZ_PARTIES</con:OwnerTableName>
                  <con:CreatedByModule>HZ_WS</con:CreatedByModule>
                  <con:ContactPointPurpose>BUSINESS</con:ContactPointPurpose>
                  <con:PhoneNumber>2128811223</con:PhoneNumber>
                  <con:PhoneExtension>999</con:PhoneExtension>
                  <con:PhoneLineType>MOBILE</con:PhoneLineType>
               </rel:Phone>

            </per:Relationship>
         </typ:personParty>
      </typ:mergePerson>
   </soapenv:Body>
</soapenv:Envelope>

Step 4: Validate Data in Frontend Screen

Step 5: Validate Data in Backend Tables
After successful API execution, verify using:

SELECT CONTACT_POINT_ID,
       CONTACT_POINT_TYPE,
       PHONE_TYPE,
       OWNER_TABLE_ID,
       RELATIONSHIP_ID,
       PHONE_NUMBER,
       EMAIL_ADDRESS
FROM fusion.hz_contact_points
WHERE creation_date > SYSDATE - 1
  AND created_by_module = 'HZ_WS'
  AND owner_table_name = 'HZ_PARTIES';

Step 6: From OIC

With same WSDL :https:/crmService/FoundationPartiesPersonService?WSDL
create Connection.
Call the connection in OIC with mergePerson Operation
Pass respective Values to it

Conclusion:
We successfully updated the Customer communication details using SOAP WSDL in Oracle Fusion ♥

Enabling Oracle Fusion BI Publisher Report Access via Custom Roles & Springboard

Naveen — Tue, 02 Jun 2026 16:16:47 +0000

In Oracle Fusion, BI Publisher (BIP) reports are widely used for operational & analytical. However, a common requirement in enterprise implementations is to provide secure, role-based access to specific reports and make them easily accessible through the Springboard (home page).
This blog walks you through how to:

Restrict BI Publisher report access to specific users using custom roles
Surface the report in the Springboard for quick access.

Let's start with Custom Role

Step 1: Create a Custom Role
Navigations: Under Home page-->Tools-->Security console
create new role

continue with next upto User, In the user section add respective users

Step 2: Expose Report in Springboard
Now let’s improve usability by making the report accessible directly from the home page.
Enable Sandbox
Mostly sandbox appears under Configuration in the springboard

Other way to access sandbox is from the navigations.

Once click on the sandbox, you will reflect new page like below

click on the create Sandbox and select above marked things.
Provide respective details like Sandbox name & publish yes

The next move is to click on structure

Then carefully we have to Create Group

let provide Groups as below here EL Expression important to note.
Because it plays a key role in the access reports.

followed by save & continue.

Time for create Page Entry
where actually report path provides here.

Note: we always create page entry under groups i.e. REPORT HUBSPOT is my group earlier.

In the dialog box copy entire report path with extension as like above
and validate & save -close safely.

Test the report access
By click on the home icon you will go to springboard there you will see your created group & page likes

Publish the Sanbox

Once you published , won't altered with the same sandbox. So be caution while doing activity & avoid personal bias

Final words:

By combining BI Publisher security with Fusion role-based access control and Springboard customization, you can deliver a seamless and secure reporting experience for users.

This approach not only enhances usability but also ensures compliance with organizational security standards.

Calling GET API & Mapping Response in VBCS (Service Connection)

Naveen — Sun, 31 May 2026 14:46:10 +0000

In Oracle VBCS, integrating a GET API and displaying its response on the UI is one of the most common use cases. In this blog, we’ll walk through how to:

Create a GET API (ORDS)
Configure Service Connection in VBCS
Call API using Event Trigger
Map API response to UI components

1. Sample GET API (ORDS)

Let’s first create a simple GET API to fetch data from nj_dump(NJ_DUMP is a table).

Below is code snippet for the creations GET API using PLSQL

BEGIN
  ORDS.define_template(
    p_module_name => 'nj_api',
    p_pattern     => 'get_data'
  );
END;
/

BEGIN
  ORDS.define_handler(
    p_module_name => 'nj_api',
    p_pattern     => 'get_data',
    p_method      => 'GET',
    p_source_type => ORDS.source_type_query,
    p_source      => '
      SELECT name, num, dob, email
      FROM nj_dump
      WHERE num = nvl(:num,num)
    '
  );
END;
/

ENDPOINT looks like
GET /ords//nj_api/get_data?num=101
Before moving to VBCS kindly test it in POSTMAN or Curl
Note: I prefer Basic Authorization.

2. Create Service Connection in VBCS
Navigations: Go to Services → Service Connections→ Chose define by endpoint
Click Create
Enter: respective Details

3. Add GET Endpoint
Paste your respectively GET URL in the below bar & proceed next

Once you done with GET REQUEST endpoint , you will able to see like this

4. Create Page Variables
Under Web apps we will create type & variables.

Hope you choose the type from endpoint
you will your endpoints here like this, pick get for our case.

In the next step we have to select the needed column to display in the VBCS UI

successfully create type, it will help us to create variable in the next page.

Now go to variables & create variable, make sure select the type which you created earlier.

5.Assign Variables to the form/page

I created form layout, if code needed, I would provide you at end of blog.

In the same manner add all variables to the respective columns in the form.

6. Call GET API Using Event Trigger
Now whenever we hit the Search button, The get REST endpoint will be called return the data to form.

For that we need to create an event action trigger there we will assign the get endpoint & collect the response from it and assign the same type.

7. Pass Query Parameter
choose the respective actions here & map the num Variable to the GET API endpoint

Mapper reference

8. Testing
Working as expected:

9. End-to-End Flow

User enters num
Event Trigger fires (button / field change)
GET API is called via Service Connection
Data is fetched from DB
Response stored in apiResponse
UI automatically updates

We successfully completed GET API calling in VBCS with help of Service connection & on button event trigger.

Try with Variable onValueChanged Event instead of button

Form code:

Oracle Fusion Report Scheduling with Skip Conditions

Naveen — Sat, 30 May 2026 14:48:41 +0000

In Oracle Fusion Applications, report scheduling plays a crucial role in automating business processes such as invoice generation, reconciliation, and operational reporting. However, not every scheduled job needs to run every time especially when there’s no relevant data.

This is where skip conditions come into play.

Skip conditions allow you to control whether a scheduled report or job should execute based on predefined logic.

Instead of wasting system resources, unnecessary runs are avoided, making scheduling smarter and more efficient.

Okay Let's drive-in into how we can save system resources.

1. Create your query in the Data Model.

2.Write Event Trigger
Simple choose Event Trigger in the same data model. Select Event Type as Scheduled.

FYR

Now write logic for when it should be skip. In my case when Data model no return any data, then won't triggers to clients.

SQL Query Reference when no data returns from data model.
SELECT DISTINCT 'true' FROM DUAL WHERE EXISTS ( SELECT 1 FROM abc//here your data model conditional logic )
3.Build Report with your template & schedule it
Time to schedule the report as below. You can add your parameters also in your data model.

choose your delivery channel. -In the Schedule Tab, select your frequency & Define Schedule Trigger(It's important here)
Here pick your event trigger which has written early in the data model . FYR

Conclsuion
By adopting skip conditions, organizations can:

Reduce system overhead
Improve report relevance
Enhance overall scheduling efficiency

Building a Custom API Using PL/SQL with ORDS

Naveen — Fri, 29 May 2026 09:58:10 +0000

In modern application development, exposing database logic as REST APIs is a powerful way to integrate systems. Oracle REST Data Services (ORDS) makes it easy to turn PL/SQL into RESTful APIs without needing a separate backend service.

In this blog, we’ll walk through how to create a simple POST API using ORDS and PL/SQL to insert data into a table.

Pre-requisites

A cloud-based ATP wallet (I prefer)

Let's start how we create the APIs on the top of any custom table which relies on databases

Create a table in the oracle SQL Developer
and followed by create an ORDS Module
1.Create an ORDS Module
A module is a logical container for related REST endpoints.

What this Module does ??

Creates a module named nj_api
Defines base URL: http://server_name/ords/table_Schema/nj_api/

2: Define a Template (Endpoint Path)
A template represents the API endpoint path.

It defines how Endpoint URL:/ords/table_schema/nj_api/insert_data

3: Define the Handler (Business Logic)
The handler contains the logic executed when the API is called.

Key Concepts:

p_method => 'POST': Defines HTTP method
p_source_type => ORDS.source_type_plsql: Uses PL/SQL block
Bind variables (:name, :num, etc.) map directly to JSON request body parameters 4: Testing the API Using Tools like Postman,cURL,ORDS REST Workshop I tested with Postman FYR

Let's call same in Oracle VBCS in new blog...
Try other methods like Delete, PATCH & GET

Inventory Aging in Oracle Fusion

Naveen — Thu, 28 May 2026 13:27:44 +0000

A Technical Deep Dive into Hybrid Valuation Design

Problem Statement
Building an Inventory Aging Report in Oracle Fusion seems straightforward:
Goal:

→ Bucket inventory by age (0–30, 31–60…)
→ Show quantity and value
→ Match Oracle inventory valuation However, this quickly becomes complex due to:
Separation of transaction data vs costing data
Oracle’s layer-based costing engine
Mismatch between operational and financial views

Hybrid Model – Technical Design

Transactions → Aging → Bucket Qty → Clean Qty → Denominator
Valuation → Total Amount
Final → Allocation → Report

Keep refer entire code for production ready Inventory aging report.
[(https://github.com/naveen-6735/SkyHigh/blob/main/Dev_to.sql)]

Using SQL Developer Web (Database Actions) in ATP to Create Tables & REST APIs

Naveen — Sun, 24 May 2026 14:07:27 +0000

If you're working on Oracle Autonomous Transaction Processing (ATP), one of the most powerful tools available is SQL Developer Web, also called Database Actions. It allows you to manage your database entirely from the browser no installation required.

In this blog, I'll walk you through:

Connecting to ATP using Database Actions
Creating a table using SQL Developer Web
Enabling REST APIs automatically using ORDS

What is SQL Developer Web (Database Actions) ?
Oracle provides a browser based interface called Database Actions, which is essentially an online version of SQL Developer.
It allows you to:

Run SQL and PL/SQL
Create tables and objects
Build REST APIs
Monitor performance
Load data and manage users

Step 1: Access Database Actions

Ensure you have ATP wallet (zip file).
When you zipped it. You will find that the README file. In that file you will see an URL below the Database Actions.That URL helps us to login into SQL Developer.
FYR, Login Page of Web sql Developer

Step 2: Open SQL Worksheet
Once inside:
Click: SQL → Have a Tour !!

Playground for your action

Step 3: Create a Table
Run the sql
CREATE TABLE nj_dump ( name VARCHAR2(200), num NUMBER, dob DATE, email VARCHAR2(200) );

Insert you can perform on your tables
Hey you know I learnt new way to insertion with below stmt

INSERT INTO NJ_DUMP VALUES ('Naveen Jejji', 567, DATE '2003-06-12', 'njejji@ok.com');

Step 4: Enable REST API
Now we use same table which we created earlier and enable rest.

You can search your table in Navigator panel as

Right Click on your table , you will get few more options among them .Choose the REST

Once you done with REST selection, you will be able to get the Curl options like below

Tooke entire curl and Paste in your POSTMAN application and provide necessary authentications details as below

We are Done
Try yourself for POST operation from POSTMAN applications.

In the next blog, I will cover the how we call this in our modern VBCS

Integrating OIC with Databricks using AWS S3 (External Tables Approach)

Naveen — Mon, 18 May 2026 14:05:23 +0000

Overview

In modern data integration scenarios, seamless connectivity between cloud platforms is critical. One common requirement is integrating Oracle Integration Cloud (OIC) with Databricks for performing table-based operations.

However, a key limitation arises:

❗ Databricks does not provide native RDS-style connectivity for direct table operations from OIC.

To overcome this limitation, we implement a scalable and efficient architecture:
Proposed Solution Architecture
OIC → AWS S3 → Databricks (External Tables)

This approach leverages AWS S3 as an intermediate storage layer, allowing OIC to push data, which Databricks can then consume via external tables.
Architecture Flow

1. OIC (Oracle Integration Cloud)

Acts as the data integration layer
Extracts and prepares data from upstream systems
Pushes data files (CSV/JSON/Parquet) to AWS S3

2. AWS S3 (Storage Layer)

Serves as a staging area for data
Stores files uploaded by OIC
Organizes data into structured folders (e.g., by date/source)

3. Databricks (Processing Layer)

Uses External Tables to read data directly from S3
Processes data using Spark SQL / PySpark
Performs transformations and analytics

Why External Tables?
Since Databricks cannot directly expose tables like traditional RDS systems:

✅ External tables allow querying data stored in S3
✅ No need to move data into Databricks-managed storage
✅ Enables scalable and cost-effective data access
Example:
CREATE TABLE customer_data USING CSV LOCATION 's3://your-bucket/path/' OPTIONS (header = "true");

Required Connection Details for OIC
To enable the integration (OIC → S3), the following details are required:
📦 AWS S3 Access Details

Bucket Name
Region
Folder Path (if applicable)
Access Key ID
Secret Access Key

🔗 Connectivity Configuration in OIC

Configure REST Adapter or FTP Adapter / Stage File Action
Use pre-signed URLs or API-based upload (if secured)
Ensure proper authentication mechanism (AWS Signature v4)

⚙️ OIC Design Reference
Step 1: Data Extraction

Fetch data from source application (DB / SaaS)

Step 2: Data Transformation

Convert to required format (CSV/JSON)

Step 3: File Creation

Use Stage File action in OIC

Step 4: Upload to S3

Use REST API or direct adapter
Push file into S3 bucket

✅ Advantages of This Approach

🔹 Decouples OIC and Databricks
🔹 Highly scalable using S3 storage
🔹 Cost-efficient (pay-as-you-go)
🔹 Supports batch and near real-time processing
🔹 Simplifies integration architecture

⚠️ Key Considerations

Ensure data format compatibility (CSV, Parquet preferred)
Maintain naming conventions in S3
Handle data partitioning for performance
Secure credentials using OCI Vault / AWS IAM policies
Monitor file upload success and retries in OIC

🎯 Conclusion
Due to the absence of native RDS-style table connectivity in Databricks, using an intermediary layer like AWS S3 is the most effective integration pattern.
The combination of:

OIC for orchestration
S3 for storage
Databricks external tables for processing

provides a robust, scalable, and cloud-native solution.