DEV Community: William Chen

Data Flow: Aggregate Transformation

William Chen — Thu, 23 Jan 2025 01:24:46 +0000

In Azure Data Factory (ADF), one of the key transformations available in ADF Data Flows is the Aggregate Transformation, which is used to summarize or aggregate data based on specified conditions. step by step guide at Data Flow: Aggregate Transformation

Data Migration Checklist: A Starting Point

William Chen — Sun, 19 Jan 2025 16:29:20 +0000

Creating a robust data migration checklist can be challenging, particularly for those new to the process. To simplify this, we’ve compiled a core set of essential activities for effective data migration planning. This checklist, designed to support thorough preparation for data migration projects, has been successfully used across diverse migration projects over several years, including those for financial institutions (including banks), insurance companies, consulting firms, and other industries. While not exhaustive, it provides a solid foundation that can be customized with project-specific requirements.

It is available for download as a template.

Locking Mechanisms in Relational Database Management Systems (RDBMS)

William Chen — Fri, 17 Jan 2025 20:44:22 +0000

Locks are crucial for ensuring data consistency and integrity in relational databases. Understanding the different types of locks, lock granularity, locking protocols, and isolation levels is essential for database developers and administrators to design and manage concurrent applications effectively.
detail at https://mainri.ca/2025/01/17/locking-mechanisms-in-relational-database-management-systems-rdbms/

Leveraging Azure Key Vault for Secrets Management and Encryption

William Chen — Wed, 15 Jan 2025 15:28:47 +0000

Key vaults define security boundaries for stored secrets. It allows you to securely store service or application credentials like passwords and access keys as secrets. All secrets in your key vault are encrypted with a software key. When you use Key Vault, you no longer need to store security information in your applications. Not having to store security information in applications eliminates the need to make this information part of the code. detail at https://mainri.ca/2024/08/31/using-key-vault-services-in-azure-ecosystem/

Provision a service principal by registering an application in Azure Active Directory (Azure AD).

William Chen — Mon, 13 Jan 2025 03:10:30 +0000

Create Service Principle, Register an application on Azure Entra ID (former Active Directory) (https://mainri.ca/2024/08/14/create-service-principle-register-an-application-id-on-azure-entra-id-former-active-directory/)

A Service Principal in Azure is an identity used by applications, services, or automated tools to access specific Azure resources. It’s tied to an Azure App Registration and is used for managing permissions and authentication.

Provision a service principal by registering an application in Azure Active Directory (Azure AD)

William Chen — Sun, 12 Jan 2025 16:38:04 +0000