<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:dc="http://purl.org/dc/elements/1.1/">
  <channel>
    <title>DEV Community: Mintu Ghosh</title>
    <description>The latest articles on DEV Community by Mintu Ghosh (@vedaforge_eng).</description>
    <link>https://dev.to/vedaforge_eng</link>
    <image>
      <url>https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F4076575%2F23946cfa-c2e3-42d3-bc38-0ece462d54f2.jpg</url>
      <title>DEV Community: Mintu Ghosh</title>
      <link>https://dev.to/vedaforge_eng</link>
    </image>
    <atom:link rel="self" type="application/rss+xml" href="https://dev.to/feed/vedaforge_eng"/>
    <language>en</language>
    <item>
      <title>Deploying Microsoft Fabric items from Azure DevOps with a service principal</title>
      <dc:creator>Mintu Ghosh</dc:creator>
      <pubDate>Thu, 13 Aug 2026 17:55:00 +0000</pubDate>
      <link>https://dev.to/vedaforge_eng/deploying-microsoft-fabric-items-from-azure-devops-with-a-service-principal-4nfa</link>
      <guid>https://dev.to/vedaforge_eng/deploying-microsoft-fabric-items-from-azure-devops-with-a-service-principal-4nfa</guid>
      <description>&lt;p&gt;Microsoft Fabric workspaces are edited in a browser. That works until you have&lt;br&gt;
more than one environment and need changes to move between them with a review&lt;br&gt;
step and a way back.&lt;/p&gt;

&lt;p&gt;This is the smallest thing that does that: one Python script, one Azure DevOps&lt;br&gt;
pipeline, three branches, three workspaces. Runs as a service principal, so no&lt;br&gt;
human session is involved.&lt;/p&gt;

&lt;p&gt;Full code: [&lt;a href="https://github.com/vedaforge-team/fabric-cicd-reference/tree/v1.0.0" rel="noopener noreferrer"&gt;https://github.com/vedaforge-team/fabric-cicd-reference/tree/v1.0.0&lt;/a&gt;]. &lt;br&gt;
This post covers the parts worth understanding&lt;br&gt;
before you copy it.&lt;/p&gt;
&lt;h2&gt;
  
  
  The shape
&lt;/h2&gt;


&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight plaintext"&gt;&lt;code&gt;Development workspace  --(Fabric Git integration)--&amp;gt;  Azure DevOps repo
                                                            |
                                        develop  -&amp;gt;  validate against DEV
                                        release  -&amp;gt;  deploy to UAT
                                        main     -&amp;gt;  deploy to PROD
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;


&lt;p&gt;Only the Development workspace is Git-connected. UAT and PROD are reached over&lt;br&gt;
the Fabric REST API by the pipeline.&lt;/p&gt;

&lt;p&gt;Connect UAT to Git as well and that environment has two sources of truth: the&lt;br&gt;
repository, and whoever last edited the workspace directly. Both will look&lt;br&gt;
current. Nothing errors.&lt;/p&gt;
&lt;h2&gt;
  
  
  The script is a thin wrapper
&lt;/h2&gt;

&lt;p&gt;Everything environment-specific arrives as an environment variable. The pipeline&lt;br&gt;
supplies them from variable groups.&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight python"&gt;&lt;code&gt;&lt;span class="k"&gt;def&lt;/span&gt; &lt;span class="nf"&gt;build_workspace&lt;/span&gt;&lt;span class="p"&gt;()&lt;/span&gt; &lt;span class="o"&gt;-&amp;gt;&lt;/span&gt; &lt;span class="n"&gt;FabricWorkspace&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;
    &lt;span class="n"&gt;credential&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="nc"&gt;ClientSecretCredential&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;
        &lt;span class="n"&gt;tenant_id&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="nf"&gt;read_env&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;TENANT_ID&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;),&lt;/span&gt;
        &lt;span class="n"&gt;client_id&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="nf"&gt;read_env&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;CLIENT_ID&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;),&lt;/span&gt;
        &lt;span class="n"&gt;client_secret&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="nf"&gt;read_env&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;CLIENT_SECRET&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;),&lt;/span&gt;
    &lt;span class="p"&gt;)&lt;/span&gt;
    &lt;span class="k"&gt;return&lt;/span&gt; &lt;span class="nc"&gt;FabricWorkspace&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;
        &lt;span class="n"&gt;workspace_id&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="nf"&gt;read_env&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;TARGET_WORKSPACE_ID&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;),&lt;/span&gt;
        &lt;span class="n"&gt;environment&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="nf"&gt;read_env&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;TARGET_ENVIRONMENT_NAME&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;),&lt;/span&gt;
        &lt;span class="n"&gt;repository_directory&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="n"&gt;repository_directory&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
        &lt;span class="n"&gt;item_type_in_scope&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="nf"&gt;read_csv&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;ITEM_TYPES_IN_SCOPE&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;DEFAULT_ITEM_TYPES&lt;/span&gt;&lt;span class="p"&gt;),&lt;/span&gt;
        &lt;span class="n"&gt;token_credential&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="n"&gt;credential&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
        &lt;span class="n"&gt;exclude_paths&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="nf"&gt;read_csv&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;EXCLUDE_FOLDERS&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;),&lt;/span&gt;
    &lt;span class="p"&gt;)&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Twelve variables in total, covering authentication, the target workspace, the&lt;br&gt;
source directory, and switches for validation and cleanup.&lt;/p&gt;
&lt;h2&gt;
  
  
  Validate-only is not a no-op
&lt;/h2&gt;

&lt;p&gt;The &lt;code&gt;develop&lt;/code&gt; branch runs the same script with &lt;code&gt;VALIDATE_ONLY=true&lt;/code&gt;. Ordering&lt;br&gt;
matters more than it looks:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight python"&gt;&lt;code&gt;&lt;span class="n"&gt;workspace&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="nf"&gt;build_workspace&lt;/span&gt;&lt;span class="p"&gt;()&lt;/span&gt;          &lt;span class="c1"&gt;# authenticates, resolves, parses
&lt;/span&gt;
&lt;span class="k"&gt;if&lt;/span&gt; &lt;span class="nf"&gt;read_bool&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;VALIDATE_ONLY&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;):&lt;/span&gt;
    &lt;span class="nf"&gt;print&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;Validation-only mode. No workspace changes applied.&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
    &lt;span class="k"&gt;return&lt;/span&gt;

&lt;span class="k"&gt;if&lt;/span&gt; &lt;span class="nf"&gt;read_bool&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;REMOVE_ORPHANS&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="bp"&gt;True&lt;/span&gt;&lt;span class="p"&gt;):&lt;/span&gt;
    &lt;span class="nf"&gt;unpublish_all_orphan_items&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;workspace&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;span class="nf"&gt;publish_all_items&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;workspace&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Constructing &lt;code&gt;FabricWorkspace&lt;/code&gt; is what authenticates the service principal,&lt;br&gt;
resolves the target workspace and parses every item in the repository. It is the&lt;br&gt;
validation. Return before it and every &lt;code&gt;develop&lt;/code&gt; build goes green having checked&lt;br&gt;
nothing.&lt;/p&gt;

&lt;p&gt;Worth a test that asserts validation actually validates, because a refactor that&lt;br&gt;
moves that line will not otherwise fail anything.&lt;/p&gt;
&lt;h2&gt;
  
  
  Branch gating
&lt;/h2&gt;

&lt;p&gt;Three stages, each gated only by the branch. No &lt;code&gt;dependsOn&lt;/code&gt; between them.&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight yaml"&gt;&lt;code&gt;&lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;stage&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Deploy_UAT&lt;/span&gt;
  &lt;span class="na"&gt;condition&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;and(succeeded(), eq(variables['Build.SourceBranch'], 'refs/heads/release'))&lt;/span&gt;
  &lt;span class="na"&gt;variables&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
    &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;group&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;VG-Fabric-UAT&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;There is no automatic DEV to UAT to PROD chain. Promotion happens when someone&lt;br&gt;
merges a pull request, which is where review happens. A commit never walks itself&lt;br&gt;
into production.&lt;/p&gt;
&lt;h2&gt;
  
  
  Warehouse is excluded on purpose
&lt;/h2&gt;

&lt;p&gt;Sixteen item types are in scope. Warehouse is not:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight python"&gt;&lt;code&gt;&lt;span class="n"&gt;DEFAULT_ITEM_TYPES&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="p"&gt;[&lt;/span&gt;
    &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;DataPipeline&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;Lakehouse&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;Notebook&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;SemanticModel&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
    &lt;span class="c1"&gt;# "Warehouse" is intentionally excluded. Warehouse schema deployment must
&lt;/span&gt;    &lt;span class="c1"&gt;# be handled separately to avoid schema reset risk during publish.
&lt;/span&gt;    &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;Environment&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;Eventhouse&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;Eventstream&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;KQLDatabase&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
    &lt;span class="bp"&gt;...&lt;/span&gt;
&lt;span class="p"&gt;]&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Publishing a warehouse through this path can reset its schema. An automation&lt;br&gt;
that handles most cases and silently corrupts the rest is worse than one that&lt;br&gt;
refuses the rest.&lt;/p&gt;

&lt;h2&gt;
  
  
  The part that actually breaks
&lt;/h2&gt;

&lt;p&gt;The code above is not where deployments fail. They fail on prerequisites.&lt;/p&gt;

&lt;p&gt;I ended up writing them down and there are 43, across six categories: Fabric&lt;br&gt;
environment (6), identity and security (10), Azure DevOps configuration (10),&lt;br&gt;
deployment configuration (7), validation (4), post-deployment verification (6).&lt;/p&gt;

&lt;p&gt;Identity is the largest, and three of those ten are the same check repeated per&lt;br&gt;
environment: is the service principal actually a member of this workspace. It&lt;br&gt;
needs to be added to DEV, UAT and PROD separately. Nothing in the repository&lt;br&gt;
indicates when it is missing.&lt;/p&gt;

&lt;p&gt;That produces a misleading failure mode. A missing permission surfaces as an&lt;br&gt;
error thrown by the deployment step, which is the last thing in the chain and&lt;br&gt;
the first thing you look at. The error is real, the deployment did fail, and the&lt;br&gt;
code is fine.&lt;/p&gt;

&lt;p&gt;The checklist is in the repo at &lt;code&gt;docs/checklists/DEPLOYMENT_READINESS_CHECKLIST.md&lt;/code&gt;.&lt;br&gt;
Of everything this produced, it is the part I would copy first.&lt;/p&gt;

&lt;h2&gt;
  
  
  Environment template
&lt;/h2&gt;



&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;&lt;span class="nv"&gt;TENANT_ID&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;
&lt;span class="nv"&gt;CLIENT_ID&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;
&lt;span class="nv"&gt;CLIENT_SECRET&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;
&lt;span class="nv"&gt;TARGET_WORKSPACE_ID&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;
&lt;span class="nv"&gt;TARGET_ENVIRONMENT_NAME&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;DEV
&lt;span class="nv"&gt;REPOSITORY_DIRECTORY&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;./.
&lt;span class="nv"&gt;VALIDATE_ONLY&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="nb"&gt;true
&lt;/span&gt;&lt;span class="nv"&gt;REMOVE_ORPHANS&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="nb"&gt;true
&lt;/span&gt;&lt;span class="nv"&gt;ENABLE_SHORTCUT_PUBLISH&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="nb"&gt;true
&lt;/span&gt;&lt;span class="nv"&gt;LOG_LEVEL&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;INFO
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Keep &lt;code&gt;VALIDATE_ONLY=true&lt;/code&gt; until you are sure the target is right.&lt;/p&gt;

&lt;h2&gt;
  
  
  Known limitations
&lt;/h2&gt;

&lt;ul&gt;
&lt;li&gt;No approval gates. A merge to &lt;code&gt;main&lt;/code&gt; deploys production unattended.&lt;/li&gt;
&lt;li&gt;No &lt;code&gt;parameter.yml&lt;/code&gt;, so items referencing a workspace-specific resource by GUID
still point at the source environment after deployment.&lt;/li&gt;
&lt;li&gt;One solution per repository. The layout and variable naming assume it.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Stack: &lt;code&gt;fabric-cicd&lt;/code&gt; 1.2.0, Python 3.12, &lt;code&gt;ubuntu-latest&lt;/code&gt;.&lt;/p&gt;




&lt;p&gt;Full walkthrough: [&lt;a href="https://www.linkedin.com/pulse/building-enterprise-microsoft-fabric-cicd-practical-guide-mintu-ghosh-f3dbf/" rel="noopener noreferrer"&gt;https://www.linkedin.com/pulse/building-enterprise-microsoft-fabric-cicd-practical-guide-mintu-ghosh-f3dbf/&lt;/a&gt;] &lt;/p&gt;

&lt;p&gt;Code: [&lt;a href="https://github.com/vedaforge-team/fabric-cicd-reference/tree/v1.0.0" rel="noopener noreferrer"&gt;https://github.com/vedaforge-team/fabric-cicd-reference/tree/v1.0.0&lt;/a&gt;].&lt;/p&gt;

&lt;p&gt;Next post covers what happens when a second team needs the same repository, and&lt;br&gt;
why "just add path filters" does not work.&lt;/p&gt;

</description>
      <category>microsoftfabric</category>
      <category>azuredevops</category>
      <category>cicd</category>
      <category>python</category>
    </item>
  </channel>
</rss>
