DEV Community

mage0535
mage0535

Posted on

From 2 hours to 40 minutes: how I built a multi-platform publishing pipeline

I run content across multiple platforms. Publishing used to eat two hours every morning — copy, paste, reformat, re-upload covers, write tags per platform. It was the most mechanical part of my day.

So I built a pipeline. One Markdown file in, platform-ready packages out. Here is how it works, and the mistakes I made along the way.

The architecture

The pipeline has five layers:

  1. Content layer — one Markdown file plus a material checklist (title, summary, images, tags, target platforms). Structured input makes everything downstream deterministic.
  2. Strategy layer — topic data, platform rules, publish plan.
  3. Processing layer — format converters per platform, image matching, cover generation, tag generation.
  4. Gate layer — content integrity checks, image verification, anti-AI-taste detection, platform rule validation.
  5. Distribution layer — push to draft boxes for auto platforms, build ready-to-post packages for manual ones.

Every layer has a clear input and output contract. That is the whole trick: standards, not magic.

The three habits that saved the most time

Standardize input first. My first attempt failed because every article had a different structure — the script could not parse anything reliably. Once I enforced a template, everything downstream worked.

Gate everything. No gates means errors multiply across every platform at once. I check title, body, images, tags before anything ships. Images get re-verified after CDN upload — uploaders often fail silently.

Keep a manual fallback. Automation breaks. Platforms change APIs, rate limits appear, rules shift. Every workflow keeps a manual path so a single failure never stops the day.

Mistakes I made

  • Tried full automation on day one. Built a half-working thing in three days and almost gave up. Cover 80% of cases, handle the rest manually, iterate.
  • Did not check upload failures. Some CDN uploaders print a warning but do not fail — broken images shipped. Now I count images after every publish.
  • Over-automated a 3-minute task with a 2-hour script. Rule of thumb: automate only what repeats 3+ times a week for 15+ minutes each.

Result

Two hours became forty minutes. Error rate dropped because every step has a standard. Adding a new platform costs one converter and one distributor.

Automation is not magic. It is structure — and structure is copyable.

Top comments (0)