DEV Community

David Haley
David Haley

Posted on • Edited on

Running a Vertex AI custom container

After creating our container, it's time to run it.

Our first container didn't work (of course). After a few iterations we got it running. 🎉

Vertex AI job list, 3 failed and 1 succeeded

After a container path whoopsie, the main challenge was fetching the active machine config from within the container.

Previously, we'd copy the notebook id into the benchmark then use the notebook API to fetch the machine config. We found the API to describe the custom job by ID which has the machine info … but you don't have an ID until the job is created. 🤨

This StackOverflow answer had the key. You do get to set a display name, then you can fetch all jobs filtered on that name.

So we'll need to make sure those job names (nominally for display) are actually unique identifiers…

Hostinger image

Get n8n VPS hosting 3x cheaper than a cloud solution

Get fast, easy, secure n8n VPS hosting from $4.99/mo at Hostinger. Automate any workflow using a pre-installed n8n application and no-code customization.

Start now

Top comments (0)

Billboard image

The Next Generation Developer Platform

Coherence is the first Platform-as-a-Service you can control. Unlike "black-box" platforms that are opinionated about the infra you can deploy, Coherence is powered by CNC, the open-source IaC framework, which offers limitless customization.

Learn more

👋 Kindness is contagious

Please leave a ❤️ or a friendly comment on this post if you found it helpful!

Okay