loading...

Discussion on: What's your worst nightmare as a coder?

Collapse
ddaly profile image
David Daly

Production releases on a Friday evening 😐

Collapse
ziarv profile image
Zia

exactly :)

Collapse
akulbe profile image
Aaron Kulbe

I think the goal should be to get to the place where this isn't a big deal. Testing in production should be a thing. That's not a trolling comment, and I'm dead serious.

Get to where you can deploy multiple times a day, every day, all day.

For reference, read stuff by Charity Majors about observability.

Collapse
ferricoxide profile image
Thomas H Jones II

Don't forget, "when a critical resource is starting two weeks' PTO the next day".

Collapse
ddaly profile image
David Daly

That's bringing it to a whole other level 😂

Collapse
arlopezg profile image
Alejandro López

Doing this today. Yeah...

Collapse
ddaly profile image
David Daly

Good luck 👍

Thread Thread
arlopezg profile image
Alejandro López

Thanks! We just happened to find a somewhat-critical error on Google Analytics and decided to pull the trigger ASAP to get it fixed. Shouldn't be too traumatic of a deploy :)

Collapse
crh3675 profile image
Hoovinator

Hope you have some good CI/CD for that :-)

Thread Thread
arlopezg profile image
Alejandro López

Yup! Jenkins rules :)

It didn't go as well as it could (some repo drama), but we managed to get stuff done. Yay!

Thread Thread
crh3675 profile image
Hoovinator

Awesome! Late night deploys suck, we have to in some cases to reduce user downtime. We had to recently migrate an entire AWS VPN - business team was "shipping their pants". It went fine with minimal downtime. Which leads to a question, when should Developers NOT tell business about some changes? I have found that sometimes they make things worse off than they should be.

Collapse
chiefnoah profile image
Noah Pederson

I think this heavily depends on the risk and impact of the deploy

Collapse
ddaly profile image
David Daly

I definitely agree with you here, but on Friday evenings people can often get distracted with weekend plans. Then if something goes wrong with a deployment, asking people to stay late and resolve the issues can be hard (for everyone involved).

This can be challenging, and its why our team generally tries to avoid this (but it does happen sometimes).

Collapse
david_j_eddy profile image
David J Eddy

Been there, done that. Leave before they ask you to work weekends.

Collapse
kylefilegriffin profile image
Kyle Griffin

If they are asking, you don't need to say yes. If you need to get out the building before this, then they are not asking you, in which case you need to LEAVE THAT JOB!

Collapse
ilvalerione profile image
Valerio

😆😆😆😆😆 great