Do you run Integration Tests during each CI build?

Integration tests are tests that cross boundary. There are many pros and cons of running those every time.

Pros

• A more complete functionality test

Cons

• Slow
• External dependencies not related to the code you are testing
• Need to create external test environment (e.g. test database, qa account in prod)
• Network restrictions from CI server in Enterprise environment

So, what do you do?

Comments

[Suraj Shrestha]

Last time I was running some Integration tests that calls Google Translate api.
The tests were failing and Azure Pipelines was rerunning those tests for some reason.
Unfortunately, Google Translate isn't free. So, it ended up costing me $400 for some stupid integration tests that I ignored :(.