DEV Community

Cover image for Difference between Iteration and Epoch in Neural Networks
Ruthvik Raja M.V
Ruthvik Raja M.V

Posted on

1

Difference between Iteration and Epoch in Neural Networks

Epoch describes the number of times the algorithm sees the entire dataset whereas an Iteration tells the number of times a batch of data passed through the algorithm.

For example, consider the input dataset consists of 100,000 records and if we train the model for 10 epochs, let the batch size = 1 i.e loading each data point every time and performing forward, backward propagation for every data point [Optimiser would be the Stochastic Gradient Descent]. Hence, the number of iterations per epoch for the above example would be 100,000 and the total number of epochs would be 10.

Top comments (0)

A Workflow Copilot. Tailored to You.

Pieces.app image

Our desktop app, with its intelligent copilot, streamlines coding by generating snippets, extracting code from screenshots, and accelerating problem-solving.

Read the docs

👋 Kindness is contagious

Please leave a ❤️ or a friendly comment on this post if you found it helpful!

Okay