DEV Community

Super Kai (Kazuya Ito)
Super Kai (Kazuya Ito)

Posted on • Edited on

1

Global or Local Minima and Maxima and Saddle Points in Deep Learning

Buy Me a Coffee

<Global and Local Minima>

  • A global minimum is the globally minimal point whose gradient is zero but not a local minimum.

  • A local minimum is the locally minimal point whose gradient is zero but not a global minimum.

Image description

*Memos:

  • I used math3d.
  • The left formula is 10x/e^(x^2+y^2)(-x)^e. *x∈ is [-3, 3] and y∈ is [-3, 3].
  • The right formula is -4x/e^(x^2+y^2)(x)^e. *x∈ is [-3, 3] and y∈ is [-3, 3].

<Global and Local Maxima>

  • A global maximum is the globally maximal point whose gradient is zero but not a local maximum.

  • A local maximum is the locally maximal point whose gradient is zero but not a global maximum.

Image description

*Memos:

  • I used math3d.
  • The left formula is -10x/e^(x^2+y^2)(-x)^e. *x∈ is [-3, 3] and y∈ is [-3, 3].
  • The right formula is 4x/e^(x^2+y^2)(x)^e. *x∈ is [-3, 3] and y∈ is [-3, 3].

<Saddle Points>

A saddle point is the combination point of a local minimum and maximum.

Image description

Image description

*Memos:

  • I used math3d.
  • The formula is x^2-y^2. *x∈ is [-4, 4] and y∈ is [-4, 4].

Image of Timescale

Timescale – the developer's data platform for modern apps, built on PostgreSQL

Timescale Cloud is PostgreSQL optimized for speed, scale, and performance. Over 3 million IoT, AI, crypto, and dev tool apps are powered by Timescale. Try it free today! No credit card required.

Try free

Top comments (0)

Billboard image

The Next Generation Developer Platform

Coherence is the first Platform-as-a-Service you can control. Unlike "black-box" platforms that are opinionated about the infra you can deploy, Coherence is powered by CNC, the open-source IaC framework, which offers limitless customization.

Learn more

👋 Kindness is contagious

Please leave a ❤️ or a friendly comment on this post if you found it helpful!

Okay