Particle Swarm Optimization

The most mesmerizing way of optimizing arbitrary functions

Photo by James Wainscoat on Unsplash

Whether we deal with machine learning, operations research, or other numerical fields, a common task we all have to do is optimizing functions. Depending on the field, some go-to methods emerged:

• In machine learning when training neural networks, we usually use gradient descent. This works…