Derivative of Sigmoid and Cross-Entropy Functions

A step-by-step differentiation of the Sigmoid activation and cross-entropy loss function

Kiprono Elijah Koech
Towards Data Science
5 min readAug 10, 2022

--

This article will go through step-by-step differentiation of Sigmoid and Cross-Entropy functions. The understanding of derivatives of these two functions is essential in the area of machine learning when performing back-propagation during model training.

Photo by Saad Ahmad on Unsplash

--

--