In the beginning stages of deep learning, the sigmoid function is used. It’s an easily derived and practically used smoothing function. The term “sigmoidal” originates

It is common practice for deep learning’s initial stages to employ sigmoid activation. This smoothing sigmoid function is easy to figure out from the basics