Why does regularizing the bias lead to underfitting in neural networks?

This article explains the reason behind the taboo of not including the bias parameter in regularization while also explaining the substantial role it plays in algorithms such as linear regression and neural networks. So read on!