DEV Community

Discussion on: Neural Networks are Overrated

amueller profile image
Andreas Mueller

Cool article and an important point. Thanks for recommending our book! Neural networks are certainly not a cure-all, though it's tricky business to compare different algorithms on the same data because there are so many hyper parameters. For example increasing the number of iterations or using the sag sober solver might have improved the linear model, but take longer. Similarly a larger hidden layer (or changing any of the other tuning parameters) might have positive effects for the neural network.
I think the main takeaway should be: never try neural networks first. Start with something simple and try complex models later if the gain in accuracy justifies for the added complexity in your application.