Expanding on this experiment using logistic regression is an interesting continuation, detailed here: https://www.teachmecoolstuff.com/viewarticle/using-logistic-...

In summary: Using logistic regression actually improves accuracy, but also performance during both runtime and during training.