Comment by IanCal

SGD is fast but not necessarily more accurate. If you've got lots and lots of data, then a simple yet fast approach is likely to be a good choice to start with.