Comment by amorroxic

This. Same scenario here, fondly remember 1080ti, that was the workhorse for us alongside cloud training (startup with ~100 nlp prod models, ner, siamese, count models, etc). ULMFiT and language transfer was the moment when upgrades felt necessary though 2080ti’s vram unfortunately stayed the same (never had access to Titans for instance so perspective may be limited).