One thing that I have learned with large datasets is to add pagination in queries/APIs and always do them server side. Client side paginations are not good enough for large datasets.
Also in general, always query less data than more and then request more as needed. For example, lets say you are loading a table for users. You could have 2 million users in the database. Do you really want to query all 2 million at once even if you have optimized the code and hardware for it ? I would say No. Query may be a few hundred at once and then query more as needed.
Also in general, always query less data than more and then request more as needed. For example, lets say you are loading a table for users. You could have 2 million users in the database. Do you really want to query all 2 million at once even if you have optimized the code and hardware for it ? I would say No. Query may be a few hundred at once and then query more as needed.