Comment by Falcorian

Here is an overly simple example:

Pre-compute the recommended hotels for my top users every night. Now when that user comes back, they see a slightly stale recommendation, but it's lightning fast.

You can also pre-compute and cache some of the inputs cheer model, like maybe a vector representation of the description of a hotel.