These are 2 valid concerns. Using localStorage to cache the URL already looked up would help for the pages you visit the most (gmail.com, twitter, etc). Having a whitelist/blacklist of site {not,} to lookup might also help.
Let me know if you think these 2 features would actually help. I could implement them.
Thanks for your comment!