landyman

I haven't used Spidermon yet, but Scrapinghub has a Scrapy plugin called Splash which can be used to render JS pages within a Scrapy spider.

I'm pretty sure Excel can do all of this. I think if all of the data has already been ported to Excel, it would be much easier to figure out how to make Excel do what you want than to port the data to something else and learning something else.

In this example, you could filter the data by name, sort the results by the date, and highlight all duplicate addresses using conditional formatting.

If you really don't want to use Excel, you could load the csv in almost any programming language; read in the records, find the duplicates and spit the resulting records back out into whatever format you want.

Rosetta Stone

I agree that it seems valid. I also think that Google would most definitely use that data if they had it. Google used to show live twitter results in their SERPs; but stopped when Twitter took that data away if I remember correctly.

I think it was Apple 2 as well. This was the first thing I looked for.

I work with ellyagg and I can confirm that he did in fact gain 25 lbs in a month using GOMAD, CrossFit and some additional strength work at the gym.

In the same time, I lost about 23 lbs with a diet of few carbs and no processed food, and doing the same exercise routine. I've kept it off even after going back to more normal diet. But, I plan on doing it again since I've still got some weight to lose.

Yes, which is what we thought too. But, you can setup a "custom search engine" with some default site (we used www.google.com), then change the settings to that it uses the entire web, and remove the site that you originally put in.

The Bing and Yahoo APIs are definitely a lot better, IMO. But, as long as Google wants me to use their Custom Search API, then that's what I'll use.

Google has told me (and other users of the now deprecated AJAX Search API) to switch to their paid Custom Search API.

The new API is missing some features that were in the old API, which is unfortunate. And, also unfortunate, the most accurate Google results (Local, Web, Image, etc.) come from scraping in ways like this article describes. Hopefully, Google will address these issues in its Custom Search API. If they don't many people will still continue to scrape.

Yes, you can change the amount with ARB -- once you have the subscription id, you can change pretty much anything about that subscription.

In my experience, Titles do matter. Titles matter not only as a main "ranking factor", but also because the Title is most often the link from the search engine result to the webpage. Having keywords in there means that those keywords will be highlighted/bolded in the result, making them stand out -- I don't know if that actually makes people click on links more often, but I wouldn't bet against it.

Also, using Apple as an example from the article, Apple's Title is Apple because people don't get to the Apple site by searching for "mp3 player". People go to Apple's site because they want an Apple product. Apple doesn't need to try and rank for all that other stuff; it's not what they do and they don't need it. Branding is different than ranking.