Recent submissions

Comment · 6 years ago
MLScrape is an API that allows you to scrape data from a wide variety of product pages, without having to maintain your own web scraper. It's now available on RapidAPI and comes with a free trial.

The API currently scrapes the following data (more will be coming soon):

Name Price Image URL Specification Identifiers: SKU, UPC/EAN, ISBN

Comment · 6 years ago
No problem, you can send an email to [email protected] :)
Comment · 6 years ago
Thanks for getting in touch, I've just sent over an email
Comment · 6 years ago
That's really useful feedback, especially the part about NLP models, thanks!!
Comment · 6 years ago
Yes, a universal price tracker is a great example! Another potential use cases would be competitor price analysis so that you can react in real time to changes in your competitor's prices.
Comment · 6 years ago
It's currently a prototype, so I haven't fully finished integrating all the computer vision algorithms which means that it may miss some data in certain situations - but the purpose at this stage was just to see if this is something people would genuinely use and to get general feedback to help me decide what features to prioritise going forward.
Comment · 6 years ago
Yes that's pretty much it - using a mix of ecommerce APIs and manual work to create data, and then using that as training data
Comment · 6 years ago
Hello,

Over the past few months I've been working on a neural-network based web scraper for e-commerce websites. The aim is to be able to scrape product data from any product page (so far it extracts the name, price, main image URL and technical specification of the product).

I've developed a working prototype of the API along with a demo page (with rate limits so please use it within reason! ) in order to get some feedback before I carry on with the project.

Because the API is only a prototype, there are some features which are currently missing but will be added later on - for example: • Only English sites that use GBP, EUR or USD are supported • I haven't finished integrating my computer vision algorithms, which means that in some specific situations, the API might not detect a strikethrough and will therefore mix-up the "current price" of the product with the "old price" • The service is running on a hobby heroku server so the API takes a few seconds longer than it otherwise would.

I would appreciate any feedback on the API, in particular: • Is there any other product data that you would like to see (e.g product ID, delivery costs, etc)? • What sort of applications would you use this API for once it's fully developed? • Apart from e-commerce sites, what other types of websites would you like to see an API for (e.g news websites, real estate listings, etc)?

Comment · 11 years ago
Aware (which can be downloaded from the above link) is an app that works a lot like Google Now on Tap, except for the fact that it is designed to analyse news articles and then present information about the main people in the article (for example,their wikipedia or instagram page).Moreover,it isn't restricted to devices running Android Marshmallow, but it is compatible with Jelly Bean forward (unlike Now on Tap). Try it, you might just like it

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton