IWantAllTheData

Joined 2 years ago

Karma
16
Submissions
12
Member since
Jul 15
View on Hacker News

Recent submissions

Comment · 2 years ago
Thanks for letting me know. I will choose a better wording.

Eng. Rate (%) is Engagement Rate. Which is a common metric marketers look into when hiring an influencer.

Comment · 2 years ago
All the scrapers are in Python but im slowly transferring it to Golang, i find it much faster.

The website is NextJS.

Comment · 2 years ago
So many useful stuffs in the comments. Thank you, will give this a read as well.
Comment · 2 years ago
Thank you. Yes proxy bill is quite high!

Yes you are right, the ID enumeration method doesn't work with TikTok.

Comment · 2 years ago
I appreciate the positive comment. Thanks!

Fun fact: I did the UI Design, frontend/backend web development, database, servers, scraping and everything else by myself. It took me few months but i guess its worth it.

Comment · 2 years ago
I use proxy.
Comment · 2 years ago
Will check it out thanks. I'm always ready to take down the site if TikTok reach out me to.
Comment · 2 years ago
Yes, I did receive some backlash, which is understandable. However, this is a very useful tool for content creators to find out what's trending on TikTok. It is also used by brands to analyze market sentiment about them.

I can't share the specifics, but i can explain the methodology in private. My contacts are on the website.

Comment · 2 years ago
All the data were scraped without creating a TikTok account, AKA public data. Google.com has scraped more TikTok profiles and videos than me.

In fact, one the way i did it is by scraping google search results itself.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton