Recent submissions

Comment · 5 months ago
> The article points out that nobody made a movie about this guy.

What are you talking about? The article doesn't say no one made a movie about him.

There are at least three Chinese movies and a TV series about him.

Comment · 5 months ago
Comment · 6 months ago
Hot damn, fed it part of an unpublished blog post I wrote, and it got me immediately.

I'm not famous or anything. I've written some academic papers and had a couple blog posts trend on HN, which are surely in the training set.

It was able to identify me based on my style (at least according to its explanation). The way I approached the topic and some of the notation I used point to a particular academic lineage, and the general style reflected my previous blog posts.

That said, I gave it part of an (unpublished) personal essay, and it had no idea. But I have no writing in that style that's published, so it makes sense. Still impressed.

Comment · 1 year ago
Comment · 1 year ago
People do these same sock puppet studies on Twitter/YouTube/etc. and find biases there as well. There's a lot of literature out there.

Here's a recent study on YouTube from the same author as this TikTok study finding left-leaning bias in US recommendations: https://academic.oup.com/pnasnexus/article/2/8/pgad264/72424....

Here's a somewhat older study from Twitter itself where they determined that their recommendations were biased toward right-leaning accounts: https://cdn.cms-twdigitalassets.com/content/dam/blog-twitter....

IMO the interesting question is not whether an individual platform is biased and what its biases are, but rather how we might regulate recommendations given that there is always a risk of bias.

Comment · 1 year ago
Comment · 1 year ago
I think the key metric missing here is how long the user watches each video. Likes and replies are probably helpful too, but when I've used short-form video content apps like TikTok, Reels, and YouTube Shorts before, they've gotten a pretty good measure of me without me ever liking, replying, or following.

With the current methodology, the bot either watches the whole video, a fixed duration of it, or a random duration before swiping. The bot doesn't organically watch or swipe based on its interests like a human user would.

Comment · 1 year ago
Perhaps I should have been more clear. It's TikTok, so of course the only way to collect recommendations is to watch videos. Some studies watch the whole video, some just watch part of it, but it's TikTok, so fundamentally you're watching a video.
Comment · 1 year ago
It's another sock puppet study: https://arxiv.org/abs/2501.17831

Very similar methodology to an earlier study the government cited in their case against TikTok: https://networkcontagion.us/wp-content/uploads/NCRI-Report_-...

There are a number of issues with these studies, one being that the way the sock puppet bots interact with content is not exactly organic. Typically they search for content in a conditioning phase, followed by random scrolling during which the recommended videos are collected and classified by an LLM. Modern recommendation algorithms famously work by examining how long and how users engage with content, and there's none of that going on here. Still, the methodology itself and the use of LLMs to classify content is clever and probably about the best we can get.

Also, even if there _is_ a bias, it doesn't tell us why. Are the recommendations intentionally spiked, or is this simply the recommendation strategy that maximizes profit? (Or that the recommendation model thinks will maximize profit?) It's very difficult to tell, which is part of what makes these models dangerous and also part of what makes them difficult to regulate.

On a sidenote, TikTok (and presumably other content platforms) _really_ does not like these studies, as demonstrated by them nerfing search functionality after the second study above was released to prevent researchers using these techniques in the future. I haven't read the study in detail yet, but it will be interesting to see how the team at NYU Abu Dhabi adapted their methodology.

Comment · 4 years ago
Yeah, I'd say this is exactly what's going on at big tech companies. Add to that the need for an interview process that is very standardized for (1) scalability in a large company and (2) legal protection against discrimination (at least nominally), and it makes a load of sense.
Comment · 4 years ago
There's also the problem of content which doesn't have subtitles to begin with---YouTube's automatic subtitle generation is great, but could be improved and expanded to languages other than English.
Comment · 4 years ago
Yes! My perennial problem is that most Chinese TV content has excellent subtitles, but they're burned in to the videos. So if I want to watch a Chinese show with a friend who doesn't read Chinese, there's no option even for auto-translated subtitles. I've often thought of writing a script to generate subtitle files using text recognition, but haven't gotten around to it.
Comment · 4 years ago
Becoming more and more surprised by intentionally misleading headlines these days....

Shocker---you might be required to be vaccinated in order to live in a facility for ultra-sick kids, many of whom are immunocompromised. I guess that's an "insult to the Canadian anthem" somehow.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton