Recent submissions

Comment · 1 month ago
Surely you see how your anecdotal experience isn't sufficient to understand the false positive rate of these systems, right?

My 11 year old reddit account was banned a couple of hours into my engagement vacation to bhutan. After putting a local sim in my phone, I was first locked out of my account - I then passed their verification and unlocked it, just to wake up the next morning to an account ban. Their anti abuse systems are clearly very poorly calibrated for anybody who even slightly deviates from normal account access patterns.

Comment · 2 months ago
That counts as 200% on exploitbench to me!
Comment · 3 months ago
They already have a bright light that when covered, disables the camera
Comment · 5 months ago
I believe they rewrite the chain of thought to protect their IP, i.e. the chain of thought reveals information about how the model works in a manner that may aid replication
Comment · 1 year ago
we don't know if that's due to inherent limitations of the tokenisation of audio, or a byproduct of reinforcement learning. In my own usage, I noticed a significant degradation in capabilities over time from when they initially released advanced voice mode. The model used to be able to sing, whisper, imitate sounds and tone just fine, but I imagine this was not intended and has subsequently been stunted via reinforcement learning.

I don't find the articles argument that this is due to tokenisation convincing.

Comment · 1 year ago
advanced voice mode operates on audio tokens directly, it doesn't transcribe them into "text tokens" as an intermediate step like the original version of voice mode did.
Comment · 1 year ago
RAG certainly doesn't reduce hallucinations to 0, but using RAG correctly in this instance would have solved the hallucinations they describe.

The purpose of the system described in this post is OCR inaccuracies - it's convenient to use LLMs for OCR of PDFs because PDFs do not have standard layouts - just using the text strings extracted from the PDFs code results in incorrect paragraph/sentence sequencing.

The way they *should* have used RAG is to ensure that subsentence strings extracted via LLM appear in the PDF at all, but it appears they were just trusting the output without automated validation of the OCR.

Comment · 1 year ago
do you care to elaborate or are we being mysterious today?
Comment · 1 year ago
No it didn’t. You’re literally just making this up, I worked at RL
Comment · 1 year ago
Based on your comment it's apparent you neither follow the industry closely nor understand it's dynamics. The vast majority of the billions of dollars are being pumped into R&D, not marketing existing legacy devices.

You also seem to be implying in your comment that the orion glasses displayed at connect last year were a last minute pivot, which is a ludicrous statement

Comment · 1 year ago
Meta haven't abandoned the metaverse, and made it very clear from the beginning that "the metaverse" was something that does not exist, and will not exist in any form until the end of the decade. They continuously reiterate this during earnings calls, while increasing their capital expenditures on it.

You cannot determine it's a waste if the effort isn't completed, and if you have no insight into their progress.

Comment · 1 year ago
I completely disagree. This is really just more of the great execution that I've come to expect from Sam Altman.

Core to OpenAI's strategy is that they control not just the models, but also the entrypoints to how these models are used. Don't take it from me, this is explicitly their strategy according to internal documents (https://x.com/TechEmails/status/1923799934492606921).

Some important entrypoints are:

- Entrypoints for layman consumers: They already control this entrypoint due to ChatGPT, the app. They have a limited moat here because they are at the whims of the platform owners, primarily Apple and Google. This is why they are purchasing Ive's startup.

- Entrypoints for developers: They acquired Windsurf, and are actively working on cloud development interfaces such as the new codex product.

- Entrypoints for enterprise: They have the codex products as described above, but also Operator, and are actively working on more cloud based agents.

A rebuttal that I anticipate to the above goes something along the lines of this: "If they have so much capital and dev experience, why are they acquiring these businesses instead of building internal competitors? This is a demonstration of their failure to execute"

The current AI boom is one of the most competitive tech races that has ever occurred. It is because of this, and particularly because they are so well capitalised that it makes sense to acquire instead of build. They simply cannot afford to waste time building these products internally if they can purchase products much further along in their development, and then attach them to their capital and R&D engine

Comment · 1 year ago
Whatsapp has been audited several times, and to say that an engineer at meta “has been lied to” is laughable given he/she has access to the entire codebase

Source: also worked at meta and had full access to WhatsApps codebase, like most engineers at meta

Comment · 3 years ago
Do you seriously believe nobody in the non English speaking world can write code?

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton