steveridout

I wonder how much this depends on the quality and consistency of the context?

For example, it may be the case that a long context full of useful information relevant to the task is completely fine, perhaps even beneficial. And if the context contains a bunch of unrelated tangents and conflicting instructions, then it will be detrimental.

Have there been studies on what makes models get dumber? To what extent is context length to blame vs context quality?

Human doctors are probabilistic systems.

I run readlang.com as one person. I started it back in 2012 and it currently makes about 14K euros / month, with expenses of about 1.5K, so it's mostly profit.

Just use a VPN to pretend you're in the US and it works.

Same, along with the Tron soundtrack from Daft Punk.

Even if you don't feel like reading the whole article, do yourself a favor and skip down to the video of the final product at the very end. It's delightful and put a big smile on my face. The fact that all the modern technology is hidden inside leaving only the wooden structure visible makes it magical, like something from Harry Potter.

I've got a bunch of scripts to handle my finances, both personal investments and to help with certain parts of my company tax reporting.

Among other things it uses ChatGPT to extract structured data from PDF invoices for reporting expenses.

I'm under the impression that this CPU is faster AND more efficient, so if you do equivalent tasks on the M4 vs an older processor, the M4 should be less power hungry, not more. Someone correct me if this is wrong!

Interesting point but I don't think it's that clear cut. Twitter/X seemed to increase the pace of product changes directly after laying of the majority of its employees after Elon Musk took over. Also, when Steve Jobs returned to lead apple in 1997 he fired a significant fraction of the company before starting an incredible period of innovation. So I think a lot depends on the leadership and incentive structures.

A very relatable story! Are you going to write follow-up posts with more details covering the rest of the journey with more of the ups and downs of running a tiny bootstrapped startup? I'd be interested in reading!

I've gone retro with my watch. Wearing a simple Casio to avoid getting sucked into using my phone and checking notifications each time I want to see the time.

For my laptop I have an M1 pro macbook. It was a huge upgrade over the previous intel mac, but I don't feel the need to upgrade to the M2 or M3 machines, the M1 still feels really fast to me.

Nice start! I love the idea of an AI assisted learning experience structured around stories.

I make a tool in the same space (readlang.com). I started it before the current LLM wave but I've recently added LLM-generated explanations and several users have been uploading LLM generated texts to read (including me!). I've been considering adding LLM based practice too, similar to what you've done with the comprehension questions, but haven't got around to that yet.

Feel free to reach out if you'd like a chat :-)

At first glance this doesn't seem that surprising. We often use "is" in a way which isn't reversible. e.g.

"A dog is an animal" -> Makes sense

"An animal is a dog" -> Doesn't make sense