innolitics

Every company will turn into a lab with its own benchmarks and evals for evals. Here is a eval for medical device consulting ran against the frontier models and supervised fine tunes.

I work in the medical device space (mostly software as a medical device). I attended the AAMI Nexus conference two weeks ago and attended a talk about making devices more eco friendly. The tension between safety and sterilization and packaging was definitely brought up. It’s a hard balance to make. One example I thought was interesting was that the NIH did a study to see if it was necessary to swab people’s skin and use gloves before a shot. It turned out it wasn’t and it didn’t make a difference, so they stopped requiring the providers to swab people’s skin or wear gloves, thus saving an immense amount of waste when taken over all vaccine shots.

I really like diagrams as text for simple diagrams where you don't care too much about the formatting. I think Figma is better if you really care about the formatting. I just discovered this the other day, but you can create mermaid diagrams in Notion by adding a codeblocks and selecting the "mermaid" language from the dropdown.

That's absolutely true. We work with a lot of technical founders who are turning their research into a diagnostic medical devices. One of the first questions we always ask is: how will the information produced by your device help clinical decision making? More data is _nice_ but if it doesn't alter the course of treatment, it's pointless. Sometimes it's okay if the doctor doesn't know if the problem is A or B if the treatment for A and B is the same.