Revanche1367
Joined 1 year ago
Joined 1 year ago
Gemini so far has also had terrible computer-use capability or tool-use capability compared to ChatGPT (haven't used enough of Claude for these tasks lately to really compare). I tell ChatGPT to make some formatting changes to a LaTeX file I gave it and generate a PDF, it get's the PDF generated most of the time; occasionally the download link doesn't work, but that seems to be a server or link-generation issue, the actual PDF is generated and it quickly fixes the broken link when told. With Gemini, it's a long struggle and I use LLMs for formatting LaTeX a lot, so sometimes if ChatGPT is doing some long-running task for me, I have to begrudgingly give the document formatting task to Gemini, and it's dreadful every single time.
Before Argon was a thing, it once generated a PDF file, then started claiming PDF generation was not part of its functionality and the link that was previously working stopped doing so. I think I had inadvertently jail-broken a functionality because it refused to generate PDFs again and said the first time was a mistake. With Argon, it doesn't deny having the capability, but it takes much longer than ChatGPT, and messes up more formatting than it fixes. Its PDF viewer is also trash and seems like it gets built from scratch every time you want to view a PDF.
That’s exactly how the biggest vendors have been marketing them, it’s no wonder non-experts think of them that way. I’m not an expert myself but have a passing familiarity with theory as a SWE and grad student who did some research for machine translation and currently am in a computing-adjacent field. I use LLMs heavily for work and have never come across any coder-oriented tutorial, guide, etc. encouraging use of LLMs as decision models specifically, even if they are being used that way “beneath the hood.” Jev’s announcement seemed sort of new functionality to me but even in the first post about it on HN (where I heard about it), iirc people were pointing out that LLMs do the same thing, at least to some extent.