sarthak-ag
Joined 4 years ago
Joined 4 years ago
This is not always as easy for all types of questions. It's hard to come up with an example on the spot, but I tried a few queries I searched on SO in the last week, and found one to demonstrate. I was searching for "Where to store JWT in browser?". This is the SO answer [1] for reference. Now to prove my point, I ask the question to ChatGPT (3.5). Here's the chat [2].
On a first glance it looks like ChatGPT may have nailed it, though the information dump is HUGE. Among the 6 options it suggests, the last option "secure cookies" looks "correct". Indeed it is correct in what it says that this can prevent XSS attack. But it is not complete. Because it still does not prevent XSRF attack entirely. So I had to explicitly prompt it to think about XSRF and its response is weird. At first it incorrectly claims that XSRF attack is mitigated, but then in the response body it elaborates that we also need anti-XSRF tokens for complete protection. So I don't know what to make of it. Contrast this with the SO answer which is way more direct.
Honestly, ChatGPT's answer looks like that of a student who is trying to impress some examiner with their knowledge dump by beating around the bush rather than trying to precisely answer the actual question.
[1]: https://stackoverflow.com/questions/27067251/where-to-store-... [2]: https://chat.openai.com/share/c26fee93-5d3d-48e2-a820-297974...
In my programming job I consult SO multiple times, and I have never once felt the kind of hostile discussion environment that people try to potray. SO is very valuable to me especially for questions that have less to do with documentation but more about the essence of programming itself. It disgusts me that in future I will have to communicate with a brainless LLM instead where I have no recourse if its answer doesn't satisfy me, nor I have the confidence in the correctness of its word vomit.
Secondly, we don't need to respect this new flag for no color because most programs already disable their color output if they detect absence of a real tty by isatty(). So people who want to enforce no colors for all programs should either find a hack to put the running program under illusion, or just pipe output throught cat which will do it anyways. There is no point in having more unnecessary standards that will never realistically be complied with.