wr
hn
Top
New
Best
Ask
Show
Jobs
Back
x
xkapastel
Joined 10 years ago
Karma
621
Submissions
133
Member since
May 16
View on Hacker News
Recent submissions
Comment · 3 years ago
The point is wrong, they don't have any claim to having created deep learning and so their perspective can't be used to argue for the reality of "superintelligence". Even if they did create it, the question of whether "superintelligence" is a meaningful concept or not isn't really related to what they would have had to go through in order to make deep learning work.
Comment · 3 years ago
This is a strange way to count, the three Turing award winners are not the ones that "created the tech". Many thousands of people did that.
Comment · 3 years ago
I don't think you can do this, it will just make things up. Language models don't have this type of reflection. Google would need to indicate this out of band, like on the page itself, in order for you to be confident about what model you're using.
Comment · 3 years ago
Using 8-bit still runs out of RAM for both the 3B and 7B models. It's unclear if it's because it still uses more than the available RAM, or if it's just quietly not using 8-bit since it's not implemented.
Comment · 3 years ago
Amazon did release a 20B transformer called Alexa last year:
https://www.amazon.science/blog/20b-parameter-alexa-model-se...
Comment · 3 years ago
bing cannot do anything besides read some of microsoft's scrape of the web. it can't make a GET or POST request, it can't click buttons, etc
Comment · 3 years ago
CLIP Interrogator uses BLIP, an image captioning model, as well as trying a bunch of prompts with CLIP. I guess you mean that this model uses the captioning model to generate the complete prompt? Is the code for this one available?
Comment · 3 years ago
Okay, and that funding and top tier talent was attracted to Google, right? I'm not sure what you meant by that.
Comment · 3 years ago
Google did not "threaten their own business" by publishing basic research in machine learning. Products threaten businesses, not research.
Comment · 3 years ago
OpenAI made GPT, not Google. Did you mean "Attention is all you need", the paper that introduced transformers?
Comment · 3 years ago
did you tell chatgpt to act like jar jar binks or what?
Comment · 3 years ago
transformer-xl is a totally different net. the thing to keep in mind is that gpt will play along with anything unless they explicitly prevent it
Comment · 3 years ago
BERT is a simple model that is not capable of answering questions in this manner. For very simple things it might help with that answer box at the top, but that's not what I meant.
Comment · 3 years ago
It's very different because it will answer the question you asked, rather than answering a question that matches a substring of the question you asked like Google will.