jeffreyw128
Joined 8 years ago
Karma
20
Submissions
20
Member since
Jul 16
Recent submissions
Comment · 1 year ago
This was my favorite course in college!
Comment · 1 year ago
This is cool!
If you want to add embeddings over internet as a source, you should try out exa.ai. Includes: wikipedia, tens of thousands of news feeds, Github, 70M+ papers including all of arxiv, etc.
disclaimer: I am one of the founders (:
Comment · 1 year ago
Hey Paulista,
Cofounder Jeff here. Both!
Comment · 2 years ago
Exa | San Francisco | In person | Full time | $130K-350K
Jeff, cofounder of Exa.ai here. LLMs represent a brand new opportunity to organize humanity's knowledge, in a way that hasn't been done before. We're an AI research lab focused on AI-powered search algorithms (using embeddings), currently applied to vast swaths of the web (we make our money as a search API).
A little about us: - Raised series A a few months ago. https://techcrunch.com/2024/07/16/exa-raises-17m-lightspeed-... - 15 people, fully in person in SF. Our team - https://exa.ai/team - Our mission: https://exa.ai/blog/superknowledge
We're hiring pretty broadly across engineering - AI research, high performance Rust (e.g., we build an in-house vector DB), and full stack. If the mission of organizing the Internet motivates you, it's a good fit :)
Comment · 2 years ago
Exa | San Francisco | In person | Full time | $130K-350K
Jeff, cofounder of Exa.ai here. LLMs represent a brand new opportunity to organize humanity's knowledge. We're an AI research lab focused on AI-powered search algorithms (using embeddings), currently applied to vast swaths of the web (we make our money as a search API).
A little about us:
- Raised series A a few months ago. https://techcrunch.com/2024/07/16/exa-raises-17m-lightspeed-...
- 15 people, fully in person in SF. Our team - https://exa.ai/team
- Our mission: https://exa.ai/blog/superknowledge
We're hiring pretty broadly across engineering - AI research, high performance Rust (e.g., we build an in-house vector DB), and full stack. If the mission of organizing the Internet motivates you, it's a good fit :)
Comment · 2 years ago
Exa | San Francisco | In person | Full time | $130K-180K
Jeff, cofounder of Exa here. LLMs represent a brand new opportunity to organize humanity's knowledge, in a way that hasn't been done before. We're an AI research lab focused on AI-powered search algorithms (using embeddings), currently applied to vast swaths of the web (we make our money as a search API).
We're hiring pretty broadly across engineering - AI research, high performance Rust (e.g., we build an in-house vector DB), and full stack. If the mission of organizing the Internet motivates you, it's a good fit :)
Comment · 2 years ago
Missed exa.ai! Embeddings-based search engine with its own index
Comment · 2 years ago
Exa | San Francisco | In person | Full time | $130K-180K
Jeff, cofounder of Exa here. LLMs represent a brand new opportunity to organize humanity's knowledge, in a way that hasn't been done before. We're an AI research lab focused on AI-powered search algorithms (using embeddings), currently applied to vast swaths of the web (we make our money as a search API).
We're hiring pretty broadly across engineering - AI research, high performance Rust (e.g., we build an in-house vector DB), and full stack. If the mission of organizing the Internet motivates you, it's a good fit :)
Comment · 2 years ago
That's true. Although should be much harder
Comment · 2 years ago
Do our best at getting the right content.
For paywalls/login - we play pretty straight, always obey robots.txt, etc.
Comment · 2 years ago
Yup, definitely still gameable but if the model learns what high quality content is like and what high quality webpages there are (which it does), then the only way to game would be to be great :)
For your search - I would recommend turning autoprompt off and searching something like "Here is a great summary of the best computer mice to use:".
Our embeddings model is trained on how links are talked about on the Internet, if that helps with querying. So you have to query like how someone would refer to a link before sharing it
Comment · 2 years ago
The issue with traditional search engines is that keyword-first algorithms are extremely gameable.
Try https://search.metaphor.systems - it's fully neural embeddings-based search. No keywords, only an embedding of what the actual content of a webpage is.
So in the mentioned example of searching for Youtube downloaders, with Metaphor you'll get only Youtube downloaders (https://search.metaphor.systems/search?q=This%20is%20the%20b...)
Full disclosure - I work there :p