wxs
Joined 15 years ago
Karma
794
Submissions
109
Member since
Apr 27
Recent submissions
Comment · 5 years ago
If you like this you may enjoy the "Pink Trombone" an interactive speech synthesizer that you control by moving around the virtual tongue and lips: https://dood.al/pinktrombone/
Comment · 9 years ago
> of consciousness, we have agents that perceive the environment and act, in order to maximize rewards
I don't believe "agents acting to maximize rewards" is a good description of any human I know, or if it is the reward function is certainly unknown.
Comment · 10 years ago
Like Bret Victor? Who seems to have been involved in presenting this to Jobs? I'd say he's a pretty interesting guy and probably not worth firing even if you don't like one of his proposals.
Comment · 10 years ago
I agree with the first half of this comment, but I don't follow you here: "Until there is an element of randomness fueled by context, they aren't creating anything new. That's where genius lies."
I suspect reframing of problems, seeing things in new light, paradigm shifts, new ontologies, whatever you want to call it are not quite so simple as context-dependent randomness! I don't think we understand this process very well right now.
Finally; I think there is an artfulness in copying existing patterns, because the way in which you "abduce"[1] an observation-explaining theory out of the infinite space of possibilities is a creative and aesthetic process.
Comment · 10 years ago
Unicode Technical Report #51, which is where Emoji are laid out, talks a bit about the current thinking of the committees on this:
> The longer-term goal for implementations should be to support embedded graphics, in addition to the emoji characters. Embedded graphics allow arbitrary emoji symbols, and are not dependent on additional Unicode encoding. Some examples of this are found in Skype and LINE—see the emoji press page for more examples.
> However, to be as effective and simple to use as emoji characters, a full solution requires significant infrastructure changes to allow simple, reliable input and transport of images (stickers) in texting, chat, mobile phones, email programs, virtual and mobile keyboards, and so on. (Even so, such images will never interchange in environments that only support plain text, such as email addresses.) Until that time, many implementations will need to use Unicode emoji instead
Comment · 10 years ago
The matrix has nice features like flexible dates on a multi-leg trip that Google Flights doesn't offer.
Comment · 10 years ago
I really like your Hidden Unit Zoo here http://colinmorris.github.io/rbm/zoo/ as a window into what this thing is actually "thinking" about. The "top matches" for a given hidden unit are pretty helpful.
Comment · 10 years ago
The possibilities for how language will work in the future are really exciting and interesting! We made the Minuum keyboard, too, which also explores how machine learning assistance can open up new ways of communicating.
One reason we're interested in visual communication with Dango, though, is that regular text input is pretty good already. Chorded keyboards exist and are way faster, but people mostly can't be bothered to use them. QWERTY is just good enough. But the field is wide open for rich communication with images, nothing out there is particularly good yet.
Comment · 10 years ago
Well those are sort of equivalent. But yeah, we use cross-entropy between the projected output and the target emoji distribution as our objective to minimize.
And yes, we do the t-SNE on that pre-projection space. That's why we can visualize the targets (emoji) in it. We can also t-SNE the word embeddings themselves — the input to the RNN — which is also kind of interesting. It automatically learns all kinds of structures there. Chris Olah has a good post on word embeddings if you're interested: http://colah.github.io/posts/2014-07-NLP-RNNs-Representation...
Comment · 10 years ago
Not officially, although people have started reverse-engineering the website ;).
We can get an actually supported one up officially if there's interest. Email me at [email protected]!
Comment · 10 years ago
Well you can search in Dango, too ;)
But yeah our main focus is suggestions. You can use Dango concurrently with the normal emoji keyboard, of course! It can just sit there showing you emoji you might not know about "ambiently"
Comment · 10 years ago
Yeah we'd need to do some more work. But this is similar to stickers and GIFs: there are many fewer examples for any given sticker or GIF, which is why we do transfer-learning approaches as discussed in the article.
So there's a good chance we could get it to work! We've not focused on that possibility… yet.
[email protected] @wxswxs
[ my public key: https://keybase.io/wxswxs; my proof: https://keybase.io/wxswxs/sigs/fhibuu3BrSc7k3fLOwDrKBHC1A5GGzzsoPACnipuWJ4 ]