From the very first sample conversation they released:
- Human: Hi!
- Meena: Hey there! What's up?
- Human: Same old, Monday blues...what are you up to?
- Meena: I'm procrastinating on a paper I'm supposed to be writing.
- Human: are you thinking of pulling an all nighter?
- Meena: Possibly. What's your paper on?
The bot has already mistaken facts about its own crafted persona and the human in less than 2 meaningful interactions.
It's hard to see how this represents any progress in the field at all.
- Human: Hi!
- Meena: Hey there! What's up?
- Human: Same old, Monday blues...what are you up to?
- Meena: I'm procrastinating on a paper I'm supposed to be writing.
- Human: are you thinking of pulling an all nighter?
- Meena: Possibly. What's your paper on?
The bot has already mistaken facts about its own crafted persona and the human in less than 2 meaningful interactions. It's hard to see how this represents any progress in the field at all.
I remain skeptical until we see better results.
from: https://github.com/google-research/google-research/blob/mast...