Comment by qsera

>for the sake of argument, that context can express everything weights can...

Does this imply that a completely untrained model (random weights) should show intelligent behavior only by providing enough context?