BiasRegularizer
Joined 7 years ago
Joined 7 years ago
Microsoft has an initiative called AI4Sciencie (https://www.microsoft.com/en-us/research/lab/microsoft-resea...) which published a fair amount of SDE/diffusion-based method to solve scientific problems
Similarly, humans are also prone to the distribution shift unless we get updated information on a specific topic. The key differences are that we are great at continual learning and we are much better at learning abstraction
I can see some niche applications for this system, but I am very skeptical it's ability to handle larger models (100M+) and the ability to and it's scalability when there are increased demand.
Additionally, while we don't know how us humans functionally reason, it's believed that the predictive nature of our brain is central to our reasoning abilities. Maybe in some way, the autoregressive nature of LLMs is similar to our predictive brain.
For a collection of emergent properties in LLMs, I recommend this paper [2]
[1]https://arxiv.org/abs/2201.11903.pdf [2]https://arxiv.org/pdf/2206.07682.pdf
Has anyone tried having two apple watches so one can be worn while the other charges?
[edit] Charging it at night is kind of missing the point, as I would like to track both my daily activities and my sleep
1. Nobody would store all their wealth in a deflationary currency - other forms of assets, stocks etc will still exist. They will need a high liquidity vehicle to trade a.k.a inflationary currency.
2. Deflationary currency doesn't necessarily mean it will gain value overtime. Unless it contains growing intrinsic value, the overall market cap will drop/plateau.
Think of inflation vs deflation as lubricant vs sandpaper, one encourages economic activities while the other discourages.
IMO the biggest problem with most cryptocurrencies is their deflationary nature. Limited supply means they behave more like assets than currency. As currency nobody would want to spend it as they gain value over time. As an asset it lacks intrinsic value, and therefore overall market cap will tank slowly.