actually_a_dog
Joined 5 years ago
Joined 5 years ago
That's true, but not really saying very much. Any differentiable function is locally linear around a neighborhood of any point where the derivative exists.
> Also exponential growth does hit some kind of ceiling relatively quickly.
Well... that depends. Much like how markets can remain irrational longer than you can remain solvent, exponential growth can often remain exponential for much longer than it takes to create a problem. Conversely, sometimes it can't remain exponential long enough to prevent a problem. Exponential growth is a hard beast to tame.
> And it seemeth, that the cause why it is called mortgage is, for that it is doubtful whether the feoffor will pay at the day limited such sum or not: and if he doth not pay, then the land which is put in pledge upon condition for the payment of the money, is taken from him for ever, and so dead to him upon condition, &c. And if he doth pay the money, then the pledge is dead as to the tenant, &c. [Coke upon Littleton, 1664]
H_s(x) := -\sum_{x \in X_s} p(x) log(p(x))
where X_s := all s-grams from the training set? That seems like it would eventually become hard to impossible to actually compute. Even if you could what would it tell you?Or, wait... are you referring to running such an analysis on the output of the model? Yeah, that might prove interesting....
---