lol1lol

Joined 5 years ago

Karma

Submissions

Member since

Aug 10

Recent submissions

Last night I was running run_translator.py script and found that their scripts not actually allow people training models from scratch.

But hey, I was able to read the code, fix that small thing that needed to work for my case and ran my experiment.

I could never do that in AllenNLP. Go figure.

Comment · 4 years ago

I think you are missing the point.

The hackability quotient of AllenNLP is way low.

I'll give you specific examples where AllenNLP overdid it, while HuggingFace was better just by keeping it simple.

Vocabulary class. HuggingFace just used a python dictionary. I can't think of one person who said they needed higher level abstraction. Turns out a python dictionary is pickle-able, saving to a text file is one line code, while the AbstractSinglettonProxyVocabulary is not and no one wants to care in the first place.

Tokenizer class. HuggingFace just used a python dictionary to return strings and integers. I can't think of one person frustrated by it. It's printable, picklable, and everything in between people can fiddle with. And boy where do I start about AllenNLP's overdoing of Tokenizers.

Trainer class. vs. HuggingFace example scripts. The scripts are just much more readable, tweakable, debuggable etc. HF didn't bother with AbstractBaseTrainer class bs.

It just shows they never understood the playing field.

- First, I don't think anyone thought AllenNLP was a good choice for high performance production systems. Again HuggingFace clearly understood the problem and built a fast tokenizer in Rust.

- A math, physics, linguistics, or even CS PhD student who know basics of coding would prefer bare bone scripts. They just want to hack it off and focus on research. Writing good code is not their objective.

Just my opinion.

Comment · 4 years ago

It's one of the overly abstracted libraries. Too hard to tweak something. HuggingFace Transformers did a better job at keeping things simpler.

Comment · 4 years ago

when has his fund ever outperformed sp500 or has it at least remain uncorrelated?

Comment · 4 years ago

"We're not in a recession, we're in the early stages of a depression. A depression is a self-feeding liquidity crisis - it's a cash-flow squeeze that occurs when the economy turns down, inventories are being sold, borrowings increased, and liquidity reduced." - Raymond T. Dalio, New York Times, Jun 27, 1982

"For decades the numbers have told us that each time the capacity utilization figure moves over 85 percent, the inflation rate rises, and also that each inflation cycle tends to peak at a higher level than the preceding one. During this inflation cycle, we expect capacity utilization to cross the 85 percent line by early 1985, when the CPI should be running at an annual rate of 7.8 percent and well on its way to a cyclical peak of about 11.5 percent sometime in 1986." - Raymond T. Dalio, New York Times, Jun 17, 1984