Recent submissions

Comment · 6 years ago
Check out Turn Base (implement and play board games using a DSL): https://turn-base.com/

Here's an original game implemented using this system: https://turn-base.com/games/lobby/22/ (Buy cards to summon and move chess pieces in a chess game) You'll need to grab a friend to play (no AI). Ping me in discord if the game doesn't make sense.

Comment · 6 years ago
Comment · 6 years ago
Comment · 7 years ago
Agreed there doesn’t seem to be a consensus. Thanks for the links
Comment · 7 years ago
Thanks, good to have this data point. I’ve been training a roughly similarly sized dataset for many 10s of ks of steps (but on 355m). Wondering if I need so many steps.
Comment · 7 years ago
Can you share how large your dataset (how many tokens) and batch size was and how many epochs you used? By training slowly, do you mean that you used a small learning rate? If so, what was it?

I've been reading up on batch size and people are all over the place. Some say smaller is better and some say larger is better. Mostly when it comes to gpt2 people say larger is better but there must come a point when increasing the batch size is no longer beneficial (or is it just that you use as large as your memory will allow)?

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton