inputcoffee
Joined 10 years ago
Joined 10 years ago
That is like saying if I mistyped in a word doc, that word created the loss.
But you haven't responded to the argument. If someone urges you to use Racket, and you have task in front of you (say, put up a website), it sort of matters whether Racket has a framework more than if it has brackets, indents or curly braces.
But if you're talking about Racket, I would want to know what you can do with it. Does it have a data science library? A web app framework?
However, writing your own Tensorflow interface would take several human lifetimes to get it right, and Google already has provided it. So it seems that is not the part you would re-write no matter how good the language is.
In my experience, python is used for Tensorflow, or Pandas, or Django, or Flask, or pytorch or something else that runs on top of it. Sometimes it is even more specialized and I need a wrapper for an API to let me talk to some web data. Maybe I need a crawler/scraper and a parser. There is a specialized language on top of the language.
So when someone says, oh this language is better with objects, or has some syntax thing or the other, or I can reason about it I am left confused.
Its like if I were talking to a professional shoe designer and I ask for hiking boots and they tell me that they're really into having at least two tones to offset the lace and the heels or something.
What am I missing? I want to reason about the language too, but doesn't that pale in comparison to being able to run a specialized library?
Imho, the data problem Tidyverse is trying to solve is basically the ones we face in a database. So, select, join, inner join and so forth. Show me all the rows in this datatable where the 4th columm is larger than the 6th column and the number itself is odd. Something like that.
There might be other ways to do it, but you want your select, filter, summarize, mutate etc functions to all work with each other, pipe to each other and be compatible.
Maybe there is a better way to do all this -- I haven't seen it but I am not an expert -- but you have to show that to me.
So, in base R, walk through a set of example of mutating, joining, filtering and so forth, and show me how they are all easier. Then I'll say, wow there is an alternative to this Tidyverse thing. But in lieu of that demo, this felt more like an intro to a complaint than an actual complaint.
Edit: Also, its funny that Wickham is (apparently) such a nice fellow that people go out of the way to be nice to him in critiques.
> Taking averages, grouped by something? That's AI now.
I think that is right. The algorithm that does the grouped averages is machine learning, and if you put error bars around it, it is stats.
To address your concern: I wouldn't worry about the relevance of applying math and logic to the world. It has always been growing.
Suppose you like fountain pens, and you recommend certain ones. One of your friend looks for fountain pens that their friends recommend and finds the ones you like.
That is just one example of things that don't require explicit questions.
Another one might be you have searched for books or other things and then they follow the same "path". So long as you have similar interests it might work.
People haven't solved this issue, but there is a lot of research out there on networks of connections potentially replacing certain kinds of search.
I am being purposefully vague because I don't think people know what an effective version of that would look like, but its worth exploring.
If you have some data you might ask questions like:
1. Can this network reveal obscure information?
2. When -- if ever -- is it more effective than indexing by words?
Are the articles the same as he had? Did you get a snapshot before it went down?
I am surprised you said you found flask lacking though, because I would have thought they were similar. Can you say more about what you found to be lacking in terms of performance/team, size/code and tooling?
I would love to see something like this for other successful companies.
Too often, we see the tech stacks of famous firms, but not the stacks that preceded them.
It would be very interesting to note if, say, 80% of unicorns started their life as RoR, or PHP projects. It tells you one of two things:
1. Which frameworks were popular n years ago (where n is the average time it takes from launch to unicorn)
2. Which framework actually helps you get an MVP off the ground
Is that high? Low? about right?
Well, it depends if Slack made $100 million in sales and is flat, or if it did $2B in sales and is doubling every year.
(I assume that it doesn't have earnings because its still growing and plowing all that money back into the business)
inputcoffee.com
The big question in data science is: should I spend more time learning Python or R?
The answer is always: math