inputcoffee

Joined 10 years ago

Karma
1,760
Submissions
441
Member since
Aug 5
@inputcoffee

inputcoffee.com

The big question in data science is: should I spend more time learning Python or R?

The answer is always: math

View on Hacker News

Recent submissions

Comment · 7 years ago
The Fidelity "minus sign mistake" didn't create a loss. The mistake was in relaying the information to the end user. It didn't actually cause a loss of that magnitude.

That is like saying if I mistyped in a word doc, that word created the loss.

Comment · 7 years ago
I am not offended that you think I may not program. That is fine. (I mean less than some, more than others. I have coded up the examples I brought up.)

But you haven't responded to the argument. If someone urges you to use Racket, and you have task in front of you (say, put up a website), it sort of matters whether Racket has a framework more than if it has brackets, indents or curly braces.

Comment · 7 years ago
True, if we were talking about Data science, and you were bringing up Python or R or Julia, fair enough.

But if you're talking about Racket, I would want to know what you can do with it. Does it have a data science library? A web app framework?

Comment · 7 years ago
Well, I assume people write mountains of code in the library. If you're making a machine learning product, that is still a lot of work.

However, writing your own Tensorflow interface would take several human lifetimes to get it right, and Google already has provided it. So it seems that is not the part you would re-write no matter how good the language is.

Comment · 7 years ago
I am always confused when people talk about the language itself.

In my experience, python is used for Tensorflow, or Pandas, or Django, or Flask, or pytorch or something else that runs on top of it. Sometimes it is even more specialized and I need a wrapper for an API to let me talk to some web data. Maybe I need a crawler/scraper and a parser. There is a specialized language on top of the language.

So when someone says, oh this language is better with objects, or has some syntax thing or the other, or I can reason about it I am left confused.

Its like if I were talking to a professional shoe designer and I ask for hiking boots and they tell me that they're really into having at least two tones to offset the lace and the heels or something.

What am I missing? I want to reason about the language too, but doesn't that pale in comparison to being able to run a specialized library?

Comment · 7 years ago
Agree 100%, but only if it is a one time activity. If you have to automatically pull files and do the operation several times, it is better to go with R (or python, or awk sed or whatever).
Comment · 7 years ago
I was waiting for the critique... but I never quite saw it.

Imho, the data problem Tidyverse is trying to solve is basically the ones we face in a database. So, select, join, inner join and so forth. Show me all the rows in this datatable where the 4th columm is larger than the 6th column and the number itself is odd. Something like that.

There might be other ways to do it, but you want your select, filter, summarize, mutate etc functions to all work with each other, pipe to each other and be compatible.

Maybe there is a better way to do all this -- I haven't seen it but I am not an expert -- but you have to show that to me.

So, in base R, walk through a set of example of mutating, joining, filtering and so forth, and show me how they are all easier. Then I'll say, wow there is an alternative to this Tidyverse thing. But in lieu of that demo, this felt more like an intro to a complaint than an actual complaint.

Edit: Also, its funny that Wickham is (apparently) such a nice fellow that people go out of the way to be nice to him in critiques.

Comment · 7 years ago
Don't you think it was policy so they can capture the information and get reporting?
Comment · 7 years ago
I've been trying to explain to people why I think ML is Stats rebranded but this is the most succinct expression of that sentiment:

> Taking averages, grouped by something? That's AI now.

I think that is right. The algorithm that does the grouped averages is machine learning, and if you put error bars around it, it is stats.

To address your concern: I wouldn't worry about the relevance of applying math and logic to the world. It has always been growing.

Comment · 7 years ago
I don't think it would be questions.

Suppose you like fountain pens, and you recommend certain ones. One of your friend looks for fountain pens that their friends recommend and finds the ones you like.

That is just one example of things that don't require explicit questions.

Another one might be you have searched for books or other things and then they follow the same "path". So long as you have similar interests it might work.

People haven't solved this issue, but there is a lot of research out there on networks of connections potentially replacing certain kinds of search.

Comment · 7 years ago
It was thought that one way of finding information is to ask your network (Facebook and Twitter would be examples), and then they would pass on the message and a chain of trusted sources would get the information back to you.

I am being purposefully vague because I don't think people know what an effective version of that would look like, but its worth exploring.

If you have some data you might ask questions like:

1. Can this network reveal obscure information?

2. When -- if ever -- is it more effective than indexing by words?

Comment · 7 years ago
It went down a few times before and I reached out asking if he wanted help too. He did respond fairly promptly (< 2 days) and told me he was fine and about to get it back up. This happens every so often so I am glad you’re doing this.

Are the articles the same as he had? Did you get a snapshot before it went down?

Comment · 7 years ago
I admit, it really makes you think about iterations and MVP in a new way.

I am surprised you said you found flask lacking though, because I would have thought they were similar. Can you say more about what you found to be lacking in terms of performance/team, size/code and tooling?

Comment · 7 years ago
This is really interesting.

I would love to see something like this for other successful companies.

Too often, we see the tech stacks of famous firms, but not the stacks that preceded them.

It would be very interesting to note if, say, 80% of unicorns started their life as RoR, or PHP projects. It tells you one of two things:

1. Which frameworks were popular n years ago (where n is the average time it takes from launch to unicorn)

2. Which framework actually helps you get an MVP off the ground

Comment · 7 years ago
These declarations of valuation should be followed by a little note explaining what multiple of earnings (or, failing that, sales) this represents, and how fast it is growing.

Is that high? Low? about right?

Well, it depends if Slack made $100 million in sales and is flat, or if it did $2B in sales and is doubling every year.

(I assume that it doesn't have earnings because its still growing and plowing all that money back into the business)

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton