digitalzombie

> Statistics is "the practice or science of collecting and analyzing numerical data in large quantities"

That's not true.

Statistic can analyze data in small quantities you can read up on it with nonparametric statistic. At least half of nonparametric statistic deal with small data (mostly through use of ranking). With Bayesian stat you can just assign a prior distribution.

I think the best way to describe statistic is that it uses data to infer the population. A subset data via sampling and infer a statistic (mean, median, whatever) about the population at large.

More often than not I'm just surprise as to why Data Science is so big when seemingly it seems like statistic does every freaking thing with data. From how to correctly sampling, designing experiment to collect the correct data to answer a hypothesis, making sure the data aren't bias, etc.. It deals with designing the data from inception to end, including either collecting the data or data given to you already. On top of dealing with problematic data such as missing data, imputation, etc..

Seriously Intel is already struggling after buying Nervana.

I went to their shing dig and they were working their butt off to wow the developers who were invited. When I asked for hard number they were very mum about that and very evasive.

The timeline for Nervana chip have been always seemingly in this mystical horizon that is never solidified to a real date but over yonder.

Google is going to pull this crap? They got better software expertise than Intel though they may be able to do it. But after that fiasco with Angular 1 to 2 I wouldn't trust Google with any early version number.

Their power cord keep on dying for my macbook 2013.

I had a temp iphone and it took over a lot of my texts by redirecting it toward apple's server first. When I got my android back I receive no text msgs from my friends who have iphone.

It also seem like they're making cheaper stuff so they can increase their margin via tech support and peripherals.

I agree they should invest more in software so they don't have to resort to these crappy tactic.

Also they should make a cheaper iphone region lock it to china and india only if they want to increase their margin. Their current strategy for these markets is stupid.

You can harvest data and anonymize it. My friend at Google supposedly is doing this via research at Google. I'm not going to say Google care about our privacy as much as Apple but they are researching this probably for medical and for when opportunity arises. To be perfectly honest I think Apple's stance on privacy is all marketing, there are cases where they refused to unlock phones for the FBI but there are other cases where they ship recordings of your talk to SIRI to a third party company.

Programmers should have a union.

Especially the ones that are working in the gaming industry.

It's just statistic.

How you collect your data can introduce bias and statistic have a whole range of topics on how to collect data without introducing bias and systematic techniques to sample data. Stratifying data if a certain group is under represented, random sample, etc... Survey analysis goes into hardcore details on how to sample a population to accurately do inference and it's an interesting statistic sub field if anybody is interested.

ML tends to be more here's the data already do something with it.

Statistic encompass everything about the data including how to sample, collect the data, and designing the experiment to collect the correct data to answer your hypothesis. Where as ML is usually here's the data, go figure out what you can get out of it.

> anyone have a good strategy?

I left the industry for data science. Went back to school and fall in love with statistic. Going to try to get a biostat job. I'm trying to do side projects web app and not give a damn about the flavor flav of the month.

I don't know if that's a good strategy.. it's basically peacing out. I also move most of my tech stack to plain old stuff like a simple mvc framework and no frontend rendering.

More data is better.

You can reduce it via PCA one of the many techniques in multivariate statistic.

You can do anova to select your predictors.

In general you can use a subset of it using the tools that statistic have provided.

Complaining about messy data... welcome to the real world. As for complaining about non-reproducible models , choose a reproducible ones. I've only done mostly statistical models and forest base algorithms and they're all reproducible.

All I see in this post is complaints and no real solutions. The solution that's given is what? Have less data?

> The results were consistent with asymptotic theory (central limit theorem) that predicts that more data has diminishing returns

CLT talks about sampling from the population infinitely. It doesn't say anything about diminishing returns. I don't get how you go from sampling infinitely to diminishing returns.

Elixir have better syntax because it's familiar.

I did play around with Erlang a few time. I really love the comma and period. It really nest and group the function patterns together.

For Elixir you just have to put them near each other. The function are enclose in a do/end block. And you put those similar pattern function next to each other. I believe you can move those pattern function around.

Other than that I can't recall much else. Prolog syntax is foreign but I'll admit I can see myself learning Erlang pretty fast since the language isn't "big" compare to Java or Scala. Like wise Elixir is a small language too with added macro (I don't recall Erlang got this) feature. Elixir also have better tooling baked in (mix/hex, doc, lint, etc...).

Also the Erlang community sucks. This is my personal experience but I vividly recall attending a meetup. The group meetup have a discussion about Erlang's adoption and how to get better adoption. I told them Ruby got popular because RoR other wise people would have chose Python and call it a day. Erlang should really have a killer framework like a web framework. Everybody thought it was ridiculous.

And you know what? Elixir came along and so did Phoenix. Phoenix may not be the only thing that got Elixir popular, Elixir got toolings from the get go. Jose and those people are from the industry they know what was needed. They came from Ruby.

No please.

I do not want a monopoly in x86.

Intel is very greedy in their cpu prices. Their consumer cpu never gave the option of ecc memory and have gimp certain things. AMD was more flexible. Having two company competing will be great for the consumers.

I tried reading Pearl once. I couldn't get over his tone.

Andrew Gelman summarize it pretty nicely his take on it.

Coming from a statistic background, casual inference is a growing thing now and several government sponsor research have been pushing for it.

Casual inference from statistic point of view is base on missing data, basically Rudin stuff. It's pretty dang interesting to me. I'm sure there are many ways of looking at the same thing. Linear regression you can look at it in more of a optimal math problem with cost function or you can look at it in statitic using maximum likelihood estimation. Both have it's pro and con, with MLE you get a confidence interval. In my bias opinion I feel that statistic is only about data and it's a great domain for casual inference.

There's no need to put a field down to make yours better. But if it's constructive criticism (pro/con, contrast) I think it make both fields better. Pearl attitude is off putting when you try to read his stuff. We're all human and have vary degree of ego, if you're going to try to convince us that do calculus and your ways is better be objective about it or word things better. If you don't want to convince people then just be blunt as hell.

> averages Hide too much.

I had to read the article because of your comment.

You're wrong.

When competent researchers talk about salary/income they always do median because average doesn't account of skew like Bill Gates.

If you do a ctrl+f with mean or average you won't find it. But if you do ctrl+f and search for median you'll find it.

Considering they sold most of their hardware department, such as harddrive to Hitachi and thinkpad to Lenovo, and went focusing on patents, this is a change in their image. I had the view they were risk adverse, to be using Elm is interesting.

WeHarvest what is their product? Soylent green?