obelix_
Joined 8 years ago
Joined 8 years ago
In the meantime (unless you are dealing with video) most text and image datasets out there that avg Joe needs can easily be stored/processed entirely locally thanks to cheap terabyte drives/multicore chips these days. People just haven't realized there isn't that much useable textual data OR that local computing doesn't require all the overhead of handling millions of requests a second. This is Google problem not an avg Joe problem that is being solved with cloud compute.
But...if you just want to run your own personal search engine say...
Then for Wikipedia/Stackoverflow/Quora size datasets (50GB with with 10GB worth of every kind of index(regex/geo/full text etc) ) you can run real time indexing on live updates with all the advanced search options you see under their "advanced search" page one any random Dell or HP Desktop with about 6-8GB of RAM.
Lots of people do this on Wall Street. People don't get what is possible on desktop cause so much of it has moved to the cloud. It will come back to desktop imho.
1. You assume stopping "revolution" is the goal. It is not. All you have to do is look at what outcomes "revolutions" in an info saturated/low attention span/consumption culture based society have produced in the last 20 years.
2. In 2013 the Washington post did an estimate on how much was being spent on the surveillance society in the US. Everyone reacted in disbelief. Do you know by how much that budget has increased in the last 5 years? Are these people just brain-dead to be spending this kind of cash? Ofcourse not.
The US has made its share of mistakes over valuing freedom and squandering potential. China is overvaluing control and will make its share of mistakes too. We have to learn from both sets of mistakes to arrive at the right balance of where society should go in high noise info saturation environments. These are very new environment that society hasnt been in before and the right path ahead is not as obvious as people think.
The real damaging data to people and society at large is a different set of data. It's the publicly visible counts next to every thought and utterance reinforcing misguided beliefs and behaviour up and down the food chain constantly. Any experienced shrink, psycologist or educator, marketing/PR expert knows applying the right amount of feedback at the right time is critical to how people process info.
Remove/delay/reduce the visibility of like counts/view counts/upvotes/retweet counts that are displayed and the world will be a different place overnight.
Fred Rogers was critical of it even back then. Since then, consumption culture has exploded, objectification of women, violence, escapism whether it is in games, drugs or your social media, news streams is at an all time high. For a Fred Rogers type message to get through the volume dial on all this other stuff has to be dialed down. Otherwise the very valuable message gets lost in the noise.
Kim Kardashian has a 110 million followers. After the Russians (or whoever...maybe just that "400 pound dude in the basement") get her to become the next president I am waiting to see what boywonder shows up and says to Congress.
We know what he and his exec staff thought about fake news before the election. Now who here thinks fake imagery is not a thing? Just take a look at the content produced by the top 100 accounts.
There is going to be a special place in history for the damage boywonder has done. People will have to invent new terms to describe it. Nothing like it has happened ever before.