wladimir
Joined 16 years ago
Joined 16 years ago
The 'cells' in the case of the hypothetical technological singularity will be computer hardware, not organic cells or human brains. There is the tacit assumption that silicon-based AI tech is somehow superior to our own carbon-based 'tech' and will displace it.
Human brains forming into a kind of super-organism would be a different phenomenon. It wouldn't even need AI, or much more advanced technology. It could indeed be argued that this is the case already with the internet and even printing press before it.
The idea of the singularity implies that the complexity of technology moves above anything humanity can understand. It is unclear whether there still be any use for our kind of individual conscious mind. At what scale will cognition happen? Will the world itself turn into a kind of brain?
But I'm with you in hoping that the Minds will be like the culture's and keep us around as pets in a sort of enlightened hedonism :-)
Say, I needed write a custom GPU driver for some device, either to improve performance for some specific application or to work outside the dependency or API constraints of the binary blob (like porting to another OS). Usually vendors provide no register level documentation about graphics hardware, so the only way to do this is by reverse engineering.
Another reason for reverse engineering can be to find backdoors and security vulnerabilities (like these guys did) or even for legal reasons to find whether some copyrighted (or GPLed) code was used.
No madness needed at all. Or maybe just a bit.
Oh I see dropship is mentioned in the paper, great :)
In any case, interesting that they found some previously unknown security holes this way. This again proves that security through obscurity, at least for client software, doesn't work. When will people learn. You can't hide anything on the client for the user, at least not for long.
Sure, everything was possible before, but much harder for the average programmer interested in this stuff. With just Python and LLVM-python you can do very interesting things, quickly, without delving into GCC sources.
It may be possible that GCC cached up in that aspect, but back in the day I heard from language researchers, the GCC low and high level IR were a hell to introspect and required delving into the GCC source at a deep level.
I feel for him. Likely, he should try to escalate it higher up so that he gets moved to another project. But I understand his reluctance too, as they could decide he should not be working at the company at all.
And what bugs me as strange is that the CTO knows that he's doing nothing and still not doing anything about it.
It's more aimed at computer vision applications such as image filters for robotics.
FYI, I did some OpenCL tests and benchmarks on the GC2000 some time ago and reported about it here: https://blog.visucore.com/2013/3/12/opencl-on-i-mx6 . I'm also working on a reverse engineered open source driver for Vivante GPUs such as that in the i.mx6 (https://github.com/laanwj/etna_viv).
For example the baseband processors in phones contain a complicated firmware of 16 MB+. This contains many hidden diagnostic modes on various subsystem levels. Baseband processors have been known to be exploited remotely, and as they have direct connection to the main CPU, giving full control over the device, including GPS, camera etc.
There have also been bugs in wired networking hardware in which specially crafted packets resulted in low-level crashes. It was not exploitable in the cases I remember, but I'm sure someone persistent enough and with the right skills may be able to find some.
None of these examples actually "phone home" in the classic sense, but my point is that these peripherals have proprietary firmware that is hardly under public scrutiny, and anything can be hidden in them.
The fear is about the rich and privileged knowing everything about the poor and underprivileged (using databases that are expensive, protected by IP laws, and/or require clearance), and opaqueness the other way around. Information as a means of control.
It always reminds me of a shocking fact in Dutch history: In the Netherlands, the Germans managed to exterminate a relatively large proportion of the Jews. The main reason was that before the war, the Dutch authorities had required citizens to register their religion so that church taxes could be distributed among the various religious organizations (https://en.wikipedia.org/wiki/Dutch_resistance)
And this looks so quaint now. We can only imagine what potentially damning information a totalitarian government can now find about every citizen retroactively.
Digital networks are increasingly an intermediate in every little communication and transaction between people. And with the internet of things, in everything we do, in the future maybe even inside our bodies (what's after Google Glass?).
We really need a way to prevent rampant data collection, otherwise the internet is a large threat to civilization. I didn't go into technology to facilitate some 1984-ish world government :(
'Well, in our country,' said Alice, still panting a little, 'you'd generally get to somewhere else if you ran very fast for a long time, as we've been doing.'
'A slow sort of country!' said the Queen. 'Now, here, you see, it takes all the running you can do, to keep in the same place. If you want to get somewhere else, you must run at least twice as fast as that!'