akssri
Joined 11 years ago
Joined 11 years ago
The statements however, if taken to mean optimality, are also incorrect. Reverse-mode AD (backprop) is generally quite efficient for scalar outputs (more generally, when n_inputs >> n_outputs), but it's not strictly optimal even for this particular scalar-output case.
Consider for eg. a MLP, with 4-layers with dims (1, N, 1, N, 1) - reverse-mode here does ~3N multiplies, but the optimal is ~2N. The optimal ordering for gradient accumulation is in fact NP-hard on general DAGs, but such 'cross-mode' AD is apparently quite hard to implement and not often seen given the marginal gains.
Griewank-Walther's excellent book is a excellent reference for this and much more,
https://epubs.siam.org/doi/book/10.1137/1.9780898717761
They also had a library called ADOL-C that had mixed-mode.
"Can a biologist fix a radio?—Or, what I learned while studying apoptosis - Yuri Lazebnik"
https://www.cell.com/cancer-cell/fulltext/S1535-6108(02)0013...
You have a serious issue with general comprehension, sir.
I've not once brought up UK or Western countries - my issue was/is/will-be with the Anglophone-Indian elites (who think they're honorary part of UK now ?), who will paint themselves as saints to the world with M.K Gandhi's face, but who are vicious corpulent vessels of the most vile forms of racism from the worst periods of the British-empire of 1 1/2 century before. India has more British laws inherited from this period, while UK itself has completely transformed itself (including the Civil-Service).
I'll not reply to the rest of the screed - that well-studied pedagogical gap of having to spend inordinate amount of time "muggin-up" things in English instead of actually understanding things means that I can't get much across anyway...
Try using these "laws" and "rights" when you're trying to apply for a university, or asking a IIT to teach you in Hindi/Tamil LOL. These provisions are mostly used to skirt around the (generally onerous) laws by so-called "minority institutions" (eg. Manipal).
It's very disingenous to make such arguments by anyone with their eyes open in India. It's almost like the classic quip (almost a criticism of proto-liberalism) about the British empire: everyone is free in it as long as he's British!
Indians will go to Germany and learn German; go to Japan and learn Japanese; but will resist building anything of value with the culture/language of their own states of residence. The Anglophone-Indians will religiously preach a particularly seductive form of nationalist-liberalism internally for India that continues all the colonial structures of the British empire, because it helps them optimize for their own economic outcomes (ofc. they do this internationally too).
Absurd state of affairs tbh - and it has (eg. Blume Ventures' report) and will keep India poor with the wealth limited to ~5-10% of the population.
In my opinion, these are just excuses for continued colonial-era English-imposition - because it's often only the aforementioned section that makes such brain-dead arguments.
For all the politically-ostentatious love of their own mother-languages there's not a single technical-university of any great reputation in either of these (it's worse in other Indic languages). The economic-value of these languages is close to zero if not negative.
Sheldon Pollock notes that, even in classical studies and literature, the institutions have turned utterly incompetent and filled with political retainers who can barely hold a mantle to people from previous generations who were experts in linguistics and manuscriptology.
So much for "Hindi/Tamil..." pride...
(Anglo-)India is of the Anglophones, by the Anglophones and for the Anglophones for all practical purposes.
That's why laws etc. are mandated to be written in this foreign language that's incomprehensible to the majority, and why there's a strict near-apartheid like barrier preventing higher education (and with it, higher employment) to non-Anglophones.
The only reason I imagine we don't hear about this systematic discrimination that prevent downstream material development like industrialization (as opposed to the ethereal one like caste) is perhaps because Western institutions have vested geopolitical interest in having such a large vassal, intellectually if not politically.
It's a bit silly to downplay their investment based on the sales numbers of Toyota Mirai.
https://en.wikipedia.org/wiki/2010_Senkaku_boat_collision_in...
https://www.rusi.org/explore-our-research/publications/comme...
Japan was one of the first countries to be hit with rare-earth export-restrictions by China - going back to 2010. It seems that a lot of policy came out from this unpleasant shock, incl. the decision by Toyota to focus on developing FCEVs which would be less dependent on Chinese supply-chains. Ironically, the resulting vacuum may have actually led to Chinese/American companies gaining market share in the BEV space.
Still, given how things are going, FCEVs (and Japan with it) might actually end-up having the last laugh.
https://www.youtube.com/watch?v=f3c4mQty_so
The hardware for these machines have been capable of household tasks for atleast 2 decades.
Here's PR1 cleaning up a room,
https://www.youtube.com/watch?v=o7JH3UWO6I0
The issue is not even teleop as a product. The issue none of these companies talk about is one of state-reset. Even a teleop-ed robot comes nowhere near the dexterity of a human - as the Joanna Stern review of 1x shows: 10 mins to load a dishwasher, 5 mins to get a glass of water, body coming the way of a fridge door, irrecoverable breakdowns every 30 mins...
Consider what happens if it drops some glassware or spills liquids on a carpet in addition (or worse does something stupid with the kitchen appliances). The teleop guy in Phillipines or India can't hop on a plane to fix this.
This 'environment reset' problem is at the core of RL - there are no solutions for this yet, only workarounds.
It talks about how Chinese society was completely destroyed and instantly "modernized" (read, liberal, secular-Christian etc.), and is one step removed from claiming that India too needs this "total destruction".
The article notes about "traditional evils like Dowry or Female Foeticide" like some cliched missionary in British India begging patrons for funding (also the tactic of many a NGOs) - but fails to mention that every one of these issues come from exactly this "societal smashing" created by the "Great" (TM) British civilizers, and their eugenics obsessed American counterparts [1][2]. The latter even talks about how obssesed with killing children the American elites were that they didn't even spare their allies China and South Korea (an unthinkable thing to today Yellow-Fevered zietgeist).
The article barely touches on how the colonial Indian state survived in nearly the same exact form, and pretty much implements the same old British policies to this day. Indeed, the constitution of India is a near facsimile of the 1935 Government of India Act. passed in the British Parliament to secure their vice-grip on the colony and choke it to death.
In India, education remains restricted to the 5-10% Anglophones, and everyone else is considered pretty much "not human". These policies come out from Indian-looking Anglo elites who hate the country to the very core, and don't face push back since even the counter-elites have to come from the same process of colonial education [3].
This is pretty much why India punches, in every field, as a country 1/10 the size. The Anglo-Americans don't complain, since they get slaves for cheap who willingly become part of the Anglo-American borg (like colonized Africa, Phillipines etc.), and it also satisfies their deep religio-cultural obsession with turning everything into be a mirror of themselves by "societal smashing".
This "societal-smashing" business and "lets turn everything American!" scheme of liberalism will die with the societies whom it exhausts into exhaustion and extinction. The breakdown of social-cohesion and drop of birth-rates, coupled without the necessary financial power to "marketize" society (Anglo-utilitarianism is obsessed with "marketizing" everything), this will "fix" itself in half-a-century.
The signs are quite obvious. I hope the Elephant remains a witness.
[1]. Oldenburg, Veena Talwar. Dowry murder: The imperial origins of a cultural crime. Oxford University Press, 2002.
[2]. Hvistendahl, Mara. Unnatural selection: Choosing boys over girls, and the consequences of a world full of men. Public Affairs, 2011.
[3]. Sanu, Sankrant. "The English class system." South Asian Language Review 17, no. 1 (2007): 69-85.
https://sankrant.org/wp-content/uploads/2011/03/The-English-...
https://www.etymonline.com/word/cipher
(Al Jabr, the translator of Indian Mathematical texts was a Persian IIRC)
I hate programming these days - back in the day, the cubicle-hell nature of "popular" frameworks was at least offset by being able to think through and solve interesting problems.
These days most of us are stuck in the "endless-review" loop with LLMs. You can't afford to not use it given the inflated expectations. As with all of modernity, productivity doesn't yield leisure - it just proportionally increases your workload.
Hardly surprising that the other side of the Curry-Howard correspondence is now getting hit with this. Math was one of those depts. where slow/deep-thinking was possible (CS was already insane 10 years back - now it's just absurd) - now even this fortress will be broken. Tragic.