kerneltime
Joined 13 years ago
Karma
83
Submissions
52
Member since
Nov 13
Recent submissions
Comment · 1 year ago
Apache Ozone has multiple 100+ petabyte clusters in production. The capacity is on HDDs and metadata is on SSDs. Updated docs (staging for new docs): https://kerneltime.github.io/ozone-site/
Comment · 1 year ago
https://github.com/oneconcern/datamon
Had written this git for data tool few years back (works with GCS but can be made to work with S3)
1. No server side
2. Immutable data (via GCS policies)
3. Ability to mount data sets as filesystems
4. Integrated with k8s.
It was built to work for the needs of the startup funding it, but I would love it if it could be extended.
Comment · 3 years ago
What the author is up to now https://www.silverthreadinc.com
Comment · 3 years ago
That is the share of value capture from the market that they just made real. There are legitimate scenarios where first movers do not have an advantage.
Comment · 3 years ago
The tag line within SDM was that it is a program for those who want to lead engineering and not leave engineering (MBA)
I think the meta framework for thinking and being able to step away from the madness of releasing a v1 product and having tools for thinking about the bigger picture.
Also, MIT.. it is a very rewarding ecosystem to be in.
Comment · 3 years ago
ESD.34 ESD.342 16.863J 15.871 15.783J ESD.33 to name a few
Also, 15.965 my favorite and offered by my thesis advisor Michael A. M. Davies: Based on which it is likely that OpenAI won't be walking away with the cake.
Comment · 3 years ago
MIT has an amazing program for System Design and Management. Dan and I are both graduates of this program. Some of the courses I would recommend include System Architecture, System Safety, and System Dynamics. Most of the content is available on OCW.
What is taught is not software-specific, but is entirely applicable to software, outside of the world of 'throw everything on the wall and see what sticks' as long as the venture capitalist can be shown growth at all costs. I wish more software developers were mindful of complexity and architecture.
Comment · 4 years ago
I came across this when investigating keto and lipid profile. Experiments such as this one and continuous monitoring impact makes me believe that the revolution in medicine to keep us healthy will come from tech innovations.
https://cholesterolcode.com
https://citizensciencefoundation.org
https://ownyourlabs.com
Comment · 4 years ago
Note the word competent.. Also, insurance companies will often have opinions on what tests were valid and might reject paying for tests. So if a DB admin spins up a cluster to debug his hunch of a SQL Compiler issue, that bill will be paid by the customer and not the insurance and might bankrupt the customer..
I had an apt with a cardiologist where he literally read a standard template of care and when I tried to see if he is interested diving deeper into inflammation causes, tests and ways to avoid the standard medications which only deal with symptoms he was least interested as it all dealt with metabolic issues and not the heart per se.. the system is run to see how can a patient be billed and who owns the organ. Insurance companies have swim lanes and medical practitioners are educated and trained to remain in those swim lanes.. as long as things are kept simple for prescribed cures and billing, the gravy train continues.. it not in their best interest to solve the problem. Have you ever been to a annual physical where god forbid you discuss issues that are not part of the normal annual health checkup? You will actually be asked to schedule a separate appointment as the billing for that is separate..
A lot of "functional medicine" happens outside of insurance payment coverage.
Some more interesting things to follow:
https://cholesterolcode.com/
https://cynthialimd.com/faqs/
Comment · 4 years ago
Yeah don't talk to a DB admin about SQL compiler issues.. :-P
Comment · 4 years ago
I recently came across a term "Functional Medicine" https://www.ifm.org which looks at the body as a whole and tries to root cause metabolic issues which can often result in IBS cures.. most older medicinal practices always considered the body as a unified system which make sense in terms of how it is engineered but modern medicine tries to break things down and often misses the cross specialization impacts. Best of luck!
Comment · 4 years ago
Wow! Allegations without context or material. Who would have thought someone on twitter would sling mud!
If the Indian government is going to implement the Aadhaar card.. I rather would like folks such as Viral Shah on the team to make sure the implementation is headed in the right direction.. The scale and operational challenges faced are significant. The context for that twitter thread is a leak of private data that occurred. If competent engineers are not involved, it will only get worse.
This is analogous to the US Govt implementing a plan to provide universal healthcare but random developers getting angry when a competent engineer works to make sure it is done right..
Comment · 5 years ago
I find this paper to be one of the earliest and one from which other consensus algos can be derived: https://en.wikipedia.org/wiki/Shared_register#Implementing_a...