batbomb
Joined 13 years ago
Joined 13 years ago
Considering they sold their business to Grab, I think you could safely say Uber+Grab are as close to a global service as you can get, and probably represents a significant fraction (though maybe not 50%+) of the global market
There's a good document on this:
That's not so different from BeyondCorp and Uber's model.
Alternatively, some kind of OpenID Connect init (oidcinit) to get a JWT and then a PAM module like the kerberos one (which also checks the JWT's Key Id for revocation on authentication)
If you are just running a web app, then this is the correct answer. If your business is in your database, you employ data analysts and want to gleam some additional insights from your database, then it might be worth a look, though most people who chose MySQL did so because they were building a web applications and don't employ analysts.
Nextflow was mentioned. I think what most people want is probably closer to Airflow, although it takes some time getting it up to production in a cloud environment (there is astronomer.io and a GCP product).
HTCondor via DAGMan has existed a long time, and there’s even engines built on that (Pegasus, Wings).
There’s Swift (http://swift-lang.org/main/) and it’s successor Parsl. Cray has Chapel. These are a bit different, in that they are more like a distributed computer program. Of course, so is Julia, but built into these languages is the assumption you can be using unreliable, in some way, computing. Makeflow and GNU Parallel are closer to this category too.
Then there’s Beam, but that’s dataflow.
The crappy thing about this is it’s hard to understand when to use a solution and when to not use a solution. Why are there so many solutions? Because there’s a ton of different needs, and a lot of these focus on a few in particular:
Latency
Scalability or workers
Dynamic Scalability of workers
Throughput
Polyglot
Integration with existing Schedulers
Workflow Code Management (container support)
Maintainability of very large DAGs
Testability of DAGs/Development support
Execution Management support/Web APIs
Error recovery (especially for long running workflows)
Re-execution capabilities
Provenance tracking
Domain Specificity
Data Management (next to data processing)
... the list goes on.
As a user, there is no easy recourse. I had to create an account on dash.cloudflare.com, which I was able to do after SSH tunneling to another server and doing a SOCKS proxy. This because they don’t accept emails to [email protected] unless you have created an account.
Once you open a ticket, you are doing so from a free account, because you are not the user. You are not prioritized.
I have no idea why I can’t access tons of sites right now, but it’s fucking frustrating. I’m in Chile and all the VPNs I can use are in the US so that makes for a terrible browsing experience.
This has really slowed me down this week. If I didn’t have a VPN, like most people in Chile, I’m sure a small part of the internet just be broken.