whytai
Joined 7 years ago
Karma
391
Submissions
61
Member since
Jul 31
Recent submissions
Comment · 3 months ago
Comment · 6 months ago
the manus founders moved the entire company, researchers, and IP out of china to singapore. most of the researchers and business is still there, but unfortunately the founders wives/parents and family stayed in china. ultimately this is why they had to come back when the PRC summoned them after the meta acquisition.
sad day to be a chinese founder.
Comment · 8 months ago
surprised to hear others don't do this! obsidian also works well for daily notes
Comment · 8 months ago
i thought the reason claude code defaults to terminal-ish workflows (glob/grep) is bc they trained with bash-y sandboxes, and the creator argued for this approach vs indexing + bespoke tools. would be interesting to see how often the model defaults to using grep for everything (in my experience almost always..)
Comment · 1 year ago
I really enjoy the obsidian daily notes feature for this [1]. It's a dedicated button to create a new note with a title of your choosing. I typically do YYYY-MM-DD d, so 2024-12-1 mon.
I'm not sure about the time tracking though. Is this more for people working on contract for billing? I see the value in having the data but collecting the data seems difficult.
Comment · 3 years ago
Every day this video ages more and more poorly [1].
categories of startups that will be affected by these launches:
- vectorDB startups -> don't need embeddings anymore
- file processing startups -> don't need to process files anymore
- fine tuning startups -> can fine tune directly from the platform now, with GPT4 fine tuning coming
- cost reduction startups -> they literally lowered prices and increased rate limits
- structuring startups -> json mode and GPT4 turbo with better output matching
- vertical ai agent startups -> GPT marketplace
- anthropic/claude -> now GPT-turbo has 128k context window!
That being said, Sam Altman is an incredible founder for being able to have this close a watch on the market. Pretty much any "ai tooling" startup that was created in the past year was affected by this announcement.
For those asking: vectorDB, chunking, retrieval, and RAG are all implemented in a new stateful AI for you! No need to do it yourself anymore. [2] Exciting times to be a developer!
[1] https://youtu.be/smHw9kEwcgM
[2] https://openai.com/blog/new-models-and-developer-products-an...
Comment · 3 years ago
It's certainly true that most people are deficient in potassium. The daily recommended dose for males is over 3 grams per day![1]
To make matters worse, the FDA limits the amount of potassium that can be present in supplements to 100mg[2]. So good luck taking 30 supplements to meet your daily requirements!
One option Id like to advertise is salt alternatives at grocery stores which are filled with potassium, some with at least 800mg per tsp. This can be another way to supplement potassium and magnesium in the diet [2]
[1] https://ods.od.nih.gov/factsheets/Potassium-HealthProfession...
[2] https://www.health.harvard.edu/staying-healthy/should-i-take...
Comment · 3 years ago
For testing:
- we have a dedicated dev environment for analysts to experience a dev/test loop. None of the pipelines can be run locally unfortunately.
- we have CI jobs and unit tests that are run on all pipelines
Observability:
- we have data quality checks for each dataset, organized by tier. This also integrates with our alerting system to send pagers when data quality dips.
- Airflow and our query engines hive/spark/presto each integrate with our in-house lineage service. We have a lineage graph that shows which pipelines produce/consume which assets but it doesn't work at the column level because our internal version of Hive doesn't support that.
- we have a service that essential surfaces observability metrics for pipelines in a nice ui
- our airflow is integrated with pagerduty to send pagers to owning teams when pipelines fail.
We'd like to do more, but nobody has really put in the work to make a good static analysis system for airflow/python. Couple that with the lack of support for column level lineage OOTB and it's easy to get into a mess. For large migrations (airflow/infra/python/dependecy changes) we still end up doing adhoc analysis to make sure things go right, and we often miss important things.
Happy to talk more about this if you're interested.
Comment · 3 years ago
How do you guys do the static analysis on the queries? I notice you support dbt, bigquery etc, but all of our companies pipelines are in airflow. That makes the static analysis difficult because we're dealing with arbitrary python code that programmatically generates queries :).
Any plans to support airflow in the future? Would love to have something like this for our companies 500k+ airflow jobs.
Comment · 3 years ago
I always thought bee communication through "dancing" was visual. On reading more, it seems the bees build up electric charge which interacts with the antennae on other bees.
Excerpt [1]:
> Honeybees accumulate an electric charge during flying. Bees emit constant and modulated electric fields during the waggle dance. Both low- and high-frequency components emitted by dancing bees induce passive antennal movements in stationary bees. The electrically charged flagella of mechanoreceptor cells are moved by electric fields and more strongly so if sound and electric fields interact. Recordings from axons of the Johnston's organ indicate its sensitivity to electric fields. Therefore, it has been suggested that electric fields emanating from the surface charge of bees stimulate mechanoreceptors and may play a role in social communication during the waggle dance.
I have a hunch the amount of prs written per day per engineer is likely the same or only 10-15% higher.