hbcondo714

Joined 11 years ago

Karma
4,405
Submissions
1,414
Member since
Apr 28

  +----------------------------+
  |       amarkota.com         |
  |                            |
  |  linkedin.com/in/amarkota  |
  |                            |
  |     github.com/hbcondo     |  
  +----------------------------+
View on Hacker News

Recent submissions

Comment · 19 days ago
> a burst of incoming traffic can share warm environments instead of mapping each request to a new one

But cold starts could still occur, especially in a low-traffic environment where requests come in seldomly?

Comment · 20 days ago
Comment · 1 month ago
Comment · 1 month ago
Taking a quick look at the network traffic, the site does a POST to https://america.gov/api/chat with a JSON payload when submitting a query:

  {"language":"en","id":"VSvMeyCMKTX05oLW","messages":[{"parts":[{"type":"text","text":"how do I register my new business?"}],"id":"oHub5UDJ3iYARhao","role":"user"}],"trigger":"submit-message"} 
So the user's query is hitting a server so to answer my own question, the answer is No to local inference / models.

Edit: PDF attachments and voice input are processed locally according to the site's privacy policy[1]. But they still use 3rd party 'AI Providers' that abide by a ZDR.

[1] https://america.gov/privacy-policy

Comment · 1 month ago
> Your personal information isn’t collected or stored, and your conversation disappears when you leave.

I am left to wonder how this is technically accomplished. Is inference running in the browser? Is the model downloaded to the user’s machine?

Comment · 1 month ago
Comment · 1 month ago
Comment · 1 month ago
Comment · 2 months ago
Comment · 2 months ago
Comment · 2 months ago
I was gifted an Oura 4 last year and thought it accurately tracked my sleep. But a couple months ago, the sleep debt metric went flat to 0 even when I tagged poor nights of sleep (mainly due to child care).

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton