1. The conda recommendation is in the JS App Walkthrough documentation page:
> A Python package manager: we recommend conda or pip
2. Makes sense! Something like sqlalchemy/alembic would be cool for PostgreSQL support.
3. Ah, this is interesting. Will read up on the different ASGI implementations. I had just assumed that having LLM workloads, async or not, on your main web server would be a problem (memory and/or i/o), but maybe not. To do date I’ve been moving LLM i/o workloads to background jobs on different machines with Celery, but it’s a bit more work and also makes streaming impossible. I recently did a Qwik + Celery stack for heavy LLM use, but have wanted a pure Python solution.
> A Python package manager: we recommend conda or pip
2. Makes sense! Something like sqlalchemy/alembic would be cool for PostgreSQL support.
3. Ah, this is interesting. Will read up on the different ASGI implementations. I had just assumed that having LLM workloads, async or not, on your main web server would be a problem (memory and/or i/o), but maybe not. To do date I’ve been moving LLM i/o workloads to background jobs on different machines with Celery, but it’s a bit more work and also makes streaming impossible. I recently did a Qwik + Celery stack for heavy LLM use, but have wanted a pure Python solution.
Thank you!