dacm
Joined 11 years ago
Karma
686
Submissions
96
Member since
Dec 26
Recent submissions
Comment · 3 years ago
Very interesting take to counteract the 23andme data leak
Comment · 7 years ago
Forcing you to give consent to receive a newsletter in order to download the ebook is not the way to go
Comment · 8 years ago
Being that the data is queried from a web app through HTTP, the shorter the better. Around 1 sec should be alright, but 6 - 8 definitely isn't
Comment · 8 years ago
It is in our case. This is a service which is very seasonal, so it may be used during a couple of days each month only. Having a bunch of instances mostly idle would definitely be more expensive
Comment · 8 years ago
When I worked on this I used this article as a reference: https://serverless.com/blog/serverless-python-packaging/ and also ended up with a huge image. What that article didn't mention is that the virtual environment folder should be excluded in the serverless config file, as the runtime is provided by boto3. So adding:
package: exclude: - venv/
would reduce the size considerably (to 50 MB in my case)
Comment · 8 years ago
Our problem is that we have a team of data scientists who are familiar with Python, plus a decent set of custom tools written in it, so changing languages isn't an option
Comment · 8 years ago
We've been packaging pandas in a lambda which is used to perform some calculations, but being a 50 MB zip file makes cold starts of about 6-8 secs. We're lucky that the service has little use, thus our way to workaround it is by having a lambda warmer which is run every 5 minutes and invokes N pandas lambdas. I'd be very interested in knowing if Layers has some feature to avoid this kind of issue.