Ask HN: What do I need to learn how to write a scalable app?
I'm a self taught programmer. I mostly code in Python. I have built a couple of fairly well received applications at my workplaces, using flask and either React or Plotly's dash framework for UI. However I am facing a problem. My work does not involve much data. I write tools that are used to automate tasks. Visitors are below 10 to 20 at any given time, even though my company is a large fintech company. My work does not deal with much data. But I want to learn. I want to build something that involves billions of rows of data. I want to know how to speed it up.
Right now, I am building an application that has 2 million rows of data. It is centred around a lot of analytics around team productivity. I would like to increase how fast it is. I am already using redis as a cache, my database is postgres, I select only columns I need using flask Sqlalchemy and I have cut down a lot of the processing time already. But I am certain this can be faster. Where do I learn the design patterns for this? What do I use to figure out how to improve this application? How do I measure performance? How do I learn to build apps that achieve less than 300ms response time?
Right now, I am building an application that has 2 million rows of data. It is centred around a lot of analytics around team productivity. I would like to increase how fast it is. I am already using redis as a cache, my database is postgres, I select only columns I need using flask Sqlalchemy and I have cut down a lot of the processing time already. But I am certain this can be faster. Where do I learn the design patterns for this? What do I use to figure out how to improve this application? How do I measure performance? How do I learn to build apps that achieve less than 300ms response time?