zetalemur
Joined 6 years ago
Joined 6 years ago
showcasing my project over the last years (again). The updated LC-Product works now pretty streamlined and it makes pretty interesting (and surprisingly good to compress) maps.
Stack is a collection of adjustable U-Nets that make predictions that are merged together to derive the final map.
Happy to answer questions.
Happy holidays and happy hacking.
It's also interesting to make maps directly from raw data (in this case that would be aerial imagery with mostly elevation data). E.g. if you find good training data you can easily make "land-cover" maps and although my example (of Austria) [1] does not have annotations (addresses, etc.), it's still nice to look at and has the benefit of being extremely compressible (compared to aerial raw imagery).
[0] https://wiki.openstreetmap.org/wiki/Map_features [1] https://turmfalke.httpd.app/test.html
AFAIK that is the common approach to solve this problem, but it still needs some degree of sensor accuracy?
Senior Software Engineer specialized in Django, Pipeline-Development, GIS and applied machine learning in the context of earth observation, sensor mapping in general and remote sensing in particular.
e-mail: [email protected]
Stack:
- Django
- Python (with eco-system: numpy, pytorch, etc.)
- Linux
- Godot
- GDAL
- OpenStreetMap
- Rust
- Bash-Voodoo
Available 20 to 100 hours/month (@110e VHB).Example work: https://turmfalke.httpd.app/test.html
Happy coding and nice to meet you!
- 15000 Sentinel-2 scenes over land
- 10980^2 pixels per scene
- 50% lossless compression per scene
- 4 channels (RGB and infrared)
This results in 15000 * 10980^2 * 4 * 0.5 / 1024*4 ~ 3.3TB. This matches commercial offerings like in https://cloudless.eox.at/#data. Of course we have to add lower-scale imagery that is often used to provide XYZ tiling that would further increase the storage requirements.Thanks for the link to OpenTopography, it's an interesting project and elevation data is extremely valuable.
It might be feasible to store entire planet's raster tiles in 10 years in a (beefy) desktop machine.
So, good luck!
Sometimes you do not want to run an additional process/daemon like postgres. Your state is in essence now a file on some file system that you can atomically (full ACID) update using multi processing without the need for more complex machinery - you can get very far with this architecture.
I get your intention, but monetizing infrastructure and systems code is pretty hard.
E-Mail:
$ echo aG5AemV0YWxhYnMuaW8K | base64 -d
Happy coding
Founder and CTO of ζLabs
https://www.zetalabs.io