gpsarakis
Joined 13 years ago
Karma
505
Submissions
84
Member since
May 11
Senior Software Engineer - https://github.com/georgepsarakis/
View on Hacker NewsRecent submissions
Comment · 11 years ago
Sphinx does indeed a very good job and is continuously improved. It is very fast and with small memory footprint.
We also built https://techusearch.com which uses Sphinx indexes (think of a SaaS version of Elasticsearch backed by Sphinx).
Comment · 11 years ago
Interestingly enough, there is one unofficial API http://pygments.appspot.com/, but supports an outdated version (1.5).
Comment · 11 years ago
Great work! Do you consider PyPy support also?
Comment · 12 years ago
Sure you can :). Naturally transfers via SSH "suffer" from the encryption overhead but prevent MITM/network sniffing etc. The author points out that (only) in a trusted LAN you could use this solution to make things go faster.
I guess the title should be a little more mild - scp isn't going away, or rsync via SSH for that matter.
Comment · 12 years ago
pigz does parallel compression, taking advantage of multiple cores. I am not really sure if you can achieve this with scp.
Comment · 12 years ago
Thumbs up for pv which shows the progress bar. Using parallel compression may have serious impact on CPU resources, so it needs to be balanced.
Have you also done any testing with ssh + gzip?
Also, as you note at the end, the security concerns are not trivial.
Comment · 12 years ago
Great read! An effort on a DSL using PLY (Python LEX-YACC implementation): https://github.com/georgepsarakis/quick-bash .
It is actually a transcompilation to Bash from a functional language, using Python for the intermediate processing.