pyxru
Joined 8 years ago
Karma
28
Submissions
48
Member since
Aug 14
Recent submissions
Comment · 3 months ago
It is long running project, never got 100 stars in day
Comment · 3 years ago
last Updates:
1. Chromium support: it is means now we can scrape site with frontend rendering
2. Docker support: same as previous but more flexible and not required install binary
3. Binary released for different platforms
4. XPath parsing supported
5. CLI can copy in clipboard and provide pretty results
6. Add limiters for avoid DDOS block and memory consumptions
7. YAML support for configuration
CLI configuration examples for play: https://github.com/PxyUp/fitter/tree/master/examples/cli
Roadmap:
1. Fitter should parse with new different triggers like: Webhook/Queue
2. Website FAQ + playground: for test and run configuration
3. Cypress support + Docker: for some sites need authorization or etc, we will have scenarios which will be pre-runed during parsing
4. Add more notification method
5. Improve validation:
5.1 Config validation - for be able know issue during setup
5.2 Result validation - for be able omit result without mandatory fields
6. Config build - web app which will simplify building of configuration
Waiting for your feedback!