ArturT
Joined 13 years ago
Karma
88
Submissions
56
Member since
Apr 24
Recent submissions
Comment · 4 years ago
Comment · 5 years ago
I posted my add-on in Heroku Marketplace over a year ago https://elements.heroku.com/addons/knapsack-pro and did not see much organic leads from the marketplace itself.
Anyone using Heroku Marketplace as well? Any ideas how did you approach promoting your add-on? Thanks.
Comment · 6 years ago
Sidekiq Pro version was inspiration for me to create a pro version for my Ruby gem called knapsack that automatically splits tests in parallel on CI nodes/jobs.
With the knapsack_pro version I focused on common needs of users and there was simple validation method to verify if particular feature was needed. People just pay if it brings value.
In case of free open source tool, people tend to want something but you don't know if they actually will you use it and sometimes people demand a thing while you have to put the hard work.
When you do paid version of your tool then somehow people are polite. :)
Nowadays I have also support for running parallel tests in JS.
More at https://knapsackpro.com and here is detailed technical explanation how it works https://docs.knapsackpro.com/2020/how-to-speed-up-ruby-and-j...
Comment · 6 years ago
Maybe because of running Rails on Heroku is simpler than with Docker.
Comment · 7 years ago
If you have no tests at all I would start with simple E2E tests to ensure your critical parts of app are working like sign up page and billing. You can add later other important sections of your app to ensure happy paths for your features are working fine.
When I started my own product for Ruby & JS developers https://knapsackpro.com I was doing mostly unit testing and later relayed on E2E tests for testing user dashboard to ensure happy paths are covered.
It's very easy to introduce weird bugs and it's much faster to run CI build to test your app than manually verify if it works correctly in your browser when you make some changes.
Comment · 7 years ago
knapsack_pro gem uses Knapsack Pro API which is paid. See more at https://knapsackpro.com
It works similarly like tools for exceptions tracking, i.e https://www.honeybadger.io is paid but has MIT client https://github.com/honeybadger-io/honeybadger-ruby
Other than that I do support paying customers.
Comment · 7 years ago
I started with writing open source Ruby gem https://github.com/ArturT/knapsack for running tests in parallel on CI and later I gave a talk on local meetup event for Ruby developers.
With time I wrote more blog posts https://docs.knapsackpro.com and shared on Reddit, Twitter, LinkedIn profile or Ruby groups. From time to time posts landed in RubyWeekly newsletter.
Also asking users for recommendation might help.
I connected with each person on LinkedIn I talked to or who signed up and I followed them on Twitter. People who like your product can easily see you publish new content and can like or share it.
Comment · 7 years ago
End-to-end tests tend to take a lot of time when project grows. Some tricks like recording API calls with Puffing Billy can help save some time but still majority time is spend in browser.
This problem triggered me to work on knapsack ruby gem to solve problem how to split tests across parallel CI servers and run my whole test suite faster. E2E tests can vary in time execution so I decided to split them in a dynamic way between CI nodes to auto balance tests speed between nodes.
Recently someone let me know about fix for puffing-billy gem to work with my knapsack_pro Queue Mode. https://github.com/KnapsackPro/knapsack_pro-ruby#how-to-conf...
Comment · 7 years ago
For annoying flaky features tests, I use rspec-retry gem to repeat the test a few times before marking it as failed. It helped for integration tests with external sandbox API.
I noticed discourse had a lot of flaky tests while using their repo to test my knapsack_pro ruby gem to run test suite with CI parallelisation. A few articles with CI examples of parallelisation can be found here https://docs.knapsackpro.com
I need to try the latest version of discourse code, maybe now it will be more stable to run tests in parallel.
Comment · 7 years ago
Back in 2014 I work on a project where we had ~15min test suite running on CI and this was painful so I started working on open source solution knapsack for CI parallelisation for Ruby tests.
Later on developed more advanced way with dynamic tests allocation across parallel CI nodes not only for Ruby to get CI build as fast as possible. To give you some idea how it works check https://docs.knapsackpro.com/2017/auto-balancing-7-hours-tes...
or watch video https://www.youtube.com/watch?v=hUEB1XDKEFY
Comment · 7 years ago
I work on knapsack gem to split tests across parallel CI nodes. To do optimal balancing I developed a dynamic test suite split with Queue approach.
Here is example for Travis CI https://docs.knapsackpro.com/2018/how-to-run-travis-ci-paral...
And this is the graph showing the difference if you compare knapsack_pro dynamic tests split with what CircleCI does which is basically only time-based split. https://docs.knapsackpro.com/2018/improve-circleci-paralleli...
I spin off https://knapsackpro.com from the knapsack gem and we are helping our customers run fast CI builds.