He links to Visual Website Optimizer[1] as the A/B testing tool he will use. I haven't used VWO personally but based on their features page it's a point-and-click to change some visual details on the website. Install a javascript link and good to go. Again, haven't used the tool but doesn't seem like much work to me.
[1] http://vwo.com