davidjairala

I've actually been working on something like this for a while now, and found your comment about proprietary data interesting. Would this mean that hosting this data in a third party server is out of the question for you? OK with NDA?

What would a reasonable price for this product be for you?

Would you say the customer experience was that much better before the regulations in 2008? Cause that hasn't been my experience personally.

I personally find myself going through this with most aspects of my life. I have lulls at work where I'm less than 100% excited about the work at hand, and then after a while I'm back in top shape, but I now find it normal when the lulls occur.

It happens to me for most other hobbies as well. I enjoy working out a lot, but there are times where I just don't feel super excited about it, for like lets say a month or so, and I have to put in a lot of will-power to get to the gym. So I do basically what you do here as well, try different kind of workouts, etc., with varying results and that helps sometimes.

I think at the end of the day it's really hard to maintain that level of passion for something that you do day in day out. You just have to accept the downtime and know that it will pass in a bit. At least that's my take on it.

Edit: right after I posted I was reminded of a quote lifters use often: "motivation gets you in the gym, as it's fleeting, but discipline keeps you coming back". I think the same applies here, to some extent.

Just to make sure I understand your reply correctly, are you saying that if a robot.txt file disallows your specific crawler but allows googlebot you'd see no problem with crawling it?

From personal experience, it's quite the headache, even if you stay within legal parameters, you will run into site owners who are less than thrilled about what you're doing (possibly understandably so).

I ran into several people who wrote cease and desists, which I honored, and into several others who started banning our IP addresses, etc, disallowing us specifically via robots.txt, etc.. There are obviously ways to get around these issues, but the main question is, morally, would you want to go around them? Are you willing to go against website owners who flat out don't want you scraping their data? Would you be willing to fight them legally for your right to do so?

Ultimately, that's what it came down for me, I just felt really crappy about it and stopped.

I've been having similar difficulties lately. I've been thinking about shared workspaces. Have you given them a shot?

What are your credentials? Not trying to be snobby, just for comparison's sake.

Generally speaking, installing and having an installation of Wordpress is pretty simple. However, my advice would be to keep things as simple as possible, especially since it seems you guys are starting out.

For the frontend, I'd recommend either just having very thin pages in your Rails stack that are fully or at least heavily cached that then ping your API, or relying on something like Jekyll to generate static pages that then do the same.

Eventually, when the project becomes larger and/if you start feeling pain points, you can abstract this frontend layer away from the stack into its own little app. You could also make it its own little Rails or Sinatra app that just serves basically HTML (again, heavily cached, since the dynamic content will come from the backend). I keep recommending keeping it in Rails or Sinatra just so you can use some goodies like layouts, easy caching infrastructure, you're already hosting rails, the asset pipeline.

As for your marketing site, I'd go for something that's hosted elsewhere, like Tumblr if you need a blog, etc. Just try to minimize the things you need to host and support yourselves.

Really liking the app. Also enjoyed the "free for a limited time", adds a bit of a time component where you download it quickly and then maybe get hooked to it for when you have to pay later on.

Hi Ravi, thanks for the feedback! What do you mean? Like let you try saving some bookmarks without signing in or signing up?