Comment by Aeolun

Jup, had the same issue with Google App Engine. Luckily I could contact support...

"What do you mean, you retain a running instance of every previous instance I pushed?!"

Fun times.