Comment by mellifluousmind

Octave is pretty awesome. There is also R. Personally, I also do a lot of computing within interactive programming console (like irb, php -a, node). However, if you are doing symbolic expression, you can't go wrong with Octave