Two.js[1] has a WebGL renderer and abstractions for basic vector graphics and polygons. I haven't had the chance to use it in a project yet but it seems promising. Two.js could even be used as a basis for a WebGL charting library (thus providing another layer of abstraction).
[1] http://jonobr1.github.io/two.js/