colincsl
Joined 15 years ago
Joined 15 years ago
We have a major effort at Hopkins going on right now to get around this. See this article more info: http://hub.jhu.edu/2015/10/19/hopkins-microsoft-patient-safe...
For what it's worth I still stick with Python for computer vision applications. I mostly use Julia for timeseries models (e.g. Semi Markov CRFs) where it's harder to vectorize everything.
If I were restart again I'm not sure if I would suggest going the Julia route. I know there are alternatives like Numba that enable you write efficient code with minimal effort. Overall I like Julia as a language but there are a lot of little issues due to it being a new language.
Furthermore, I don't know which dataset they're using. Perhaps it only works on a small set of objects such as those shown in the video.
I don't mean to knock their results but it will still take time to get this to work on a more broad set of videos.
Also, a "cheap camcorder" is nothing compared to this. The Kinect is a 3D sensor. You would need 2 "cheap camcorders," stereo vision algorithms/hardware to process it in real-time, and even then the quality typically wouldn't be as good as the Kinect.
Tangentially, it's also disheartening (at least for the time being) that Apple recently bought Primesense - the maker of the original Kinect. Primesense was selling a better 3D sensor for developers/researchers. Apple shut it down as soon as they bought them.
I would love to play around with the data, unfortunately, I assume it's private (for good reason) due to potentially sensitive patient data.
If anyone is interested in related methods for time series, I just put up code for our recent action segmentation paper using Temporal Convolutional Networks (https://github.com/colincsl/TemporalConvolutionalNetworks). I would be very interested in trying this model on the ICU data. In my experience, TCNs are much better at learning complex temporal pattern than LSTMs.