It seems to me we are in the same place Front-End Web was a couple of years ago: There is an explosion of new tech and frameworks. BUT there seems to be a bump for the adoption of new tech for data engineering, the HIGH cost of migrating terabytes and terabytes of the company's data to a new system.
Migrating and integrating data is incredibly expensive. When you implement a new system you either have to migrate the data from the older system (= expensive) OR having both systems working in parallel one for "older" data and one for newer (= really expensive)
Currently the established risk-averse corporations, the owners of most of the non- social media and internet data, seem to be still testing enterprise Hadoop distributions like Cloudera and Hortonworks for daily enterprise data operations, and maybie have some projects on R&D for harnessing new "types" ok data (like sensor data from a factory floor or high granularity transport data for supply chain).
Still, I hope the best of the new tech can get a place inside the modern corporations that work on important problems like Energy and Healthcare.
Migrating and integrating data is incredibly expensive. When you implement a new system you either have to migrate the data from the older system (= expensive) OR having both systems working in parallel one for "older" data and one for newer (= really expensive)
Currently the established risk-averse corporations, the owners of most of the non- social media and internet data, seem to be still testing enterprise Hadoop distributions like Cloudera and Hortonworks for daily enterprise data operations, and maybie have some projects on R&D for harnessing new "types" ok data (like sensor data from a factory floor or high granularity transport data for supply chain).
Still, I hope the best of the new tech can get a place inside the modern corporations that work on important problems like Energy and Healthcare.