Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Hadoop very "fancy" 5-6 years ago, what's the trend now? I guess with managed services from AWS / Google it makes Hadoop less useful?


Its still there - storage is still mainly HDFS, but computation layer morphed into Spark on Yarn (Mesos as a scheduler is barely used). Barely anyone runs classic Mapreduce jobs, Spark all around, written in Scala(or java or python).


The managed data science services from AWS/Google is Hadoop/Spark.


True. Some one in the cloud is managing these Hadoop stacks for you. You just pay usage of these services.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: