I have a Big Data class and I’m looking for a way for the easiest way to deploy Hadoop (single-use?) over Fly.io so my students can run a simple mapreduce. Do I need to deploy Docker Hub over Fly.io or is there other ways to do it?
1 Like
I looked at a few articles about booting up Hadoop clusters. They appear to have a lot of moving parts. So you could do it, if you know Hadoop well enough to know which services are required.
This example has no less than 11 services running! Would be glad to help if you knew, roughly, which of these services are needed to run a minimal cluster.