Published September 7, 2026
| Version v2.0.0
Software
Open
Hadoop Infrastructure for Big Data using Docker Compose
Description
Hadoop Big Data Infrastructure v2.0.0
Version 2.0.0 introduces a major update to the Docker Compose infrastructure used for Big Data learning, experimentation and technical demonstrations.
Main improvements
- Persistent storage for HDFS NameNode and DataNode.
- Persistent Hive Metastore using PostgreSQL.
- Persistent storage for Zeppelin notebooks.
- Persistent storage for Kafka and ZooKeeper.
- Persistent MySQL storage used by Hue.
- Persistent storage for StreamSets.
- Persistent repositories and state for Apache NiFi.
- Apache NiFi updated and fixed to version 2.11.0.
- NiFi configured in standalone mode with HTTPS access.
- StreamSets startup issue fixed by configuring the required
nofilelimit. - Docker services configured with
restart: unless-stopped. - Improved separation between container lifecycle and persistent data.
- Updated
docker-compose.yml,hadoop-hive.env,README.mdandCITATION.cff.
Persistence
This release introduces explicit Docker volumes for services that maintain state.
Notes
Files
juliopez/Hadoop-v2.0.0.zip
Additional details
Related works
- Is supplement to
- Software: https://github.com/juliopez/Hadoop/tree/v2.0.0 (URL)
Software
- Repository URL
- https://github.com/juliopez/Hadoop