Skip to content

Svetixbot/hadoop-up-and-running

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 

Repository files navigation

Hadoop cluster on Virtual box with Docker

Mac OSx

Prerequisites checklist

Setup:

1. mkdir hadoopUpAndRunning
2. cd hadoopUpAndRunning
3. create docker-compose.yml file
4. copy content from README page of [This docker image](https://registry.hub.docker.com/u/badele/debian-hadoop/)
5. boot2docker init
6. boot2docker up

Init HDFS

docker-compose run namenode hdfs namenode -format

Start hadoop cluster

docker-compose up -d

Check port numbers and ip address

$ docker ps
$ boot2docker ip

Access hadoop web-ui:

https://{boot2docker ip-address}:{port number of namenode}/
sample: https://192.168.59.103:50070

Access hadoop fs:

hadoop fs -ls hdfs:https://{boot2docker ip-addess}/

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published