Sign inSign up

loum/hadoop-pseudo

By loum

•Updated almost 3 years ago

Hadoop Pseudo-Distributed container image

Image
Languages & frameworks
Developer tools
Databases & storage
2

100K+

loum/hadoop-pseudo repository overview

⁠Hadoop Pseudo Distributed on Docker

⁠Overview

Quick and easy way to get Hadoop running in pseudo-distributed⁠ mode using Docker⁠. Ideal for experimentation but robust enough to use in your workloads.

Docker image is based on Ubuntu Jammy 22.04 LTS⁠.

See Hadoop docs⁠ for more information.

⁠Supported Tags and Respective Dockerfile Links

Hadoop version 3.3.6⁠

Hadoop version 3.3.5⁠

Hadoop version 3.3.4⁠

Hadoop version 3.3.3⁠

Hadoop version 3.3.2⁠

Hadoop version 3.3.1⁠

Hadoop version 3.2.2⁠

⁠Quick Reference

⁠Quick Start

⁠Start the Container
docker run --rm -d --name hadoop-pseudo\
 --publish 8088:8088\
 loum/hadoop-pseudo:latest

Hadoop ResourceManager is available at http://localhost:8088⁠

NOTE: This will start the HDFS filesystem with all default settings except for mapreduce.framework.name which has been set to yarn⁠. However, this can be changed back to the default local as per the following:

docker run --rm -d --name hadoop-pseudo\
 --env MAPRED_SITE__MAPREDUCE_FRAMEWORK_NAME=local\
 --publish 8088:8088\
 loum/hadoop-pseudo:latest
⁠Start shell Inside Container
 docker exec -ti hadoop-pseudo bash

Check the Hadoop Command Reference⁠

⁠Terminate Container
 docker stop hadoop-pseudo

Tag summary

Content type

Image

Digest

sha256:f697790dc…

Size

1 GB

Last updated

almost 3 years ago

docker pull loum/hadoop-pseudo:3.3.6