Architecture

Cloudbreak Deployer Architecture

System Level Containers

Cloudbreak Application Architecture

Cloudbreak is built on the foundation of cloud providers APIs, Apache Ambari, Docker containers, Swarm and Consul.

Apache Ambari

The Apache Ambari project is aimed at making Hadoop management simpler by developing software for provisioning, managing, and monitoring Apache Hadoop clusters. Ambari provides an intuitive, easy-to-use Hadoop management web UI backed by its RESTful APIs.

System Administrators

Ambari enables to integrate Hadoop provisioning, management and monitoring capabilities into applications with the Ambari REST APIs.

  1. Provision a Hadoop Cluster:
    • Ambari provides a step-by-step wizard for installing Hadoop services across any number of hosts.
    • Ambari handles configuration of Hadoop services for the cluster.
  2. Manage a Hadoop Cluster:
    • Ambari provides central management for starting, stopping, and reconfiguring Hadoop services across the entire. cluster.
  3. Monitor a Hadoop Cluster:
    • Ambari provides a dashboard for monitoring health and status of the Hadoop cluster.
    • Ambari allows to choose between predefined alerts or add your custom ones.

Ambari Blueprint

Ambari blueprints are a declarative definition of a cluster. With a blueprint, you can specify stack, component layout and configurations to materialise a Hadoop cluster instance (via a REST API) without having to use the Ambari Cluster Install Wizard.

Docker

Docker is an open platform for developers and sysadmins to build, ship and run distributed applications. Consisting of Docker Engine, a portable, lightweight runtime and packaging tool and hub. Docker Hub is a cloud service for sharing applications and automating the workflow.

Docker enables apps to be quickly assembled from components and eliminates the friction between development, QA and production environments. As a result, IT can ship faster and run the same app, unchanged, on laptops, data center VMs and any cloud.

The main features of Docker

  1. Lightweight
  2. Portable
  3. Build once
  4. Run anywhere
  5. VM - without the overhead of a VM

    • Each virtualised application includes not only the application and the necessary binaries and libraries, but also an entire guest operating system
    • The Docker Engine container comprises just the application and its dependencies. It runs as an isolated process in userspace on the host operating system, sharing the kernel with other containers.
  6. Containers are isolated

  7. It can be automated and scripted

Swarm

Docker Swarm is native clustering for Docker. It turns a pool of Docker hosts into a single, virtual host. Swarm serves the standard Docker API.

Consul

Consul it is a tool for discovering and configuring services in your infrastructure.

Key features

Edit on GitHub