Data Flow

Extracts, Transforms and Moves Data from Various Sources and Automates Data Processing Flow
Data Flow is data processing flow tool that extracts large data from various data sources. It enables the visual establishment of how stream/batch data are converted/transmitted and also provides open source Apache NiFi services. It can be used independently in a Kubernetes Engine cluster environment of Samsung Cloud Platform or along with other application SW.

Features

  1. Easy Installation

    The installation of Data Flow in a standard Kubernetes cluster environment is easy using a web-based console. By auto-configuring the architecture needed for open source Apache NiFi-based scalable clustering, ZooKeeper, registry and management modules are installed automatically. Using Data Flow, configuration files and NiFi template needed for service connection can be configured as well as deployed.

  2. Easier Data Flow Management

    You can easily create GUI-based data stream/batch processing and processing flow according to user environment. Creating the flowchart of stream/batch data between systems is easy as it is GUI-based. This also makes the extraction, moving, and processing of data more efficient.

  3. NiFi Template Gallery

    Using Data Flow, reference NiFi templates are shared and deployed. Data Flow provides a gallery of frequently-used NiFi templates and users can share their data processing jobs.

Architecture Diagram and Details

Architecture Diagram
Easy installation
  • Automatically install container-based open source NiFi scalable cluster environment using a web console
  • Pre-installed components : NiFi, ZooKeeper, NiFi Registry
Data processing
  • Data sources available for connection : HDFS, HIVE, HBASE, Solr, Cassandra, MongoDB, Elasticsearch, Kafka, RabbitMQ, Syslog, HTTPS, SFTP, etc
  • Connect with data at a real-time, track data flow, and prevent data loss
  • Processing large amounts of data and parallel tasks
GUI-based easy management
  • GUI-based deployment/management of NiFi settings and Nar files in a cluster environment
  • Share/deploy NiFi templates
Check Pricing by currency

Pricing Standard

  • It is charged per minute of CPU usage for the container pods used by Data Flow created by the Apache NiFi cluster.
(Unit: KRW/hour, VAT excluded)
Type License Fee Note
Per 1vCore54
Minimum vCore quantities are available in units of 0.1.
Users are charged per minute and any usage less than a minute will be rounded up to the next full minute.
(e.g. Charged for 2 minutes when usage is 1 minute and 20 seconds)
Rates for Kubernetes Engine, Virtual Server, Storage, etc. for service configuration are charged separately.