Flume - Log (Aggregator|Collector)

Data System Architecture

About

Apache Flume 1) is a log collector to collect, aggregate, and move log data from many different sources to a centralized data store.

Glossary

  • aggregation = sink

Documentation / Reference

  • Apache Flume example with HTTP channel to HBase Sync example - time to show some ODI examples with basic templates http://t.co/AYJEZ4iDoq
1)
Apache Flume




Discover More
Data System Architecture
Data Management - (Transaction|Request|Commit|Redo) Log

(Transaction|Request|commit) logs are structured log file store all changes made to the data as they occur. They permits the implementation of : transaction isolation undoable operation. recovery...
Card Puncher Data Processing
Oracle Database - Golden Gate (OGG)

1926867.1Oracle GoldenGate Application (Java) Adapter v11.2.1 Example for Flume (into HBase, Hive, HDFS)
Bird Message
Stream - Messaging System

Messaging systems implements near-realtime asynchronous computation. A messaging system is a fairly low-level piece of infrastructure—it stores messages and waits for consumers to consume them as stream...
Data System Architecture
What are Log Collectors (Aggregators)?

A log collector will collect log file, optionally transform them and deliver them to one or more destination such as: a log server or metrics server Name Type Log to Log Log To Metrics Description...



Share this page:
Follow us:
Task Runner