Software Design - Real time

Card Puncher Data Processing

About

Real time refers to the data latency property of eventual consistency being almost instantaneous.

See What is a Stream? Also known as Pipe, Message Queue or Event Processing

Real time process have the highest priority

They are generally passed over a websocket in dual communication application.

Example

push real-time updates such as:

  • notifications,
  • vote counts,
  • new answers
  • comments

Algorithm

Recursive algorithm on few data may run in real time: See Data Science - (Kalman Filtering|Linear quadratic estimation (LQE))




Discover More
Card Puncher Data Processing
Data Processing - Replication

Replication: Having a copy of the same data on multiple machines (nodes) in order to increase : Feature Example Performance serve reads in parallel, distributing application workloads across multiple...
Thomas Bayes
Data Science - (Kalman Filtering|Linear quadratic estimation (LQE))

Kalman Filtering or Linear quadratic estimation (LQE) is an algorithm that uses a series of measurements observed over time Because of the algorithm's recursive nature, it can run in real time using only...
Utah Teapot
Data Visualization Foundation

The Utah Teapot. Data visualization is the process of mapping quantitative data to visuals (shapes, color, position, etc) to create a graph made of geometric object. Information visualization: ...
Data System Architecture
Data property - Data Latency

Data latency is a property of eventual consistency and describe how quickly two set of data will be consistent. This is a latency performance of the consistency of your data. In a DW/BI environment,...
Card Puncher Data Processing
Monitoring - (Alert|Anomalie) Detection

Alerting is the science of detection Deviations from prediction on Time serie are a powerful way to tell when there is a problem and to trigger alerts when a is reached. See also: ...
Process States
OS - Process (Main Thread) / Program

OS A process is the first thread started (called the main thread). It's the only thread that is authorized to start a new threads. A process is a unit of resources, while a thread is a unit of: scheduling...
Card Puncher Data Processing
Stream - Apache Storm (Real Time analytics)

A platform for doing analysis on streams of data in real-time. Storm process unbounded streams of data. It does for realtime processing what Hadoop did for batch processing....
Bird Message
Stream - Messaging System

Messaging systems implements near-realtime asynchronous computation. A messaging system is a fairly low-level piece of infrastructure—it stores messages and waits for consumers to consume them as stream...
Stream Vs Batch
Stream vs Batch

This article talks Stream Processing vs Batch Processing. The most important difference is that: in batch processing the size (cardinality) of the data to process is known whereas in a stream processing,...
Event Centric Thinking
Streaming - SQL

continuous SQL query on an infinite data stream A streaming sql can not be ANSI SQL compliant because the streaming functions are not part of those database standards. A streaming query is a query that...



Share this page:
Follow us:
Task Runner