bigdata, iot,

AIOT data collection

Wen-Chieh-Lee Wen-Chieh-Lee Follow Apr 10, 2021 · 1 min read
AIOT data collection
Share this

AIOT data collection

AIOT is the combination of AI and IOT. Three major steps for AIOT: data, intelligence, actions mean data collection, smart data intelligence, then actions accordingly. For data collection, IOT devices events and user behaviorial events might be collected via several approaches. Here we focus on the approaches of data collections and aggreagration.

via InfluxDB

Data collection, or IOT devices and user behaviorial events collection, can be formulated as time series or events and and stored in times series database (TSDB)

a time series or event can be in the form of

measurement tag fields timestamp

andd an example as

temperature,device=device1,buidling=b1 internal=80,external=18 1443782126

influxDB is the top solution for (TSDB) as collectors, aggregators and visualizer and its block digram as below.

A showcase of IOT data collection architecture via influxDB.

A detailed pipeline for telegraf plugins: Inputs, outputs, processors plugins to process the data.

An example show how FLUX to handle the data source buckets, pipe, and forward operator, and tables.

from(bucket:"mongo")
  |> range(start:-1h)
  |> filter(fn:(r) =>
    r._measurement == "cpu" and
    r.cpu == "cpu-total"
  )
  |> aggregateWindow(every: 1m, fn: mean)

References

Wen-Chieh-Lee
Written by Wen-Chieh-Lee
Senior Software Architect