Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

normalization methods for stream data

I am using Clustream algorithm and I have figured out that I need to normalize my data. I decided to use min-max algorithm to do this, but I think in this way the values of new coming data objects will be calculated differently as the values of min and max may change. Do you think that I'm correct? If so, which algorithm shall I use?

like image 263
T.Sh Avatar asked Jul 24 '15 15:07

T.Sh


People also ask

What is stream normalization?

Data normalization explainedThe normalizer's job is to patch up the incoming data stream to eliminate the risk of evasion as well as ambiguities. The monitor then views the data in its pure, protected and normalized form. Varying forms of normalization exist on levels of increasing complexity.

Which method is best for normalization?

In my opinion, the best normalization technique is linear normalization (max – min). It's by far the easiest, most flexible, and most intuitive.

What are three normalization methods?

The three main categories of normalization methods, namely (i) data-driven procedures, (ii) external controls, and (iii) all-gene reference, are reviewed in the following sections Data-Driven Reference Normalization to All-Gene Reference Normalization, respectively.


1 Answers

Instead to compute the global min-max based on the whole data, you can use a local nomarlization based on a sliding window (e.g. using just the last 15 secconds of data). This approach is very commom to compute Local Mean Filter on signal and image processing.

I hope it can help you.

like image 165
Vinicius Woloszyn Avatar answered Sep 29 '22 13:09

Vinicius Woloszyn