Data Quality - Data (cleaning|scrubbing|wrangling)

> (Data|State) Management and Processing > Data Quality

1 - About

Data cleansing or data scrubbing is the act of:

corrupt or inaccurate records from a record set, table, or database.

Used mainly in databases, the term refers to identifying incomplete, incorrect, inaccurate, irrelevant etc. parts of the data and then replacing, modifying or deleting this dirty data.

The goal is to get data ready for analysis.

After cleansing, a data set will be consistent with other similar data sets in the system. The inconsistencies detected or removed may have been originally caused by different data dictionary definitions of similar entities in different stores, may have been caused by user entry errors, or may have been corrupted in transmission or storage.


3 - Tool

4 - Documentation / Reference

data/quality/data_cleansing.txt · Last modified: 2017/11/20 17:33 by gerardnico