(Data|State) Management and Processing

This section is about data and state management as opposed to code.

System that manages data are called database.

In a computer, there is two kinds of byte

• instruction byte
• and data byte.

This section is about data byte.

Data are recorded facts.

Data are often viewed as the lowest level of abstraction from which information and knowledge are derived.

Data comes from the Latin word datum meaning a thing given.

The word data is the plural of the word datum, which means the result of a single measurement.

Data without context tells a misleading story.

Application needs to:

• Store and retrieve data:
  • a small amount (OLTP databases),
  • analytics (OLAP, columnar databases)
• Speed up response time by remembering the result of expensive operations (caches),
• Search data or filter it (search indexes),

Reference : Warehouse Builder 11g - What is new and where do we go from here?

• Data - Unstructured data - (structure-later|schema-later|schema on read) data
• Data - Raw Data
• Data - Aggregate Data
• Data Science - Big Data
• Dark Data

• Data: recorded facts
• Information: patterns, or expectations, that underlie them
• Knowledge: the accumulation of your set of expectations
• Wisdom: the value attached to knowledge

• Weka unit 5 - The data mining process