Table - Csv Data Structure

> (Data|State) Management and Processing > (Data Type|Data Structure) > (Relation|Table) - Tabular data > Table - Physical Data Structure

1 - About

The CSV format is a physical representation of a relation (table).

Tabular formats are often more space-efficient than JSON, which can improve loading times for large datasets.

Advertising

3 - Text qualifier

The text qualifier is used to enclose text values in the exported data.

This is required when some data include a comma (such as some European address formats), and these must be distinguished from the commas that are used to separate each column value in the exported text file.

4 - Syntax

Escape character: “

"You are ""top"""

New Line: CRLF

"You are ""top""" CRLF

New line in field:

"You are CRLF 
top" CRLF

5 - Library

Tool;

  • json2csv (json to xml) Converts a stream of newline separated json data to csv format,
  • csvkit. A suite of utilities for converting to and working with CSV, the king of tabular file formats.
Advertising

6 - Row to column storage

  • A simple way to turn a CSV file into a column-oriented (columnar) format is to save each column to a separate file. To load the data back in, read a single line from each file (column), and 'stitch' the data back together into a row.

7 - Extended

Extended CSV format add metadata to the data (such as data type,…)

By order of preference:

8 - Documentation / Reference

data/type/relation/structure/csv.txt · Last modified: 2018/10/31 08:58 by gerardnico