What are Fixed-point numbers (exact numbers)?

Data System Architecture

About

A fixed-point number represents a limited-precision rational number that may have a fractional part.

These numbers are stored internally in a scaled-integer form, typically in binary but sometimes in decimal.

Because fixed-point numbers have limited precision, only a subset of real or rational numbers are exactly representable; other numbers can be represented only approximately.

Fixed-point numbers also tend to have a more limited range of values than floating point, and so the programmer must be careful to avoid overflow in intermediate calculations as well as the final results.

Arithmetic on fixed-point values is very slow compared to the integer types, or to the floating-point types but they can store numbers with a very large number of digits and perform calculations exactly.

Syntax

In computer, the data type of fixed point number is generally called NUMERIC

NUMERIC(precision, scale)

Precision

Precision is the total number of digits.

Example:

  • The number 00123456.78 has a precision of 8

If a value exceeds the precision, then Oracle returns an error.

Scale

Scale is the number of digits from the radix point to the least significant digit.

Example:

  • The number 00123456.78 has a positive scale of 2

If a value exceeds the scale, then Oracle rounds it.

The scale can range from -84 to 127.

Positive

Positive scale is the number of significant digits to the right of the decimal point to and including the least significant digit.

Negative

Negative scale is the number of significant digits to the left of the decimal point, to but not including the least significant digit. For negative scale the least significant digit is on the left side of the decimal point, because the actual data is rounded to the specified number of places to the left of the decimal point. For example, a specification of (10,-2) means to round to hundreds.

Documentation / Reference





Discover More
Data System Architecture
Computer - Fixed Point

fixed point number in computer are generally called: NUMERIC or DECIMAL
Data System Architecture
Fixed Point Number - Precision

Precision is the maximum number of significant digits (on either side of the radix point) in the fixed point notation The number 00123456.78 has a precision of 8 123.45 has a precision of 5...
Data System Architecture
Number - Integer -

An integer is the part of a number that is located at the left of the radix point. In other word, it's a number without its fractional component. Negative numbers without fractional components are...
Data System Architecture
Number - Scale

Scale is the total number of digits to the right of the decimal point in the fixed point notation. Generally, a positive value round to the right and a negative value round the value to the left. ...
Data System Architecture
Number, Numeric, Quantity

A number is a mathematical object used to: count, label, and measure. Example: When we are interested in the total number of each species of tortoise, or how many individuals there are per square...
Card Puncher Data Processing
Oracle Database - NUMBER Data Type

The NUMBER data type stores zero as well as positive and negative fixed numbers with absolute values from 1.0 x 10-130 to (but not including) 1.0 x 10126. If you specify an arithmetic expression whose...
Card Puncher Data Processing
Oracle Database - Numeric Datatype

The following SQL data types store numeric data: NUMBER for integers and real numbers in a fixed-point or floating-point format BINARY_FLOAT and BINARY_DOUBLE for floating point Use the NUMBER...
Data System Architecture
SQL - Data Type

The Data Type of a column in SQL. They are defined in the ANSI/ISO SQL standard but may vary from sql engine (database) to another. The below table shows you the history of the data type in the ANSI...
Data System Architecture
SQL - Decimal(p,s) or Numeric(p,s)

DECIMAL and NUMERIC are sql datatype used to represent a fixed point notation (exact number) numeric is generally functionally identical to decimal. With a DECIMAL(5,2): the number has: a precision...
What is JSON (JavaScript Object Notation)?

JSON 99)) is a structured text format that stands for JavaScript Object Notation. It is a simple text format that can be used for representing nested structures of data (lists of...



Share this page:
Follow us:
Task Runner