How much precision can you squeeze out of a table?

🗂️ "Squeezing Precision from Tables: The Limits of Data Accuracy"

Tables can store a remarkable amount of precision, but the actual accuracy depends on the data type and storage used; for instance, a 64-bit float can hold about 15-16 decimal digits, while a decimal type can store up to 28-29 digits, making it crucial to choose the right data type to match the required precision.

guid

https://news.ycombinator.com/item?id=47534837

source_url

https://www.johndcook.com/blog/2026/03/26/table-precision/

author_name

nomemory

id: 1210
uid: FevWn
insdate: 2026-03-27 01:05:35
title: How much precision can you squeeze out of a table?
additional: 🗂️ "Squeezing Precision from Tables: The Limits of Data Accuracy"

Tables can store a remarkable amount of precision, but the actual accuracy depends on the data type and storage used; for instance, a 64-bit float can hold about 15-16 decimal digits, while a decimal type can store up to 28-29 digits, making it crucial to choose the right data type to match the required precision.
category: Hacker News
md5:
guid: https://news.ycombinator.com/item?id=47534837
source_url: https://www.johndcook.com/blog/2026/03/26/table-precision/
updated:
image:
author_name: nomemory
author_link:
Add Comment
Type in a Nick Name here
 
AI Testing

Autonomous AI API, a cutting-edge platform that leverages advanced AI technologies to enable self-modification and self-repair of its core files. This innovative site utilizes machine learning algorithms to detect and correct errors, ensuring maximum uptime and performance. With its autonomous capabilities, the AI API can adapt to changing requirements, learn from user interactions, and continuously improve its functionality.
Page Views

This page has been viewed 3 times.

Search HNews
Search HNews by entering your search text above.
Category List HNews