SAP Knowledge Base Article - Preview

2259442 - How do you determine if your 4.2 Web Intelligence document numerical errors are caused by double-precision round-off issues?

Symptom

  • Web Intelligence document presenting numerical values.
  • Apparent loss-of-precision: inaccuracies in the least-significant digits of the number.
  • Only 15 to 16 digits of precision is retained when a numerical computation is performed.
  • How do you determine if the error is caused by loss-of-precision in the use of double-precision number formats?

Read more...

Environment

  • SAP BusinessObjects BI Platform 4.2 Web Intelligence
  • Double Precision or Extended Precision or BigDecimal Numbers

 

Product

SAP BusinessObjects Business Intelligence platform 4.2

Keywords

OCINumber, decimal128, WebI, trunctation, floating-point, double-precision, IEEE 754, IEEE 754-2008 , KBA , gscnawest_video , video , big number , BI-RA-WBI , Web Intelligence , How To

About this page

This is a preview of a SAP Knowledge Base Article. Click more to access the full version on SAP ONE Support launchpad (Login required).

Search for additional results

Visit SAP Support Portal's SAP Notes and KBA Search.