Float numbers coming back incorrectly

Float numbers coming back incorrectly

jhblayzerjhblayzer Posts: 1Questions: 1Answers: 0

I am running into an issue where I am getting back a different number in the table than what I am sending it from the ajax call, as well it being different from the number shown in the export file for the table. The number from the ajax call and the export match up as they should but the data table display itself seems to be messing up the number.

Here is an example of what I am seeing:
0.92152777777778
0.9215277777777778

The top number there is what the ajax is sending back to the table, and the bottom number is what I am seeing on the data table display.

There is no number formatting or anything set for this column or this number so I am not sure how or why this is being changed. Anyone with any ideas of this would be of much help.

Thank you!

Answers

  • allanallan Posts: 61,744Questions: 1Answers: 10,111 Site admin

    Can you link to a test case showing the issue please? At a guess is say it is something to do with IEEE 754 numbers, but really is need to be able to see it.

    Allan

  • colincolin Posts: 15,154Questions: 1Answers: 2,587

    It's displaying as expected here . If you are unable to link to your page, perhaps update that example please to demonstrate the issue.

    Colin

Sign In or Register to comment.