|
| PORTAIL | ANNUAIRE | ARTICLES | COMPARATEUR HÉBERGEURS | DEVIS | FORUMS | RÉDUCTEUR D'URL |
|
|
|
|
||||||
| ms.sqlserver.setup Questions about SQL Server. |
 |
|
|
LinkBack | Outils de la discussion |
14/02/2007, 00h43
|
#1 |
Messages: n/a
Hébergeur: |
setting arithmetic precision for SQL function results
(I'm using SQL Server 2005) When I download data from a database table into a
DataSet and run calculations in VB, e.g. an average over 200 rows for a decimal type number, I get very precise answers. However, if I use a SQL user-defined function to do the same calculation, the answer seems to be rounded to maybe 3 or 4 decimal places. Is there an option somewhere to increase the precision of the function calculation in SQL Server? -- Ed |
|
|
14/02/2007, 01h09
|
#2 |
|
Messages: n/a
Hébergeur: |
never mind!
Actually, I determined I had a rounding function in my software in one of the
calculations but not the other that affected the outcome. Apparently, SQL Server's precision is just as precise. -- Ed "Ed White" wrote: > (I'm using SQL Server 2005) When I download data from a database table into a > DataSet and run calculations in VB, e.g. an average over 200 rows for a > decimal type number, I get very precise answers. However, if I use a SQL > user-defined function to do the same calculation, the answer seems to be > rounded to maybe 3 or 4 decimal places. Is there an option somewhere to > increase the precision of the function calculation in SQL Server? > -- > Ed |
|
|
|
| Outils de la discussion | |
|
|
