绑定完请刷新页面
取消
刷新

分享好友

×
取消 复制
MySQL令人咋舌的隐式转换
2019-11-29 12:06:16

导读

作者徐晨亮,MySQL DBA,知数堂学员。热衷于数据库优化,自动化运维及数据库周边工具开发,对MySQL源码有一定的兴趣

本文建议横屏观看,效果更佳

一、问题描述

root@mysqldb22:12: [xucl]> show create table t1\G

***************************1.row ***************************

Table: t1

Create Table: CREATE TABLE`t1`(

`id`varchar(255) DEFAULT NULL

) ENGINE=InnoDB DEFAULT CHARSET=utf8

1rowinset (0.00sec)

root@mysqldb22:19: [xucl]> select *fromt1;

+--------------------+

| id |

+--------------------+

|204027026112927605|

|204027026112927603|

|2040270261129276|

|2040270261129275|

|100|

|101|

+--------------------+

6rowsinset (0.00sec)

奇怪的现象:

root@mysqldb22:19: [xucl]> select *fromt1 where id=204027026112927603;

+--------------------+

| id |

+--------------------+

|204027026112927605|

|204027026112927603|

+--------------------+

2rowsinset (0.00sec)

什么鬼,明明查的是204027026112927603,为什么204027026112927605也出来了

二、源码解释

堆栈调用关系如下所示:

其中JOIN::exec()是执行的入口,Arg_comparator::compare_real()是进行等值判断的函数,其定义如下

int Arg_comparator::compare_real()

{

/*

Fix yet another manifestation of Bug#2338. 'Volatile' will instruct

gcc to flush double values out of 80-bit Intel FPU registers before

performing the comparison.

*/

volatile double val1, val2;

val1= (*a)->val_real();

if(!(*a)->null_value)

{

val2= (*b)->val_real();

if(!(*b)->null_value)

{

if(set_null)

owner->null_value=0;

if(val1 < val2)return-1;

if(val1 == val2)return0;

return1;

}

}

if(set_null)

owner->null_value=1;

return-1;

}

比较步骤如下图所示,逐行读取t1表的id列放入val1,而常量204027026112927603存在于cache中,类型为double类型(2.0402702611292762E+17),所以到这里传值给val2后val2=2.0402702611292762E+17。

当扫描到行时,204027026112927605转成doule的值为2.0402702611292762e17,等式成立,判定为符合条件的行,继续往下扫描,同理204027026112927603也同样符合

如何检测string类型的数字转成doule类型是否溢出呢?这里经过测试,当数字超过16位以后,转成double类型就已经不准确了,例如20402702611292711会表示成20402702611292712(如图中val1)

MySQL string转成double的定义函数如下:

{

char buf[DTOA_BUFF_SIZE];

double res;

DBUG_ASSERT(end != NULL && ((str != NULL && *end != NULL) ||

(str == NULL && *end == NULL)) &&

error != NULL);

res= my_strtod_int(str, end, error, buf, sizeof(buf));

return(*error ==0) ? res : (res <0? -DBL_MAX : DBL_MAX);

}

真正转换函数my_strtod_int位置在dtoa.c(太复杂了,简单贴个注释吧)

/*

strtod for IEEE--arithmetic machines.

This strtod returns a nearest machine number to the input decimal

string (or sets errno to EOVERFLOW). Ties are broken by the IEEE round-even

rule.

Inspired loosely by William D. Clinger's paper "How to Read Floating

Point Numbers Accurately" [Proc. ACM SIGPLAN '90, pp. 92-101].

Modifications:

1. We only require IEEE (not IEEE double-extended).

2. We get by with floating-point arithmetic in a case that

Clinger missed -- when we're computing d * 10^n

for a small integer d and the integer n is not too

much larger than 22 (the maximum integer k for which

we can represent 10^k exactly), we may be able to

compute (d*10^k) * 10^(e-k) with just one roundoff.

3. Rather than a bit-at-a-time adjustment of the binary

result in the hard case, we use floating-point

arithmetic to determine the adjustment to within

one bit; only in really hard cases do we need to

compute a second residual.

4. Because of 3., we don't need a large table of powers of 10

for ten-to-e (just some small tables, e.g. of 10^k

for 0 <= k <= 22).

*/

既然是这样,我们测试下没有溢出的案例

root@mysqldb23:30: [xucl]> select *fromt1 where id=2040270261129276;

+------------------+

| id |

+------------------+

|2040270261129276|

+------------------+

1rowinset (0.00sec)

root@mysqldb23:30: [xucl]> select *fromt1 where id=101;

+------+

| id |

+------+

|101|

+------+

1rowinset (0.00sec)

结果符合预期,而在本例中,正确的写法应当是

root@mysqldb22:19: [xucl]> select *fromt1 where id='204027026112927603';

+--------------------+

| id |

+--------------------+

|204027026112927603|

+--------------------+

1rowinset (0.01sec)

三、结论

避免发生隐式类型转换,隐式转换的类型主要有字段类型不一致、in参数包含多个类型、字符集类型或校对规则不一致等

隐式类型转换可能导致无法使用索引、查询结果不准确等,因此在使用时必须仔细甄别

数字类型的建议在字段定义时就定义为int或者bigint,表关联时关联字段必须保持类型、字符集、校对规则都一致

后贴一下官网对于隐式类型转换的说明吧

1、If one or bothargumentsare NULL, the resultofthe comparison is NULL, exceptforthe NULL-safe

<=> equality comparison operator. For NULL <=> NULL, the result istrue. No conversion is needed.

2、If bothargumentsina comparison operation are strings, they are comparedasstrings.

3、If bothargumentsare integers, they are comparedasintegers.

4、Hexadecimal values are treatedasbinary stringsifnot compared to a number.

5、If oneoftheargumentsis a TIMESTAMP or DATETIME column and the other argument is a

constant, the constant is converted to a timestamp before the comparison is performed. This is

done to be more ODBC-friendly. This is not donefortheargumentsto IN(). To be safe, always

use complete datetime, date, or time strings when doing comparisons. For example, to achieve best

results when using BETWEENwithdate or time values, use CAST() to explicitly convert the values to

the desired data type.

A single-row subqueryfroma table or tables is not considered a constant. For example,ifa subquery

returns an integer to be compared to a DATETIME value, the comparison is doneastwo integers.

The integer is not converted to a temporal value. To compare the operandsasDATETIME values,

use CAST() to explicitly convert the subquery value to DATETIME.

6、If oneoftheargumentsis a decimal value, comparison depends on the other argument. The

argumentsare comparedasdecimal valuesifthe other argument is a decimal or integer value, oras

floating-point valuesifthe other argument is a floating-point value.

7、In all other cases, theargumentsare comparedasfloating-point (real) numbers.

参考文章

1、聊聊 隐式转换

2、Type Conversion in Expression Evaluation:https://dev.mysql.com/doc/refman/8.0/en/type-conversion.html

感谢八怪的友情指导,想学习更多源码内容,强烈推荐一下八怪的专栏《深入理解MySQL主从原理》

END

点击下图小程序订阅

《深入理解MySQL主从原理32讲》专栏

可了解更多八怪技术文章

扫码加入MySQL技术Q群

(群号:793818397)

   

分享好友

分享这个小栈给你的朋友们,一起进步吧。

MySQL大本营
创建时间:2019-04-18 16:52:37
MySQL大本营是MySQL爱好者交流的社区。关注:MySQL实战,MySQL高性能,MySQL架构实战,MySQL DBA职业发展。MySQL大本营旨在创造一个MySQL社区交流环境。
展开
订阅须知

• 所有用户可根据关注领域订阅专区或所有专区

• 付费订阅:虚拟交易,一经交易不退款;若特殊情况,可3日内客服咨询

• 专区发布评论属默认订阅所评论专区(除付费小栈外)

栈主、嘉宾

查看更多
  • coolriver
    栈主

小栈成员

查看更多
  • 小雨滴
  • hwayw
  • 栈栈
  • 老七
戳我,来吐槽~