Skip Menu |
 

This queue is for tickets about the DBD-mysql CPAN distribution.

Report information
The Basics
Id: 51059
Status: resolved
Priority: 0/
Queue: DBD-mysql

People
Owner: MICHIELB [...] cpan.org
Requestors: sargie [...] cpan.org
Cc: paulm [...] paulm.com
AdminCc:

Bug Information
Severity: Important
Broken in: 4.013
Fixed in: 4.033



CC: paulm [...] paulm.com
Subject: DBD::mysql incorrectly handles Unicode chars with a codepoint > ffff
Download (untitled) / with headers
text/plain 198b
DBD::mysql's 'mysql_enable_utf8' flag works fine for characters with a codepoint of 'ffff' or below - above that, it's failing to either encode or decode them properly. Attached script demonstrates.
Subject: test.pl
Download test.pl
text/x-perl 1.4k
#!/usr/bin/perl use strict; use warnings; use DBI; my @labels = ( # On the right side of the ffff/10000 border ["\x{61}", '[97/61]' ], # LATIN SMALL LETTER A ["\x{2012}", '[8210/2012]' ], # FIGURE DASH ["\x{ffee}", '[65518/ffee]' ], # HALFWIDTH WHITE CIRCLE # On the wrong side of the ffff/10000 border ["\x{10000}", '[65536/10000]'], # LINEAR B SYLLABLE B008 A ["\x{10412}", '[66578/10412]'], # DESERET CAPITAL LETTER BEE ); my $db = DBI->connect( 'DBI:mysql:database=idl_test', 'root', '', { mysql_enable_utf8 => 1 } ); for ( @labels ) { my ( $label, $explanation ) = @$_; # Insert our label $db->do("DELETE FROM testtest"); $db->prepare(" INSERT INTO testtest VALUES (?) ")->execute( $label ); # Retrieve our label my $retrieve_sql = $db->prepare("SELECT * FROM testtest"); $retrieve_sql->execute(); my $result = $retrieve_sql->fetchrow_arrayref->[0]; # Was it right? if ( $result eq $label ) { print "Result and label are equal: " . explode( $label ) . "\n"; } else { print "Result and label are NOT equal:\n"; print "Label was: " . explode( $label ) . "\n"; print "Result was: " . explode( $result ) . "\n"; } print '-' x 75 . "\n"; } sub explode { my $string = shift; my @chars = split(//, $string); my $explain; for my $char ( @chars ) { my $ord = ord($char); my $hex = sprintf("%x", $ord); $explain .= "[$ord/$hex]"; } return $explain; } __DATA__ CREATE TABLE testtest ( label varchar(255) ) charset=utf8;
Download (untitled) / with headers
text/plain 436b
On Mon 02 Nov 2009 21:29:03, SARGIE wrote: Show quoted text
> DBD::mysql's 'mysql_enable_utf8' flag works fine for characters with a > codepoint of 'ffff' or below - above that, it's failing to either encode > or decode them properly. Attached script demonstrates.
Hi, Thanks for your ticket. version 4.033 and later of DBD::mysql got 'mysql_enable_utf8mb4' which makes this now work! See also https://mathiasbynens.be/notes/mysql-utf8mb4 -- Michiel


This service is sponsored and maintained by Best Practical Solutions and runs on Perl.org infrastructure.

Please report any issues with rt.cpan.org to rt-cpan-admin@bestpractical.com.