Questions tagged [utf8mb4]
Unlike its `utf8` encoding, MySQL’s `utf8mb4` encoding offers full Unicode support (including four-byte UTF-8-encoded symbols).
403
questions
-1
votes
0
answers
18
views
Problems found when displaying from my MySQL database in a website [duplicate]
I would like to inform you that every 3 months or 2 months, I update information in my PHPMYADMIN SQL database..I made a web site for my client and he complained that the font of the web site was not ...
0
votes
2
answers
87
views
utf8_encode and mb_convert_encoding Conflicting Resuts [duplicate]
I have a very annoying issue when transferring data from PHP (which is set up with default_charset = 'UTF-8') to MySQL, on an IIS environment with web.config set to:
<globalization requestEncoding=&...
0
votes
0
answers
21
views
How to change value of character_set_results variable to utfmb4 in MySQL 8.0?
I am trying to read in a browser, the utf8 characters from MySQL database. After necessary changes made in my PHP code, I decided to edit my.ini in MySQL 8.0 in my Windows 11 machine.
Some changes ...
0
votes
1
answer
83
views
issues connecting MySQL workbench to Power BI
I am unable to connect my DB to Power Bi after installing the correct connectors.
Details: "An error happened while reading data from the provider: 'Character set 'utf8mb3' is not supported by ....
0
votes
1
answer
54
views
whether magento 2.4.6 support utf8mb4 [duplicate]
currently i work magento website based 2.4.6.
when customer sso login from line, there are some EmoJi characters. When use utf8mb3, it show ???. We need change mariadb to be utf8mb4.
when run bin/...
0
votes
1
answer
74
views
How to wrap 32-bit (4 bytes) emojis in arbitrary string using PHP?
I'm using this PHP function to wrap emojis in arbitrary HTML tags, which allows me to style them on web pages, since CSS3 does not (yet?) directly support styling of multi-byte characters, at least I ...
0
votes
0
answers
19
views
Mysql select data not working because string is utf-8 [duplicate]
I'm having a problem while executing a SELECT query. Namely, I use an external API to analyze whether articles are in my database. I noticed that the source encoding is UTF-8 while my base encoding is ...
0
votes
0
answers
31
views
Cant change charset of database
Now I have character set utf8mb3 for my database. I want to change it to utf8mb4. For this task, I create a script, that creates SQL script, that doing it. This script can generate rows like this:
...
1
vote
0
answers
63
views
JPABuddy Liquibase Init generation of MySQL uses utf8mb3 for nvarchar?
I uses JPABuddy to generate an init Liquibase db for MySQL 8.0.33 DB. I notices that for nvarchar datatype it uses character set utf8mb3, collation utf8mb3_general_ci which are deprecated, instead ...
0
votes
0
answers
106
views
how to handle warnings shown when applying flyway migrations on MySQL 8.0
After upgrading to MySQL 8.0 I started testing flyway migrations that I have been using on our current MySQL 5.7, I started seeing warning about deprecation like
WARNING: DB: Integer display width is ...
1
vote
1
answer
141
views
MySQL: Illegal mix of collations: both same collation
I see a number of questions on SO regarding something similar, but none of them addresses this particular detail.
I created a database using something like this:
CREATE DATABASE db CHARACTER SET ...
0
votes
1
answer
318
views
Issue when migrating data in charset latin1 from MySQL 5.7 to 8.0
My company faced an unpleasant issue when we upgraded our MySQL DB hosted in AWS RDS from version 5.7 to 8.0.
Initially, we had MySQL 5.7, where the previous dev team left the charsets and collations ...
0
votes
1
answer
44
views
Tcl, database insertion mysqlexec/db server: Incorrect string value:
I have a weird issue for several years now. Here's the thing.
I run Rocky Linux (happens also in CentOS), running Apache 2.4.53 wiith MariaDB (mysql Ver 8.0.30 for Linux on x86_64 (Source ...
1
vote
2
answers
169
views
Using like with mariadb and chinese characters
I come back with utf8mb4 character issues. I'm using mariadb Server version: 10.3.37-MariaDB-0ubuntu0.20.04.1 Ubuntu 20.04 on a local machine with Linux Mint 20.3.
Here is a test table:
CREATE TABLE ...
1
vote
1
answer
333
views
How to store emojis in a MySQL table? Tried everything
I have a CSV file containing tweets with emojis (eg. "Cool! 💕") and I need to import them into a MySQL table in such a way they will be saved/displayed correctly...
What do I have to set up ...
0
votes
1
answer
127
views
How to use emojis (or other utf8mb4) characters in a column alias of a MySQL query?
I'm using SuiteCRM 7 with a MySQL 8.0.31 database. I have taken steps to migrate the MySQL database to accept utf8mb4 characters which works well when entering in, say, emojis into table data either ...
1
vote
0
answers
170
views
PHP json encode and Node.js decode utf8mb4_unicode_ci strings
On my server, the database is encode in utf8mb4_unicode_ci
I'm writing an API to serve data in JSON.
The PHP function json_encode only accepts utf8.
I'm not able to build the full chain:
strings ...
-1
votes
1
answer
41
views
Prints results including HTML Entity code instead of value itself
When I edit a data value, the output it prints includes the HTML entity along with the value itself.
Example:
Expected text: Absence &
Obtained text: <p>Ausence &</p>
I'm ...
1
vote
1
answer
7k
views
How to insert special characters in SQL Server? [duplicate]
Much like this question in MySQL, I am trying to retain special characters such emojis into an nvarchar type column. However, any emojis are converted to "??". I have tried to reproduce the ...
0
votes
0
answers
25
views
How to convert a MySQL table's character set and collation to UTF-8? [duplicate]
This has been asked before and answered: How to convert an entire MySQL database characterset and collation to UTF-8?
The right answer is along the lines of:
ALTER TABLE tablename CONVERT TO CHARACTER ...
2
votes
1
answer
214
views
execute failed: Incorrect string value: '\xE4rvine...' with mariadb and perl DBD
More than three years ago I posted a similar question related to not being able to insert data into a table because of what I believe is an incorrect character set, and I'm having the same problem ...
0
votes
0
answers
18
views
Save SQL in Windows, to upload in Plesk [duplicate]
Very confused about charsets.
I've a script to download a .sql file that contains Sql tables. I use MySql.
My tables are like this:
CREATE TABLE `xxx` (
`id` int(11) NOT NULL AUTO_INCREMENT,
`...
2
votes
1
answer
885
views
MySQL to postgres migration issue
I want to migrate my project from MySQL to postgres, I have one table in MySQL, in which utf8mb4 set for particular column in a table, what alternative is there in postgres to set in column for ...
1
vote
1
answer
957
views
Laravel exception: 1366 Incorrect string value: '\\xC0\\xA7\\xC0\\xA2%2...' for column 'user_agent'
Occasionally I will get the following exception thrown from Laravel:
"class": "Illuminate\\Database\\QueryException",
"message": "SQLSTATE[HY000]: General error: ...
3
votes
3
answers
9k
views
ERROR 1300 (HY000): Invalid utf8mb4 character string: 'Paysand'
I was trying to import csv data file using command prompt in MySQL Workbench (mysql Ver 8.0.30 for Win64 on x86_64 (MySQL Community Server - GPL)).
Using following steps:
mysql>
load data local ...
2
votes
2
answers
769
views
UTF8-mb4 in Kafka
I have a UTF8-mb4 char in mongo and have a java extractor which extracts data from mongo and put into kafka. When the data goes to Kafka the special char has been replaced with \u...
Sample text:- &...
0
votes
1
answer
777
views
How to get mysqldump to export a database in the right encoding and collation?
I'm having a problem with the encoding when dumping a database using mysqldump.
The issue is that the file being generated is breaking non-ASCII characters (for ex. german and spanish characters). The ...
1
vote
1
answer
2k
views
MySQL: 1366 Incorrect string value: '\xE0' in utf8mb4 column
I'm getting errors when certain characters are being added to a table... even when the column is has utf8mb4 character set. For example:
SQLSTATE[HY000]: General error: 1366 Incorrect string value: '\...
-1
votes
1
answer
59
views
mySQL optimizations - Compact type type, InnoDB and UTF8MB4
I'm using a community forum site software package.
In the dashboard the automated software reports some suggestions to make the site more efficient.
The recommendations are/were to:
Use dynamic table ...
0
votes
2
answers
603
views
How do I to export utf8mb4 mysql data using php to a csv file
I am looking for help on a csv file export.
I have a mysql database encoded as utf8mb4 (unicode_ci) with a table using collation utf8mb4_unicode_ci for my fields. The data contains special characters ...
1
vote
0
answers
120
views
Table with latin1 collation slow query, fast with utf8mb4 - why?
Table A is 25k rows with a dozen columns, about 8mb of total data set to latin1.
Table B has 2000 rows with two dozen columns, about 5mb of total data set to utf8mb3.
Doing an inner join between the ...
0
votes
1
answer
151
views
how to convert raw utf8mb4_unicode_ci like X'313735313136' to a regular string (utf8) in php
This question is about converting a raw utf8mb4_unicode_ci from a .sql to a normal utf-8
My .sql was from a database that had COLLATE utf8mb4_unicode_ci
like this :
(5558,'2019-11-18 18:28:36',X'...
-1
votes
2
answers
8k
views
General error: 3988 Conversion from collation utf8_unicode_ci into utf8mb4_0900_ai_ci impossible for parameter
I'm trying to save a string containing html of an email in a text type column. but i'm getting this error. I failed finding where's the incompatible caractere. There is any sanitizing method that i ...
0
votes
2
answers
102
views
MySQL 5.7 select where Unicode SMP area char equal
I want to select table use character in Unicode CJK Extension-B.
select * from saseung where hanja = '𦤎';
But the result shows all CJK Extension-B characters in the table.
𦤎, 𦥑, 𣩭, 𦇗, 𨙄, etc
I ...
0
votes
2
answers
241
views
"Incorrect string value" when trying to insert UTF-8 into MySQL from Rails
While debugging my Rails App I found the following messages in the log file:
(0.1ms) ROLLBACK
Completed 500 Internal Server Error in 25ms (ActiveRecord: 4.2ms)
ActiveRecord::StatementInvalid (Mysql2::...
0
votes
1
answer
270
views
Python/Mysql UTF8/UTF8MB4 configuration problem?
Since last release of Wordpress I get a
/usr/lib/python3/dist-packages/pymysql/cursors.py:170: Warning: (3719, "'utf8' is currently an alias for the character set UTF8MB3, but will be an alias ...
0
votes
0
answers
33
views
Still get the replacement character error even after modifying the table characterset and collation
The MySQL version is 8.0.16
I modified the table character set and collation :
alter table pdrintervention character set utf8mb4 collate utf8mb4_0900_ai_ci;
At runtime I still get the Incorrect ...
2
votes
1
answer
4k
views
Incorrect string value \xF0\x9F\x98\x8A\xF0\x9F... for column 'desc'
I'm having this error and still don't know why.
I predict it's happen because some users try to use an emoji. But I try a lot of emoji and it all work.
I use Mysql 5.7
I already set column to COLLATE ...
1
vote
3
answers
1k
views
UTF-8 decoding when reading a MySQL column of type JSON (vs. TEXT), using Perl DBI + DBD::mysql
Here is the problem, in a working unit test. I think it's either a bug in DBI + DBD::mysql, with respect to how it handles MySQL JSON columns, or a bug in my brain.
use strict;
use warnings;
use utf8;...
0
votes
2
answers
2k
views
How does php utf8_decode deal with utf8mb4? [duplicate]
I am working on localhost windows10 apache 2.4: Apache/2.4.51 (Win64) OpenSSL/1.1.1l PHP/8.0.11and Database client version: libmysql - mysqlnd 8.0.11 which uses the server Server version: 10.4.21-...
0
votes
1
answer
342
views
Hi, I am trying to find all instances of utf8mb4_bin in my table, using REGEXP, but cannot get the right results
I can find single chars using:
SELECT * FROM table WHERE column LIKE '%Â%' COLLATE utf8mb4_bin;
-- 1 result: 246.8 ± 11.7
I have tried a dozen or more REGEXP with COLLATE utf8mb4_bin, but none ...
3
votes
0
answers
485
views
mysql 1300 Invalid utf8mb4 character string: '\\xF0\\x9F\\x91\\x8C' with Unicode emoji
So I'm trying to commit unicode emoji to database (this one especially:👌)
But everytime something with emoji is executed on database this happens:
pymysql.err.OperationalError: (1300, "Invalid ...
0
votes
1
answer
182
views
MariaDB query won't run via PHP, works manually with HeidiSQL; en dash encoding issue; proper DB utf8mb4 character set and collation
I'm importing emails from a Gmail account and storing them in a database. Apparently my PHP logic to convert everything to UTF-8 has failed with one particular email and when I run the query with that ...
0
votes
0
answers
34
views
Convert or store non-ascii characters properly in a MySQL Database [duplicate]
My Question
How can I store or convert emojis and french accents and other special non-ascii characters in a MySQL database?
The Problem
Within the wp_posts table of my MySQL database called local, ...
0
votes
1
answer
237
views
Words of Urdu Language are not displaying properly after changing hosting server
I was previously using Namecheap hosting servers to run my website (https://www.bilawalcoachingcenter.com) and now shifted on Site Ground. The problem is that the words of the Urdu language, that were ...
0
votes
1
answer
195
views
How to import amharic data from to mysql database?
I found this from stack overflow
ALTER DATABASE ethioVision CHARACTER SET utf8mb4 COLLATE utf8mb4_0900_ai_ci;
but still cannot add file
0
votes
0
answers
176
views
Problem changing mysql database encoding to utf8mb4 in Gcloud
I have a mysql database in Gcloud using utf8 enconding and I want to change it to utf8mb4 to support storing emoticons.
I did this using my local version of mysql in my laptop and it worked fine using:...
0
votes
1
answer
447
views
What collation can be used in MySQL 5.5 for sorting Japanese characters?
I have a database with utf8mb4 character set and Ive been trying to select records where data are in Japanese characters but the utf8mb4_general_ci collation can't seem to order the result correctly. ...
0
votes
0
answers
84
views
Laravel Mysql error inserting £ sign (Incorrect string value: '\xA327.20...')
I am using laravel to import some .txt files into the database.
The contents of the file would be:
Amount due is £27.20
I am able to obtain the contents of the file using
$record[contents] = Storage::...
0
votes
1
answer
156
views
MySQL utf8 multibyte (utf8mb4) insert duplicate entry problem
I have two words ('বাঁধা' and 'বাধা') to be inserted in a mysql (8.0.12 - MySQL Community Server - GPL) table. The word 'বাঁধা' is inserted correctly. But when inserting 'বাধা', mysql produces an ...