Questions tagged [cjk]
CJK stands for Chinese, Japanese and Korean and is used to label issues common to these East Asian languages and their large character repertoires.
1,049
questions
0
votes
1
answer
26
views
Splitting a column that contains Chinese Characters MySQL
So I have a table that has a column 'full_name' and it stores chinese names in the format surname+given name.
What I want to do is split it into two columns: one for surname and one for given name. ...
6
votes
1
answer
68
views
Generating chinese/pinyin names
I am trying to generate random chinese names using Faker (Python), but it generates the names in chinese characters instead of pinyin.
I found this :
from faker import Faker
fake = Faker("zh_CN&...
0
votes
0
answers
25
views
Korean characters are showing as squares, only in raspberry Pi
I'm trying to display some korean characters into a tkinter window. Those characters are read from a .json file, and displayed direct to buttons, labels and so.
If I try to execute the script on my ...
0
votes
1
answer
16
views
Pinyin packages: accuracy and efficiency
I am looking to get the pinyin of Simplified Mandarin characters, and have come across two packages:
pinyin 0.4.0 which is 6 years old (GitHub repo here)
pinyin_jyutping_sentence which is 2> years ...
0
votes
0
answers
19
views
iText7 : How to add chinese characters to a paragraph inside cell
I'm using iText7 with Arial as font. Now Chinese and other Unicode characters should be entered mixed in address fields.
However, the Unicode characters disappear. I thought Arial was Unicode aware?
...
0
votes
0
answers
16
views
Split function, with Unicode delimiter visual basic 6
i wrote data arrays at the end of the exe with delimiter. After I compiled, the app it didn't work on Chinese Windows, only on English, I want to configure the app to work on Chinese windows as well, ...
0
votes
1
answer
38
views
How to set source encoding for 'list' command in GDB?
I have a project, Geki 2, which is written in C and uses a library called Kacchan X Library (libKXL for short) for graphics and sound. This library uses X11 API directly. When debugging Geki 2 under ...
-1
votes
0
answers
14
views
Why should most CJK fonts support the Latin alphabet and Arabic numerals?
Why should most (computer/screen) CJK fonts support the Latin alphabet and Arabic numerals, even though they are not CJK symbols?
2
votes
1
answer
30
views
Chinese characters with multiple unicode representations
Some Chinese characters have multiple Unicode representations. For example, although the characters 金 and 金 are usually rendered the same, they actually have different underlying unicodes (see https://...
0
votes
0
answers
15
views
Csv file character conversion in python to Japanese language [duplicate]
I am having a csv file which contains columns having numbers and some strings but there are few rows having characters like this ->"
ã¥ûzF¤i
ãAz¿AMtgï¿ÆµÄwüÒ©ç¥ûµ½
ã"
When i open this via ...
2
votes
0
answers
40
views
Destructuring Korean characters
What I'm trying to do is get a Korean verb or adjective and turn it to its dictionary form. So let's say that someone typed '추워요', which is the adjective for cold. Its dictionary form is '춥다'. Is ...
2
votes
1
answer
54
views
How do I enable Chinese input in pygame?
What I want to do is this: using pinyin input method to input Chinese characters in pygame.
The only way to do this I have figured out is: reading the individual keyboard input, and then use some ...
1
vote
0
answers
32
views
Change from Japanese font style to English font style in Python
So i have trouble with Japanese font like "939-2367", what i read in Japanese database.
It's different with normal font in my PC like 0123456789.
So how can i convert Japanese font to ...
0
votes
0
answers
16
views
Chinese text in source code is not interpreted correctly by CS compiler [duplicate]
I can see the text in Chinese to display correctly in VSCode, Notepad++, and Notepad.
But, when I run the code the Chinese text shows garbled.
Here is the code:
// Text used in this sample is taken ...
0
votes
0
answers
51
views
Apply custom font to Unicode range while preserving font of characters outside range
My goal is to apply a custom font that I have to a range of Unicode characters (Chinese in this case), and have the remaining characters retain their font.
Via this Stack Overflow question: How to ...
0
votes
1
answer
102
views
EUC-KR encoded XML Shows as invalid Korean character
We are fetching a EUC-KR encoded XML data <?xml version='1.0' encoding='EUC-KR' ?> , while printing the value in console or saving the data in file show as <![CDATA[����Ư���� ������ �������87�...
1
vote
1
answer
99
views
How to automatically translate between traditional and simplified Chinese characters with Unicode?
Is there a way to translate programmatically from traditional to simplified Chinese characters? If so, how do you do it, does unicode offer a way? If not, why doesn't there exist a database with the ...
1
vote
2
answers
53
views
Python FTP return corrupted name of file: じし->し ゙し (how can i properly decode/encode a string)
In my open source application, I use rented hosting with FTP. My application needs to read a list of files from a directory and parse it. However, some of the files have erroneous names. How can I ...
0
votes
0
answers
69
views
What Unicode Ranges are used exclusively by Simplified Chinese, Traditional Chinese, Korean, and Japanese?
I need to create packages that contain Unicode characters used only by a specified language. A key requirement for these packages is to make them as small as possible (thus why each package only ...
0
votes
0
answers
24
views
Using Dart Regex to determine if a character is a kanji
I'm trying to use a regular expression to parse a file and add the kanji to a list in Dart. I'm trying to add the kanji to a list, only the ones containing certain radicals. A sample of the contents ...
0
votes
0
answers
36
views
How can use fcitx-pinyin in wechat's docker?
I build an image with wechat.Dockerfile wechat.Dockerfile:
docker build -f wechat.Dockerfile --tag=wechat:0.0.3 .
Have pushed into docker hub,you can pull it .
docker pull yufeiluo/wechat:0.0.3
Run ...
0
votes
1
answer
35
views
Performance Testing for Japanese Language Based website
I have an application in which the content inside the website is totally in Japanese language with some english alphabets included in between.
Example string- ヘマトクリット A B C ヘマトクリット
Need to Capture ...
1
vote
0
answers
183
views
How can I allow Chinese characters in C++ input?
I've been trying to take Chinese (simplified) inputs through both the iostream in Visual Studio 2019. When I input an English word, it works fine. To make sure that the console is printing correctly, ...
0
votes
0
answers
20
views
How can I use php mpdf, can not Chinese garbled code?
This is my php code, use dPdf, But the PDF I got was garbled in Chinese,like this:
I tried many methods, but they didn't work, My MPDF version is 8.0.8, php verson is v7.4
<?php
$defaultConfig = (...
0
votes
1
answer
42
views
Script crashes when trying to read a specific Japanese character from file
I was trying to save some Japanese characters from a text file into a string. Most of the characters like "道" make no problems. But others like "坂" don't work. When I'm trying to ...
0
votes
0
answers
16
views
Chromium reports CJK characters' height as taller than Latin characters
I have an <input element in a form along with some code checking that the text being entered doesn't exceed the dimensions of the input. This is done by using a second hidden input and comparing ...
1
vote
0
answers
37
views
Can you create a Range variable of all 2136 kanji letters?
I currently creating a simple Japanese learning application in Ruby on Rails.
I have a Word model that needs to create a Kanji model if it contains a kanji character.
At first, I though of using Regex ...
0
votes
0
answers
23
views
How to display Chinese in programs on CentOS7 system?
I am writing a c program in CentOS7(using VMware), l have succeed in making my system language Chinese, but But the Chinese in my code still cannot be displayed normally. like this
PS:English is not ...
1
vote
2
answers
46
views
substr Chinese string after first space in R
How can I extract Chinese characters after a space?
The original data is below:
10:36 不願做奴隸的人們 然後看你有沒有在時間內申覆。
10:37 千里之外 真的很無奈
10:37 不願做奴隸的人們 如果五天內你沒注意信心,表示你默認。
The data that I need is:...
0
votes
1
answer
742
views
Package fontspec Error: The Font SimSun can't be found
I am using Overleaf for my Chinese thesis work and having this issue "Package fontspec Error: The font "SimSun" cannot be found."
\setCJKmainfont[AutoFakeBold = {2.25},ItalicFont={[...
0
votes
1
answer
92
views
mPDF Japanese font configuration
I need to generate a PDF using mPDF and YuGothM.ttc font for a Japanese client. The page I need to export in PDF contains some text which in browser version (HTML) is rendered well, but in the PDF, ...
1
vote
0
answers
31
views
Cannot break specific Korean Characters
How can I break these characters?
ᄀᄁᄂᄃᄄᄅᄆᄇᄈᄉᄊᄋᄌᄍᄎᄏᄐᄑ
As you can see, all of the characters are automatically moved to the new line to prevent overflowing but not the said Korean string above.
...
0
votes
0
answers
58
views
Chinese characteres are not properly rendered in CMD/Powershell
I have this rendering issue on Chinese characters on multiple console app: fzf, lazygit and vim (when running fzf).
I have set the chcp to 65001 as default, using the correct font for Chinese (so the ...
0
votes
1
answer
50
views
Reading the kanji database kradfile into R: encoding problem
I am trying to load the kradfile into R like this:
krad<-readLines("kradfile2",encoding = "UTF-8")
krad<-readLines("kradfile2",encoding = "EUC-JP")
but ...
0
votes
0
answers
18
views
Generate PDF from HTML using MPdf with Japanese characters and NotoSansJP font [duplicate]
I have a website built on WordPress within I made a plugin to extend some specific functionality. One is to export a grid with custom header from a html content to PDF. I have to use MPdf (version 8) ...
1
vote
1
answer
204
views
How to smooth scrolling when clicking an japanese anchor link
My anchor link generated automatically:
<a class="" href="#Heading_3" title="">Heading 3</a>
<a class="" href="#%E3%81%A8%E3%80%81%E3%82%B2%...
0
votes
2
answers
45
views
MySQL 5.7 select where Unicode SMP area char equal
I want to select table use character in Unicode CJK Extension-B.
select * from saseung where hanja = '𦤎';
But the result shows all CJK Extension-B characters in the table.
𦤎, 𦥑, 𣩭, 𦇗, 𨙄, etc
I ...
0
votes
2
answers
146
views
Decode Korean String from Bytes in Java
I ran into struggles converting a byte array korean chars in Java.
Wikipedia states that somehow 3 bytes are beeing used for each char, but not all bits are taken into account.
Is there a simple way ...
0
votes
0
answers
73
views
how to modify flair.data.Sentence to work on Chinese text(which tokenizer to use inside)?
from flair.data import Sentence
for sent_ind, sent in enumerate(chinese_sentences):
sentence = Sentence(sent, use_tokenizer= True)
0
votes
0
answers
18
views
Remove double-byte whitespace in Japanese language
I am removing whitespace from my 'sequence' string but for Japanese whitespace this code isn't working. How can I remove Japanese language whitespace, which is double-byte I believe? So when entries ...
0
votes
0
answers
58
views
How can I get the path of the file which name is not in English?
I made a page for uploading files with MultipartRequest.
There is no problem when i check the uploaded files.
and then I have a problem when I'm downloading it.
If the file's name is in Korean, the ...
1
vote
0
answers
60
views
How to parse and encode Chinese Characters in Jupyter Notebook?
I want to train a really basic NLP model but using Chinese characters. Read_csv doesn't really work.
I was also wondering if there is any way to extract the different parts of the character, like for ...
2
votes
1
answer
211
views
How to Check If The Rune is Chinese Punctuation Character in Go
For Chinese punctuation chars like ~ , 。, how to detect via Go?
I tried with range table of package unicode like the code below, but Han doesn't include those punctuation chars.
Can you please tell me ...
0
votes
0
answers
12
views
How to add Japanese citations?
I know how to add Japanese text to my dissertation, but when I try to do it in a citation, it does not work. I get a "?" in the resulting .pdf and the citation is not added to the ...
1
vote
2
answers
200
views
Tokenizing Chinese text with keras.preprocessing.text.Tokenizer
keras.preprocessing.text.Tokenizer doesn't work correctly with Chinese text. How can I modify it to work on Chinese text?
from keras.preprocessing.text import Tokenizer
def fit_get_tokenizer(data, ...
0
votes
0
answers
14
views
Truncate Chinese characters in Jekyll
I have a Jekyll blog with a mixture of Chinese and English posts. truncatewords works excellently for all English posts until it is applied to Chinese posts. Instead of showing just a few lines of the ...
1
vote
2
answers
106
views
Custom format Korean date with forward-slash not working
If you run the following code: https://dotnetfiddle.net/kBqe9x
using System;
public class Program
{
public static void Main()
{
var date = DateTime.Now;
...
0
votes
1
answer
48
views
Cannot query nvarchar values [duplicate]
I have one table in sql db where I store nvarchar values
CREATE TABLE [dbo].[Buns]
(
[ID] INT NOT NULL PRIMARY KEY IDENTITY,
[ARABIC] NVARCHAR(MAX) NULL,
[...
0
votes
0
answers
19
views
Springboot use FileInputStream to read file(chinese name) in linux Failed
//filePath:/root/pcl/代码安全审计报告.xlsx
File file = new File(filePath);
InputStream is = new FileInputStream(file);
is.close();
Charset.defaultCharset().name() is "UTF-8"
System.getProperty(&...