13

I want to have different process for English word and Japanese word in this function

function process_word($word) {
   if($word is english) {
     /////////
   }else if($word is japanese) {
      ////////
   }
}

thank you

1
  • 1
    maybe it does not have to be language... just to differentiate double byte character
    – bbnn
    Commented May 18, 2010 at 12:15

6 Answers 6

26

A quick solution that doesn't need the mb_string extension:

if (strlen($str) != strlen(utf8_decode($str))) {
    // $str uses multi-byte chars (isn't English)
}

else {
    // $str is ASCII (probably English)
}

Or a modification of the solution provided by @Alexander Konstantinov:

function isKanji($str) {
    return preg_match('/[\x{4E00}-\x{9FBF}]/u', $str) > 0;
}

function isHiragana($str) {
    return preg_match('/[\x{3040}-\x{309F}]/u', $str) > 0;
}

function isKatakana($str) {
    return preg_match('/[\x{30A0}-\x{30FF}]/u', $str) > 0;
}

function isJapanese($str) {
    return isKanji($str) || isHiragana($str) || isKatakana($str);
}
8
  • This leaves out english words which use diacritics. These are not used very often, however it's a tradeoff that should be known when making the choice :) Commented May 18, 2010 at 14:57
  • @Thomas.Winsnes: You mean stuff like Hai, Wa, Ka, Arigatou and so on, right?
    – Alix Axel
    Commented May 18, 2010 at 14:59
  • No, I mean english words like: naïve, café, résumé, soufflé etc. Commented May 18, 2010 at 15:19
  • 1
    I always write naïve with a diæresis, and diæresis with a æ.
    – Zorf
    Commented May 19, 2010 at 16:46
  • 1
    @AlixAxel You can check for the kana Unicode ranges, given in the isHiragana() and isKatakana() functions above. Any text with either of those is almost definitely Japanese, and almost all Japanese text that isn't extremely short will have at least a few characters in those ranges. isJapanese() above should be written as just isHiragana($str) || isKatakana($str), since isKanji() will also return true for Chinese or (some) Korean text. Commented Aug 2, 2012 at 22:38
22

This function checks whether a word contains at least one Japanese letter (I found unicode range for Japanese letters in Wikipedia).

function isJapanese($word) {
    return preg_match('/[\x{4E00}-\x{9FBF}\x{3040}-\x{309F}\x{30A0}-\x{30FF}]/u', $word);
}
3
3

You could try Google's Translation API that has a detection function: http://code.google.com/apis/language/translate/v2/using_rest.html#detect-language

0
1

Try with mb_detect_encoding function, if encoding is EUC-JP or UTF-8 / UTF-16 it can be japanese, otherwise english. The better is if you can ensure which encoding each language, as UTF encodings can be used for many languages

0

English text usually consists only of ASCII characters (or better say, characters in ASCII range).

1
  • 1
    Although it's fairly easy to identify most words as being either English or Japanese, there are some characters that belong to both character sets. For example, a string containing only numbers should return true for both English and Japanese.
    – Jin Kim
    Commented Jun 7, 2010 at 16:57
0

You can try to convert the charset and check if it succeeds.

Take a look at iconv: http://www.php.net/manual/en/function.iconv.php

If you can convert a string to ISO-8859-1 it might be english, if you can convert to iso-2022-jp it is propably japanese (I might be wrong for the exact charsets, you should google for them).

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.