Question2Answer Q&A - Recent questions tagged japanese

can anybody help me about the search function for Japanese

Tue, 08 Mar 2011 20:55:59 +0000

In japanese, there are no space between words, so this search engline can't pick up any words and but only words in tags.

I found the following Q&A

Q2A converts text into words (for searching) based on separating out words by word delimiters, like spaces (obviously), commas, quote marks, etc...

You can see the full set used at the top of qa-util-string.php, in the constant QA_PREG_INDEX_WORD_SEPARATOR and also in the mapping $qa_utf8punctuation which converts UTF-8 punctuation characters.

In the case of Chinese and similar languages, there are no word delimiters per se, but rather each multibyte (UTF-8) character is essentially a separate word.

I don't know what exactly how I do that. It wound very much appreciate if someone write me a code and tell me where I put it on which file.

One of the usrs wrote the following code but it seems to be problem because of slowness.

That is what he did:

open qa-include/qa-db-selects.php file and go to qa_db_search_posts_selectspec() function.

Just before below line ( almost end of function )

if ($selectparts==0)

add this lines

if (!empty($handlewords)) {
$aaa = implode($handlewords);}
else
{$aaa = $handlewords;}

$selectspec['source'].=($selectparts++ ? " UNION ALL " : "").
"(SELECT postid AS questionid, 0 AS score, _utf8 'Q' AS matchposttype, postid AS matchpostid FROM ^posts JOIN ^users WHERE (^posts.title like _utf8 '%".$aaa."%' OR ^posts.content like _utf8 '%".$aaa."%' ) AND type='Q' )";

This will work fine, except if your database starts containing a large amount of content, in which case it could become quite slow.

Can Japanese be used?

Mon, 28 Feb 2011 02:23:13 +0000

Can Japanese be used?

How can I convert string into words in a mixed-language question?

Fri, 25 Feb 2011 03:03:42 +0000

I have same problem when searching question or answer in japanese. Like chinese, japanese sentence has no space between words.

Gidgreen gave us a clue to deal with such kind of problem inserting space between characters so it can be splitted into words .But I still have trouble with this. My site is not pure japanese, It mixes between Japanese and Vietnamese (separates words by space like English). For example, sometime i got a question like this: [ Vì sao người Nhật không nói 愛している ?] or [にあずからなかった cấu trúc này là như nào vậy] . In this case, the solutions does not work well, because it may change vietnamese word into splitted characters like this: không ---> k h ô n g

Have you got any idea to deal with this?