40,000 items in chinese language, Search Index was loading slowly and reply wrong results.

7 months 6 days ago - 7 months 4 days ago #69577 by lomuyeh
After Re-Index Advanced, the page was loading very slowly. (There are about 300k records in the table).
And after done, the result are all the same one.
Please check the attachment. The title and Search Index are all in Chinese, but I think you can see it's all the same.

The content of the table is good. Just the problem when click "Search Index".

The MYSQL slow query command is:

SELECT SQL_CALC_FOUND_ROWS ai.sid FROM kwtad_flexicontent_advsearch_index as ai JOIN kwtad_content as a ON ai.item_id=a.id ORDER BY a.title ASC LIMIT 0, 50

I don't know if it's a bug in newer version. I forgot when did I notice it. But I remember it started in previous version.

Or did I miss anything?

Thanks,
Lomu
Attachments:

Please Log in or Create an account to join the conversation.

7 months 6 days ago - 7 months 4 days ago #69578 by ggppdk
Hello

please send me a PM with super admin access


-- FLEXIcontent is Free but involves a big effort on our part.
Like the our support? (for a bug-free FC, despite having a long list of functions) Like the features? Like the ongoing development and future commitment to FLEXIcontent?
-- Add your voice to the FLEXIcontent JED listing with a 5-star review. Thanks!

Please Log in or Create an account to join the conversation.

7 months 4 days ago - 7 months 4 days ago #69624 by ggppdk
Hello

After Re-Index Advanced, the page was loading very slowly. (There are about 300k records in the table).


The backend "search index" page will not effect frontend
- i have made some changes, now backend "search index" listing, should load 4 times faster

about updating the index you have more that 40,000 items , so it should take some time ...


- about correctly populating the index
chinese has no spaces , right ?

so you will need a word file, with all chinese words seperated by enter (new line)
otherwise the words are added as 1 big single word

can you provide such file ?


-- FLEXIcontent is Free but involves a big effort on our part.
Like the our support? (for a bug-free FC, despite having a long list of functions) Like the features? Like the ongoing development and future commitment to FLEXIcontent?
-- Add your voice to the FLEXIcontent JED listing with a 5-star review. Thanks!

Please Log in or Create an account to join the conversation.

7 months 3 days ago #69625 by lomuyeh

ggppdk wrote: Hello

After Re-Index Advanced, the page was loading very slowly. (There are about 300k records in the table).


The backend "search index" page will not effect frontend
- i have made some changes, now backend "search index" listing, should load 4 times faster

about updating the index you have more that 40,000 items , so it should take some time ...

OK I see. I know it takes time. I just feel it took too long than it should be.

- about correctly populating the index
chinese has no spaces , right ?

so you will need a word file, with all chinese words seperated by enter (new line)
otherwise the words are added as 1 big single word

can you provide such file ?

Basically there won't be space between Chinese words.
So what you ask for is a file with ALL Chinese words?
I can try to provide but just want to confirm.

Thanks,
Lomu

Please Log in or Create an account to join the conversation.

7 months 3 days ago #69626 by ggppdk
Hello
So what you ask for is a file with ALL Chinese words?

yes a word file like this

account
accountant
accounting


or a PHP class that does splitting of chinese text into words
i was thinking of this one:
www.phpbone.com/phpanalysis/


-- FLEXIcontent is Free but involves a big effort on our part.
Like the our support? (for a bug-free FC, despite having a long list of functions) Like the features? Like the ongoing development and future commitment to FLEXIcontent?
-- Add your voice to the FLEXIcontent JED listing with a 5-star review. Thanks!

Please Log in or Create an account to join the conversation.

7 months 3 days ago #69627 by ggppdk
Hello

it seems that the word segmenter, that i mentioned above is best option

www.phpbone.com/phpanalysis/


-- FLEXIcontent is Free but involves a big effort on our part.
Like the our support? (for a bug-free FC, despite having a long list of functions) Like the features? Like the ongoing development and future commitment to FLEXIcontent?
-- Add your voice to the FLEXIcontent JED listing with a 5-star review. Thanks!
The following user(s) said Thank You: lomuyeh

Please Log in or Create an account to join the conversation.

7 months 3 days ago #69632 by lomuyeh
Hi
Thanks for your effort.
So do you still need the file with Chinese words?

Sorry for asking but I'm not that good in php coding. Just know some basics and tricks~

Thanks,
Lomu

Please Log in or Create an account to join the conversation.

7 months 3 days ago #69633 by ggppdk
Hello

i will use the above mentioned library

just would like a smaller website with a few chinese articles
(e.g. a new joomla install with a few chinese articles)

to make a faster testing


-- FLEXIcontent is Free but involves a big effort on our part.
Like the our support? (for a bug-free FC, despite having a long list of functions) Like the features? Like the ongoing development and future commitment to FLEXIcontent?
-- Add your voice to the FLEXIcontent JED listing with a 5-star review. Thanks!

Please Log in or Create an account to join the conversation.

7 months 3 days ago #69634 by lomuyeh
Hi
I will see what I can do.

Thanks,
Lomu

Please Log in or Create an account to join the conversation.

7 months 2 days ago #69647 by lomuyeh
Hi
Send you a PM.
Please check it.

Thanks,
Lomu

Please Log in or Create an account to join the conversation.

Moderators: vistamediajoomlacornerggppdk
© 2018 Flexicontent. All Rights Reserved.