40,000 items in chinese language, Search Index was loading slowly and reply wrong results.

More
10 months 3 days ago - 10 months 1 day ago #69577 by lomuyeh
After Re-Index Advanced, the page was loading very slowly. (There are about 300k records in the table).
And after done, the result are all the same one.
Please check the attachment. The title and Search Index are all in Chinese, but I think you can see it's all the same.

The content of the table is good. Just the problem when click "Search Index".

The MYSQL slow query command is:

SELECT SQL_CALC_FOUND_ROWS ai.sid FROM kwtad_flexicontent_advsearch_index as ai JOIN kwtad_content as a ON ai.item_id=a.id ORDER BY a.title ASC LIMIT 0, 50

I don't know if it's a bug in newer version. I forgot when did I notice it. But I remember it started in previous version.

Or did I miss anything?

Thanks,
Lomu
Attachments:
Last edit: 10 months 1 day ago by ggppdk.

Please Log in or Create an account to join the conversation.

More
10 months 3 days ago - 10 months 1 day ago #69578 by ggppdk
Hello

please send me a PM with super admin access


-- FLEXIcontent is Free but involves a big effort on our part.
Like the our support? (for a bug-free FC, despite having a long list of functions) Like the features? Like the ongoing development and future commitment to FLEXIcontent?
-- Add your voice to the FLEXIcontent JED listing with a 5-star review. Thanks!
Last edit: 10 months 1 day ago by ggppdk.

Please Log in or Create an account to join the conversation.

More
10 months 1 day ago - 10 months 1 day ago #69624 by ggppdk
Hello

After Re-Index Advanced, the page was loading very slowly. (There are about 300k records in the table).


The backend "search index" page will not effect frontend
- i have made some changes, now backend "search index" listing, should load 4 times faster

about updating the index you have more that 40,000 items , so it should take some time ...


- about correctly populating the index
chinese has no spaces , right ?

so you will need a word file, with all chinese words seperated by enter (new line)
otherwise the words are added as 1 big single word

can you provide such file ?


-- FLEXIcontent is Free but involves a big effort on our part.
Like the our support? (for a bug-free FC, despite having a long list of functions) Like the features? Like the ongoing development and future commitment to FLEXIcontent?
-- Add your voice to the FLEXIcontent JED listing with a 5-star review. Thanks!
Last edit: 10 months 1 day ago by ggppdk.

Please Log in or Create an account to join the conversation.

More
10 months 23 hours ago #69625 by lomuyeh

ggppdk wrote: Hello

After Re-Index Advanced, the page was loading very slowly. (There are about 300k records in the table).


The backend "search index" page will not effect frontend
- i have made some changes, now backend "search index" listing, should load 4 times faster

about updating the index you have more that 40,000 items , so it should take some time ...

OK I see. I know it takes time. I just feel it took too long than it should be.

- about correctly populating the index
chinese has no spaces , right ?

so you will need a word file, with all chinese words seperated by enter (new line)
otherwise the words are added as 1 big single word

can you provide such file ?

Basically there won't be space between Chinese words.
So what you ask for is a file with ALL Chinese words?
I can try to provide but just want to confirm.

Thanks,
Lomu

Please Log in or Create an account to join the conversation.

More
10 months 22 hours ago #69626 by ggppdk
Hello
So what you ask for is a file with ALL Chinese words?

yes a word file like this

account
accountant
accounting


or a PHP class that does splitting of chinese text into words
i was thinking of this one:
www.phpbone.com/phpanalysis/


-- FLEXIcontent is Free but involves a big effort on our part.
Like the our support? (for a bug-free FC, despite having a long list of functions) Like the features? Like the ongoing development and future commitment to FLEXIcontent?
-- Add your voice to the FLEXIcontent JED listing with a 5-star review. Thanks!

Please Log in or Create an account to join the conversation.

More
10 months 22 hours ago #69627 by ggppdk
Hello

it seems that the word segmenter, that i mentioned above is best option

www.phpbone.com/phpanalysis/


-- FLEXIcontent is Free but involves a big effort on our part.
Like the our support? (for a bug-free FC, despite having a long list of functions) Like the features? Like the ongoing development and future commitment to FLEXIcontent?
-- Add your voice to the FLEXIcontent JED listing with a 5-star review. Thanks!

Please Log in or Create an account to join the conversation.

More
10 months 17 hours ago #69632 by lomuyeh
Hi
Thanks for your effort.
So do you still need the file with Chinese words?

Sorry for asking but I'm not that good in php coding. Just know some basics and tricks~

Thanks,
Lomu

Please Log in or Create an account to join the conversation.

More
10 months 16 hours ago #69633 by ggppdk
Hello

i will use the above mentioned library

just would like a smaller website with a few chinese articles
(e.g. a new joomla install with a few chinese articles)

to make a faster testing


-- FLEXIcontent is Free but involves a big effort on our part.
Like the our support? (for a bug-free FC, despite having a long list of functions) Like the features? Like the ongoing development and future commitment to FLEXIcontent?
-- Add your voice to the FLEXIcontent JED listing with a 5-star review. Thanks!

Please Log in or Create an account to join the conversation.

More
10 months 15 hours ago #69634 by lomuyeh
Hi
I will see what I can do.

Thanks,
Lomu

Please Log in or Create an account to join the conversation.

More
9 months 4 weeks ago #69647 by lomuyeh
Hi
Send you a PM.
Please check it.

Thanks,
Lomu

Please Log in or Create an account to join the conversation.

Moderators: vistamediajoomlacornerggppdk
© 2018 Flexicontent. All Rights Reserved.