Sphinx is crushed when use api_v3 for search action

5 replies [Last post]
Tue, 03/01/2011 - 02:07
k0hji
k0hji's picture
User offline. Last seen 46 weeks 4 days ago.
Joined: 08/21/2010
Points: 22

Hi,

When I use api_v3 for search action with "nameMultiLikeAnd" for mixing entries, the kaltura server does not make any response.

According with sphinx log of kaltura server, it seems that the sphinx is crushed with following log.

tail -n 30 kaltura_sphinx_searchd.log

[Tue Mar 1 03:48:48.966 2011] [ 486] Searchd 1.10-beta (r2420)
[Tue Mar 1 03:48:48.966 2011] [ 486] Program compiled with gcc 3.4.6
[Tue Mar 1 03:48:48.966 2011] [ 486] Host OS is Linux domU-12-31-39-00-0F-12 2.6.18-xenU-ec2-v1.0 #2 SMP Mon Feb 18 14:28:43 UTC 2008 x86_64 x86_64 x86_64 GNU/Linux
[Tue Mar 1 03:48:48.966 2011] [ 486] Stack bottom = 0x7f993a8f2e67, thread stack size = 0xa4000
[Tue Mar 1 03:48:48.994 2011] [ 486] /opt/kaltura/bin/sphinx/searchd() [0x409dbd]
[Tue Mar 1 03:48:48.994 2011] [ 486] /lib/libpthread.so.0(+0xf8f0) [0x7f993bf4b8f0]
[Tue Mar 1 03:48:48.994 2011] [ 486] /opt/kaltura/bin/sphinx/searchd() [0x565193]
[Tue Mar 1 03:48:48.994 2011] [ 486] /opt/kaltura/bin/sphinx/searchd() [0x5659e5]
[Tue Mar 1 03:48:48.994 2011] [ 486] /opt/kaltura/bin/sphinx/searchd() [0x57fbd0]
[Tue Mar 1 03:48:48.994 2011] [ 486] /opt/kaltura/bin/sphinx/searchd() [0x56b270]
[Tue Mar 1 03:48:48.994 2011] [ 486] /opt/kaltura/bin/sphinx/searchd() [0x57ce16]
[Tue Mar 1 03:48:48.994 2011] [ 486] /opt/kaltura/bin/sphinx/searchd() [0x595082]
[Tue Mar 1 03:48:48.994 2011] [ 486] /opt/kaltura/bin/sphinx/searchd() [0x580106]
[Tue Mar 1 03:48:48.994 2011] [ 486] /opt/kaltura/bin/sphinx/searchd() [0x43bc12]
[Tue Mar 1 03:48:48.994 2011] [ 486] /opt/kaltura/bin/sphinx/searchd() [0x43d924]
[Tue Mar 1 03:48:48.994 2011] [ 486] /opt/kaltura/bin/sphinx/searchd() [0x44062f]
[Tue Mar 1 03:48:48.994 2011] [ 486] /opt/kaltura/bin/sphinx/searchd() [0x443e41]
[Tue Mar 1 03:48:48.994 2011] [ 486] /opt/kaltura/bin/sphinx/searchd() [0x44ce8f]
[Tue Mar 1 03:48:48.994 2011] [ 486] /opt/kaltura/bin/sphinx/searchd() [0x522f2f]
[Tue Mar 1 03:48:48.994 2011] [ 486] /lib/libpthread.so.0(+0x69ca) [0x7f993bf429ca]
[Tue Mar 1 03:48:48.994 2011] [ 486] /lib/libc.so.6(clone+0x6d) [0x7f993b77470d]
[Tue Mar 1 03:48:48.994 2011] [ 486] Stack trace seems to be succesfull. Now you have to resolve the numbers above and attach resolved values to the bugreport. See the section about resolving in the documentation

It is actually caused when the filter data includes "space" between words.
This crush is happen not only use with filter "nameMultiLikeAnd", but use "tagsNameMultiLikeOr"....

Since sphinx is a indexer for search, it seems to conflict to use the search texts which include space code between search words.
However, I would like to use search which include a space code for finding a entry which has matching specific phrase.

When, this crush has occured, I can't use search function for long time.
The search function freeze is also affect to KMC. The contents view of KMC returns "Internal Server Error".

Does anybody have solution?
I would like to know :

  • how to avoid sphinx crush
  • when sphinx crush has happen, how to restart it

    • My environment is :

  • Ubuntu Lucid (10.04) 64bit
  • Kaltura 3.0
  • Client use api_v3
  • php 5.3.2-1ubuntu4.7
  • mysql 5.1.41

    • Regards.

    Top
    Tue, 03/01/2011 - 09:03
    #1
    Kalturian
    Kalturian's picture
    User offline. Last seen 7 hours 17 min ago.
    Core Team
    Joined: 01/05/2009
    Points: 1697

    Seems like a known bug in sphinx... http://sphinxsearch.com/bugs/view.php?id=560
    Checking with them about status, will help if you comment on the bug too.

    Thanks for reporting.

    Top
    Wed, 03/02/2011 - 11:48
    #2
    Kalturian
    Kalturian's picture
    User offline. Last seen 7 hours 17 min ago.
    Core Team
    Joined: 01/05/2009
    Points: 1697

    k0hji - Could you please paste here a couple of examples that made your sphinx crash?

    Thanks!

    Top
    Thu, 11/03/2011 - 12:23
    #3
    rajendra.alapaty_1
    rajendra.alapaty_1's picture
    User offline. Last seen 26 weeks 5 days ago.
    Joined: 05/26/2011
    Points: 2

    I've just added couple of videos to KMC template publisher and added new categories in KMC and switching/selecting between different categories from left hand filters navigation caused exactly same error by crashing sphinx. When I see the /opt/kaltura/log/sphinx/kaltura_sphinx_searchd.log the following line suggests there is a solution to solve this,

    Stack trace seems to be succesfull. Now you have to resolve the numbers above and attach resolved values to the bugreport. See the section about resolving in the documentation

    Does anyone in community knows how to solve/work around this Sphinx crash issue?

    Thanks & Regards,
    Rajendra Alapaty
    Kaltura CE 4.0/Ubuntu 10.04.3 LTS X_64

    Top
    Thu, 03/03/2011 - 04:17
    #4
    k0hji
    k0hji's picture
    User offline. Last seen 46 weeks 4 days ago.
    Joined: 08/21/2010
    Points: 22

    Hi

    To support your request, I have try to reproduce this crash many times.
    However, I could not reproduce this again, now.

    I do not know why it can't.
    When I succeed to do this, I will post it here.

    Thanks.

    Top
    Wed, 07/20/2011 - 18:30
    #5
    info_42
    info_42's picture
    User offline. Last seen 31 weeks 2 days ago.
    Joined: 07/08/2011
    Points: 69

    I must add that nearly nothing works at all in terms of searching and filtering.
    We have tried it on Ubuntu 11.04 and CentOS 5.6, on both 32 and 64 bit flavours,.
    Extremely frustrating.
    Wondering how come no one has noticed such a gross failure so far.
    Please check my latest reply in http://www.kaltura.org/sphinx-search-deamona

    Top