1) Open Terminal and first become root user:
sudo su
2) Now we need to download the package sphinxsearch 2.0.5 from the Sphinx Search site.
wget http://sphinxsearch.com/files/sphinxsearch_2.0.5-release-0ubuntu11~precise2_amd64.deb
3) Sphinx Search 2.0.5 requires a dependency package called libpq5 that you might not have yet on your server so run the following to install the deb package:
# install dependency
apt-get install libpq5
# install deb package
dpkg -i sphinxsearch_2.0.5-release-0ubuntu11~precise2_amd64.deb
NOTE: Now we have Sphinx Search 2.0.5 installed on our Ubuntu Server installation and we are ready to index some of our mysql data. Here are the programs we need to get the job done: (don’t run this commands)
/usr/bin/searchd
/usr/bin/indexer
/usr/bin/search
For example purpose, we have a folder structure of
/home/indianic/web/sphinx/etc
/home/indianic/web/logs
4) The above line shows that we have an etc in a sphinx directory which is were we store our config file
cat /home/indianic/web/sphinx/etc/sphinx.conf
Below is our configuration file that Sphinx Search will use to index the data we want indexed. Our purpose is to allow full text search so the configuration below covers what such a setup might look like.
source indianiccom
{
type = mysql
sql_host = localhost
sql_user = root
sql_pass = root
sql_db = mysqldatabase_sphinx
sql_port = 3306
sql_query_range = SELECT MIN(id), MAX(id) FROM posts
sql_range_step = 128
sql_query = SELECT id, created, modified, title, content, tags, short_description, author_id FROM posts WHERE id>=$start AND id<=$end
}
index indianiccom {
source = indianiccom
path = /home/indianic/web/sphinx/sphinx
morphology = stem_en
min_word_len = 3
min_prefix_len = 0
}
searchd {
compat_sphinxql_magics = 0
port = 3313
log = /home/indianic/web/logs/searchd.log
query_log = /home/indianic/web/logs/query.log
pid_file = /home/indianic/web/logs/searchd.pid
max_matches = 10000
}
5) Now that our configuration file is ready and points out exactly what we want sphinxsearch to index, we can move on to the actual indexing. Still as root user do the following to index your data:
/usr/bin/indexer --config /home/indianic/web/sphinx/etc/sphinx.conf --all
6) Now your mysql query in the config file is indexed. We can now move forward and set up sphinxsearch to start at startup of our server in case we need to reboot or something happens that restarts your server. As root do the following:
nano /etc/rc.local
7) Now we need to add the following command right before the last line which displays exit 0 so that our file looks like:
#!/bin/sh -e
#
# rc.local
#
# This script is executed at the end of each multiuser runlevel.
# Make sure that the script will "exit 0" on success or any other
# value on error.
#
# In order to enable or disable this script just change the execution
# bits.
#
# By default this script does nothing.
/usr/bin/searchd --config /home/indianic/web/sphinx/etc/sphinx.config
exit 0
8) Make sure to replace indianic with your directory. What the above script does is it starts the search daemon using the configuration file we used earlier.
Now let us test our installation by starting the sphinxsearch daemon. Run the following to start searchd:
/usr/bin/searchd --config /home/indianic/web/sphinx/etc/sphinx.conf
9) Once the we have searchd running we can test if the index work by doing the following:
eg: /usr/bin/search -c /home/indianic/web/sphinx/etc/sphinx.conf <search key>
/usr/bin/search -c /home/indianic/web/sphinx/etc/sphinx.conf mysql
10) The result should look similar to what I have below. Obviously if your data has different content yours would look different but the below display is just so you can see how it is supposed to look like.
Sphinx 2.0.5-id64-release (r3308)
Copyright (c) 2001-2012, Andrew Aksyonoff
Copyright (c) 2008-2012, Sphinx Technologies Inc (http://sphinxsearch.com)
using config file '/home/indianic/web/sphinx/etc/sphinx.conf'...
index 'indianiccom': query 'mysql ': returned 15 matches of 15 total in 0.024 sec
displaying matches:
1. document=120, weight=4660
2. document=125, weight=4655
3. document=6, weight=4645
4. document=115, weight=4645
5. document=100, weight=4634
6. document=93, weight=3660
7. document=99, weight=3645
8. document=60, weight=2609
9. document=118, weight=1645
10. document=105, weight=1634
11. document=10, weight=1624
12. document=7, weight=1609
13. document=117, weight=1609
14. document=119, weight=1609
15. document=108, weight=1579
words:
1. 'mysql': 15 documents, 82 hits
11) When you want to index the mysql’s updated data, then you have to run the following command:
/usr/bin/indexer --rotate --config /home/indianic/web/sphinx/etc/sphinx.conf --all
12) In Java:
b) Create project in eclipse and add this sphinxapi.jar in classpath.
c) Create a new class SphinxMain.java as follow:
package com.demo;
sudo su
2) Now we need to download the package sphinxsearch 2.0.5 from the Sphinx Search site.
wget http://sphinxsearch.com/files/sphinxsearch_2.0.5-release-0ubuntu11~precise2_amd64.deb
3) Sphinx Search 2.0.5 requires a dependency package called libpq5 that you might not have yet on your server so run the following to install the deb package:
# install dependency
apt-get install libpq5
# install deb package
dpkg -i sphinxsearch_2.0.5-release-0ubuntu11~precise2_amd64.deb
NOTE: Now we have Sphinx Search 2.0.5 installed on our Ubuntu Server installation and we are ready to index some of our mysql data. Here are the programs we need to get the job done: (don’t run this commands)
/usr/bin/searchd
/usr/bin/indexer
/usr/bin/search
For example purpose, we have a folder structure of
/home/indianic/web/sphinx/etc
/home/indianic/web/logs
4) The above line shows that we have an etc in a sphinx directory which is were we store our config file
cat /home/indianic/web/sphinx/etc/sphinx.conf
Below is our configuration file that Sphinx Search will use to index the data we want indexed. Our purpose is to allow full text search so the configuration below covers what such a setup might look like.
source indianiccom
{
type = mysql
sql_host = localhost
sql_user = root
sql_pass = root
sql_db = mysqldatabase_sphinx
sql_port = 3306
sql_query_range = SELECT MIN(id), MAX(id) FROM posts
sql_range_step = 128
sql_query = SELECT id, created, modified, title, content, tags, short_description, author_id FROM posts WHERE id>=$start AND id<=$end
}
index indianiccom {
source = indianiccom
path = /home/indianic/web/sphinx/sphinx
morphology = stem_en
min_word_len = 3
min_prefix_len = 0
}
searchd {
compat_sphinxql_magics = 0
port = 3313
log = /home/indianic/web/logs/searchd.log
query_log = /home/indianic/web/logs/query.log
pid_file = /home/indianic/web/logs/searchd.pid
max_matches = 10000
}
5) Now that our configuration file is ready and points out exactly what we want sphinxsearch to index, we can move on to the actual indexing. Still as root user do the following to index your data:
/usr/bin/indexer --config /home/indianic/web/sphinx/etc/sphinx.conf --all
6) Now your mysql query in the config file is indexed. We can now move forward and set up sphinxsearch to start at startup of our server in case we need to reboot or something happens that restarts your server. As root do the following:
nano /etc/rc.local
7) Now we need to add the following command right before the last line which displays exit 0 so that our file looks like:
#!/bin/sh -e
#
# rc.local
#
# This script is executed at the end of each multiuser runlevel.
# Make sure that the script will "exit 0" on success or any other
# value on error.
#
# In order to enable or disable this script just change the execution
# bits.
#
# By default this script does nothing.
/usr/bin/searchd --config /home/indianic/web/sphinx/etc/sphinx.config
exit 0
8) Make sure to replace indianic with your directory. What the above script does is it starts the search daemon using the configuration file we used earlier.
Now let us test our installation by starting the sphinxsearch daemon. Run the following to start searchd:
/usr/bin/searchd --config /home/indianic/web/sphinx/etc/sphinx.conf
9) Once the we have searchd running we can test if the index work by doing the following:
eg: /usr/bin/search -c /home/indianic/web/sphinx/etc/sphinx.conf <search key>
/usr/bin/search -c /home/indianic/web/sphinx/etc/sphinx.conf mysql
10) The result should look similar to what I have below. Obviously if your data has different content yours would look different but the below display is just so you can see how it is supposed to look like.
Sphinx 2.0.5-id64-release (r3308)
Copyright (c) 2001-2012, Andrew Aksyonoff
Copyright (c) 2008-2012, Sphinx Technologies Inc (http://sphinxsearch.com)
using config file '/home/indianic/web/sphinx/etc/sphinx.conf'...
index 'indianiccom': query 'mysql ': returned 15 matches of 15 total in 0.024 sec
displaying matches:
1. document=120, weight=4660
2. document=125, weight=4655
3. document=6, weight=4645
4. document=115, weight=4645
5. document=100, weight=4634
6. document=93, weight=3660
7. document=99, weight=3645
8. document=60, weight=2609
9. document=118, weight=1645
10. document=105, weight=1634
11. document=10, weight=1624
12. document=7, weight=1609
13. document=117, weight=1609
14. document=119, weight=1609
15. document=108, weight=1579
words:
1. 'mysql': 15 documents, 82 hits
11) When you want to index the mysql’s updated data, then you have to run the following command:
/usr/bin/indexer --rotate --config /home/indianic/web/sphinx/etc/sphinx.conf --all
12) In Java:
a) Go to the path where Sphinx has been installed:
cd /usr/share/sphinxsearch/api/java
Creating sphinxapi.jar file:
make
The above “make” command will create sphinxapi.jar file.
b) Create project in eclipse and add this sphinxapi.jar in classpath.
c) Create a new class SphinxMain.java as follow:
package com.demo;
import java.util.Date;
import org.sphx.api.SphinxClient;
import org.sphx.api.SphinxException;
import org.sphx.api.SphinxMatch;
import org.sphx.api.SphinxResult;
import org.sphx.api.SphinxWordInfo;
public class SphinxMain {
public SphinxClient client = new SphinxClient();
public String index = "*" ;
public SphinxMain() {
try {
client.SetServer("localhost", 3313);
} catch (SphinxException e) {
e.printStackTrace();
}
}
public static void main(String[] args) {
SphinxMain object = new SphinxMain();
object.searchValue("sunil");
object.searchValue("tag");
object.searchValue("asdasdasdasd");
}
public void searchValue(String query)
{
System.out.println("***********************************************");
System.out.println("Search Key: " + query);
System.out.println("***********************************************");
try {
SphinxResult res = client.Query(query, index);
if ( res==null )
{
System.err.println ( "Error: " + client.GetLastError() );
System.exit ( 1 );
}else
{
printResult(query, res);
}
} catch (SphinxException e) {
e.printStackTrace();
}
}
public void printResult(String query,SphinxResult res)
{
/* print me out */
System.out.println ( "Query '" + query + "' retrieved " +
res.total + " of " + res.totalFound + " matches in " + res.time + "
sec." );
System.out.println ( "Query stats:" );
for ( int i=0; i<res.words.length; i++ )
{
SphinxWordInfo wordInfo = res.words[i];
System.out.println ( "\t'" + wordInfo.word + "' found " +
wordInfo.hits + " times in " + wordInfo.docs + " documents" );
}
System.out.println ( "\nMatches:" );
for ( int i=0; i<res.matches.length; i++ )
{
SphinxMatch info = res.matches[i];
System.out.print ( (i+1) + ". id=" + info.docId + ", weight=" + info.weight );
if ( res.attrNames==null || res.attrTypes==null )
continue;
for ( int a=0; a<res.attrNames.length; a++ )
{
System.out.print ( ", " + res.attrNames[a] + "=" );
if ( res.attrTypes[a]==SphinxClient.SPH_ATTR_MULTI || res.attrTypes[a]==SphinxClient.SPH_ATTR_MULTI64 )
{
System.out.print ( "(" );
long[] attrM = (long[]) info.attrValues.get(a);
if ( attrM!=null )
for ( int j=0; j<attrM.length; j++ )
{
if ( j!=0 )
System.out.print ( "," );
System.out.print ( attrM[j] );
}
System.out.print ( ")" );
} else
{
switch ( res.attrTypes[a] )
{
case SphinxClient.SPH_ATTR_INTEGER:
case SphinxClient.SPH_ATTR_ORDINAL:
case SphinxClient.SPH_ATTR_FLOAT:
case SphinxClient.SPH_ATTR_BIGINT:
case SphinxClient.SPH_ATTR_STRING:
/* ints, longs, floats, strings.. print as is */
System.out.print ( info.attrValues.get(a) );
break;
case SphinxClient.SPH_ATTR_TIMESTAMP:
Long iStamp = (Long) info.attrValues.get(a);
Date date = new Date ( iStamp.longValue()*1000 );
System.out.print ( date.toString() );
break;
default:
System.out.print ( "(unknown-attr-type=" + res.attrTypes[a] + ")" );
}
}
}
System.out.println();
}
}
}
