1 **********************************
2 phinde - generic web search engine
3 **********************************
4 Self-hosted search engine you can use for your static blog or about
5 any other website you want search functionality for.
7 My live instance is at http://search.cweiske.de/ and indexes my
8 website, blog and all linked URLs.
14 - Crawler and indexer with the ability to run many in parallel
15 - Shows and highlights text that contains search words
16 - Boolean search queries:
18 - ``foo bar`` searches for ``foo AND bar``
20 - ``title:foo`` searches for ``foo`` only in the page title
21 - Facets for tag, domain, language and type
24 - ``before:2016-08-30`` - modification date before that day
25 - ``after:2016-08-30`` - modified after that day
26 - ``date::2016-08-30`` - exact modification day match
29 - Query: ``foo bar site:example.org/dir/``
30 - or use the ``site`` GET parameter:
31 ``/?q=foo&site=example.org/dir``
32 - OpenSearch support with HTML and Atom result lists
33 - Instant indexing with WebSub (formerly PubSubHubbub)
42 - PHP Gearman extension
51 #. Install and run Elasticsearch and Gearman
52 #. Install ``php-gearman``
53 #. Get a local copy of the code::
55 $ git clone https://git.cweiske.de/phinde.git phinde
57 #. Install dependencies via composer::
61 #. Point your webserver's document root to phinde's ``www`` directory
62 #. Copy ``data/config.php.dist`` to ``data/config.php`` and adjust it.
63 Make sure your add your domain to the crawl whitelist.
64 #. Run ``bin/setup.php`` which sets up the Elasticsearch schema
65 #. Put your homepage into the queue::
67 $ ./bin/process.php http://example.org/
69 #. Start at least one worker to process the crawl+index queue::
71 $ ./bin/phinde-worker.php
73 #. Check phinde's status page in your browser.
74 The number of open tasks should be > 0, the number of workers also.
77 Re-index when your site changes
78 ===============================
79 When your site changed, the search engine needs to re-crawl and re-index
82 Simply tell phinde that something changed by running::
84 $ ./bin/process.php http://example.org/foo.htm
86 phinde supports HTML pages and Atom feeds, so if your blog has a feed
87 it's enough to let phinde reindex that one.
88 It will find all linked pages automatically.
93 Adding a simple search form to your website is easy.
96 - ``<form>`` tag with an action that points to the phinde instance
97 - Search text field with name of ``q``.
101 <form method="get" action="http://phinde.example.org">
102 <input type="text" name="q" placeholder="Search text"/>
103 <button type="submit">Search</button>
109 When using systemd, you can let it run multiple worker instances when
112 #. Copy files ``data/systemd/phinde*.service`` into ``/etc/systemd/system/``
113 #. Adjust user and group names, and the work directories
114 #. Enable three worker processes::
116 $ systemctl daemon-reload
117 $ systemctl enable phinde@1
118 $ systemctl enable phinde@2
119 $ systemctl enable phinde@3
120 $ systemctl enable phinde
121 $ systemctl start phinde
122 #. Now three workers are running. Restarting the ``phinde`` service also
123 restarts the workers.
129 Run ``bin/renew-subscriptions.php`` once a day with cron.
130 It will renew the WebSub subscriptions.
137 Delete index data from one domain::
139 $ curl -iv -XDELETE -H 'Content-Type: application/json' -d '{"query":{"term":{"domain":"example.org"}}}' http://127.0.0.1:9200/phinde/_query
141 That's delete-by-query 2.0, see
142 https://www.elastic.co/guide/en/elasticsearch/plugins/2.0/delete-by-query-usage.html
151 phinde's source code is available from http://git.cweiske.de/phinde.git
152 or the `mirror on github`__.
154 __ https://github.com/cweiske/phinde
159 phinde is licensed under the `AGPL v3 or later`__.
161 __ http://www.gnu.org/licenses/agpl.html
166 phinde was written by `Christian Weiske`__.
168 __ http://cweiske.de/