Name
Message
Author
Age
bin/Fixes a synchronization bug between scheduler and indexer when queue shutting down, a=chrisChris Pollett14 years ago
configs/Adds files to list of files fetcher needs to delete from deleted crawls, a=chrisChris Pollett14 years ago
controllers/Fixes a synchronization bug between scheduler and indexer when queue shutting down, a=chrisChris Pollett14 years ago
css/Merge branch 'master' of http://www.seekquarry.com/git/yioopChris Pollett14 years ago
data/Merge branch 'master' of http://www.seekquarry.com/git/yioopChris Pollett14 years ago
examples/Merge branch 'master' of http://www.seekquarry.com/git/yioopChris Pollett14 years ago
lib/Adds files to list of files fetcher needs to delete from deleted crawls, a=chrisChris Pollett14 years ago
locale/Temporary commit so ravi and I can be in sync, a=chrisChris Pollett14 years ago
models/fixed a slowness in getSnippets (still could be improved), a=chrisChris Pollett14 years ago
resources/create master yioop repositoryChris Pollett16 years ago
scripts/Temporary commit so ravi and I can be in sync, a=chrisChris Pollett14 years ago
tests/First pass at running indexer and scheduler in separate processes, a=chrisChris Pollett14 years ago
views/Adds code to handle mirroring of machines, also adds code to reset queue if scheduler gets stuck, a=chrisChris Pollett14 years ago
.gitignoreMerge branch 'master' of http://www.seekquarry.com/git/yioopChris Pollett15 years ago
INSTALLMerge branch 'master' of http://www.seekquarry.com/git/yioopChris Pollett14 years ago
LICENSEMerge branch 'master' of http://www.seekquarry.com/git/yioopChris Pollett14 years ago
READMEMerge branch 'master' of http://www.seekquarry.com/git/yioopChris Pollett14 years ago
bot.phpMerge branch 'master' of http://www.seekquarry.com/git/yioopChris Pollett14 years ago
favicon.icocreate master yioop repositoryChris Pollett16 years ago
index.phpAdds resource controller for handling app_dir resources, a=chrisChris Pollett14 years ago
robots.txtMerge branch 'master' of http://www.seekquarry.com/git/yioopChris Pollett15 years ago
yioopbar.xmlimproved opensearch plugin, a=chrisChris Pollett15 years ago
📖 README

SeekQuarry/Yioop -- Open Source Pure PHP Search Engine, Crawler, and Indexer

Copyright (C) 2009 - 2012 Chris Pollett chris@pollett.org

http://www.seekquarry.com/

LICENSE:

This program is free software: you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation, either version 3 of the License, or (at your option) any later version.

This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.

You should have received a copy of the GNU General Public License along with this program. If not, see http://www.gnu.org/licenses/.

Summary

The Yioop search engine consists of five main scripts:

fetcher.php - used to download batches of urls provided the queue_server. queue_server.php - maintains a queue of urls that are going to be scheduled to be seen. It also keeps track of what has been seen and robots.txt info. Its last responsibility is to create the index_archive that is used by the search front end.

arc_tool.php - an auxiliary script used to view the contents of a web or index archive from the command line

query_tool.php - an auxiliary script used to query an index from the command line

index.php -- a search engine web page. It is also used to handle message passing between the fetchers (multiple machines can act as fetchers) and the queue_server.

Download

You can download the SeekQuarry search engine from http://www.seekquarry.com/

Requirements

The Yioop search engine requires Apache and PHP. It was developed under Apache 2.2, PHP 5.3, and the sqlite3 built into PHP.

Credits

The source code is mainly due to Chris Pollett. Other contributors include: Priya Gangaraju, Nakul Natu, Vijaya Pamidi, Vijeth Patil, Tarun Pepira. Several people helped with localization: My wife, Mary Pollett, Jonathan Ben-David, Sujata Dongre, Youn Kim, Chao-Hsin Shih and Sugi Widjaja. Thanks to Ravi Dhillon for finding and helping with the fixes for Issue 15 and Commit 632e46.

Installation

Please see the INSTALL file

Documentation and Support

Please check out seekquarry.com

X