Name
Message
Author
Age
bin/makes process of detecting a change in allowed disallowed faster, a=chrisChris Pollett11 years ago
configs/Fix issue caused by renamed sequences in Postgres, a=chrisChris Pollett11 years ago
controllers/Add for field checking to search sources, a=chrisChris Pollett11 years ago
css/Add font-size css, a=chrisChris Pollett11 years ago
data/Makeing sure database has latest changes, a=chrisChris Pollett11 years ago
examples/Adding documentation so that it can be parsed with phpDoc 2.0 without error, a=chrisChris Pollett12 years ago
lib/More wiki list tweaks 4, a=chrisChris Pollett11 years ago
locale/Add for field checking to search sources, a=chrisChris Pollett11 years ago
models/Do better checking of names of crawl mixes, a=chrisChris Pollett11 years ago
resources/- Added New wiki button for "Add slide" - Added new icon for wikibtn-slide - Display slide btn only for data-page-type is set && is equal to presentationepinapala11 years ago
scripts/If wiki used as landing then signout goes to wiki, a=chrisChris Pollett11 years ago
tests/adds support for crawling gopher protocol, a=chrisChris Pollett11 years ago
views/Fix signout link in a few more places, a=chrisChris Pollett11 years ago
.gitignoreMerge branch 'master' of /Applications/XAMPP/xamppfiles/htdocs/git/shawn_stuffChris Pollett14 years ago
INSTALLNot a checkoutable commit. This is a checkpoint in the process of adding missing documentation to Yioop and to including some of Sreenidhi's captcha code, a-chrisChris Pollett12 years ago
LICENSEMinor tweaks to the documentation of various files, a=chrisChris Pollett13 years ago
READMENot a checkoutable commit. This is a checkpoint in the process of adding missing documentation to Yioop and to including some of Sreenidhi's captcha code, a-chrisChris Pollett12 years ago
blog.phpAdding documentation so that it can be parsed with phpDoc 2.0 without error, a=chrisChris Pollett12 years ago
bot.phpAdding documentation so that it can be parsed with phpDoc 2.0 without error, a=chrisChris Pollett12 years ago
error.phpFirst pass at allowing resource uploads with progress meter, a=chrisChris Pollett12 years ago
favicon.icocreate master yioop repositoryChris Pollett16 years ago
index.phpFirst pass at adding color and landing page customizations to configure, a=chrisChris Pollett11 years ago
privacy.phpAdding documentation so that it can be parsed with phpDoc 2.0 without error, a=chrisChris Pollett12 years ago
robots.txtForbid robots on news feed pages, a=chrisChris Pollett13 years ago
terms.phpAdding documentation so that it can be parsed with phpDoc 2.0 without error, a=chrisChris Pollett12 years ago
yioopbar.xmlQuick pass at hash-cash prettifying/simplifying, a=chrisChris Pollett12 years ago
📖 README

SeekQuarry/Yioop -- Open Source Pure PHP Search Engine, Crawler, and Indexer

Copyright (C) 2009 - 2013 Chris Pollett chris@pollett.org

http://www.seekquarry.com/

LICENSE:

This program is free software: you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation, either version 3 of the License, or (at your option) any later version.

This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.

You should have received a copy of the GNU General Public License along with this program. If not, see http://www.gnu.org/licenses/.

Summary

The Yioop search engine consists of three main scripts:

bin/fetcher.php - used to download batches of urls provided the queue_server. bin/queue_server.php - maintains a queue of urls that are going to be scheduled to be seen. It also keeps track of what has been seen and robots.txt info. Its last responsibility is to create the index_archive that is used by the search front end.

index.php -- a search engine web page. It is also used to handle message passing between the fetchers (multiple machines can act as fetchers) and the queue_server.

Download

You can download the SeekQuarry search engine from http://www.seekquarry.com/

Requirements

The Yioop search engine requires Apache and PHP. It was developed under Apache 2.2, PHP 5.3, and the sqlite3 built into PHP.

Credits

The source code is mainly due to Chris Pollett. Other contributors include: Mangesh Dahale, Ravi Dhillon, Priya Gangaraju, Akshat Kukreti, Sreenidhi Pundi Muralidharan, Nakul Natu, Shailesh Padave, Vijaya Pamidi, Snigdha Parvatneni, Akash Patel, Vijeth Patil, Mallika Perepa, Tarun Pepira, Eswara Rajesh Pinapala, Tamayee Potluri, Shawn Tice, Sandhya Vissapragada. Several people helped with localization: My wife, Mary Pollett, Jonathan Ben-David, Ismail.B, Andrea Brunetti, Thanh Bui, Sujata Dongre, Animesh Dutta, Aida Khosroshahi, Youn Kim, Akshat Kukreti, Chao-Hsin Shih, Ahmed Kamel Taha, and Sugi Widjaja.

Installation

Please see the INSTALL file

Documentation and Support

Please check out seekquarry.com

X