Name
Message
Author
Age
bin/Add more crawllog messages fetcher, a=chrisChris Pollett13 years ago
configs/Fixes a bug in fetcher with how unique link_ids are made that caused some links with vertical bars to not get indexed correctly, switches negation iterator to use site:any rather than site:all, a=chrisChris Pollett13 years ago
controllers/Attempt to fix issues with yioop login people out too frequently, a=chrisChris Pollett13 years ago
css/First pass at implementing archive crawling of crawl mixes, a=chrisChris Pollett13 years ago
data/Added Vietnamese Translation, a=chrisChris Pollett13 years ago
examples/Move e() to utlity.php, define MOBILE in config rather than index.php, a=chrisChris Pollett14 years ago
lib/another try at mix iterator stop condition, a=chrisChris Pollett13 years ago
locale/Give a warning if try to make work dir a subfolder of yioop base dir, a=chrisChris Pollett13 years ago
models/Fix a bug in handling info:https queries, a=chrisChris Pollett13 years ago
resources/Add blank.png, a=chrisChris Pollett14 years ago
scripts/First pass at doc_iterator, fixes bug in cache page display when current index is a recrawl, moves windows 1256 code to locale_functions.php, a=chrisChris Pollett13 years ago
tests/Give a warning if try to make work dir a subfolder of yioop base dir, a=chrisChris Pollett13 years ago
views/Force the word wrap at 60 chars in machine log, a=chrisChris Pollett13 years ago
.gitignoreMerge branch 'master' of /Applications/XAMPP/xamppfiles/htdocs/git/shawn_stuffChris Pollett14 years ago
INSTALLUpdating INSTALL and README file for Version 0.84Chris Pollett14 years ago
LICENSEMerge branch 'master' of http://www.seekquarry.com/git/yioopChris Pollett14 years ago
READMEGetting rid of my local machine from default.db, fix minor notices, a=chrisChris Pollett14 years ago
blog.phpAdd Video Sources, a=chrisChris Pollett14 years ago
bot.phpMove e() to utlity.php, define MOBILE in config rather than index.php, a=chrisChris Pollett14 years ago
error.phpAdd Video Sources, a=chrisChris Pollett14 years ago
favicon.icocreate master yioop repositoryChris Pollett16 years ago
index.phpTake 7, a=chrisChris Pollett13 years ago
privacy.phpRearrange css and comments, a=chrisChris Pollett14 years ago
robots.txtForbid robots on news feed pages, a=chrisChris Pollett13 years ago
yioopbar.xmlimproved opensearch plugin, a=chrisChris Pollett15 years ago
📖 README

SeekQuarry/Yioop -- Open Source Pure PHP Search Engine, Crawler, and Indexer

Copyright (C) 2009 - 2012 Chris Pollett chris@pollett.org

http://www.seekquarry.com/

LICENSE:

This program is free software: you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation, either version 3 of the License, or (at your option) any later version.

This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.

You should have received a copy of the GNU General Public License along with this program. If not, see http://www.gnu.org/licenses/.

Summary

The Yioop search engine consists of three main scripts:

bin/fetcher.php - used to download batches of urls provided the queue_server. bin/queue_server.php - maintains a queue of urls that are going to be scheduled to be seen. It also keeps track of what has been seen and robots.txt info. Its last responsibility is to create the index_archive that is used by the search front end.

index.php -- a search engine web page. It is also used to handle message passing between the fetchers (multiple machines can act as fetchers) and the queue_server.

Download

You can download the SeekQuarry search engine from http://www.seekquarry.com/

Requirements

The Yioop search engine requires Apache and PHP. It was developed under Apache 2.2, PHP 5.3, and the sqlite3 built into PHP.

Credits

The source code is mainly due to Chris Pollett. Other contributors include: Ravi Dhillon, Priya Gangaraju, Nakul Natu, Vijaya Pamidi, Vijeth Patil, Tarun Pepira, Shawn Tice, Sandhya Vissapragada. Several people helped with localization: My wife, Mary Pollett, Jonathan Ben-David, Sujata Dongre, Animesh Dutta, Youn Kim, Akshat Kukreti, Chao-Hsin Shih and Sugi Widjaja.

Installation

Please see the INSTALL file

Documentation and Support

Please check out seekquarry.com

X