phinde.git/src/phinde/Crawler.php, branch v0.2.0
Website search in PHP and elasticsearch
https://git.cweiske.de/phinde.git/atom?h=v0.2.0
2016-11-10T19:52:35Z
add log class
2016-11-10T19:52:35Z
Christian Weiske
cweiske@cweiske.de
2016-11-10T19:52:35Z
urn:sha1:696fcd7ce4d495e356667019493bf312e2a6e47b
Big patch merging crawling+indexing into one command, new json document structure
2016-11-07T20:41:36Z
Christian Weiske
cweiske@cweiske.de
2016-11-07T20:41:36Z
urn:sha1:d7651fd96dcfa2829519504e4c8ec1ce511cd57f
tell why crawler stops
2016-08-30T19:37:50Z
Christian Weiske
cweiske@cweiske.de
2016-08-30T19:37:50Z
urn:sha1:9d97bab663adb122d6edf7c15639a3457e94c71f
Add crawlBlacklist configuration option
2016-08-30T11:35:05Z
Christian Weiske
cweiske@cweiske.de
2016-08-30T11:35:05Z
urn:sha1:083fa4116b22f4898123006880fb52061763513d
Resolves: #7
Fix notice
2016-08-30T11:05:14Z
Christian Weiske
cweiske@cweiske.de
2016-08-30T11:05:14Z
urn:sha1:ba1f6fc77827dba86b1ac0b62aa288dd0f977cb8
Option to disable linked URL indexing
2016-08-30T06:13:33Z
Christian Weiske
cweiske@cweiske.de
2016-08-30T06:13:33Z
urn:sha1:45638a5de3c8c05c1792f8a3ab93acb11a2c1a86
Resolves: #2
Send If-Modified-Since header on crawling and indexing
2016-08-29T18:30:45Z
Christian Weiske
cweiske@cweiske.de
2016-08-29T18:30:45Z
urn:sha1:90d2e0f8c2a80f4d5db5ae20248337d3a0594411
debug option for crawler
2016-02-11T07:43:01Z
Christian Weiske
cweiske@cweiske.de
2016-02-11T07:43:01Z
urn:sha1:a2e7177d78911d219bc5be86c1cc86989b36983f
remove debug statement
2016-02-10T20:15:35Z
Christian Weiske
cweiske@cweiske.de
2016-02-10T20:15:35Z
urn:sha1:5a5d2545fd262fa06e4ddc49cc675779b21f86c4
crawler supports "nofollow" now
2016-02-10T16:26:15Z
Christian Weiske
cweiske@cweiske.de
2016-02-10T16:26:15Z
urn:sha1:298d81c60b6103cd29e9c219d243a5a8a8289f6f