git.cweiske.de
/
phinde.git
/ history
commit
grep
author
committer
pickaxe
?
search:
re
summary
|
shortlog
|
log
|
commit
|
commitdiff
|
tree
first ⋅ prev ⋅ next
Add URL rewrites/replacements
[phinde.git]
/
src
/
phinde
/
Crawler.php
2020-02-29
Christian Weiske
Add URL rewrites/replacements
blob
|
commitdiff
|
raw
2016-11-10
Christian Weiske
add log class
blob
|
commitdiff
|
raw
|
diff to current
2016-11-07
Christian Weiske
Big patch merging crawling+indexing into one command...
blob
|
commitdiff
|
raw
|
diff to current
2016-08-30
Christian Weiske
tell why crawler stops
blob
|
commitdiff
|
raw
|
diff to current
2016-08-30
Christian Weiske
Add crawlBlacklist configuration option
blob
|
commitdiff
|
raw
|
diff to current
2016-08-30
Christian Weiske
Fix notice
blob
|
commitdiff
|
raw
|
diff to current
2016-08-30
Christian Weiske
Option to disable linked URL indexing
blob
|
commitdiff
|
raw
|
diff to current
2016-08-29
Christian Weiske
Send If-Modified-Since header on crawling and indexing
blob
|
commitdiff
|
raw
|
diff to current
2016-02-11
Christian Weiske
debug option for crawler
blob
|
commitdiff
|
raw
|
diff to current
2016-02-10
Christian Weiske
remove debug statement
blob
|
commitdiff
|
raw
|
diff to current
2016-02-10
Christian Weiske
crawler supports "nofollow" now
blob
|
commitdiff
|
raw
|
diff to current
2016-02-10
Christian Weiske
send accept header during crawl
blob
|
commitdiff
|
raw
|
diff to current
2016-02-10
Christian Weiske
rework crawler; add atom link extraction
blob
|
commitdiff
|
raw
|
diff to current