2020-03-08 | Christian Weiske | Fix accept header in crawler | blob | commitdiff | raw |
2020-02-29 | Christian Weiske | Add URL rewrites/replacements | blob | commitdiff | raw | diff to current |
2016-11-10 | Christian Weiske | add log class | blob | commitdiff | raw | diff to current |
2016-11-09 | Christian Weiske | properly handle noindex pages | blob | commitdiff | raw | diff to current |
2016-11-07 | Christian Weiske | Big patch merging crawling+indexing into one command... | blob | commitdiff | raw | diff to current |