phinde.git/src/phinde/Crawler.php, branch v0.1.0 Website search in PHP and elasticsearch https://git.cweiske.de/phinde.git/atom?h=v0.1.0 2016-02-11T07:43:01Z debug option for crawler 2016-02-11T07:43:01Z Christian Weiske cweiske@cweiske.de 2016-02-11T07:43:01Z urn:sha1:a2e7177d78911d219bc5be86c1cc86989b36983f remove debug statement 2016-02-10T20:15:35Z Christian Weiske cweiske@cweiske.de 2016-02-10T20:15:35Z urn:sha1:5a5d2545fd262fa06e4ddc49cc675779b21f86c4 crawler supports "nofollow" now 2016-02-10T16:26:15Z Christian Weiske cweiske@cweiske.de 2016-02-10T16:26:15Z urn:sha1:298d81c60b6103cd29e9c219d243a5a8a8289f6f send accept header during crawl 2016-02-10T16:09:56Z Christian Weiske cweiske@cweiske.de 2016-02-10T16:09:56Z urn:sha1:b018834e5c337be762cf9809e69e341061f4638a rework crawler; add atom link extraction 2016-02-10T13:56:20Z Christian Weiske cweiske@cweiske.de 2016-02-10T13:56:20Z urn:sha1:cd02bac646f42a0cb402ff2dc8240aa01f1f0fb8