properly handle noindex pages
authorChristian Weiske <cweiske@cweiske.de>
Wed, 9 Nov 2016 20:46:05 +0000 (21:46 +0100)
committerChristian Weiske <cweiske@cweiske.de>
Wed, 9 Nov 2016 20:46:05 +0000 (21:46 +0100)
commit31f0bc4f5a980b40ab8d6ebc6cf682e97f59f647
treeebc4b1599f4dab89c762bb1928b71371d076e588
parentd7651fd96dcfa2829519504e4c8ec1ce511cd57f
properly handle noindex pages
src/phinde/Fetcher.php
src/phinde/Helper.php
src/phinde/Indexer.php