Remove URL check from process.php. Checking is done in Crawler already
-rw-r--r-- 29 .gitignore
-rw-r--r-- 34520 LICENSE
-rw-r--r-- 1738 README.rst
drwxr-xr-x - bin
drwxr-xr-x - data
drwxr-xr-x - docs
drwxr-xr-x - src
drwxr-xr-x - www