geekparadize.fr
robots.txt
Robots Exclusion Standard data for geekparadize.fr
Resource Scan
Scan Details
Site Domain | geekparadize.fr |
Base Domain | geekparadize.fr |
Scan Status | Ok |
Last Scan | 2024-09-22T17:15:50+00:00 |
Next Scan | 2024-09-29T17:15:50+00:00 |
Last Scan
Scanned | 2024-09-22T17:15:50+00:00 |
URL | https://geekparadize.fr/robots.txt |
Domain IPs | 51.83.25.5 |
Response IP | 51.83.25.5 |
Found | Yes |
Hash | 152bb54c7ef2cdef68ffeee25468c62932a90da7bf9bd8d65d094082ed39348f |
SimHash | 484250d0c9f2 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-* |
Disallow | /content/cache |
Disallow | /membres/* |
Disallow | /trackback |
Disallow | /*.php$ |
Disallow | /*.inc$ |
Disallow | /*.gz$ |
Disallow | /wp-login.php |
Allow | /content/uploads/ |
Other Records
Field | Value | Comment |
---|---|---|
crawl-delay | 30 | 10 seconds between page requests |
*
Rule | Path |
---|---|
Disallow | /CHANGELOG.txt |
Disallow | /cron.php |
Disallow | /INSTALL.mysql.txt |
Disallow | /INSTALL.pgsql.txt |
Disallow | /INSTALL.sqlite.txt |
Disallow | /install.php |
Disallow | /INSTALL.txt |
Disallow | /LICENSE.txt |
Disallow | /MAINTAINERS.txt |
Disallow | /update.php |
Disallow | /UPGRADE.txt |
Disallow | /xmlrpc.php |
Other Records
Field | Value |
---|---|
sitemap | https://www.geekparadize.fr/sitemap_index.xml |
Warnings
- 2 invalid lines.
- `visit-time` is not a known field.
Comments