gaspedaal.nl
robots.txt
Robots Exclusion Standard data for gaspedaal.nl
Resource Scan
Scan Details
Site Domain | gaspedaal.nl |
Base Domain | gaspedaal.nl |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-11-15T00:20:42+00:00 |
Next Scan | 2024-11-29T00:20:42+00:00 |
Last Successful Scan
Scanned | 2023-07-10T14:55:55+00:00 |
URL | https://gaspedaal.nl/robots.txt |
Redirect | https://www.gaspedaal.nl/robots.txt |
Redirect Domain | www.gaspedaal.nl |
Redirect Base | gaspedaal.nl |
Domain IPs | 2600:1413:b000:6::17d5:2bd1, 2600:1413:b000:6::17d5:2bdf, 96.17.96.11, 96.17.96.23 |
Redirect IPs | 2600:1413:b000:6::17d5:2bd1, 2600:1413:b000:6::17d5:2bdf, 96.17.96.11, 96.17.96.23 |
Response IP | 23.223.18.128 |
Found | Yes |
Hash | 1e6643cf2e6d98eaf88b1f2966d50250143475487a7cb6c8ba4e0ccf3d321bd2 |
SimHash | 4855df176c53 |
Groups
*
Rule | Path |
---|---|
Disallow | /searchbox |
Disallow | /redirect |
Disallow | /*? |
Disallow | /importautos |
Disallow | /profile |
Disallow | /mijn-favorieten |
Disallow | /dealer/* |
Disallow | /cdn-cgi/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.gaspedaal.nl/sitemap-v3/sitemap-v3_gaspedaal.xml |