goodcarbadcar.net
robots.txt

Robots Exclusion Standard data for goodcarbadcar.net

Resource Scan

Scan Details

Site Domain goodcarbadcar.net
Base Domain goodcarbadcar.net
Scan Status Ok
Last Scan2024-11-09T14:19:51+00:00
Next Scan 2024-11-16T14:19:51+00:00

Last Scan

Scanned2024-11-09T14:19:51+00:00
URL https://goodcarbadcar.net/robots.txt
Redirect https://www.goodcarbadcar.net/robots.txt
Redirect Domain www.goodcarbadcar.net
Redirect Base goodcarbadcar.net
Domain IPs 172.66.40.85, 172.66.43.171, 2606:4700:3108::ac42:2855, 2606:4700:3108::ac42:2bab
Redirect IPs 172.66.40.85, 172.66.43.171, 2606:4700:3108::ac42:2855, 2606:4700:3108::ac42:2bab
Response IP 172.66.43.171
Found Yes
Hash 33cc1e3b54fdd5dde31cfdf94725985124aade1d0ece9bf5ce47133dfdab7ffb
SimHash ca08dce28f93

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /wp-admin/
Disallow /search/
Disallow /?s=
Disallow /?Up
Disallow /?action=SEARCH&s=
Disallow /?type=
Disallow /?T=
Disallow /?ID=
Disallow /?token=
Disallow /?ihmSf=
Disallow /?time=
Disallow /?IoSbs=
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap http://www.goodcarbadcar.net/sitemap.xml