radaris.com
robots.txt
Robots Exclusion Standard data for radaris.com
Resource Scan
Scan Details
Site Domain | radaris.com |
Base Domain | radaris.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-20T12:57:20+00:00 |
Next Scan | 2024-10-04T12:57:20+00:00 |
Last Successful Scan
Scanned | 2024-09-04T22:39:03+00:00 |
URL | https://radaris.com/robots.txt |
Domain IPs | 67.217.248.10 |
Response IP | 67.217.248.10 |
Found | Yes |
Hash | 5198cae49aa714240acd95324b749e1babb5aa72e600b381097a537b5d39a21a |
SimHash | 4004df51c713 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /n/ |
Disallow | /t/ |
Disallow | /US/2/ |
Disallow | /payment/ |
Disallow | /*BUS_CENSUS_NAME* |
Disallow | /*BUS_FEMALE_NAME* |
Other Records
Field | Value |
---|---|
sitemap | https://radaris.com/sitemap_index.xml |