cr.simpleescorts.com
robots.txt
Robots Exclusion Standard data for cr.simpleescorts.com
Resource Scan
Scan Details
Site Domain | cr.simpleescorts.com |
Base Domain | simpleescorts.com |
Scan Status | Ok |
Last Scan | 2025-06-01T08:50:34+00:00 |
Next Scan | 2025-07-01T08:50:34+00:00 |
Last Scan
Scanned | 2025-06-01T08:50:34+00:00 |
URL | https://cr.simpleescorts.com/robots.txt |
Domain IPs | 104.26.0.161, 104.26.1.161, 172.67.71.12, 2606:4700:20::681a:1a1, 2606:4700:20::681a:a1, 2606:4700:20::ac43:470c |
Response IP | 172.67.71.12 |
Found | Yes |
Hash | f1ced6140cb6b7897f27fc66b99a117653965bf11470238ca9759cb8cdbdb50c |
SimHash | 2014d802a593 |
Groups
*
Rule | Path |
---|---|
Disallow | /cdn-cgi/ |
Allow | / |
Disallow | /search/ |
Disallow | /*q%3D* |
Disallow | *gender%3D* |
Disallow | *fromAge%3D* |
Disallow | *toAge%3D* |
Disallow | *nationality%3D* |
Other Records
Field | Value |
---|---|
sitemap | https://cr.simpleescorts.com/sitemap_index.xml |