do.simpleescorts.com
robots.txt
Robots Exclusion Standard data for do.simpleescorts.com
Resource Scan
Scan Details
Site Domain | do.simpleescorts.com |
Base Domain | simpleescorts.com |
Scan Status | Ok |
Last Scan | 2025-05-02T18:37:11+00:00 |
Next Scan | 2025-06-01T18:37:11+00:00 |
Last Scan
Scanned | 2025-05-02T18:37:11+00:00 |
URL | https://do.simpleescorts.com/robots.txt |
Domain IPs | 104.26.0.161, 104.26.1.161, 172.67.71.12, 2606:4700:20::681a:1a1, 2606:4700:20::681a:a1, 2606:4700:20::ac43:470c |
Response IP | 104.26.1.161 |
Found | Yes |
Hash | f52894b036d33d1ff4ffd7571acbe2c6a8c6c7ea30de5734494d6211a14cf5ea |
SimHash | 7014dc72a583 |
Groups
*
Rule | Path |
---|---|
Disallow | /cdn-cgi/ |
Allow | / |
Disallow | /search/ |
Disallow | /*q%3D* |
Disallow | *gender%3D* |
Disallow | *fromAge%3D* |
Disallow | *toAge%3D* |
Disallow | *nationality%3D* |
Other Records
Field | Value |
---|---|
sitemap | https://do.simpleescorts.com/sitemap_index.xml |