mt.simpleescorts.com
robots.txt
Robots Exclusion Standard data for mt.simpleescorts.com
Resource Scan
Scan Details
Site Domain | mt.simpleescorts.com |
Base Domain | simpleescorts.com |
Scan Status | Ok |
Last Scan | 2025-05-02T21:06:10+00:00 |
Next Scan | 2025-06-01T21:06:10+00:00 |
Last Scan
Scanned | 2025-05-02T21:06:10+00:00 |
URL | https://mt.simpleescorts.com/robots.txt |
Domain IPs | 104.26.0.161, 104.26.1.161, 172.67.71.12, 2606:4700:20::681a:1a1, 2606:4700:20::681a:a1, 2606:4700:20::ac43:470c |
Response IP | 104.26.1.161 |
Found | Yes |
Hash | 2d75cfedf9098b05afb55a95c6e555fe0aefd07654ca2ba9aa2bf4a5e10adcd6 |
SimHash | 6014d872e593 |
Groups
*
Rule | Path |
---|---|
Disallow | /cdn-cgi/ |
Allow | / |
Disallow | /search/ |
Disallow | /*q%3D* |
Disallow | *gender%3D* |
Disallow | *fromAge%3D* |
Disallow | *toAge%3D* |
Disallow | *nationality%3D* |
Other Records
Field | Value |
---|---|
sitemap | https://mt.simpleescorts.com/sitemap_index.xml |