r.escortgirl.cc
robots.txt
Robots Exclusion Standard data for r.escortgirl.cc
Resource Scan
Scan Details
Site Domain | r.escortgirl.cc |
Base Domain | escortgirl.cc |
Scan Status | Ok |
Last Scan | 2024-05-31T01:55:59+00:00 |
Next Scan | 2024-06-30T01:55:59+00:00 |
Last Scan
Scanned | 2024-05-31T01:55:59+00:00 |
URL | https://r.escortgirl.cc/robots.txt |
Domain IPs | 104.21.93.52, 172.67.204.153, 2606:4700:3030::ac43:cc99, 2606:4700:3036::6815:5d34 |
Response IP | 104.21.93.52 |
Found | Yes |
Hash | bf65c941246c37f4f8fdce36fcc7bc25b796283c8db7fc7b5c308a7cf62f710f |
SimHash | 8ee0584e0533 |
Groups
*
Rule | Path |
---|---|
Disallow | / |
Disallow | /*confirm.html* |
Disallow | /*listing-details.html* |
Disallow | /*print.html* |
Disallow | /404.html* |
Disallow | /*listing-remove.html* |
Disallow | /*newsletter.html* |
Other Records
Field | Value |
---|---|
sitemap | https://r.escortgirl.cc/sitemap.xml |
Warnings
- `host` is not a known field.
Comments