escortfly.com
robots.txt

Robots Exclusion Standard data for escortfly.com

Resource Scan

Scan Details

Site Domain escortfly.com
Base Domain escortfly.com
Scan Status Ok
Last Scan5/30/2025, 9:22:03 PM
Next Scan 6/6/2025, 9:22:03 PM

Last Scan

Scanned5/30/2025, 9:22:03 PM
URL https://escortfly.com/robots.txt
Domain IPs 104.21.5.53, 172.67.132.254, 2606:4700:3032::6815:535, 2606:4700:3032::ac43:84fe
Response IP 104.21.5.53
Found Yes
Hash 2a6f816cdac964ad0090fa11da5f007942ad4f35503e18cfe506b3bb6884af4f
SimHash c91ed420ee93

Groups

*

Rule Path
Allow /
Disallow /search/
Disallow /cgi-bin/

awariobot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://escortfly.com/sitemap.xml