escortdude.com
robots.txt

Robots Exclusion Standard data for escortdude.com

Resource Scan

Scan Details

Site Domain escortdude.com
Base Domain escortdude.com
Scan Status Ok
Last Scan5/31/2025, 8:39:53 AM
Next Scan 6/30/2025, 8:39:53 AM

Last Scan

Scanned5/31/2025, 8:39:53 AM
URL https://escortdude.com/robots.txt
Domain IPs 104.21.40.116, 172.67.185.139, 2606:4700:3031::ac43:b98b, 2606:4700:3036::6815:2874
Response IP 104.21.40.116
Found Yes
Hash 727b95b9f9474fd0d6cdb2d0e9462b14110fa19cd98a5f68139833bade82dc82
SimHash 41145e72c711

Groups

*

Rule Path
Allow /
Disallow /cdn-cgi/

ahrefsbot

Rule Path
Allow /
Disallow /cdn-cgi/

Other Records

Field Value
crawl-delay 2

semrushbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.escortdude.com/sitemap.xml