escortnearme.com
robots.txt

Robots Exclusion Standard data for escortnearme.com

Resource Scan

Scan Details

Site Domain escortnearme.com
Base Domain escortnearme.com
Scan Status Ok
Last Scan5/13/2025, 11:51:13 AM
Next Scan 6/12/2025, 11:51:13 AM

Last Scan

Scanned5/13/2025, 11:51:13 AM
URL https://escortnearme.com/robots.txt
Redirect https://www.escortnearme.com/robots.txt
Redirect Domain www.escortnearme.com
Redirect Base escortnearme.com
Domain IPs 104.21.40.245, 172.67.140.100, 2606:4700:3035::ac43:8c64, 2606:4700:3036::6815:28f5
Redirect IPs 104.21.40.245, 172.67.140.100, 2606:4700:3035::ac43:8c64, 2606:4700:3036::6815:28f5
Response IP 104.21.40.245
Found Yes
Hash 2cf5f500afd951dcfd8cc6997c8bde03053621b4ad4ce8637ec15e310f37b86c
SimHash 2910de7065c3

Groups

*

Rule Path
Allow /
Disallow /cdn-cgi/
Disallow /*?*term=*
Disallow /*?*filter=*

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

duckduckbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.escortnearme.it/sitemap.xml