Log In Sign Up

theaerocityescorts.com
robots.txt

Robots Exclusion Standard data for theaerocityescorts.com

Resource Scan

Scan Details

Site Domain theaerocityescorts.com
Base Domain theaerocityescorts.com
Scan Status Ok
Last Scan6/28/2025, 1:48:14 AM
Next Scan 7/28/2025, 1:48:14 AM

Last Scan

Scanned6/28/2025, 1:48:14 AM
URL https://theaerocityescorts.com/robots.txt
Domain IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Response IP 104.21.112.1
Found Yes
Hash d649c66dc1b4775d0bff74bc47a7119c2e0493654546402d6a231ed78577ccd4
SimHash 601c49d0f4d7

Groups

amazonbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

*

Rule Path
Disallow
Disallow /cgi-bin/
Back to top

Other Records

Field Value
sitemap https://theaerocityescorts.com/sitemap.xml
Back to top

Comments

  • Cloudflare Managed Robots.txt to block AI related bots - START
  • Cloudflare Managed Robots.txt to block AI related bots - END
Back to top