Log In Sign Up

global-aero.com
robots.txt

Robots Exclusion Standard data for global-aero.com

Resource Scan

Scan Details

Site Domain global-aero.com
Base Domain global-aero.com
Scan Status Ok
Last Scan2025-11-15T10:55:16+00:00
Next Scan 2025-12-15T10:55:16+00:00

Last Scan

Scanned2025-11-15T10:55:16+00:00
URL https://global-aero.com/robots.txt
Redirect https://www.global-aero.com/robots.txt
Redirect Domain www.global-aero.com
Redirect Base global-aero.com
Domain IPs 151.101.194.159
Redirect IPs 151.101.194.159
Response IP 151.101.194.159
Found Yes
Hash 77f05a09e2df0fc1da6a7c166b38af37a91535ffdfba84167d5b24a6c48c7160
SimHash 7b9c9c42e6b4

Groups

*

Rule Path
Disallow /calendar/action*
Disallow /events/action*
Allow /*.css
Allow /*.js

Other Records

Field Value
crawl-delay 3

gptbot

Rule Path
Disallow

google-extended

Rule Path
Disallow

claudebot

Rule Path
Disallow

perplexitybot

Rule Path
Disallow
Back to top

Other Records

Field Value
sitemap https://www.global-aero.com/sitemap.xml
Back to top

Comments

  • Default robots file version:2
  • Allow GPTBot (OpenAI)
  • Allow Google-Extended (Google AI services like Bard/Gemini)
  • Allow Anthropic's ClaudeBot
  • Allow PerplexityBot
Back to top