usegalileo.ai
robots.txt

Robots Exclusion Standard data for usegalileo.ai

Resource Scan

Scan Details

Site Domain usegalileo.ai
Base Domain usegalileo.ai
Scan Status Ok
Last Scan2024-05-21T19:21:39+00:00
Next Scan 2024-06-20T19:21:39+00:00

Last Scan

Scanned2024-05-21T19:21:39+00:00
URL https://usegalileo.ai/robots.txt
Redirect https://www.usegalileo.ai/api/robots
Redirect Domain www.usegalileo.ai
Redirect Base usegalileo.ai
Domain IPs 216.24.57.1
Redirect IPs 216.24.57.252, 216.24.57.4
Response IP 216.24.57.252
Found Yes
Hash 97bf7c725a14a8b1ff0a6b8cf76067fc5891dc9a18409fd737a1ef4f748eea26
SimHash 08149f0083b3

Groups

*

Rule Path
Disallow /create
Disallow /settings

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.usegalileo.ai/sitemap.xml

Comments

  • Allow all crawlers