charliebury.com
robots.txt

Robots Exclusion Standard data for charliebury.com

Resource Scan

Scan Details

Site Domain charliebury.com
Base Domain charliebury.com
Scan Status Ok
Last Scan2024-05-25T21:11:28+00:00
Next Scan 2024-06-24T21:11:28+00:00

Last Scan

Scanned2024-05-25T21:11:28+00:00
URL https://charliebury.com/robots.txt
Redirect https://www.charliebury.com/robots.txt
Redirect Domain www.charliebury.com
Redirect Base charliebury.com
Domain IPs 13.215.144.61, 18.139.194.139
Redirect IPs 13.228.199.255, 13.251.96.10
Response IP 13.228.199.255
Found Yes
Hash 5cb445fc913d7b41058c5dc37004a851dec9e15c504e79c88ff22e1dd4ef8102
SimHash ab529943deb5

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.charliebury.com/sitemap.xml

Comments

  • robotstxt.org - if ENV production variable is false robots will be disallowed.