thestaffcanteen.com
robots.txt

Robots Exclusion Standard data for thestaffcanteen.com

Resource Scan

Scan Details

Site Domain thestaffcanteen.com
Base Domain thestaffcanteen.com
Scan Status Ok
Last Scan2024-05-30T09:26:48+00:00
Next Scan 2024-06-06T09:26:48+00:00

Last Scan

Scanned2024-05-30T09:26:48+00:00
URL https://thestaffcanteen.com/robots.txt
Domain IPs 104.26.4.13, 104.26.5.13, 172.67.71.4, 2606:4700:20::681a:40d, 2606:4700:20::681a:50d, 2606:4700:20::ac43:4704
Response IP 104.26.4.13
Found Yes
Hash 816c50a17599bbcb7e120380f352f19cc1fb744057be2e7660b762a5ade5f35e
SimHash 28094a6ce993

Groups

*

Rule Path
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://www.thestaffcanteen.com/sitemap.xml

Comments

  • robotstxt.org/