firebirdsrestaurants.com
robots.txt

Robots Exclusion Standard data for firebirdsrestaurants.com

Resource Scan

Scan Details

Site Domain firebirdsrestaurants.com
Base Domain firebirdsrestaurants.com
Scan Status Ok
Last Scan2024-04-21T15:11:27+00:00
Next Scan 2024-05-21T15:11:27+00:00

Last Scan

Scanned2024-04-21T15:11:27+00:00
URL https://firebirdsrestaurants.com/robots.txt
Domain IPs 104.26.0.86, 104.26.1.86, 172.67.70.202, 2606:4700:20::681a:156, 2606:4700:20::681a:56, 2606:4700:20::ac43:46ca
Response IP 172.67.70.202
Found Yes
Hash c3a7e350b8b10f9e894706c6c210ca23847125b5248e197c8e60e3cc2ba5658a
SimHash c3701d767513

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

Other Records

Field Value
sitemap https://firebirdsrestaurants.com/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://firebirdsrestaurants.com/
  • live - don't allow web crawlers to index cpresources/ or vendor/