eredivisie.eu
robots.txt

Robots Exclusion Standard data for eredivisie.eu

Resource Scan

Scan Details

Site Domain eredivisie.eu
Base Domain eredivisie.eu
Scan Status Ok
Last Scan2024-09-25T06:52:36+00:00
Next Scan 2024-10-02T06:52:36+00:00

Last Scan

Scanned2024-09-25T06:52:36+00:00
URL https://eredivisie.eu/robots.txt
Domain IPs 136.144.201.133
Response IP 136.144.201.133
Found Yes
Hash 8a57ab861538483a1143ef13a87ff68111d60b44ff1160909b5ce8d0f3cca194
SimHash 210a1d7227b5

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

Other Records

Field Value
sitemap https://eredivisie.nl/sitemaps-1-sitemap.xml
sitemap https://eredivisie.eu/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://eredivisie.eu/
  • live - don't allow web crawlers to index cpresources/ or vendor/