foodswinesfromspain.com
robots.txt

Robots Exclusion Standard data for foodswinesfromspain.com

Resource Scan

Scan Details

Site Domain foodswinesfromspain.com
Base Domain foodswinesfromspain.com
Scan Status Ok
Last Scan2024-10-05T23:18:26+00:00
Next Scan 2024-11-04T23:18:26+00:00

Last Scan

Scanned2024-10-05T23:18:26+00:00
URL https://www.foodswinesfromspain.com/robots.txt
Domain IPs 13.107.246.59, 2620:1ec:bdf::59
Response IP 13.107.246.70
Found Yes
Hash 865142b30ca9f5afa3a2e9326f4165fd389c4fac441cc0ef511477db69cc4492
SimHash 2a5e4a42e4b3

Groups

sogou spider

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

*

Rule Path
Disallow /en/errors/

Other Records

Field Value
sitemap https://www.foodswinesfromspain.com/en/sitemap.xml

Comments

  • Start Group: sogou spider
  • End Group: sogou spider
  • Start Group: Sosospider
  • End Group: Sosospider
  • Start Group: all
  • End Group: all