sourdoughandolives.com
robots.txt

Robots Exclusion Standard data for sourdoughandolives.com

Resource Scan

Scan Details

Site Domain sourdoughandolives.com
Base Domain sourdoughandolives.com
Scan Status Ok
Last Scan2024-10-18T21:36:24+00:00
Next Scan 2024-10-25T21:36:24+00:00

Last Scan

Scanned2024-10-18T21:36:24+00:00
URL https://sourdoughandolives.com/robots.txt
Redirect https://www.sourdoughandolives.com/robots.txt
Redirect Domain www.sourdoughandolives.com
Redirect Base sourdoughandolives.com
Domain IPs 162.241.225.66
Redirect IPs 162.241.225.66
Response IP 162.241.225.66
Found Yes
Hash 99d88cb71b8b71a870ad1b4d969969db1136848c203044bb084672ee0339a211
SimHash 484c0a40d593

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.sourdoughandolives.com/sitemap_index.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK