chipsoffury.com
robots.txt

Robots Exclusion Standard data for chipsoffury.com

Resource Scan

Scan Details

Site Domain chipsoffury.com
Base Domain chipsoffury.com
Scan Status Ok
Last Scan2025-08-25T11:49:18+00:00
Next Scan 2025-09-01T11:49:18+00:00

Last Scan

Scanned2025-08-25T11:49:18+00:00
URL https://chipsoffury.com/robots.txt
Domain IPs 104.21.13.54, 172.67.132.156, 2606:4700:3030::ac43:849c, 2606:4700:3037::6815:d36
Response IP 104.21.13.54
Found Yes
Hash 78fa1e994ccdd07c5631c3e8a544e58ac6ec8fd80b6461cffc18efd4b175b56b
SimHash 6550df936785

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 0

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 0

slurp

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

duckduckbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://chipsoffury.com/sitemap.xml

Comments

  • Robots.txt for ChipsOfFury.com
  • Allow all crawlers
  • Sitemap location
  • Crawl-delay for responsible crawling
  • Specific rules for major search engines