fanatics.ca
robots.txt

Robots Exclusion Standard data for fanatics.ca

Resource Scan

Scan Details

Site Domain fanatics.ca
Base Domain fanatics.ca
Scan Status Ok
Last Scan2024-11-08T12:19:57+00:00
Next Scan 2024-11-15T12:19:57+00:00

Last Scan

Scanned2024-11-08T12:19:57+00:00
URL https://fanatics.ca/robots.txt
Redirect https://www.fanatics.ca/robots.txt
Redirect Domain www.fanatics.ca
Redirect Base fanatics.ca
Domain IPs 23.215.7.12, 23.215.7.21
Redirect IPs 23.215.7.12, 23.215.7.21
Response IP 23.44.4.138
Found Yes
Hash 29523c3a6ff148a5405015dbcf75b1a4aae03007509c506fe18d83489090137d
SimHash 471499d2f7b4

Groups

adsbot-google
adsbot-google-mobile
adidxbot

Rule Path
Allow /*%2Bf-*
Allow /*?_s=gppc*
Allow /*/browse/featuredproduct/*

googlebot
*

Rule Path
Allow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

ahrefsbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10