fanatics.ca
robots.txt

Robots Exclusion Standard data for fanatics.ca

Resource Scan

Scan Details

Site Domain fanatics.ca
Base Domain fanatics.ca
Scan Status Ok
Last Scan2024-06-28T08:49:53+00:00
Next Scan 2024-07-05T08:49:53+00:00

Last Scan

Scanned2024-06-28T08:49:53+00:00
URL https://fanatics.ca/robots.txt
Redirect https://www.fanatics.ca/robots.txt
Redirect Domain www.fanatics.ca
Redirect Base fanatics.ca
Domain IPs 184.28.235.59, 184.28.235.73
Redirect IPs 23.52.40.10, 23.52.40.40
Response IP 23.52.171.232
Found Yes
Hash 29523c3a6ff148a5405015dbcf75b1a4aae03007509c506fe18d83489090137d
SimHash 471499d2f7b4

Groups

adsbot-google
adsbot-google-mobile
adidxbot

Rule Path
Allow /*%2Bf-*
Allow /*?_s=gppc*
Allow /*/browse/featuredproduct/*

googlebot
*

Rule Path
Allow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

ahrefsbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10