blackcircles.ca
robots.txt
Robots Exclusion Standard data for blackcircles.ca
Resource Scan
Scan Details
Site Domain | blackcircles.ca |
Base Domain | blackcircles.ca |
Scan Status | Ok |
Last Scan | 2024-11-04T21:59:59+00:00 |
Next Scan | 2024-11-18T21:59:59+00:00 |
Last Scan
Scanned | 2024-11-04T21:59:59+00:00 |
URL | https://blackcircles.ca/robots.txt |
Redirect | https://www.blackcircles.ca/robots.txt |
Redirect Domain | www.blackcircles.ca |
Redirect Base | blackcircles.ca |
Domain IPs | 13.33.21.72, 13.33.21.86, 13.33.21.93, 13.33.21.96, 2600:9000:23d1:3800:b:62d7:ec00:93a1, 2600:9000:23d1:600:b:62d7:ec00:93a1, 2600:9000:23d1:800:b:62d7:ec00:93a1, 2600:9000:23d1:8e00:b:62d7:ec00:93a1, 2600:9000:23d1:a200:b:62d7:ec00:93a1, 2600:9000:23d1:c000:b:62d7:ec00:93a1, 2600:9000:23d1:e000:b:62d7:ec00:93a1, 2600:9000:23d1:e00:b:62d7:ec00:93a1 |
Redirect IPs | 18.161.111.30, 18.161.111.59, 18.161.111.69, 18.161.111.99, 2600:9000:20b4:1000:b:62d7:ec00:93a1, 2600:9000:20b4:5000:b:62d7:ec00:93a1, 2600:9000:20b4:7600:b:62d7:ec00:93a1, 2600:9000:20b4:9a00:b:62d7:ec00:93a1, 2600:9000:20b4:be00:b:62d7:ec00:93a1, 2600:9000:20b4:dc00:b:62d7:ec00:93a1, 2600:9000:20b4:e400:b:62d7:ec00:93a1, 2600:9000:20b4:f000:b:62d7:ec00:93a1 |
Response IP | 18.165.140.21 |
Found | Yes |
Hash | 3640529904d7e266326e2634e0ee0d1d4cfb25270563411af228dd3f56c014fa |
SimHash | 2b1e54d08472 |
Groups
boitho.com-dc
cazoodlebot
converacrawler
discobot
dotbot
etaospider
exabot
exabot-thumbnails
ezooms
fasterfox
gaisbot
gigabot
heritrix
huaweisymantecspider
ia_archiver
ichiro
irlbot
kalooga
ladenzeile
ladenzeile.de
lexxebot
mlbot
msiecrawler
naverbot
nutch
ocelli
pagesinventory
penthesilea
phpdig
scoutjet
searchdaimon.com-dc
seokicks-robot
shopwiki
snapbot
spbot
speobot
teoma
turnitinbot
twiceler
wikiwix-bot
woozweb-monitoring
woriobot
wotbox
yacybit
yacybot
yeti
yodaobot
zyborg
Rule | Path |
---|---|
Disallow | / |
*
Rule | Path |
---|---|
Disallow | /myaccount/* |
Disallow | /myaccount |
Disallow | /basket/* |
Disallow | /basket |
Disallow | /*?adressSearchField=* |
Disallow | /payment/* |
Disallow | /payment |
Disallow | /terms-and-conditions |
Disallow | /cookies |
Disallow | /customerOpinionProfilAjax/* |
Disallow | /paymentRedirect |
Disallow | /en/paymentRedirect |
Other Records
Field | Value |
---|---|
sitemap | https://www.blackcircles.ca/en/sitemap.xml |