blackcircles.ca
robots.txt
Robots Exclusion Standard data for blackcircles.ca
Resource Scan
Scan Details
Site Domain | blackcircles.ca |
Base Domain | blackcircles.ca |
Scan Status | Ok |
Last Scan | 2024-05-20T16:23:43+00:00 |
Next Scan | 2024-06-03T16:23:43+00:00 |
Last Scan
Scanned | 2024-05-20T16:23:43+00:00 |
URL | https://blackcircles.ca/robots.txt |
Redirect | https://www.blackcircles.ca/robots.txt |
Redirect Domain | www.blackcircles.ca |
Redirect Base | blackcircles.ca |
Domain IPs | 13.33.21.72, 13.33.21.86, 13.33.21.93, 13.33.21.96, 2600:9000:2363:1e00:b:62d7:ec00:93a1, 2600:9000:2363:4600:b:62d7:ec00:93a1, 2600:9000:2363:8400:b:62d7:ec00:93a1, 2600:9000:2363:8800:b:62d7:ec00:93a1, 2600:9000:2363:a00:b:62d7:ec00:93a1, 2600:9000:2363:a600:b:62d7:ec00:93a1, 2600:9000:2363:c200:b:62d7:ec00:93a1, 2600:9000:2363:e000:b:62d7:ec00:93a1 |
Redirect IPs | 13.33.21.72, 13.33.21.86, 13.33.21.93, 13.33.21.96, 2600:9000:2363:1000:b:62d7:ec00:93a1, 2600:9000:2363:2400:b:62d7:ec00:93a1, 2600:9000:2363:3e00:b:62d7:ec00:93a1, 2600:9000:2363:5400:b:62d7:ec00:93a1, 2600:9000:2363:7c00:b:62d7:ec00:93a1, 2600:9000:2363:c00:b:62d7:ec00:93a1, 2600:9000:2363:c800:b:62d7:ec00:93a1, 2600:9000:2363:d800:b:62d7:ec00:93a1 |
Response IP | 108.157.60.116 |
Found | Yes |
Hash | 61654d2c6e787f06295b60153bbb4c9941b48e2f1d27986d97d91c4c8c729efc |
SimHash | 2b1e54408472 |
Groups
boitho.com-dc
cazoodlebot
converacrawler
discobot
dotbot
etaospider
exabot
exabot-thumbnails
ezooms
fasterfox
gaisbot
gigabot
heritrix
huaweisymantecspider
ia_archiver
ichiro
irlbot
kalooga
ladenzeile
ladenzeile.de
lexxebot
mlbot
msiecrawler
naverbot
nutch
ocelli
pagesinventory
penthesilea
phpdig
scoutjet
searchdaimon.com-dc
seokicks-robot
shopwiki
snapbot
spbot
speobot
teoma
turnitinbot
twiceler
wikiwix-bot
woozweb-monitoring
woriobot
wotbox
yacybit
yacybot
yeti
yodaobot
zyborg
Rule | Path |
---|---|
Disallow | / |
*
Rule | Path |
---|---|
Disallow | /myaccount/* |
Disallow | /myaccount |
Disallow | /basket/* |
Disallow | /basket |
Disallow | /*?adressSearchField=* |
Disallow | /payment/* |
Disallow | /payment |
Disallow | /blog/* |
Disallow | /blog |
Disallow | /terms-and-conditions |
Disallow | /cookies |
Disallow | /customerOpinionProfilAjax/* |
Disallow | /paymentRedirect |
Disallow | /en/paymentRedirect |
Other Records
Field | Value |
---|---|
sitemap | https://www.blackcircles.ca/en/sitemap.xml |