Log In Sign Up

bacatus.shop
robots.txt

Robots Exclusion Standard data for bacatus.shop

Resource Scan

Scan Details

Site Domain bacatus.shop
Base Domain bacatus.shop
Scan Status Ok
Last Scan2024-09-14T12:04:03+00:00
Next Scan 2024-10-14T12:04:03+00:00

Last Scan

Scanned2024-09-14T12:04:03+00:00
URL https://bacatus.shop/robots.txt
Domain IPs 213.133.121.27, 2a01:4f8:d0a:11e6::2
Response IP 213.133.121.27
Found Yes
Hash ba411f3cfcf833654beed2f5fb0e8d307a7477fb696b08d0430219a7542fabdc
SimHash 524d47705620

Groups

barkrowler

Rule Path
Disallow /

scrapy

Rule Path
Allow /

suggybot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

kraken

Rule Path
Disallow /

genieo

Rule Path
Disallow /

r6_commentreader

Rule Path
Disallow /

r6_feedfetcher

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

yeti

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

seobility

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

ssearch crawler

Rule Path
Disallow /

publiclibraryarchive

Rule Path
Disallow /

publiclibraryarchive.org

Rule Path
Disallow /

coccoc

Rule Path
Disallow /

wesee

Rule Path
Disallow /

memorybot

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

netlyzer fastprobe

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

adscanner

Rule Path
Disallow /
Back to top