cbmpress.com
robots.txt

Robots Exclusion Standard data for cbmpress.com

Resource Scan

Scan Details

Site Domain cbmpress.com
Base Domain cbmpress.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-15T04:01:49+00:00
Next Scan 2025-10-29T04:01:49+00:00

Last Successful Scan

Scanned2025-09-29T21:18:50+00:00
URL https://cbmpress.com/robots.txt
Domain IPs 159.203.56.80
Response IP 159.203.56.80
Found Yes
Hash 70a53e9d5f216ca636fcbfaa867750127a4ebd4e1a305c896bcd3f65b740eb8e
SimHash f05b7c00e8c4

Groups

ahrefsbot

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

bdcbot

Rule Path
Disallow /

businessbot

Rule Path
Disallow /

dataprovider.com

Rule Path
Disallow /

dialogsearch.com bot

Rule Path
Disallow /

digincore crawler bot

Rule Path
Disallow /

domainsigmacrawler

Rule Path
Disallow /

kisabot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

mediavbot

Rule Path
Disallow /

memorybot

Rule Path
Disallow /

mfibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

msnbot-media

Rule Path
Disallow /

neumobbot

Rule Path
Disallow /

pageanalyzer

Rule Path
Disallow /

pagesinventory

Rule Path
Disallow /

plukkie

Rule Path
Disallow /

roboto

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

rsnbot

Rule Path
Disallow /

safednsbot

Rule Path
Disallow /

semanticbot

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

uxcrawlerbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

crawl.amazonbot.amazon

Rule Path
Disallow /

googlebot

Rule Path
Disallow /adm/
Disallow /data/
Disallow /extend/
Disallow /install/
Disallow /js/
Disallow /lib/
Disallow /plugin/
Disallow /skin/
Disallow /theme/

Other Records

Field Value
crawl-delay 604800