comicbookrealm.com
robots.txt

Robots Exclusion Standard data for comicbookrealm.com

Resource Scan

Scan Details

Site Domain comicbookrealm.com
Base Domain comicbookrealm.com
Scan Status Ok
Last Scan2024-10-11T18:48:46+00:00
Next Scan 2024-10-18T18:48:46+00:00

Last Scan

Scanned2024-10-11T18:48:46+00:00
URL https://comicbookrealm.com/robots.txt
Domain IPs 159.89.145.72
Response IP 159.89.145.72
Found Yes
Hash 5b208bfb829e72a8c97b7a832a169916cf756ff267b4b8887b3160020f9ef93a
SimHash d12c7860c488

Groups

ahrefsbot

Rule Path
Disallow /

awariorssbot
awariosmartbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

barkrowler

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

blexbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

careerbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

crystalsemanticsbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

friendlycrawler

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

jikespider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

maxpointcrawler

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

netseer

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

skimbot

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

unisterbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

*

Rule Path
Disallow /scan

*

Rule Path
Disallow /admin

*

Rule Path
Disallow /register

*

Rule Path
Disallow /search/

*

Rule Path
Disallow /report/contributor/21125/*

*

Rule Path
Allow /