demonology.en-academic.com
robots.txt

Robots Exclusion Standard data for demonology.en-academic.com

Resource Scan

Scan Details

Site Domain demonology.en-academic.com
Base Domain en-academic.com
Scan Status Ok
Last Scan2024-09-24T11:26:44+00:00
Next Scan 2024-10-24T11:26:44+00:00

Last Scan

Scanned2024-09-24T11:26:44+00:00
URL https://demonology.en-academic.com/robots.txt
Domain IPs 2a01:4f9:c01e:78::1, 95.217.170.197
Response IP 95.217.170.197
Found Yes
Hash 688f9894e228cb2dd60cb85fb5e9ad181d2633f24d96d90fc4f677032c7cb538
SimHash 527ccd624a8a

Groups

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 0.1

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

detectify

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

flipboardproxy

Rule Path
Disallow /

knowledge ai

Rule Path
Disallow /

femtosearchbot

Rule Path
Disallow *

Other Records

Field Value
sitemap https://demonology.en-academic.com/sitemaps/en-academic.com/demonology_index.xml