book-news.org
robots.txt

Robots Exclusion Standard data for book-news.org

Resource Scan

Scan Details

Site Domain book-news.org
Base Domain book-news.org
Scan Status Ok
Last Scan2024-10-13T15:37:54+00:00
Next Scan 2024-10-20T15:37:54+00:00

Last Scan

Scanned2024-10-13T15:37:54+00:00
URL http://book-news.org/robots.txt
Domain IPs 104.248.5.188
Response IP 104.248.5.188
Found Yes
Hash 2d52bca9a6297ef14495e11765c21fcbd8ee7045ec1378307b213891fdaba476
SimHash cb4d56f22631

Groups

ahrefsbot

Rule Path
Disallow /

amazonadbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

clickagy

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

linguee

Rule Path
Disallow /

photon

Rule Path
Disallow /

rytebot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

adbeat_bot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

Other Records

Field Value
sitemap /sitemap.xml
sitemap /sitemaps/sitemap-0001.xml
sitemap /sitemaps/sitemap-index.xml

Warnings

  • 1 invalid line.