cheapbooks.biz
robots.txt

Robots Exclusion Standard data for cheapbooks.biz

Resource Scan

Scan Details

Site Domain cheapbooks.biz
Base Domain cheapbooks.biz
Scan Status Ok
Last Scan2024-10-10T08:19:04+00:00
Next Scan 2024-10-17T08:19:04+00:00

Last Scan

Scanned2024-10-10T08:19:04+00:00
URL http://cheapbooks.biz/robots.txt
Domain IPs 204.12.243.106
Response IP 204.12.243.106
Found Yes
Hash f5a70e3c83d14424d97624aa2b4591bf3d7745c02b10ff383835ed75169df18c
SimHash cb0fe6b22610

Groups

ahrefsbot

Rule Path
Disallow /

amazonadbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

clickagy

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

linguee

Rule Path
Disallow /

photon

Rule Path
Disallow /

rytebot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

adbeat_bot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

Other Records

Field Value
sitemap /sitemaps/rss-0000.xml
sitemap /sitemaps/rss-0001.xml
sitemap /sitemaps/rss-0002.xml
sitemap /sitemaps/rss-0003.xml
sitemap /sitemaps/rss-0004.xml
sitemap /sitemaps/rss-0005.xml
sitemap /sitemaps/sitemap-0001.xml
sitemap /sitemaps/sitemap-index.xml
sitemap /sitemaps/urls.txt