bottroper-zeitung.de
robots.txt

Robots Exclusion Standard data for bottroper-zeitung.de

Resource Scan

Scan Details

Site Domain bottroper-zeitung.de
Base Domain bottroper-zeitung.de
Scan Status Ok
Last Scan2024-10-08T09:14:28+00:00
Next Scan 2024-10-09T09:14:28+00:00

Last Scan

Scanned2024-10-08T09:14:28+00:00
URL https://bottroper-zeitung.de/robots.txt
Domain IPs 213.202.245.205
Response IP 213.202.245.205
Found Yes
Hash 9bf41f56441bd8e817aae1834a144f7beda1bc9c9a72618570b79480272ccba0
SimHash 604d5c518453

Groups

*

Rule Path
Disallow /stats/*

cliqzbot

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://bottroper-zeitung.de/sitemap_index.xml