regionews.at
robots.txt

Robots Exclusion Standard data for regionews.at

Resource Scan

Scan Details

Site Domain regionews.at
Base Domain regionews.at
Scan Status Ok
Last Scan2025-03-13T04:04:15+00:00
Next Scan 2025-03-20T04:04:15+00:00

Last Scan

Scanned2025-03-13T04:04:15+00:00
URL https://regionews.at/robots.txt
Domain IPs 104.26.12.37, 104.26.13.37, 172.67.71.99, 2606:4700:20::681a:c25, 2606:4700:20::681a:d25, 2606:4700:20::ac43:4763
Response IP 104.26.13.37
Found Yes
Hash 00c5f31358462a8f1e8ca1fac3f31abd8403aecd1e8a0b547327f57d36b043db
SimHash 6601d041c135

Groups

*

Rule Path
Disallow

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

applebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5