varecha.pravda.sk
robots.txt

Robots Exclusion Standard data for varecha.pravda.sk

Resource Scan

Scan Details

Site Domain varecha.pravda.sk
Base Domain pravda.sk
Scan Status Ok
Last Scan2024-05-28T13:53:14+00:00
Next Scan 2024-06-27T13:53:14+00:00

Last Scan

Scanned2024-05-28T13:53:14+00:00
URL https://varecha.pravda.sk/robots.txt
Domain IPs 185.65.220.42
Response IP 185.65.220.42
Found Yes
Hash c3c1a8880b13c615b10d0e04b9d38c33d7069b6d7617d5e40a0a11df3c661af7
SimHash a1255d01c3e4

Groups

disallow slovenskedomeny.sk
*

Rule Path
Disallow /export/

*

Rule Path
Disallow /pages/

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

msnbot-media

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Comments

  • Limiting the crawl rate of Bingbot