news.bg
robots.txt

Robots Exclusion Standard data for news.bg

Resource Scan

Scan Details

Site Domain news.bg
Base Domain news.bg
Scan Status Ok
Last Scan2024-11-17T19:27:54+00:00
Next Scan 2024-11-24T19:27:54+00:00

Last Scan

Scanned2024-11-17T19:27:54+00:00
URL https://news.bg/robots.txt
Domain IPs 79.98.111.110
Response IP 79.98.111.110
Found Yes
Hash 1c5a3777de30c48ed9329f150552a404b88610c939d82a435e94ce4c34799e17
SimHash 6d14dc5067d2

Groups

*

Rule Path
Disallow /search

Other Records

Field Value
crawl-delay 10