dagonbel.ru
robots.txt

Robots Exclusion Standard data for dagonbel.ru

Resource Scan

Scan Details

Site Domain dagonbel.ru
Base Domain dagonbel.ru
Scan Status Ok
Last Scan5/12/2025, 1:46:22 AM
Next Scan 6/11/2025, 1:46:22 AM

Last Scan

Scanned5/12/2025, 1:46:22 AM
URL https://dagonbel.ru/robots.txt
Domain IPs 104.21.60.129, 172.67.196.162, 2606:4700:3036::ac43:c4a2, 2606:4700:3037::6815:3c81
Response IP 104.21.60.129
Found Yes
Hash 35de7318f4fefe27b50e94ee61e9e053871abd31fe8ed34f88733998c3ae154b
SimHash 67508c51eeb0

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4.5

Other Records

Field Value
sitemap https://dagonbel.ru/sitemap.xml

Warnings

  • `host` is not a known field.