nevelsk.ru
robots.txt

Robots Exclusion Standard data for nevelsk.ru

Resource Scan

Scan Details

Site Domain nevelsk.ru
Base Domain nevelsk.ru
Scan Status Ok
Last Scan2024-11-18T07:08:50+00:00
Next Scan 2024-11-25T07:08:50+00:00

Last Scan

Scanned2024-11-18T07:08:50+00:00
URL https://nevelsk.ru/robots.txt
Domain IPs 46.255.138.79
Response IP 46.255.138.79
Found Yes
Hash a193247ce011d8e11ba4b951ffaf7790a7679feaa1fe9021f5ca521d9e1d72be
SimHash 6558d8f24331

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 20