Log In Sign Up

star03.ru
robots.txt

Robots Exclusion Standard data for star03.ru

Resource Scan

Scan Details

Site Domain star03.ru
Base Domain star03.ru
Scan Status Ok
Last Scan2024-06-08T01:10:35+00:00
Next Scan 2024-07-08T01:10:35+00:00

Last Scan

Scanned2024-06-08T01:10:35+00:00
URL https://star03.ru/robots.txt
Domain IPs 104.21.55.163, 172.67.149.51, 2606:4700:3031::6815:37a3, 2606:4700:3035::ac43:9533
Response IP 172.67.149.51
Found Yes
Hash dcb02341d85065e19ae732b4b0b6539e7b4b74c084d069429333b702a09c224c
SimHash 61009cd2cab1

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4.5
Back to top

Other Records

Field Value
sitemap https://star03.ru/sitemap.xml
Back to top

Warnings

  • `host` is not a known field.
Back to top