helpset.ru
robots.txt

Robots Exclusion Standard data for helpset.ru

Resource Scan

Scan Details

Site Domain helpset.ru
Base Domain helpset.ru
Scan Status Ok
Last Scan2025-05-15T15:14:25+00:00
Next Scan 2025-05-22T15:14:25+00:00

Last Scan

Scanned2025-05-15T15:14:25+00:00
URL https://helpset.ru/robots.txt
Redirect https://www.helpset.ru/robots.txt
Redirect Domain www.helpset.ru
Redirect Base helpset.ru
Domain IPs 104.21.3.114, 172.67.130.167, 2606:4700:3031::ac43:82a7, 2606:4700:3033::6815:372
Redirect IPs 104.21.3.114, 172.67.130.167, 2606:4700:3031::ac43:82a7, 2606:4700:3033::6815:372
Response IP 172.67.130.167
Found Yes
Hash 727acddf5edae2f630815c4deece8f32cfacef177da477cefae74005e9a55ddf
SimHash 6920ce60c6b2

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /wp-admin/
Allow /doc/
Allow /img/
Allow /wp-content/uploads/

Other Records

Field Value
crawl-delay 2

Warnings

  • `host` is not a known field.