acm.math.spbu.ru
robots.txt

Robots Exclusion Standard data for acm.math.spbu.ru

Resource Scan

Scan Details

Site Domain acm.math.spbu.ru
Base Domain spbu.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-12-10T05:40:03+00:00
Next Scan 2026-02-08T05:40:03+00:00

Last Successful Scan

Scanned2025-09-08T11:53:47+00:00
URL https://acm.math.spbu.ru/robots.txt
Domain IPs 185.148.210.100
Response IP 185.148.210.100
Found Yes
Hash addd95547cc5373b8e088902b37ebab55a577f646da823baa224ca9741924313
SimHash 3544c870cd62

Groups

*

Rule Path
Disallow /manual/
Disallow /doc/
Disallow /gif/
Disallow /cgi-bin/monitor_au.pl/

susedig

Rule Path
Disallow

stress-agent

Rule Path
Disallow /

Comments

  • exclude help system from robots
  • but allow htdig to index our doc-tree
  • disallow stress test