airpump.ru
robots.txt

Robots Exclusion Standard data for airpump.ru

Resource Scan

Scan Details

Site Domain airpump.ru
Base Domain airpump.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-09-21T22:27:54+00:00
Next Scan 2024-12-20T22:27:54+00:00

Last Successful Scan

Scanned2023-11-04T01:28:12+00:00
URL http://airpump.ru/robots.txt
Domain IPs 2a00:15f8:a000:5:1:11:6:df9f, 2a00:15f8:a000:5:1:12:6:df9f, 2a00:15f8:a000:5:1:13:6:df9f, 2a00:15f8:a000:5:1:14:6:df9f, 90.156.201.35, 90.156.201.48, 90.156.201.76, 90.156.201.97
Response IP 90.156.201.97
Found Yes
Hash e4e61c880e55f6d74451ca25dc5023a8a7fd451e2ef6236fc36d1946a6ad03c3
SimHash 43258b635991

Groups

yandex

Rule Path
Disallow /scripts/
Disallow /inc/
Disallow /include/
Disallow /inc_bottom/
Disallow /404.htm

*

Rule Path
Disallow /scripts/
Disallow /inc/
Disallow /include/
Disallow /inc_bottom/
Disallow /404.htm

uniplace-bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 45

Other Records

Field Value
sitemap http://airpump.ru/sitemap.xml
sitemap http://airpump.ru/promnews/sitemap.xml
sitemap http://airpump.ru/new/sitemap.xml

Warnings

  • `host` is not a known field.