ac-system.ru
robots.txt

Robots Exclusion Standard data for ac-system.ru

Resource Scan

Scan Details

Site Domain ac-system.ru
Base Domain ac-system.ru
Scan Status Ok
Last Scan2024-06-15T09:47:22+00:00
Next Scan 2024-06-16T09:47:22+00:00

Last Scan

Scanned2024-06-15T09:47:22+00:00
URL https://ac-system.ru/robots.txt
Redirect https://www.ac-system.ru/robots.txt
Redirect Domain www.ac-system.ru
Redirect Base ac-system.ru
Domain IPs 194.67.112.20
Redirect IPs 194.67.112.20
Response IP 194.67.112.20
Found Yes
Hash 0d73ab51a9cfecddf0dacee8476d18623be3969fdf6be416ca1e10c234c7c1dd
SimHash 62149c025eb1

Groups

spbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

begunadvertising

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

sputnikbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 100.1

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

yandex

Rule Path
Disallow /cgi-bin
Disallow /plugins
Disallow /skins
Disallow /system
Disallow

*

Rule Path
Disallow /cgi-bin
Disallow /plugins
Disallow /skins
Disallow /system
Disallow

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.