ability-perm.ru
robots.txt

Robots Exclusion Standard data for ability-perm.ru

Resource Scan

Scan Details

Site Domain ability-perm.ru
Base Domain ability-perm.ru
Scan Status Ok
Last Scan2024-05-27T08:09:30+00:00
Next Scan 2024-06-26T08:09:30+00:00

Last Scan

Scanned2024-05-27T08:09:30+00:00
URL https://ability-perm.ru/robots.txt
Domain IPs 81.177.174.11
Response IP 81.177.174.11
Found Yes
Hash 91fb5810dbe3d68ca9da0c1482536dc8fb7cd44a0dd835d3ab3bbe2c4904351c
SimHash 7219dd53cd81

Groups

yandex

Rule Path
Allow *
Disallow /download/
Disallow /services/promotion/
Disallow /company/jobs

googlebot

Rule Path
Allow *
Disallow /download/
Disallow /services/promotion/
Disallow /company/jobs

slurp

Rule Path
Allow *
Disallow /download/
Disallow /services/promotion/
Disallow /company/jobs

msnbot

Rule Path
Allow *
Disallow /download/
Disallow /services/promotion/
Disallow /company/jobs

bingbot

Rule Path
Allow *
Disallow /download/
Disallow /services/promotion/
Disallow /company/jobs

stackrambler

Rule Path
Allow *
Disallow /download/
Disallow /services/promotion/
Disallow /company/jobs

mail.ru

Rule Path
Allow *
Disallow /download/
Disallow /services/promotion/
Disallow /company/jobs

yahoo

Rule Path
Allow *
Disallow /download/
Disallow /services/promotion/
Disallow /company/jobs

*

Rule Path
Allow *
Disallow /download/
Disallow /services/promotion/
Disallow /company/jobs

Other Records

Field Value
crawl-delay 2.0

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

begunadvertising

Rule Path
Disallow /

ntentbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

sputnikbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://ability-perm.ru/sitemap.xml

Warnings

  • `host` is not a known field.