unmission.su
robots.txt

Robots Exclusion Standard data for unmission.su

Resource Scan

Scan Details

Site Domain unmission.su
Base Domain unmission.su
Scan Status Ok
Last Scan2024-11-16T08:23:07+00:00
Next Scan 2024-11-23T08:23:07+00:00

Last Scan

Scanned2024-11-16T08:23:07+00:00
URL https://unmission.su/robots.txt
Domain IPs 95.131.27.119
Response IP 95.131.27.119
Found Yes
Hash c4c76e95ae376c701dfabd897a99506bc2180fc810ab1ba9afc335d6c0d7b89f
SimHash 6c08dc559491

Groups

yandex

Rule Path
Disallow /api
Disallow /gqapi
Disallow /photos
Disallow /pedia
Disallow /videos
Disallow /gadgets

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Disallow /api
Disallow /gqapi
Disallow /photos
Disallow /pedia
Disallow /videos
Disallow /gadgets

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /api
Disallow /gqapi
Disallow /photos
Disallow /pedia
Disallow /videos
Disallow /gadgets

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://unmission.su/sitemap.xml

Warnings

  • `clean-param` is not a known field.