av-gk.ru
robots.txt

Robots Exclusion Standard data for av-gk.ru

Resource Scan

Scan Details

Site Domain av-gk.ru
Base Domain av-gk.ru
Scan Status Ok
Last Scan2024-10-04T01:17:56+00:00
Next Scan 2024-10-11T01:17:56+00:00

Last Scan

Scanned2024-10-04T01:17:56+00:00
URL https://av-gk.ru/robots.txt
Domain IPs 144.76.35.141
Response IP 144.76.35.141
Found Yes
Hash 4bbecc260d63d4cc6b33e8574b2d40d1f6c7c27602d105c41b159b1f920fd38b
SimHash 611cc860cbf0

Groups

*

Rule Path
Disallow /api/
Disallow /baza/
Disallow /my/
Disallow /search/
Disallow /s/
Allow /static/js/
Allow /static/css/
Allow /static/templates/
Disallow *?
Allow /sites/*?
Allow /static/*?

petalbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 500

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Warnings

  • `host` is not a known field.