gidonline-film.ru
robots.txt

Robots Exclusion Standard data for gidonline-film.ru

Resource Scan

Scan Details

Site Domain gidonline-film.ru
Base Domain gidonline-film.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-09T11:07:56+00:00
Next Scan 2025-02-07T11:07:56+00:00

Last Successful Scan

Scanned2024-04-14T10:44:49+00:00
URL https://gidonline-film.ru/robots.txt
Redirect https://io.gidonline-film.fun/robots.txt
Redirect Domain io.gidonline-film.fun
Redirect Base gidonline-film.fun
Domain IPs 104.21.67.184, 172.67.179.120
Redirect IPs 104.21.26.2, 172.67.168.51, 2606:4700:3032::ac43:a833, 2606:4700:3035::6815:1a02
Response IP 104.21.26.2
Found Yes
Hash 1b65c7469385b9f6c72bd596e0423d6b3420f6c663b78b6bff2f6f487a23c916
SimHash 090dc141cf31

Groups

*

Rule Path
Allow /engine/classes/min/index.php?
Allow /engine/data/emoticons/
Disallow /engine/

blexbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

criteobot/0.1

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

Other Records

Field Value
sitemap https://io.gidonline-film.ru/sitemap.xml

Warnings

  • `host` is not a known field.