indi-39.com
robots.txt

Robots Exclusion Standard data for indi-39.com

Resource Scan

Scan Details

Site Domain indi-39.com
Base Domain indi-39.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-12-09T02:55:56+00:00
Next Scan 2026-03-09T02:55:56+00:00

Last Successful Scan

Scanned2025-07-18T16:33:04+00:00
URL https://indi-39.com/robots.txt
Domain IPs 104.21.26.39, 172.67.135.91, 2606:4700:3035::6815:1a27, 2606:4700:3036::ac43:875b
Response IP 104.21.26.39
Found Yes
Hash 7117a819e4993335f5ac7a9daca69807c8dcf017b70103f7cce548d58122ef49
SimHash 7949a842dd82

Groups

*

Rule Path
Allow /*.css
Disallow /*?*
Disallow /*.php
Disallow *utm*%3D
Disallow /arxiv/
Disallow /cgi-bin
Disallow /install/
Disallow /manager/
Disallow *openstat%3D
Disallow /assets/docs/
Disallow /pravila.html
Disallow /anketyi.html
Disallow /assets/cache/
Disallow /otzyivyi.html
Disallow /izbrannoe.html
Disallow /assets/export/
Disallow /assets/import/
Disallow /assets/modules/
Disallow /assets/plugins/
Disallow /assets/snippets/
Disallow /aktivirovan.html
Disallow /webcam-models.html
Disallow /dobavit-anketu.html
Disallow /udalenie-anket.html
Disallow /chernyij-spisok.html
Disallow /obratnaya-svyaz.html
Disallow /popolnenie-scheta.html
Disallow /nastrojki-profilya.html
Disallow /bannernaya-reklama.html
Disallow /rasshirennyij-poisk.html
Disallow /aktivacziya-akkaunta.html
Disallow /redaktirovanie-anketyi.html
Disallow /vosstanovlenie-parolya.html
Disallow /polzovatelskoe-soglashenie.html
Disallow /zagruzka-proverochnogo-foto.html

yandex

Rule Path
Allow /*.css
Disallow /*?*
Disallow /*.php
Disallow *utm*%3D
Disallow /arxiv/
Disallow /cgi-bin
Disallow /install/
Disallow /manager/
Disallow *openstat%3D
Disallow /assets/docs/
Disallow /pravila.html
Disallow /anketyi.html
Disallow /assets/cache/
Disallow /assets/export/
Disallow /assets/import/
Disallow /assets/modules/
Disallow /assets/plugins/
Disallow /assets/snippets/

Other Records

Field Value
sitemap https://indi-39.com/sitemap.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.