bigcaucasus.com
robots.txt

Robots Exclusion Standard data for bigcaucasus.com

Resource Scan

Scan Details

Site Domain bigcaucasus.com
Base Domain bigcaucasus.com
Scan Status Ok
Last Scan2024-04-26T17:59:13+00:00
Next Scan 2024-05-03T17:59:13+00:00

Last Scan

Scanned2024-04-26T17:59:13+00:00
URL https://bigcaucasus.com/robots.txt
Redirect https://www.bigcaucasus.com/robots.txt
Redirect Domain www.bigcaucasus.com
Redirect Base bigcaucasus.com
Domain IPs 104.21.35.7, 172.67.167.39, 2606:4700:3031::6815:2307, 2606:4700:3031::ac43:a727
Redirect IPs 104.21.35.7, 172.67.167.39, 2606:4700:3031::6815:2307, 2606:4700:3031::ac43:a727
Response IP 104.21.35.7
Found Yes
Hash 436982e135744baaf8bae803df4933e8db76f9c9407919196c1d39079c351e5a
SimHash 5f508822cd3b

Groups

yandex

Rule Path
Disallow /cache/static_fragment/
Disallow /*area%3D
Disallow /*.html?add
Disallow *.jpeg
Disallow *.jpg
Disallow *.gif
Disallow *.png

*

Rule Path
Disallow /cache/static_fragment/
Disallow /*area%3D
Disallow /*.html?add

Other Records

Field Value
sitemap http://www.bigcaucasus.com/sitemap_index.xml

Warnings

  • 2 invalid lines.
  • `host` is not a known field.