findex.az
robots.txt

Robots Exclusion Standard data for findex.az

Resource Scan

Scan Details

Site Domain findex.az
Base Domain findex.az
Scan Status Ok
Last Scan2025-11-15T23:23:04+00:00
Next Scan 2025-12-15T23:23:04+00:00

Last Scan

Scanned2025-11-15T23:23:04+00:00
URL https://findex.az/robots.txt
Domain IPs 104.21.90.173, 172.67.202.176, 2606:4700:3035::6815:5aad, 2606:4700:3035::ac43:cab0
Response IP 104.21.90.173
Found Yes
Hash 6397cc8b15346a386dc9a31e57cc2460a5ec9d889105c9e07f2159098265ba93
SimHash 41488870e392

Groups

*

Rule Path
Allow /

googlebot

Rule Path
Disallow /news/*

Other Records

Field Value
sitemap http://findex.az/sitemap.xml

Warnings

  • `host` is not a known field.