gistindia.org.in
robots.txt

Robots Exclusion Standard data for gistindia.org.in

Resource Scan

Scan Details

Site Domain gistindia.org.in
Base Domain gistindia.org.in
Scan Status Ok
Last Scan2024-06-10T10:34:18+00:00
Next Scan 2024-06-17T10:34:18+00:00

Last Scan

Scanned2024-06-10T10:34:18+00:00
URL https://gistindia.org.in/robots.txt
Redirect https://www.gistindia.org.in/robots.txt
Redirect Domain www.gistindia.org.in
Redirect Base gistindia.org.in
Domain IPs 104.21.72.187, 172.67.153.221, 2606:4700:3031::6815:48bb, 2606:4700:3034::ac43:99dd
Redirect IPs 104.21.72.187, 172.67.153.221, 2606:4700:3031::6815:48bb, 2606:4700:3034::ac43:99dd
Response IP 172.67.153.221
Found Yes
Hash 2e3b159c6c3fb2b996d683372deb2decba769349019f715de852890310e3c402
SimHash 45051b51d7d3

Groups

*

Rule Path
Disallow /comments/feed/
Disallow /archives/
Disallow /preview/
Disallow /profiles/
Disallow /search

mediapartners-google*

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.gistindia.org.in/sitemap.xml