indiaforums.com
robots.txt

Robots Exclusion Standard data for indiaforums.com

Resource Scan

Scan Details

Site Domain indiaforums.com
Base Domain indiaforums.com
Scan Status Ok
Last Scan2024-11-11T20:34:57+00:00
Next Scan 2024-11-18T20:34:57+00:00

Last Scan

Scanned2024-11-11T20:34:57+00:00
URL https://indiaforums.com/robots.txt
Redirect https://www.indiaforums.com/robots.txt
Redirect Domain www.indiaforums.com
Redirect Base indiaforums.com
Domain IPs 104.22.0.27, 104.22.1.27, 172.67.14.19
Redirect IPs 104.22.0.27, 104.22.1.27, 172.67.14.19
Response IP 172.67.14.19
Found Yes
Hash 31aee75e098d668a9b34927bf7a7e83def4f9a49681885e6455adc5131a7c112
SimHash cd0cda74cd70

Groups

*

Rule Path
Disallow /my/
Disallow /bin/
Disallow /login
Disallow /logout
Disallow /comment
Disallow /popup
Disallow */inftrees$
Disallow */inffast$
Disallow */trees$
Disallow */common$
Disallow */crc32$
Disallow */adler32$
Disallow */messages$
Allow *

proximic

Rule Path
Disallow /

googlebot-news

Rule Path
Allow /article/
Disallow /video/
Disallow /media/
Disallow /person/
Disallow /play/
Disallow /fanfiction/
Disallow /forum/
Disallow /helpcenter/
Disallow /gallery/
Disallow /channel/
Disallow /movie/
Disallow /show/
Disallow /channel/

Other Records

Field Value
sitemap https://www.indiaforums.com/sitemaps/sitemaps.xml