theinformr.in
robots.txt

Robots Exclusion Standard data for theinformr.in

Resource Scan

Scan Details

Site Domain theinformr.in
Base Domain theinformr.in
Scan Status Ok
Last Scan2024-11-15T15:51:50+00:00
Next Scan 2024-11-22T15:51:50+00:00

Last Scan

Scanned2024-11-15T15:51:50+00:00
URL https://theinformr.in/robots.txt
Redirect https://theinformr.com/robots.txt?utm_source=redirects&utm_medium=theinformr.in&utm_campaign=301_Redirects
Redirect Domain theinformr.com
Redirect Base theinformr.com
Domain IPs 104.21.68.55, 172.67.187.189, 2606:4700:3031::ac43:bbbd, 2606:4700:3037::6815:4437
Redirect IPs 162.159.136.54, 162.159.137.54, 2606:4700:7::a29f:8836, 2606:4700:7::a29f:8936
Response IP 162.159.136.54
Found Yes
Hash d9eaab21abf11c70048d69a12c322df3273ff5a18aef7d2290125fa0ef73b9c5
SimHash ec09f507e000

Groups

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /submit-review
Disallow /submit-question
Disallow /submit-answer
Disallow /submit-comment
Disallow /accessories/offer
Disallow /offer
Disallow /accessories/reviews
Disallow /cell-phones/reviews
Disallow /cell-plans/carriers/reviews
Disallow /apps/reviews
Disallow /manufacturers/reviews
Disallow /external/reviews
Disallow /visitor/tick
Disallow /compare-cart
Disallow /user-state
Disallow /resolve-location/
Disallow /editor
Disallow /loading
Disallow /login
Disallow /signup
Disallow /password-reset
Disallow /account
Disallow /profile/*/$
Disallow /videos/*/$
Disallow /videos/topic/*/$
Disallow /external/
Disallow /admin
Disallow /wp-admin
Disallow /administrator
Disallow /components
Disallow /honeypot
Disallow /*/review-add/
Disallow /*/show-provinces/
Disallow /*/show-cities/
Disallow /cart/
Disallow /*/sort/
Disallow /*/loc/
Disallow /*/filter_reset/$
Disallow /plans/carrier/*/$
Disallow /features/preview/*/$
Disallow /result/
Disallow /ca/result/
Disallow /uk/result/
Disallow /external/*/review/
Disallow /cell-phones/*/codemirror
Disallow /cell-phones/phone-review-form/
Disallow /cell-phones/correction/
Disallow /cell-phones/*/offers/phoneonly/
Disallow /cell-phones/*/offers/phoneandplan/
Disallow /tablets/*/offers/phoneonly/
Disallow /tablets/*/offers/phoneandplan/
Disallow /news/preview/*/$
Disallow /news/*/$
Disallow /*.php$
Disallow /*.inc$
Disallow /*.cgi$
Disallow /*.lst$

Other Records

Field Value
sitemap https://theinformr.com/sitemaps/index.xml

Comments

  • Disallow all files ending with these extensions
  • Sitemaps