theinformr.co.uk
robots.txt

Robots Exclusion Standard data for theinformr.co.uk

Resource Scan

Scan Details

Site Domain theinformr.co.uk
Base Domain theinformr.co.uk
Scan Status Ok
Last Scan2024-11-15T15:25:33+00:00
Next Scan 2024-11-22T15:25:33+00:00

Last Scan

Scanned2024-11-15T15:25:33+00:00
URL https://theinformr.co.uk/robots.txt
Redirect https://theinformr.com/uk/robots.txt?utm_source=redirects&utm_medium=theinformr.co.uk&utm_campaign=301_Redirects
Redirect Domain theinformr.com
Redirect Base theinformr.com
Domain IPs 104.21.61.80, 172.67.207.101, 2606:4700:3031::ac43:cf65, 2606:4700:3033::6815:3d50
Redirect IPs 162.159.136.54, 162.159.137.54, 2606:4700:7::a29f:8836, 2606:4700:7::a29f:8936
Response IP 162.159.136.54
Found Yes
Hash 04863030a2b3ee21548993dfe34f50abadc83af6131855fb6f0cc7b802d63bec
SimHash cc09fd87e100

Groups

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /submit-review
Disallow /submit-question
Disallow /submit-answer
Disallow /submit-comment
Disallow /accessories/offer
Disallow /offer
Disallow /accessories/reviews
Disallow /cell-phones/reviews
Disallow /cell-plans/carriers/reviews
Disallow /apps/reviews
Disallow /manufacturers/reviews
Disallow /external/reviews
Disallow /visitor/tick
Disallow /compare-cart
Disallow /user-state
Disallow /resolve-location/
Disallow /editor
Disallow /loading
Disallow /login
Disallow /signup
Disallow /password-reset
Disallow /account
Disallow /profile/*/$
Disallow /videos/*/$
Disallow /videos/topic/*/$
Disallow /external/
Disallow /admin
Disallow /wp-admin
Disallow /administrator
Disallow /components
Disallow /honeypot
Disallow /*/review-add/
Disallow /*/show-provinces/
Disallow /*/show-cities/
Disallow /cart/
Disallow /*/sort/
Disallow /*/loc/
Disallow /*/filter_reset/$
Disallow /plans/carrier/*/$
Disallow /features/preview/*/$
Disallow /result/
Disallow /ca/result/
Disallow /uk/result/
Disallow /external/*/review/
Disallow /cell-phones/*/codemirror
Disallow /cell-phones/phone-review-form/
Disallow /cell-phones/correction/
Disallow /cell-phones/*/offers/phoneonly/
Disallow /cell-phones/*/offers/phoneandplan/
Disallow /tablets/*/offers/phoneonly/
Disallow /tablets/*/offers/phoneandplan/
Disallow /news/preview/*/$
Disallow /news/*/$
Disallow /*.php$
Disallow /*.inc$
Disallow /*.cgi$
Disallow /*.lst$

Other Records

Field Value
sitemap https://theinformr.com/uk/sitemaps/index.xml

Comments

  • Disallow all files ending with these extensions
  • Sitemaps