cellphones.ca
robots.txt

Robots Exclusion Standard data for cellphones.ca

Resource Scan

Scan Details

Site Domain cellphones.ca
Base Domain cellphones.ca
Scan Status Ok
Last Scan2024-11-15T11:23:50+00:00
Next Scan 2024-11-22T11:23:50+00:00

Last Scan

Scanned2024-11-15T11:23:50+00:00
URL https://cellphones.ca/robots.txt
Domain IPs 162.159.136.54, 162.159.137.54, 2606:4700:7::a29f:8836, 2606:4700:7::a29f:8936
Response IP 162.159.136.54
Found Yes
Hash be4091b8cfd8a964a1ec2dedeb5a94672e4d1833294eb76810bb57ec8c5f164c
SimHash ec09f507e100

Groups

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /submit-review
Disallow /submit-question
Disallow /submit-answer
Disallow /submit-comment
Disallow /accessories/offer
Disallow /offer
Disallow /accessories/reviews
Disallow /cell-phones/reviews
Disallow /cell-plans/carriers/reviews
Disallow /apps/reviews
Disallow /manufacturers/reviews
Disallow /external/reviews
Disallow /visitor/tick
Disallow /compare-cart
Disallow /user-state
Disallow /resolve-location/
Disallow /editor
Disallow /loading
Disallow /login
Disallow /signup
Disallow /password-reset
Disallow /account
Disallow /profile/*/$
Disallow /videos/*/$
Disallow /videos/topic/*/$
Disallow /external/
Disallow /admin
Disallow /wp-admin
Disallow /administrator
Disallow /components
Disallow /honeypot
Disallow /*/review-add/
Disallow /*/show-provinces/
Disallow /*/show-cities/
Disallow /cart/
Disallow /*/sort/
Disallow /*/loc/
Disallow /*/filter_reset/$
Disallow /plans/carrier/*/$
Disallow /features/preview/*/$
Disallow /result/
Disallow /ca/result/
Disallow /uk/result/
Disallow /external/*/review/
Disallow /cell-phones/*/codemirror
Disallow /cell-phones/phone-review-form/
Disallow /cell-phones/correction/
Disallow /cell-phones/*/offers/phoneonly/
Disallow /cell-phones/*/offers/phoneandplan/
Disallow /tablets/*/offers/phoneonly/
Disallow /tablets/*/offers/phoneandplan/
Disallow /news/preview/*/$
Disallow /*.php$
Disallow /*.inc$
Disallow /*.cgi$
Disallow /*.lst$

Other Records

Field Value
sitemap https://www.cellphones.ca/sitemaps/index.xml

Comments

  • Disallow all files ending with these extensions
  • Sitemaps