phonearena.com
robots.txt

Robots Exclusion Standard data for phonearena.com

Resource Scan

Scan Details

Site Domain phonearena.com
Base Domain phonearena.com
Scan Status Ok
Last Scan2024-11-14T11:39:33+00:00
Next Scan 2024-11-21T11:39:33+00:00

Last Scan

Scanned2024-11-14T11:39:33+00:00
URL https://phonearena.com/robots.txt
Redirect https://www.phonearena.com/robots.txt
Redirect Domain www.phonearena.com
Redirect Base phonearena.com
Domain IPs 172.66.40.221, 172.66.43.35, 2606:4700:3108::ac42:28dd, 2606:4700:3108::ac42:2b23
Redirect IPs 172.66.40.221, 172.66.43.35, 2606:4700:3108::ac42:28dd, 2606:4700:3108::ac42:2b23
Response IP 172.66.40.221
Found Yes
Hash ee609518d7d54e09eac36a238b21c35905f1d34674dd3d5156f3192ba54cac16
SimHash 4b0e75c3ac53

Groups

*

Rule Path
Disallow /cp
Disallow /search
Disallow /more
Disallow /tests/
Disallow /search/
Disallow /feed/
Disallow /news/FCC-OKs-Cingulars-purchase-of-AT-T-Wireless_id69*
Disallow /_track.php
Disallow /widget/
Disallow /user
Disallow /login
Disallow /phones/compare/*/*%2C*%2C*
Disallow /phones/size/*/*%2C*%2C*
Disallow /phones/compare/*/phones/9*%2C*
Disallow /phones/compare/*/phones/8*%2C*
Disallow /phones/compare/*/phones/7*%2C*
Disallow /phones/compare/*/phones/6*%2C*
Disallow /phones/compare/*/phones/5*%2C*
Disallow /phones/compare/*/phones/4*%2C*
Disallow /phones/compare/*/phones/3*%2C*
Disallow /phones/compare/*/phones/2*%2C*
Disallow /phones/compare/*/phones/*%2C2*
Disallow /phones/compare/*/phones/*%2C3*
Disallow /phones/compare/*/phones/*%2C4*
Disallow /phones/compare/*/phones/*%2C5*
Disallow /phones/compare/*/phones/*%2C6*
Disallow /phones/compare/*/phones/*%2C7*
Disallow /phones/compare/*/phones/*%2C8*
Disallow /phones/compare/*/phones/*%2C9*
Disallow /phones/compare/*/phones/s/
Disallow /phones/size/*/phones/
Disallow /comments
Disallow /*/comments
Disallow /phones/compare/*/phones/*C*
Disallow /phones/*/reviews/report-review/
Disallow /phones/compare/*%*
Disallow /phones/size/*%*
Disallow /htmls
Disallow /*/htmls
Disallow *124260794*
Disallow *?ratelimit=*
Disallow *us_census_name*
Disallow *US_CENSUS_NAME*
Disallow */sort/
Disallow *?f%5B
Disallow /phones/camera/
Disallow */add/reviews
Disallow */edit/reviews
Disallow */reviews/vote/
Disallow *?sort=

ahrefsbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.phonearena.com/sitemaps/website.xml
sitemap https://www.phonearena.com/sitemaps/googlenews.xml
sitemap https://www.phonearena.com/sitemaps/news/index.xml
sitemap https://www.phonearena.com/sitemaps/hubs/index.xml
sitemap https://www.phonearena.com/sitemaps/reviews/index.xml
sitemap https://www.phonearena.com/sitemaps/phones/index.xml
sitemap https://www.phonearena.com/sitemaps/compare/specifications.xml
sitemap https://www.phonearena.com/sitemaps/compare/specifications-new.xml
sitemap https://www.phonearena.com/ar-vr/sitemaps/index.xml
sitemap https://www.phonearena.com/sitemaps/discussions.xml

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449