phonearena.com
robots.txt
Robots Exclusion Standard data for phonearena.com
Resource Scan
Scan Details
Site Domain | phonearena.com |
Base Domain | phonearena.com |
Scan Status | Ok |
Last Scan | 2024-11-14T11:39:33+00:00 |
Next Scan | 2024-11-21T11:39:33+00:00 |
Last Scan
Scanned | 2024-11-14T11:39:33+00:00 |
URL | https://phonearena.com/robots.txt |
Redirect | https://www.phonearena.com/robots.txt |
Redirect Domain | www.phonearena.com |
Redirect Base | phonearena.com |
Domain IPs | 172.66.40.221, 172.66.43.35, 2606:4700:3108::ac42:28dd, 2606:4700:3108::ac42:2b23 |
Redirect IPs | 172.66.40.221, 172.66.43.35, 2606:4700:3108::ac42:28dd, 2606:4700:3108::ac42:2b23 |
Response IP | 172.66.40.221 |
Found | Yes |
Hash | ee609518d7d54e09eac36a238b21c35905f1d34674dd3d5156f3192ba54cac16 |
SimHash | 4b0e75c3ac53 |
Groups
*
Rule | Path |
---|---|
Disallow | /cp |
Disallow | /search |
Disallow | /more |
Disallow | /tests/ |
Disallow | /search/ |
Disallow | /feed/ |
Disallow | /news/FCC-OKs-Cingulars-purchase-of-AT-T-Wireless_id69* |
Disallow | /_track.php |
Disallow | /widget/ |
Disallow | /user |
Disallow | /login |
Disallow | /phones/compare/*/*%2C*%2C* |
Disallow | /phones/size/*/*%2C*%2C* |
Disallow | /phones/compare/*/phones/9*%2C* |
Disallow | /phones/compare/*/phones/8*%2C* |
Disallow | /phones/compare/*/phones/7*%2C* |
Disallow | /phones/compare/*/phones/6*%2C* |
Disallow | /phones/compare/*/phones/5*%2C* |
Disallow | /phones/compare/*/phones/4*%2C* |
Disallow | /phones/compare/*/phones/3*%2C* |
Disallow | /phones/compare/*/phones/2*%2C* |
Disallow | /phones/compare/*/phones/*%2C2* |
Disallow | /phones/compare/*/phones/*%2C3* |
Disallow | /phones/compare/*/phones/*%2C4* |
Disallow | /phones/compare/*/phones/*%2C5* |
Disallow | /phones/compare/*/phones/*%2C6* |
Disallow | /phones/compare/*/phones/*%2C7* |
Disallow | /phones/compare/*/phones/*%2C8* |
Disallow | /phones/compare/*/phones/*%2C9* |
Disallow | /phones/compare/*/phones/s/ |
Disallow | /phones/size/*/phones/ |
Disallow | /comments |
Disallow | /*/comments |
Disallow | /phones/compare/*/phones/*C* |
Disallow | /phones/*/reviews/report-review/ |
Disallow | /phones/compare/*%* |
Disallow | /phones/size/*%* |
Disallow | /htmls |
Disallow | /*/htmls |
Disallow | *124260794* |
Disallow | *?ratelimit=* |
Disallow | *us_census_name* |
Disallow | *US_CENSUS_NAME* |
Disallow | */sort/ |
Disallow | *?f%5B |
Disallow | /phones/camera/ |
Disallow | */add/reviews |
Disallow | */edit/reviews |
Disallow | */reviews/vote/ |
Disallow | *?sort= |
Other Records
Field | Value |
---|---|
sitemap | https://www.phonearena.com/sitemaps/website.xml |
sitemap | https://www.phonearena.com/sitemaps/googlenews.xml |
sitemap | https://www.phonearena.com/sitemaps/news/index.xml |
sitemap | https://www.phonearena.com/sitemaps/hubs/index.xml |
sitemap | https://www.phonearena.com/sitemaps/reviews/index.xml |
sitemap | https://www.phonearena.com/sitemaps/phones/index.xml |
sitemap | https://www.phonearena.com/sitemaps/compare/specifications.xml |
sitemap | https://www.phonearena.com/sitemaps/compare/specifications-new.xml |
sitemap | https://www.phonearena.com/ar-vr/sitemaps/index.xml |
sitemap | https://www.phonearena.com/sitemaps/discussions.xml |
Comments