zdnetasia.com
robots.txt
Robots Exclusion Standard data for zdnetasia.com
Resource Scan
Scan Details
| Site Domain | zdnetasia.com |
| Base Domain | zdnetasia.com |
| Scan Status | Ok |
| Last Scan | 2024-11-16T05:58:54+00:00 |
| Next Scan | 2024-11-23T05:58:54+00:00 |
Last Scan
| Scanned | 2024-11-16T05:58:54+00:00 |
| URL | https://www.zdnetasia.com/robots.txt |
| Redirect | https://www.zdnet.com/robots.txt |
| Redirect Domain | www.zdnet.com |
| Redirect Base | zdnet.com |
| Domain IPs | 18.185.24.46, 2a05:d014:803:f30a:4c8d:5530:dac2:179, 2a05:d014:803:f30c:505c:9738:13c:b7a5, 2a05:d014:803:f30e:ffe5:90d1:736a:fcad, 3.126.5.188, 3.71.139.153 |
| Redirect IPs | 199.232.194.154, 199.232.198.154, 2a04:4e42:4c::666, 2a04:4e42:4d::666 |
| Response IP | 151.101.42.154 |
| Found | Yes |
| Hash | 32da0c7bcb692629993c0d369a06c9a533bebde55d958cffccf2c33b420b2420 |
| SimHash | 321ef940eaa4 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /user/* |
| Disallow | /members/ |
| Disallow | /members/newsletters/ |
| Disallow | /members/alerts/add/ |
| Disallow | /search/ |
| Disallow | *Xhr* |
| Disallow | */xhr* |
| Disallow | */ajax/* |
| Disallow | */fly/*/bundles/flyjs/* |
| Disallow | */libs/* |
| Disallow | */version%21libs/* |
| Disallow | /.well-known/* |
| Disallow | /index.php/* |
| Disallow | *?beta=* |
| Disallow | *?ftag=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.zdnet.com/sitemaps/news.xml |
| sitemap | https://www.zdnet.com/sitemaps/topics.xml |
| sitemap | https://www.zdnet.com/sitemaps/article/index.xml |
| sitemap | https://www.zdnet.com/sitemaps/gallery/index.xml |
| sitemap | https://www.zdnet.com/sitemaps/video/index.xml |
| sitemap | https://www.zdnet.com/sitemaps/review/index.xml |
Comments