chinese.aljazeera.net
robots.txt
Robots Exclusion Standard data for chinese.aljazeera.net
Resource Scan
Scan Details
Site Domain | chinese.aljazeera.net |
Base Domain | aljazeera.net |
Scan Status | Ok |
Last Scan | 2024-05-24T18:11:38+00:00 |
Next Scan | 2024-06-07T18:11:38+00:00 |
Last Scan
Scanned | 2024-05-24T18:11:38+00:00 |
URL | https://chinese.aljazeera.net/robots.txt |
Domain IPs | 23.52.112.222, 2600:1413:b000:693::2392, 2600:1413:b000:695::2392 |
Response IP | 23.200.181.73 |
Found | Yes |
Hash | d0f2e8433bdea5895483061b321f8428891190e55dee9f02a08728cbc3b67d3a |
SimHash | 683c5c747593 |
Groups
*
Rule | Path |
---|---|
Disallow | /api |
Disallow | /asset-manifest.json |
Allow | /search/$ |
Disallow | /search/ |
Disallow | /home/search?q= |
Other Records
Field | Value |
---|---|
sitemap | https://chinese.aljazeera.net/sitemap.xml |
sitemap | https://chinese.aljazeera.net/news-sitemap.xml |
sitemap | https://chinese.aljazeera.net/sitemaps/article-archive.xml |
sitemap | https://chinese.aljazeera.net/sitemaps/article-new.xml |
sitemap | https://chinese.aljazeera.net/sitemaps/video-archive.xml |
sitemap | https://chinese.aljazeera.net/sitemaps/video-new.xml |