chinese.aljazeera.net
robots.txt

Robots Exclusion Standard data for chinese.aljazeera.net

Resource Scan

Scan Details

Site Domain chinese.aljazeera.net
Base Domain aljazeera.net
Scan Status Ok
Last Scan2024-05-24T18:11:38+00:00
Next Scan 2024-06-07T18:11:38+00:00

Last Scan

Scanned2024-05-24T18:11:38+00:00
URL https://chinese.aljazeera.net/robots.txt
Domain IPs 23.52.112.222, 2600:1413:b000:693::2392, 2600:1413:b000:695::2392
Response IP 23.200.181.73
Found Yes
Hash d0f2e8433bdea5895483061b321f8428891190e55dee9f02a08728cbc3b67d3a
SimHash 683c5c747593

Groups

*

Rule Path
Disallow /api
Disallow /asset-manifest.json
Allow /search/$
Disallow /search/
Disallow /home/search?q=

Other Records

Field Value
sitemap https://chinese.aljazeera.net/sitemap.xml
sitemap https://chinese.aljazeera.net/news-sitemap.xml
sitemap https://chinese.aljazeera.net/sitemaps/article-archive.xml
sitemap https://chinese.aljazeera.net/sitemaps/article-new.xml
sitemap https://chinese.aljazeera.net/sitemaps/video-archive.xml
sitemap https://chinese.aljazeera.net/sitemaps/video-new.xml