mubasher.aljazeera.net
robots.txt

Robots Exclusion Standard data for mubasher.aljazeera.net

Resource Scan

Scan Details

Site Domain mubasher.aljazeera.net
Base Domain aljazeera.net
Scan Status Ok
Last Scan2024-05-03T23:18:38+00:00
Next Scan 2024-05-17T23:18:38+00:00

Last Scan

Scanned2024-05-03T23:18:38+00:00
URL https://mubasher.aljazeera.net/robots.txt
Redirect https://www.aljazeeramubasher.net/robots.txt
Redirect Domain www.aljazeeramubasher.net
Redirect Base aljazeeramubasher.net
Domain IPs 104.83.197.149, 2600:1413:1:484::2392, 2600:1413:1:497::2392
Redirect IPs 125.56.219.42, 2600:1413:b000:1e::17d1:2e49, 2600:1413:b000:1e::17d1:2e5f, 96.17.72.72
Response IP 184.27.123.24
Found Yes
Hash ba2ffc66149171925c9578dec420fded41d0dedea5aad811e996164d438c108b
SimHash 400cce778493

Groups

*

Rule Path
Disallow /api
Disallow /asset-manifest.json
Allow /search/$
Disallow /search/
Disallow /home/search?q=

Other Records

Field Value
sitemap https://aljazeeramubasher.net/sitemap.xml
sitemap https://aljazeeramubasher.net/sitemaps/article-archive.xml
sitemap https://aljazeeramubasher.net/sitemaps/article-new.xml
sitemap https://aljazeeramubasher.net/sitemaps/video-archive.xml
sitemap https://aljazeeramubasher.net/sitemaps/video-new.xml