malaymail.com
robots.txt

Robots Exclusion Standard data for malaymail.com

Resource Scan

Scan Details

Site Domain malaymail.com
Base Domain malaymail.com
Scan Status Ok
Last Scan2024-11-03T04:21:36+00:00
Next Scan 2024-11-10T04:21:36+00:00

Last Scan

Scanned2024-11-03T04:21:36+00:00
URL https://malaymail.com/robots.txt
Redirect https://www.malaymail.com/robots.txt
Redirect Domain www.malaymail.com
Redirect Base malaymail.com
Domain IPs 104.26.8.244, 104.26.9.244, 172.67.68.92, 2606:4700:20::681a:8f4, 2606:4700:20::681a:9f4, 2606:4700:20::ac43:445c
Redirect IPs 104.26.8.244, 104.26.9.244, 172.67.68.92, 2606:4700:20::681a:8f4, 2606:4700:20::681a:9f4, 2606:4700:20::ac43:445c
Response IP 172.67.68.92
Found Yes
Hash 4823febc164a9fac67dcd09960e15c57b421a140bea665a3e8db977f833dc63c
SimHash 912d78476fde

Groups

*

Rule Path
Disallow /ajax/*
Disallow /print*
Disallow /getRelatedArticles*
Disallow /getMostReadArticles*
Disallow /article_count/*
Disallow /get-menu-header*
Disallow /search*
Disallow /morearticles/*
Disallow /article.php*
Disallow /login-mgt
Disallow /*.php
Disallow /archive/*
Disallow /widget/*
Disallow */page/*
Disallow /test/
Disallow /test*

grapeshot

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.malaymail.com/sitemap.xml