alrai.com
robots.txt

Robots Exclusion Standard data for alrai.com

Resource Scan

Scan Details

Site Domain alrai.com
Base Domain alrai.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-04-06T02:54:44+00:00
Next Scan 2024-07-05T02:54:44+00:00

Last Successful Scan

Scanned2023-06-08T16:35:12+00:00
URL https://alrai.com/robots.txt
Domain IPs 104.26.14.242, 104.26.15.242, 172.67.69.237, 2606:4700:20::681a:ef2, 2606:4700:20::681a:ff2, 2606:4700:20::ac43:45ed
Response IP 104.26.14.242
Found Yes
Hash a2f346608ea24f0807b4c09a1a529d8242ace3518f4ffb41d9f9bca4275e3490
SimHash b1ed78cf6abc

Groups

*

Rule Path
Disallow /ajax/*
Disallow /print*
Disallow /getRelatedArticles*
Disallow /getMostReadArticles*
Disallow /article_count/*
Disallow /get-menu-header*
Disallow /search*
Disallow /morearticles/*
Disallow /article.php*
Disallow /login-mgt
Disallow /*.php
Disallow /archive/*
Disallow /rss
Disallow /rssFeed/*
Disallow /widget/*
Disallow */page/*