raya.com
robots.txt
Robots Exclusion Standard data for raya.com
Resource Scan
Scan Details
| Site Domain | raya.com |
| Base Domain | raya.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2026-02-09T02:16:56+00:00 |
| Next Scan | 2026-02-23T02:16:56+00:00 |
Last Successful Scan
| Scanned | 2026-01-24T05:17:12+00:00 |
| URL | https://raya.com/robots.txt |
| Redirect | https://www.raya.com/robots.txt |
| Redirect Domain | www.raya.com |
| Redirect Base | raya.com |
| Domain IPs | 104.26.4.250, 104.26.5.250, 172.67.75.93, 2606:4700:20::681a:4fa, 2606:4700:20::681a:5fa, 2606:4700:20::ac43:4b5d |
| Redirect IPs | 104.26.4.250, 104.26.5.250, 172.67.75.93, 2606:4700:20::681a:4fa, 2606:4700:20::681a:5fa, 2606:4700:20::ac43:4b5d |
| Response IP | 104.26.4.250 |
| Found | Yes |
| Hash | 0aee6566a949a9f3ae3e790f6663289b67ea64470cb24ee449862da8e2ad6e20 |
| SimHash | 900dda316eb8 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /ajax/* |
| Disallow | /ajax* |
| Disallow | /print* |
| Disallow | /getRelatedArticles* |
| Disallow | /getMostReadArticles* |
| Disallow | /article_count/* |
| Disallow | /get-menu-header* |
| Disallow | /article.php* |
| Disallow | /login-mgt |
| Disallow | /*.php |
| Disallow | /widget/* |
| Disallow | /?page= |
| Disallow | /test-ads |
| Disallow | /api/* |
| Disallow | /redirect-email* |
*
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
Comments