aryeb.com
robots.txt
Robots Exclusion Standard data for aryeb.com
Resource Scan
Scan Details
Site Domain | aryeb.com |
Base Domain | aryeb.com |
Scan Status | Ok |
Last Scan | 2025-05-30T13:01:31+00:00 |
Next Scan | 2025-06-29T13:01:31+00:00 |
Last Scan
Scanned | 2025-05-30T13:01:31+00:00 |
URL | https://aryeb.com/robots.txt |
Redirect | https://www.aryeb.com/robots.txt |
Redirect Domain | www.aryeb.com |
Redirect Base | aryeb.com |
Domain IPs | 192.250.235.94 |
Redirect IPs | 192.250.235.94 |
Response IP | 192.250.235.94 |
Found | Yes |
Hash | 9536a69f45ed3563febfecbb69cbe8e535daaa0e7a004b8d213ac438770f915a |
SimHash | 2fc459166996 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /temp/ |
Disallow | /db_backup/ |
Disallow | /periodic.php |
Disallow | /favorites.php |
Disallow | /feed.php |
Disallow | /login.php |
Disallow | /logout.php |
Disallow | /mailto.php |
Disallow | /reply.php |
Disallow | /report.php |
Disallow | /access_restricted.php |
Disallow | /not_authorized.php |
Disallow | /offline.php |