websitex5.com
robots.txt
Robots Exclusion Standard data for websitex5.com
Resource Scan
Scan Details
| Site Domain | websitex5.com |
| Base Domain | websitex5.com |
| Scan Status | Ok |
| Last Scan | 2025-11-30T21:55:09+00:00 |
| Next Scan | 2025-12-30T21:55:09+00:00 |
Last Scan
| Scanned | 2025-11-30T21:55:09+00:00 |
| URL | https://www.websitex5.com/robots.txt |
| Domain IPs | 104.21.94.212, 172.67.140.81, 2606:4700:3033::6815:5ed4, 2606:4700:3034::ac43:8c51 |
| Response IP | 172.67.140.81 |
| Found | Yes |
| Hash | 2191a4d97caeae125f85f60d005ba91d398eb967c774bf5d1479cf1371ad635a |
| SimHash | ec884734aee4 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /_new/ |
| Disallow | /affiliates/ |
| Disallow | /banner/ |
| Disallow | /changelog/ |
| Disallow | /forms/ |
| Disallow | /padfile/ |
| Disallow | /promo/ |
| Disallow | /register/ |
| Disallow | /resource/ |
| Disallow | /reviews/ |
| Disallow | /start/ |
| Disallow | /v8/ |
| Disallow | /it/admin |
| Disallow | /it/captcha |
| Disallow | /it/imemail |
| Disallow | /de/admin |
| Disallow | /de/captcha |
| Disallow | /de/imemail |
| Disallow | /en/admin |
| Disallow | /en/captcha |
| Disallow | /en/imemail |
| Disallow | /fr/admin |
| Disallow | /fr/captcha |
| Disallow | /fr/imemail |
| Disallow | /es/admin |
| Disallow | /es/captcha |
| Disallow | /es/imemail |
| Disallow | /br/admin |
| Disallow | /br/captcha |
| Disallow | /br/imemail |
| Disallow | /pl/admin |
| Disallow | /pl/captcha |
| Disallow | /pl/imemail |
| Disallow | /ru/admin |
| Disallow | /ru/captcha |
| Disallow | /ru/imemail |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.websitex5.com/Sitemap_Index.xml |
Comments