xetot.me
robots.txt
Robots Exclusion Standard data for xetot.me
Resource Scan
Scan Details
| Site Domain | xetot.me |
| Base Domain | xetot.me |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-09-17T18:26:44+00:00 |
| Next Scan | 2024-12-16T18:26:44+00:00 |
Last Successful Scan
| Scanned | 2023-08-24T19:52:33+00:00 |
| URL | https://xetot.me/robots.txt |
| Domain IPs | 104.21.18.241, 172.67.183.234, 2606:4700:3033::ac43:b7ea, 2606:4700:3036::6815:12f1 |
| Response IP | 172.67.183.234 |
| Found | Yes |
| Hash | 407a7ddc3f9a6c6d328e79bddcf5c16c5d76e4373b907e8e0c36a7b023122f25 |
| SimHash | 20551c41d381 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */page/* |
| Disallow | *?fbclid=* |
| Disallow | /?s=* |
| Disallow | /login/ |
| Disallow | *?fb_comment_id=* |
| Disallow | *?sort=new |
| Disallow | *?sort=popular |
| Allow | /*.js$ |
| Allow | /*.css$ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://xetot.me/sitemap.xml |