steamlevelu.com
robots.txt
Robots Exclusion Standard data for steamlevelu.com
Resource Scan
Scan Details
| Site Domain | steamlevelu.com |
| Base Domain | steamlevelu.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-08-15T06:21:55+00:00 |
| Next Scan | 2024-11-13T06:21:55+00:00 |
Last Successful Scan
| Scanned | 2023-12-27T05:02:45+00:00 |
| URL | https://steamlevelu.com/robots.txt |
| Domain IPs | 104.26.4.123, 104.26.5.123, 172.67.73.218, 2606:4700:20::681a:47b, 2606:4700:20::681a:57b, 2606:4700:20::ac43:49da |
| Response IP | 104.26.5.123 |
| Found | Yes |
| Hash | 8a8b55c463e4c5ee058c27d23bbbf2216f76fdb2a28a4796b00f857d88f73dd1 |
| SimHash | 4c09cc43a5b0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /index.php |
| Disallow | /*openstat* |
| Disallow | /*utm* |
| Disallow | /*gclid* |
| Disallow | *.swf |
| Disallow | /*page* |
| Disallow | */p/* |
| Disallow | */?ref=* |
| Disallow | */offers |
| Disallow | */offers |
| Disallow | */profile |
| Disallow | */giveaway |
| Disallow | */socket.io/* |
| Disallow | */?EIO=* |
| Disallow | */*?ref=* |
| Disallow | */secretadminpage/ |
| Disallow | */api/* |
yandex
| Rule | Path |
|---|---|
| Disallow | /index.php |
| Disallow | /*openstat* |
| Disallow | /*utm* |
| Disallow | /*gclid* |
| Disallow | *.swf |
| Disallow | /*page* |
| Disallow | */p/* |
| Disallow | */?ref=* |
| Disallow | */offers |
| Disallow | */profile |
| Disallow | */giveaway |
| Disallow | */socket.io/* |
| Disallow | */?EIO=* |
| Disallow | */*?ref=* |
| Disallow | */secretadminpage/ |
| Disallow | */api/* |
googlebot
| Rule | Path |
|---|---|
| Disallow | /index.php |
| Disallow | /*openstat* |
| Disallow | /*utm* |
| Disallow | /*gclid* |
| Disallow | *.swf |
| Disallow | /*page* |
| Disallow | */p/* |
| Disallow | */?ref=* |
| Disallow | */offers |
| Disallow | */profile |
| Disallow | */giveaway |
| Disallow | */socket.io/* |
| Disallow | */?EIO=* |
| Disallow | */*?ref=* |
| Disallow | */secretadminpage/ |
| Disallow | */api/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://steamlevelu.com/sitemap.xml |
Warnings
- `host` is not a known field.