grusty.net
robots.txt
Robots Exclusion Standard data for grusty.net
Resource Scan
Scan Details
| Site Domain | grusty.net |
| Base Domain | grusty.net |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2024-09-24T10:09:57+00:00 |
| Next Scan | 2024-11-23T10:09:57+00:00 |
Last Successful Scan
| Scanned | 2024-07-27T10:09:12+00:00 |
| URL | https://grusty.net/robots.txt |
| Redirect | https://negrusty.pro/robots.txt |
| Redirect Domain | negrusty.pro |
| Redirect Base | negrusty.pro |
| Domain IPs | 158.160.37.235 |
| Redirect IPs | 158.160.37.235 |
| Response IP | 158.160.37.235 |
| Found | Yes |
| Hash | d434617f7f2f03f70c253c24660feae295830ae2955834f951bda4f5a8bcb8b5 |
| SimHash | 6bfedac6bb15 |
Groups
googlebot
| Rule | Path |
|---|---|
| Disallow | /index.php |
| Disallow | /user |
| Disallow | /devel |
| Disallow | /search |
| Disallow | /node |
*
| Rule | Path |
|---|---|
| Disallow | /index.php |
| Disallow | /user |
| Disallow | /devel |
| Disallow | /search |
| Disallow | /node |
| Disallow | *_gl%3D |
| Disallow | *_ga%3D |
| Disallow | *_wrapper_format%3D |
| Disallow | /?amp$ |
| Disallow | *search_api_fulltext%3D |
| Disallow | /*amp_lite%3D |
| Disallow | /*route%3D |
| Disallow | /*email%3D |
| Disallow | /*from%3D |
| Disallow | /*fullscreen%3D |
| Disallow | /*next%3D |
| Disallow | /*vid%3D |
| Disallow | /*cid%3D |
| Disallow | /*id%3D |
| Disallow | /*uid%3D |
| Disallow | *from%3D |
| Disallow | *openstat%3D |
| Disallow | *utm*%3D |
| Disallow | *matchtype%3D |
| Disallow | *network%3D |
| Disallow | *device%3D |
| Disallow | *creative%3D |
| Disallow | *keyword%3D |
| Disallow | *placement%3D |
| Disallow | *adposition%3D |
Other Records
| Field | Value |
|---|---|
| sitemap | https://negrusty.pro/sitemap.xml |
| sitemap | https://negrusty.pro/sitemap-fast.xml |
Warnings
- `clean-param` is not a known field.