pastem3u.com
robots.txt
Robots Exclusion Standard data for pastem3u.com
Resource Scan
Scan Details
| Site Domain | pastem3u.com |
| Base Domain | pastem3u.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-09-14T14:25:47+00:00 |
| Next Scan | 2024-12-13T14:25:47+00:00 |
Last Successful Scan
| Scanned | 2022-11-20T21:20:36+00:00 |
| URL | https://pastem3u.com/robots.txt |
| Redirect | https://www.pastem3u.com/robots.txt |
| Redirect Domain | www.pastem3u.com |
| Redirect Base | pastem3u.com |
| Response IP | 104.21.5.176, 172.67.133.174 |
| Found | Yes |
| Hash | 3a1f7fd6867a109196a4cac46a2933af747284b9d16f6e7c4bb1218ec03d55ec |
| SimHash | 49189862ce30 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search?updated-min= |
| Disallow | /search?updated-max= |
| Disallow | /search/label/*?updated-min= |
| Disallow | /search/label/*?updated-max= |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://pastem3u.com/sitemap.xml |