shahed4u.diy
robots.txt
Robots Exclusion Standard data for shahed4u.diy
Resource Scan
Scan Details
| Site Domain | shahed4u.diy |
| Base Domain | shahed4u.diy |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-04-09T23:39:11+00:00 |
| Next Scan | 2025-04-16T23:39:11+00:00 |
Last Successful Scan
| Scanned | 2025-03-09T23:28:16+00:00 |
| URL | https://shahed4u.diy/robots.txt |
| Redirect | https://shid4u.net/robots.txt |
| Redirect Domain | shid4u.net |
| Redirect Base | shid4u.net |
| Domain IPs | 104.21.85.176, 172.67.208.174, 2606:4700:3030::6815:55b0, 2606:4700:3035::ac43:d0ae |
| Redirect IPs | 104.26.0.96, 104.26.1.96, 172.67.71.146, 2606:4700:20::681a:160, 2606:4700:20::681a:60, 2606:4700:20::ac43:4792 |
| Response IP | 172.67.71.146 |
| Found | Yes |
| Hash | d453cac39e31b5516b5265fbd872eaebd6bbb225bce4d7e378a40af77f93bf0e |
| SimHash | 281819048931 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /download/* |
| Disallow | /data_provider/* |
| Disallow | /server/* |
| Disallow | /director/* |
| Disallow | /writer/* |
| Disallow | /actor/* |
| Disallow | /release-year/* |
| Disallow | /quality/* |
| Disallow | /watch/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://shid4u.net/sitemap.xml |
| sitemap | https://shid4u.net/sitemap-category.xml |
| sitemap | https://shid4u.net/sitemap-daily-posts.xml |