hdfilmsurge.com
robots.txt
Robots Exclusion Standard data for hdfilmsurge.com
Resource Scan
Scan Details
| Site Domain | hdfilmsurge.com |
| Base Domain | hdfilmsurge.com |
| Scan Status | Ok |
| Last Scan | 2024-11-10T12:08:53+00:00 |
| Next Scan | 2024-11-17T12:08:53+00:00 |
Last Scan
| Scanned | 2024-11-10T12:08:53+00:00 |
| URL | https://hdfilmsurge.com/robots.txt |
| Redirect | https://www.hdfilmsurge.com/robots.txt |
| Redirect Domain | www.hdfilmsurge.com |
| Redirect Base | hdfilmsurge.com |
| Domain IPs | 104.26.8.20, 104.26.9.20, 172.67.73.114, 2606:4700:20::681a:814, 2606:4700:20::681a:914, 2606:4700:20::ac43:4972 |
| Redirect IPs | 104.26.8.20, 104.26.9.20, 172.67.73.114, 2606:4700:20::681a:814, 2606:4700:20::681a:914, 2606:4700:20::ac43:4972 |
| Response IP | 172.67.73.114 |
| Found | Yes |
| Hash | 1953227ee99dc66fc57f9ca9e00851ac0b2bc35533f8d1876ed97daf8309810f |
| SimHash | 390da4707933 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /engine/go.php |
| Disallow | /engine/download.php |
| Disallow | /user/ |
| Disallow | /newposts/ |
| Disallow | /statistics.html |
| Disallow | /*subaction%3Duserinfo |
| Disallow | /*subaction%3Dnewposts |
| Disallow | /*do%3Dlastcomments |
| Disallow | /*do%3Dfeedback |
| Disallow | /*do%3Dregister |
| Disallow | /*do%3Dlostpassword |
| Disallow | /*do%3Daddnews |
| Disallow | /*do%3Dstats |
| Disallow | /*do%3Dpm |
| Disallow | /*do%3Dsearch |
| Disallow | /mobile/ |
| Disallow | /m/ |
| Disallow | /favorites/ |
| Disallow | /load/compilations/page/ |
| Disallow | /index.php |
| Disallow | /iframeNew.html |
| Disallow | /actors/ |
| Disallow | /directors/ |
Warnings
- `host` is not a known field.