cwmods.com
robots.txt
Robots Exclusion Standard data for cwmods.com
Resource Scan
Scan Details
Site Domain | cwmods.com |
Base Domain | cwmods.com |
Scan Status | Ok |
Last Scan | 2024-11-01T23:09:49+00:00 |
Next Scan | 2024-11-08T23:09:49+00:00 |
Last Scan
Scanned | 2024-11-01T23:09:49+00:00 |
URL | https://cwmods.com/robots.txt |
Domain IPs | 104.21.41.4, 172.67.141.31 |
Response IP | 104.21.41.4 |
Found | Yes |
Hash | 20d7f0537f399b724d85b29e37407d79c037ca6c247ece8e203ef2bac76bf827 |
SimHash | 7cb11110a382 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /images/ |
Disallow | /forums/images/ |
Disallow | /forums/newreply.php |
Disallow | /forums/editpost.php |
Disallow | /forums/newthread.php |
Disallow | /forums/online.php |
Disallow | /forums/private.php |
Disallow | /forums/avatar.php |
Disallow | /downloads/upload.php |
Disallow | /downloads/editfile.php |
Disallow | /downloads/editcomment.php |
Disallow | /downloads/upload-update.php |
Disallow | /downloads/filecpl.php |
Disallow | /downloads/dl.php |
Disallow | /downloads/download.php |
Disallow | /downloads/getfile.php |
Disallow | /downloads/downloads.php |
Disallow | /ads/ |