madnessporn.com
robots.txt
Robots Exclusion Standard data for madnessporn.com
Resource Scan
Scan Details
Site Domain | madnessporn.com |
Base Domain | madnessporn.com |
Scan Status | Ok |
Last Scan | 2024-04-29T04:39:06+00:00 |
Next Scan | 2024-05-29T04:39:06+00:00 |
Last Scan
Scanned | 2024-04-29T04:39:06+00:00 |
URL | https://madnessporn.com/robots.txt |
Domain IPs | 104.27.201.89, 104.27.202.89, 2606:4700:21::681b:c959, 2606:4700:21::681b:ca59 |
Response IP | 104.27.201.89 |
Found | Yes |
Hash | 9756f6b37eafb697c800da31bc89da488c880c96d93c9ca2f2614d2526127b87 |
SimHash | 795d8c84c013 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /cache/ |
Disallow | /content/ |
Disallow | /ftp_content/ |
Disallow | /ftp_photos/ |
Disallow | /actions.php* |
Disallow | /uploads-user/* |
Other Records
Field | Value |
---|---|
sitemap | https://madnessporn.com/sitemap.xml |