italian-milfs.com
robots.txt
Robots Exclusion Standard data for italian-milfs.com
Resource Scan
Scan Details
Site Domain | italian-milfs.com |
Base Domain | italian-milfs.com |
Scan Status | Ok |
Last Scan | 2024-10-28T00:00:43+00:00 |
Next Scan | 2024-11-27T00:00:43+00:00 |
Last Scan
Scanned | 2024-10-28T00:00:43+00:00 |
URL | https://italian-milfs.com/robots.txt |
Domain IPs | 108.157.254.122, 108.157.254.13, 108.157.254.45, 108.157.254.65 |
Response IP | 108.157.254.122 |
Found | Yes |
Hash | 2d261956c6e3487552f08720a277d57c6b25dfbe437aaa7509266086c128666d |
SimHash | 2b12f70bac68 |
Groups
*
Rule | Path |
---|---|
Disallow | |
Disallow | /campaign/* |
Disallow | /support |
Disallow | /terms |
Disallow | /privacy |
Disallow | /imprint |
Disallow | /login |
Disallow | /ajax |
Disallow | /form/* |
Disallow | /profileadvertising |
Disallow | /network |
Disallow | /cookies |
Disallow | /remarketing |