youfeed.it
robots.txt
Robots Exclusion Standard data for youfeed.it
Resource Scan
Scan Details
Site Domain | youfeed.it |
Base Domain | youfeed.it |
Scan Status | Ok |
Last Scan | 2024-11-15T07:34:54+00:00 |
Next Scan | 2024-11-22T07:34:54+00:00 |
Last Scan
Scanned | 2024-11-15T07:34:54+00:00 |
URL | https://youfeed.it/robots.txt |
Domain IPs | 104.21.29.106, 172.67.171.115, 2606:4700:3034::ac43:ab73, 2606:4700:3035::6815:1d6a |
Response IP | 104.21.29.106 |
Found | Yes |
Hash | 94d4cf5f98c65fa2bad4318b793a7da1576ff2653f988dbbdd21636db7e98b37 |
SimHash | 174819555a23 |
Groups
*
Rule | Path |
---|---|
Disallow | |
Disallow | /go/ |
Disallow | /trck/ |
Disallow | /*shedir-pharma |
Disallow | /*shedirpharma |
Disallow | /*pedof |
Disallow | /*pedop |
Disallow | /*pedo- |
Disallow | /*porn |
Disallow | /cerca/*lauro-buoro* |
Disallow | /search/*pussy |
Disallow | /search/*-vona-costruzioni* |
Disallow | /search/vona-costruzioni* |
Disallow | /search/*massimo-dolce* |
Disallow | /search/*marco-bernardini* |
Disallow | /search/*saverio-fatone* |
Disallow | /search/*malato* |
Disallow | /search/*malata* |
Disallow | /search/*malattia* |
Disallow | /search/*tumore* |
Other Records
Field | Value |
---|---|
sitemap | http://www.youfeed.it/img/maps/index.xml |
Comments