familydir.com
robots.txt
Robots Exclusion Standard data for familydir.com
Resource Scan
Scan Details
Site Domain | familydir.com |
Base Domain | familydir.com |
Scan Status | Ok |
Last Scan | 2024-11-07T07:56:04+00:00 |
Next Scan | 2024-11-14T07:56:04+00:00 |
Last Scan
Scanned | 2024-11-07T07:56:04+00:00 |
URL | https://familydir.com/robots.txt |
Domain IPs | 38.58.178.86 |
Response IP | 38.58.178.86 |
Found | Yes |
Hash | 82b9c6c7d2cfc632a2749290634a99f8cc86d4309d1624b102c78eebb0c065f8 |
SimHash | 45d0c9d3427d |
Groups
*
Rule | Path |
---|---|
Disallow | /*page |
Disallow | /*search |
Disallow | /*p%3D |
Disallow | /*gosearch.php |
Disallow | /*s%3D |
Disallow | /*id%3D |
Disallow | /*rss.php |
Disallow | /*sitemap.xml |
Disallow | /*sitemap.xml.gz |
Disallow | /*urllist.txt |
Disallow | /*?p= |
Disallow | /*?s= |
Disallow | /*?id= |
Disallow | /*cgi-bin/ |
Disallow | /*cat_id |
Disallow | /*search.php? |
Disallow | /*% |
Disallow | /*submit.php |
Disallow | /*detail.php |
Disallow | /*details.php |
Disallow | /*details |
Disallow | /*detail |
Disallow | /*_1 |
Disallow | /*_2 |
Disallow | /*_3 |
Disallow | /*_4 |
Disallow | /*_5 |
Disallow | /*_6 |
Disallow | /*_7 |
Disallow | /*_8 |
Disallow | /*_9 |