familydir.com
robots.txt

Robots Exclusion Standard data for familydir.com

Resource Scan

Scan Details

Site Domain familydir.com
Base Domain familydir.com
Scan Status Ok
Last Scan2024-11-07T07:56:04+00:00
Next Scan 2024-11-14T07:56:04+00:00

Last Scan

Scanned2024-11-07T07:56:04+00:00
URL https://familydir.com/robots.txt
Domain IPs 38.58.178.86
Response IP 38.58.178.86
Found Yes
Hash 82b9c6c7d2cfc632a2749290634a99f8cc86d4309d1624b102c78eebb0c065f8
SimHash 45d0c9d3427d

Groups

*

Rule Path
Disallow /*page
Disallow /*search
Disallow /*p%3D
Disallow /*gosearch.php
Disallow /*s%3D
Disallow /*id%3D
Disallow /*rss.php
Disallow /*sitemap.xml
Disallow /*sitemap.xml.gz
Disallow /*urllist.txt
Disallow /*?p=
Disallow /*?s=
Disallow /*?id=
Disallow /*cgi-bin/
Disallow /*cat_id
Disallow /*search.php?
Disallow /*%
Disallow /*submit.php
Disallow /*detail.php
Disallow /*details.php
Disallow /*details
Disallow /*detail
Disallow /*_1
Disallow /*_2
Disallow /*_3
Disallow /*_4
Disallow /*_5
Disallow /*_6
Disallow /*_7
Disallow /*_8
Disallow /*_9