familytoday.com
robots.txt
Robots Exclusion Standard data for familytoday.com
Resource Scan
Scan Details
Site Domain | familytoday.com |
Base Domain | familytoday.com |
Scan Status | Ok |
Last Scan | 2024-11-09T21:23:17+00:00 |
Next Scan | 2024-11-16T21:23:17+00:00 |
Last Scan
Scanned | 2024-11-09T21:23:17+00:00 |
URL | https://familytoday.com/robots.txt |
Redirect | https://www.familytoday.com/robots.txt |
Redirect Domain | www.familytoday.com |
Redirect Base | familytoday.com |
Domain IPs | 34.208.114.174 |
Redirect IPs | 192.229.237.241 |
Response IP | 192.229.237.241 |
Found | Yes |
Hash | 8db2dff0e5de88909452942d1d05573a3fec65c9316ccecd45a6ee808bb59e03 |
SimHash | 38445044df51 |
Groups
*
Rule | Path |
---|---|
Disallow | /test/* |
Disallow | /directory/* |
Disallow | /29966721/FAMILYTODAY/* |
Disallow | /sitecore/* |
Disallow | /coupled |
Disallow | /ftapi/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.familytoday.com/familytoday_sitemap.xml.gz |