families.com
robots.txt

Robots Exclusion Standard data for families.com

Resource Scan

Scan Details

Site Domain families.com
Base Domain families.com
Scan Status Ok
Last Scan2024-11-12T09:25:26+00:00
Next Scan 2024-11-19T09:25:26+00:00

Last Scan

Scanned2024-11-12T09:25:26+00:00
URL https://families.com/robots.txt
Redirect https://www.families.com/robots.txt
Redirect Domain www.families.com
Redirect Base families.com
Domain IPs 50.28.76.14
Redirect IPs 50.28.76.14
Response IP 50.28.76.14
Found Yes
Hash fca50bb31629d2921d134efb36f39f99884b521ac45bee966ad5da82ddec6a9c
SimHash 6510cd5061b5

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 500