sweetbabyname.com
robots.txt

Robots Exclusion Standard data for sweetbabyname.com

Resource Scan

Scan Details

Site Domain sweetbabyname.com
Base Domain sweetbabyname.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2026-01-13T18:42:37+00:00
Next Scan 2026-04-13T18:42:37+00:00

Last Successful Scan

Scanned2025-03-20T08:38:23+00:00
URL https://sweetbabyname.com/robots.txt
Domain IPs 172.96.186.147
Response IP 172.96.186.147
Found Yes
Hash 9922d449fdd723f03a228a26ba7a41792261fc9bfe34ac6c6096920564a9d905
SimHash 6800181047b3

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://sweetbabyname.com/sitemap_index.xml