blog.littlesun.com
robots.txt

Robots Exclusion Standard data for blog.littlesun.com

Resource Scan

Scan Details

Site Domain blog.littlesun.com
Base Domain littlesun.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-10-01T15:21:37+00:00
Next Scan 2025-12-30T15:21:37+00:00

Last Successful Scan

Scanned2022-02-02T18:57:06+00:00
URL https://blog.littlesun.com/robots.txt
Response IP 74.114.154.18
Found Yes
Hash 1c9be23db9ba64bff3810735c08a2fd0afe50f52f0f4c55f4d03ab8ea3ef5bdb
SimHash 6b059864ceb2

Groups

*

Rule Path
Disallow /random
Disallow /day
Disallow /sticky-ad-iframe.html
Disallow /privacy/consent

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://blog.littlesun.com/sitemap.xml