goodnightsleepsite.com
robots.txt

Robots Exclusion Standard data for goodnightsleepsite.com

Resource Scan

Scan Details

Site Domain goodnightsleepsite.com
Base Domain goodnightsleepsite.com
Scan Status Ok
Last Scan2026-02-06T11:34:01+00:00
Next Scan 2026-03-08T11:34:01+00:00

Last Scan

Scanned2026-02-06T11:34:01+00:00
URL https://goodnightsleepsite.com/robots.txt
Domain IPs 34.69.59.42
Response IP 34.69.59.42
Found Yes
Hash 5e2bb9117f10742a0d8d0f5411b55f6e2072a74ef64b20ef3f06134b7042c913
SimHash 3d0c12775b75

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Allow */wp-admin/admin-ajax.php
Disallow */wp-content/plugins/
Disallow */wp-admin/
Disallow */wp-includes/
Disallow */readme.html
Disallow */license.txt
Disallow */xmlrpc.php
Disallow */wp-login.php
Disallow */wp-register.php

Other Records

Field Value
sitemap https://goodnightsleepsite.com/post-sitemap.xml
sitemap https://goodnightsleepsite.com/page-sitemap.xml
sitemap https://goodnightsleepsite.com/product-sitemap.xml
sitemap https://goodnightsleepsite.com/category-sitemap.xml
sitemap https://goodnightsleepsite.com/post_tag-sitemap.xml
sitemap https://goodnightsleepsite.com/product_cat-sitemap.xml
sitemap https://goodnightsleepsite.com/author-sitemap.xml

Warnings

  • `noindex` is not a known field.