adelightfulglow.com
robots.txt

Robots Exclusion Standard data for adelightfulglow.com

Resource Scan

Scan Details

Site Domain adelightfulglow.com
Base Domain adelightfulglow.com
Scan Status Ok
Last Scan2024-11-08T05:23:21+00:00
Next Scan 2024-11-15T05:23:21+00:00

Last Scan

Scanned2024-11-08T05:23:21+00:00
URL https://adelightfulglow.com/robots.txt
Domain IPs 104.21.26.68, 172.67.135.152
Response IP 104.21.26.68
Found Yes
Hash d8026a068f748a8ea959175d614020c732051790c343baf76fd6ebe8922a864f
SimHash 77085c8601f1

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

*

Rule Path
Disallow /cgi-bin
Disallow /trackback
Disallow /*/trackback
Disallow /comment
Disallow /comments
Disallow /wp-login.php
Disallow /xmlrpc.php

*

Rule Path
Disallow /*.php$
Disallow /*.inc$
Disallow /*.cgi$
Disallow /*.xhtml$
Disallow /*.xlsx$
Disallow /*.doc$
Disallow /*.pdf$
Disallow /*.zip$

Other Records

Field Value
sitemap https://adelightfulglow.com/sitemap.xml