dailydoll.shop
robots.txt

Robots Exclusion Standard data for dailydoll.shop

Resource Scan

Scan Details

Site Domain dailydoll.shop
Base Domain dailydoll.shop
Scan Status Ok
Last Scan2024-05-23T09:15:49+00:00
Next Scan 2024-06-22T09:15:49+00:00

Last Scan

Scanned2024-05-23T09:15:49+00:00
URL https://dailydoll.shop/robots.txt
Domain IPs 104.26.4.7, 104.26.5.7, 172.67.71.57, 2606:4700:20::681a:407, 2606:4700:20::681a:507, 2606:4700:20::ac43:4739
Response IP 172.67.71.57
Found Yes
Hash 38c15453e7d2e22ac18ec235c73847dc587e2c4e52bdf2a5cceff32bfbc56f8d
SimHash 05198ea2e6f7

Groups

*

Rule Path
Disallow /wp-
Disallow /?
Disallow /*?
Disallow /%26
Disallow /*%26
Disallow /author/
Disallow /embed
Disallow /page/
Disallow /trackback
Allow /uploads/2022
Allow /uploads/2023
Allow /*.js
Allow /*.css
Allow /wp-*.png
Allow /wp-*.jpg
Allow /wp-*.jpeg
Allow /wp-*.gif
Allow /wp-*.svg
Allow /wp-admin/admin-ajax.php
Disallow /wishlist/
Disallow /cart/
Disallow /my-account/

Other Records

Field Value
crawl-delay 90

Other Records

Field Value
sitemap https://dailydoll.shop/sitemap.xml