lavenderandmacarons.com
robots.txt

Robots Exclusion Standard data for lavenderandmacarons.com

Resource Scan

Scan Details

Site Domain lavenderandmacarons.com
Base Domain lavenderandmacarons.com
Scan Status Ok
Last Scan2024-06-13T06:01:56+00:00
Next Scan 2024-06-20T06:01:56+00:00

Last Scan

Scanned2024-06-13T06:01:56+00:00
URL https://lavenderandmacarons.com/robots.txt
Domain IPs 104.21.26.223, 172.67.139.119, 2606:4700:3030::ac43:8b77, 2606:4700:3034::6815:1adf
Response IP 104.21.26.223
Found Yes
Hash 746ab41e57283f018d5bfc4f06c0ae0b4a0f6868ce2c8f4e469ebdbc39004f04
SimHash e915ee62cb23

Groups

*

Rule Path
Allow /
Disallow *?utm_medium=*
Disallow *?utm_content=*
Disallow *?utm_source=*
Disallow *?replytocom*
Disallow *?s=*
Disallow /search*
Disallow *?p=*
Disallow *?q=*
Disallow /*/feed/*
Disallow /cdn-cgi*
Disallow /wp-json
Disallow /author/*
Disallow /tag/*
Disallow *?swcfpc=*
Disallow *?attachment_id*
Disallow /.well-known/*
Disallow *?srp*
Disallow *comment-page-*
Disallow *tiktok.com*
Disallow *yummly.com*
Disallow *surveymonkey.com*
Disallow *youtube.com*
Disallow *whirlpoolcorp.com*
Disallow *facebook.com*
Disallow *pinterest.com*
Disallow *?ssp_iabi=*
Disallow *?wordfence_lh=*
Disallow *wprm_print*

anthropicbot

Rule Path
Disallow /

claude

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Allow

ahrefssiteaudit

Rule Path
Allow

Other Records

Field Value
sitemap https://www.lavenderandmacarons.com/sitemap_index.xml