Log In Sign Up

weddingbee.com
robots.txt

Robots Exclusion Standard data for weddingbee.com

Resource Scan

Scan Details

Site Domain weddingbee.com
Base Domain weddingbee.com
Scan Status Ok
Last Scan2026-01-20T19:01:21+00:00
Next Scan 2026-01-27T19:01:21+00:00

Last Scan

Scanned2026-01-20T19:01:21+00:00
URL https://weddingbee.com/robots.txt
Redirect https://www.weddingbee.com/robots.txt
Redirect Domain www.weddingbee.com
Redirect Base weddingbee.com
Domain IPs 104.21.66.3, 172.67.167.202, 2606:4700:3030::6815:4203, 2606:4700:3031::ac43:a7ca
Redirect IPs 104.21.66.3, 172.67.167.202, 2606:4700:3030::6815:4203, 2606:4700:3031::ac43:a7ca
Response IP 172.67.167.202
Found Yes
Hash f651d1396a4859f4cf3be3921c80b9667f076cae337de3591313436931ff8b93
SimHash 620e1043a3a3

Groups

*

Rule Path
Disallow /2922/

discobot

Rule Path
Disallow /

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 0.5

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

boomtrain-content-bot*

Rule Path
Disallow
Allow /*

gptbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.weddingbee.com/sitemap_index.xml
Back to top

Comments

  • allow boomtrain bot on entire site
  • BEGIN XML-SITEMAP
  • END XML-SITEMAP
Back to top