weddingpaperdivas.com
robots.txt

Robots Exclusion Standard data for weddingpaperdivas.com

Resource Scan

Scan Details

Site Domain weddingpaperdivas.com
Base Domain weddingpaperdivas.com
Scan Status Ok
Last Scan2024-11-16T02:47:21+00:00
Next Scan 2024-11-23T02:47:21+00:00

Last Scan

Scanned2024-11-16T02:47:21+00:00
URL https://weddingpaperdivas.com/robots.txt
Redirect https://www.shutterfly.com/robots.txt
Redirect Domain www.shutterfly.com
Redirect Base shutterfly.com
Domain IPs 13.248.216.157, 76.223.88.49
Redirect IPs 23.208.169.161
Response IP 23.54.56.48
Found Yes
Hash d233bc1bd275b92c6e35f7b08b35633880977f72559c4930f42de476a80afcba
SimHash 644b1a35ad77

Groups

*

Rule Path
Disallow /account
Disallow /error
Disallow /secure
Disallow /help
Disallow /progal/album.jsp
Disallow /promos
Disallow /sitesearch
Disallow /c-s
Disallow /g/ts
Disallow /signin/
Disallow /_internal/
Disallow /about/emp_sub*
Disallow /page/
Disallow /br-cms-spa/
Disallow /seasonal-stop-emails/
Disallow /header
Disallow /footer
Disallow /ambassador
Disallow /ambassador-terms
Disallow /ambassador-signupform
Disallow /ambassador-success
Disallow /ambassador-participation
Disallow /c4p
Disallow /osc4p
Disallow /creationpath
Disallow /creationPath
Disallow /ssc
Disallow /action/welcome
Disallow /share/received

googlebot

Rule Path
Disallow /account/
Disallow /error/
Disallow /secure/
Disallow /help
Disallow /progal/album.jsp
Disallow /promos
Disallow /sitesearch
Disallow /c-s
Disallow /g/ts
Disallow /signin/
Disallow /c4p
Disallow /osc4p
Disallow /creationpath
Disallow /creationPath
Disallow /ssc
Disallow /action/welcome
Disallow /share/received
Disallow /specialOffers
Disallow /signup/
Disallow /page/
Disallow /br-cms-spa/
Disallow /seasonal-stop-emails/
Disallow /header
Disallow /footer
Disallow /ambassador
Disallow /ambassador-terms
Disallow /ambassador-signupform
Disallow /ambassador-success
Disallow /ambassador-participation

r6_feedfetcher

Rule Path
Disallow /

genieo

Rule Path
Disallow /

genieo

Rule Path
Disallow /

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1.0

deepcrawl

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.shutterfly.com/sitemap.xml
sitemap https://www.shutterfly.com/videositemap.xml
sitemap https://www.shutterfly.com/a/sitemap.xml

Comments

  • Tells Scanning shutterfly Robots Where They Are And Are Not Welcome
  • User-agent: can also specify by name; "*" is for everyone
  • Disallow: disallow if this matches first part of requested path
  • Disable click for prints
  • disable creation path crawling
  • do not allow shares to be indexed