shutterchance.com
robots.txt

Robots Exclusion Standard data for shutterchance.com

Resource Scan

Scan Details

Site Domain shutterchance.com
Base Domain shutterchance.com
Scan Status Ok
Last Scan6/6/2025, 12:10:02 AM
Next Scan 7/6/2025, 12:10:02 AM

Last Scan

Scanned6/6/2025, 12:10:02 AM
URL https://shutterchance.com/robots.txt
Domain IPs 104.21.75.159, 172.67.178.185, 2606:4700:3035::ac43:b2b9, 2606:4700:3037::6815:4b9f
Response IP 104.21.75.159
Found Yes
Hash eb7ef864401362d08671d3f25bca8b0b548741ee867da36c22f3c28b70ea371f
SimHash 435ec8f5e1b1

Groups

*

Rule Path
Disallow /

google-image
yahoo-image
googlebot
google
bingbot
bing
twitterbot

Rule Path
Disallow /ajax/
Disallow /common/
Disallow /error_docs/
Disallow /php/
Disallow /subdomains/

Other Records

Field Value
crawl-delay 20

mj12bot
serpstatbot
mail.ru_bot
mail.ru
ahrefsbot

Rule Path
Disallow /ajax/
Disallow /common/
Disallow /error_docs/
Disallow /php/
Disallow /subdomains/

Other Records

Field Value
crawl-delay 30

facebookexternalhit

Rule Path
Disallow /ajax/
Disallow /common/
Disallow /error_docs/
Disallow /php/
Allow /subdomains/_*/photos/*/*.jpg$

Comments

  • Disallow: /*.jpg$
  • Disallow: /*.gif$