istockdiary.com
robots.txt

Robots Exclusion Standard data for istockdiary.com

Resource Scan

Scan Details

Site Domain istockdiary.com
Base Domain istockdiary.com
Scan Status Ok
Last Scan2025-07-11T19:37:41+00:00
Next Scan 2025-07-25T19:37:41+00:00

Last Scan

Scanned2025-07-11T19:37:41+00:00
URL https://istockdiary.com/robots.txt
Redirect https://www.vectordiary.com/robots.txt
Redirect Domain www.vectordiary.com
Redirect Base vectordiary.com
Domain IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Redirect IPs 104.21.85.60, 172.67.203.9, 2606:4700:3033::ac43:cb09, 2606:4700:3035::6815:553c
Response IP 104.21.85.60
Found Yes
Hash 29d8bf51971b02a8f62170f5ca9a045ea973e9cbc0c92293d1abd7e2510da61a
SimHash 6b1c6b13f320

Groups

*

Rule Path
Disallow /go/
Disallow /cgi-bin/
Disallow /z/j/
Disallow /z/c/
Disallow /stats/
Disallow /dh_
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /contact/
Disallow /tag/
Disallow /wp-content/b
Disallow /wp-content/p
Disallow /wp-content/themes/askapache/4
Disallow /wp-content/themes/askapache/c
Disallow /wp-content/themes/askapache/d
Disallow /wp-content/themes/askapache/f
Disallow /wp-content/themes/askapache/h
Disallow /wp-content/themes/askapache/in
Disallow /wp-content/themes/askapache/p
Disallow /wp-content/themes/askapache/s
Disallow /trackback/
Disallow /*?*
Disallow */trackback/
Disallow */isd_premium/

googlebot

Rule Path
Disallow /*.php$
Disallow /*.js$
Disallow /*.inc$
Disallow /*.css$
Disallow /*.gz$
Disallow /*.cgi$
Disallow /*.wmv$
Disallow /*.png$
Disallow /*.gif$
Disallow /*.jpg$
Disallow /*.cgi$
Disallow /*.xhtml$
Disallow /*.php*
Disallow */trackback*
Disallow /*?*
Disallow /z/
Disallow /wp-*
Allow /wp-content/uploads/

googlebot-image

Rule Path
Allow /*

mediapartners-google*

Rule Path
Disallow /*?*
Allow /z/
Allow /about/
Allow /contact/
Allow /wp-content/
Allow /tag/
Allow /manual/*
Allow /docs/*
Allow /*.php$
Allow /*.js$
Allow /*.inc$
Allow /*.css$
Allow /*.gz$
Allow /*.cgi$
Allow /*.wmv$
Allow /*.cgi$
Allow /*.xhtml$
Allow /*.php*
Allow /*.gif$
Allow /*.jpg$
Allow /*.png$

ia_archiver

Rule Path
Disallow /

duggmirror

Rule Path
Disallow /

Comments

  • disallow all files in these directories
  • disallow all files ending with these extensions
  • allow google image bot to search all images
  • allow adsense bot on entire site
  • disallow archiving site
  • disable duggmirror