photobiz.com
robots.txt

Robots Exclusion Standard data for photobiz.com

Resource Scan

Scan Details

Site Domain photobiz.com
Base Domain photobiz.com
Scan Status Ok
Last Scan2024-09-09T08:56:22+00:00
Next Scan 2024-10-09T08:56:22+00:00

Last Scan

Scanned2024-09-09T08:56:22+00:00
URL https://photobiz.com/robots.txt
Redirect https://www.photobiz.com/robots.txt
Redirect Domain www.photobiz.com
Redirect Base photobiz.com
Domain IPs 18.235.135.157
Redirect IPs 18.235.135.157
Response IP 18.235.135.157
Found Yes
Hash 638cd7432d1c43d603d87b80e61b6ddfa3aac129457280e094b8fadb08746ece
SimHash 114cc85cc393

Groups

googlebot

Rule Path
Allow *.css
Allow *.js

twitterbot

Rule Path
Disallow

facebookexternalhit

Rule Path
Disallow

archive.org_bot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

aboundex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

deusu

Rule Path
Disallow /

*

Rule Path
Disallow /ajax/
Disallow /cart/
Disallow /cfdocs/
Disallow /CFIDE/
Disallow /global/
Disallow /image*/
Disallow /includes/
Disallow /js/
Disallow /controlpanel/
Disallow /corporate/
Disallow /emailsupport/
Disallow /photobizadmin/
Disallow /pbadmin/
Disallow /music/
Disallow /xml/
Disallow /portfolio/
Disallow /fckeditor/
Disallow /movies/
Disallow /qacontrol/
Disallow /billing/
Disallow /fonts/
Disallow /viewing/
Disallow /store/share.cfm

Other Records

Field Value
crawl-delay 60

Other Records

Field Value
sitemap http://www.photobiz.com/sitemap.xml