juliasalbum.com
robots.txt

Robots Exclusion Standard data for juliasalbum.com

Resource Scan

Scan Details

Site Domain juliasalbum.com
Base Domain juliasalbum.com
Scan Status Ok
Last Scan2024-11-09T05:14:11+00:00
Next Scan 2024-11-16T05:14:11+00:00

Last Scan

Scanned2024-11-09T05:14:11+00:00
URL https://juliasalbum.com/robots.txt
Domain IPs 192.124.249.115
Response IP 192.124.249.115
Found Yes
Hash 2eff2f809eee4e95caae7215ff0e9b0a21599f45cdd87cd170a5f83e8e8f5516
SimHash 2c04dc820683

Groups

teoma

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

scrubby

Rule Path
Disallow /

robozilla

Rule Path
Disallow

nutch

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

asterias

Rule Path
Disallow /

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap http://juliasalbum.com/sitemap.xml