loff.it
robots.txt

Robots Exclusion Standard data for loff.it

Resource Scan

Scan Details

Site Domain loff.it
Base Domain loff.it
Scan Status Ok
Last Scan2024-10-22T09:13:25+00:00
Next Scan 2024-11-21T09:13:25+00:00

Last Scan

Scanned2024-10-22T09:13:25+00:00
URL https://loff.it/robots.txt
Domain IPs 159.69.147.179
Response IP 159.69.147.179
Found Yes
Hash 671b1535fe7d19f847d17c3d3babbc1c13cf76cb76baf3bd644e09059c0437c6
SimHash ab40ce908ab1

Groups

*
googlebot-news
googlebot-image
googlebot-video
*

Rule Path
Allow /wp-content/uploads/*
Allow /wp-content/uploads/$
Disallow /wp-content/themes/
Disallow /wp-includes/
Disallow /wp-admin/
Disallow /wp-
Disallow /?s=
Disallow /search
Allow /sitemaps/$
Allow /wp-content/plugins/*
Allow /wp-content/themes/loffit_v6/*
Allow /wp-content/themes/loffit_v6_s/*
Allow /wp-content/themes/loffit_v6_s/js/*
Allow /wp-content/themes/loffit_v6_s/$
Allow /wp-content/themes/loffit_v62_s/*
Allow /wp-content/themes/loffit_v62_s/js/*
Allow /wp-content/themes/loffit_v62_s/$
Allow /wp-content/js/*
Allow /wp-includes/js/*
Allow /wp-content/plugins/bwp-minify/min/*
Allow /wp-content/plugins/jetpack/modules/photon/*
Allow /wp-content/plugins/wp-email/*
Allow /wp-includes/js/jquery/*
Allow /wp-content/plugins/*
Allow /wp-content/plugins/wp-email/*
Allow /wp-content/plugins/jetpack/css/*
Allow /wp-content/plugins/i-like-this/js/*
Allow /wp-content/cache/autoptimize/*
Allow /wp-content/cache/autoptimize/css/*
Allow /wp-content/cache/autoptimize/js/*
Allow /wp-content/cache/autoptimize/$

googlebot

Rule Path
Allow /*.css$
Allow /*.js$
Allow /*.jpg$
Allow /*.png$

mediapartners-google*

Rule Path
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

msiecrawler

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

libwww

Rule Path
Disallow /

noxtrumbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 50

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

baiduspider
baiduspider-video
baiduspider-image
sogou

Rule Path
Disallow /
Disallow /*/
Disallow /*/*/
Disallow /*/*/*/
Disallow /*/*/*/*/
Disallow /*/*/*/*/*/
Disallow /wp-content/uploads/
Disallow /wp-content/uploads/*/
Disallow /wp-content/uploads/*/*/

Other Records

Field Value
sitemap https://loff.it/sitemaps/sitemap.xml