peleteriamanuela.com
robots.txt

Robots Exclusion Standard data for peleteriamanuela.com

Resource Scan

Scan Details

Site Domain peleteriamanuela.com
Base Domain peleteriamanuela.com
Scan Status Ok
Last Scan2024-09-16T04:44:49+00:00
Next Scan 2024-09-23T04:44:49+00:00

Last Scan

Scanned2024-09-16T04:44:49+00:00
URL https://peleteriamanuela.com/robots.txt
Domain IPs 104.21.22.251, 172.67.207.231, 2606:4700:3036::ac43:cfe7, 2606:4700:3037::6815:16fb
Response IP 104.21.22.251
Found Yes
Hash 34a6d96d55a4afa3befafd4c147ad90b2bffd54377c6ff71ba819166fbeb1a1a
SimHash 401ec8702bea

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /wp-login
Disallow /wp-admin
Disallow /*/feed/
Disallow /*/trackback/
Disallow /*/attachment/
Disallow /author/
Disallow *?replytocom
Disallow /tag/*/page/
Disallow /tag/*/feed/
Disallow /comments/
Disallow /xmlrpc.php
Disallow /*?s=
Disallow /*/*/*/feed.xml
Disallow /?attachment_id*
Disallow /search

googlebot

Rule Path
Allow /*.css$
Allow /*.js$

semrushbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

sistrix

Rule Path
Disallow /

sistrix crawler

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

jobs.de-robot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

unisterbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

Comments

  • Slow down bots
  • Disallow: Sistrix
  • Disallow: Sistrix
  • Disallow: Sistrix
  • Disallow: SEOkicks-Robot
  • Disallow: jobs.de-Robot
  • Backlink Analysis
  • Bot der Leipziger Unister Holding GmbH
  • http://moz.com/products