bu-power.com
robots.txt

Robots Exclusion Standard data for bu-power.com

Resource Scan

Scan Details

Site Domain bu-power.com
Base Domain bu-power.com
Scan Status Ok
Last Scan2025-09-24T19:30:35+00:00
Next Scan 2025-10-24T19:30:35+00:00

Last Scan

Scanned2025-09-24T19:30:35+00:00
URL https://bu-power.com/robots.txt
Domain IPs 104.26.0.140, 104.26.1.140, 172.67.72.212, 2606:4700:20::681a:18c, 2606:4700:20::681a:8c, 2606:4700:20::ac43:48d4
Response IP 104.26.0.140
Found Yes
Hash 187639abec16665a713e53fa3cf432f64a834bfeade7fc1eb77db983e57e7507
SimHash 795c988087b3

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /ad/
Allow /wp-admin/admin-ajax.php

webreaper
webcopier
offline explorer
httrack
microsoft.url.control
emailcollector
penthesilea

Rule Path
Disallow /

*

Rule Path
Disallow /?blackhole

Other Records

Field Value
sitemap https://bu-perkins.com/de/sitemap.xml
sitemap https://bu-perkins.com/en/sitemap.xml
sitemap https://bu-perkins.com/it/sitemap.xml
sitemap https://bu-perkins.com/hr/sitemap.xml
sitemap https://bu-perkins.com/sl/sitemap.xml
sitemap https://bu-perkins.com/da/sitemap.xml
sitemap https://bu-perkins.com/pl/sitemap.xml

Comments

  • ===================================
  • Folgende Seiten sollen nicht indexiert werden:
  • ===================================
  • ===================================
  • Schließe folgende Spider komplett aus:
  • ===================================