business-and-science.de
robots.txt

Robots Exclusion Standard data for business-and-science.de

Resource Scan

Scan Details

Site Domain business-and-science.de
Base Domain business-and-science.de
Scan Status Ok
Last Scan2025-07-25T15:55:07+00:00
Next Scan 2025-08-24T15:55:07+00:00

Last Scan

Scanned2025-07-25T15:55:07+00:00
URL https://business-and-science.de/robots.txt
Domain IPs 104.21.74.213, 172.67.206.180, 2606:4700:3033::ac43:ceb4, 2606:4700:3035::6815:4ad5
Response IP 172.67.206.180
Found Yes
Hash 31f5246ae58e809cd3bf267fb9365b892627baac9ab06198fecf6fe4e32fe320
SimHash 1b5dc1d2ca93

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-content/uploads/2013/11/
Disallow /wp-content/uploads/woocommerce_uploads/
Disallow /wp-content/uploads/vfb-uploads/vfb-uploads/
Disallow /wp-content/uploads/vfb-uploads/

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

scoutjet

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 0

Other Records

Field Value
sitemap https://business-and-science.de/sitemap.xml

Comments

  • spam-bots