infrastrukturhelden.de
robots.txt

Robots Exclusion Standard data for infrastrukturhelden.de

Resource Scan

Scan Details

Site Domain infrastrukturhelden.de
Base Domain infrastrukturhelden.de
Scan Status Ok
Last Scan2025-05-31T06:39:21+00:00
Next Scan 2025-06-07T06:39:21+00:00

Last Scan

Scanned2025-05-31T06:39:21+00:00
URL https://infrastrukturhelden.de/robots.txt
Domain IPs 2a00:1169:11c:4ef0::, 92.205.110.224
Response IP 92.205.110.224
Found Yes
Hash 30f46bea93b3a9e79b7a315e96585619e4afd9e17a787a56830f59bc15662016
SimHash da1ac408aa22

Groups

ezoicstatic

Rule Path
Disallow /wp-admin/

Other Records

Field Value
crawl-delay 10

dotbot

Rule Path
Disallow /wp-admin/

Other Records

Field Value
crawl-delay 10

ubermetrics-technologies.com

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

chatgpt

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ias_crawler

Rule Path
Disallow /wp-admin/

Other Records

Field Value
crawl-delay 10

nextcloud-news

Rule Path
Disallow /wp-admin/

Other Records

Field Value
crawl-delay 10

freshrss

Rule Path
Disallow /wp-admin/

Other Records

Field Value
crawl-delay 10

inoreader

Rule Path
Disallow /wp-admin/

Other Records

Field Value
crawl-delay 10