speedtestx.de
robots.txt

Robots Exclusion Standard data for speedtestx.de

Resource Scan

Scan Details

Site Domain speedtestx.de
Base Domain speedtestx.de
Scan Status Ok
Last Scan2024-10-04T03:50:42+00:00
Next Scan 2024-10-11T03:50:42+00:00

Last Scan

Scanned2024-10-04T03:50:42+00:00
URL https://speedtestx.de/robots.txt
Redirect https://www.speedtestx.de/robots.txt
Redirect Domain www.speedtestx.de
Redirect Base speedtestx.de
Domain IPs 136.243.134.31
Redirect IPs 136.243.134.31
Response IP 136.243.134.31
Found Yes
Hash 376168f1f4702db968841c84dae721276393e07ca9a09c732c1be53c8d830c1f
SimHash 046c98c0eb12

Groups

googlebot

Rule Path
Disallow /testfiles/
Disallow /capcha/
Disallow /stats/
Disallow /error/

*

Rule Path
Disallow /testfiles/

ahrefsbot

Rule Path
Disallow /

openbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

seodat

Rule Path
Disallow /

seoengbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

true_robot

Rule Path
Disallow /

url_spider_pro

Rule Path
Disallow /

xovi

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /