dfb.de
robots.txt

Robots Exclusion Standard data for dfb.de

Resource Scan

Scan Details

Site Domain dfb.de
Base Domain dfb.de
Scan Status Ok
Last Scan2024-06-03T08:30:30+00:00
Next Scan 2024-06-17T08:30:30+00:00

Last Scan

Scanned2024-06-03T08:30:30+00:00
URL https://dfb.de/robots.txt
Redirect https://www.dfb.de/robots.txt
Redirect Domain www.dfb.de
Redirect Base dfb.de
Domain IPs 83.125.118.150
Redirect IPs 23.33.126.14, 23.33.126.47, 2600:1413:a000::1734:2832, 2600:1413:a000::1734:284b
Response IP 23.44.4.186
Found Yes
Hash d2cc8385a35797a66aba9a73aa272393514a198b181d164d7a8bc27f79f3b569
SimHash 630ddbd75bb1

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /css/
Disallow /apf/
Disallow /script/
Disallow /xml/
Disallow /prototypes/*
Disallow /typo3temp/*
Allow /typo3temp/*.css$
Allow /typo3temp/*.css.*.gzip$
Allow /typo3temp/*.js$
Allow /typo3temp/*.js.*.gzip$
Allow /typo3temp/*.jpg$
Allow /typo3temp/*.gif$
Allow /typo3temp/*.png$
Disallow *.sql
Disallow *.sql.gz
Disallow *.sql.tar
Disallow *.sql.tar.gz
Disallow *.sql.tar.j2

Other Records

Field Value
sitemap https://www.dfb.de/sitemap.xml