Log In Sign Up

toa.de
robots.txt

Robots Exclusion Standard data for toa.de

Resource Scan

Scan Details

Site Domain toa.de
Base Domain toa.de
Scan Status Ok
Last Scan2024-09-07T09:30:53+00:00
Next Scan 2024-10-07T09:30:53+00:00

Last Scan

Scanned2024-09-07T09:30:53+00:00
URL https://toa.de/robots.txt
Redirect https://www.toa.de/robots.txt
Redirect Domain www.toa.de
Redirect Base toa.de
Domain IPs 18.196.91.176
Redirect IPs 108.156.133.103, 108.156.133.54, 108.156.133.73, 108.156.133.82, 2600:9000:2755:0:e:1cd0:1c0:93a1, 2600:9000:2755:4e00:e:1cd0:1c0:93a1, 2600:9000:2755:5200:e:1cd0:1c0:93a1, 2600:9000:2755:7800:e:1cd0:1c0:93a1, 2600:9000:2755:7a00:e:1cd0:1c0:93a1, 2600:9000:2755:800:e:1cd0:1c0:93a1, 2600:9000:2755:8a00:e:1cd0:1c0:93a1, 2600:9000:2755:aa00:e:1cd0:1c0:93a1
Response IP 108.156.133.54
Found Yes
Hash ac30c3f389a48f87cfec80cbb2f04fd40097694f6bc2def473d06ce10e2e2469
SimHash 66897b56cb89

Groups

*

Rule Path
Disallow /*?id=*
Disallow /*%26id%3D*
Disallow /*?L=0*
Disallow /*%26L%3D0*
Disallow /*?type=98*
Disallow /*%26type%3D98*
Disallow /*/Private/*
Disallow /fileadmin/templates/html/*
Disallow /*/Configuration/*
Disallow /typo3temp/*
Allow /typo3temp/*.css$
Allow /typo3temp/*.css.*.gzip$
Allow /typo3temp/*.js$
Allow /typo3temp/*.js.*.gzip$
Allow /typo3temp/*.jpg$
Allow /typo3temp/*.gif$
Allow /typo3temp/*.png$
Disallow *.sql
Disallow *.sql.gz
Back to top

Comments

  • Only allow URLs generated with RealURL
  • L=0 is the default language
  • typeNum = 98 is usually the print version.
  • Should always be protected (.htaccess)
Back to top