Log In Sign Up

toa.de
robots.txt

Robots Exclusion Standard data for toa.de

Resource Scan

Scan Details

Site Domain toa.de
Base Domain toa.de
Scan Status Ok
Last Scan2024-11-06T09:31:04+00:00
Next Scan 2024-12-06T09:31:04+00:00

Last Scan

Scanned2024-11-06T09:31:04+00:00
URL https://toa.de/robots.txt
Redirect https://www.toa.de/robots.txt
Redirect Domain www.toa.de
Redirect Base toa.de
Domain IPs 18.196.91.176
Redirect IPs 108.156.133.103, 108.156.133.54, 108.156.133.73, 108.156.133.82, 2600:9000:2755:1200:e:1cd0:1c0:93a1, 2600:9000:2755:2600:e:1cd0:1c0:93a1, 2600:9000:2755:7e00:e:1cd0:1c0:93a1, 2600:9000:2755:8800:e:1cd0:1c0:93a1, 2600:9000:2755:9200:e:1cd0:1c0:93a1, 2600:9000:2755:9600:e:1cd0:1c0:93a1, 2600:9000:2755:9e00:e:1cd0:1c0:93a1, 2600:9000:2755:d000:e:1cd0:1c0:93a1
Response IP 108.156.133.82
Found Yes
Hash 47c4ac01416848a4fb50484cb798e3958e701323f091445bc726e55479d71775
SimHash 66897b56cb89

Groups

*

Rule Path
Disallow /*?id=*
Disallow /*%26id%3D*
Disallow /*?L=0*
Disallow /*%26L%3D0*
Disallow /*?type=98*
Disallow /*%26type%3D98*
Disallow /*/Private/*
Disallow /fileadmin/templates/html/*
Disallow /fileadmin/user_upload/form_*
Disallow /*/Configuration/*
Disallow /typo3temp/*
Allow /typo3temp/*.css$
Allow /typo3temp/*.css.*.gzip$
Allow /typo3temp/*.js$
Allow /typo3temp/*.js.*.gzip$
Allow /typo3temp/*.jpg$
Allow /typo3temp/*.gif$
Allow /typo3temp/*.png$
Disallow *.sql
Disallow *.sql.gz
Back to top

Comments

  • Only allow URLs generated with RealURL
  • L=0 is the default language
  • typeNum = 98 is usually the print version.
  • Should always be protected (.htaccess)
Back to top