toa.eu
robots.txt

Robots Exclusion Standard data for toa.eu

Resource Scan

Scan Details

Site Domain toa.eu
Base Domain toa.eu
Scan Status Ok
Last Scan2024-09-24T03:46:54+00:00
Next Scan 2024-10-24T03:46:54+00:00

Last Scan

Scanned2024-09-24T03:46:54+00:00
URL https://toa.eu/robots.txt
Redirect https://www.toa.eu/robots.txt
Redirect Domain www.toa.eu
Redirect Base toa.eu
Domain IPs 18.196.91.176
Redirect IPs 108.156.133.103, 108.156.133.54, 108.156.133.73, 108.156.133.82, 2600:9000:2755:200:e:1cd0:1c0:93a1, 2600:9000:2755:4600:e:1cd0:1c0:93a1, 2600:9000:2755:5e00:e:1cd0:1c0:93a1, 2600:9000:2755:800:e:1cd0:1c0:93a1, 2600:9000:2755:9000:e:1cd0:1c0:93a1, 2600:9000:2755:9c00:e:1cd0:1c0:93a1, 2600:9000:2755:c00:e:1cd0:1c0:93a1, 2600:9000:2755:e800:e:1cd0:1c0:93a1
Response IP 108.156.133.82
Found Yes
Hash 47c4ac01416848a4fb50484cb798e3958e701323f091445bc726e55479d71775
SimHash 66897b56cb89

Groups

*

Rule Path
Disallow /*?id=*
Disallow /*%26id%3D*
Disallow /*?L=0*
Disallow /*%26L%3D0*
Disallow /*?type=98*
Disallow /*%26type%3D98*
Disallow /*/Private/*
Disallow /fileadmin/templates/html/*
Disallow /fileadmin/user_upload/form_*
Disallow /*/Configuration/*
Disallow /typo3temp/*
Allow /typo3temp/*.css$
Allow /typo3temp/*.css.*.gzip$
Allow /typo3temp/*.js$
Allow /typo3temp/*.js.*.gzip$
Allow /typo3temp/*.jpg$
Allow /typo3temp/*.gif$
Allow /typo3temp/*.png$
Disallow *.sql
Disallow *.sql.gz

Comments

  • Only allow URLs generated with RealURL
  • L=0 is the default language
  • typeNum = 98 is usually the print version.
  • Should always be protected (.htaccess)