Log In Sign Up

toa.co.uk
robots.txt

Robots Exclusion Standard data for toa.co.uk

Resource Scan

Scan Details

Site Domain toa.co.uk
Base Domain toa.co.uk
Scan Status Ok
Last Scan2024-05-18T05:41:17+00:00
Next Scan 2024-06-17T05:41:17+00:00

Last Scan

Scanned2024-05-18T05:41:17+00:00
URL https://www.toa.co.uk/robots.txt
Domain IPs 13.33.88.110, 13.33.88.121, 13.33.88.40, 13.33.88.77, 2600:9000:223b:2200:5:4c3c:4a40:93a1, 2600:9000:223b:3c00:5:4c3c:4a40:93a1, 2600:9000:223b:5200:5:4c3c:4a40:93a1, 2600:9000:223b:5c00:5:4c3c:4a40:93a1, 2600:9000:223b:600:5:4c3c:4a40:93a1, 2600:9000:223b:a800:5:4c3c:4a40:93a1, 2600:9000:223b:b000:5:4c3c:4a40:93a1, 2600:9000:223b:e000:5:4c3c:4a40:93a1
Response IP 13.33.88.110
Found Yes
Hash ac30c3f389a48f87cfec80cbb2f04fd40097694f6bc2def473d06ce10e2e2469
SimHash 66897b56cb89

Groups

*

Rule Path
Disallow /*?id=*
Disallow /*%26id%3D*
Disallow /*?L=0*
Disallow /*%26L%3D0*
Disallow /*?type=98*
Disallow /*%26type%3D98*
Disallow /*/Private/*
Disallow /fileadmin/templates/html/*
Disallow /*/Configuration/*
Disallow /typo3temp/*
Allow /typo3temp/*.css$
Allow /typo3temp/*.css.*.gzip$
Allow /typo3temp/*.js$
Allow /typo3temp/*.js.*.gzip$
Allow /typo3temp/*.jpg$
Allow /typo3temp/*.gif$
Allow /typo3temp/*.png$
Disallow *.sql
Disallow *.sql.gz
Back to top

Comments

  • Only allow URLs generated with RealURL
  • L=0 is the default language
  • typeNum = 98 is usually the print version.
  • Should always be protected (.htaccess)
Back to top