Log In Sign Up

spp-dynamicearth.de
robots.txt

Robots Exclusion Standard data for spp-dynamicearth.de

Resource Scan

Scan Details

Site Domain spp-dynamicearth.de
Base Domain spp-dynamicearth.de
Scan Status Ok
Last Scan2025-10-09T07:12:32+00:00
Next Scan 2025-11-08T07:12:32+00:00

Last Scan

Scanned2025-10-09T07:12:32+00:00
URL https://www.spp-dynamicearth.de/robots.txt
Domain IPs 195.37.145.18
Response IP 195.37.145.18
Found Yes
Hash b1e067a65d22999c01bdea7ea6c18b8009c8d09aa7b829945e526c5391e4a454
SimHash a911897067d3

Groups

*

Rule Path
Disallow /fileadmin/_temp_/
Disallow /t3lib/
Disallow /typo3/
Disallow /typo3_src/
Disallow /clear.gif
Allow /typo3/sysext/frontend/Resources/Public/*
Back to top

Comments

  • Use the following lines during development of a website to disallow robots to spider the website
  • User-agent: *
  • Disallow: /
  • Use the following lines to ALLOW robots the access to the website
  • Remove the # at the beginning of each line
Back to top