euramet.org
robots.txt

Robots Exclusion Standard data for euramet.org

Resource Scan

Scan Details

Site Domain euramet.org
Base Domain euramet.org
Scan Status Ok
Last Scan2024-09-21T22:45:56+00:00
Next Scan 2024-10-21T22:45:56+00:00

Last Scan

Scanned2024-09-21T22:45:56+00:00
URL https://euramet.org/robots.txt
Redirect https://www.euramet.org/robots.txt
Redirect Domain www.euramet.org
Redirect Base euramet.org
Domain IPs 192.53.103.122, 2001:638:610:bd01::122
Redirect IPs 192.53.103.122, 2001:638:610:bd01::122
Response IP 192.53.103.122
Found Yes
Hash 9a18894da44e8949a014d3ec927a3f1f4c4bdd3962944cac115c595ee5e151fe
SimHash 6155c0f360b3

Groups

mj12bot

Rule Path
Disallow /*

ezooms

Rule Path
Disallow /*

yandexbot

Rule Path
Disallow /*

ahrefsbot

Rule Path
Disallow /*

turnitin

Rule Path
Disallow /*

baiduspider

Rule Path
Disallow /*

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

jobboersebot

Rule Path
Disallow /*

semrushbot

Rule Path
Disallow /*

typhoeus

Rule Path
Disallow /*

yacybot

Rule Path
Disallow /*

dotbot

Rule Path
Disallow /*

*

Rule Path
Disallow /typo3/
Disallow /typo3_src/
Disallow /typo3conf/
Disallow /typo3temp/
Disallow /index.php?eID=tx_nawsecuredl*t=12*
Disallow /index.php?eID=tx_nawsecuredl*t=130*
Disallow /index.php?eID=tx_nawsecuredl*t=131*
Disallow /index.php?eID=tx_nawsecuredl*t=132*
Disallow /index.php?*tx_sevenpack_pi1%5Bexport%5D=xml*
Disallow /index.php?*tx_sevenpack_pi1%5Bexport%5D=bibtex*
Disallow /index.php?*print*
Disallow /index.php?*tx_webkitpdf_pi1*
Disallow /get/?tx_stag_base*