wiki.anton-paar.com
robots.txt

Robots Exclusion Standard data for wiki.anton-paar.com

Resource Scan

Scan Details

Site Domain wiki.anton-paar.com
Base Domain anton-paar.com
Scan Status Ok
Last Scan2024-11-03T14:40:15+00:00
Next Scan 2024-12-03T14:40:15+00:00

Last Scan

Scanned2024-11-03T14:40:15+00:00
URL https://wiki.anton-paar.com/robots.txt
Domain IPs 193.46.209.36
Response IP 193.46.209.36
Found Yes
Hash b022a5239d174c9ecf145c3138e7d135ac2750fb05062ff7344ee93eece18597
SimHash 413d0b0781c1

Groups

wget
googlebot
adsbot-google
yahoo! slurp
bingbot
msnbot
sistrix
strucr
searchmetricsbot

Rule Path
Disallow /typo3/
Allow /typo3/sysext/core/Resources/Public/Icons/Flags/SVG/
Disallow /typo3temp/
Allow /typo3temp/scriptmerger/compressed/
Disallow /uploads/
Disallow /TOKEN/
Disallow /*TOKEN
Disallow /NL/
Disallow /HU/
Disallow /GB/
Disallow /001/
Disallow /Japan/
Disallow /Anton-Paar-Canada/
Disallow /Anton-Paar-Ltd-UK/
Disallow /htr/teaser/
Disallow /static/
Disallow /static/newsletter_AP_India/
Disallow /static/newsletter/

ia_archiver

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://wiki.anton-paar.com/sitemap.xml

Comments

  • URL: http://wiki.anton-paar.com
  • Versions: 1.12