firmencheck.at
robots.txt

Robots Exclusion Standard data for firmencheck.at

Resource Scan

Scan Details

Site Domain firmencheck.at
Base Domain firmencheck.at
Scan Status Ok
Last Scan2024-11-12T03:10:04+00:00
Next Scan 2024-11-19T03:10:04+00:00

Last Scan

Scanned2024-11-12T03:10:04+00:00
URL https://firmencheck.at/robots.txt
Redirect https://www.firmenabc.at/robots.txt
Redirect Domain www.firmenabc.at
Redirect Base firmenabc.at
Domain IPs 185.54.208.46
Redirect IPs 128.204.137.76
Response IP 128.204.137.76
Found Yes
Hash de538bd53bf2bde1f562646c1042cd55f58f8d3680aff20ff87c7ad7e77e5745
SimHash ed6952d65d41

Groups

*

Rule Path Comment
Allow / -
Disallow /typo3/ -
Disallow /typo3conf/ -
Allow /_assets/ -
Allow /typo3temp/ -
Disallow /*?id=* non speaking URLs
Disallow /*cHash no cHash
Disallow /*tx_powermail_pi1 no powermail thanks pages
Disallow /*tx_form_formframework no forms
Disallow /suche/ -
Disallow /firma-preview -
Allow /*sitemap.xml*cHash -

yandex

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

webzip

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

web downloader

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

offline <span class="il_ad" id="il_ad4">explorer</span> pro

Rule Path
Disallow /

httrack website copier

Rule Path
Disallow /

offline commander

Rule Path
Disallow /

leech

Rule Path
Disallow /

websnake

Rule Path
Disallow /

blackwidow

Rule Path
Disallow /

http weazel

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.firmenabc.at/sitemap.xml

Comments

  • Folders
  • Parameters
  • Exclude search
  • Exclude company preview
  • Allow cHash in sitemap
  • Sitemap