Log In Sign Up

professional.auto-motor-und-sport.de
robots.txt

Robots Exclusion Standard data for professional.auto-motor-und-sport.de

Resource Scan

Scan Details

Site Domain professional.auto-motor-und-sport.de
Base Domain auto-motor-und-sport.de
Scan Status Ok
Last Scan2024-11-08T09:07:06+00:00
Next Scan 2024-11-15T09:07:06+00:00

Last Scan

Scanned2024-11-08T09:07:06+00:00
URL https://professional.auto-motor-und-sport.de/robots.txt
Domain IPs 2a01:138:a027:0:e::101, 2a01:138:a027:0:e::102, 2a01:138:a027:0:e::103, 62.146.96.101, 62.146.96.102, 62.146.96.103
Response IP 62.146.96.102
Found Yes
Hash 26676a8260f7795db4e8bf007f6c27f1011df5db4fab45bf504d8b367b305ed6
SimHash 22321d18eda3

Groups

*

Rule Path
Disallow /irapi/*
Disallow /irelements/*
Disallow /suche/*
Disallow *ePaper*.pdf

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://professional.auto-motor-und-sport.de/sitemap/sitemap-techhnikprofi-index.xml
Back to top

Comments

  • Allow sitemap
  • disallow api calls
  • Legal notice: [https://professional.auto-motor-und-sport.de/] expressly reserves the right to use its content for commercial text and data mining (ยง 44b UrhG).
  • The use of robots or other automated means to access [https://professional.auto-motor-und-sport.de/] or collect or mine data without the express permission of [https://professional.auto-motor-und-sport.de/] is strictly prohibited.
  • If you would like to apply for permission to crawl [https://professional.auto-motor-und-sport.de/], collect or use data, please contact [ompi@motorpresse.de]
Back to top