login.motorsport-magazin.com
robots.txt

Robots Exclusion Standard data for login.motorsport-magazin.com

Resource Scan

Scan Details

Site Domain login.motorsport-magazin.com
Base Domain motorsport-magazin.com
Scan Status Ok
Last Scan2024-06-03T20:17:44+00:00
Next Scan 2024-06-17T20:17:44+00:00

Last Scan

Scanned2024-06-03T20:17:44+00:00
URL https://login.motorsport-magazin.com/robots.txt
Domain IPs 149.154.99.236
Response IP 149.154.99.236
Found Yes
Hash a7834e27a8a1846724bbc5f483faed92e0037924e6f5aafd5785f3da81fade04
SimHash 7a8041311835

Groups

proximic

Rule Path
Disallow /

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

*

Rule Path
Disallow /ads/
Disallow /error/
Disallow /kunden/
Disallow /logos/
Disallow /mediadaten/
Disallow /statit/
Disallow /mobile/
Disallow /sounds/
Disallow /speedacademy/
Disallow /ticker/
Disallow /player/
Disallow /sf_micro/
Disallow /forum/admin.php
Disallow /forum/admin/
Disallow /forum/db/
Disallow /community/search.php
Disallow /community/search.php*
Disallow /community/report.php
Disallow /community/report.php*
Disallow /community/viewonline.php
Disallow /community/download.php
Disallow /community/download.php*
Disallow /community/*?sid=*
Disallow /community/*%26sid%3D*
Disallow /community/*?hilit=*
Disallow /community/*%26hilit%3D*
Disallow /structured/*?id=8
Disallow /structured/*%26id%3D8
Allow /structured/htdocs/
Disallow /videoc/

Other Records

Field Value
sitemap https://m.motorsport-magazin.com/sitemap-news.xml
sitemap https://m.motorsport-magazin.com/sitemap-videos.xml