freizeitkarte-osm.de
robots.txt

Robots Exclusion Standard data for freizeitkarte-osm.de

Resource Scan

Scan Details

Site Domain freizeitkarte-osm.de
Base Domain freizeitkarte-osm.de
Scan Status Ok
Last Scan2024-08-30T03:31:07+00:00
Next Scan 2024-09-29T03:31:07+00:00

Last Scan

Scanned2024-08-30T03:31:07+00:00
URL https://www.freizeitkarte-osm.de/robots.txt
Domain IPs 46.4.253.146
Response IP 46.4.253.146
Found Yes
Hash 974c6b1f16b831508a3e65c12183622c295df35dd82b9bf8575e4784f31fc753
SimHash 0a187de0c000

Groups

googlebot

Rule Path
Disallow /maps/Experimental/
Disallow /cgi-bin/

*

Rule Path
Disallow /maps/Experimental/
Disallow /cgi-bin/

Other Records

Field Value
crawl-delay 43200

ezooms

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

pixray-seeker

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

spiderlytics

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

careerbot

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

compspybot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

Warnings

  • 2 invalid lines.