hamburg.com
robots.txt

Robots Exclusion Standard data for hamburg.com

Resource Scan

Scan Details

Site Domain hamburg.com
Base Domain hamburg.com
Scan Status Ok
Last Scan2024-09-21T00:07:48+00:00
Next Scan 2024-10-21T00:07:48+00:00

Last Scan

Scanned2024-09-21T00:07:48+00:00
URL https://www.hamburg.com/robots.txt
Domain IPs 141.91.172.100
Response IP 141.91.172.100
Found Yes
Hash e96e5b38b328cee087f1a3ef1d509ef9b5f7ee48a6db39fe9237d26e9afc69d9
SimHash 9c0dd3d67a92

Groups

*

Rule Path
Disallow /branchenbuch/*/*/ln0/
Disallow /branchenbuch/*/*/*/ln0/
Disallow /iason/hamburg/
Disallow /iason/search
Disallow /iason/search
Disallow /iason/widget
Disallow /iason/listing/
Disallow /befi/$
Disallow /befi/?$
Disallow /befi/hamburg/
Disallow /befi/widget
Disallow /premiumpartner/
Disallow /625042%21search
Disallow /search
Disallow /newsletter

hyscore

Rule Path
Disallow /

teleport

Rule Path
Disallow /

webwhacker

Rule Path
Disallow /

webzip

Rule Path
Disallow /

net attache

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

httrack

Rule Path
Disallow /

webcapture

Rule Path
Disallow /

websauger

Rule Path
Disallow /

proximic

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

flamingo_searchengine

Rule Path
Disallow /

msnbot-media/1.1

Rule Path
Disallow /

msnbot-media/2.0b

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

rytebot

Rule Path
Disallow /

backlink-check.de

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

extractorpro

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

linkextractorpro

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

openbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

searchpreview

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seodat

Rule Path
Disallow /

seoengbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

true_robot

Rule Path
Disallow /

url control

Rule Path
Disallow /

url_spider_pro

Rule Path
Disallow /

xovi

Rule Path
Disallow /

um-ic

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.hamburg.de/service-sitemap-hamburg.de-sitemap_index.xml
sitemap https://www.hamburg.com/service-sitemap-hamburg.com-sitemap_index.xml

Warnings

  • 2 invalid lines.