hamburg.de
robots.txt

Robots Exclusion Standard data for hamburg.de

Resource Scan

Scan Details

Site Domain hamburg.de
Base Domain hamburg.de
Scan Status Ok
Last Scan2024-09-19T10:39:22+00:00
Next Scan 2024-09-26T10:39:22+00:00

Last Scan

Scanned2024-09-19T10:39:22+00:00
URL https://hamburg.de/robots.txt
Redirect https://www.hamburg.de/robots.txt
Redirect Domain www.hamburg.de
Redirect Base hamburg.de
Domain IPs 212.1.41.48
Redirect IPs 141.91.172.100
Response IP 141.91.172.100
Found Yes
Hash 4004a97cdcb2d80e7a0289b8c5bcc38cf3564e86454e618334f6deb8d539399c
SimHash 980dd3d65a92

Groups

*

Rule Path
Disallow /branchenbuch/*/*/ln0/
Disallow /branchenbuch/*/*/*/ln0/
Disallow /iason/hamburg/
Disallow /iason/search
Disallow /iason/search
Disallow /iason/widget
Disallow /iason/listing/
Disallow /befi/$
Disallow /befi/?$
Disallow /befi/hamburg/
Disallow /befi/widget
Disallow /premiumpartner/

hyscore

Rule Path
Disallow /

teleport

Rule Path
Disallow /

webwhacker

Rule Path
Disallow /

webzip

Rule Path
Disallow /

net attache

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

httrack

Rule Path
Disallow /

webcapture

Rule Path
Disallow /

websauger

Rule Path
Disallow /

proximic

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

flamingo_searchengine

Rule Path
Disallow /

msnbot-media/1.1

Rule Path
Disallow /

msnbot-media/2.0b

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

rytebot

Rule Path
Disallow /

backlink-check.de

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

extractorpro

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

linkextractorpro

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

openbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

searchpreview

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seodat

Rule Path
Disallow /

seoengbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

true_robot

Rule Path
Disallow /

url control

Rule Path
Disallow /

url_spider_pro

Rule Path
Disallow /

xovi

Rule Path
Disallow /

um-ic

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.hamburg.de/service-sitemap-hamburg.de-sitemap_index.xml
sitemap https://www.hamburg.com/service-sitemap-hamburg.com-sitemap_index.xml

Warnings

  • 2 invalid lines.