marktjagd.de
robots.txt

Robots Exclusion Standard data for marktjagd.de

Resource Scan

Scan Details

Site Domain marktjagd.de
Base Domain marktjagd.de
Scan Status Ok
Last Scan2024-06-22T15:06:32+00:00
Next Scan 2024-06-29T15:06:32+00:00

Last Scan

Scanned2024-06-22T15:06:32+00:00
URL https://marktjagd.de/robots.txt
Redirect https://www.handelsangebote.de:443/robots.txt
Redirect Domain www.handelsangebote.de
Redirect Base handelsangebote.de
Domain IPs 18.200.154.255, 2a05:d018:d00:3500:ad43:526c:25d2:31b7, 2a05:d018:d00:3501:78c4:44c9:5a3c:4ff3, 34.249.234.146
Redirect IPs 18.200.154.255, 2a05:d018:d00:3500:ad43:526c:25d2:31b7, 2a05:d018:d00:3501:78c4:44c9:5a3c:4ff3, 34.249.234.146
Response IP 34.249.234.146
Found Yes
Hash db4d1b2301c67e763f8f7dc2c9b9aa224de57fb876a734dd5a8881dbb95362ee
SimHash 0d1d74a29601

Groups

*

Rule Path
Disallow /xhr/

adsbot-google

Rule Path
Disallow /xhr/

semrushbot

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

sistrix crawler

Rule Path
Disallow /

seekportbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap https://www.handelsangebote.de/c-brochure-list-sitemap-index.xml
sitemap https://www.handelsangebote.de/cc-brochure-list-city-sitemap-index.xml
sitemap https://www.handelsangebote.de/i-industry-detail-sitemap-index.xml
sitemap https://www.handelsangebote.de/h-offer-list-sitemap-index.xml
sitemap https://www.handelsangebote.de/hc-offer-list-city-sitemap-index.xml
sitemap https://www.handelsangebote.de/p-product-detail-sitemap-index.xml
sitemap https://www.handelsangebote.de/p-product-detail-expired-sitemap-index.xml
sitemap https://www.handelsangebote.de/ta-search-keyword-sitemap-index.xml
sitemap https://www.handelsangebote.de/static-sitemap-index.xml
sitemap https://www.handelsangebote.de/f-store-detail-sitemap-index.xml
sitemap https://www.handelsangebote.de/fl-store-list-sitemap-index.xml
sitemap https://www.handelsangebote.de/top-city-sitemap-index.xml
sitemap https://www.handelsangebote.de/update.rss