ad-magazin.de
robots.txt

Robots Exclusion Standard data for ad-magazin.de

Resource Scan

Scan Details

Site Domain ad-magazin.de
Base Domain ad-magazin.de
Scan Status Ok
Last Scan2024-06-26T07:16:44+00:00
Next Scan 2024-07-03T07:16:44+00:00

Last Scan

Scanned2024-06-26T07:16:44+00:00
URL https://ad-magazin.de/robots.txt
Redirect https://www.ad-magazin.de/robots.txt
Redirect Domain www.ad-magazin.de
Redirect Base ad-magazin.de
Domain IPs 151.101.130.133, 151.101.194.133, 151.101.2.133, 151.101.66.133
Redirect IPs 18.173.121.111, 18.173.121.31, 18.173.121.5, 18.173.121.50, 2600:9000:229f:3800:2:e962:ba40:93a1, 2600:9000:229f:5200:2:e962:ba40:93a1, 2600:9000:229f:5600:2:e962:ba40:93a1, 2600:9000:229f:6a00:2:e962:ba40:93a1, 2600:9000:229f:7200:2:e962:ba40:93a1, 2600:9000:229f:8000:2:e962:ba40:93a1, 2600:9000:229f:9600:2:e962:ba40:93a1, 2600:9000:229f:a400:2:e962:ba40:93a1
Response IP 13.33.30.39
Found Yes
Hash 8b9dd1d2e86ade247fc6e764579112ba38605aacbd373a7b0414f62d965a1e50
SimHash 5490d9408eb5

Groups

*

Rule Path
Disallow /preview/
Disallow /search
Disallow /*bolt
Disallow /1147.1/
Disallow /5574/
Disallow /data/
Disallow /files
Disallow /*?redirectURL=
Disallow /*%7B%7Burl%7D%7D
Disallow /*%7B%7Burl%7D%7D
Disallow /*%7B%7Bsection%7D%7D
Disallow /*%7B%7Bsection%7D%7D
Disallow /auth/*
Disallow /account/*
Disallow /product/
Disallow /user-context?referrer
Disallow /services.min.js?_=

google-inspectiontool

Rule Path
Allow /

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

youbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.ad-magazin.de/sitemap.xml
sitemap https://www.ad-magazin.de/feed/google-latest-news/sitemap-google-news
sitemap https://www.ad-magazin.de/gewinnspiele/sitemap.xml
sitemap https://nautilus.condenastdigital.de/api/feed/ad-all
sitemap https://www.ad-magazin.de/feed/rss
sitemap https://www.ad-magazin.de/categories-sitemap.xml
sitemap https://www.ad-magazin.de/contributors-sitemap.xml
sitemap https://www.ad-magazin.de/branded-sitemap.xml
sitemap https://www.ad-magazin.de/bundles-sitemap.xml