wihel.de
robots.txt

Robots Exclusion Standard data for wihel.de

Resource Scan

Scan Details

Site Domain wihel.de
Base Domain wihel.de
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-08T01:20:27+00:00
Next Scan 2025-01-06T01:20:27+00:00

Last Successful Scan

Scanned2024-03-13T00:43:09+00:00
URL https://wihel.de/robots.txt
Redirect https://www.wihel.de/robots.txt
Redirect Domain www.wihel.de
Redirect Base wihel.de
Domain IPs 104.21.16.167, 172.67.214.221, 2606:4700:3037::6815:10a7, 2606:4700:3037::ac43:d6dd
Redirect IPs 104.21.16.167, 172.67.214.221, 2606:4700:3037::6815:10a7, 2606:4700:3037::ac43:d6dd
Response IP 172.67.214.221
Found Yes
Hash a3698329e9d19e2798663928758add2e7823fb0734d9869fa53fe2e9d51d56c4
SimHash 39355044c113

Groups

*

Rule Path
Disallow /wp-admin/*
Disallow */wp-login.php
Disallow /readme.html
Disallow /liesmich.html
Disallow /datenschutz/
Disallow /*?*
Disallow */page/*

emailcollector

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /*.gif$
Disallow /*.GIF$
Disallow /*.jpg$
Disallow /*.JPG$
Disallow /*.JPEG$
Disallow /*.jpeg$
Disallow /*.PNG$
Disallow /*.png$
Disallow /*.BMP$
Disallow /*.bmp$
Disallow /*.ico$
Disallow /*.ICO$
Disallow /*.webp$
Disallow /*.WEBP$
Disallow /*.AVIF$
Disallow /*.avif$

mediapartners-google

Rule Path
Disallow /*.gif$
Disallow /*.GIF$
Disallow /*.jpg$
Disallow /*.JPG$
Disallow /*.JPEG$
Disallow /*.jpeg$
Disallow /*.PNG$
Disallow /*.png$
Disallow /*.BMP$
Disallow /*.bmp$
Disallow /*.ico$
Disallow /*.ICO$
Disallow /*.AVIF$
Disallow /*.avif$

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.wihel.de/sitemap.xml