sexy.wasserburg24.de
robots.txt

Robots Exclusion Standard data for sexy.wasserburg24.de

Resource Scan

Scan Details

Site Domain sexy.wasserburg24.de
Base Domain wasserburg24.de
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-05-26T00:08:24+00:00
Next Scan 2024-08-24T00:08:24+00:00

Last Successful Scan

Scanned2022-04-05T22:11:27+00:00
URL https://sexy.wasserburg24.de/robots.txt
Response IP 91.235.47.86
Found Yes
Hash a03bf0a517d0167bcee7229f648810ddc56341b486af7a77b6bf8e5cbb930c51
SimHash 67091a848713

Groups

*

Rule Path
Disallow /lightweight-ajax
Disallow /*?trafficsource
Disallow /suche/
Disallow /*?cmp=defrss
Disallow /test/

xovi

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /test/

msnbot

Rule Path
Disallow /test/

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.wasserburg24.de/sitemap-index.xml
sitemap https://www.wasserburg24.de/sitemap-image-index.xml
sitemap https://www.wasserburg24.de/sitemap-index.xml
sitemap https://www.wasserburg24.de/sitemap-image-index.xml
sitemap https://www.wasserburg24.de/sitemap-index.xml
sitemap https://www.wasserburg24.de/sitemap-image-index.xml

Comments

  • robots.txt www.wasserburg24.de