meine-flohmarkt-termine.de
robots.txt

Robots Exclusion Standard data for meine-flohmarkt-termine.de

Resource Scan

Scan Details

Site Domain meine-flohmarkt-termine.de
Base Domain meine-flohmarkt-termine.de
Scan Status Ok
Last Scan2024-09-27T18:48:11+00:00
Next Scan 2024-10-04T18:48:11+00:00

Last Scan

Scanned2024-09-27T18:48:11+00:00
URL https://meine-flohmarkt-termine.de/robots.txt
Domain IPs 138.68.75.79, 2a03:b0c0:3:d0::2309:1001
Response IP 138.68.75.79
Found Yes
Hash cbea499a4bea3262ad4eb127f5b78d401f7869d50d8ad5b2f18790b09a154e7b
SimHash 4d1cd2128711

Groups

ogdwctxcrawler

Rule Path
Allow /
Disallow /captcha/*
Disallow /geocode/*

*

Rule Path
Allow /
Disallow /captcha/*
Disallow /geocode/*

Other Records

Field Value
sitemap https://meine-flohmarkt-termine.de/sitemaps/mft/sitemap.xml