aegypten.de
robots.txt

Robots Exclusion Standard data for aegypten.de

Resource Scan

Scan Details

Site Domain aegypten.de
Base Domain aegypten.de
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-11-30T04:50:22+00:00
Next Scan 2025-12-01T04:50:22+00:00

Last Successful Scan

Scanned2025-11-01T04:32:27+00:00
URL https://aegypten.de/robots.txt
Redirect https://www.aegypten.de/robots.txt
Redirect Domain www.aegypten.de
Redirect Base aegypten.de
Domain IPs 195.201.248.15
Redirect IPs 195.201.248.15
Response IP 195.201.248.15
Found Yes
Hash 51d0373516b331b30454983edeb1cbdd1c7798cea0b53000b2bd4e2131a6a666
SimHash 482cdca36a90

Groups

*

Rule Path
Disallow /?s=
Disallow /?p=
Disallow /?q=
Disallow /index.php?s=
Disallow /index.php?p=
Disallow /?SobiCatSelected_0=
Disallow /harming/humans
Disallow /ignoring/human/orders
Disallow /harm/to/self

mediapartners-google

Rule Path
Allow /

ahrefsbot
dotbot
mj12bot
semrushbot
semrushbot-sa

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

Other Records

Field Value
sitemap https://www.aegypten.de/sitemap.xml

Comments

  • Version: $Id: robots-ssl.php 177720 2021-03-01 18:58:42Z cgaffga $