schlaile.de
robots.txt

Robots Exclusion Standard data for schlaile.de

Resource Scan

Scan Details

Site Domain schlaile.de
Base Domain schlaile.de
Scan Status Ok
Last Scan2024-10-30T14:41:20+00:00
Next Scan 2024-11-29T14:41:20+00:00

Last Scan

Scanned2024-10-30T14:41:20+00:00
URL https://schlaile.de/robots.txt
Redirect https://www.schlaile.de/robots.txt
Redirect Domain www.schlaile.de
Redirect Base schlaile.de
Domain IPs 188.40.138.250
Redirect IPs 188.40.138.250
Response IP 188.40.138.250
Found Yes
Hash e6be88052c34ec526f3cd807c906e450a0d2f22dbdf87778fe1a1a1593183cbe
SimHash 465d1511c3b0

Groups

*

Rule Path
Disallow /yoxview/
Disallow /images/thumbs/personen/
Disallow /wws-php/get_person_picture.php

semrushbot

Rule Path
Disallow /

domaincrawler

Rule Path
Disallow /

exabot

Rule Path
Disallow /

alphaseobot

Rule Path
Disallow /

alphaseobot-sa

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

seekport

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

geedobot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5