abnehmen.com
robots.txt

Robots Exclusion Standard data for abnehmen.com

Resource Scan

Scan Details

Site Domain abnehmen.com
Base Domain abnehmen.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-02-28T00:55:07+00:00
Next Scan 2026-05-29T00:55:07+00:00

Last Successful Scan

Scanned2025-05-04T19:06:22+00:00
URL https://abnehmen.com/robots.txt
Redirect https://www.abnehmen.com/robots.txt
Redirect Domain www.abnehmen.com
Redirect Base abnehmen.com
Domain IPs 104.26.12.105, 104.26.13.105, 172.67.71.170
Redirect IPs 104.26.12.105, 104.26.13.105, 172.67.71.170
Response IP 104.26.12.105
Found Yes
Hash cca0641278f5deb24e18e7d98859bfc1d02ee112ddd27c07c54764dbb0f8dcca
SimHash 253e584d83c5

Groups

mediapartners-google

Rule Path
Disallow

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

criteobot/0.1

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

dataforseobot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

spinn3r

Rule Path
Disallow /

*

Rule Path
Disallow /cdn-cgi/
Disallow /activity.php
Disallow /adventcalendar.php
Disallow /advertising.php
Disallow /affiliate.php
Disallow /agb.php
Disallow /album.php
Disallow /ajax.php
Disallow /attachment.php
Disallow /calendar.php
Disallow /converse.php
Disallow /cron.php
Disallow /editpost.php
Disallow /external.php
Disallow /facebook.php
Disallow /getitem.php
Disallow /global.php
Disallow /image.php
Disallow /impressum.php
Disallow /infraction.php
Disallow /inlinemod.php
Disallow /joinrequests.php
Disallow /login.php
Disallow /member.php
Disallow /member_inlinemod.php
Disallow /memberlist.php
Disallow /misc.php
Disallow /moderation.php
Disallow /moderator.php
Disallow /newattachment.php
Disallow /newreply.php
Disallow /newthread.php
Disallow /online.php
Disallow /payment_gateway.php
Disallow /payments.php
Disallow /picture.php
Disallow /picture_inlinemod.php
Disallow /picturecomment.php
Disallow /privacy.php
Disallow /poll.php
Disallow /posthistory.php
Disallow /postings.php
Disallow /printthread.php
Disallow /private.php
Disallow /profile.php
Disallow /register.php
Disallow /report.php
Disallow /reputation.php
Disallow /search.php
Disallow /sendmessage.php
Disallow /showgroups.php
Disallow /subscription.php
Disallow /threadtag.php
Disallow /threadrate.php
Disallow /tags.php
Disallow /threadread.php
Disallow /usercp.php
Disallow /usernote.php
Disallow /visitormessage.php
Disallow /vbglossar_attachment.php
Disallow /vbglossar_newattachment.php
Disallow /weightlist.php
Disallow /1006223/
Disallow /admincp/
Disallow /customavatars/
Disallow /customprofilepics/
Disallow /includes/
Disallow /install/
Disallow /members/
Disallow /modcp/
Disallow /vbmembermap/
Disallow /vb3/
Disallow /vb4/

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.abnehmen.com/xmlsitemap.php