eppingen.org
robots.txt

Robots Exclusion Standard data for eppingen.org

Resource Scan

Scan Details

Site Domain eppingen.org
Base Domain eppingen.org
Scan Status Ok
Last Scan2024-09-28T00:51:18+00:00
Next Scan 2024-10-28T00:51:18+00:00

Last Scan

Scanned2024-09-28T00:51:18+00:00
URL https://eppingen.org/robots.txt
Domain IPs 176.221.47.111, 2a00:1169:103:22f0::
Response IP 176.221.47.111
Found Yes
Hash 149892222c808e83324eb1df32262395bd3eaa89d67bdeb11d29941d1de3b609
SimHash 623c5cd3cd63

Groups

*

Rule Path
Disallow /cloud
Disallow /*searchTerm%3D
Disallow /wthumbnails
Disallow /de/nachrichten/stellenangebote.php

yandex
semrushbot
linguee
ahrefsbot
mj12bot
ccbot
dotbot
sentibot
seokicks-robot
siteexplorer
exabot
spbot
scoutjet
indy library
baiduspider
panscient.com
sogou web spider
yak
toweyabot
toweya
toweya.com bot
toweyabot: toweya.com
toweya.com bot; report abuse to abuse@toweya.net
mozilla/5.0 (compatible,webintegration jobroboter webspider/7,+http://www.webintegration.at)

Rule Path
Disallow /

metajobbot

Rule Path
Allow /de/nachrichten/2017

bingbot

Rule Path
Disallow /de/fotos/2012/
Disallow /de/fotos/2013/
Disallow /de/fotos/2014/
Disallow /de/nachrichten/2012/
Disallow /de/nachrichten/2013/
Disallow /de/nachrichten/2014/

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.eppingen.org/de/sitemap/google-sitemap.php
sitemap https://www.eppingen.org/job-app/sitemap-jobs.xml