Log In Sign Up

opo.de
robots.txt

Robots Exclusion Standard data for opo.de

Resource Scan

Scan Details

Site Domain opo.de
Base Domain opo.de
Scan Status Ok
Last Scan2024-09-25T20:12:24+00:00
Next Scan 2024-10-09T20:12:24+00:00

Last Scan

Scanned2024-09-25T20:12:24+00:00
URL https://opo.de/robots.txt
Redirect https://www.opo.de/robots.txt
Redirect Domain www.opo.de
Redirect Base opo.de
Domain IPs 2600:1413:b000:6::17d5:2bd5, 2600:1413:b000:6::17d5:2bdc, 96.17.96.16, 96.17.96.17
Redirect IPs 23.59.168.106, 2600:1413:b000:6::17d5:2bd5, 2600:1413:b000:6::17d5:2bdc
Response IP 23.59.168.106
Found Yes
Hash 10dfd3704c654c78ffcd61050a6c9e8229d5a8eb08cf0095c4ab91dd49688a88
SimHash 8a5ed452dd1a

Groups

*

Rule Path
Disallow */s?
Disallow */p/bps
Disallow */p/bpg
Disallow *//p/bp

blexbot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

x28-job-bot

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

spider

Rule Path
Disallow /

nutch

Rule Path
Disallow /

yandex

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

jobroboter

Rule Path
Disallow /

exabot

Rule Path
Disallow /

duckduckbot

Rule Path
Disallow /

duckduckgo-favicons-bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-render

Rule Path
Disallow /

i4ds-bot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

jobboersebot

Rule Path
Disallow /

mb2345browser

Rule Path
Disallow /

liebaofast

Rule Path
Disallow /

zh-cn

Rule Path
Disallow /

micromessenger

Rule Path
Disallow /

zh_cn

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.opo.de/sitemap.xml
Back to top

Warnings

  • 4 invalid lines.
Back to top