opzeggen.nl
robots.txt

Robots Exclusion Standard data for opzeggen.nl

Resource Scan

Scan Details

Site Domain opzeggen.nl
Base Domain opzeggen.nl
Scan Status Ok
Last Scan2024-08-31T16:34:10+00:00
Next Scan 2024-09-30T16:34:10+00:00

Last Scan

Scanned2024-08-31T16:34:10+00:00
URL https://opzeggen.nl/robots.txt
Redirect https://www.opzeggen.nl:443/robots.txt
Redirect Domain www.opzeggen.nl
Redirect Base opzeggen.nl
Domain IPs 13.226.2.18, 13.226.2.31, 13.226.2.78, 13.226.2.90
Redirect IPs 13.226.2.18, 13.226.2.31, 13.226.2.78, 13.226.2.90
Response IP 3.160.246.32
Found Yes
Hash 6de8c1fcc1cef58a0b29dbbc6693291c7b9aa4ffdc70643a66090ac472439ef0
SimHash dabdf421aac2

Groups

*

Rule Path
Disallow /*.pdf
Disallow /wp-admin/
Disallow /terms
Disallow /contact
Disallow /feedback
Disallow *step%3D
Disallow *gclid%3D
Disallow *ref%3D
Disallow *forced_desktop%3D
Disallow *rel%3D
Disallow *per_page%3D
Disallow *campaign-data%3D
Disallow *source%3D
Disallow *product_id%3D
Disallow *s%3D
Disallow *page%3D
Disallow *keys%5B0%5D%26keys%5B1%5D%3D
Disallow *gaverder%3D
Disallow *param_kenteken%3D
Disallow *utm_source%3D
Disallow *kmp-subid%3D
Disallow *mc_cid%3D
Disallow /search/

slurp

Rule Path
Disallow /

niki-bot

Rule Path
Disallow /

compspybot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

beetlebot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

yandexvideo

Rule Path
Disallow /

yandexmedia

Rule Path
Disallow /

yandexfavicons

Rule Path
Disallow /

Comments

  • Disallow query strings
  • specific agents

Warnings

  • 2 invalid lines.