overstappen.nl
robots.txt

Robots Exclusion Standard data for overstappen.nl

Resource Scan

Scan Details

Site Domain overstappen.nl
Base Domain overstappen.nl
Scan Status Ok
Last Scan2024-06-10T01:08:24+00:00
Next Scan 2024-07-10T01:08:24+00:00

Last Scan

Scanned2024-06-10T01:08:24+00:00
URL https://overstappen.nl/robots.txt
Redirect https://www.overstappen.nl/robots.txt
Redirect Domain www.overstappen.nl
Redirect Base overstappen.nl
Domain IPs 87.233.179.201
Redirect IPs 87.233.179.201
Response IP 87.233.179.201
Found Yes
Hash 4a54526622e8563d395d55d73f395f3b9c404b17b6efcbf04f52d9a305026f92
SimHash ca1cf5218a43

Groups

*

Rule Path
Disallow /wp/wp-admin/
Allow /wp/wp-admin/admin-ajax.php
Disallow *step%3D
Disallow *gclid%3D
Disallow *ref%3D
Disallow *forced_desktop%3D
Disallow *rel%3D
Disallow *per_page%3D
Disallow *campaign-data%3D
Disallow *source%3D
Disallow *product_id%3D
Disallow *s%3D
Disallow *keys%5B0%5D%26keys%5B1%5D%3D
Disallow *gaverder%3D
Disallow *param_kenteken%3D
Disallow *utm_source%3D
Disallow *kmp-subid%3D
Disallow *mc_cid%3D
Disallow /search/

slurp

Rule Path
Disallow /

niki-bot

Rule Path
Disallow /

compspybot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

beetlebot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

yandexvideo

Rule Path
Disallow /

yandexmedia

Rule Path
Disallow /

yandexfavicons

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.overstappen.nl/sitemap_index.xml

Comments

  • Disallow query strings

Warnings

  • 2 invalid lines.