Log In Sign Up

hippekippe.nl
robots.txt

Robots Exclusion Standard data for hippekippe.nl

Resource Scan

Scan Details

Site Domain hippekippe.nl
Base Domain hippekippe.nl
Scan Status Ok
Last Scan2024-06-02T06:02:03+00:00
Next Scan 2024-06-16T06:02:03+00:00

Last Scan

Scanned2024-06-02T06:02:03+00:00
URL https://hippekippe.nl/robots.txt
Redirect https://www.hippekippe.nl/robots.txt
Redirect Domain www.hippekippe.nl
Redirect Base hippekippe.nl
Domain IPs 151.101.130.132, 151.101.194.132, 151.101.2.132, 151.101.66.132
Redirect IPs 151.101.130.132, 151.101.194.132, 151.101.2.132, 151.101.66.132
Response IP 199.232.46.132
Found Yes
Hash e1eec3ea9af786fceaee4dd4f2c98cfab57b6e427928cf77661cd1a104105eff
SimHash 31729b74cd11

Groups

*

Rule Path
Allow /
Disallow /*/privacy-policy
Disallow /*/algemene-voorwaarden
Disallow /*/cookie-informatie
Disallow /*/q/
Allow /*/q/Brand

Other Records

Field Value
crawl-delay 25

mj12bot

Rule Path
Disallow /

vagabondo

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

exabot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

cfnetwork

Rule Path
Disallow /

twengabot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

fatbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

speedyspider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.hippekippe.nl/xmlsitemap.php
Back to top

Comments

  • Website Sitemap
  • Paths used for non seo pages
  • ----------------------------------------------------
  • Block bad crawlers
  • ----------------------------------------------------
  • third party search engine bot
  • Web-crawler by the company 'WiseGuys' to gather unstructured webdata
  • Chinese Search Engine
  • French Search Engine
  • Russian Search Engine
Back to top