digitransfer.com
robots.txt

Robots Exclusion Standard data for digitransfer.com

Resource Scan

Scan Details

Site Domain digitransfer.com
Base Domain digitransfer.com
Scan Status Ok
Last Scan2025-05-05T02:36:27+00:00
Next Scan 2025-06-04T02:36:27+00:00

Last Scan

Scanned2025-05-05T02:36:27+00:00
URL https://digitransfer.com/robots.txt
Redirect https://www.digitransfer.com/robots.txt
Redirect Domain www.digitransfer.com
Redirect Base digitransfer.com
Domain IPs 104.26.6.78, 104.26.7.78, 172.67.74.221, 2606:4700:20::681a:64e, 2606:4700:20::681a:74e, 2606:4700:20::ac43:4add
Redirect IPs 104.26.6.78, 104.26.7.78, 172.67.74.221, 2606:4700:20::681a:64e, 2606:4700:20::681a:74e, 2606:4700:20::ac43:4add
Response IP 104.26.6.78
Found Yes
Hash 88b4a81200ad2e9141ec3befa541d7befa7871f21af68f7beb85b114e7bc14b5
SimHash e08e7a928774

Groups

adidxbot

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

*

Rule Path
Disallow /*_wpnonce%3D*
Disallow /*filter_certificaat%3D*
Disallow /*filter_filter-color%3D*
Disallow /*filter_grammage%3D*
Disallow /*filter_materiaal%3D*
Disallow /*filter_merk%3D*
Disallow /*filter_model%3D*
Disallow /*filter_mouw%3D*
Disallow /*filter_pasvorm%3D*
Disallow /*filter_stijl%3D*
Disallow /*gf_page%3D*
Disallow /*id%3D*
Disallow /*pa_doelgroep%3D*
Disallow /*pa_grammage%3D*
Disallow /*pa_materiaal%3D*
Disallow /*pa_merk%3D*
Disallow /*pa_model%3D*
Disallow /*pa_mouw%3D*
Disallow /*pa_pasvorm%3D*
Disallow /*pa_secondary-color%3D*
Disallow /*pa_size%3D*
Disallow /*pa_stijl%3D*
Disallow /*product_cat%3D*
Disallow /*query_type_certificaat%3D*
Disallow /*query_type_filter-color%3D*
Disallow /*query_type_grammage.
Disallow /*query_type_materiaal%3D*
Disallow /*query_type_merk%3D*
Disallow /*query_type_model%3D*
Disallow /*query_type_mouw%3D*
Disallow /*query_type_pasvorm%3D*
Disallow /*query_type_stijl%3D*
Disallow /*yith_wcan%3D*
Disallow /wp-admin/
Disallow /*kleur_filter%3D*
Disallow /*splash_category%3D*
Disallow /*merk%3D*
Disallow /*?redirect_to=*
Disallow /catalog/product_compare/add/
Allow /*.js
Allow /*.css
Allow /*.jpg
Allow /*.jpeg
Allow /*.svg
Allow /*.gif
Allow /*.png
Allow /*.js*
Allow /*.css*
Allow /*.jpg*
Allow /*.jpeg*
Allow /*.svg*
Allow /*.gif*
Allow /*.png*
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.digitransfer.com/sitemap_index.xml

Comments

  • disallow all query parameters from all filter combinations
  • allow all resources for rendering