scribbr.nl
robots.txt

Robots Exclusion Standard data for scribbr.nl

Resource Scan

Scan Details

Site Domain scribbr.nl
Base Domain scribbr.nl
Scan Status Ok
Last Scan2024-06-13T07:37:59+00:00
Next Scan 2024-06-20T07:37:59+00:00

Last Scan

Scanned2024-06-13T07:37:59+00:00
URL https://scribbr.nl/robots.txt
Redirect https://www.scribbr.nl/robots.txt
Redirect Domain www.scribbr.nl
Redirect Base scribbr.nl
Domain IPs 104.26.10.204, 104.26.11.204, 172.67.68.47, 2606:4700:20::681a:acc, 2606:4700:20::681a:bcc, 2606:4700:20::ac43:442f
Redirect IPs 104.26.10.204, 104.26.11.204, 172.67.68.47, 2606:4700:20::681a:acc, 2606:4700:20::681a:bcc, 2606:4700:20::ac43:442f
Response IP 172.67.68.47
Found Yes
Hash d9726a316c075e95aa4fba8504d2dad926973c136cfe543f40a84aa700e39265
SimHash 01068a73e2e5

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes
Disallow /trackback
Disallow /comments
Disallow /wp-json
Disallow */trackback
Disallow */comments
Disallow /category/uncategorized
Disallow /cdn-cgi/
Allow /wp-content/uploads
Allow /wp-admin/admin-ajax.php

googlebot-image

Rule Path
Disallow
Allow /*

mediapartners-google*

Rule Path
Disallow
Allow /*

ia_archiver

Rule Path
Disallow /

duggmirror

Rule Path
Disallow /

Comments

  • Google Image
  • Google AdSense
  • Internet Archiver Wayback Machine
  • digg mirror