scribbr.co.uk
robots.txt

Robots Exclusion Standard data for scribbr.co.uk

Resource Scan

Scan Details

Site Domain scribbr.co.uk
Base Domain scribbr.co.uk
Scan Status Ok
Last Scan2024-05-17T06:36:47+00:00
Next Scan 2024-05-24T06:36:47+00:00

Last Scan

Scanned2024-05-17T06:36:47+00:00
URL https://scribbr.co.uk/robots.txt
Redirect https://www.scribbr.co.uk/robots.txt
Redirect Domain www.scribbr.co.uk
Redirect Base scribbr.co.uk
Domain IPs 104.26.2.123, 104.26.3.123, 172.67.68.13, 2606:4700:20::681a:27b, 2606:4700:20::681a:37b, 2606:4700:20::ac43:440d
Redirect IPs 104.26.2.123, 104.26.3.123, 172.67.68.13, 2606:4700:20::681a:27b, 2606:4700:20::681a:37b, 2606:4700:20::ac43:440d
Response IP 172.67.68.13
Found Yes
Hash d9726a316c075e95aa4fba8504d2dad926973c136cfe543f40a84aa700e39265
SimHash 01068a73e2e5

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes
Disallow /trackback
Disallow /comments
Disallow /wp-json
Disallow */trackback
Disallow */comments
Disallow /category/uncategorized
Disallow /cdn-cgi/
Allow /wp-content/uploads
Allow /wp-admin/admin-ajax.php

googlebot-image

Rule Path
Disallow
Allow /*

mediapartners-google*

Rule Path
Disallow
Allow /*

ia_archiver

Rule Path
Disallow /

duggmirror

Rule Path
Disallow /

Comments

  • Google Image
  • Google AdSense
  • Internet Archiver Wayback Machine
  • digg mirror