scribbr.com
robots.txt

Robots Exclusion Standard data for scribbr.com

Resource Scan

Scan Details

Site Domain scribbr.com
Base Domain scribbr.com
Scan Status Ok
Last Scan2024-10-03T09:05:24+00:00
Next Scan 2024-10-10T09:05:24+00:00

Last Scan

Scanned2024-10-03T09:05:24+00:00
URL https://scribbr.com/robots.txt
Redirect https://www.scribbr.com/robots.txt
Redirect Domain www.scribbr.com
Redirect Base scribbr.com
Domain IPs 104.22.44.219, 104.22.45.219, 172.67.37.109, 2606:4700:10::6816:2cdb, 2606:4700:10::6816:2ddb, 2606:4700:10::ac43:256d
Redirect IPs 104.22.44.219, 104.22.45.219, 172.67.37.109, 2606:4700:10::6816:2cdb, 2606:4700:10::6816:2ddb, 2606:4700:10::ac43:256d
Response IP 172.67.37.109
Found Yes
Hash d9726a316c075e95aa4fba8504d2dad926973c136cfe543f40a84aa700e39265
SimHash 01068a73e2e5

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes
Disallow /trackback
Disallow /comments
Disallow /wp-json
Disallow */trackback
Disallow */comments
Disallow /category/uncategorized
Disallow /cdn-cgi/
Allow /wp-content/uploads
Allow /wp-admin/admin-ajax.php

googlebot-image

Rule Path
Disallow
Allow /*

mediapartners-google*

Rule Path
Disallow
Allow /*

ia_archiver

Rule Path
Disallow /

duggmirror

Rule Path
Disallow /

Comments

  • Google Image
  • Google AdSense
  • Internet Archiver Wayback Machine
  • digg mirror