scribbr.no
robots.txt

Robots Exclusion Standard data for scribbr.no

Resource Scan

Scan Details

Site Domain scribbr.no
Base Domain scribbr.no
Scan Status Ok
Last Scan2025-12-07T21:24:43+00:00
Next Scan 2025-12-14T21:24:43+00:00

Last Scan

Scanned2025-12-07T21:24:43+00:00
URL https://scribbr.no/robots.txt
Redirect https://www.scribbr.no/robots.txt
Redirect Domain www.scribbr.no
Redirect Base scribbr.no
Domain IPs 104.18.22.155, 104.18.23.155, 2606:4700::6812:169b, 2606:4700::6812:179b
Redirect IPs 104.18.22.155, 104.18.23.155, 2606:4700::6812:169b, 2606:4700::6812:179b
Response IP 104.18.23.155
Found Yes
Hash 6fbe2402cb8527141db1637ab9fca1bca1d1ef066f52f3fc5b8706521c1b8a6c
SimHash 43461893e6ee

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes
Disallow /trackback
Disallow /comments
Disallow /wp-json
Disallow */trackback
Disallow */comments
Disallow /category/uncategorized
Disallow /cdn-cgi/
Allow /wp-content/uploads
Allow /wp-admin/admin-ajax.php

googlebot-image

Rule Path
Disallow
Allow /*

mediapartners-google*

Rule Path
Disallow
Allow /*

ia_archiver

Rule Path
Disallow /

duggmirror

Rule Path
Disallow /

*

Rule Path
Disallow /citation/generator/folders/

googlebot

Rule Path
Allow /citation/generator/folders/

bingbot

Rule Path
Allow /citation/generator/folders/

audigentadbot

Rule Path
Disallow /citation/generator/folders/

ias_crawler

Rule Path
Disallow /citation/generator/folders/

sirdatabot

Rule Path
Disallow /citation/generator/folders/

claudebot

Rule Path
Disallow /citation/generator/folders/

leikibot

Rule Path
Disallow /citation/generator/folders/

isbot

Rule Path
Disallow /citation/generator/folders/

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Comments

  • Google Image
  • Google AdSense
  • Internet Archiver Wayback Machine
  • digg mirror
  • Rule for Citation Generator Folder