cdn.scribbr.com
robots.txt
Robots Exclusion Standard data for cdn.scribbr.com
Resource Scan
Scan Details
| Site Domain | cdn.scribbr.com |
| Base Domain | scribbr.com |
| Scan Status | Ok |
| Last Scan | 2025-11-22T20:55:15+00:00 |
| Next Scan | 2025-12-22T20:55:15+00:00 |
Last Scan
| Scanned | 2025-11-22T20:55:15+00:00 |
| URL | https://cdn.scribbr.com/robots.txt |
| Domain IPs | 104.18.24.114, 104.18.25.114, 2606:4700::6812:1872, 2606:4700::6812:1972 |
| Response IP | 104.18.25.114 |
| Found | Yes |
| Hash | 6fbe2402cb8527141db1637ab9fca1bca1d1ef066f52f3fc5b8706521c1b8a6c |
| SimHash | 43461893e6ee |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | /wp-admin |
| Disallow | /wp-includes |
| Disallow | /trackback |
| Disallow | /comments |
| Disallow | /wp-json |
| Disallow | */trackback |
| Disallow | */comments |
| Disallow | /category/uncategorized |
| Disallow | /cdn-cgi/ |
| Allow | /wp-content/uploads |
| Allow | /wp-admin/admin-ajax.php |
*
| Rule | Path |
|---|---|
| Disallow | /citation/generator/folders/ |
*
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
Comments