nunusantander.com
robots.txt
Robots Exclusion Standard data for nunusantander.com
Resource Scan
Scan Details
Site Domain | nunusantander.com |
Base Domain | nunusantander.com |
Scan Status | Ok |
Last Scan | 2024-08-31T01:32:55+00:00 |
Next Scan | 2024-09-30T01:32:55+00:00 |
Last Scan
Scanned | 2024-08-31T01:32:55+00:00 |
URL | https://nunusantander.com/robots.txt |
Domain IPs | 104.26.12.236, 104.26.13.236, 172.67.75.236, 2606:4700:20::681a:cec, 2606:4700:20::681a:dec, 2606:4700:20::ac43:4bec |
Response IP | 104.26.13.236 |
Found | Yes |
Hash | cf7f716e1e790a6b150739433ec8b4009d2e9a8b442ef697fd40cc1295a3807a |
SimHash | e8995a0b48c5 |
Groups
*
Rule | Path |
---|---|
Allow | /wp-content/uploads/* |
Allow | /wp-content/*.js |
Allow | /wp-content/*.css |
Allow | /wp-includes/*.js |
Allow | /wp-includes/*.css |
Disallow | /cgi-bin |
Allow | /wp-admin/admin-ajax.php |
Disallow | /wp-admin/ |
Disallow | /wp-content/uploads/MRW/ |
Disallow | /wp-content/uploads/backupbuddy_backups/ |
Disallow | /wp-content/uploads/cart_product_feeds/ |
Disallow | /wp-content/uploads/csv_exports/ |
Disallow | /wp-content/uploads/gravity_forms/ |
Disallow | /wp-content/uploads/pb_backupbuddy/ |
Disallow | /wp-content/uploads/siteorigin-widgets/ |
Disallow | /wp-content/uploads/wc-logs/ |
Disallow | /wp-content/uploads/woocommerce_pdf_invoice/ |
Disallow | /wp-content/uploads/woocommerce_uploads/ |
Disallow | /wp-content/uploads/wp-migrate-db/ |
Disallow | /wp-content/uploads/wpallexport/ |
Disallow | /wp-content/uploads/wpo_wcpdf/ |
Disallow | /wp-content/uploads/wysija/ |
Disallow | /wp-content/uploads/ywpi-pdf-invoice/ |
Disallow | /wp-content/plugins/ |
Disallow | /wp-content/themes/ |
Disallow | /wp-includes/ |
Disallow | /*/attachment/ |
Disallow | /tag/*/page/ |
Disallow | /tag/*/feed/ |
Disallow | /page/ |
Disallow | /comments/ |
Disallow | /xmlrpc.php |
Disallow | /?attachment_id* |
Disallow | /*? |
Other Records
Field | Value |
---|---|
crawl-delay | 3 |
*
Rule | Path |
---|---|
Disallow | /?s= |
Disallow | /search |
*
Rule | Path |
---|---|
Disallow | /trackback |
Disallow | /*trackback |
Disallow | /*trackback* |
Disallow | /*/trackback |
*
Rule | Path |
---|---|
Allow | /feed/$ |
Disallow | /feed/ |
Disallow | /comments/feed/ |
Disallow | /*/feed/$ |
Disallow | /*/feed/rss/$ |
Disallow | /*/trackback/$ |
Disallow | /*/*/feed/$ |
Disallow | /*/*/feed/rss/$ |
Disallow | /*/*/trackback/$ |
Disallow | /*/*/*/feed/$ |
Disallow | /*/*/*/feed/rss/$ |
Disallow | /*/*/*/trackback/$ |
Comments