fabricresource.com
robots.txt

Robots Exclusion Standard data for fabricresource.com

Resource Scan

Scan Details

Site Domain fabricresource.com
Base Domain fabricresource.com
Scan Status Ok
Last Scan2025-11-23T09:05:17+00:00
Next Scan 2025-12-23T09:05:17+00:00

Last Scan

Scanned2025-11-23T09:05:17+00:00
URL https://fabricresource.com/robots.txt
Redirect https://www.fabricresource.com/robots.txt
Redirect Domain www.fabricresource.com
Redirect Base fabricresource.com
Domain IPs 104.21.57.181, 172.67.165.71, 2606:4700:3030::6815:39b5, 2606:4700:3033::ac43:a547
Redirect IPs 104.21.57.181, 172.67.165.71, 2606:4700:3030::6815:39b5, 2606:4700:3033::ac43:a547
Response IP 172.67.165.71
Found Yes
Hash dfa9e0635a4ede175ff649724c09c46eaee9ceed6e5520fd111bdbc8e94670d3
SimHash 4a39dc626682

Groups

*

Rule Path
Disallow /wp-content/uploads/wc-logs/
Disallow /wp-content/uploads/woocommerce_transient_files/
Disallow /wp-content/uploads/woocommerce_uploads/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-content/uploads/wpo/wpo-plugins-tables-list.json
Disallow /private-directory/

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Allow /

pinterestbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

duckduckbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

facebookexternalhit

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

seek

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.fabricresource.com/sitemap_index.xml

Comments

  • General Directives for All Bots
  • Sitemaps
  • Search Engine Bots
  • Block Aggressive or Non-Essential Bots