firewoodcafe.com
robots.txt

Robots Exclusion Standard data for firewoodcafe.com

Resource Scan

Scan Details

Site Domain firewoodcafe.com
Base Domain firewoodcafe.com
Scan Status Ok
Last Scan2024-06-30T16:13:05+00:00
Next Scan 2024-07-07T16:13:05+00:00

Last Scan

Scanned2024-06-30T16:13:05+00:00
URL https://firewoodcafe.com/robots.txt
Domain IPs 104.21.3.224, 172.67.153.186, 2606:4700:3030::ac43:99ba, 2606:4700:3037::6815:3e0
Response IP 172.67.153.186
Found Yes
Hash 3504f758dd40d6c3ba4eeb44644531fc30f99e97d6f8a067b85629a3233938bc
SimHash 6308c8e2a233

Groups

*

Rule Path
Allow /wp-content/uploads/
Allow /wp-admin/admin-ajax.php
Disallow /wp-login.php
Disallow /wp-admin/
Disallow /wp-content/plugins/
Disallow /wp-admin/
Disallow /readme.html
Disallow /refer/

bottraffic032.xyz

Rule Path
Disallow /

*

Rule Path
Disallow /trafficart.club

*

Rule Path
Disallow /cutt.ly/yxlHTUi

ahrefsbot

No rules defined. All paths allowed.

Comments

  • crawl-delay: 10
  • Crawl-delay: 30
  • crawl-delay: 20

Warnings

  • 1 invalid line.