forwardforward.com
robots.txt

Robots Exclusion Standard data for forwardforward.com

Resource Scan

Scan Details

Site Domain forwardforward.com
Base Domain forwardforward.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2025-06-10T09:35:26+00:00
Next Scan 2025-09-08T09:35:26+00:00

Last Successful Scan

Scanned2024-10-21T07:39:35+00:00
URL http://forwardforward.com/robots.txt
Redirect https://www.fwrd.com/robots.txt
Redirect Domain www.fwrd.com
Redirect Base fwrd.com
Domain IPs 142.202.244.47
Redirect IPs 23.215.7.19, 23.215.7.23
Response IP 23.215.7.19
Found Yes
Hash 2fe7bc4c8eab200af9e5464d59971a30ff44437f93b61d1da90ab87edfd18842
SimHash 4126e6a182b1

Groups

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /WEB-INF/
Disallow /b/
Disallow /beta/
Disallow /productpages/
Disallow /hgg/
Disallow /classic/
Disallow /images/
Disallow /Unsubscribe.jsp
Disallow /luckybreaks/
Disallow /brandinfopages/
Disallow /beta3/
Disallow /fwd/Shipping.jsp
Disallow /fwd/AboutUs.jsp
Disallow /fwd/CustomerService.jsp
Disallow /fwd/Guarantee.jsp
Disallow /fwd/ReturnPolicy.jsp
Disallow /fwd/FAQ.jsp
Disallow /fwd/MyAccount.jsp
Disallow /fwd/LoginOrCreateAccount.jsp
Disallow /fwd/PrivacyPolicy.jsp
Disallow /blog/ViewFullPost.jsp
Disallow /r/
Disallow /fw/content/wishlist/

Other Records

Field Value
sitemap https://www.fwrd.com/scripts/fw_sitemap/fw_sitemap_index.xml

Comments

  • Block GPT crawler