fibrenew.com
robots.txt

Robots Exclusion Standard data for fibrenew.com

Resource Scan

Scan Details

Site Domain fibrenew.com
Base Domain fibrenew.com
Scan Status Ok
Last Scan2025-10-19T16:51:01+00:00
Next Scan 2025-11-02T16:51:01+00:00

Last Scan

Scanned2025-10-19T16:51:01+00:00
URL https://fibrenew.com/robots.txt
Redirect https://www.fibrenew.com/robots.txt
Redirect Domain www.fibrenew.com
Redirect Base fibrenew.com
Domain IPs 172.66.40.203, 172.66.43.53, 2606:4700:3108::ac42:28cb, 2606:4700:3108::ac42:2b35
Redirect IPs 172.66.40.203, 172.66.43.53, 2606:4700:3108::ac42:28cb, 2606:4700:3108::ac42:2b35
Response IP 172.66.40.203
Found Yes
Hash 3c31189f04c7df7c76b0828abbef77619322690174611ed365744baa0b910454
SimHash 428858a58792

Groups

googlebot

Rule Path
Disallow /?option=com_events*
Disallow /index.php?option=com_events*
Disallow /wp-admin/admin-ajax.php
Disallow /training-prep/
Disallow /training-prep
Disallow /sample/
Disallow /sample/files/site-map.xml
Disallow /color-blind-assessment/
Disallow /lead-background-form/
Disallow /lead-assessments/
Disallow /franchisee-login/

slurp

Rule Path
Disallow /*wp-admin/
Disallow /option%3Dcom_events*
Disallow /index.php?option=com_events*
Disallow /color-blind-assessment/
Disallow /lead-background-form/
Disallow /lead-assessments/
Disallow /franchisee-login/

*

Rule Path
Disallow /wp-admin/
Disallow /complaints/
Disallow /to2016/
Disallow /at2017/
Disallow /list/
Disallow /ce2019/
Disallow /ce2020/
Disallow /wp-admin/admin-ajax.php
Disallow /jobber-request-form/
Disallow /sample/
Disallow /sample/files/site-map.xml
Disallow /training-prep/
Disallow /training-prep
Disallow /lead-background-form/
Disallow /color-blind-assessment/
Disallow /lead-assessments/
Disallow /emailconfirm/
Disallow /emailoptout/
Disallow /franchisee-login/

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap https://www.fibrenew.com/files/site-map.xml