fiberexperts.com
robots.txt

Robots Exclusion Standard data for fiberexperts.com

Resource Scan

Scan Details

Site Domain fiberexperts.com
Base Domain fiberexperts.com
Scan Status Ok
Last Scan2025-10-07T04:33:54+00:00
Next Scan 2025-10-14T04:33:54+00:00

Last Scan

Scanned2025-10-07T04:33:54+00:00
URL https://fiberexperts.com/robots.txt
Redirect https://www.fiberexperts.com/robots.txt
Redirect Domain www.fiberexperts.com
Redirect Base fiberexperts.com
Domain IPs 66.29.137.138
Redirect IPs 66.29.137.138
Response IP 66.29.137.138
Found Yes
Hash 77035682c2a642ae56589fb845fdef03ff33a01ace99a404e7baf6e6dba620df
SimHash 8550c100a180

Groups

*

Rule Path
Disallow /availability/
Disallow /content/
Disallow /ForYourHome/
Disallow /b2c/
Disallow /internet/
Disallow /tv/
Disallow /wireless/
Disallow /voip/
Disallow /images/

googlebot

Rule Path
Disallow /forums/index.php?action=search*
Disallow /forums/index.php?action=calendar*
Disallow /forums/index.php?action=login*
Disallow /forums/index.php?action=register*
Disallow /forums/index.php?action=profile*
Disallow /forums/index.php?action=stats*
Disallow /forums/index.php?action=arcade*
Disallow /forums/index.php?action=printpage*
Disallow /forums/index.php?PHPSESSID=*
Disallow /forums/index.php?*rss*
Disallow /forums/index.php?*%3Bwap*
Disallow /forums/index.php?*%3Bwap2*
Disallow /forums/index.php?*%3Bimode*
Disallow /forums/Themes/*

Comments

  • Don't index mobile versions and profiles