terracon.com
robots.txt

Robots Exclusion Standard data for terracon.com

Resource Scan

Scan Details

Site Domain terracon.com
Base Domain terracon.com
Scan Status Ok
Last Scan2025-12-30T06:33:15+00:00
Next Scan 2026-01-29T06:33:15+00:00

Last Scan

Scanned2025-12-30T06:33:15+00:00
URL https://terracon.com/robots.txt
Redirect https://www.terracon.com/robots.txt
Redirect Domain www.terracon.com
Redirect Base terracon.com
Domain IPs 141.193.213.10
Redirect IPs 141.193.213.10
Response IP 141.193.213.10
Found Yes
Hash 68af27459d84b7fb3f0d13001357ee4d3274d316f433a47355be76971d609257
SimHash f209dc54c25d

Groups

*

Rule Path
Disallow /?s*
Disallow *?ical*
Disallow /*?post_type=tribe*
Disallow /?platform=hootsuitepage
Disallow /calendar/action*
Disallow /conferences-tradeshows/tag/
Disallow /conferences-tradeshows/list/*/?tribe*
Disallow /events/action*
Disallow /lifecycle_stage_category/
Disallow /office_category/
Disallow /sector_category/
Disallow /service_category/
Disallow /staff_type_category/
Disallow /stories_display_category/
Disallow /stories_type_category/
Disallow /wp-content/plugins/vc524-googlemap/
Disallow /wp-content/themes/terraconEmployee/
Disallow /wp-content/wflogs/

mj12bot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

ultimate_sitemap_parser

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

petalbot

Rule Path
Disallow /

amazonbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

alittle client

Rule Path
Disallow /

arctic wolf scan

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://www.terracon.com/sitemap_index.xml

Comments

  • _______ ______ _____ _____ _____ ____ _ _
  • |__ __| ____| __ \| __ \ /\ / ____/ __ \| \ | |
  • | | | |__ | |__) | |__) | / \ | | | | | | \| |
  • | | | __| | _ /| _ / / /\ \| | | | | | . ` |
  • | | | |____| | \ \| | \ \ / ____ \ |___| |__| | |\ |
  • |_| |______|_| \_\_| \_\/_/ \_\_____\____/|_| \_|
  • -- 7/29/25 MB --

Warnings

  • `crawl-dealy` is not a known field.