techclusion.com
robots.txt

Robots Exclusion Standard data for techclusion.com

Resource Scan

Scan Details

Site Domain techclusion.com
Base Domain techclusion.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-20T03:28:54+00:00
Next Scan 2026-02-18T03:28:54+00:00

Last Successful Scan

Scanned2025-07-23T23:20:24+00:00
URL https://techclusion.com/robots.txt
Redirect https://www.techclusion.com/robots.txt
Redirect Domain www.techclusion.com
Redirect Base techclusion.com
Domain IPs 2a02:4780:16:46b1:e567:7ce5:6939:a239, 2a02:4780:38:5f7:926:55ab:7385:5143, 84.32.84.179, 84.32.84.219
Redirect IPs 2a02:4780:16:2f25:159:cef8:752d:d882, 2a02:4780:39:6a38:f67f:3eae:38ce:a29c, 84.32.84.11, 84.32.84.7
Response IP 77.37.115.46
Found Yes
Hash e24b32c9f9c160d69a02e83327aa38547105c82f8681bc64fae5318f2a50a410
SimHash c8165c1acc9b

Groups

barkrowler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

*

Rule Path
Disallow /redirect/
Disallow /search/
Disallow /category/filters/
Disallow /*.html$

Other Records

Field Value
sitemap https://www.techclusion.com/sitemap.xml