biz.sitetech.tips
robots.txt

Robots Exclusion Standard data for biz.sitetech.tips

Resource Scan

Scan Details

Site Domain biz.sitetech.tips
Base Domain sitetech.tips
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2025-10-06T13:35:42+00:00
Next Scan 2026-01-04T13:35:42+00:00

Last Successful Scan

Scanned2023-11-23T17:19:07+00:00
URL http://biz.sitetech.tips/robots.txt
Domain IPs 51.254.238.171
Response IP 51.254.238.171
Found Yes
Hash 7a19ec8de1445975168f50a90098b8c47406cb6683a82d3e20137d6a3f212b1e
SimHash 683cdc608710

Groups

*

Rule Path
Disallow /*.svg$

semrush

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

barkrowler/0.9

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

clark-crawler2/nutch-1.19-snapshot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://sitetech.tips/sitemap_05/sitemap.xml