abcosport.com.sitetech.tips
robots.txt

Robots Exclusion Standard data for abcosport.com.sitetech.tips

Resource Scan

Scan Details

Site Domain abcosport.com.sitetech.tips
Base Domain sitetech.tips
Scan Status Ok
Last Scan2025-10-13T15:58:44+00:00
Next Scan 2025-11-12T15:58:44+00:00

Last Scan

Scanned2025-10-13T15:58:44+00:00
URL https://abcosport.com.sitetech.tips/robots.txt
Domain IPs 51.254.238.171
Response IP 51.254.238.171
Found Yes
Hash 7a19ec8de1445975168f50a90098b8c47406cb6683a82d3e20137d6a3f212b1e
SimHash 683cdc608710

Groups

*

Rule Path
Disallow /*.svg$

semrush

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

barkrowler/0.9

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

clark-crawler2/nutch-1.19-snapshot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://sitetech.tips/sitemap_05/sitemap.xml