maxi.by
robots.txt

Robots Exclusion Standard data for maxi.by

Resource Scan

Scan Details

Site Domain maxi.by
Base Domain maxi.by
Scan Status Ok
Last Scan2024-05-19T13:21:09+00:00
Next Scan 2024-05-26T13:21:09+00:00

Last Scan

Scanned2024-05-19T13:21:09+00:00
URL https://maxi.by/robots.txt
Redirect https://www.maxi.by/robots.txt
Redirect Domain www.maxi.by
Redirect Base maxi.by
Domain IPs 104.21.36.107, 172.67.192.148, 2606:4700:3033::6815:246b, 2606:4700:3037::ac43:c094
Redirect IPs 104.21.36.107, 172.67.192.148, 2606:4700:3033::6815:246b, 2606:4700:3037::ac43:c094
Response IP 172.67.192.148
Found Yes
Hash cbc7afb6ee7237500da1fc79e1b9b39af688a5f26aa370b3c5001f0480ef977c
SimHash 0010956d27b1

Groups

*

Rule Path
Disallow /iframe*
Disallow /*type%3D*
Disallow /suggest*
Allow /assets/*
Allow /js/*
Allow /*?brand_id=*
Allow /fonts/*
Allow /css/*

googlebot

Rule Path
Disallow /iframe*
Disallow /*type%3D*
Disallow /suggest*
Allow /assets/*
Allow /js/*
Allow /*?brand_id=*
Allow /fonts/*
Allow /css/*

yandex

Rule Path
Disallow /iframe*
Disallow /*type%3D*
Disallow /suggest*
Allow /assets/*
Allow /js/*
Allow /*?brand_id=*
Allow /fonts/*
Allow /css/*

mail.ru

Rule Path
Disallow /iframe*
Disallow /*type%3D*
Disallow /suggest*
Allow /assets/*
Allow /js/*
Allow /*?brand_id=*
Allow /fonts/*
Allow /css/*

stackrambler

Rule Path
Disallow /iframe*
Disallow /*type%3D*
Disallow /suggest*
Allow /assets/*
Allow /js/*
Allow /*?brand_id=*
Allow /fonts/*
Allow /css/*

bingbot

Rule Path
Disallow /iframe*
Disallow /*type%3D*
Disallow /suggest*
Allow /assets/*
Allow /js/*
Allow /*?brand_id=*
Allow /fonts/*
Allow /css/*

msnbot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

aport

Rule Path
Disallow /

yahoo! slurp

Rule Path
Disallow /

webalta

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

sputnikbot

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

insitesbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

exabot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

deusu

Rule Path
Disallow /

Warnings

  • `clean-param` is not a known field.