author24.ru
robots.txt

Robots Exclusion Standard data for author24.ru

Resource Scan

Scan Details

Site Domain author24.ru
Base Domain author24.ru
Scan Status Ok
Last Scan2024-05-21T13:02:08+00:00
Next Scan 2024-06-20T13:02:08+00:00

Last Scan

Scanned2024-05-21T13:02:08+00:00
URL https://author24.ru/robots.txt
Redirect https://avtor24.ru/robots.txt
Redirect Domain avtor24.ru
Redirect Base avtor24.ru
Domain IPs 104.21.75.78, 172.67.217.143, 2606:4700:3030::6815:4b4e, 2606:4700:3037::ac43:d98f
Redirect IPs 91.215.42.198
Response IP 91.215.42.198
Found Yes
Hash c484721816e07286ce93cc2bbc0445d78574b5e4e481f7c57edbf5f739c2a1d4
SimHash 6e961730c6a4

Groups

*

Rule Path
Disallow /forgot
Disallow /reg
Disallow /login
Disallow /partners
Disallow /readyworks/buy
Disallow /finished_works
Disallow /info/license
Disallow /*?*
Disallow /file/
Disallow /forumfile/
Disallow /order/
Disallow /home
Disallow /home/*
Disallow *?ref=*
Disallow *?rid=*
Disallow /withdraw/
Disallow /s/dissertaciya/
Disallow /s/form_zakaz_kursovye_ekonomika/
Disallow /order-authors
Disallow /*ekaterinburge*
Disallow /*-ufe*
Disallow /*nizhnem-novgorode*
Disallow /*samare*
Disallow /*krasnoyarske*
Disallow /*novosibirske*
Disallow *form_zakaz_*
Disallow */?popup*
Disallow */?page=*
Disallow /assets/
Disallow /lp/*
Disallow /my/
Disallow /home/
Disallow /portfolio/
Allow /articles/*/?page=*
Allow /lenta/?page=*
Allow /lenta/*/?page=*
Allow /readyworks/*/?page=*
Allow /readyworks/?page=*
Allow /s/otzyvy/?page=*
Allow /assets/css/*
Allow /assets/js/*
Allow /assets/fonts/*
Allow /assets/img/*
Allow /assets/ts/*
Allow /assets/video/*
Allow /assets/images/*

Warnings

  • `clean-param` is not a known field.