new.argogeo.ru
robots.txt

Robots Exclusion Standard data for new.argogeo.ru

Resource Scan

Scan Details

Site Domain new.argogeo.ru
Base Domain argogeo.ru
Scan Status Ok
Last Scan2024-08-30T04:26:44+00:00
Next Scan 2024-09-29T04:26:44+00:00

Last Scan

Scanned2024-08-30T04:26:44+00:00
URL https://new.argogeo.ru/robots.txt
Domain IPs 81.177.49.5
Response IP 81.177.49.5
Found Yes
Hash 2b36582feddfba4a3c5918ff8de941491c6c780ac4ad158e07f639d442df409a
SimHash 856aa3629a50

Groups

*

Product Comment
* îáùèå ïðàâèëà äëÿ ðîáîòîâ âñåõ ïîèñêîâûõ ñèñòåì
Rule Path Comment
Disallow /cgi-bin ñëóæåáíàÿ ïàïêà äëÿ õðàíåíèÿ ñåðâåðíûõ ñêðèïòîâ
Disallow /wp- âñå ôàéëû WP: /wp-json/, /wp-includes, /wp-content/plugins
Disallow /wp/ åñëè åñòü ïîäêàòàëîã /wp/, ãäå óñòàíîâëåíà CMS (åñëè íåò,
Disallow *?s= ïîèñê ïî ñàéòó
Disallow *%26s%3D ïîèñê ïî ñàéòó
Disallow /search/ ïîèñê ïî ñàéòó
Disallow /author/ àðõèâ àâòîðà
Disallow /users/ àðõèâ ïîëüçîâàòåëåé
Disallow */trackback òðåêáåêè, óâåäîìëåíèÿ â êîììåíòàðèÿõ î ññûëêå íà âåá-äîêóìåíò
Disallow */feed âñå ôèäû
Disallow */rss rss ôèä
Disallow */embed âñå âñòðàèâàíèÿ
Disallow */wlwmanifest.xml xml-ôàéë ìàíèôåñòà Windows Live Writer (åñëè íå èñïîëüçóåòå,
Disallow /xmlrpc.php ôàéë WordPress API
Disallow *utm*%3D ññûëêè ñ utm-ìåòêàìè
Disallow *openstat%3D ññûëêè ñ ìåòêàìè openstat
Allow */uploads îòêðûâàåì ïàïêó ñ ôàéëàìè uploads
Allow /*/*.js îòêðûâàåì ôàéëû ñêðèïòîâ js
Allow /*/*.css îòêðûâàåì ôàëû css
Allow /wp-*.png ðàçðåøàåì èíäåêñèðîâàòü èçîáðàæåíèÿ
Allow /wp-*.jpg ðàçðåøàåì èíäåêñèðîâàòü èçîáðàæåíèÿ
Allow /wp-*.jpeg ðàçðåøàåì èíäåêñèðîâàòü èçîáðàæåíèÿ
Allow /wp-*.gif ðàçðåøàåì èíäåêñèðîâàòü ãèôêè
Allow /wp-admin/admin-ajax.php ðàçðåøàåì ajax

Comments

  • Disallow: /? # âñå ïàðàìåòðû çàïðîñà íà ãëàâíîé
  • ïðàâèëî ìîæíî óäàëèòü)
  • ïðàâèëî ìîæíî óäàëèòü)