Log In Sign Up

gadalke.ru
robots.txt

Robots Exclusion Standard data for gadalke.ru

Resource Scan

Scan Details

Site Domain gadalke.ru
Base Domain gadalke.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-02-08T00:18:04+00:00
Next Scan 2025-05-09T00:18:04+00:00

Last Successful Scan

Scanned2024-09-19T00:16:37+00:00
URL https://gadalke.ru/robots.txt
Domain IPs 104.21.93.239, 172.67.216.179
Response IP 104.21.93.239
Found Yes
Hash b022f01ff1a69be1ae46d749eb47d1e1afadcdbabec12877c717d0c0632871a2
SimHash e04504c0d9bb

Groups

*

Rule Path
Allow /

yandex

Rule Path
Allow /

ia_archiver

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

anthropicbot

Rule Path
Disallow /

openaibot

Rule Path
Disallow /

deepmindbot

Rule Path
Disallow /

huggingfacebot

Rule Path
Disallow /

amazonwebservicesbot

Rule Path
Disallow /

ibmbot

Rule Path
Disallow /

bingaibot

Rule Path
Disallow /

twitterbot

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

applebot

Rule Path
Disallow /

tgstatbot

Rule Path
Disallow /

embedly

Rule Path
Disallow /

discordbot

Rule Path
Disallow /

gnnbot

Rule Path
Disallow /

gnomebot

Rule Path
Disallow /

unwantedeyesbot

Rule Path
Disallow /

webhookbot

Rule Path
Disallow /

malwareprevention

Rule Path
Disallow /

hyperiacrawler

Rule Path
Disallow /

gisbot

Rule Path
Disallow /

crawler@fast.no

Rule Path
Disallow /

stopmehandlersrv

Rule Path
Disallow /

trackingfilterbot

Rule Path
Disallow /

copyrightremovalbot

Rule Path
Disallow /

webcopycrawler

Rule Path
Disallow /

emailcollectorbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://gadalke.ru/sitemap.xml
sitemap https://gadalke.ru/sitemap.xml
Back to top