intimdetka.ru
robots.txt

Robots Exclusion Standard data for intimdetka.ru

Resource Scan

Scan Details

Site Domain intimdetka.ru
Base Domain intimdetka.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-04-22T18:42:42+00:00
Next Scan 2024-07-21T18:42:42+00:00

Last Successful Scan

Scanned2023-12-02T18:41:14+00:00
URL https://intimdetka.ru/robots.txt
Redirect https://www.intimdetka.ru/robots.txt
Redirect Domain www.intimdetka.ru
Redirect Base intimdetka.ru
Domain IPs 104.21.78.125, 172.67.221.193, 2606:4700:3033::ac43:ddc1, 2606:4700:3036::6815:4e7d
Redirect IPs 104.21.78.125, 172.67.221.193, 2606:4700:3033::ac43:ddc1, 2606:4700:3036::6815:4e7d
Response IP 104.21.78.125
Found Yes
Hash fe670f6e0785c9bd956367a55da07b15a3fa7dd34c9932039648ce56abd66214
SimHash 611e48462611

Groups

googlebot

Rule Path
Allow /all
Allow /gorod_
Allow /devuski
Allow /parni
Allow /transy
Allow /bdsm
Allow /devushka_
Allow /paren_
Allow /trans_
Disallow /index.php$
Disallow /search/
Disallow /

googlebot-image

Rule Path
Allow /photos/bigp
Disallow /

googlebot-video

Rule Path
Allow video
Allow /clips
Disallow /

yandexbot

Rule Path
Allow /all
Allow /gorod_
Allow /devuski
Allow /parni
Allow /transy
Allow /bdsm
Allow /devushka_
Allow /paren_
Allow /trans_
Disallow /index.php$
Disallow /search/
Disallow /

yandexmetrika

Rule Path
Disallow /index.php
Allow /

yandexcatalog

Rule Path
Disallow /index.php
Allow /

yandexfavicons

Rule Path
Allow /favicon.ico
Disallow /

yandeximages

Rule Path
Allow /photos/bigp
Disallow /

yandexvideo

Rule Path
Allow video
Allow /clips
Disallow /

mail.ru bot

Rule Path
Allow /all
Allow /gorod_
Allow /devuski
Allow /parni
Allow /transy
Allow /bdsm
Allow /devushka_
Allow /paren_
Allow /trans_
Disallow /index.php$
Disallow /search/
Disallow /

bingbot

Rule Path
Allow /all
Allow /gorod_
Allow /devuski
Allow /parni
Allow /transy
Allow /bdsm
Allow /devushka_
Allow /paren_
Allow /trans_
Disallow /index.php$
Disallow /search/
Disallow /

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://interputa.ru/sitemap.xml