applebay.ru
robots.txt

Robots Exclusion Standard data for applebay.ru

Resource Scan

Scan Details

Site Domain applebay.ru
Base Domain applebay.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-04-02T08:46:29+00:00
Next Scan 2025-07-01T08:46:29+00:00

Last Successful Scan

Scanned2023-11-17T08:33:20+00:00
URL https://applebay.ru/robots.txt
Domain IPs 104.21.46.205, 172.67.141.200, 2606:4700:3031::6815:2ecd, 2606:4700:3033::ac43:8dc8
Response IP 104.21.46.205
Found Yes
Hash 06289ed4a52236664f59cdd6938a764df3ba4cf7cc41804a688de67467539227
SimHash 515b5935dadc

Groups

semrushbot

Rule Path
Disallow /

xenu

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

googlebot

Rule Path
Allow *.js
Allow *.css
Allow *.png
Allow *.jpg
Allow /wp-content/themes/
Disallow /wp-login.php
Disallow /play/
Disallow /go/
Disallow /wp-register.php
Disallow /wp-json/
Disallow /cgi-bin/
Disallow /uncategorized/
Disallow /author/
Disallow */feed/
Disallow */trackback/
Disallow */turbo/*
Disallow */resources.xml/
Disallow /?repeat=w3tc
Disallow /category/
Disallow /feed/turbopage/
Disallow /feed/turbopost/
Disallow /feed/turbopost/*
Disallow /payments/
Disallow /?p=*

yandex

Rule Path
Disallow /