mayranet.com
robots.txt

Robots Exclusion Standard data for mayranet.com

Resource Scan

Scan Details

Site Domain mayranet.com
Base Domain mayranet.com
Scan Status Ok
Last Scan2026-04-05T01:50:34+00:00
Next Scan 2026-05-05T01:50:34+00:00

Last Scan

Scanned2026-04-05T01:50:34+00:00
URL https://mayranet.com/robots.txt
Domain IPs 78.111.106.35
Response IP 78.111.106.35
Found Yes
Hash 0f37bff830b84dfcf08d61a8fff0a265f2f20173b86fe115d1a5429668b87122
SimHash 435cd871c6b1

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

httrack

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

exabot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://mayranet.com/sitemap.xml