marathonbet-yj.xyz
robots.txt

Robots Exclusion Standard data for marathonbet-yj.xyz

Resource Scan

Scan Details

Site Domain marathonbet-yj.xyz
Base Domain marathonbet-yj.xyz
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-03-21T20:27:06+00:00
Next Scan 2024-06-19T20:27:06+00:00

Last Successful Scan

Scanned2022-09-12T19:10:39+00:00
URL https://marathonbet-yj.xyz/robots.txt
Redirect https://mar-mg.top/robots.txt
Redirect Domain mar-mg.top
Redirect Base mar-mg.top
Response IP 172.67.147.9
Found Yes
Hash 037bdce9a0db529fac25d7d5a10cd128383bafe3b5685dbf47e7bc8697c39293
SimHash 0b7dd3670670

Groups

yandex

Rule Path
Disallow /wp-admin
Disallow /reg
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /?s=*
Disallow /search*
Disallow */trackback/
Disallow */feed
Disallow */comments/
Disallow */comment
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow */embed*
Allow /wp-content/uploads/

googlebot

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /wp-admin
Disallow /reg
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /?s=*
Disallow /search*
Disallow */trackback/
Disallow */feed
Disallow */comments/
Disallow */comment
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow */embed*
Allow /wp-content/uploads/

*

Rule Path
Disallow /wp-admin
Disallow /reg
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /?s=*
Disallow /search*
Disallow */trackback/
Disallow */feed
Disallow */comments/
Disallow */comment
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow */embed*
Allow /wp-content/uploads/

googlebot-image

Rule Path
Allow /wp-content/uploads/

yandeximages

Rule Path
Allow /wp-content/uploads/

mediapartners-google

Rule Path
Disallow

yadirectbot

Rule Path
Disallow

Other Records

Field Value
sitemap https://mar-mg.top/sitemap_index.xml

Warnings

  • `host` is not a known field.