mar-fd.top
robots.txt

Robots Exclusion Standard data for mar-fd.top

Resource Scan

Scan Details

Site Domain mar-fd.top
Base Domain mar-fd.top
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-11-20T05:44:27+00:00
Next Scan 2026-01-19T05:44:27+00:00

Last Successful Scan

Scanned2025-09-27T14:15:58+00:00
URL https://mar-fd.top/robots.txt
Domain IPs 5.45.73.72
Response IP 5.45.73.72
Found Yes
Hash 06cdda2c636526f63055953e4b1d57f997e417890461f96cfc32427f4d5779ed
SimHash cb75c36702b4

Groups

yandex

Rule Path
Disallow /wp-admin
Disallow /reg
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /?s=*
Disallow /search*
Disallow */trackback/
Disallow */feed
Disallow */comments/
Disallow */comment
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow */embed*
Allow /wp-content/uploads/

googlebot

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /wp-admin
Disallow /reg
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /?s=*
Disallow /search*
Disallow */trackback/
Disallow */feed
Disallow */comments/
Disallow */comment
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow */embed*
Allow /wp-content/uploads/

*

Rule Path
Disallow /wp-admin
Disallow /reg
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /?s=*
Disallow /search*
Disallow */trackback/
Disallow */feed
Disallow */comments/
Disallow */comment
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow */embed*
Allow /wp-content/uploads/

googlebot-image

Rule Path
Allow /wp-content/uploads/

yandeximages

Rule Path
Allow /wp-content/uploads/

mediapartners-google

Rule Path
Disallow

yadirectbot

Rule Path
Disallow

Other Records

Field Value
sitemap https://mar-fd.top/sitemap_index.xml

Warnings

  • `host` is not a known field.