mostbet-fyl.top
robots.txt

Robots Exclusion Standard data for mostbet-fyl.top

Resource Scan

Scan Details

Site Domain mostbet-fyl.top
Base Domain mostbet-fyl.top
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan3/28/2025, 3:11:31 PM
Next Scan 6/26/2025, 3:11:31 PM

Last Successful Scan

Scanned8/14/2023, 2:14:06 AM
URL https://mostbet-fyl.top/robots.txt
Domain IPs 104.21.50.192, 172.67.210.5, 2606:4700:3031::6815:32c0, 2606:4700:3037::ac43:d205
Response IP 172.67.210.5
Found Yes
Hash 768d120ed5b89206ee0670d353b418440004b945e036e60a8c5a14440a8dc20a
SimHash cf7dc2470250

Groups

yandex

Rule Path
Disallow /wp-admin
Disallow /reg
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /?s=*
Disallow /search*
Disallow */trackback/
Disallow */feed
Disallow */comments/
Disallow */comment
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow */embed*
Allow /wp-content/uploads/

googlebot

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /wp-admin
Disallow /reg
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /?s=*
Disallow /search*
Disallow */trackback/
Disallow */feed
Disallow */comments/
Disallow */comment
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow */embed*
Allow /wp-content/uploads/

*

Rule Path
Disallow /wp-admin
Disallow /reg
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /?s=*
Disallow /search*
Disallow */trackback/
Disallow */feed
Disallow */comments/
Disallow */comment
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow */embed*
Allow /wp-content/uploads/

googlebot-image

Rule Path
Allow /wp-content/uploads/

yandeximages

Rule Path
Allow /wp-content/uploads/

mediapartners-google

Rule Path
Disallow

yadirectbot

Rule Path
Disallow

Other Records

Field Value
sitemap https://mostbet-fyl.top/sitemap_index.xml

Warnings

  • `host` is not a known field.