1xbet-tnw.top
robots.txt

Robots Exclusion Standard data for 1xbet-tnw.top

Resource Scan

Scan Details

Site Domain 1xbet-tnw.top
Base Domain 1xbet-tnw.top
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-04-03T00:19:00+00:00
Next Scan 2024-07-02T00:19:00+00:00

Last Successful Scan

Scanned2023-08-13T19:21:37+00:00
URL https://1xbet-tnw.top/robots.txt
Redirect https://1xbet-rab.top/robots.txt
Redirect Domain 1xbet-rab.top
Redirect Base 1xbet-rab.top
Domain IPs 104.21.46.240, 172.67.143.46, 2606:4700:3032::ac43:8f2e, 2606:4700:3037::6815:2ef0
Redirect IPs 104.21.76.227, 172.67.201.236, 2606:4700:3031::ac43:c9ec, 2606:4700:3034::6815:4ce3
Response IP 104.21.76.227
Found Yes
Hash 1aaa3bc6a51067e2308087b236bcbecf46b81622d4a84c9cc73ec6dbf72457ea
SimHash cb75d2670270

Groups

yandex

Rule Path
Disallow /wp-admin
Disallow /reg
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /?s=*
Disallow /search*
Disallow */trackback/
Disallow */feed
Disallow */comments/
Disallow */comment
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow */embed*
Allow /wp-content/uploads/

googlebot

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /wp-admin
Disallow /reg
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /?s=*
Disallow /search*
Disallow */trackback/
Disallow */feed
Disallow */comments/
Disallow */comment
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow */embed*
Allow /wp-content/uploads/

*

Rule Path
Disallow /wp-admin
Disallow /reg
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /?s=*
Disallow /search*
Disallow */trackback/
Disallow */feed
Disallow */comments/
Disallow */comment
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow */embed*
Allow /wp-content/uploads/

googlebot-image

Rule Path
Allow /wp-content/uploads/

yandeximages

Rule Path
Allow /wp-content/uploads/

mediapartners-google

Rule Path
Disallow

yadirectbot

Rule Path
Disallow

Other Records

Field Value
sitemap https://1xbet-rab.top/sitemap_index.xml

Warnings

  • `host` is not a known field.