1xbet-terf.top
robots.txt

Robots Exclusion Standard data for 1xbet-terf.top

Resource Scan

Scan Details

Site Domain 1xbet-terf.top
Base Domain 1xbet-terf.top
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-04-04T01:40:36+00:00
Next Scan 2024-07-03T01:40:36+00:00

Last Successful Scan

Scanned2023-02-16T23:23:46+00:00
URL https://1xbet-terf.top/robots.txt
Redirect https://1xbet-rurus.top/robots.txt
Redirect Domain 1xbet-rurus.top
Redirect Base 1xbet-rurus.top
Domain IPs 104.21.16.225, 172.67.216.69, 2606:4700:3031::6815:10e1, 2606:4700:3036::ac43:d845
Redirect IPs 104.21.52.192, 172.67.203.54, 2606:4700:3030::ac43:cb36, 2606:4700:3031::6815:34c0
Response IP 172.67.203.54
Found Yes
Hash 7e3d6c5aacee421d9829f7b8d5866c135eaa4bcd29eb902feb60af0b1e97750a
SimHash 4b7543450654

Groups

yandex

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /?s=*
Disallow /search*
Disallow */trackback/
Disallow */feed
Disallow */comments/
Disallow */comment
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow */embed*
Disallow /goo
Allow /wp-content/uploads/

googlebot

Rule Path
Disallow /wp-admin
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /?s=*
Disallow /search*
Disallow */trackback/
Disallow */feed
Disallow */comments/
Disallow */comment
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow */embed*
Disallow /goo
Allow /wp-content/uploads/

mail.ru

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /?s=*
Disallow /search*
Disallow */trackback/
Disallow */feed
Disallow */comments/
Disallow */comment
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow */embed*
Disallow /goo
Allow /wp-content/uploads/

*

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /?s=*
Disallow /search*
Disallow */trackback/
Disallow */feed
Disallow */comments/
Disallow */comment
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow */embed*
Disallow /goo
Allow /wp-content/uploads/

googlebot-image

Rule Path
Allow /wp-content/uploads/

yandeximages

Rule Path
Allow /wp-content/uploads/

mediapartners-google

Rule Path
Disallow

yadirectbot

Rule Path
Disallow

Other Records

Field Value
sitemap https://1xbet-rurus.top/sitemap.xml