balivillasforsale.xyz
robots.txt

Robots Exclusion Standard data for balivillasforsale.xyz

Resource Scan

Scan Details

Site Domain balivillasforsale.xyz
Base Domain balivillasforsale.xyz
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer redirected incorrectly.
Last Scan2024-04-14T04:13:23+00:00
Next Scan 2024-07-13T04:13:23+00:00

Last Successful Scan

Scanned2023-11-23T23:53:10+00:00
URL https://balivillasforsale.xyz/robots.txt
Domain IPs 104.21.40.216, 172.67.139.9, 2606:4700:3030::ac43:8b09, 2606:4700:3037::6815:28d8
Response IP 104.21.40.216
Found Yes
Hash de469a2b9e8d54631bb36114d6fcbda70308bd97d09f6a281841d53aa9db2cd9
SimHash 3a5dde637e8a

Groups

*
googlebot

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

semrushbot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

begunadvertising

Rule Path
Disallow /

begun

Rule Path
Disallow /

ntentbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

sputnikbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow /