Log In Sign Up

70milyon.com
robots.txt

Robots Exclusion Standard data for 70milyon.com

Resource Scan

Scan Details

Site Domain 70milyon.com
Base Domain 70milyon.com
Scan Status Ok
Last Scan2024-11-14T20:44:35+00:00
Next Scan 2024-12-14T20:44:35+00:00

Last Scan

Scanned2024-11-14T20:44:35+00:00
URL https://70milyon.com/robots.txt
Domain IPs 94.138.202.135
Response IP 94.138.202.135
Found Yes
Hash 9c8c06ef5f4dd3906ecec83a6aeacd256bdcf34f96b79326ad48edf7806f233f
SimHash c4df77716f23

Groups

asterias

Rule Path
Disallow /

bdbrandprotect

Rule Path
Disallow /

botalot

Rule Path
Disallow /

botrighthere

Rule Path
Disallow /

bpimagewalker

Rule Path
Disallow /

builtbottough

Rule Path
Disallow /

bunnyslippers

Rule Path
Disallow /

cazoodlebot

Rule Path
Disallow /

cegbfeieh

Rule Path
Disallow /

cheesebot

Rule Path
Disallow /

cherrypicker

Rule Path
Disallow /

converacrawler

Rule Path
Disallow /

copernic

Rule Path
Disallow /

copyrightcheck

Rule Path
Disallow /

cosmos

Rule Path
Disallow /

crescent

Rule Path
Disallow /

discobot

Rule Path
Disallow /

dittospyder

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

fetch

Rule Path
Disallow /

findlinks

Rule Path
Disallow /

foobot

Rule Path
Disallow /

gaisbot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

grub

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

hloader

Rule Path
Disallow /

miixpc

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

moget

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

netants

Rule Path
Disallow /

netmechanic

Rule Path
Disallow /

searchpreview

Rule Path
Disallow /

seoengbot

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

teleport

Rule Path
Disallow /

templeton

Rule Path
Disallow /

thenomad

Rule Path
Disallow /

tighttwatbot

Rule Path
Disallow /

titan

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

twengabot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

updownerbot

Rule Path
Disallow /

url_spider_pro

Rule Path
Disallow /

vci

Rule Path
Disallow /

webauto

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

webenhancer

Rule Path
Disallow /

webmasterworldforumbot

Rule Path
Disallow /

websauger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webzip

Rule Path
Disallow /

wget

Rule Path
Disallow /

woriobot

Rule Path
Disallow /

xenu

Rule Path
Disallow /

yacybit

Rule Path
Disallow /

yeti

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

zeus

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

ranksignals

Rule Path
Disallow /
Back to top