Log In Sign Up

vastavalo.net
robots.txt

Robots Exclusion Standard data for vastavalo.net

Resource Scan

Scan Details

Site Domain vastavalo.net
Base Domain vastavalo.net
Scan Status Ok
Last Scan2024-09-22T20:54:58+00:00
Next Scan 2024-10-22T20:54:58+00:00

Last Scan

Scanned2024-09-22T20:54:58+00:00
URL https://vastavalo.net/robots.txt
Redirect https://www.vastavalo.net/robots.txt
Redirect Domain www.vastavalo.net
Redirect Base vastavalo.net
Domain IPs 173.212.236.153
Redirect IPs 173.212.236.153
Response IP 173.212.236.153
Found Yes
Hash d0e967205e9e8ad916308b28a2a04259bf4e1c8dc7d674b3e51f7f0b6b3583b4
SimHash 6a797ac2c919

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bingbot/2.0

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

msnbot-media

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

yahoo-slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

yahoo! slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

applebot

Product Comment
applebot apple

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

yandex

Rule Path
Disallow /

*

Rule Path
Disallow /tilaa-X2.php
Disallow /addfav.php
Disallow /addfav2.php
Disallow /keskustelu/
Disallow /login.php
Disallow /register.php
Disallow /displayimage.php
Disallow /tilaa.php
Disallow /tilaa-muistilista.php
Disallow /upload.php
Disallow /ratepic.php
Disallow /login.php
Disallow /logout.php
Disallow /info-international_orders.php
Disallow /info-international_orders-b.php
Disallow /info-international_orders2.php
Disallow /info-international_orders2-b.php
Disallow /editOnePic.php
Disallow /haku-Chrysopa.html
Disallow /haku-chrysopa.html
Disallow /search-chrysopa.html
Disallow /search-Chrysopa.html

ia_archiver

Rule Path
Disallow /displayimage.php
Disallow /search.php

spbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

webzip

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

web downloader

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

offline explorer pro

Rule Path
Disallow /

httrack website copier

Rule Path
Disallow /

offline commander

Rule Path
Disallow /

leech

Rule Path
Disallow /

websnake

Rule Path
Disallow /

blackwidow

Rule Path
Disallow /

http weazel

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

riddler

Rule Path
Disallow /

riddlerbot

Rule Path
Disallow /

acoonbot

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

riddler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

paracrawl

Rule Path
Disallow /
Back to top