atelierultau.ro
robots.txt
Robots Exclusion Standard data for atelierultau.ro
Resource Scan
Scan Details
| Site Domain | atelierultau.ro |
| Base Domain | atelierultau.ro |
| Scan Status | Ok |
| Last Scan | 2024-06-22T10:01:30+00:00 |
| Next Scan | 2024-07-22T10:01:30+00:00 |
Last Scan
| Scanned | 2024-06-22T10:01:30+00:00 |
| URL | https://atelierultau.ro/robots.txt |
| Redirect | https://www.atelierultau.ro/robots.txt |
| Redirect Domain | www.atelierultau.ro |
| Redirect Base | atelierultau.ro |
| Domain IPs | 185.92.193.50 |
| Redirect IPs | 185.92.193.50 |
| Response IP | 185.92.193.50 |
| Found | Yes |
| Hash | cae0bc485f87d9c8deb6ea001a8f3c82b61ba3fab86c3fbf97691e0e4ee6d15c |
| SimHash | 936aab110e07 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /download/ |
| Disallow | /includes/ |
| Disallow | /pub/ |
| Disallow | /webalizer/ |
| Disallow | /.htaccess |
| Disallow | /about_us.php |
| Disallow | /account.php |
| Disallow | /account_edit.php |
| Disallow | /account_history.php |
| Disallow | /account_history_info.php |
| Disallow | /account_newsletters.php |
| Disallow | /account_notifications.php |
| Disallow | /account_password.php |
| Disallow | /address_book.php |
| Disallow | /address_book_process.php |
| Disallow | /advanced_search.php |
| Disallow | /catalog.zip |
| Disallow | /checkout_confirmation.php |
| Disallow | /checkout_payment.php |
| Disallow | /checkout_payment_address.php |
| Disallow | /checkout_process.php |
| Disallow | /checkout_shipping.php |
| Disallow | /checkout_shipping_address.php |
| Disallow | /checkout_success.php |
| Disallow | /cookie_usage.php |
| Disallow | /create_account.php |
| Disallow | /create_account_success.php |
| Disallow | /download.php |
| Disallow | /info_shopping_cart.php |
| Disallow | /login.php |
| Disallow | /logoff.php |
| Disallow | /password_forgotten.php |
| Disallow | /popup_image.php |
| Disallow | /popup_search_help.php |
| Disallow | /redirect.php |
| Disallow | /shopping_cart.php |
| Disallow | /ssl_check.php |
exabot
pricybot
ahrefsbot
sistrix crawler
scrubby
robozilla
mj12bot
seokicks-robot
uptimerobot
ezooms robot
wiseguys robot
turnitin robot
heritrix
magpie-crawler
ccbot
sentibot
cliqzbot
mediatoolkitbot
megaindex
fatbot
curious george
tineye-bot
vegebot
baiduspider
baiduspider-image
yisouspider
proximic
speedyspider
psbot
obot
changedetection
memorybot
linkdexbot
blexbot
musobot
domainstatsbot
xovibot
jamesbot
mojeekbot
deusu
dotbot
semrushbot
semrushbot-sa
coccocbot-web
odklbot
garlikcrawler
checkmarknetwork
gigabot
blackwidow
chinaclaw
custo
disco
superbot
surfbot
bdcbot
| Rule | Path |
|---|---|
| Disallow | / |
ahrefsbot
baiduspider
baiduspider+
blackwidow
bot-
bot/
bot\ [email="craftbot@yahoo.com"]mailto
chinaclaw
crawl
custo
disco
disco/nutch-1.0-dev
dotbot
download\ demon
ecatch
eirgrabber
emailsiphon
emailwolf
exabot
express\ webpictures
extractorpro
eyenetie
flashget
getright
getweb!
gigabot
go-ahead-got-it
go!zilla
grabnet
grafula
hmview
httrack
ia_archiver
image\ stripper
image\ sucker
indy\ library
interget
internet\ ninja
jetcar
joc\ web\ spider
jyxobot
jyxobot/1
larbin
leechftp
mass\ downloader
midown\ tool
mister\ pix
mj12bot
navroad
nearsite
net\ vampire
netants
netspider
netzip
octopus
offline\ explorer
offline\ navigator
pagegrabber
papa\ foto
pavuk
pcbrowser
psbot
realdownload
reget
robot
rogerbot
sentibot
sentibot www.sentibot.eu (compatible with googlebot)
sitesnagger
smartdownload
spider
superbot
superhttp
surfbot
takeout
teleport\ pro
twiceler
voideye
web\ image\ collector
web\ sucker
webauto
webcopier
webfetch
webgo\ is
webleacher
webreaper
websauger
website\ extractor
website\ quester
webstripper
webwhacker
webzip
wget
widow
wwwoffle
xaldon\ webspider
yandex
zeus
| Rule | Path |
|---|---|
| Disallow | / |
Warnings
- 4 invalid lines.