Log In Sign Up

trabajarbaleares.com
robots.txt

Robots Exclusion Standard data for trabajarbaleares.com

Resource Scan

Scan Details

Site Domain trabajarbaleares.com
Base Domain trabajarbaleares.com
Scan Status Ok
Last Scan2024-09-24T06:43:50+00:00
Next Scan 2024-10-01T06:43:50+00:00

Last Scan

Scanned2024-09-24T06:43:50+00:00
URL https://trabajarbaleares.com/robots.txt
Redirect https://www.trabajarbaleares.com/robots.txt
Redirect Domain www.trabajarbaleares.com
Redirect Base trabajarbaleares.com
Domain IPs 136.243.36.55, 2a01:4f8:212:42b::2
Redirect IPs 136.243.36.55, 2a01:4f8:212:42b::2
Response IP 136.243.36.55
Found Yes
Hash 90220da4327b58dbd603ac5a6f523d872889f9bf4b413249556785699017d447
SimHash 4394c22b4820

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-content/uploads/wpo/wpo-plugins-tables-list.json
Allow /
Disallow /wp-includes/
Disallow /xmlrpc.php
Disallow /*.pdf$

qihoobot

Rule Path
Disallow /

omniexplorer_bot

Rule Path
Disallow /

tmcrawler

Rule Path
Disallow /

exabot

Rule Path
Disallow /

tm.net.my

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

asterias

Rule Path
Disallow /

jyxobot/1

Rule Path
Disallow /

backdoorbot/1.0

Rule Path
Disallow /

black hole

Rule Path
Disallow /

botalot

Rule Path
Disallow /

builtbottough

Rule Path
Disallow /

bullseye/1.0

Rule Path
Disallow /

copyrightcheck

Rule Path
Disallow /

dittospyder

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

erocrawler

Rule Path
Disallow /

extractorpro

Rule Path
Disallow /

fairad client

Rule Path
Disallow /

flaming attackbot

Rule Path
Disallow /

foobot

Rule Path
Disallow /

gaisbot

Rule Path
Disallow /

grub

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

harvest/1.5

Rule Path
Disallow /

hloader

Rule Path
Disallow /

infonavirobot

Rule Path
Disallow /

iron33/1.0.2

Rule Path
Disallow /

jennybot

Rule Path
Disallow /

larbin

Rule Path
Disallow /

lexibot

Rule Path
Disallow /

linkextractorpro

Rule Path
Disallow /

linkscan/8.1a unix

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

lnspiderguy

Rule Path
Disallow /

lwp-trivial

Rule Path
Disallow /

lwp-trivial/1.34

Rule Path
Disallow /

mata hari

Rule Path
Disallow /

mister pix

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

openbot

Rule Path
Disallow /

openfind

Rule Path
Disallow /

openfind data gathere

Rule Path
Disallow /

oracle ultra search

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

spankbot

Rule Path
Disallow /

spanner

Rule Path
Disallow /

titan

Rule Path
Disallow /

true_robot

Rule Path
Disallow /

true_robot/1.0

Rule Path
Disallow /

turingos

Rule Path
Disallow /

url control

Rule Path
Disallow /

url_spider_pro

Rule Path
Disallow /

urly warning

Rule Path
Disallow /

vci

Rule Path
Disallow /

vci webviewer vci webviewer win32

Rule Path
Disallow /

web image collector

Rule Path
Disallow /

webauto

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

webbandit/3.50

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webenhancer

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.trabajarbaleares.com/sitemap.xml
sitemap https://www.trabajarbaleares.com/sitemap.rss
Back to top