islandtourtransfer.com
robots.txt

Robots Exclusion Standard data for islandtourtransfer.com

Resource Scan

Scan Details

Site Domain islandtourtransfer.com
Base Domain islandtourtransfer.com
Scan Status Ok
Last Scan2024-09-19T08:06:25+00:00
Next Scan 2024-10-19T08:06:25+00:00

Last Scan

Scanned2024-09-19T08:06:25+00:00
URL https://islandtourtransfer.com/robots.txt
Domain IPs 209.124.66.18
Response IP 209.124.66.18
Found Yes
Hash d73f3a1a378208ce38c39808d94fd684d0fee8d2163bc33c00e2042b47567879
SimHash ab8d40104bb8

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-login
Disallow /*/feed/
Disallow /*/trackback/
Disallow /*/attachment/
Disallow /?attachment_id*
Disallow /comments/
Disallow /xmlrpc.php
Disallow /*?s=
Disallow /?s=*
Disallow /*/*/*/feed.xml
Disallow /*?replytocom
Allow /*.css$
Allow /*.js$

duggmirror

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /

b2w/0.1

Rule Path
Disallow /

compspybot

Rule Path
Disallow /

backdoorbot/1.0

Rule Path
Disallow /

blowfish/1.0

Rule Path
Disallow /

bookmark search tool

Rule Path
Disallow /

seoengworldbot

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

gsa-crawler

Rule Path
Disallow /

spinn3r

Rule Path
Disallow /

yolinkbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

libwww

Rule Path
Disallow /

scoop.it

Rule Path
Disallow /

Other Records

Field Value
sitemap Sitemap: https://islandtourtransfer.com/sitemap_index.xml