/.well-known/

Log In Sign Up

golfclubsforsalewanteduk.com
robots.txt

Robots Exclusion Standard data for golfclubsforsalewanteduk.com

Archived Snapshots

Resource Scan

Scan Details

Site Domain	golfclubsforsalewanteduk.com
Base Domain	golfclubsforsalewanteduk.com
Scan Status	Ok
Last Scan	2024-11-13T02:30:48+00:00
Next Scan	2024-12-13T02:30:48+00:00

Last Scan

Scanned	2024-11-13T02:30:48+00:00
URL	https://golfclubsforsalewanteduk.com/robots.txt
Domain IPs	192.95.19.210
Response IP	192.95.19.210
Found	Yes
Hash	f271e7429b1c76991404674df126ce719ab1ca6ef8caf12fc677f9c14a0a8152
SimHash	62126ff14392

Groups

*

Rule

Path

Disallow

/wp-admin/

Allow

/wp-admin/admin-ajax.php

ahrefsbot

Rule

Path

Disallow

/

semrushbot

Rule

Path

Disallow

/

mj12bot

Rule

Path

Disallow

/

screaming frog seo spider

Rule

Path

Disallow

/

majestic-12

Rule

Path

Disallow

/

sitebot

Rule

Path

Disallow

/

dotbot

Rule

Path

Disallow

/

rogerbot

Rule

Path

Disallow

/

ia_archiver

Rule

Path

Disallow

/

bubing

Rule

Path

Disallow

/

slurp

Rule

Path

Disallow

/

yandexbot

Rule

Path

Disallow

/

sistrix

Rule

Path

Disallow

/

seokicks-robot

Rule

Path

Disallow

/

megaindex.ru

Rule

Path

Disallow

/

blexbot

Rule

Path

Disallow

/

spbot

Rule

Path

Disallow

/

obot

Rule

Path

Disallow

/

exabot

Rule

Path

Disallow

/

grapeshot

Rule

Path

Disallow

/

mojeekbot

Rule

Path

Disallow

/

searchmetricsbot

Rule

Path

Disallow

/

siteexplorer

Rule

Path

Disallow

/

ccbot

Rule

Path

Disallow

/

james bot - webcrawler

Rule

Path

Disallow

/

grapeshotcrawler

Rule

Path

Disallow

/

coccocbot-web

Rule

Path

Disallow

/

linkpadbot

Rule

Path

Disallow

/

naverbot

Rule

Path

Disallow

/

enirobot

Rule

Path

Disallow

/

turnitinbot

Rule

Path

Disallow

/

trendictionbot

Rule

Path

Disallow

/

twengabot

Rule

Path

Disallow

/

voilabot

Rule

Path

Disallow

/

wbsearchbot

Rule

Path

Disallow

/

ssearch

Rule

Path

Disallow

/

xovibot

Rule

Path

Disallow

/

yioopbot

Rule

Path

Disallow

/

zumbot

Rule

Path

Disallow

/

stealthy siteopener

Rule

Path

Disallow

/

lipperhey spider

Rule

Path

Disallow

/

ranksonicbot

Rule

Path

Disallow

/

smtbot

Rule

Path

Disallow

/

haosouspider

Rule

Path

Disallow

/

baiduspider

Rule

Path

Disallow

/

searchbot

Rule

Path

Disallow

/

safesearch microdata crawler

Rule

Path

Disallow

/

aboundexbot

Rule

Path

Disallow

/

accoona-ai-agent

Rule

Path

Disallow

/

adscanner

Rule

Path

Disallow

/

alexibot

Rule

Path

Disallow

/

aphrospider

Rule

Path

Disallow

/

arachnode.net

Rule

Path

Disallow

/

backlink-check.de

Rule

Path

Disallow

/

blekkobot

Rule

Path

Disallow

/

browsershots

Rule

Path

Disallow

/

butterfly

Rule

Path

Disallow

/

careerbot

Rule

Path

Disallow

/

charlotte

Rule

Path

Disallow

/

cityreview

Rule

Path

Disallow

/

curious george

Rule

Path

Disallow

/

dataparksearch

Rule

Path

Disallow

/

daumoa

Rule

Path

Disallow

/

docomo

Rule

Path

Disallow

/

domaincrawler

Rule

Path

Disallow

/

dragonfly

Rule

Path

Disallow

/

dudley

Rule

Path

Disallow

/

ecxi

Rule

Path

Disallow

/

envolkits

Rule

Path

Disallow

/

expertsearchspider

Rule

Path

Disallow

/

factbot

Rule

Path

Disallow

/

fairshare

Rule

Path

Disallow

/

findxbot

Rule

Path

Disallow

/

flipboardproxy

Rule

Path

Disallow

/

fyberspider

Rule

Path

Disallow

/

g2reader-bot

Rule

Path

Disallow

/

gigabot

Rule

Path

Disallow

/

glowscraper

Rule

Path

Disallow

/

gnam gnam spider

Rule

Path

Disallow

/

googlebot-image

Rule

Path

Disallow

/

grapeshotcrawler

Rule

Path

Disallow

/

greenyogi

Rule

Path

Disallow

/

ichiro

Rule

Path

Disallow

/

icjobs

Rule

Path

Disallow

/

infohelfer

Rule

Path

Disallow

/

infohelfer

Rule

Path

Disallow

/

ingrid

Rule

Path

Disallow

/

istellabot

Rule

Path

Disallow

/

iviacore

Rule

Path

Disallow

/

jam

Rule

Path

Disallow

/

justcrawl

Rule

Path

Disallow

/

kaspersky lab cfr link resolver

Rule

Path

Disallow

/

kmbot

Rule

Path

Disallow

/

kmccrew bot

Rule

Path

Disallow

/

kylinbot

Rule

Path

Disallow

/

larabot

Rule

Path

Disallow

/

libwww-perl

Rule

Path

Disallow

/

linguee bot

Rule

Path

Disallow

/

livelapbot

Rule

Path

Disallow

/

loadtimebot

Rule

Path

Disallow

/

lycos_spider

Rule

Path

Disallow

/

magpie-crawler

Rule

Path

Disallow

/

mail.ru_bot

Rule

Path

Disallow

/

meanpath bot

Rule

Path

Disallow

/

mixrankbot

Rule

Path

Disallow

/

morning_paper

Rule

Path

Disallow

/

msnbot-media

Rule

Path

Disallow

/

mxbot

Rule

Path

Disallow

/

nerdbynature.bot

Rule

Path

Disallow

/

netluchs

Rule

Path

Disallow

/

netseer

Rule

Path

Disallow

/

newsblur spider

Rule

Path

Disallow

/

nutanixclusterbot

Rule

Path

Disallow

/

omniexplorer_bot

Rule

Path

Disallow

/

openhosebot

Rule

Path

Disallow

/

openindexspider

Rule

Path

Disallow

/

pagesinventory

Rule

Path

Disallow

/

paperlibot

Rule

Path

Disallow

/

pebblecrawler

Rule

Path

Disallow

/

peepbot

Rule

Path

Disallow

/

pensacolahttp

Rule

Path

Disallow

/

phpcrawl

Rule

Path

Disallow

/

pollyapocalypse

Rule

Path

Disallow

/

postpost

Rule

Path

Disallow

/

qwantify

Rule

Path

Disallow

/

rogerbot

Rule

Path

Disallow

/

sandcrawler

Rule

Path

Disallow

/

scrapy

Rule

Path

Disallow

/

seokicks

Rule

Path

Disallow

/

shopwiki

Rule

Path

Disallow

/

similarsitecheck

No rules defined. All paths allowed.

Back to top

Other Records

Field

Value

sitemap

https://golfclubsforsalewanteduk.com/sitemap.xml

sitemap

https://golfclubsforsalewanteduk.com/sitemap.rss

Back to top

Warnings

4 invalid lines.

Back to top