guy-duncan.com
robots.txt

Robots Exclusion Standard data for guy-duncan.com

Archived Snapshots

Resource Scan

Scan Details

Site Domain	guy-duncan.com
Base Domain	guy-duncan.com
Scan Status	Ok
Last Scan	2025-10-29T10:26:31+00:00
Next Scan	2025-11-28T10:26:31+00:00

Last Scan

Scanned	2025-10-29T10:26:31+00:00
URL	https://guy-duncan.com/robots.txt
Redirect	https://www.guy-duncan.com/robots.txt
Redirect Domain	www.guy-duncan.com
Redirect Base	guy-duncan.com
Domain IPs	138.113.117.24, 163.171.99.17, 2607:3f40:ff11::25, 2607:3f40:ff11::e6
Redirect IPs	138.113.117.24, 163.171.99.17, 2607:3f40:ff11::25, 2607:3f40:ff11::e6
Response IP	138.113.117.24
Found	Yes
Hash	2a83d26245681e2bd79f2bc05a108f87510629c15cc73e5c67d524954e7be68a
SimHash	023647708112

Groups

*

Rule	Path
Allow	/wp-admin/admin-ajax.php
Disallow	/wp-admin/

Rule

Path

Allow

/wp-admin/admin-ajax.php

Disallow

/wp-admin/

ahrefsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

mj12bot

Rule	Path
Disallow	/

Rule

Path

Disallow

rogerbot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot

Rule	Path
Disallow	/

Rule

Path

Disallow

ia_archiver

Rule	Path
Disallow	/

Rule

Path

Disallow

scoutjet

Rule	Path
Disallow	/

Rule

Path

Disallow

sistrix

Rule	Path
Disallow	/

Rule

Path

Disallow

searchmetricsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

seokicks-robot

Rule	Path
Disallow	/

Rule

Path

Disallow

lipperhey spider

Rule	Path
Disallow	/

Rule

Path

Disallow

exabot

Rule	Path
Disallow	/

Rule

Path

Disallow

ncbot

Rule	Path
Disallow	/

Rule

Path

Disallow

backlinkcrawler

Rule	Path
Disallow	/

Rule

Path

Disallow

archive.org_bot

Rule	Path
Disallow	/

Rule

Path

Disallow

meanpathbot

Rule	Path
Disallow	/

Rule

Path

Disallow

pagesinventory

Rule	Path
Disallow	/

Rule

Path

Disallow

aboundexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

spbot

Rule	Path
Disallow	/

Rule

Path

Disallow

linkdexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

gigabot

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot

Rule	Path
Disallow	/

Rule

Path

Disallow

nutch

Rule	Path
Disallow	/

Rule

Path

Disallow

blexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

ezooms

Rule	Path
Disallow	/

Rule

Path

Disallow

majestic-12

Rule	Path
Disallow	/

Rule

Path

Disallow

majestic-seo

Rule	Path
Disallow	/

Rule

Path

Disallow

dsearch

Rule	Path
Disallow	/

Rule

Path

Disallow

mj12

Rule	Path
Disallow	/

Rule

Path

Disallow

blekkobot

Rule	Path
Disallow	/

Rule

Path

Disallow

nerdybot

Rule	Path
Disallow	/

Rule

Path

Disallow

jamesbot

Rule	Path
Disallow	/

Rule

Path

Disallow

tineye

Rule	Path
Disallow	/

Rule

Path

Disallow

baiduspider

Rule	Path
Disallow	/

Rule

Path

Disallow

serpstat

Rule	Path
Disallow	/

Rule

Path

Disallow

spyfu

Rule	Path
Disallow	/

Rule

Path

Disallow

prlog

Rule	Path
Disallow	/

Rule

Path

Disallow

Other Records

Field	Value
sitemap	https://www.guy-duncan.com/sitemap.xml
sitemap	https://www.guy-duncan.com/sitemap.rss

Field

Value

sitemap

https://www.guy-duncan.com/sitemap.xml

sitemap

https://www.guy-duncan.com/sitemap.rss

guy-duncan.comrobots.txt

Resource Scan

Scan Details

Last Scan

Groups

*

ahrefsbot

mj12bot

rogerbot

semrushbot

ia_archiver

scoutjet

sistrix

searchmetricsbot

seokicks-robot

lipperhey spider

exabot

ncbot

backlinkcrawler

archive.org_bot

meanpathbot

pagesinventory

aboundexbot

spbot

linkdexbot

gigabot

dotbot

nutch

blexbot

ezooms

majestic-12

majestic-seo

dsearch

mj12

blekkobot

nerdybot

jamesbot

tineye

baiduspider

serpstat

spyfu

prlog

Other Records

guy-duncan.com
robots.txt