devdiscussions.com
robots.txt

Robots Exclusion Standard data for devdiscussions.com

Archived Snapshots

Resource Scan

Scan Details

Site Domain	devdiscussions.com
Base Domain	devdiscussions.com
Scan Status	Failed
Failure Stage	Fetching resource.
Failure Reason	Server redirected incorrectly.
Last Scan	2025-05-31T20:22:23+00:00
Next Scan	2025-06-07T20:22:23+00:00

Last Successful Scan

Scanned	2025-04-16T20:03:57+00:00
URL	https://devdiscussions.com/robots.txt
Domain IPs	104.21.63.132, 172.67.145.197, 2606:4700:3034::6815:3f84, 2606:4700:3036::ac43:91c5
Response IP	104.21.63.132
Found	Yes
Hash	80f34b79fb7c0ebd147ea5b9f31389faefad22aebc67266b33c802dde4df4fdf
SimHash	02544440d11a

Groups

ahrefsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

mj12bot

Rule	Path
Disallow	/

Rule

Path

Disallow

rogerbot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot

Rule	Path
Disallow	/

Rule

Path

Disallow

ia_archiver

Rule	Path
Disallow	/

Rule

Path

Disallow

scoutjet

Rule	Path
Disallow	/

Rule

Path

Disallow

sistrix

Rule	Path
Disallow	/

Rule

Path

Disallow

searchmetricsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

seokicks-robot

Rule	Path
Disallow	/

Rule

Path

Disallow

lipperhey spider

Rule	Path
Disallow	/

Rule

Path

Disallow

exabot

Rule	Path
Disallow	/

Rule

Path

Disallow

ncbot

Rule	Path
Disallow	/

Rule

Path

Disallow

backlinkcrawler

Rule	Path
Disallow	/

Rule

Path

Disallow

archive.org_bot

Rule	Path
Disallow	/

Rule

Path

Disallow

meanpathbot

Rule	Path
Disallow	/

Rule

Path

Disallow

pagesinventory

Rule	Path
Disallow	/

Rule

Path

Disallow

aboundexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

spbot

Rule	Path
Disallow	/

Rule

Path

Disallow

linkdexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

gigabot

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot

Rule	Path
Disallow	/

Rule

Path

Disallow

nutch

Rule	Path
Disallow	/

Rule

Path

Disallow

blexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

ezooms

Rule	Path
Disallow	/

Rule

Path

Disallow

majestic-12

Rule	Path
Disallow	/

Rule

Path

Disallow

majestic-seo

Rule	Path
Disallow	/

Rule

Path

Disallow

dsearch

Rule	Path
Disallow	/

Rule

Path

Disallow

mj12

Rule	Path
Disallow	/

Rule

Path

Disallow

blekkobot

Rule	Path
Disallow	/

Rule

Path

Disallow

nerdybot

Rule	Path
Disallow	/

Rule

Path

Disallow

jamesbot

Rule	Path
Disallow	/

Rule

Path

Disallow

tineye

Rule	Path
Disallow	/

Rule

Path

Disallow

baiduspider

Rule	Path
Disallow	/

Rule

Path

Disallow

serpstat

Rule	Path
Disallow	/

Rule

Path

Disallow

spyfu

Rule	Path
Disallow	/

Rule

Path

Disallow

prlog

Rule	Path
Disallow	/

Rule

Path

Disallow

*

Rule	Path
Disallow

Rule

Path

Disallow

Other Records

Field	Value
sitemap	https://devdiscussions.com/wp-sitemap.xml

Field

Value

sitemap

https://devdiscussions.com/wp-sitemap.xml

Comments

START YOAST BLOCK
---------------------------
---------------------------
END YOAST BLOCK

devdiscussions.comrobots.txt

Resource Scan

Scan Details

Last Successful Scan

Groups

ahrefsbot

mj12bot

rogerbot

semrushbot

ia_archiver

scoutjet

sistrix

searchmetricsbot

seokicks-robot

lipperhey spider

exabot

ncbot

backlinkcrawler

archive.org_bot

meanpathbot

pagesinventory

aboundexbot

spbot

linkdexbot

gigabot

dotbot

nutch

blexbot

ezooms

majestic-12

majestic-seo

dsearch

mj12

blekkobot

nerdybot

jamesbot

tineye

baiduspider

serpstat

spyfu

prlog

*

Other Records

Comments

devdiscussions.com
robots.txt