pakwiki.org
robots.txt

Robots Exclusion Standard data for pakwiki.org

Archived Snapshots

Resource Scan

Scan Details

Site Domain	pakwiki.org
Base Domain	pakwiki.org
Scan Status	Failed
Failure Stage	Fetching resource.
Failure Reason	Server returned a client error.
Last Scan	2025-10-06T21:40:48+00:00
Next Scan	2025-11-05T21:40:48+00:00

Last Successful Scan

Scanned	2025-08-15T21:39:27+00:00
URL	https://pakwiki.org/robots.txt
Redirect	https://www.pakwiki.org/robots.txt
Redirect Domain	www.pakwiki.org
Redirect Base	pakwiki.org
Domain IPs	104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Redirect IPs	104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Response IP	104.21.96.1
Found	Yes
Hash	bf135e35adfe470fee9ced7ce66f9d8c8f1336d8dd9a83b40c6427ce9fb48afc
SimHash	0236e760c112

Groups

*

Rule	Path
Disallow	/wp-admin/
Allow	/wp-admin/admin-ajax.php

Rule

Path

Disallow

/wp-admin/

Allow

/wp-admin/admin-ajax.php

ahrefsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

mj12bot

Rule	Path
Disallow	/

Rule

Path

Disallow

rogerbot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot

Rule	Path
Disallow	/

Rule

Path

Disallow

ia_archiver

Rule	Path
Disallow	/

Rule

Path

Disallow

scoutjet

Rule	Path
Disallow	/

Rule

Path

Disallow

sistrix

Rule	Path
Disallow	/

Rule

Path

Disallow

searchmetricsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

seokicks-robot

Rule	Path
Disallow	/

Rule

Path

Disallow

lipperhey spider

Rule	Path
Disallow	/

Rule

Path

Disallow

exabot

Rule	Path
Disallow	/

Rule

Path

Disallow

ncbot

Rule	Path
Disallow	/

Rule

Path

Disallow

backlinkcrawler

Rule	Path
Disallow	/

Rule

Path

Disallow

archive.org_bot

Rule	Path
Disallow	/

Rule

Path

Disallow

meanpathbot

Rule	Path
Disallow	/

Rule

Path

Disallow

pagesinventory

Rule	Path
Disallow	/

Rule

Path

Disallow

aboundexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

spbot

Rule	Path
Disallow	/

Rule

Path

Disallow

linkdexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

gigabot

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot

Rule	Path
Disallow	/

Rule

Path

Disallow

nutch

Rule	Path
Disallow	/

Rule

Path

Disallow

blexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

ezooms

Rule	Path
Disallow	/

Rule

Path

Disallow

majestic-12

Rule	Path
Disallow	/

Rule

Path

Disallow

majestic-seo

Rule	Path
Disallow	/

Rule

Path

Disallow

dsearch

Rule	Path
Disallow	/

Rule

Path

Disallow

mj12

Rule	Path
Disallow	/

Rule

Path

Disallow

blekkobot

Rule	Path
Disallow	/

Rule

Path

Disallow

nerdybot

Rule	Path
Disallow	/

Rule

Path

Disallow

jamesbot

Rule	Path
Disallow	/

Rule

Path

Disallow

tineye

Rule	Path
Disallow	/

Rule

Path

Disallow

baiduspider

Rule	Path
Disallow	/

Rule

Path

Disallow

serpstat

Rule	Path
Disallow	/

Rule

Path

Disallow

spyfu

Rule	Path
Disallow	/

Rule

Path

Disallow

prlog

Rule	Path
Disallow	/

Rule

Path

Disallow

pakwiki.orgrobots.txt

Resource Scan

Scan Details

Last Successful Scan

Groups

*

ahrefsbot

mj12bot

rogerbot

semrushbot

ia_archiver

scoutjet

sistrix

searchmetricsbot

seokicks-robot

lipperhey spider

exabot

ncbot

backlinkcrawler

archive.org_bot

meanpathbot

pagesinventory

aboundexbot

spbot

linkdexbot

gigabot

dotbot

nutch

blexbot

ezooms

majestic-12

majestic-seo

dsearch

mj12

blekkobot

nerdybot

jamesbot

tineye

baiduspider

serpstat

spyfu

prlog

pakwiki.org
robots.txt