playpaste.net
robots.txt

Robots Exclusion Standard data for playpaste.net

Archived Snapshots

Resource Scan

Scan Details

Site Domain	playpaste.net
Base Domain	playpaste.net
Scan Status	Ok
Last Scan	2025-10-24T21:03:16+00:00
Next Scan	2025-10-31T21:03:16+00:00

Last Scan

Scanned	2025-10-24T21:03:16+00:00
URL	https://playpaste.net/robots.txt
Domain IPs	104.21.51.217, 172.67.186.181, 2606:4700:3032::6815:33d9, 2606:4700:3035::ac43:bab5
Response IP	104.21.51.217
Found	Yes
Hash	cceeb1692058e3a17d58e576628f13f7c1ddf712593363326f8ea207f878af44
SimHash	40b55b11c5d0

Groups

*

Rule	Path
Allow	/

Rule

Path

Allow

amazonbot

Rule	Path
Disallow	/

Rule

Path

Disallow

applebot-extended

Rule	Path
Disallow	/

Rule

Path

Disallow

bytespider

Rule	Path
Disallow	/

Rule

Path

Disallow

ccbot

Rule	Path
Disallow	/

Rule

Path

Disallow

claudebot

Rule	Path
Disallow	/

Rule

Path

Disallow

google-extended

Rule	Path
Disallow	/

Rule

Path

Disallow

gptbot

Rule	Path
Disallow	/

Rule

Path

Disallow

meta-externalagent

Rule	Path
Disallow	/
Disallow	/pivi/

Rule

Path

Disallow

/pivi/

*

Rule	Path
Disallow	/cgi-bin/
Disallow	/tmp/
Disallow	/junk/

Rule

Path

Disallow

/cgi-bin/

Disallow

/tmp/

Disallow

/junk/

screaming frog seo spider

Rule	Path
Disallow	/

Rule

Path

Disallow

bidswitchbot

Rule	Path
Disallow	/

Rule

Path

Disallow

w3c_validator

Rule	Path
Disallow	/

Rule

Path

Disallow

bingbot

Rule	Path
Disallow	/

Rule

Path

Disallow

validator.nu

Rule	Path
Disallow	/

Rule

Path

Disallow

msnbot-media

Rule	Path
Disallow	/

Rule

Path

Disallow

wget

Rule	Path
Disallow	/

Rule

Path

Disallow

microsoft office protocol discovery

Rule	Path
Disallow	/

Rule

Path

Disallow

jigsaw

Rule	Path
Disallow	/

Rule

Path

Disallow

barkrowler

Rule	Path
Disallow	/

Rule

Path

Disallow

daum

Rule	Path
Disallow	/

Rule

Path

Disallow

yandeximageresizer

Rule	Path
Disallow	/

Rule

Path

Disallow

unknown robot identified by \*bot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-si

Rule	Path
Disallow	/

Rule

Path

Disallow

archive.org_bot

Rule	Path
Disallow	/

Rule

Path

Disallow

duckduckbot-https

Rule	Path
Disallow	/

Rule

Path

Disallow

nbot

Rule	Path
Disallow	/

Rule

Path

Disallow

icc-crawler

Rule	Path
Disallow	/

Rule

Path

Disallow

spider

Rule	Path
Disallow	/

Rule

Path

Disallow

survey

Rule	Path
Disallow	/

Rule

Path

Disallow

yahoo! slurp

Rule	Path
Disallow	/

Rule

Path

Disallow

firephp

Rule	Path
Disallow	/

Rule

Path

Disallow

phantomjs

Rule	Path
Disallow	/

Rule

Path

Disallow

msnbot

Rule	Path
Disallow	/

Rule

Path

Disallow

mediatoolkitbot

Rule	Path
Disallow	/

Rule

Path

Disallow

konqueror

Rule	Path
Disallow	/

Rule

Path

Disallow

seznambot

Rule	Path
Disallow	/

Rule

Path

Disallow

seek

Rule	Path
Disallow	/

Rule

Path

Disallow

apache-httpclient

Rule	Path
Disallow	/

Rule

Path

Disallow

cubot

Rule	Path
Disallow	/

Rule

Path

Disallow

nautic expo using firefox/1.5

Rule	Path
Disallow	/

Rule

Path

Disallow

spider

Rule	Path
Disallow	/

Rule

Path

Disallow

yisouspider

Rule	Path
Disallow	/

Rule

Path

Disallow

ruby script

Rule	Path
Disallow	/

Rule

Path

Disallow

semanticbot

Rule	Path
Disallow	/

Rule

Path

Disallow

who.is.bot

Rule	Path
Disallow	/

Rule

Path

Disallow

surdotlybot

Rule	Path
Disallow	/

Rule

Path

Disallow

msiecrawler

Rule	Path
Disallow	/

Rule

Path

Disallow

elinks (

Rule

Path

Disallow

barkrowler

Rule

Path

Disallow

slackbot-linkexpanding

Rule

Path

Disallow

sogou web spider

Rule

Path

Disallow

my nutch spider

Rule

Path

Disallow

getintent crawler

Rule

Path

Disallow

phantomjs

Rule

Path

Disallow

ruby script

Rule

Path

Disallow

daum

Rule

Path

Disallow

adidxbot microsoft ad quality control

Rule

Path

Disallow

linkedinbot

Rule

Path

Disallow

surdotlybot

Rule

Path

Disallow

yisouspider

Rule

Path

Disallow

barkrowler

Rule

Path

Disallow

discover

Rule

Path

Disallow

scrapy

Rule

Path

Disallow

ccbot

Rule

Path

Disallow

konqueror

Rule

Path

Disallow

msiecrawler

Rule

Path

Disallow

bl.uk_lddc_bot

Rule

Path

Disallow

urllib

Rule

Path

Disallow

velen

Rule

Path

Disallow

slackbot-linkexpanding

Rule

Path

Disallow

surdotlybot

Rule

Path

Disallow

baiduspider

Rule

Path

Disallow

yak-linkfluence

Rule

Path

Disallow

ruby script

Rule

Path

Disallow

wget

Rule

Path

Disallow

semanticbot

Rule

Path

Disallow

sogou web spider

Rule

Path

Disallow

baiduspider

Rule

Path

Disallow

firephp

Rule

Path

Disallow

hit

Rule

Path

Disallow

bot\*

Rule

Path

Disallow

velen

Rule

Path

Disallow

wget

Rule

Path

Disallow

seek

Rule

Path

Disallow

archive.org_bot

Rule

Path

Disallow

cfnetwork

Rule

Path

Disallow

phantomjs

Rule

Path

Disallow

mail.ru bot

Rule

Path

Disallow

bidswitchbot

Rule

Path

Disallow

ahrefsbot

Rule

Path

Disallow

bidswitchbot

Rule

Path

Disallow

go-http-client

Rule

Path

Disallow

trendiction

Rule

Path

Disallow

elinks

Rule

Path

Disallow

proximic

Rule

Path

Disallow

serendeputy

Rule

Path

Disallow

phantomjs

Rule

Path

Disallow

validator.nu

Rule

Path

Disallow

mojeekbot

Rule

Path

Disallow

w3c_validator

Rule

Path

Disallow

yahoo! slurp

Rule

Path

Disallow

my nutch spider

Rule

Path

Disallow

survey

Rule

Path

Disallow

fetcher

Rule

Path

Disallow

nbot

Rule

Path

Disallow

dotbot

Rule

Path

Disallow

grapeshotcrawler

Rule

Path

Disallow

crawl

Rule

Path

Disallow

ccbot

Rule

Path

Disallow

links (

Rule

Path

Disallow

msie8 - ( rogue robot )

Rule

Path

Disallow

zumbot

Rule

Path

Disallow

spider

Rule

Path

Disallow

mixrankbot

Rule

Path

Disallow

discover

Rule

Path

Disallow

scanner

Rule

Path

Disallow

surdotlybot

Rule

Path

Disallow

ng/1

Rule

Path

Disallow

uptimerobot

Rule

Path

Disallow

daum

Rule

Path

Disallow

blog

Rule

Path

Disallow

xml sitemaps generator

Rule

Path

Disallow

scrapy

Rule

Path

Disallow

serendeputy

Rule

Path

Disallow

my nutch spider

Rule

Path

Disallow

a php script

Rule

Path

Disallow

seznambot

Rule

Path

Disallow

surdotlybot

Rule

Path

Disallow

yandex ( catchall )

Rule

Path

Disallow

getintent crawler

Rule

Path

Disallow

cubot

Rule

Path

Disallow

baiduspider

Rule

Path

Disallow

survey

Rule

Path

Disallow

curl

Rule

Path

Disallow

obot

Rule

Path

Disallow

mj12bot

Rule

Path

Disallow

link

Rule

Path

Disallow

semanticbot

Rule

Path

Disallow

wget

Rule

Path

Disallow

blog

Rule

Path

Disallow

java ( catchall )

Rule

Path

Disallow

feed

Rule

Path

Disallow

blexbot

Rule

Path

Disallow

dalvik

Rule

Path

Disallow

link

Rule

Path

Disallow

links (

Rule

Path

Disallow

surdotlybot

Rule

Path

Disallow

konqueror

Rule

Path

Disallow

yisouspider

Rule

Path

Disallow

perl

Rule

Path

Disallow

checker

Rule

Path

Disallow

checker

Rule

Path

Disallow

pinterestbot

Rule

Path

Disallow

mixrankbot

Rule

Path

Disallow

validator

Rule

Path

Disallow

semanticbot

Rule

Path

Disallow

surdotlybot

Rule

Path

Disallow

yandeximageresizer

Rule

Path

Disallow

crawl

Rule

Path

Disallow

sogou web spider

Rule

Path

Disallow

robot

Rule

Path

Disallow

seznambot

Rule

Path

Disallow

googlebot

Rule

Path

Disallow

crawl

Rule

Path

Disallow

linkcheck

Rule

Path

Disallow

blog

Rule

Path

Disallow

feed

Rule

Path

Disallow

go-http-client

Rule

Path

Disallow

hit

Rule

Path

Disallow

discordbot

Rule

Path

Disallow

uptimerobot

Rule

Path

Disallow

bot\*

Rule

Path

Disallow

bingbot

Rule

Path

Disallow

proximic

Rule

Path

Disallow

uptimerobot

Rule

Path

Disallow

surdotlybot

Rule

Path

Disallow

zoominfobot

Rule

Path

Disallow

mixrankbot

Rule

Path

Disallow

yak-linkfluence

Rule

Path

Disallow

mojeekbot

Rule

Path

Disallow

go-http-client

Rule

Path

Disallow

uptimerobot

Rule

Path

Disallow

unknown robot identified by bot\*

Rule

Path

Disallow

facebookexternalhit

Rule

Path

Disallow

hit

Rule

Path

Disallow

java ( catchall )

Rule

Path

Disallow

ccbot

Rule

Path

Disallow

googlebot

Rule

Path

Disallow

uptimerobot

Rule

Path

Disallow

applebot

Rule

Path

Disallow

fetcher

Rule

Path

Disallow

google web preview

Rule

Path

Disallow

googlebot-image

Rule

Path

Disallow

semrushbot

Rule

Path

Disallow

uptimerobot

Rule

Path

Disallow

survey

Rule

Path

Disallow

seek

Rule

Path

Disallow

phantomjs

Rule

Path

Disallow

xenu link sleuth

Rule

Path

Disallow

ccbot

Rule

Path

Disallow

konqueror

Rule

Path

Disallow

surdotlybot

Rule

Path

Disallow

mj12bot

Rule

Path

Disallow

mediatoolkitbot

Rule

Path

Disallow

baiduspider

Rule

Path

Disallow

microsoft office protocol discovery

Rule

Path

Disallow

barkrowler

Rule

Path

Disallow

mojeekbot

Rule

Path

Disallow

zoominfobot

Rule

Path

Disallow

seznambot

Rule

Path

Disallow

cubot

Rule

Path

Disallow

trendiction

Rule

Path

Disallow

spider

Rule

Path

Disallow

cfnetwork

Rule

Path

Disallow

archive.org_bot

Rule

Path

Disallow

feed

Rule

Path

Disallow

checker

Rule

Path

Disallow

grapeshotcrawler

Rule

Path

Disallow

mojeekbot

Rule

Path

Disallow

spider

Rule

Path

Disallow

proximic

Rule

Path

Disallow

domainstatsbot

Rule

Path

Disallow

pinterestbot

Rule

Path

Disallow

zoominfobot

Rule

Path

Disallow

uptimerobot

Rule

Path

Disallow

bingbot

Rule

Path

Disallow

empty user agent string

Rule

Path

Disallow

survey

Rule

Path

Disallow

cfnetwork

Rule

Path

Disallow

curl

Rule

Path

Disallow

dotbot

Rule

Path

Disallow

dalvik

Rule

Path

Disallow

apache-httpclient

Rule

Path

Disallow

trendiction

Rule

Path

Disallow

blexbot

Rule

Path

Disallow

mojeekbot

Rule

Path

Disallow

uptimerobot

Rule

Path

Disallow

go-http-client

Rule

Path

Disallow

velen

Rule

Path

Disallow

bidswitchbot

Rule

Path

Disallow

elinks

Rule

Path

Disallow

proximic

Rule

Path

Disallow

serendeputy

Rule

Path

Disallow

phantomjs

Rule

Path

Disallow

validator.nu

Rule

Path

Disallow

w3c_validator

Rule

Path

Disallow

my nutch spider

Rule

Path

Disallow

survey

Rule

Path

Disallow

fetcher

Rule

Path

Disallow

nbot

Rule

Path

Disallow

dotbot

Rule

Path

Disallow

grapeshotcrawler

Rule

Path

Disallow

crawl

Rule

Path

Disallow

ccbot

Rule

Path

Disallow

links (

Rule

Path

Disallow

msie8 - ( rogue robot )

Rule

Path

Disallow

zumbot

Rule

Path

Disallow

spider

Rule

Path

Disallow

mixrankbot

Rule

Path

Disallow

discover

Rule

Path

Disallow

scanner

Rule

Path

Disallow

surdotlybot

Rule

Path

Disallow

ng/1

Rule

Path

Disallow

daum

Rule

Path

Disallow

blog

Rule

Path

Disallow

xml sitemaps generator

Rule

Path

Disallow

scrapy

Rule

Path

Disallow

serendeputy

Rule

Path

Disallow

my nutch spider

Rule

Path

Disallow

a php script

Rule

Path

Disallow

seznambot

Rule

Path

Disallow

surdotlybot

Rule

Path

Disallow

getintent crawler

Rule

Path

Disallow

cubot

Rule

Path

Disallow

baiduspider

Rule

Path

Disallow

survey

Rule

Path

Disallow

curl

Rule

Path

Disallow

obot

Rule

Path

Disallow

mj12bot

Rule

Path

Disallow

link

Rule

Path

Disallow

semanticbot

Rule

Path

Disallow

wget

Rule

Path

Disallow

blog

Rule

Path

Disallow

java ( catchall )

Rule

Path

Disallow

feed

Rule

Path

Disallow

blexbot

Rule

Path

Disallow

dalvik

Rule

Path

Disallow

link

Rule

Path

Disallow

links (

Rule

Path

Disallow

surdotlybot

Rule

Path

Disallow

perl

Rule

Path

Disallow

checker

Rule

Path

Disallow

mixrankbot

Rule

Path

Disallow

validator

Rule

Path

Disallow

semanticbot

Rule

Path

Disallow

surdotlybot

Rule

Path

Disallow

crawl

Rule

Path

Disallow

sogou web spider

Rule

Path

Disallow

robot

Rule

Path

Disallow

seznambot

Rule

Path

Disallow

*

Rule

Path

Disallow

/?s=

Disallow

/search

*

Rule

Path

Disallow

/trackback

Disallow

/*trackback

Disallow

/*trackback*

Disallow

/*/trackback

*

Rule

Path

Allow

/feed/$

Disallow

/feed/

Disallow

/comments/feed/

Disallow

/*/feed/$

Disallow

/*/feed/rss/$

Disallow

/*/trackback/$

Disallow

/*/*/feed/$

Disallow

/*/*/feed/rss/$

Disallow

/*/*/trackback/$

Disallow

/*/*/*/feed/$

Disallow

/*/*/*/feed/rss/$

Disallow

/*/*/*/trackback/$

Comments

As a condition of accessing this website, you agree to abide by the following
content signals:
(a) If a content-signal = yes, you may collect content for the corresponding
use.
(b) If a content-signal = no, you may not collect content for the
corresponding use.
(c) If the website operator does not include a content signal for a
corresponding use, the website operator neither grants nor restricts
permission via content signal with respect to the corresponding use.
The content signals and their meanings are:
search: building a search index and providing search results (e.g., returning
hyperlinks and short excerpts from your website's contents). Search does not
include providing AI-generated search summaries.
ai-input: inputting content into one or more AI models (e.g., retrieval
augmented generation, grounding, or other real-time taking of content for
generative AI search answers).
ai-train: training or fine-tuning AI models.
ANY RESTRICTIONS EXPRESSED VIA CONTENT SIGNALS ARE EXPRESS RESERVATIONS OF
AND RELATED RIGHTS IN THE DIGITAL SINGLE MARKET.
BEGIN Cloudflare Managed content
END Cloudflare Managed Content

Warnings

12 invalid lines.
`content-signal` is not a known field.

playpaste.netrobots.txt

Resource Scan

Scan Details

Last Scan

Groups

*

amazonbot

applebot-extended

bytespider

ccbot

claudebot

google-extended

gptbot

meta-externalagent

*

screaming frog seo spider

bidswitchbot

w3c_validator

bingbot

validator.nu

msnbot-media

wget

microsoft office protocol discovery

jigsaw

barkrowler

daum

yandeximageresizer

unknown robot identified by \*bot

semrushbot-si

archive.org_bot

duckduckbot-https

nbot

icc-crawler

spider

survey

yahoo! slurp

firephp

phantomjs

msnbot

mediatoolkitbot

konqueror

seznambot

seek

apache-httpclient

cubot

nautic expo using firefox/1.5

spider

yisouspider

ruby script

semanticbot

who.is.bot

surdotlybot

msiecrawler

elinks (

barkrowler

slackbot-linkexpanding

sogou web spider

my nutch spider

getintent crawler

phantomjs

ruby script

daum

adidxbot microsoft ad quality control

linkedinbot

surdotlybot

yisouspider

barkrowler

discover

scrapy

ccbot

konqueror

msiecrawler

bl.uk_lddc_bot

urllib

velen

slackbot-linkexpanding

surdotlybot

baiduspider

yak-linkfluence

ruby script

playpaste.net
robots.txt