/.well-known/

Log In Sign Up

xxxpaste.com
robots.txt

Robots Exclusion Standard data for xxxpaste.com

Archived Snapshots

Resource Scan

Scan Details

Site Domain	xxxpaste.com
Base Domain	xxxpaste.com
Scan Status	Ok
Last Scan	2026-02-16T09:34:01+00:00
Next Scan	2026-02-23T09:34:01+00:00

Last Scan

Scanned	2026-02-16T09:34:01+00:00
URL	https://xxxpaste.com/robots.txt
Domain IPs	104.21.58.42, 172.67.200.52, 2606:4700:3033::6815:3a2a, 2606:4700:3036::ac43:c834
Response IP	172.67.200.52
Found	Yes
Hash	f5f1b2c481fbbdbabf6cf2471fd6c14c9102c987932ceb386a85b6b72cc7181d
SimHash	6d5519448513

Groups

adsbot-google

Rule

Path

Allow

/

Disallow

/redirect/

adsbot-google-mobile

Rule

Path

Allow

/

Disallow

/redirect/

googlebot

Rule

Path

Allow

/

Disallow

/redirect/

bingbot

Rule

Path

Allow

/

Disallow

/redirect/

yandex

Rule

Path

Allow

/

Disallow

/redirect/

applebot

Rule

Path

Allow

/

Disallow

/redirect/

*

Rule

Path

Allow

/

Disallow

/redirect/

Back to top

Other Records

Field

Value

sitemap

https://xxxpaste.com/sitemap.xml

Back to top

Warnings

`clean-param` is not a known field.

Back to top