upload2.us
robots.txt

Robots Exclusion Standard data for upload2.us

Resource Scan

Scan Details

Site Domain upload2.us
Base Domain upload2.us
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-10T16:26:13+00:00
Next Scan 2025-09-17T16:26:13+00:00

Last Successful Scan

Scanned2025-09-02T16:25:42+00:00
URL https://upload2.us/robots.txt
Domain IPs 104.21.93.47, 172.67.204.148, 2606:4700:3031::ac43:cc94, 2606:4700:3034::6815:5d2f
Response IP 104.21.93.47
Found Yes
Hash 23b30eae3c6a16d4bd67555829e0cac4f1d149b2ae3e471750f6d9b211dafdaf
SimHash 68141118adf1

Groups

*

Rule Path
Disallow /search/?*
Disallow /explore/?*
Disallow /?random
Disallow /category/?*
Disallow /u

twitterbot

Rule Path
Allow /u
Allow /view

facebookexternalhit

Rule Path
Allow /u
Allow /view

Other Records

Field Value
sitemap https://uploadme.me/sitemap.html
sitemap https://uploadme.me/sitemap.xml.gz
sitemap https://uploadme.me/sitemap.xml

Comments

  • Certain social media sites are whitelisted to allow crawlers to access page markup.