Log In Sign Up

upgrader.com
robots.txt

Robots Exclusion Standard data for upgrader.com

Resource Scan

Scan Details

Site Domain upgrader.com
Base Domain upgrader.com
Scan Status Ok
Last Scan2025-10-15T08:05:21+00:00
Next Scan 2025-11-14T08:05:21+00:00

Last Scan

Scanned2025-10-15T08:05:21+00:00
URL https://upgrader.com/robots.txt
Domain IPs 104.26.6.90, 104.26.7.90, 172.67.73.160, 2606:4700:20::681a:65a, 2606:4700:20::681a:75a, 2606:4700:20::ac43:49a0
Response IP 104.26.7.90
Found Yes
Hash f8b48b4481ec4b06e421214721d5f11cfae2753d4cbae511395b784930bdd088
SimHash 651d8e0067e6

Groups

*

Rule Path
Allow /
Allow /cases
Allow /battles
Allow /deals
Allow /mines
Allow /affiliates
Allow /rewards
Allow /leaderboard
Allow /fairness
Allow /faq
Allow /privacy-policy
Allow /tos
Allow /aml-policy
Disallow /account
Disallow /payment
Disallow /withdraw
Disallow /api/
Disallow /admin/
Disallow /*.json$
Disallow /*?*

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

duckduckbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://upgrader.com/sitemap.xml
Back to top

Comments

  • Upgrader.com robots.txt
  • https://www.robotstxt.org/robotstxt.html
  • Allow all crawlers
  • Disallow private or sensitive areas
  • Crawl-delay for all bots
  • Special rules for major search engines
  • Sitemap location
  • Host directive to specify preferred domain
Back to top

Warnings

  • `host` is not a known field.
Back to top