Log In Sign Up

playdoge.io
robots.txt

Robots Exclusion Standard data for playdoge.io

Resource Scan

Scan Details

Site Domain playdoge.io
Base Domain playdoge.io
Scan Status Ok
Last Scan2024-10-17T05:01:44+00:00
Next Scan 2024-11-16T05:01:44+00:00

Last Scan

Scanned2024-10-17T05:01:44+00:00
URL https://playdoge.io/robots.txt
Domain IPs 13.33.30.45, 13.33.30.8, 13.33.30.96, 13.33.30.99
Response IP 13.33.30.99
Found Yes
Hash 7d8b766d6213e3f616515371c13a6a99e621bf86fd4bb427ca16082a2aed5bbf
SimHash 603c4951e6d4

Groups

*

Rule Path
Disallow

*

Rule Path
Allow /assets/
Back to top

Other Records

Field Value
sitemap https://playdoge.io/sitemap.xml
Back to top

Comments

  • All web crawlers are allowed to access the entire site
  • Block all web crawlers from accessing specific directories (if any)
  • Example:
  • Disallow: /private/
  • Disallow: /admin/
  • Allow all web crawlers to access the public assets
  • Block specific crawlers if needed
  • Example:
  • User-agent: BadBot
  • Disallow: /
  • Specify the location of the sitemap
Back to top