Log In Sign Up

diggz.co
robots.txt

Robots Exclusion Standard data for diggz.co

Resource Scan

Scan Details

Site Domain diggz.co
Base Domain diggz.co
Scan Status Ok
Last Scan2026-02-14T18:53:21+00:00
Next Scan 2026-03-16T18:53:21+00:00

Last Scan

Scanned2026-02-14T18:53:21+00:00
URL https://diggz.co/robots.txt
Redirect https://www.diggz.co/robots.txt
Redirect Domain www.diggz.co
Redirect Base diggz.co
Domain IPs 104.26.0.227, 104.26.1.227, 172.67.74.155, 2606:4700:20::681a:1e3, 2606:4700:20::681a:e3, 2606:4700:20::ac43:4a9b
Redirect IPs 104.26.0.227, 104.26.1.227, 172.67.74.155, 2606:4700:20::681a:1e3, 2606:4700:20::681a:e3, 2606:4700:20::ac43:4a9b
Response IP 172.67.74.155
Found Yes
Hash 34e13ac4a3aa1a01a8c28c9df1234966a7ced3d5427be62ea1454e98ac1d02c3
SimHash d88959e60dd3

Groups

*

Rule Path
Disallow /*/like$
Disallow /*/like/
Disallow /like$
Disallow /like/
Allow /assets/
Allow /static/
Allow /images/
Allow /css/
Allow /js/
Back to top

Other Records

Field Value
sitemap https://www.diggz.co/sitemap.xml
Back to top

Comments

  • Block non-page action endpoints
  • Keep resources crawlable for rendering
  • If you use query parameters that explode URLs (facets, tracking), consider disallowing clearly-non-indexable combos:
  • Disallow: /*?*sessionid=
  • Disallow: /*?*utm_source=
  • Disallow: /*?*fbclid=
  • (Optional) If you have similar actions, add them here:
  • Disallow: /*/save$
  • Disallow: /*/favorite$
  • Disallow: /*/share$
Back to top