stagbite.com
robots.txt

Robots Exclusion Standard data for stagbite.com

Resource Scan

Scan Details

Site Domain stagbite.com
Base Domain stagbite.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2026-01-27T19:01:00+00:00
Next Scan 2026-02-26T19:01:00+00:00

Last Successful Scan

Scanned2025-12-29T18:59:46+00:00
URL https://stagbite.com/robots.txt
Domain IPs 191.101.13.85, 2a02:4780:b:972:0:8fa:39a0:2
Response IP 191.101.13.85
Found Yes
Hash 81a6fc10d66810d3f504069b5ba22b240ef21d1d7541c3314a1b2ffb497f39dd
SimHash 1001d8838996

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /?amp
Disallow /?pid=
Disallow /?tlclid
Disallow */feed*
Disallow /mpg-name-net-worth-and-biography/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://stagbite.com/sitemap_index.xml

Comments

  • Allow specific important parts
  • Correct Sitemap URL