tatfish.com
robots.txt

Robots Exclusion Standard data for tatfish.com

Resource Scan

Scan Details

Site Domain tatfish.com
Base Domain tatfish.com
Scan Status Ok
Last Scan2025-08-22T23:14:43+00:00
Next Scan 2025-08-29T23:14:43+00:00

Last Scan

Scanned2025-08-22T23:14:43+00:00
URL https://tatfish.com/robots.txt
Redirect https://www.tatfish.com/robots.txt
Redirect Domain www.tatfish.com
Redirect Base tatfish.com
Domain IPs 104.21.90.170, 172.67.158.55, 2606:4700:3031::6815:5aaa, 2606:4700:3036::ac43:9e37
Redirect IPs 104.21.90.170, 172.67.158.55, 2606:4700:3031::6815:5aaa, 2606:4700:3036::ac43:9e37
Response IP 104.21.90.170
Found Yes
Hash f681b0e43d3c473bd57c5d3bbeed66567cabdf6085ef5d1ca20eeee6017f08b0
SimHash 71008bc64e9a

Groups

*

Rule Path
Disallow /assets/backup/
Disallow /assets/cache/
Disallow /assets/docs/
Disallow /assets/export/
Disallow /assets/import/
Disallow /assets/modules/
Disallow /assets/plugins/
Disallow /assets/snippets/
Disallow /assets/packages/
Disallow /assets/tvs/
Disallow /install/
Disallow *atrId*
Disallow /search
Disallow *vote%3D*
Allow /assets/cache/images/
Allow /assets/modules/*.css
Allow /assets/modules/*.js
Allow /assets/plugins/*.css
Allow /assets/plugins/*.js
Allow /assets/snippets/*.css
Allow /assets/snippets/*.js

Comments

  • Default modx exclusions
  • For sitemaps.xml autodiscovery. Uncomment if you have one:
  • Sitemap: http://example.com/sitemap.xml

Warnings

  • `host` is not a known field.