Log In Sign Up

agknowledge.co.nz
robots.txt

Robots Exclusion Standard data for agknowledge.co.nz

Resource Scan

Scan Details

Site Domain agknowledge.co.nz
Base Domain agknowledge.co.nz
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-06-13T21:23:45+00:00
Next Scan 2025-09-11T21:23:45+00:00

Last Successful Scan

Scanned2024-07-26T21:19:43+00:00
URL https://agknowledge.co.nz/robots.txt
Redirect https://www.agknowledge.co.nz/robots.txt
Redirect Domain www.agknowledge.co.nz
Redirect Base agknowledge.co.nz
Domain IPs 104.21.66.203, 172.67.207.62, 2606:4700:3030::6815:42cb, 2606:4700:3031::ac43:cf3e
Redirect IPs 104.21.66.203, 172.67.207.62, 2606:4700:3030::6815:42cb, 2606:4700:3031::ac43:cf3e
Response IP 104.21.66.203
Found Yes
Hash e37e9eb2a89b953930a455fb516ed86fe9d467082bd28bd87716ca204e47716f
SimHash 55151517d796

Groups

*

Rule Path
Disallow /.well-known/
Disallow /.well-known?
Disallow /edit/
Disallow /edit?
Disallow /privacy.php
Disallow /privacy
Allow /edit/library/
Allow /edit/library?
Allow /edit/cache/
Allow /edit/cache?
Allow /edit/*.js
Allow /edit/*.css
Allow /edit/*.ajax.php
Allow /edit/*.png
Allow /edit/*.jpg
Allow /edit/*.jpeg
Allow /edit/*.gif
Allow /edit/*.PNG
Allow /edit/*.JPG
Allow /edit/*.JPEG
Allow /edit/*.GIF
Allow /
Back to top

Other Records

Field Value
sitemap https://www.agknowledge.co.nz/sitemap.xml
Back to top

Comments

  • Tell all the naughty search engines to be good and only
  • go to the directories they are allow to go to
  • This must be replace with an ABSOLUTE path to the sitemap
Back to top