goranmargetic.com
robots.txt

Robots Exclusion Standard data for goranmargetic.com

Resource Scan

Scan Details

Site Domain goranmargetic.com
Base Domain goranmargetic.com
Scan Status Ok
Last Scan2025-05-18T11:14:24+00:00
Next Scan 2025-05-25T11:14:24+00:00

Last Scan

Scanned2025-05-18T11:14:24+00:00
URL https://goranmargetic.com/robots.txt
Redirect https://www.goranmargetic.com/robots.txt
Redirect Domain www.goranmargetic.com
Redirect Base goranmargetic.com
Domain IPs 104.21.26.238, 172.67.168.154, 2606:4700:3030::ac43:a89a, 2606:4700:3033::6815:1aee
Redirect IPs 104.21.26.238, 172.67.168.154, 2606:4700:3030::ac43:a89a, 2606:4700:3033::6815:1aee
Response IP 172.67.168.154
Found Yes
Hash 46cf20a963ff1ee3fc8e7692ccae28650fd2cf0f59d1e4f8e7be55dd5c1bad71
SimHash f9008e118011

Groups

*

Rule Path
Allow /ads.txt
Disallow /test*
Disallow /gogo*
Disallow /gammer*
Disallow /tuna*
Disallow /developer*
Disallow /admin*
Disallow /moderator*
Disallow /login*
Disallow /email*
Disallow /register
Disallow /personal-data-exports*
Disallow /terms-of-service

Other Records

Field Value
crawl-delay 60

Other Records

Field Value
sitemap https://www.goranmargetic.com/sitemap.xml