goranmargetic.com
robots.txt
Robots Exclusion Standard data for goranmargetic.com
Resource Scan
Scan Details
Site Domain | goranmargetic.com |
Base Domain | goranmargetic.com |
Scan Status | Ok |
Last Scan | 2025-05-18T11:14:24+00:00 |
Next Scan | 2025-05-25T11:14:24+00:00 |
Last Scan
Scanned | 2025-05-18T11:14:24+00:00 |
URL | https://goranmargetic.com/robots.txt |
Redirect | https://www.goranmargetic.com/robots.txt |
Redirect Domain | www.goranmargetic.com |
Redirect Base | goranmargetic.com |
Domain IPs | 104.21.26.238, 172.67.168.154, 2606:4700:3030::ac43:a89a, 2606:4700:3033::6815:1aee |
Redirect IPs | 104.21.26.238, 172.67.168.154, 2606:4700:3030::ac43:a89a, 2606:4700:3033::6815:1aee |
Response IP | 172.67.168.154 |
Found | Yes |
Hash | 46cf20a963ff1ee3fc8e7692ccae28650fd2cf0f59d1e4f8e7be55dd5c1bad71 |
SimHash | f9008e118011 |
Groups
*
Rule | Path |
---|---|
Allow | /ads.txt |
Disallow | /test* |
Disallow | /gogo* |
Disallow | /gammer* |
Disallow | /tuna* |
Disallow | /developer* |
Disallow | /admin* |
Disallow | /moderator* |
Disallow | /login* |
Disallow | /email* |
Disallow | /register |
Disallow | /personal-data-exports* |
Disallow | /terms-of-service |
Other Records
Field | Value |
---|---|
crawl-delay | 60 |
Other Records
Field | Value |
---|---|
sitemap | https://www.goranmargetic.com/sitemap.xml |