gregtech.eu
robots.txt
Robots Exclusion Standard data for gregtech.eu
Resource Scan
Scan Details
Site Domain | gregtech.eu |
Base Domain | gregtech.eu |
Scan Status | Ok |
Last Scan | 2025-09-27T15:26:43+00:00 |
Next Scan | 2025-09-28T15:26:43+00:00 |
Last Scan
Scanned | 2025-09-27T15:26:43+00:00 |
URL | https://gregtech.eu/robots.txt |
Domain IPs | 104.21.49.31, 172.67.140.131, 2606:4700:3035::6815:311f, 2606:4700:3037::ac43:8c83 |
Response IP | 172.67.140.131 |
Found | Yes |
Hash | fb983e2dec5b24b4e21d87a598b902edb2e03c6d81bbbb31f4f792be90f10a72 |
SimHash | 44350a52cdd4 |
Groups
*
Rule | Path |
---|---|
Allow | / |
*
Rule | Path |
---|---|
Allow | / |
Disallow | /admin/ |
Disallow | /api/ |
Disallow | /accounts/ |
Disallow | /settings/ |
Disallow | /messages/ |
Disallow | /inbox/ |
Disallow | /search? |
Disallow | /*?sort= |
Disallow | /*?type_= |
Disallow | /*?q= |
Allow | /c/*/ |
Allow | /u/*/ |
Allow | /post/*/ |
Allow | /comment/*/ |
Warnings
- `content-signal` is not a known field.
Comments