tg.pe
robots.txt
Robots Exclusion Standard data for tg.pe
Resource Scan
Scan Details
Site Domain | tg.pe |
Base Domain | tg.pe |
Scan Status | Ok |
Last Scan | 2025-09-11T04:05:28+00:00 |
Next Scan | 2025-09-25T04:05:28+00:00 |
Last Scan
Scanned | 2025-09-11T04:05:28+00:00 |
URL | https://tg.pe/robots.txt |
Domain IPs | 104.21.22.21, 172.67.202.9, 2606:4700:3030::6815:1615, 2606:4700:3030::ac43:ca09 |
Response IP | 104.21.22.21 |
Found | Yes |
Hash | 4de7ce2e951a1813a705870fdd397c0a6cbe98088400373dcb406108960d6f39 |
SimHash | c80ecf22d3b6 |
Groups
*
Rule | Path |
---|---|
Allow | /$ |
Allow | /bot$ |
Allow | /web$ |
Allow | /dev$ |
Allow | /repo$ |
Allow | /logo.png$ |
Disallow | / |