gate.cc
robots.txt

Robots Exclusion Standard data for gate.cc

Resource Scan

Scan Details

Site Domain gate.cc
Base Domain gate.cc
Scan Status Ok
Last Scan2025-08-25T10:13:16+00:00
Next Scan 2025-09-24T10:13:16+00:00

Last Scan

Scanned2025-08-25T10:13:16+00:00
URL https://gate.cc/robots.txt
Redirect https://celeb.gate.cc/robots.txt
Redirect Domain celeb.gate.cc
Redirect Base gate.cc
Domain IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Redirect IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Response IP 104.21.96.1
Found Yes
Hash c47d7bba3d7533e9938f7df0d8727502e204b0c83ef90b2c62922954c823fe63
SimHash 0914c0524713

Groups

*

Rule Path
Allow /

ia_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /