Log In Sign Up

icegatevpn.com
robots.txt

Robots Exclusion Standard data for icegatevpn.com

Resource Scan

Scan Details

Site Domain icegatevpn.com
Base Domain icegatevpn.com
Scan Status Ok
Last Scan2025-10-13T06:23:37+00:00
Next Scan 2025-10-20T06:23:37+00:00

Last Scan

Scanned2025-10-13T06:23:37+00:00
URL https://icegatevpn.com/robots.txt
Redirect https://www.icegatevpn.com/robots.txt
Redirect Domain www.icegatevpn.com
Redirect Base icegatevpn.com
Domain IPs 104.21.34.67, 172.67.199.158, 2606:4700:3033::ac43:c79e, 2606:4700:3035::6815:2243
Redirect IPs 104.21.34.67, 172.67.199.158, 2606:4700:3033::ac43:c79e, 2606:4700:3035::6815:2243
Response IP 104.21.34.67
Found Yes
Hash 4f612a61f7a530584a6bbfa578de0fea586bfcad8414bf6d2d3c29113b43f4ed
SimHash 691cb850c931

Groups

*

Rule Path
Allow /
Disallow /*utm_source%3D*
Disallow /*utm_medium%3D*
Disallow /*utm_campaign%3D*
Disallow /_pgbackup/
Disallow /test-results/
Disallow /PPandToS.html
Disallow /static3.tildacdn.com/
Disallow /cdn-cgi/

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://icegatevpn.com/sitemap.xml
Back to top

Comments

  • Block duplicate content from UTM parameters and old files
  • Block non-existing paths that appear in GSC
  • Sitemap
  • Block unwanted bots
  • Crawl-delay for heavy crawlers
Back to top