iegate.net
robots.txt

Robots Exclusion Standard data for iegate.net

Resource Scan

Scan Details

Site Domain iegate.net
Base Domain iegate.net
Scan Status Ok
Last Scan2025-09-12T09:00:36+00:00
Next Scan 2025-09-19T09:00:36+00:00

Last Scan

Scanned2025-09-12T09:00:36+00:00
URL https://iegate.net/robots.txt
Domain IPs 14.41.104.37
Response IP 14.41.104.37
Found Yes
Hash 31e3f440359dddce2d4a83d92fc9901b80a869a8e36f77aed21ad62d2578cf18
SimHash 59561932391d

Groups

googlebot

Rule Path
Allow /ads.txt

amazonbot*

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

googlebot-video

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

criteobot

Rule Path
Disallow /

ev-crawler

Rule Path
Disallow /

*

Rule Path
Allow /

*

Rule Path
Disallow /bbs/

claudebot
mozilla/5.0 (l9scan/2.0.1343e28363e29363e23313; +https://leakix.net)
mozilla/5.0 (linux; android 11; vivo 1906; wv) applewebkit/537.36 (khtml, like gecko) version/4.0 chrome/87.0.4280.141 mobile safari/537.36 vivobrowser/8.9.0.0
mozilla/5.0 (linux; android 11; vivo 1906; wv) applewebkit/537.36 (khtml, like gecko) version/4.0 chrome/87.0.4280.141 mobile safari/537.36 vivobrowser/8.9.0.0 uni-app html5plus/1.0
mozilla/4.0 (compatible; msie 8.0; windows nt 6.1; trident/4.0)
mozilla/5.0 (compatible; mj12bot/v1.4.8; http://mj12bot.com/)
microsoft-webdav-miniredir/10.0.19045
pingdom.com_bot_version_1.4_(http://www.pingdom.com/)
turnitin (https://bit.ly/2uvnfoq)
mozilla/5.0 (linux; android 7.0;) applewebkit/537.36 (khtml, like gecko) mobile safari/537.36 (compatible; petalbot;+https://webmaster.petalsearch.com/site/petalbot)
mozilla/5.0 applewebkit/537.36 (khtml, like gecko; compatible; claudebot/1.0; +claudebot@anthropic.com)
mozilla/5.0 (compatible; semrushbot/7~bl; +http://www.semrush.com/bot.html)
claudebot
mozilla/5.0 (compatible; bytespider; spider-feedback@bytedance.com) applewebkit/537.36 (khtml, like gecko) chrome/70.0.0.0 safari/537.36
blackbox exporter/0.24.0
mozilla/5.0 (compatible; dotbot/1.2; +https://opensiteexplorer.org/dotbot; help@moz.com)
java/1.8.0_161
mozilla/5.0 (compatible; ahrefsbot/7.0; +http://ahrefs.com/robot/)
go-http-client/2.0
buck/2.4.2; (+https://app.hypefactors.com/media-monitoring/about.html)
mozilla/5.0 (linux; android 5.0) applewebkit/537.36 (khtml, like gecko) mobile safari/537.36 (compatible; bytespider; spider-feedback@bytedance.com)

Rule Path
Disallow /