definemg.com
robots.txt

Robots Exclusion Standard data for definemg.com

Resource Scan

Scan Details

Site Domain definemg.com
Base Domain definemg.com
Scan Status Ok
Last Scan2025-11-16T06:05:25+00:00
Next Scan 2025-12-16T06:05:25+00:00

Last Scan

Scanned2025-11-16T06:05:25+00:00
URL https://definemg.com/robots.txt
Redirect https://www.definemg.com/robots.txt
Redirect Domain www.definemg.com
Redirect Base definemg.com
Domain IPs 104.21.47.78, 172.67.170.197, 2606:4700:3033::ac43:aac5, 2606:4700:3035::6815:2f4e
Redirect IPs 104.21.47.78, 172.67.170.197, 2606:4700:3033::ac43:aac5, 2606:4700:3035::6815:2f4e
Response IP 172.67.170.197
Found Yes
Hash 31c0eec919300e661e9001f37a288ca9dd8ae593723f36b5dd79e20bef5e036e
SimHash b01cc2c2ea93

Groups

*

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

scoutjet

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

Comments

  • spam-bots