magicode.io
robots.txt

Robots Exclusion Standard data for magicode.io

Resource Scan

Scan Details

Site Domain magicode.io
Base Domain magicode.io
Scan Status Ok
Last Scan2024-10-03T18:14:14+00:00
Next Scan 2024-10-10T18:14:14+00:00

Last Scan

Scanned2024-10-03T18:14:14+00:00
URL https://magicode.io/robots.txt
Redirect https://it.commutty.com/robots.txt
Redirect Domain it.commutty.com
Redirect Base commutty.com
Domain IPs 76.76.21.21
Redirect IPs 76.76.21.9, 76.76.21.98
Response IP 76.76.21.142
Found Yes
Hash 8e2bd9f669168f84d309f9f9c23ab2c87271a3cd8b00bb8c7c0c01a8af8ba61c
SimHash 8810e4c2c371

Groups

*

Rule Path
Disallow /onboarding

yahoo pipes 1.0

Rule Path
Disallow /

voltron

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

livelapbot

Rule Path
Disallow /

megalodon

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

Other Records

Field Value
sitemap https://magicode.io/sitemap.xml

Warnings

  • 2 invalid lines.