app.simplefx.com
robots.txt

Robots Exclusion Standard data for app.simplefx.com

Resource Scan

Scan Details

Site Domain app.simplefx.com
Base Domain simplefx.com
Scan Status Ok
Last Scan2024-05-10T13:38:27+00:00
Next Scan 2024-05-24T13:38:27+00:00

Last Scan

Scanned2024-05-10T13:38:27+00:00
URL https://app.simplefx.com/robots.txt
Domain IPs 13.33.88.117, 13.33.88.121, 13.33.88.85, 13.33.88.90, 2600:9000:223b:3a00:e:2d04:9c00:93a1, 2600:9000:223b:4200:e:2d04:9c00:93a1, 2600:9000:223b:7800:e:2d04:9c00:93a1, 2600:9000:223b:8a00:e:2d04:9c00:93a1, 2600:9000:223b:a200:e:2d04:9c00:93a1, 2600:9000:223b:aa00:e:2d04:9c00:93a1, 2600:9000:223b:d800:e:2d04:9c00:93a1, 2600:9000:223b:da00:e:2d04:9c00:93a1
Response IP 13.33.88.90
Found Yes
Hash 44f948a68ee07386379b28cc279164a74f3641ccaf5a2b1b5effa19d46c5eb5e
SimHash b2840d8d6170

Groups

*

Rule Path
Disallow /admin

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines: