awesomosis.com
robots.txt

Robots Exclusion Standard data for awesomosis.com

Resource Scan

Scan Details

Site Domain awesomosis.com
Base Domain awesomosis.com
Scan Status Ok
Last Scan2025-11-02T07:37:44+00:00
Next Scan 2025-11-09T07:37:44+00:00

Last Scan

Scanned2025-11-02T07:37:44+00:00
URL https://awesomosis.com/robots.txt
Redirect https://www.awesomosis.com/robots.txt
Redirect Domain www.awesomosis.com
Redirect Base awesomosis.com
Domain IPs 104.21.22.74, 172.67.203.113, 2606:4700:3035::6815:164a, 2606:4700:3037::ac43:cb71
Redirect IPs 104.21.22.74, 172.67.203.113, 2606:4700:3035::6815:164a, 2606:4700:3037::ac43:cb71
Response IP 172.67.203.113
Found Yes
Hash 7fe0a634f06bbde28fdd7e637edb5699517f3b005696b115b81935aace98e3dc
SimHash a21e85cafe30

Groups

*

Rule Path
Allow /

awariobot
awariorssbot
awariosmartbot
blexbot
petalbot
semrushbot
dotbot
obot
ahrefsbot
domains project
mj12bot
barkrowler
bytespider
amazonbot

Rule Path
Disallow /

Comments

  • See https://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • Welcome robots