social.social-bot.io
robots.txt

Robots Exclusion Standard data for social.social-bot.io

Resource Scan

Scan Details

Site Domain social.social-bot.io
Base Domain social-bot.io
Scan Status Ok
Last Scan2025-06-29T11:47:13+00:00
Next Scan 2025-07-13T11:47:13+00:00

Last Scan

Scanned2025-06-29T11:47:13+00:00
URL https://social.social-bot.io/robots.txt
Domain IPs 104.21.0.111, 172.67.185.253, 2606:4700:3031::ac43:b9fd, 2606:4700:3035::6815:6f
Response IP 104.21.0.111
Found Yes
Hash d776d92cfd6cd1d98bb25dc730aacef811952b6e660a60849f0d238c8c9194c7
SimHash aa90ab857f60

Groups

*

Rule Path
Disallow /widget

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file