commentsbot.xyz
robots.txt

Robots Exclusion Standard data for commentsbot.xyz

Resource Scan

Scan Details

Site Domain commentsbot.xyz
Base Domain commentsbot.xyz
Scan Status Ok
Last Scan2025-04-17T15:52:25+00:00
Next Scan 2025-04-24T15:52:25+00:00

Last Scan

Scanned2025-04-17T15:52:25+00:00
URL https://commentsbot.xyz/robots.txt
Domain IPs 104.21.41.39, 172.67.142.84, 2606:4700:3036::6815:2927, 2606:4700:3037::ac43:8e54
Response IP 172.67.142.84
Found Yes
Hash 9f832e3376548d5679c051932f66da5ee54db0d5ea4f551981b53af3b7af8bf1
SimHash c944cba0c7b3

Groups

*

Rule Path
Allow /
Disallow /click/
Disallow /r/