digitalspinner.com
robots.txt

Robots Exclusion Standard data for digitalspinner.com

Resource Scan

Scan Details

Site Domain digitalspinner.com
Base Domain digitalspinner.com
Scan Status Ok
Last Scan2025-10-28T17:44:39+00:00
Next Scan 2025-11-04T17:44:39+00:00

Last Scan

Scanned2025-10-28T17:44:39+00:00
URL https://digitalspinner.com/robots.txt
Domain IPs 184.154.75.188
Response IP 184.154.75.188
Found Yes
Hash fe90a43c95821b008e95c0b13f83ec0c66c1acbdcb6f2a707078fa27475c2987
SimHash 30144c02c3de

Groups

*

Rule Path
Disallow /listings/create

bytespider

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

Comments

  • This rule blocks all bots from accessing the /admin/ directory