rocksbackpages.com
robots.txt

Robots Exclusion Standard data for rocksbackpages.com

Resource Scan

Scan Details

Site Domain rocksbackpages.com
Base Domain rocksbackpages.com
Scan Status Ok
Last Scan3/13/2025, 12:31:42 PM
Next Scan 4/12/2025, 12:31:42 PM

Last Scan

Scanned3/13/2025, 12:31:42 PM
URL https://rocksbackpages.com/robots.txt
Domain IPs 3.8.135.211
Response IP 3.8.135.211
Found Yes
Hash 48a49cd9a13181fa3e9953581a389c8a1632b7f226fd3a897a84937fc8faf875
SimHash fa17f12aa9b2

Groups

*

Rule Path
Disallow /Library/SearchResults/
Disallow /SiteManager/

anthropic-ai

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

facebot

Rule Path
Disallow /

meta-externalagent
metaai
meta-ai
meta ai
meta.ai
meta-ai
metaai

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /