bdsmsingles.com
robots.txt

Robots Exclusion Standard data for bdsmsingles.com

Resource Scan

Scan Details

Site Domain bdsmsingles.com
Base Domain bdsmsingles.com
Scan Status Ok
Last Scan2025-12-01T08:39:51+00:00
Next Scan 2025-12-15T08:39:51+00:00

Last Scan

Scanned2025-12-01T08:39:51+00:00
URL https://bdsmsingles.com/robots.txt
Redirect https://www.bdsmsingles.com/robots.txt
Redirect Domain www.bdsmsingles.com
Redirect Base bdsmsingles.com
Domain IPs 108.60.73.35
Redirect IPs 108.60.73.35
Response IP 108.60.73.35
Found Yes
Hash 8fedca654c5c289ccded688c14fbb7df31c69a5e4dc80d095fb51d4afa7ac367
SimHash 2c56d8629e0c

Groups

claudebot

Rule Path
Disallow /

claude-user

Rule Path
Disallow /

claude-searchbot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

anthropic

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

*

Rule Path
Disallow /ad_link/
Disallow /in/
Disallow /upgrade/
Disallow /_core/
Disallow /layouts/files/
Disallow /files/
Disallow /c/
Disallow /rc_statement
Disallow /unsubscribe_email
Disallow /app_in
Disallow /invoice

Other Records

Field Value
crawl-delay 2