bidprime.com
robots.txt

Robots Exclusion Standard data for bidprime.com

Resource Scan

Scan Details

Site Domain bidprime.com
Base Domain bidprime.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-02T18:19:39+00:00
Next Scan 2025-12-09T18:19:39+00:00

Last Successful Scan

Scanned2025-11-01T17:51:30+00:00
URL https://bidprime.com/robots.txt
Redirect https://www.bidprime.com:443/robots.txt
Redirect Domain www.bidprime.com
Redirect Base bidprime.com
Domain IPs 34.212.141.129, 35.164.252.66, 52.40.203.11
Redirect IPs 34.212.141.129, 35.164.252.66, 52.40.203.11
Response IP 34.212.141.129
Found Yes
Hash 134c3c668379b0cef6cd7e2153909b9c47a74586c4b21b998221ad322b13b338
SimHash a95edb2a7dd2

Groups

semrush

Rule Path
Disallow /

apache-httpclient

Rule Path
Disallow /

hubspot crawler 1.0 http://www.hubspot.com/

Rule Path
Disallow /

*

Rule Path
Disallow /member/
Disallow /members
Disallow /login

adsbot-google

Rule Path
Disallow /member/
Disallow /members

dotbot

Rule Path
Disallow /

Comments

  • Google adsbot ignores robots.txt unless specifically named!