pledgebox.com
robots.txt

Robots Exclusion Standard data for pledgebox.com

Resource Scan

Scan Details

Site Domain pledgebox.com
Base Domain pledgebox.com
Scan Status Ok
Last Scan2025-09-19T00:03:28+00:00
Next Scan 2025-10-19T00:03:28+00:00

Last Scan

Scanned2025-09-19T00:03:28+00:00
URL https://pledgebox.com/robots.txt
Redirect https://www.pledgebox.com/robots.txt
Redirect Domain www.pledgebox.com
Redirect Base pledgebox.com
Domain IPs 75.2.70.75, 99.83.190.102
Redirect IPs 52.68.134.190, 54.238.67.66, 57.180.160.60
Response IP 52.68.134.190
Found Yes
Hash 5e2af90af6121637428e62d5052ff6ab7ad5f62b3a3ede214379e052a64d16ad
SimHash 78901e0b80c6

Groups

facebookexternalhit

Rule Path
Disallow /

facebot

Rule Path
Disallow /

twitterbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

googleother

Rule Path
Disallow /

timpibot

Rule Path
Disallow /

sbintuitionsbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ai2bot

Rule Path
Disallow /

amazon q

Rule Path
Disallow /

claude-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

yandexgpt

Rule Path
Disallow /

mistralbot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

youbot

Rule Path
Disallow /

neevaai

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.pledgebox.com/sitemap.xml