Log In Sign Up

repurposingjunkie.com
robots.txt

Robots Exclusion Standard data for repurposingjunkie.com

Resource Scan

Scan Details

Site Domain repurposingjunkie.com
Base Domain repurposingjunkie.com
Scan Status Ok
Last Scan2026-01-11T15:15:51+00:00
Next Scan 2026-01-18T15:15:51+00:00

Last Scan

Scanned2026-01-11T15:15:51+00:00
URL https://repurposingjunkie.com/robots.txt
Domain IPs 104.21.71.22, 172.67.142.72, 2606:4700:3030::ac43:8e48, 2606:4700:3032::6815:4716
Response IP 104.21.71.22
Found Yes
Hash 6e90eeaaf8adb2963434604d626e55e268979d8068814b4a74f7a7462a7ac6c0
SimHash 5b3e636c8375

Groups

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

leikibot

Rule Path
Disallow

doubleverifybot

Rule Path
Disallow

dvbot

Rule Path
Disallow

amazonbot

Rule Path
Disallow

amazonadbot

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

criteobot

Rule Path
Disallow

gumgum

Rule Path
Disallow

peer39_crawler

Rule Path
Disallow

proximic

Rule Path
Disallow

pubmatic crawler bot

Rule Path
Disallow

ttd-content

Rule Path
Disallow

bidswitchbot

Rule Path
Disallow

sincerasyntheticuser

Rule Path
Disallow

ias_crawler

Rule Path
Disallow

ias_wombles

Rule Path
Disallow

ias_admantx user-agent

Rule Path
Disallow

grapeshot

Rule Path
Disallow

opebot-v

Rule Path
Disallow
Back to top

Comments

  • Allow Leikibot
  • Allow DoubleVerify bots
  • Allow Amazon bots
  • Allow Google Ads bot
  • Allow Criteo
  • Allow GumGum
  • Allow Peer39
  • Allow Proximic
  • Allow PubMatic
  • Allow The Trade Desk
  • Allow BidSwitch
  • Allow Sincera
  • Allow IAS bots
  • Allow Grapeshot
  • Allow Opebot
Back to top