Looking for Tips on Analyzing Transactions Across 100 Crypto Wallets

Hey folks, I'm diving into a project where I need to look at transactions between a group of 100 crypto wallets to see if there are any shared transactions. I'm running into some issues with API limits and just the sheer amount of data I’m dealing with. Here’s what I’ve done so far: I tried using APIs like CovalentHQ and Transpose.io, but I keep hitting those rate limits because of how many calls I need to make. I've also looked at tracking transactions for each wallet, but again, it’s a problem with the rate limits when you're dealing with 100 wallets. I’m reaching out for any tips or advice you might have on handling this more efficiently. Are there better APIs or tools that can deal with this level of data? Or maybe there's a clever way to cut down on the number of API calls? Any insights from your experience would really help! Thanks a ton for any help!

I assume you're analyzing Bitcoin wallet. In this case, i would recommend you to run your own Bitcoin full node and Bitcoin block explorer with API feature. Bitcoin Core is probably most solid for Bitcoin full nodes, while there are so many option for block explorer. Mempool probably offer most feature[1], but other option such as Bitcoin Explorer (along with any Electrum server)[2] should be easier option. That way, the only limit is your hardware speed. Other than that, your option is using paid API with higher limit. [1] https://github.com/mempool/mempool [2] https://github.com/janoside/btc-rpc-explorer/

It's not clear to me what you mean by "wallets" and "common transactions". I assume you mean addresses and the transactions referring to them. I agree with the suggestion for running your own node if that's what you are looking for. However, if you are looking for analysis information, such as groups of addresses (aka wallets), you will probably have to pay to get around rate limits.

Have you tried wallet explorer? It will basically group addresses togrther when they spend utxo together. Easy and good tool http://walletexplorer.com/ It might help you to find obvious connections between addresses.