Reduce memory use during Archive Sync

[benaadams]

Changes

• TxTries and ReceiptTries don't do any pruning so don't need the ConcurrentDictionaries allocated just for Calculating roots

• Lazy allocate ConcurrenctDictionaries (+DirtyNodes in Trie)
• Change class => struct
• NodeKey class => struct
• Force GCs on archive sync

Seen when processing archive nodes (many blocks at once)

Types of changes

What types of changes does your code introduce?

• Optimization

Testing

Requires testing

• No

[MarekM25]

LGTM! LastSeen is not needed at all for receipts and transactions. :)

Was it the reason for the memory leak?

I think TrieStore could be simplified significantly for receipts and transactions

[benaadams]

Was it the reason for the memory leak?

Yes is doing 400 blk/s so doing the block allocations at a far faster rate; plus since its not going via newPayload it doesn't trigger the GCKeeper so we don't trigger the memory release GCs (GC decides we need that memory due to the high allocation rate) or the MallocTrims