Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enhance Mempool performance #226

Merged
merged 103 commits into from
Oct 6, 2023
Merged

Commits on Jul 16, 2023

  1. Configuration menu
    Copy the full SHA
    5981bd5 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    846bd38 View commit details
    Browse the repository at this point in the history

Commits on Jul 17, 2023

  1. Configuration menu
    Copy the full SHA
    1b18e11 View commit details
    Browse the repository at this point in the history

Commits on Jul 18, 2023

  1. Configuration menu
    Copy the full SHA
    84c1743 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    a2c8e5b View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    563baaf View commit details
    Browse the repository at this point in the history

Commits on Jul 20, 2023

  1. Configuration menu
    Copy the full SHA
    d842040 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    4f3d1de View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2023

  1. Configuration menu
    Copy the full SHA
    49d74eb View commit details
    Browse the repository at this point in the history

Commits on Aug 12, 2023

  1. Configuration menu
    Copy the full SHA
    4b36529 View commit details
    Browse the repository at this point in the history

Commits on Aug 25, 2023

  1. Configuration menu
    Copy the full SHA
    2b4d41d View commit details
    Browse the repository at this point in the history

Commits on Aug 26, 2023

  1. Making room in the mempool for a new transaction won't remove chained…

    … txs nor parent txs of the new transaction
    tiram88 committed Aug 26, 2023
    Configuration menu
    Copy the full SHA
    0cb6619 View commit details
    Browse the repository at this point in the history

Commits on Aug 29, 2023

  1. Refine lock granularity on Mempool and Consensus while processing uno…

    …rphaned transactions (wip)
    tiram88 committed Aug 29, 2023
    Configuration menu
    Copy the full SHA
    6ebde53 View commit details
    Browse the repository at this point in the history
  2. Fix failing test

    tiram88 committed Aug 29, 2023
    Configuration menu
    Copy the full SHA
    ff59ac9 View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2023

  1. Enhance performance & refine lock granularity on Mempool and Consensu…

    …s while revalidating high priority transactions
    tiram88 committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    974a980 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    b725080 View commit details
    Browse the repository at this point in the history

Commits on Aug 31, 2023

  1. Comments

    tiram88 committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    b814876 View commit details
    Browse the repository at this point in the history

Commits on Sep 1, 2023

  1. Configuration menu
    Copy the full SHA
    68e341d View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    bd13f22 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    eab8c8e View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    f7b58d2 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    13b4e43 View commit details
    Browse the repository at this point in the history
  6. Add some logs and comments

    tiram88 committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    9026043 View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2023

  1. Configuration menu
    Copy the full SHA
    82cb48a View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    77af21d View commit details
    Browse the repository at this point in the history
  3. Add 2 TODOs

    tiram88 committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    41397ba View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2023

  1. Configuration menu
    Copy the full SHA
    54e8b39 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    f6225aa View commit details
    Browse the repository at this point in the history

Commits on Sep 7, 2023

  1. Add an accepted transaction ids cache to the mempool and use it to pr…

    …event reentrance in mempool, broadcasting to and asking from peers
    tiram88 committed Sep 7, 2023
    Configuration menu
    Copy the full SHA
    ece7e97 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    ea17aaa View commit details
    Browse the repository at this point in the history
  3. Enhance tx removal logging

    tiram88 committed Sep 7, 2023
    Configuration menu
    Copy the full SHA
    46fb8df View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    5b5ef5d View commit details
    Browse the repository at this point in the history
  5. Add mempool stats

    tiram88 committed Sep 7, 2023
    Configuration menu
    Copy the full SHA
    8522ced View commit details
    Browse the repository at this point in the history

Commits on Sep 10, 2023

  1. Configuration menu
    Copy the full SHA
    61ca786 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    5ba09f5 View commit details
    Browse the repository at this point in the history
  3. Some profiling and debug logs

    tiram88 committed Sep 10, 2023
    Configuration menu
    Copy the full SHA
    2df3029 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    254a7e8 View commit details
    Browse the repository at this point in the history

Commits on Sep 11, 2023

  1. Configuration menu
    Copy the full SHA
    375f78d View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    004beb6 View commit details
    Browse the repository at this point in the history
  3. fixes in on_new_block

    michaelsutton committed Sep 11, 2023
    Configuration menu
    Copy the full SHA
    f8d4401 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    c32b660 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    625cf12 View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2023

  1. Configuration menu
    Copy the full SHA
    205e934 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    674481f View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    8420832 View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2023

  1. Configuration menu
    Copy the full SHA
    78fefb3 View commit details
    Browse the repository at this point in the history
  2. Merge branch 'mempool-perf' of https:/tiram88/rusty-kaspa

    …into mempool-perf
    tiram88 committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    5bd630c View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    118559e View commit details
    Browse the repository at this point in the history

Commits on Sep 14, 2023

  1. Configuration menu
    Copy the full SHA
    9302574 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    b63b586 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    55273ab View commit details
    Browse the repository at this point in the history

Commits on Sep 15, 2023

  1. ignore perf logs

    michaelsutton committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    a9a93a0 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    782315f View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    0614dcb View commit details
    Browse the repository at this point in the history
  4. Merge pull request #4 from michaelsutton/mempool-perf-2

    Maintain mempool ready transactions in a dedicated set
    tiram88 authored Sep 15, 2023
    Configuration menu
    Copy the full SHA
    66b2ea0 View commit details
    Browse the repository at this point in the history

Commits on Sep 17, 2023

  1. Configuration menu
    Copy the full SHA
    21e3d1c View commit details
    Browse the repository at this point in the history
  2. lint

    tiram88 committed Sep 17, 2023
    Configuration menu
    Copy the full SHA
    9c0acba View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    e320045 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    84b0476 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    8212a05 View commit details
    Browse the repository at this point in the history
  6. Merge branch 'mempool-perf' of https:/tiram88/rusty-kaspa

    …into mempool-perf
    tiram88 committed Sep 17, 2023
    Configuration menu
    Copy the full SHA
    403c6b0 View commit details
    Browse the repository at this point in the history

Commits on Sep 18, 2023

  1. Configuration menu
    Copy the full SHA
    01c8f9c View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2023

  1. Configuration menu
    Copy the full SHA
    d024904 View commit details
    Browse the repository at this point in the history
  2. Test selector transaction rejects & fix empty template returned by `s…

    …elect_transactions` upon selector reuse
    tiram88 committed Sep 19, 2023
    Configuration menu
    Copy the full SHA
    1f0c44e View commit details
    Browse the repository at this point in the history
  3. Log some mempool metrics

    tiram88 committed Sep 19, 2023
    Configuration menu
    Copy the full SHA
    bb56c70 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    1156ee7 View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2023

  1. Configuration menu
    Copy the full SHA
    14da8a2 View commit details
    Browse the repository at this point in the history

Commits on Sep 21, 2023

  1. turn tx selector into an ongoing process with persistent state (wip: …

    …some tests are broken; selector is not used correctly by builder)
    michaelsutton committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    92bb8dd View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    0e54b66 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    d231134 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    9a015d1 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    58e0ed5 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    827b9fa View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    db0cddf View commit details
    Browse the repository at this point in the history
  8. avoid realloc

    michaelsutton committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    08456c6 View commit details
    Browse the repository at this point in the history

Commits on Sep 22, 2023

  1. Address review comments

    tiram88 committed Sep 22, 2023
    Configuration menu
    Copy the full SHA
    099497b View commit details
    Browse the repository at this point in the history
  2. Merge pull request #5 from michaelsutton/mempool-perf-3

    Make transaction selector iterative and reduce consensus<->mempool sync gap
    tiram88 authored Sep 22, 2023
    Configuration menu
    Copy the full SHA
    70a91ec View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    bb724e6 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    66dbca8 View commit details
    Browse the repository at this point in the history

Commits on Sep 23, 2023

  1. Log double spends

    tiram88 committed Sep 23, 2023
    Configuration menu
    Copy the full SHA
    abd3143 View commit details
    Browse the repository at this point in the history

Commits on Sep 24, 2023

  1. Configuration menu
    Copy the full SHA
    c29680f View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    6f8b024 View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2023

  1. Configuration menu
    Copy the full SHA
    87f20f0 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    bc6bdc6 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    1c7357d View commit details
    Browse the repository at this point in the history

Commits on Oct 3, 2023

  1. Configuration menu
    Copy the full SHA
    fd4731e View commit details
    Browse the repository at this point in the history
  2. rename ro validate_transaction_unacceptance and move to before the …

    …orphan case (accepted txs will usually be orphan)
    michaelsutton committed Oct 3, 2023
    Configuration menu
    Copy the full SHA
    8bec918 View commit details
    Browse the repository at this point in the history

Commits on Oct 5, 2023

  1. Configuration menu
    Copy the full SHA
    a99d3d8 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    f161b1c View commit details
    Browse the repository at this point in the history
  3. design fix: avoid exposing full collections as mut. This violates enc…

    …apsulation logic since collections can be completely modified externally; while in tx pools it is important to make sure various internal collections are maintained consistently (for instance the `ready_transactions` field on `TransactionsPool` needs careful maintenance)
    michaelsutton committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    41e4a94 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    316f9d1 View commit details
    Browse the repository at this point in the history
  5. remove_transaction: no need to manually update parent-child relatio…

    …ns in the case `remove_redeemers=false`. This is already done via `remove_transaction_from_sets` -> `transaction_pool.remove_transaction`. + a few minor changes
    michaelsutton committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    8ce99e7 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    4faf2fa View commit details
    Browse the repository at this point in the history
  7. no need to remove_redeemers_of for the initial removed tx since thi…

    …s happens as part of:
    
    `remove_from_transaction_pool_and_update_orphans` -> `orphan_pool.update_orphans_after_transaction_removed` -> `orphan_pool.remove_redeemers_of`
    michaelsutton committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    7be8b61 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    e6142e7 View commit details
    Browse the repository at this point in the history
  9. remove redeemers of expired low-prio txs + register scan time and daa…

    … score after collection (bug fix)
    michaelsutton committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    044fa3d View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    969fae4 View commit details
    Browse the repository at this point in the history

Commits on Oct 6, 2023

  1. Configuration menu
    Copy the full SHA
    d01ebd6 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    acc3016 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    2e11cf6 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    cc51b62 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    5aff480 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    099aa40 View commit details
    Browse the repository at this point in the history