Roadmap(SeM): Secure Scaling

[kaiserd]

Background / Motivation

Issues

(This roadmap is WIP. Items on the roadmap, especially ones farther in the future, might change.)

Simple scaling to 1 mio users

• New RFC: first version of Waku Relay Sharding #163
  • raw RFC topic sharding: alternative approaches and update requests #174
    • update: RFC 51 static sharding rfc#576
    • update: topic naming rfc#579
    • feat: RFC 51 index list representation rfc#583
  • update 31/WAKU2-ENR: add static sharding fields #178
• New RFC: BCP Waku Simple Scaling #160
• Analysis: Waku Relay scaling (part 1) #158
• Simple Waku Relay DoS mitigation #164
  • Improve Waku resilience against flooding attacks #148
  • Application Defined Message Validation #141

Overview over the integration of these tasks into the Status MVP

mid/long-term Research

• Waku Relay pubSub topic sharding #157
• Analysis: Waku Store scaling #159
• Waku Relay DoS mitigation
• Scaling a single Waku Relay mesh
• New Message Dissemination Methods
  • alternatives to Waku Relay, with different desirable trade-offs

[oskarth]

Can we make this issue more targeted specifically towards 1m users? Either by rewording this issue or creating a new one with subset.

It should be similar to waku-org/pm#12 for 10k users

I know there are specs etc, but it is useful to have an overarching milestone that captures the general problem, even if there's a lot of uncertainty.

This issue should also have a link to the model issue for napkin calculation as talked about before

[kaiserd]

My answer here did not go through, sorry, just realized now.
(We already discussed (parts) in Discord.)

Issues under the section Simple scaling to 1 mio users are towards the 1mio milestone.
Imo, this issue should be a general SeM roadmap, also beyond the milestone.
Also, part of the SeM effort towards the milestone is on other roadmaps:

#170
#165

I will write an overview over the SeM efforts towards the 1mio milestone (expected next week).

Research done here is embedded in the Status MVP issue you linked.
(It is also linked in the roadmap above.)

The RFC targeted in #160 will explain how to scale various components.
The model issue is #158.
Both are on this roadmap.

[kaiserd]

Here is the milestone issue: #187

[kaiserd]

Ownership of most parts of this issue has been moved to Waku: waku-org/pm#101

Gossipsub scaling specific parts are covered in: https://roadmap.logos.co/vac/dr/