Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support Kafka message transformation #1174

Open
2 of 3 tasks
jfallows opened this issue Aug 1, 2024 · 0 comments
Open
2 of 3 tasks

Support Kafka message transformation #1174

jfallows opened this issue Aug 1, 2024 · 0 comments
Labels
needs_triage Unknowns need to be addressed story Feature description from user's perspective

Comments

@jfallows
Copy link
Contributor

jfallows commented Aug 1, 2024

Describe the desired outcome from the user's perspective
As an application developer, I need to transform messages received from a Kafka topic to present via mqtt-kafka, http-kafka or sse-kafka mappings.

Acceptance criteria

  • transforms should not be required
  • transforms should be aligned with Kafka Connect SMTs
  • transforms should be evaluated in configured order

Additional context
Suggested configuration for transforms.

  kafka_cache_server:
    type: kafka
    kind: cache_server
    options:
        topics:
          - name: my-transformed-topic
            transforms:
              - extract-key: ${message.key.id}
              - extract-headers:
                'zilla:identity': ${message.value.user_id}
...

See also Kafka Connect transformations.

Tasks

@jfallows jfallows added the story Feature description from user's perspective label Aug 1, 2024
@vordimous vordimous added the needs_triage Unknowns need to be addressed label Aug 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
needs_triage Unknowns need to be addressed story Feature description from user's perspective
Projects
Status: No status
Development

No branches or pull requests

2 participants