Implement message queue

[secustor]

Fixes #429

Changes

• add Kafka to docker-compose
• add Kafka producer to checkoutservice
• implement Accountingservice
• implement Frauddetectionservice

For significant contributions please make sure you have completed the following items:

• Appropriate CHANGELOG.md updated for non-trivial changes
• Design discussion issue feat: Add queue example to demo  #429

[cartersocha]

Hey just an fyi we're on a feature freeze for the next week or 2 due to our upcoming v1 release and kubecon.

Feel free to keep this open and working on it tho!

[fatsheep9146]

I wonder that why add two new services? Since the checkout service is the only kafka message producer, the two new services are both consumers. What's the point of this?

[secustor]

Async workflows usually have multiple consumers with different use cases.
The intention is to show async with OTEL in a common scenario and that both spans are added to the parent span of the checkoutservice

[saurabhdes]

Lgtm

[cartersocha]

we should test the build time increase from 3 new containers. One thing to keep in mind is that go doesn’t have an operator instrumentation option. We’d need to implement that with the Java service or replace Go

[cartersocha]

For the architecture docs and services table my bias would be to label the language Java not Kotlin for the fraud detection service

[secustor]

I have tested builds again this branch and main.

Setup:

• Mac M1
• ContainerRuntime:
  • DockerDaemon: Colima
  • 8 GB RAM
  • 4 Cores
  • 100 GB Disk

Methodology
Run docker system prune --force && docker-compose build --no-cache

implemented changes:

• 12m 11s
• 13m 22s

main ( 5a2c0ef ):

• 12m 30s
• 12m 58s

So there are no relevant changes. The limiting factor is the build time of the currency service.

For the architecture docs and services table my bias would be to label the language Java not Kotlin for the fraud detection service

I prefer to use Kotlin as this signals that multiple JVM languages are supported. An alternative would be to rename JAVA to JVM

[secustor]

From the Google docs:

Merge PR then re-write new service?

@julianocosta89 @cartersocha @puckpuck I have not been able to join the SIG Meeting, is there a decision to rewrite accountingservice in Python before or after the merge of this PR?

[puckpuck]

The goal is to get this PR merged this week with Go for the accountingservice

After the merge, we will rewrite the service in another language that can be auto-instrumented with the OpenTelemetry Operator. We may want to document that as part of this PR so expectations are set with the broader community.

[cartersocha]

lgtm. Ready to merge after @julianocosta89 or @puckpuck get a chance to take a look.

Thank you @secustor for the big addition!

[puckpuck]

Thank you very much for this. Docs are great too. I do have some non-functional items that I would like addressed, but everything else looks ready to go.

[puckpuck]

I made some changes to logging as well as added health checks.

I also changed the name of the kafka container to: kafka

[puckpuck]

🎉