New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create cloudformation template to setup s3 + sqs #40624

Closed

kaiyan-sheng opened this issue Aug 26, 2024 · 1 comment · Fixed by #40642

Assignees

Labels

Team:obs-ds-hosted-services

Contributor

kaiyan-sheng commented Aug 26, 2024

In Filebeat/agent, we can use the aws-s3 input to retrieve logs from S3 objects that are pointed to by S3 notification events read from an SQS queue. In order to avoid manual setup every time by following https://www.elastic.co/guide/en/beats/filebeat/current/filebeat-input-aws-s3.html#_s3_and_sqs_setup, we should create a cloudformation template to:

create s3
create sqs
setup s3+sqs

kaiyan-sheng assigned Kavindu-Dodan

botelastic bot added the needs_team label

kaiyan-sheng added the Team:obs-ds-hosted-services label

Collaborator

elasticmachine commented Aug 26, 2024

Pinging @elastic/obs-ds-hosted-services (Team:obs-ds-hosted-services)

botelastic bot removed the needs_team label

Kavindu-Dodan mentioned this issue

[Docs] add cloudformation backed guide for s3-sqs setup for filebeats #40642

Merged

2 tasks

Kavindu-Dodan closed this as completed in #40642

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment