Configuring the AWS S3 backend (Managed)
otel-data
in region us-east-1
using the AWS CLI, you can run the following command:
AWS Credentials
and permissions set up.$EKS_CLUSTER_REGION
with the region of your EKS cluster and $EKS_CLUSTER_NAME
with the name of your EKS cluster (or set them as environment variables).
otel-data
with the name of your bucket if you used a different name.odigos-s3
in this example, you can use it or choose a different name. Take note of the policy ARN, you will need it in the next step.--attach-policy-arn
value with the ARN of the policy you created in the previous step.otlp_json
and otlp_proto
.
Each batch of logs / metrics / spans will be written as a single s3 object in the specified bucket.
The content of the object will be the serialized data in the OpenTelemetry Protocol format,
represented as either JSON or Protocol Buffers.
For example, the following JSON string represents a single span in otlp_json
format, from Odigos demo application:
Supported Signals:
string
: Bucket Name. The name of the bucket where the data will be stored
string
: Bucket Region. The AWS region where the bucket is located
string
: Time granularity of S3 Bucket. Wether a new subdirectory should be created every minute or every hour
minute
string
: Marshaller (Data Format). The format in which the data will be encoded. It can be either otlp_json
or otlp_proto
. Default is otlp_json
otlp_json
Add Destination
, select AWS S3
and follow the on-screen instructionss3.yaml
)kubectl