Getting Started
otel-data
in region us-east-1
using the AWS CLI, you can run the following command:
Make sure that you have the necessary
AWS credentials are retrieved from the default credential chain.
AWS Credentials
and permissions set up.AWS credentials are retrieved from the default credential chain.
$EKS_CLUSTER_REGION
with the region of your EKS cluster and $EKS_CLUSTER_NAME
with the name of your EKS cluster (or set them as environment variables).
- Replace
otel-data
with the name of your bucket if you used a different name. - The policy name is
odigos-s3
in this example, you can use it or choose a different name. Take note of the policy ARN, you will need it in the next step.
- make sure to replace the
--attach-policy-arn
value with the ARN of the policy you created in the previous step. - use your EKS cluster name and region.
otlp_json
and otlp_proto
.
Each batch of logs / metrics / spans will be written as a single s3 object in the specified bucket.
The content of the object will be the serialized data in the OpenTelemetry Protocol format,
represented as either JSON or Protocol Buffers.
For example, the following JSON string represents a single span in otlp_json
format, from Odigos demo application:
Configuring Destination Fields
Supported Signals:
Supported Signals:
✅ Traces
✅ Metrics
✅ Logs
- S3_BUCKET
string
: Bucket Name. The name of the bucket where the data will be stored- This field is required
- S3_REGION
string
: Bucket Region. The AWS region where the bucket is located- This field is required
- S3_PARTITION
string
: Time granularity of S3 Bucket (Deprecated, use Partition Format). Deprecated field for time granularity. Use S3_PARTITION_FORMAT for custom formats.- This field is optional and defaults to
minute
- This field is optional and defaults to
- S3_PARTITION_FORMAT
string
: S3 Partition Format. Custom partition format using strftime syntax (e.g., ‘%Y/%m/%d/%H/%M’ for minute-level, ‘%Y/%m/%d/%H’ for hour-level). If not specified, S3_PARTITION will be used.- This field is optional
- Example:
%Y/%m/%d/%H/%M
- S3_MARSHALER
string
: Marshaller (Data Format). The format in which the data will be encoded. It can be eitherotlp_json
orotlp_proto
. Default isotlp_json
- This field is required and defaults to
otlp_json
- This field is required and defaults to
Adding Destination to Odigos
There are two primary methods for configuring destinations in Odigos:Using the UI
1
Use the Odigos CLI to access the UI
2
Click on
Add Destination
, select AWS S3
and follow the on-screen instructionsUsing Kubernetes manifests
1
Save the YAML below to a file (e.g.
s3.yaml
)2
Apply the YAML using
kubectl