Collect Logs Using FluentD in SigNoz Cloud

1. Add OpenTelemetry Collector Binary Follow this guide to add the OpenTelemetry collector binary to your VM.

2. Configure FluentForward Receiver Add the following to your config.yaml:

   receivers:
     fluentforward:
       endpoint: 0.0.0.0:24224
   

   You can change the port if needed. Learn more about the fluentforward receiver here.

3. Modify the Service Section Update your config.yaml:

   service:
       ...
       logs:
           receivers: [otlp, fluentforward]
           processors: [batch]
           exporters: [otlp]
   

4. Update FluentD Configuration Add the following to your FluentD configuration to forward logs to the OpenTelemetry collector:

   <match <directive>>
     @type forward
     send_timeout 60s
     recover_wait 10s
     hard_timeout 60s
   
     <server>
       name myserver1
       host localhost
       port 24224
     </server>
   </match>
   

   Replace <directive> with your directive name. If FluentD is not running on the host, adjust the host value accordingly.

5. Restart Services Restart FluentD and the OpenTelemetry collector binary. Logs should now appear in SigNoz.

6. Transform Logs to OpenTelemetry Model Use processors in OpenTelemetry to transform logs. Example:

   processors:
     logstransform:
       operators:
         - type: trace_parser
           trace_id:
             parse_from: attributes.trace_id
           span_id:
             parse_from: attributes.span_id
         - type: remove
           field: attributes.trace_id
         - type: remove
           field: attributes.span_id