Shipping logs through fly-log-shipper

1

Hi everyone,

I have setup fly-log-shipper to ship the logs from my Fastify API server, which emit logs in JSON format, to AWS CloudWatch. What I observe in CLoudWatch is that the log entries from the app are converted to stringified JSON, because they are inside another JSON object emitted by the fly-log-shipper. Is there a way to configure fly-log-shipper to just ship the original message without adding its own “fluff?

FWIW, below is the fly.toml file that I used to deploy fly-log-shipper:

app = ‘…’’
primary_region = ‘…’

[build]
image = ‘ghcr.io/superfly/fly-log-shipper:latest’

[env]
SUBJECT = “logs.app-name.>”

[http_service]
internal_port = 8080
force_https = true
auto_stop_machines = ‘stop’
auto_start_machines = true
min_machines_running = 0
processes = [‘app’]

[[services]]
http_checks = 

internal_port = 8686

[[vm]]
memory = ‘256mb’
cpus = 1
memory_mb = 256

Thanks!

3

Can you try this branch of the log shipper? You’ll need to update the fly.toml and set CLOUDWATCH_ENCODING_CODEC to “raw_message”. If that doesn’t work, other formats are here.

4

Thank you! I changed my fly.toml as follows and as far as I can tell nothing gets shippped now:

[build]

  image = 'flyio/log-shipper:latest'




[env]

SUBJECT = "logs.tr-api-prod.>"

CLOUDWATCH_ENCODING_CODEC = "raw_message”

Below is what I see in the log-shipper’s log:

09:57:04Configured sinks:

09:57:042026-03-06T09:57:04.698811Z  INFO vector::app: Log level is enabled. level="vector=info,codec=info,vrl=info,file_source=info,tower_limit=trace,rdkafka=info,buffers=info,lapin=info,kube=info"

09:57:042026/03/06 09:57:04 INFO SSH listening listen_address=[fdaa:2e:b3af:a7b:56:187e:18e:2]:22

09:57:042026-03-06T09:57:04.715729Z  INFO vector::app: Loading configs. paths=["/etc/vector/vector.toml", "/etc/vector/sinks"]

09:57:052026-03-06T09:57:05.285610Z  INFO vector::topology::running: Running healthchecks.

09:57:052026-03-06T09:57:05.285988Z  INFO vector::topology::builder: Healthcheck passed.

09:57:052026-03-06T09:57:05.286051Z  INFO vector::topology::builder: Healthcheck passed.

09:57:052026-03-06T09:57:05.286965Z  INFO vector: Vector has started. debug="false" version="0.29.1" arch="x86_64" revision="74ae15e 2023-04-20 14:50:42.739094536"

09:57:052026-03-06T09:57:05.294566Z  INFO vector::sinks::prometheus::exporter: Building HTTP server. address=[::]:9598

09:57:052026-03-06T09:57:05.302435Z  INFO vector::sinks::blackhole::sink: Collected events. events=0 raw_bytes_collected=0

09:57:052026-03-06T09:57:05.304477Z  INFO vector::internal_events::api: API server running. address=[::]:8686 playground=http://:::8686/playground

I reverted for now. Please let me know if I’ve done something wrong.