Managed Kafka by Upstash available in private beta

Fresh Produce
,
1

We’re delighted to announce Managed Kafka by Upstash, running on Fly.io infrastructure! Private beta access is available iad and fra regions.

Write to extensions@fly.io with your Fly.io organization name to join. Then, check our getting started docs.

This beta comes with no SLA or uptime guarantees, but Upstash Kafka clusters can be considered production-grade. To predict costs, you’ll soon see usage details in your Fly.io billing dashboard. We won’t charge you until Upstash Kafka exits beta, and you’ll be notified about that.

Upstash for Redis already powers thousands of Redis databases for Fly.io customers. We noticed that Upstash brought pay-as-you-go pricing to Kafka, a service known for its hefty price tag.

We asked Upstash to bring their experience operating Kafka clusters at scale to Fly.io customers. This integration was a breeze, thanks to Upstash’s existing implementation of our Extensions API.

Please leave any questions or feedback here. Upstash and Fly.io are here for you.

4 Likes
2

So it cost the same as to leaving the hosting to Upstash, against when the servers are hosted within my fly org and I pay for the machines. Why would I want to incur extra cost to keep and manage the fly apps related to that cluster?

3

Sorry for the confusion. What’s meant here by ‘Fly.io Infrastructure’ is the same as the Upstash Redis case: your databases and clusters are managed by Upstash in their own Fly.io organization. You pay the same price as listed on Upstash’s site.

The reason you’d want this: having everything hosted on Fly.io means low-latency access (same datacenter) and security (no public access to the internet).

1 Like
4

Thanks. That makes sense. I thought I’d have to own and pay for the compute on fly.io, while paying for usage to upstash as well

5

Love this.

BTW, is there any plan to introduce Upstash QStash as well?

6

We’re discussing it. Do you already have a use case for QStash? Would it benefit from a low latency deployment on Fly.io?

7

with fly.io apps and kafka, i don’t need QStash. I’d go for it in a pure serverless system like lambda

8

Oh wow! Definitely interested. Emailed!

9

Upstash Kafka is now in public beta, available to all Fly.io users via fly ext kafka.

Let us know if you have any questions or feedback!

1 Like
10

How can I get into the beta? I got an error running ‘fly ext kafka’:

? Choose a name, use the default, or leave blank to generate one: kafka

Some regions require a Launch plan or higher (fra).

See Plan Pricing · Fly to set up a plan.

? Choose the primary region (can’t be changed later) Ashburn, Virginia (US) (iad)

Error: input:3: createAddOn Upstash_kafka provisioning is in private beta. Check back soon!

11

Hey andre, sorry for the confusion here. Upstash is shortly going to announce that they’re shutting down their Kafka product :cry: . So we’ve switched off public access for now, until we do a formal announcement and remove it from our CLI.

12

no worries, thanks for the info!