Neki – Sharded Postgres

247 points131 comments19 hours ago
gk1

Folks, in your launch posts remember to describe what you're launching and what it's for. Ideally in the opening paragraph.

- Intro: Explains problem but not what is Neki or what it's for.

- Why Neki: Explains alternatives and why they suck but not what is Neki or what it's for.

- How does Neki work: Describes the technical components but not what is Neki or what it's for.

- What you get beyond sharding: Explains how to run/deploy but not what is Neki or what it's for.

- What is a platform preview + Try Neki today: 140 words on the definition of "preview" and links to get started... but not what is Neki or what it's for.

Edit: The landing page has 100x more useful information up front -> https://neki.dev/

Edit #2: They've since added a "What is Neki" section. Good reaction time.

show comments
Yannik_Sc

I love the offer which is running on the "PlanetScale Metal".

They claim to provide unlimited IOPS (I/O operations Per Second).

I would like to get some of these drives myself. Sounds like a technical miracle.

On the other hand claiming such miracles makes me wonder which other aspects in this are are actually a working miracle or rather a mythos/false marketing claim.

Atreiden

The top concern I've gotten from dev teams when proposing HA distributed postgres (e.g through RDS Aurora global) is that eventual consistency is not suitable for many workloads.

Does Neki solve for this, and if so how? My understanding of CAP theorem is that this basically requires some compromises around availability, but I'm curious as to what that looks like in practice here.

show comments
xyzzy_plugh

I love how the Planetscale CEO has been shitting on multigres[0], Supabase's equivalent to Neki, and gloating about how superior Neki is, and yet Neki is not even open source!

Sam, it feels like you're just playing games. It's hard to take anything you say or do seriously. Are you going to OSS this thing? Or have you decided to backpedal?

Congrats on the checks notes closed launch, I guess?

0: https://github.com/multigres/multigres

show comments
fsuts

Kinda ironic that Planetscale built their company on open source Vitess that google built

And now planetscale have made a Vitess like equivalent for Postgres which they have made proprietary

show comments
hanspagel

I need this for my side project that has zero users, but I wonder if Neki will scale well enough.

show comments
erulabs

I love to see this but as a heavy Vitess/MySQL user I do fear the split focus from PlanetScale. Hoping to see continued improvements on the Vitess side as well.

Selfish doubts aside, congrats to Planetscale on the launch!

show comments
dvtkrlbs

Is this going to be open sourced? I thought this was the plan at the start. But ow I am confused.

khy

Man, I was deep into this blog post before I was able to answer the question "what is Neki?".

show comments
eile23

How are cross-shard joins and transactions handled? Are there query patterns that would require application changes despite using the same drivers and ORM?

kaycebasques

I am on a 12 Muni right now that is plastered with a Neki ad, and I looked up neki.dev literally 10 mins ago to see what this product is about. Did they time the release of this bus ad with the launch date?

show comments
ripe

Neki is a sharded Postgres implementation. It introduces one level of indirection between the application and the Postgres shards.

Found this from neki.dev.

show comments
devy

How does Neki compare to https://pgdog.dev/?

show comments
aamederen

The first question came to my mind was, how would this compare against Citus.

show comments
Tepix

So apparently the neki router uses many parts of Postgres. But is it open source itself?

Apparently not.

tjohnell

A C2 level diagram included in the blog post would be helpful. What are the drawbacks to using Neki aside from the obvious (new software has bugs)?

show comments
kamikazechaser

Not even freeware/shareware?

wewewedxfgdf

Nice work by the marketing department getting two posts on HN front page at same time.

show comments
vaibhav2614

Pretty exciting to see a sharded Postgres product in the market.

The pitch is compelling. I wonder how many teams will be able to operate sharded database setups in production as a result of this.

vira28

Obviously welcome more tools for Postgres and sharding but it’s a tough hill to climb against the hyper clouds. Best wishes to the team.

show comments
ragall

I see no mention of foreign keys, or any other constraints, across shards. If, as I suspect, they're not implemented, it would still be useful but at the level of Spanner 10 years ago.

show comments
phoenix24

is this open-sourced?

manlymuppet

I think this will become the new standard.

_1tan

Cool, but we're on MySQL - anything similar available? Percona XtraDB?

show comments
Hasz

Independent of the product, love the branding design for this page.

xnx

What does this compete with? Google Cloud SQL?

show comments
karuppiah7890

It's not Open Source Software. So, I'm not even interested. Lol

show comments
rs_rs_rs_rs_rs

Will this be open source at some point?

show comments
behole

Site design is tight. I like it.

show comments
xyst

only planet scale? Rookie numbers.

I am looking for interdimensional and interuniversal scale. Which of you trust fund babies has a startup which is working on this problem?

show comments
_kidlike

can we choose read-after-write consistency at query time, if needed?

parthdesai

The tech might be amazing, but the CEO comes across as an asshole

show comments