Zero-latency SQLite storage in every Durable Object

1. simonw ◴[13 Oct 24 23:55 UTC] No.41832812[source]▶

One thing I don't understand about Durable Objects yet is where they are physically located.

Are they located in the region that hosted the API call that caused them to be created in the first place?

If so, is there a mechanism by which a DO can be automatically migrated to another location if it turns out that e.g. they were created in North America but actually all of the subsequent read/write traffic to them comes from Australia?

replies(5): >>41832834 #>>41832862 #>>41832906 #>>41832933 #>>41833115 #

2. ko_pivot ◴[13 Oct 24 23:59 UTC] No.41832834[source]▶

>>41832812 (TP) #

Durable Objects have long term storage. They get hydrated from that storage, so in that sense, they can move to any Cloudflare DS. However, there is no API call to move a Durable Object. It has to have no connections and then gets recreated in the DS nearest to the next/first connection. Memory gets dropped when that happens, storage survives. (This is slightly out of date as they have some nuanced hibernation stuff that is recent).

3. masterj ◴[14 Oct 24 00:03 UTC] No.41832862[source]▶

>>41832812 (TP) #

> Durable Objects do not currently change locations after they are created

> Dynamic relocation of existing Durable Objects is planned for the future.

https://developers.cloudflare.com/durable-objects/reference/....

IIRC Orleans (https://www.microsoft.com/en-us/research/wp-content/uploads/...) allows actors to be moved between machines, which should map well to DOs being moved between locations.

replies(1): >>41834934 #

4. mhart ◴[14 Oct 24 00:12 UTC] No.41832906[source]▶

>>41832812 (TP) #

By default in the region you created them in, but you can alternatively specify a locationHint. Use "oc" for Australia. https://developers.cloudflare.com/durable-objects/reference/...

Note the "Dynamic relocation of existing Durable Objects is planned for the future"

replies(1): >>41833048 #

5. crabmusket ◴[14 Oct 24 00:17 UTC] No.41832933[source]▶

>>41832812 (TP) #

Not an answer to your question, but shoutout to https://where.durableobjects.live/

6. simonw ◴[14 Oct 24 00:37 UTC] No.41833048[source]▶

>>41832906 #

Thanks, added that to my post.

7. dantiberian ◴[14 Oct 24 00:50 UTC] No.41833115[source]▶

>>41832812 (TP) #

https://where.durableobjects.live is a good website that shows you where they live. Only about 10-11% of Cloudflare PoPs host durable objects. Requests to another PoP to create a DO will get forward to one of the nearby PoPs which do host them.

8. pests ◴[14 Oct 24 06:59 UTC] No.41834934[source]▶

>>41832862 #

As actors in Orleans are virtual and persistent it can also be the case it is running nowhere.

If it's stateless it could be running in multiple locations.

I worry "Dynamic relocation of DOs" might be going a bit too granular, this should be something the runtime takes care of.