loro/README.md

104 lines
5.4 KiB
Markdown
Raw Normal View History

2022-11-18 10:55:09 +00:00
<p align="center">
<a href="https://loro.dev">
<picture>
2023-02-08 02:54:44 +00:00
<img src="./docs/Loro.svg" width="200"/>
2022-11-18 10:55:09 +00:00
</picture>
</a>
</p>
2023-10-29 13:37:24 +00:00
<h1 align="center">
2023-11-11 08:28:05 +00:00
<a href="https://loro.dev" alt="loro-site">Loro</a>
2023-11-11 03:20:16 +00:00
</h1>
2023-11-11 02:57:47 +00:00
<p align="center">
2023-11-11 08:28:05 +00:00
<b>Reimagine state management with CRDTs 🦜</b><br/>
Make your app state synchronized and collaborative effortlessly.
2023-11-11 02:57:47 +00:00
</p>
2023-10-29 13:37:24 +00:00
<p align="center">
2023-10-30 14:00:49 +00:00
<a aria-label="X" href="https://x.com/loro_dev" target="_blank">
2023-10-29 13:37:24 +00:00
<img alt="" src="https://img.shields.io/badge/Twitter-black?style=for-the-badge&logo=Twitter">
</a>
2023-10-30 14:00:49 +00:00
<a aria-label="Discord-Link" href="https://discord.gg/tUsBSVfqzf" target="_blank">
2023-10-29 13:37:24 +00:00
<img alt="" src="https://img.shields.io/badge/Discord-black?style=for-the-badge&logo=discord">
</a>
</p>
2023-11-14 11:06:11 +00:00
![Rich text example](https://i.postimg.cc/nr2SLHQB/202311120101-2.gif)
2023-11-11 17:50:54 +00:00
2023-11-16 13:14:11 +00:00
> ⚠️ **Notice**: The current API and encoding schema of Loro are **experimental** and **subject to change**. You should not use it in production.
2022-10-03 09:35:44 +00:00
2023-11-13 09:38:14 +00:00
Loro is a CRDTs(Conflict-free Replicated Data Types) library that makes building [local-first apps][local-first] easier.
2022-11-18 10:55:09 +00:00
2023-11-13 09:59:21 +00:00
Explore our vision for the local-first development paradigm in our blog post: [**Reimagine State Management with CRDTs**](https://loro.dev/blog/loro-now-open-source).
2023-11-13 09:13:33 +00:00
2023-11-11 03:54:12 +00:00
# Features
2023-11-11 02:57:47 +00:00
2023-10-29 13:37:24 +00:00
## Supported CRDT Algorithms
2022-11-18 10:55:09 +00:00
2023-11-03 13:33:36 +00:00
- **Common Data Structures**: Support for `List` for ordered collections, LWW(Last Write Win) `Map` for key-value pairs, `Tree` for hierarchical data, and `Text` for rich text manipulation, enabling various applications.
- **Text Editing with Fugue**: Loro integrates [Fugue](https://arxiv.org/abs/2305.00583), a CRDT algorithm designed to minimize interleaving anomalies in concurrent text editing.
- **Peritext-like Rich Text CRDT**: Drawing inspiration from [Peritext](https://www.inkandswitch.com/peritext/), Loro manages rich text CRDTs that excel at merging concurrent rich text style edits, maintaining the original intent of users input as much as possible. Details on this will be explored further in an upcoming blog post.
- **Moveable Tree**: For applications requiring directory-like data manipulation, Loro utilizes the algorithm from [*A Highly-Available Move Operation for Replicated Trees*](https://ieeexplore.ieee.org/document/9563274), which simplifies the process of moving hierarchical data structures.
2022-11-18 10:55:09 +00:00
2023-11-11 03:54:12 +00:00
## Advanced Features in Loro
2023-10-29 13:37:24 +00:00
- **Preserve Editing History**
- With Loro, you can track changes effortlessly as it records the editing history with low overhead.
- This feature is essential for audit trails, undo/redo functionality, and understanding the evolution of your data over time.
- **Time Travel Through History**
- It allows users to compare and merge manually when needed, although CRDTs typically resolve conflicts well.
2023-11-11 03:54:12 +00:00
- **High Performance**
- [See benchmarks](https://www.loro.dev/docs/performance).
2023-10-29 13:37:24 +00:00
> **Build time travel feature easily for large documents**.
https://github.com/loro-dev/loro/assets/18425020/ec2d20a3-3d8c-4483-a601-b200243c9792
2023-11-11 17:50:54 +00:00
2023-11-03 13:33:36 +00:00
## Features Provided by CRDTs
2023-10-29 13:37:24 +00:00
2023-11-11 03:54:12 +00:00
- **Decentralized Synchronization**: Loro allows your app's state synced via p2p connections.
- **Automatic Merging**: CRDTs guarantee strong eventual consistency by automating the merging of concurrent changes.
- **Local Availability**: Data can be persisted on users' devices, supporting offline functionality and real-time responsiveness.
2023-10-29 13:37:24 +00:00
- **Scalability**: Effortlessly scale your application horizontally thanks to the inherently distributed nature of CRDTs.
2023-11-11 03:54:12 +00:00
- **Delta Updates**
2022-11-18 10:55:09 +00:00
2023-11-15 02:12:04 +00:00
# Development
2023-11-15 13:07:00 +00:00
### Development Environment Setup
1. **Rust**: Install from the official Rust website.
2. **Deno**: Download and install from Deno's website.
3. **Node**: Install from the Node.js website.
4. **pnpm**: Run `npm i -g pnpm` for global installation.
5. **Rust Target**: Add with `rustup target add wasm32-unknown-unknown`.
6. **wasm-bindgen-cli**: Install version 0.2.86 via `cargo install wasm-bindgen-cli --version 0.2.86`.
2023-11-21 04:36:03 +00:00
6. **wasm-opt**: Install using `cargo install wasm-opt --locked`.
2023-11-29 07:07:39 +00:00
7. **wasm-snip**: Install using `cargo install wasm-snip`.
8. **cargo-nextest**: Install using `cargo install cargo-nextest --locked`.
9. **cargo-fuzz**: Run `cargo install cargo-fuzz`.
2023-11-15 02:12:04 +00:00
### Test
```bash
deno task test
# Build and test WASM
deno task test-wasm
```
2022-11-18 10:55:09 +00:00
# Credits
2023-10-29 13:37:24 +00:00
Loro draws inspiration from the innovative work of the following projects and individuals:
- [Ink & Switch](https://inkandswitch.com/): The principles of Local-first Software have greatly influenced this project. The [Peritext](https://www.inkandswitch.com/peritext/) project has also shaped our approach to rich text CRDTs.
- [Diamond-types](https://github.com/josephg/diamond-types): The ingenious OT-like merging algorithm from @josephg has been adapted to reduce the computation and space usage of CRDTs.
- [Automerge](https://github.com/automerge/automerge): Their use of columnar encoding for CRDTs has informed our strategies for efficient data encoding.
2023-11-03 13:33:36 +00:00
- [Yjs](https://github.com/yjs/yjs): We have incorporated a similar algorithm for effectively merging collaborative editing operations, thanks to their pioneering contributions.
2023-10-29 13:37:24 +00:00
- [Matthew Weidner](https://mattweidner.com/): His work on the [Fugue](https://arxiv.org/abs/2305.00583) algorithm has been invaluable, enhancing our text editing capabilities.
2023-01-11 13:40:16 +00:00
2023-10-29 13:37:24 +00:00
[local-first]: https://www.inkandswitch.com/local-first/
[Fugue]: https://arxiv.org/abs/2305.00583
[Peritext]: https://www.inkandswitch.com/peritext/