Merge branch 'master' into fix-raw-scan-limit

Author: ekexium

README.md

@@ -8,41 +8,123 @@
 This crate provides a clean, ready to use client for [TiKV](https://github.com/tikv/tikv), a
 distributed transactional Key-Value database written in Rust.
 
-With this crate you can easily connect to any TiKV deployment, interact with it, and mutate the data it contains.
+With this crate you can easily connect to any TiKV deployment, interact with it, and mutate the data it contains. It uses async/await internally and exposes some `async fn` APIs as well.
 
 This is an open source (Apache 2) project hosted by the Cloud Native Computing Foundation (CNCF) and maintained by the TiKV Authors. *We'd love it if you joined us in improving this project.*
 
-## Using the client
+## Getting started
 
-The TiKV client is a Rust library (crate). It uses async/await internally and exposes some `async fn` APIs as well.
-
-To use this crate in your project, add it as a dependency in your `Cargo.toml`:
+The TiKV client is a Rust library (crate). To use this crate in your project, add following dependencies in your `Cargo.toml`:
 
 ```toml
 [dependencies]
-# ...Your other dependencies...
 tikv-client = { git = "https://github.com/tikv/client-rust.git" }
+
+[patch.crates-io]
+raft-proto = { git = "https://github.com/tikv/raft-rs", rev = "e624c1d48460940a40d8aa69b5329460d9af87dd" }
 ```
 
 The client requires a Git dependency until we can [publish it](https://github.com/tikv/client-rust/issues/32).
 
-There are [examples](examples) which show how to use the client in a Rust program.
+The client provides two modes to interact with TiKV: raw and transactional. 
+In the current version (0.0.0), the transactional API only supports optimistic transactions.
+
+Important note: It is **not recommended or supported** to use both the raw and transactional APIs on the same database.
+
+### Code examples
+
+Raw mode:
+
+```rust
+let config = Config::new(vec!["127.0.0.1:2379"]);
+let client = RawClient::new(config).await?;
+client.put("key".to_owned(), "value".to_owned()).await;
+let value = client.get("key".to_owned()).await;
+```
+
+Transactional mode:
+
+```rust
+let config = Config::new(vec!["127.0.0.1:2379"]);
+let txn_client = TransactionClient::new(config).await?;
+let mut txn = txn_client.begin().await?;
+txn.put("key".to_owned(), "value".to_owned()).await?;
+let value = txn.get("key".to_owned()).await;
+txn.commit().await?;
+```
+
+There are some [examples](examples) which show how to use the client in a Rust program.
+
+### API
+
+#### Raw requests
+
+| Request        | Main parameter type | Successful result type | Noteworthy Behavior                           |
+| -------------- | ------------------- | ---------------------- | --------------------------------------------- |
+| `put`          | `KvPair`            | `()`                   |                                               |
+| `get`          | `Key`               | `Option<Value>`        |                                               |
+| `delete`       | `Key`               | `()`                   |                                               |
+| `scan`         | `BoundRange`        | `Vec<KvPair>`          |                                               |
+| `batch_put`    | `Iter<KvPair>`      | `()`                   |                                               |
+| `batch_get`    | `Iter<Key>`         | `Vec<KvPair>`          | Skip non-existent keys; Does not retain order |
+| `batch_delete` | `Iter<Key>`         | `()`                   |                                               |
+| `delete_range` | `BoundRange`        | `()`                   |                                               |
+
+#### Transactional requests
+
+| Request     | Main parameter type | Successful result type | Noteworthy Behavior                           |
+| ----------- | ------------------- | ---------------------- | --------------------------------------------- |
+| `put`       | `KvPair`            | `()`                   |                                               |
+| `get`       | `Key`               | `Option<value>`        |                                               |
+| `delete`    | `Key`               | `()`                   |                                               |
+| `scan`      | `BoundRange`        | `Iter<KvPair>`         |                                               |
+| `batch_get` | `Iter<Key>`         | `Iter<KvPair>`         | Skip non-existent keys; Does not retain order |
+| `lock_keys` | `KvPair`            | `()`                   |                                               |
+
+For detailed behavior of each request, please refer to the [doc](#Access-the-documentation).
+
+#### Experimental raw requests
+
+You must be careful if you want to use the following request(s). Read the description for reasons.
+
+| Request        | Main parameter type | Successful result type |
+| -------------- | ------------------- | ---------------------- |
+| `batch_scan`   | `Iter<BoundRange>`  | `Vec<KvPair>`          |
+
+The `each_limit` parameter does not work as expected. It does not limit the number of results returned of each range, instead it limits the number of results in each region of each range. As a result, you may get **more than** `each_limit` key-value pairs for each range. But you should not miss any entries.
+
+The results of `batch_scan` are flattened. The order of ranges is retained.
+
+### Useful types
+
+To use the client, there are 4 types you will need. 
+
+`Key` is simply a vector of bytes(`Vec<u8>`). `String` and `Vec<u8>` implements `Into<Key>`, so you can directly pass them to clients.
+
+`Value` is just an alias of `Vec<u8>`.
+
+`KvPair` is a tuple consisting of a `Key` and a `Value`. It also provides some convenience methods for conversion to and from other types.
+
+`BoundRange` is used for range related requests like `scan`. It implements `From` for usual ranges so you can just create a range and pass them to the request.For instance, `client.scan("k2".to_owned()..="k5".to_owned(), 5)` or `client.delete_range(vec![]..)`.
 
 ## Access the documentation
 
 We recommend using the cargo-generated documentation to browse and understand the API. We've done
 our best to include ample, tested, and understandable examples.
 
-You can visit [docs.rs/tikv-client](https://docs.rs/tikv-client/), or build the documentation yourself.
-
 You can access the documentation on your machine by running the following in any project that depends on `tikv-client`.
 
 ```bash
 cargo doc --package tikv-client --open
 # If it didn't work, browse file URL it tried to open with your browser.
 ```
 
-## Minimal Rust Version
+## Known issues
+
+If you use transactional APIs, you'll need to perform GC in TiKV to save storage.
+However, current implementation does not provide a direct way to do this. A workaround is described in [#180](https://github.com/tikv/client-rust/issues/180).
+
+## Minimal Rust version
 
 This crate supports Rust 1.40 and above.
 

examples/raw.rs

@@ -94,11 +94,7 @@ async fn main() -> Result<()> {
     let keys: Vec<_> = pairs.into_iter().map(|p| p.key().clone()).collect();
     assert_eq!(
         &keys,
-        &[
-            Key::from("k1".to_owned()),
-            Key::from("k2".to_owned()),
-            Key::from("k3".to_owned())
-        ]
+        &[Key::from("k1".to_owned()), Key::from("k2".to_owned()),]
     );
     println!("Scaning from {:?} to {:?} gives: {:?}", start, end, keys);
 

src/raw/client.rs

@@ -103,7 +103,7 @@ impl Client {
     /// Create a new 'batch get' request.
     ///
     /// Once resolved this request will result in the fetching of the values associated with the
-    /// given keys.
+    /// given keys
     /// Non-existent entries will be skipped. The order of the keys is not retained.
     ///
     /// ```rust,no_run
@@ -174,6 +174,7 @@ impl Client {
     /// Create a new 'delete' request.
     ///
     /// Once resolved this request will result in the deletion of the given key.
+    /// It does not return an error if the key does not exist.
     ///
     /// ```rust,no_run
     /// # use tikv_client::{Key, Config, RawClient};
@@ -194,6 +195,7 @@ impl Client {
     /// Create a new 'batch delete' request.
     ///
     /// Once resolved this request will result in the deletion of the given keys.
+    /// It does not return an error if some of the keys do not exist and will delete the others.
     ///
     /// ```rust,no_run
     /// # use tikv_client::{Config, RawClient};

src/raw/requests.rs

@@ -333,7 +333,9 @@ impl KvRequest for kvrpcpb::RawDeleteRangeRequest {
     fn reduce(
         results: BoxStream<'static, Result<Self::Result>>,
     ) -> BoxFuture<'static, Result<Self::Result>> {
-        results.try_for_each(|_| future::ready(Ok(()))).boxed()
+        results
+            .try_for_each_concurrent(None, |_| future::ready(Ok(())))
+            .boxed()
     }
 }
 

src/transaction/requests.rs

@@ -348,7 +348,9 @@ impl KvRequest for kvrpcpb::PrewriteRequest {
     fn reduce(
         results: BoxStream<'static, Result<Self::Result>>,
     ) -> BoxFuture<'static, Result<Self::Result>> {
-        results.try_for_each(|_| future::ready(Ok(()))).boxed()
+        results
+            .try_for_each_concurrent(None, |_| future::ready(Ok(())))
+            .boxed()
     }
 }
 
@@ -408,7 +410,9 @@ impl KvRequest for kvrpcpb::CommitRequest {
     fn reduce(
         results: BoxStream<'static, Result<Self::Result>>,
     ) -> BoxFuture<'static, Result<Self::Result>> {
-        results.try_for_each(|_| future::ready(Ok(()))).boxed()
+        results
+            .try_for_each_concurrent(None, |_| future::ready(Ok(())))
+            .boxed()
     }
 }
 
@@ -454,7 +458,9 @@ impl KvRequest for kvrpcpb::BatchRollbackRequest {
     fn reduce(
         results: BoxStream<'static, Result<Self::Result>>,
     ) -> BoxFuture<'static, Result<Self::Result>> {
-        results.try_for_each(|_| future::ready(Ok(()))).boxed()
+        results
+            .try_for_each_concurrent(None, |_| future::ready(Ok(())))
+            .boxed()
     }
 }