examples/aqua-examples/ts-oracle
renovate[bot] f2146bee14
Update Rust crate marine-rs-sdk-test to 0.8.1 (#395)
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2022-09-22 09:23:24 -05:00
..
aqua changes to comply with the schema pairs support for mounted_binaries, mapped_dirs, envs (#346) 2022-06-28 14:55:15 +02:00
configs reflecting the deployment config changes (#344) 2022-06-28 11:54:32 +02:00
scripts Use set to set shell options (#387) 2022-08-11 13:47:06 +02:00
src update tests, bump version 2021-09-01 17:01:12 -05:00
Cargo.toml Update Rust crate marine-rs-sdk-test to 0.8.1 (#395) 2022-09-22 09:23:24 -05:00
Readme.md update aqua deploy to config-path from data-path 2022-04-28 09:40:54 +02:00

Timestamp Oracle PoC

Overview

Getting accurate timestamps can be problematic in various contexts including blockchains. Timestamp oracles can alleviate this concern by aggregating and processing a variety of timestamp sources into a point- or range-estimate. Of course, the acquisition of accurate timestamps not subject to manipulation is a critical attribute of a good oracle. The Fluence peer-to-peer network offers a large number of independent nodes that can serve as timestamp sources from either Kademilia or TrustGraph neighborhoods.

Note: The timestamps are currently not signed by the nodes. But that could be easily addressed.

Fluence Solution

Fluence provides an open Web3 protocol, framework and associated tooling to develop and host applications, interfaces and backends on permissionless peer-to-peer networks. An integral part of the Fluence solution is the Aquamarine stack comprised of Aqua and Marine. Aqua is a new programming language and paradigm purpose-built to program distributed networks and compose applications from distributed services. For more information on Aqua, see

Marine is a general purpose Wasm runtime and toolkit, allows developers to build distributed services that can be composed into distributed applications by Aqua. For more information on Marine, see

Setup

Note that we already deployed the service to node 12D3KooWHLxVhUQyAuZe6AHMB29P7wkvTNMn7eDMcsqimJYLKREf with service id ed657e45-0fe3-4d6c-b3a4-a2981b7cadb9, which is all what's needed to use the service in Aqua.

In order to run the entire code base, Rust and Node required. If necessary see Install Rust and NVM for details.

Install the following tools:

cargo install mrepl 
cargo install marine

npm -g install @fluencelabs/aqua

To compile the code to the wasi target:

./scripts/build.sh

You can use the REPL to locally test the services:

mrepl Config.toml

test the code with

cargo +nightly test --release

and deploy the service to a peer of your choice with the aqua cli tool:

aqua remote deploy_service \
     --addr krasnodar-06 \
     --config-path configs/ts_oracle_deploy_cfg.json \
     --service ts-oracle \
     --sk <your secret key>

which results in:

Your peerId: 12D3KooWHS2Eys5GmmdBGZHwUGRM4TRvcaW4m7dgGAShxbMEcKms
"Going to upload a module..."
2022.02.08 14:30:48 [INFO] created ipfs client to /ip4/161.35.212.85/tcp/5001
2022.02.08 14:30:48 [INFO] connected to ipfs
2022.02.08 14:30:50 [INFO] file uploaded
"Now time to make a blueprint..."
"Blueprint id:"
"5617e051fbd7f8e18dfc16cace62f71f0ff090d576ee09e3520c196ef44f6a79"
"And your service id is:"
"388d8717-b547-43c3-af05-b4713893d453"

As always, take note of the service id!

Approach

We implemented a custom service that returns the mode and frequency for an array of timestamps, see src/ that can be deployed on to any node of the peer-to-peer network and, once deployed, used to in an Aqua script. Moreover, network peers have builtin services including Kademlia and timestamp services. Both custom and bultin services are accessible by Aqua and ready for composition into an application.

Our oracle solution is implemented in Aqua and utilizes timestamps from peers selected from our Kademlia neighborhood and, for illustrative purposes, use the deployed service to arrive at the point estimate for our oracle. See src/main.rs. There certanly are better ways to process the timestamps into an oracle but for our purposes, mode works.

In our Aqua script, aqua-scripts/ts_getter.aqua, we separate the timestamp collections from the subsequent oracle processing. That is, if a peer-client wants to process the timestamps locally, all that's needed are the timestamps, which can be obtained by calling the ts_getter function. Alternatively, the timestamps may be processed by calling one or more ts-oracle services deployed on the network.

-- aqua-scripts/ts_getter.aqua
import "builtin.aqua"

service Op2("op"):
    identity(s: u64)
     array(a: string, b: u64) -> string

-- the data struct from the Wasm file
-- marine aqua artifacts/ts_oracle.wasm
data Oracle:
    n: u32
    mode: u64
    freq: u32
    err_str: string
    raw_data: []u64

-- the point_estimate function from the Wasm file wrapped as a service
-- marine aqua artifacts/ts_oracle.wasm
service TSOracle("service-id"):
    point_estimate: []u64, u32 -> Oracle

-- the timestamp getter drawing from the Kademlia neighborhood
-- function collects the neighborhood peers
-- retrieves and returns the timestamps 
func ts_getter(node: string) -> []u64:
  res: *u64
  on node:
    k <- Op.string_to_b58(node)
    nodes <- Kademlia.neighborhood(k, nil, nil)
    for n <- nodes par:
      on n:
        try:
          res <- Peer.timestamp_ms()
    Op2.identity(res!9)
  <- res

-- oracle function operating on array of timestamps utilizing a distributed
-- service to calculate the point_estimate
-- see src/main.rs for the service implementation
func ts_oracle(node: string, oracle_service_id: string, min_points:u32) -> Oracle:
  res <- ts_getter(node)
  
  on node:
    TSOracle oracle_service_id
    oracle <- TSOracle.point_estimate(res, min_points)  -- calculate mode 
  <- oracle                                             -- and return to initiating peer

We can run our Aqua ts_oracle script against the deployed processing service to get our oracle point estimate using aqua run (Note that you can replace the service id with the one you obtained from your deployment):

aqua run \
     -i aqua \
     -a /dns4/kras-02.fluence.dev/tcp/19001/wss/p2p/12D3KooWHLxVhUQyAuZe6AHMB29P7wkvTNMn7eDMcsqimJYLKREf \
     -f 'ts_oracle("12D3KooWHLxVhUQyAuZe6AHMB29P7wkvTNMn7eDMcsqimJYLKREf", "ed657e45-0fe3-4d6c-b3a4-a2981b7cadb9", 5)'

Which results in below but may be different for you:

Your peerId: 12D3KooWDB6bCvW7vim4iw88TRyyuouLiyZz2Cr2ZdaaBZKJ916d
{
  "err_str": "",
  "freq": 3,
  "mode": 1644352733889,
  "n": 12
}

Alternatively, we can run the ts_getter functions just for the timestamps:

aqua run \
    -i aqua \
    -a /dns4/kras-02.fluence.dev/tcp/19001/wss/p2p/12D3KooWHLxVhUQyAuZe6AHMB29P7wkvTNMn7eDMcsqimJYLKREf \
    -f 'ts_getter("12D3KooWHLxVhUQyAuZe6AHMB29P7wkvTNMn7eDMcsqimJYLKREf")'

Which gives us just the timestamps, which wil be different for you:

Your peerId: 12D3KooWEdPZCXxSEDMLMTR8doUVhjcZ6YB5CUJnq36QwU65XVFH
[
  1644352807634,
  1644352807632,
  1644352807630,
  1644352807629,
  1644352807650,
  1644352807630,
  1644352807633,
  1644352807633,
  1644352807634,
  1644352807631,
  1644352807631
]

Instead of aqua run, you can use the Typescript stub and integrate it into a TS client. See Aqua Playground for more information.