morty/permissionless batches recovery #1639
+373
−122
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1 +0,0 @@ | ||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,25 @@ | ||
| .PHONY: batch-production-submission launch_local_prover launch_cloud_prover psql check_proving_status | ||
|
|
||
| export SCROLL_ZKVM_VERSION=0.3.0 | ||
| PG_URL=postgres://postgres@localhost:5432/scroll | ||
|
|
||
| batch_production_submission: | ||
| docker compose --profile batch-production-submission up | ||
|
|
||
| local_prover: | ||
| docker compose --profile local-prover up | ||
|
|
||
| cloud_prover: | ||
| docker compose --profile cloud-prover up | ||
|
|
||
| psql: | ||
| psql 'postgres://postgres@localhost:5432/scroll' | ||
|
|
||
| check_proving_status: | ||
| @echo "Checking proving status..." | ||
| @result=$$(psql "${PG_URL}" -t -c "SELECT proving_status = 4 AS is_status_success FROM batch ORDER BY index LIMIT 1;" | tr -d '[:space:]'); \ | ||
| if [ "$$result" = "t" ]; then \ | ||
| echo "✅ Prove succeeded! You're ready to submit permissionless batch and proof!"; \ | ||
| else \ | ||
| echo "Proof is not ready..."; \ | ||
| fi |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,127 @@ | ||
| #!/usr/bin/bash | ||
|
|
||
| apt update | ||
| apt install -y wget libdigest-sha-perl | ||
|
|
||
| # release version | ||
| if [ -z "${SCROLL_ZKVM_VERSION}" ]; then | ||
| echo "SCROLL_ZKVM_VERSION not set" | ||
| exit 1 | ||
| fi | ||
|
|
||
| if [ -z "${HTTP_PORT}" ]; then | ||
| echo "HTTP_PORT not set" | ||
| exit 1 | ||
| fi | ||
|
|
||
| if [ -z "${METRICS_PORT}" ]; then | ||
| echo "METRICS_PORT not set" | ||
| exit 1 | ||
| fi | ||
|
|
||
| case $CHAIN_ID in | ||
| "5343532222") # staging network | ||
| echo "staging network not supported" | ||
| exit 1 | ||
| ;; | ||
| "534353") # alpha network | ||
| echo "alpha network not supported" | ||
| exit 1 | ||
| ;; | ||
| esac | ||
|
|
||
| BASE_DOWNLOAD_DIR="/verifier" | ||
| # Ensure the base directory exists | ||
| mkdir -p "$BASE_DOWNLOAD_DIR" | ||
|
|
||
| # Set subdirectories | ||
| ASSETS_DIR="$BASE_DOWNLOAD_DIR/assets" | ||
| OPENVM_DIR="$BASE_DOWNLOAD_DIR/openvm" | ||
|
|
||
| # Create necessary directories | ||
| mkdir -p "$ASSETS_DIR" | ||
| mkdir -p "$OPENVM_DIR/verifier" | ||
|
|
||
| # Define URLs for asset files | ||
| ASSETS_CHECKSUM_URL="https://circuit-release.s3.us-west-2.amazonaws.com/release-v0.13.1/sha256sum" | ||
| ASSETS_CHECKSUM_FILE="$ASSETS_DIR/sha256sum" | ||
|
|
||
| ASSETS_URLS=( | ||
| "https://circuit-release.s3.us-west-2.amazonaws.com/release-v0.13.1/vk_batch.vkey" | ||
| "https://circuit-release.s3.us-west-2.amazonaws.com/release-v0.13.1/vk_bundle.vkey" | ||
| "https://circuit-release.s3.us-west-2.amazonaws.com/release-v0.13.1/vk_chunk.vkey" | ||
| ) | ||
|
|
||
| # Define URLs for OpenVM files (No checksum verification) | ||
| OPENVM_URLS=( | ||
| "https://circuit-release.s3.us-west-2.amazonaws.com/scroll-zkvm/releases/$SCROLL_ZKVM_VERSION/verifier/verifier.bin" | ||
| "https://circuit-release.s3.us-west-2.amazonaws.com/scroll-zkvm/releases/$SCROLL_ZKVM_VERSION/verifier/root-verifier-vm-config" | ||
| "https://circuit-release.s3.us-west-2.amazonaws.com/scroll-zkvm/releases/$SCROLL_ZKVM_VERSION/verifier/root-verifier-committed-exe" | ||
| ) | ||
|
|
||
| # Function to download and verify files (skips existing valid files) | ||
| download_and_verify() { | ||
| local url="$1" | ||
| local dest_dir="$2" | ||
| local checksum_file="$3" | ||
|
|
||
| local filename=$(basename "$url") | ||
| local filepath="$dest_dir/$filename" | ||
|
|
||
| if [[ -f "$filepath" ]]; then | ||
| echo "Checking existing file: $filename..." | ||
| if grep "$filename" "$checksum_file" | sed "s|$filename|$filepath|" | sha256sum --check --status; then | ||
| echo "File is already present and valid ✅ - Skipping download." | ||
| return | ||
| else | ||
| echo "File exists but checksum mismatch ❌ - Re-downloading." | ||
| rm -f "$filepath" | ||
| fi | ||
| fi | ||
|
|
||
| echo "Downloading $filename..." | ||
| curl -o "$filepath" -L "$url" | ||
|
|
||
| if [[ ! -f "$filepath" ]]; then | ||
| echo "Download failed for $filename ❌" | ||
| exit 1 | ||
| fi | ||
|
|
||
| echo "Verifying checksum for $filename..." | ||
| grep "$filename" "$checksum_file" | sed "s|$filename|$filepath|" | sha256sum --check --status || exit 1 | ||
| echo "Checksum verification passed for $filename ✅" | ||
| } | ||
|
|
||
| # Download and verify asset files | ||
| curl -o "$ASSETS_CHECKSUM_FILE" -L "$ASSETS_CHECKSUM_URL" | ||
| for url in "${ASSETS_URLS[@]}"; do | ||
| download_and_verify "$url" "$ASSETS_DIR" "$ASSETS_CHECKSUM_FILE" | ||
| done | ||
|
|
||
| # Download OpenVM files (No checksum verification, but skips if file exists) | ||
| for url in "${OPENVM_URLS[@]}"; do | ||
| dest_subdir="$OPENVM_DIR/$(basename $(dirname "$url"))" | ||
| mkdir -p "$dest_subdir" | ||
|
|
||
| filepath="$dest_subdir/$(basename "$url")" | ||
| echo "Downloading $filepath..." | ||
| curl -o "$filepath" -L "$url" | ||
| done | ||
|
|
||
| mkdir -p "$HOME/.openvm" | ||
| ln -s "$OPENVM_DIR/params" "$HOME/.openvm/params" | ||
|
|
||
| echo "All files downloaded successfully! 🎉" | ||
|
|
||
| mkdir -p /usr/local/bin | ||
| wget https://github.com/ethereum/solidity/releases/download/v0.8.19/solc-static-linux -O /usr/local/bin/solc | ||
| chmod +x /usr/local/bin/solc | ||
|
|
||
| # Start coordinator | ||
| echo "Starting coordinator api" | ||
|
|
||
| RUST_BACKTRACE=1 exec coordinator_api --config /coordinator/config.json \ | ||
| --genesis /coordinator/genesis.json \ | ||
| --http --http.addr "0.0.0.0" --http.port ${HTTP_PORT} \ | ||
| --metrics --metrics.addr "0.0.0.0" --metrics.port ${METRICS_PORT} \ | ||
| --log.debug |
Empty file.
Empty file.
Empty file.
Empty file.
File renamed without changes.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,23 @@ | ||
| { | ||
| "prover_name_prefix": "prover", | ||
| "keys_dir": "keys", | ||
| "coordinator": { | ||
| "base_url": "http://coordinator:8390", | ||
| "retry_count": 10, | ||
| "retry_wait_time_sec": 10, | ||
| "connection_timeout_sec": 30 | ||
| }, | ||
| "l2geth": { | ||
| "endpoint": "<L2 RPC with generated blocks reachable from Docker network>" | ||
| }, | ||
| "prover": { | ||
| "circuit_type": 2, | ||
| "supported_proof_types": [ | ||
| 1, | ||
| 2, | ||
| 3 | ||
| ], | ||
| "circuit_version": "v0.13.1" | ||
| }, | ||
| "db_path": "db" | ||
| } |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,28 @@ | ||
| { | ||
| "sdk_config": { | ||
| "prover_name_prefix": "local_prover", | ||
| "keys_dir": "/keys", | ||
| "db_path": "/db", | ||
| "coordinator": { | ||
| "base_url": "http://172.17.0.1:8556", | ||
| "retry_count": 10, | ||
| "retry_wait_time_sec": 10, | ||
| "connection_timeout_sec": 30 | ||
| }, | ||
| "l2geth": { | ||
| "endpoint": "<L2 RPC with generated blocks reachable from Docker network>" | ||
| }, | ||
| "prover": { | ||
| "circuit_type": 2, | ||
| "supported_proof_types": [1,2,3], | ||
| "circuit_version": "v0.13.1" | ||
| }, | ||
| "health_listener_addr": "0.0.0.0:89" | ||
| }, | ||
| "circuits": { | ||
| "euclidV2": { | ||
| "hard_fork_name": "euclidV2", | ||
| "workspace_path": "/openvm" | ||
| } | ||
| } | ||
| } |
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Maybe not related to this PR, but do we have some docs for the next step? e.g., withdraw the funds in L1. If any, it's nice to have it placed here.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
yeah there should be some more extended docs on how to do this from beginning to end
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Good suggestion, @jonastheis Do you want me to add those steps? Or you will do it later.