Skip to content

readme-metrics #17

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 4 commits into
base: main
Choose a base branch
from
Open
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
45 changes: 43 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -167,14 +167,55 @@ Redis Connect Swagger UI is available on port 8282 by default. If you're running

**Start Job -** `/connect/api/vi/job/transition/start/{jobName}/{jobType}`
<br>_For quick start, use '**stream**' as **jobType**_
<br><br><img src="/images/quick-start/Redis Connect Start Job.png" style="float: right;" width = 700px height = 375px/>
<br><br><img src="/images/quick-start/Redis Connect Start Job.png" style="float: right;" width = 700px height = 375px/><br>

**Confirm Job Claim -** `/connect/api/vi/jobs/claim/{jobStatus}`
<br>_For quick start, use '**all**' as **jobStatus**_
<br><br><img src="/images/quick-start/Redis Connect Get Claims.png" style="float: right;" width = 700px height = 250px/>
<br><br><img src="/images/quick-start/Redis Connect Get Claims.png" style="float: right;" width = 700px height = 250px/><br>

<br>
Once you've configured a job, try inserting some records into the source database. Then confirm that they have arrived in Redis.




### Monitoring the System

Redis Connect exports OpenTelemetry metrics via a Prometheus endpoint. A simple Prometheus configuration would look like this:

```cmd
- job_name: "connect"
scrape_interval: 5s
scrape_timeout: 5s
metrics_path: /
scheme: http
static_configs:
- targets: ["localhost:19090"]
```

Redis Connect provides a dashboard for monitoring the system. After installing Grafana and connecting it to Prometheus (i.e., adding a data source), you can install the Redis Connect dashboard by navigating to the Grafana dashboard page and clicking New -> Import.

The Redis Connect dashboard reports the following metrics:

| metric | label | type | description |
|--------------------------------------------|---------------|-----------|---------------------------------------|
| event_job_starts_total | job starts | count | number of times job has been started |
| event_job_stops_total | job stops | count | number of times job has been stopped |
| event_input_buffer_histogram | buffer | histogram | number of events received |
| event_input_buffer_count | buffer count | count | number of measurements |
| event_input_buffer_sum | buffer total | count | sum of all measured quantities |
| event_operation_lag | elapsed | histogram | time it took connect to receive event |
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

s/connect/Redis Connect

| event_operation_lag_milliseconds_count | elapsed count | count | number of times lag was recorded |
| event_operation_lag_milliseconds_sum | elapsed sum | count | sum total of all lag recordings |
| event_operation_latency | elapsed | histogram | time it took to process the event |
| event_operation_latency_milliseconds_count | elapsed count | count | number of times latency was recorded |
| event_operation_latency_milliseconds_sum | elapsed sum | count | sum of all latency recordings |
| event_operation_elapsed | elapsed | histogram | time it took to write event to Redis |
| event_operation_elapsed_milliseconds_count | elapsed count | count | number of times duration was recorded |
| event_operation_elapsed_milliseconds_sum | elapsed sum | count | sum of all duration recordings |
| event_job_operation_throughput_total | throughput | count | total number of events processed |


## Copyright

Redis Connect is developed by Redis, Inc. Copyright (C) 2023 Redis, Inc.