Velto

How To

Velto: Athletic Intelligence, explained step by step.

Overview

Velto has four main tabs, each with a key function. A recording contains data, gets analyzed with evaluations, is compared using comparison, while program summarizes gathered data over time.

Recordings

A recording is where everything begins: one video, with everything Velto knows about it attached. The body pose in every frame, the objects you marked, the reps it found, your tags and drawings, and the results of every evaluation that has run on it.

Creating a recording

The Recordings library with five recordings

There are two ways to make a recording, both at the top of the Recordings tab.

  • 1 Capture Video opens the camera inside Velto.
  • 2 Import (the + button) picks one or more videos from Photos. Velto only sees the videos you choose.

Either way, Velto finds the body in every frame, in 2D and 3D, on your device. A progress row shows while it works, and you can keep using the app.

Every recording is then listed here, newest first. 3 Search finds recordings by name or tag; the tag button beside the camera filters by tag. Tap a recording 4 to open it, or swipe it left to delete it.

The capture screen with the record button

On the capture screen, 1 starts and stops recording.

  • 2 opens the capture settings: the live pose overlay, which evaluations to show while you film, and which to keep with the new recording. The 3D / 2D switch beside it chooses the live skeleton.

Live readings are a preview. When you stop, the saved recording is analysed again in full, and that is what every result comes from.

Filming tips

Film one person, with the whole body in frame and the camera still. Good, even light helps. A side view suits squats, lunges and pull-ups; a front view suits presses and anything left against right.

Playback

A golf swing with the skeleton and two knee angles drawn over it

A recording opens on its video, with the skeleton drawn over the body. Play, pause and scrub as usual. The controls around the video:

  • 1 Video settings: how the skeleton, objects and evaluations look on this video (below).
  • 2 3D / 2D: switch between the two skeletons. They are different models: 3D includes the spine and head, 2D the neck and nose.
  • 3 Download: save a video with everything drawn in, or the current frame as an image (Exports).
  • 4 Mark objects: box a dumbbell, a bar or a ball (Objects).
  • 5 Draw: draw on the video (Drawing).
  • 6 Full screen.
  • 7 Export Data: the recording's data as CSV files (Exports).

Nothing you do here changes the original video.

Video settings

Video settings for this video
Video settings for this video

Video settings changes how this one video looks. Each change is saved for this video only (marked This Video); everything you leave alone follows the app defaults in Settings.

  • 1 Reset to App Defaults removes this video's changes.

Evaluation Overlay draws evaluations on the video, such as the knee angles on the golf swing.

  • 2 Show measurement guides draws the arcs and lines that show what an angle or distance is measured between. Guide Color, Follow joint visibility, Fade by pose confidence and Hide below confidence control how they look when tracking is uncertain.
  • 3 Evaluations chooses which evaluations are drawn on the video.

Pose Appearance

  • 4 Customize Appearance chooses which joints are shown, their colours and sizes, separately for 3D and 2D.

Objects

  • 5 Show Objects draws the objects you marked, with their labels.

Motion Trail

  • 6 Motion Trail draws the path a joint or object took over the last moments.
  • 7 Customize Motion Trail chooses which joints and objects leave a trail, and how long it is.

Privacy

  • 8 Blur Faces blurs faces in playback and in videos you export. The original recording stays unchanged.

Drawing

Draw mode with a pen line drawn over a golf swing

Draw opens the video full screen with a dock of tools: Select, 1 Pen, Shapes, Text, Blur and Eraser. Choose one and draw on the video.

Drawings can stay where you put them or follow the body as it moves. Undo and Redo are in the dock; Frame saves the current frame as an image. 2 Measure is explained below.

  • 3 Save keeps your changes.
  • 4 Cancel throws away everything since you opened Draw.
Measure: tapping three joints to measure an angle
  • 1 Measure measures the body itself.
  • 2 The dock says what to do: three joints for an angle, two for a distance. Every joint becomes a target; tap them in order, here starting at the elbow 3.

The measurement becomes an evaluation, so it is calculated on every frame, not just the one you drew on, and it can be charted and drawn on the video like any other.

Objects

Velto finds the body by itself. Anything else, such as a dumbbell, a barbell or a pull-up bar, you mark once, and Velto follows it through the video.

A dumbbell boxed, with its label being chosen

Open marking with Mark objects under the video, choose Object, and drag a box around the thing you want followed.

Then say what it is. 1 Pick a label such as Dumbbell, Kettlebell, Plate or Ball, or make a new one. An object held in a hand is labelled with that hand, such as Dumbbell · right hand. 2 Details gives it a weight, a size and its kind.

Velto tracks the box through the whole video as soon as you finish.

Two tracked dumbbells, and the marking tools
Two tracked dumbbells, and the marking tools

Once marked, objects are drawn on the video with their labels. 1 Mark objects opens marking again.

The marking tools:

  • 2 Object follows something that moves: tap it to box it, or drag around it.
  • 3 Area marks a fixed spot, like a box you jump onto. Keep the camera still.
  • 4 Line marks a fixed bar or edge, like a pull-up bar. Keep the camera still.
  • 5 Link joins two objects, such as both ends of a barbell, so their middle can be measured too.

Marked objects can be measured like joints: Velocity, Acceleration, Force, Power and Motion Trail can all read them. Force and Power use the weight you gave the object.

Tags

The Tags card with one tag and suggestions

Tags say what is in a recording: 1 here, arm. Type a new one in 2, or tap a suggestion 3.

Tags do two things:

  • They filter the Recordings library, so you can see all your squats at once.
  • They turn on matching evaluations. Built-in evaluations carry the same tags, so tagging a recording squat makes the squat counter and scores active on it.

Tags never change the video or the pose data.

Charts

A chart with Work and Power plotted on two axes

The Charts card plots evaluations over the length of the video. The chips above the chart list what it plots (here Work and Power for the Root joint); tap ✕ on a chip to remove it.

  • 1 Plot adds another evaluation to this chart.
  • 2 Clear empties the chart.
  • 3 Table shows the numbers row by row, with a CSV download.
  • 4 Full opens the chart full screen.
  • 5 Download saves the chart as an image.
  • 6 Split puts each evaluation on its own chart.
  • 7 Style sets how it is drawn: line, dots or bars where the result allows, plus each series' colour and line pattern.

Tap a point on the chart to move the video to that moment.

8 Units

Every value carries its unit, and a chart is drawn by unit, not by evaluation. 8 The chips at the top of the card name each unit on the chart; tap ⓘ to see what it means. Here J (joules, for Work) has the left axis and W (watts, for Power) the right.

  • Evaluations with the same unit share an axis, so two angles in degrees are drawn against one scale.
  • A second unit gets the other axis. When a unit does not fit, Velto asks where to plot it: This Chart while a second axis is free, or a New Chart.
  • 3D evaluations are in real units: metres (m), metres per second (m/s), newtons (N), joules (J), watts (W), degrees (°).
  • 2D evaluations measure the image, not the world. Distances are in fpx: the frame is 100 fpx tall at any resolution, so moving the camera or zooming changes them. Angles in 2D are still degrees.
  • Scores are from 0 to 1 and counts are plain numbers, without a unit.
The Plot Evaluations list

Plot Evaluations opens the list of everything that can be plotted, grouped by kind of answer: Metrics, Pose Detectors, Motion Detectors, scores and Counters. 1 Search matches names and tags as you type, and copes with typos.

Choosing joints

Choosing joints three ways: on a body, from lists, from groups
Choosing joints three ways: on a body, from lists, from groups
Choosing joints three ways: on a body, from lists, from groups

Most metrics ask which joints to measure. Open one in the list (here Angle 3D) and choose them one of three ways:

  • 4 Figure: tap the joints on a body diagram, in order. Good when you know where on the body you mean.
  • 2 Picker: choose each joint from a list.
  • 3 For an angle, the list asks for Point A, the Vertex and Point B.
  • 5 Menu: pick from ready-made groups, such as Angle: Left Hip – Left Knee – Left Ankle.
  • 6 Search the groups by joint name.

Then tap Plot, or 1 Plot all to plot every group at once. Objects you marked are offered beside the joints.

Segments

Five Arm Push reps found on the timeline

A segment is a stretch of the video, usually one rep. Segments are what counts, per-rep scores and comparisons work from.

  • 1 Segment Detectors find them for you.
  • 2 Here Arm Push 2D found five reps: the green blocks on the timeline, each listed below with its start and end time. Play a segment on its own, open it, or edit its ends.
  • 3 adds segments by hand, for anything a detector doesn't find. They are listed under Manual.
The list of segment detectors

Segment Detectors lists every motion detector and what it found on this recording. 1 A detector that has run shows its result; 2 runs it again. 3 Run tries a detector that hasn't run on this recording yet.

A detector is an ordinary evaluation (a Motion Detector), so you can make your own (Creating an evaluation).

Evaluations on a recording

The Evaluations card on a recording

Every recording has a set of active evaluations: the ones kept with it. 1 shows how many.

  • An active evaluation is calculated for this recording and its result is saved, so it appears straight away in charts, on the video and in Programs, and stays up to date when the evaluation or the recording changes.
  • An evaluation becomes active when you choose it: by plotting it, drawing it on the video, running a detector, or ticking it here. Tags turn on the evaluations that match them.
  • Turning one off keeps its existing results; turn it back on at any time.
  • 2 Clear turns them all off.
  • 3 Evaluation Parameters holds values for the whole recording that several evaluations share, such as body weight for Force and Power.
  • 4 Search for an evaluation to tick it on or off.
  • 5 Or open a group to see all of its evaluations.
A group opened, with each evaluation's state

Inside a group 1, each evaluation shows whether it is active and its result: a count is a number, a score is a value from 0 to 1, a detector says what it found.

Tracking

The Tracking card

The Tracking card, at the bottom of a recording, answers one question: can you trust what Velto saw? It describes detection, not your form.

  • Body: how many frames have a skeleton in 3D and 2D, and how confident the detection was. Joints appear only when their tracking drops; tap one to see when. Confidence Details shows it over time.
  • Objects: how much of the video each marked object was tracked, and the moments to check (1 to check). Tap one to see that moment, then accept it or correct the box.

Evaluations

An evaluation is one question about a recording, written once and run on any recording: what is the knee angle on every frame?, how many squats?, how deep was each rep? Velto comes with a library of more than 200, and you can make your own.

Every evaluation gives one kind of answer, and that decides where it is listed and how it is drawn.

Kinds of evaluation

Metric: a value on every frame

An angle, a distance, a speed, a force: a number with a unit at every moment of the video. Drawn as a curve, one line per side. Velocity 3D, Angle 2D. Units are explained under Charts.

Pose Detector: yes or no on every frame

Is a pose held? Each frame is yes or no; the yes stretches are drawn as lanes. Arms Straight, Arms Bent At Side.

Motion Detector: each time a movement happens

Finds whole movements and turns each one into a segment, usually one rep. Arm Push 2D found five presses in the Segments example.

Counter: how many times

Counts what a detector found. A count is only as good as the detector it reads, so its page names that detector. Squat Count 3D.

Pose Score, Rep Score, Recording Score: a grade from 0 to 1

The same quality judged three ways. A Pose Score grades every frame, a Rep Score grades each rep, and a Recording Score gives one grade for the whole video. Squat Depth Pose Score 3D, Squat Depth Rep Score 3D, Squat Depth Recording Score 3D.

Per Rep and Across Recordings: summaries you make

Per Rep turns a value per frame into one value per rep: its lowest point, highest point, typical value or range of motion. Across Recordings reads an evaluation over many recordings, grouped by session, day, week or month: totals, best so far, change and trends. These are evaluations too, made by you and listed in the library.

Compared to Source: differences in a comparison

How far a subject is from the source in a comparison, joint by joint.

Most come in a 3D and a 2D version. They read different skeletons, so their numbers are not interchangeable. Some movements exist in 3D only, because a side view hides the far leg.

The library

The evaluation library

The Evaluations tab lists every evaluation, grouped by kind of answer: 4 Metrics, Compared to Source, Pose Detectors, Motion Detectors, Pose Scores, Motion Scores, Recording Scores and Counters. Open a group to see its evaluations.

  • 2 Search finds them by name, tag or movement, as you type and despite typos.
  • 3 Filters narrows the list by tag, or to built-in (System) or your own (User Defined) evaluations. 1 makes a new one.
An evaluation's page

Tap an evaluation to see its page.

  • 2 Takes and Gives say what it runs on (one recording) and what kind of answer it gives (here, a value per rep).
  • 3 What This Measures says what it calculates and how, then what it needs (here, the whole body in frame) and what it cannot tell apart.
  • 4 Capture Video films a new recording with this evaluation already on.
  • 1 Make an Evaluation From This… copies it into a new evaluation you can change. Built-in evaluations can't be edited themselves.

Creating an evaluation

The New Evaluation list

Tap + in the Evaluations tab. Guided builds the six common kinds from a few questions. Tap a number to read about each one:

1 Pose Detector

Is a pose true on each frame? Add one or more conditions, such as knee angle near 90°; each is a measurement compared with a target: Above, Below, Between or Near.

2 Motion Detector

Is a movement happening over time? Describe it as steps in order, such as standing → bottom of the squat → standing. Each step is a saved Pose Detector or its own conditions, with how long it must hold; Also Require Throughout adds a condition for the whole movement. Each time the steps happen in order becomes a segment.

3 Pose Score

Grade a pose from 0 to 1 on each frame: choose one or more measurements and how each one is scored.

4 Motion Score

Grade each detected movement from 0 to 1: choose the Motion Detector whose reps it grades, then the measurements, and how to take one value from each rep (such as its lowest point or its range).

5 Recording Score

Summarize a Pose Score over the whole recording: its Average, or its best (Max) or weakest (Min) moment.

6 Counter

Count how many times a detector fires: pick the detector, and the counter counts its segments.

Summaries makes one from an evaluation you already have: 7 Per Rep gives one value per rep, 8 Across Recordings follows it over many recordings. Advanced opens the graph editor, starts from an existing evaluation, or imports one someone shared with you as a file.

From a Program's exercise you can also show Velto one rep and let it build a detector and counter from it.

The Pose Detector builder

Each guided builder is one screen. For a Pose Detector:

  • 1 Name it.
  • 2 What to Measure: choose a metric and its joints.
  • 3 Comparison: Above, Below, Between, Near or Follows a Shape, with a Target (and a Tolerance for Near).
  • 4 Use Recorded Values fills the target from a moment in one of your videos: pause where the pose is right, and the value there becomes the target.
  • 5 Add Condition adds another measurement that must hold at the same time.

A Preview further down runs it on one of your recordings before you save. 6 Create saves it to the library.

How an evaluation is built

The graph of Acceleration 3D

Every evaluation is a graph of steps: each one takes what the step before it gives and passes its own result on. This is what Velto actually runs, so it is the exact answer to "how was this number made?". This is Acceleration 3D.

  • 1 Slots are values you can change without editing the graph. Here, the pose confidence threshold: frames below it are left out.
  • 2 The first step, Positions, reads joint positions from each frame's pose.
  • 3 The next step, Filter, drops frames whose confidence is below the slot's value (conf >= 0.3). The line between the two steps shows that Filter takes what Positions gives.

Further steps smooth the positions and take the derivative twice (position → velocity → acceleration); the full-screen view below shows them all. Sample Data, below the graph, runs it on one of your recordings so you can see each step's result.

One step of the graph, full screen

Open the graph full screen (the ⤢ button) to read each step. 4 Every step has three rows:

  • Joints: which joints it works on, here all of the 3D skeleton's joints.
  • In: what it takes. Positions takes the pose data.
  • Out: what it gives: a position (x, y, z) in metres for each joint, every frame, measured from the root, the centre of the hips. In the compact view this reads joint-ref 3D vec3 m @root.

Two evaluations with the same graph and the same inputs always give the same result, on every screen.

Comparisons

A comparison puts recordings side by side: one source and one or more subjects compared with it. Today's rep against last month's, your rep against a coach's, the left side against the right.

Creating a comparison

The New Comparison form

In the Comparisons tab, tap +.

  • 1 Name the comparison.
  • 2 Choose Source: the recording everything is measured against.
  • 3 Add Subjects: one or more recordings to compare with it.

For each recording you then choose which part: the whole video, or one segment, such as a single rep. Comparing one rep with one rep is usually what you want, so their timing lines up.

Tags are optional: add one, and the evaluations matching it run across the comparison.

The red notes at the bottom list what is still missing; Save becomes available once there are none.

Choosing the source recording

Choosing a recording opens your library. 1 Recording Tags narrows it to recordings with a tag; tap a recording 2 to choose it, then its segment.

The comparison page

A comparison with the source and one subject

At the top, each subject is listed with the segment it uses. 1 turns a subject on or off without removing it; Add Subjects adds more.

Comparison Video plays the source with every included subject's skeleton drawn over it, each in its own colour, aligned to the start of its segment. Video settings and 3D / 2D work as they do on a recording.

  • 2 Generate Video Overlay exports every subject drawn over the source video.
  • 3 Generate Side by Side exports them next to each other (Exports).
Plotting in a comparison, with Differences first

Charts plots an evaluation for every participant on the same axis, by percent of segment, so reps of different lengths line up.

Differences comes first in the plot list. A difference shows how far each subject is from the source: the gap (|Δ|) or the signed difference (Δ) for a value, and Disagreement for yes-or-no detectors. Quick differences are shown on the chart only; Make saves one as an evaluation in the library.

The Evaluations card lists the evaluations applied across the comparison, as on a recording.

Programs

A program is your training plan, written as text, the way you'd write it anyway. Velto reads it, finds the exercises, and links each workout's videos to them, so you can see how each exercise went over weeks.

A program has three parts:

  • The text: your plan, in your words. It stays yours; Velto only reads it.
  • Exercises, found in the text. Each has the evaluations that measure it: one to count reps, and any others you choose, optionally with a target.
  • Sessions, one per workout. Each holds the recordings you filmed and your log.

Writing a program

The Programs tab

The Programs tab lists your programs, with their training days. 1 starts a new one.

New Program with the text marked as it is typed

Type or paste your plan. As you type, Velto marks exercises in yellow, sets and reps in blue and training days in purple, and lists the exercises it found below the text. If it misses one, mark the line as an exercise from the keyboard bar; if it marks a line that isn't one, unmark it.

Save, and the program is ready. You can edit the text at any time; every earlier version is kept.

The program page

A program page
  • 1 Start Session begins a workout (Sessions).
  • 2 Details shows your training days and the program text.
  • 3 Exercises lists the exercises Velto found, each with the evaluations that measure it.

Further down, Sessions lists every workout, and Charts follows any evaluation across all of them.

Exercises

An exercise page

An exercise's page shows 1 its line from your program, then 2 every recording of it, grouped by session, with what was counted (5 reps). Below them, Charts shows the exercise over time.

An exercise's evaluations

The Evaluations card is where you decide how the exercise is measured.

  • 2 In Use lists the evaluations measuring it. Choose its role in each row's ⋯ menu:
  • Count Reps With This makes it the exercise's counter. Nothing is counted until you choose one.
  • Find the Movement With This makes a detector find the exercise in a longer video, when there is no counter.
  • Set a Target… turns a value into a check, such as depth below 95° or knee angle under 160°, judged on every rep.
  • 3 Suggested lists evaluations that match the exercise's name.
  • 1 Create Evaluation makes a new one, including From One Rep: mark one rep in a video and Velto builds a detector and counter from it.

Sessions

A session page

Tap Start Session on the program page. While a session is open, a bar stays at the top of the app, and every video you capture is filed to it.

  • 1 Log: write your workout as you go, in any words. Insert Table adds a table of sets and reps. Velto writes the reps it counted into the log, and marks the lines it wrote.
  • 2 Counts: what each exercise's counter found, per set.
  • 3 Recordings: the videos filed to this session, grouped by exercise. Add one from the library with +; a row opens to each evaluation's result and one line per rep.
Sessions and charts on the program page
  • 1 Every session is listed on the program page with what was counted. Once a session has ended and you've reviewed it, its results are saved: changing an evaluation later never rewrites past sessions. If an exercise's settings change, its sessions can be measured again, and the earlier result is kept beside the new one.
  • 2 Charts draws any evaluation across your sessions by what it gives: reps per session as bars, a score per rep as dots, a value per frame as a strip per recording.

Exports

Everything you make in Velto can leave it: a video to share, an image of a chart, or the numbers for a spreadsheet.

Videos and frames

The Download menu under the video

Under the video, tap Download:

  • 1 Download Video renders the video with what you see drawn in.
  • 2 Save Frame saves the current frame as an image.
The export ready card

When the video is ready:

  • 1 Share sends it to Photos, Messages, Files or any app.
  • 2 Include chooses what is drawn in: the skeleton, the evaluation overlays and your drawings. Change one and the video renders again. Blurred faces stay blurred.
  • 3 Exported videos and charts carry a small Velto badge. Velto Pro removes it; every other feature in Velto is free.

Data

The Export Data sheet

Export Data (the share button at the top of a recording) makes a ZIP of CSV files: the poses in 3D and 2D, every evaluation result and the segments, ready for Numbers, Excel, pandas or R.

  • 1 Include Original Video adds the video file to the ZIP. The estimated size is shown before you export.
  • 2 Export Data makes the file and opens the share sheet.

Charts

The chart ready to share

A chart's Download makes an image of the chart with its legend. 1 Share sends it anywhere.

A chart's values as a table

A chart's Table shows every value it plots, row by row.

  • 1 Export CSV saves those rows as a spreadsheet file.
  • 2 Series shows one evaluation or all of them.
  • 3 Sort orders the rows by position in the video or by value.

Comparisons

On a comparison page, Generate Video Overlay and Generate Side by Side render the comparison as a video, with the same ready card as a recording's video (The comparison page). The share button at the top exports the comparison's data, like a recording's.

Programs

Sharing a program

A program's Share (top right) offers two formats:

  • 1 Text: the program text, each session's log and what Velto measured. Good for a message or your notes.
  • 2 Data Files (ZIP): everything as CSV and JSON, for a spreadsheet or code. It can include the original videos.
  • 3 Share makes the file and opens the share sheet.