Purpose

Track Anything follows query points using BootsTAPIR. Each point retains a slot identity while its position and visibility change. Use it to attach effects to selected image features or sample motion across a grid.

Use

Place Track Anything under Analyze in the Image view and connect video to in. Start with Query Mode set to Grid and inspect preview.

For chosen features, select Input and supply normalized XY pairs to queries. Reset to seed a fresh set of tracks on the current frame.

Inputs and outputs

• in supplies the video.
• queries supplies up to 256 XY pairs for Input mode. Coordinates run from 0 through 1.
• preview draws tracked points.
• points_tex stores X, Y, confidence and visibility in RGBA, with one texel per point slot.
• points contains slot, position, visibility, confidence, age and XY movement rows.
• count bounds the published point slots. summary includes active and visible counts and tracking statistics.

Controls

• Model selects the BootsTAPIR checkpoint.
• Query Mode selects Grid or Input. Grid Size controls grid density.
• Iterations sets the tracking refinement count.
• Visibility Threshold decides which points are marked visible.
• Point Size changes the drawn markers.
• Reset clears tracking history and seeds points again.

Notes

Use visibility or the visible count in summary when deciding which tracks to use. The slot count alone does not say how many points are currently visible. Reset at a cut to avoid following locations from an unrelated shot.

Ports

Inputs

• in image required
  RGBA
• queries image required
  256 x 2

Outputs

• preview image
  RGBA
• points_tex image
  256 x 1 x 4
• points image
  256 x 8
• summary image
  6
• count image
  1

Parameters

Model (Modelpath) Str op('track_anything').par.Modelpath

Default:

causal_bootstapir_checkpoint.pt

Query Mode (Querymode) Menu op('track_anything').par.Querymode

Default:

grid

Options:

grid, input

Grid Size (Gridsize) Int op('track_anything').par.Gridsize

Default:

16

Range:

1 to 16

Iterations (Iterations) Int op('track_anything').par.Iterations

Default:

1

Range:

1 to 4

Visibility Threshold (Visthreshold) Float op('track_anything').par.Visthreshold

Default:

0.5

Range:

0 to 1

Point Size (Pointsize) Int op('track_anything').par.Pointsize

Default:

2

Range:

1 to 8

Reset (Reset) Pulse op('track_anything').par.Reset

Default:

None