arXiv:2610.21880v1 Announce Type: new Abstract: Vision-aided beam tracking reduces mmWave beam-training overhead by predicting beam indices from camera observations. Fixed top-$K$ selection, however, assigns the same candidate beam budget to all predictions, ignoring uncertainty variations across samples and horizons. This letter proposes confidence-guided adaptive candidate selection: predictor logits are temperature-calibrated, and the smallest top-ranked beam set whose cumulative probability reaches a target threshold is retained under a maximum budget. On DeepSense~6G Scenario~8, over five random seeds and at matched overhead, the policy improves candidate set accuracy by up to 3.80 percentage points, increases normalized received power by 0.32 percentage points, and reduces outage probability by 2.06 percentage points without retraining the predictor.