Open Source
Reliability-Targeted Simulation of Item Response Data: Solving the Inverse Design Problem
arXiv stat.CO0 views
arXiv:2512.16012v3 Announce Type: replace-cross Abstract: Monte Carlo studies of item response theory (IRT) methods often leave the information level implicit in the choice of item parameters. Designs with the same sample size and test length can therefore represent quite different measurement conditions. We develop a calibration procedure that makes the information level an explicit design choice. The target is an information-based reliability index derived from population mean test information. Before generating responses, we solve for a common multiplier on item discriminations, keeping difficulties, test length and the reference population fixed. The R package IRTsimrel implements the procedure, allowing researchers to compare methods across chosen information levels or compare designs at a common target. In an item-level treatment-effect simulation, power increases across targets, while excess rejection from ignoring item-effect variation persists. These comparisons show how targeting helps distinguish findings that depend on the chosen information level from those that persist across the studied range.
Source:https://arxiv.org/abs/2512.16012PreviousSAT-sampling for statistical significance testing in sparse contingency tablesNextParticle-based Generalised Stochastic Optimisation
Related posts

MagSafe Monday: Pelican’s MagSafe Battery Pack is the battery built to go anywhere
09to5Mac
Your Product Is Copyable. Your Distribution Isn't: A 24-Channel Map for Solo Builders
0dev.to
Astra can read and write weights to improve Qwen
0Hacker News
Distillation didn't help our small model until we took the labels away
0dev.to Machine Learning

462. Minimum Moves to Equal Array Elements II
0dev.to PHP
MUSBRIC: LEGO-Compatible Pneumatic Muscle Bricks for Reconfigurable Musculoskeletal Robots
0arXiv cs.RO