OmniTraj: Pre-training on heterogeneous data for adaptive and zero-shot human trajectory prediction
The researchers developed OmniTraj, a Transformer-based trajectory prediction framework designed to handle varying sensor frame rates and observation horizons. By explicitly conditioning the model on temporal metadata, it addresses temporal mismatches across datasets and reduces prediction errors by over 70% under joint scene-temporal transfer conditions, while maintaining high accuracy in edge cases with limited observations.
Why it matters — It provides a trajectory prediction model capable of zero-shot generalization across different sensor configurations and unseen environments, removing the need to retrain models when deploying them on vehicles with different camera frame rates or observation windows.
Transportation Research Part C Emerging Technologies · doi · code