In a new preprint study, researchers at Carnegie Mellon University claim sound can be used to predict an object's appearance and its motion. The coauthors created a "sound-action-vision" data set and a family of AI algorithms to investigate the interactions between audio, visuals, and movement. The results, they say, show representations derived from sound can be used to anticipate where objects will move when subjected to physical force.
