CSCE 689 - Evaluating AI Video Models on Analytical Physics Prompts
Classic gravity prompts highlighting differences between Earth, Moon, vacuum, and projectile motion.
Side view, static camera. The ball is released and It falls straight down under Earth gravity. Realistic, physics adhering video, tripod shot, fixed camera, no camera motion.
Side view, static camera. The ball is released and It falls straight down under Moon gravity. Realistic, physics adhering video, tripod shot, fixed camera, no camera motion.
Side view of a tall vacuum chamber. A metal hammer and a feather are released simultaneously from the top and they fall, hitting the bottom. Realistic, physics adhering video, tripod shot, fixed camera, no camera motion.
A ball shoots out from the launcher on the left which follows trajectory under gravity and falls to the ground. Realistic, physics adhering video, tripod shot, fixed camera, no camera motion.
Testing whether models capture sinking, floating, and buoyant pop-up behavior inside a water tank.
A heavy solid steel ball is dropped into the water. Realistic, physics adhering video, tripod shot, fixed camera, no camera motion.
A hollow plastic ball is dropped into the water. Realistic, physics‑adhering video, tripod shot, fixed camera, no camera motion.
The light wooden block at the bottom of the surface is released. Realistic, physics‑adhering video, tripod shot, fixed camera, no camera motion.
Examining how well models respect conservation principles during impacts and rolling contact.
The blue billiard ball is struck by a cue stick from the right and the blue ball moves toward a stationary red ball. They collide head-on. Realistic, physics‑adhering video, Static top-down fixed camera, no camera motion.
Top-down, fixed camera on a billiard table. Cue stick enters from the right, hits a blue ball. Blue ball rolls left, strikes a stationary red ball off-center in an oblique collision. Realistic, physics‑adhering video, Static top-down fixed camera, no camera motion.
Side view of a vertical stack of wooden blocks. The block on the left slides in and hits the base at very high speed. Realistic, physics‑adhering video, tripod shot, fixed camera, no camera motion.
Static side view. The metal cart slides smoothly to the right along the rails. It makes contact with the large metal spring. The spring compresses horizontally against the wall as the cart pushes into it. Realistic, physics‑adhering video, tripod shot, fixed camera, no camera motion.
Comparing measured Earth/Moon gravity ratios. Expected ratio ≈ 6.05 (Earth: 9.8 m/s² ÷ Moon: 1.62 m/s²)
| Model | G1 Earth Accel (px/s²) | G2 Moon Accel (px/s²) | Actual Ratio | Expected Ratio | Accuracy |
|---|---|---|---|---|---|
| Grok | 334.42 | 248.79 | 1.34 | 6.05 | 22% |
| Sora2 | 160.54 | 192.34 | 0.83 | 6.05 | 14% |
| Veo2 | 200.34 | 63.68 | 3.15 | 6.05 | 52% |
| Veo3 | 5.16 | 35.72 | 0.14 | 6.05 | 2% |
| Wan2.1 | 5.52 | 77.75 | 0.07 | 6.05 | 1% |
Accuracy = (Actual Ratio / Expected Ratio) × 100, capped at 100%. Higher values indicate better physics modeling.