This markerless video tracking system records the movement of Infants using both traditional RBG video and infrared & depth data, allowing clinicians to categorize infants into examples of typical or aberrant movement. Since using this system to track infants movements allows for more data to be collected and categorized, researchers will be able to create highly accurate machine learning algorithms used to screen infants worldwide.