Aubry Babcock & Joshua both looked forward to their alone time