"And when I got back, when we - you felt that too, right?"
He told him as much, at the time.
Other options:
no subject
"And when I got back, when we - you felt that too, right?"
He told him as much, at the time.