Oh yes, Peter is definitely missing the point. Sirius wants to touch Remus; Remus doesn't trust himself to be touched by Sirius.

But points to Peter for noticing the oddities of their behaviour. I figure Peter was very likely the most observant of the group. (James and Sirius were too busy being observed.)