Now thatljust violates physics
Not exactly. See, boats are big and heavy, regardless of whether they are made of steel or wood.
What makes them float?
All of the air (buoyancy) within that boat!
Now, with so many people with so much air in their heads on a wooden plank (our boat) in this pond (the sea), it all balances out.
Physics!