When trousers are lain with side seam to side seam, it creates a crease line down the outside of the trousers.  And what that means (depending on the fabric) is that this crease line will stick out.  Making the person look bigger than they are.