This is not a problem as long as baby is well supported as shown in the photo below (make sure you pull on the straps on baby's back (on the apron) to keep the shoulders flat.
His growing curiosity can also indicate to you to switch to back carrying with the booster seat if needed.
