The bosses daughter part would bother me more than the kid.
Kids do add a challenge to starting a new relationship tho, for sure. My fiance has two, both boys. The oldest ones dad passed away and the young ones dad is a worthless pos that hasnt seen him in the almost two years that ive been around. He calls about once a month wanting to see her though and asking if im still around and acts like the boy is just a secondary issue.
You get attached to them. If you already have a kid its kinda weird, at least it was for me. Its definitely a challenge.