It doesn't have to be a harem. 'Raising children from an orphanage' is also fine
yotsuba?
My Daughter Left the Nest and Returned an S-Rank Adventurer