@ OP I see two options for you.
Option 1: Press your claim through war. Then kill the little sister and then the boy to inherit his remaining titles.
Option 2: Betroth and marry your heir to the duke's little sister and let her inherit by killing her brother. Then wait until your dynasty takes over peacefully.
Option 1: Press your claim through war. Then kill the little sister and then the boy to inherit his remaining titles.
Option 2: Betroth and marry your heir to the duke's little sister and let her inherit by killing her brother. Then wait until your dynasty takes over peacefully.