That has actually happened to me three times now, I think there something about how they are set up to prevent take-overs such as that.
There need to be more people sieging a fort than there is defending it; so you pop up a 2k rebel army on Rhodes and some die to their army and now you have 1500 trying to siege a fort with 2000 defenders... -> the siege will last indefinitely.