I personally find the existing arab/turkish skins too dark. They're certainly right for a lot of the muslims but are definatley 'brown' rather than 'olive'.
Pretty sure I read somewhere that nobles in Muslim Iberia were more ethnically Spanish than Arabic, because their mothers were typically white Iberian concubines. So I suppose a lighter skin colour for Andalusians would be accurate.