Nope. Not most men. Sure, some men. Just as skinny women are a turn off for some men, red-heads and chicks with big round asses don't do it for some men. Pale lady, you won't be loved by all, but pale skin is far from... The Scarlet Complexion. Not only do some guys cream in their sweatpants for the alabaster porcelain look, but others don't really think about it. They notice, but they don't NOTICE. I mean, unless you're translucent.
Beyond that, many pale women are appreciative of their melanin count. They enjoy standing out from the sun baked and naturally dark skinned women in their social scene. Having "a look" you can own and radiate is a good thing. Especially, if you're somewhere like Miami or Palm Springs where the going look is sunned the F out.
And lastly, often men and women enjoy dating people who bring something to the table they aren't or don't have. Tall craves short. Black likes white. Blue-eyed seeks brown-eyed and so on. You may find the types that respond most to you are not the pale dudes - hopefully that works for you and your libido. If not, worry not, you'll eventual find your man: Tall, pale and handsome.
Oh no funny guy - you've just added redheads to the undesirable pile. There really is no hope for me.