If you are using the camera for pro portraits, I think you've got to try an XE-1 in that situation (a lot) before making that decision. With portraits, the image is often about getting just a select portion of the image in focus, or the whole thing - depends on whether it for commercial directory or creative "salon" shots. In either case it's more about the focus detection and indication that the image crispness. Your lighting plays the other 90% and neither camera will help you with that.
I'm interested in the XE1 for a travel camera not for "serious" work, I have a D700 and that is my portrait camera. So perhaps I'm biased. I do have a X100 and X10 and I do like the quality of the Fuji images. I'm sure the EVF in the XE1 will beat my X100's hands down, but I can't see an EVF being as effective as a SLR viewfinder in placing the shadows, fine definition around the eyes, hair strands, reflections and highlights.
So in all that we differ in anticipating the camera's main purpose. I still recommend spending as much time as possible with the camera before making the choice based on commercial work.
BTW, the RAW conversion support of the X Pro-1 and XE-1 is still in question. Adobe does provide some level of conversion for these sensors, but there is significant disagreement in the RAW usage world whether it's a full quality conversion.
Roger It's still, ISO, aperture and shutter-speed, right?