I never use vegas 11 before, I use the old one vegas 8.
Well you can mask one layer first and copy paste and put under the that layer. The below layer change it to white or something u like and set the feather to around 1 - 3. it'll be smoother if the above layer feather set to 1 too. but the below layer must have higher feather level than the above one.