I’ve removed shoulder pads before, and it has improved the fit of the garment for me. FWIW, I have broad shoulders and long arms, and removing the shoulder pads gave me extra length in the sleeves. You have to be careful about where the bust tailoring falls however.
Usually shoulder pads are held in place by two or three very thin threads. You can snip them out to audition the fit, and replace with a few stitches if you need them. Or, replace with different (smaller) shoulder pads that can be got at most sewing supply stores.
If you aren’t crafty, a tailor can advise you.