Mine stretch a little when I wear them and wonder if it might help to dry them in the dryer this time?

Have you tried it?

These were capris and I had them hemmed to clamdigger length.