My feeling on this is that it is always best to listen to your body. As you said, you have small hands, so it makes sense that you might have to adapt some things. My hands are also on the smaller side, and I am always adapting fingerings to suit my own needs. For the most part, the fingerings put into music, especially at a more advanced level, are suggestions of what has worked for ONE harpist… the one who edited the edition or composed the piece.
Maybe I am wrong, and I welcome anyone to correct me here… but if the 3-1 sounds better and is easier on your hand I say go for it, and try to consider printed fingerings more as helpful guides that can be adapted to your own needs.