Gradually taper off Cymbalta with help from your healthcare provider to avoid severe withdrawal symptoms. Stopping Cymbalta suddenly can cause symptoms like dizziness, nausea, and trouble sleeping.