Ice in a bag with a towel over it. That will treat the swelling and help with pain.
Massage. Use your other hand to stimulate circulation in the injured area and slowly & carefully move the digit.
Alternate those things. You probably shouldn't ice longer than 20 minutes and no more often than once per hour. That's likely 'overkill' if you still have normal days but a few times per day will really help.