India said on Tuesday it will divest an up to 4% stake in Indian Railway Finance Corp through an offer for sale on Wednesday.