Read,
It appears that while originally being issued a mixture of US conversion muskets and Enfield rifles, the 21st Indiana Infantry was issued Enfield rifles sometime in 1862. This is based on information from Todd's American Military Equipage, but seems to be reinforced by a first-hand account written by a member of this regiment.
There are some photos of this regiment available on the Internet, as well as some published aricles written by Vincent Anderson of that regiment.
Mike