The precious metals can be a strong diversifier, but it comes with downsides, too.