"Bottom line — in my view, what causes gold to turn around is when the Fed has to stop pretending that it cares about inflation," said Chris Temple of the National Investor.