How do I install shelves?

I am installing shelves in my closet, so there is drywall and then metal or concrete behind it. My plan was to uses drywall anchors but the anchors i have are to big for the drywall. If i use smaller anchors i dont think it will be stong enough for shelves. What would one do in this situation?