Evaluating CLIP: Towards Characterization of Broader Capabilities and Downstream Implications.