LoCoCo: Dropping In Convolutions for Long Context Compression Ruisi Cai1, Yuandong Tian2, Zhangyang Wang1, Beidi Chen3, 1University of Texas at Austin, 2Meta AI (FAIR), 3Carnegie Mellon University