{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":640410840,"defaultBranch":"main","name":"evals","ownerLogin":"momensity","currentUserCanPush":false,"isFork":true,"isEmpty":false,"createdAt":"2023-05-14T01:57:03.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/121355377?v=4","public":true,"private":false,"isOrgOwned":true},"refInfo":{"name":"","listCacheKey":"v0:1684031021.5323598","currentOid":""},"activityList":{"items":[{"before":"86cecbe4d0c3725b8ad0c04f2d64f49e54f7883d","after":"4f6810113353b359f68f65db88c4bf10d6affed5","ref":"refs/heads/dvelle-patch-1","pushedAt":"2023-05-14T03:19:16.300Z","pushType":"push","commitsCount":1,"pusher":{"login":"dvelle","name":"Jermon Green","path":"/dvelle","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/7250699?s=80&v=4"},"commit":{"message":"conceptual_metaphor_detection.jsonl","shortMessageHtmlLink":"conceptual_metaphor_detection.jsonl"}},{"before":null,"after":"86cecbe4d0c3725b8ad0c04f2d64f49e54f7883d","ref":"refs/heads/dvelle-patch-1","pushedAt":"2023-05-14T02:23:41.532Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"dvelle","name":"Jermon Green","path":"/dvelle","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/7250699?s=80&v=4"},"commit":{"message":"Create conceptual-metaphor-detection\n\nConceptual metaphors involve understanding one idea or domain in terms of another, which is a fundamental aspect of human cognition and communication. They often involve abstract or complex ideas, and understanding them requires a certain level of semantic understanding and context awareness.\r\n\r\nEvaluating an LLM's ability to generate, understand, and appropriately use conceptual metaphors could provide valuable insights into its language understanding capabilities. Such an evaluation could involve:\r\n\r\nAssessing the model's ability to generate appropriate metaphors given a certain context.\r\nTesting the model's understanding by having it explain the meaning of given metaphors.\r\nEvaluating whether the model can identify and interpret conceptual metaphors in a text.","shortMessageHtmlLink":"Create conceptual-metaphor-detection"}}],"hasNextPage":false,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"djE6ks8AAAADLDmoFAA","startCursor":null,"endCursor":null}},"title":"Activity · momensity/evals"}