<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
Hi CaCL members,</div>
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
<br>
</div>
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
Here's the reading for our next meeting, on 9/14.</div>
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
<br>
</div>
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof ContentPasted0">
Contextual Distortion Reveals Constituency: Masked Language Models are Implicit Parsers (Li and Lu 2023)<br>
</div>
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof ContentPasted0">
<br>
</div>
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof ContentPasted0 ContentPasted1">
<b>Paper:</b> <a href="https://aclanthology.org/2023.acl-long.285.pdf" id="LPlnk564103" data-loopstyle="linkonly" class="OWAAutoLink">https://aclanthology.org/2023.acl-long.285.pdf</a></div>
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof ContentPasted0 ContentPasted1">
<br>
</div>
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof ContentPasted0 ContentPasted1">
<b>Zoom:</b> <a href="https://urldefense.com/v3/__https://osu.zoom.us/j/93495474520?pwd=NWFRZzF6QnZrQWdheThxbWJyNjJ4dz09__;!!KGKeukY!2TWrTWTrANlP6_byTlK5ZLL4FcVlqFnyd9wv4X2M3zr-UJY-3iNs13eazubwOhgODDjOzblyZP_95P1NaUWjzw$" target="_blank" rel="noopener noreferrer" data-auth="NotApplicable" id="LPlnkOWA6d2ead6d-2f18-e5ba-53fd-e1c924c35ff8" data-linkindex="0" style="font-size: 13.32px; font-family: Calibri, sans-serif; margin: 0px; background-color: white;" class="OWAAutoLink ContentPasted2" data-loopstyle="linkonly"><span style="font-size: 12pt; font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; margin: 0px; color: rgb(14, 113, 235);">https://osu.zoom.us/j/93495474520?pwd=NWFRZzF6QnZrQWdheThxbWJyNjJ4dz09</span></a></div>
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof ContentPasted0 ContentPasted1">
<br>
</div>
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof ContentPasted0 ContentPasted1">
<b>Abstract:</b></div>
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof ContentPasted0 ContentPasted1">
<span style="font-family: -apple-system, BlinkMacSystemFont, "segoe ui", Roboto, "helvetica neue", Arial, "noto sans", sans-serif, "apple color emoji", "segoe ui emoji", "segoe ui symbol", "noto color emoji"; text-align: left; display: inline !important; color: rgb(33, 37, 41); background-color: rgb(248, 249, 250);" class="ContentPasted3">Recent
advancements in pre-trained language models (PLMs) have demonstrated that these models possess some degree of syntactic awareness. To leverage this knowledge, we propose a novel chart-based method for extracting parse trees from masked language models (LMs)
without the need to train separate parsers. Our method computes a score for each span based on the distortion of contextual representations resulting from linguistic perturbations. We design a set of perturbations motivated by the linguistic concept of constituency
tests, and use these to score each span by aggregating the distortion scores. To produce a parse tree, we use chart parsing to find the tree with the minimum score. Our method consistently outperforms previous state-of-the-art methods on English with masked
LMs, and also demonstrates superior performance in a multilingual setting, outperforming the state-of-the-art in 6 out of 8 languages. Notably, although our method does not involve parameter updates or extensive hyperparameter search, its performance can even
surpass some unsupervised parsing methods that require fine-tuning. Our analysis highlights that the distortion of contextual representation resulting from syntactic perturbation can serve as an effective indicator of constituency across languages.</span> </div>
<div class="elementToProof">
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div id="Signature">
<div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<span style="font-size: 12pt; margin: 0px; text-align: start; background-color: rgb(255, 255, 255);"><span style="margin:0px">----</span></span>
<div style="font-size: 12pt; margin: 0px; text-align: start; background-color: rgb(255, 255, 255);">
</div>
<div style="font-size: 12pt; margin: 0px; text-align: start; background-color: rgb(255, 255, 255);">
<b>Christian Clark</b><br>
</div>
<div style="font-size: 12pt; margin: 0px; text-align: start; background-color: rgb(255, 255, 255);">
<div style="margin:0px">Ph.D. Student</div>
<div style="margin:0px">Department of Linguistics</div>
<span style="margin:0px">The Ohio State University</span></div>
</div>
</div>
</div>
</div>
</body>
</html>