Structural priming is a tendency to reuse previously produced sentence structures. It provides good evidence for syntactic representations in language use, and is informative about how experience with other structures influences those representations. A ne
Comprehending Structural Priming: A Connectionist Learning Account Franklin Chang 1, Gary Dell 2, and Kathryn Bock 2 1
Max Planck Institute for Evolutionary Anthropology, 2 University of Illinois at Urbana-Champaign Dual-path Model Architecture (Chang, 2002) Message system Insensitivity to Closed Class Items Structural priming is insensitive to closed-class elements (Bock, 1989; Pickering& Branigan, 1998). Priming Difference (%) Prime Structure Example John gives the dog the cake John gives the cake to the dog John makes the cake for the dog Sally passed a beer to Mary Structures
Abstract Structural priming is a tendency to reuse previously produced sentence structures. It provides good evidence for syntactic representations in language use, and is informative about how experience with other structures influences those representations. A new connectionist model that does language learning is shown to be better able to explain a variety of structural priming results (compared to previous models), suggesting the same language learning mechanism can support syntax acquisition and structural priming.
word
Sequencing system
what (concepts) where (roles)
0
10 14
Difference in percent between conditions
20
30
compress
Double Object Dative (DO) Prepositional Dative(PD) Benefactive Dative (PDFOR)
PD-DO 12
Bock,
1989 PDFOR
PD-DO= PDFOR 14 12
hidden event-semantics cwhere (roles) ccompress Previously heard or produced words
TARGET EVENT
Human Model 25
SAMEVERB
context
Same Verb Same Verb+ Past Tense Different Verb TARGET
John passes the cake to the dog John passed the cake to the dog John gives the cake to the dog Sally passed a beer to Mary
Pickering& Branigan, 1998 SAMEVERB+ED
12
SAME= SAME+ED 20 12
SAME> DIFF 7
DIFFVERB 12
The Mechanism underlying Structural Priming: 3 Critical Findings 1. Structural priming can be long-lasting, suggesting that it is form of implicit learning (Bock& Griffin, 2000) 2. Comprehension-to-production and production-to-production are similar in magnitude (Bock, 2002, March) 3. Structurally similar but lexically and semantically different sentences can prime one another (Bock& Loebell, 1990) These critical findings suggest that priming is supported by an implicit learning mechanism that is shared between production and comprehension and has the ability to abstract away from lexical and conceptual content.
cwhat (concepts) cword The dual-path architecture separates content from structural relationships, allowing abstract syntactic representations to be learned and used. The message is in weights between where (role) and what (concepts) units.
These results suggest that the model is able to use structural frames to activate the appropriate closed-class element, but these elements are separate from the syntactic structure (further support for critical finding 3). Priming Over Lag Structural priming lasts over a lag of 10 intervening sentences (Bock& Griffin, 2000; Bock, 2002, March). Comb
ined Dative and Transitive Priming over Lag 25 20 15 10 5 0 -2 0 2 Lag 4 6 8 10
Testing Structural Priming We took a fully trained model and presented the prime with learning turned ON. Then we gave the model the target message, and allowed it to choose a structure to convey it. This was repeated with 10 models that were trained on different input sets. Results averaged over 10 models, and t-tests applied to priming difference (all results significant at 0.05). In previous models (Chang et al., 2000; Rohde, 2001 March), during prime processing both the prime message and the prime's words were processed. Here, we only presented the prime's words (without the prime message), thus simulating only the comprehension of the prime. The equivalence of comprehension-to-production and production-to-production priming (critical finding 2) occurs because in both cases, the prime is comprehended, and this comprehension is the cause of the priming (Branigan, et al. 2000).
Previous Work Connectionist models generalize based on overlap in unit-specific representations (which in language models tend to be words and concepts) (Fodor& Pylyshyn, 1988; Marcus, 1998). For example, a connectionist model of sentence production requires overlap between prime and target MESSAGES to get structural priming (Chang, Dell, Bock,& Griffin, 2000). These issues make it difficult to account for critical findings 2 and 3 above. Chang (2002) developed a novel model architecture (Dual-path) that allows a connectionist model to generalize more abstractly by developing separate representations that can be combined in novel ways.
Priming in the model was present over 10 intervening sentences, and similar to both comprehension and production results (supporting critical finding 1 and 2).
Priming involves Structures Sentences Types use to Train Model Event Type Inanimate Intransitive Animate Intransitive Locative Presentational Transitive Theme-experiencer Cause-motion Double Object Dative Benefactive Dative A bottle break,-s. A girl walk,-ed. A man goes near the cafe. This is jumping. Mary eat,-s a crossiant. The cake amuse,-ed Mary The woman pour,-ed the water on the car. The girl give,-s Mary a crossiant Fred is bake,-ing a cake for Mary Example open, close, break, fall dance, sleep, laugh, play, go,walk,run,jump go, walk any verb hit, carry, push, touch scare, surprise, amuse, annoy put, hit, carry, push, touch give, send, throw, feed make, bake, build, mold, hit, carry, push, touch, scare, surprise, amuse, annoy Change Spray-load Alternation The woman fill,-ed the bottle with water. The boy spray,-ed water on the wall. fill, cover, soak, bathe spray, load, brush, heap Actions
Priming does not require meaning or open-class lexical overlap (Bock& Loebell, 1990). Structure Double Object Dative (DO) Prepositional Dative (PD) Prepositional Locative (PL) TARGET EVENT Active Transitive (AC) Passive Transitive (PA) Intransitive Locative (LO) TARGET EVENT Example John gives the dog th
e cake 7
0
5
Difference in percent between conditions
Priming Difference (%) 10 15
Conclusions The Dual-path architecture constrains language learning such that abstract syntactic representations are developed. By only using the prime word sequence, we show that distributional sequence learning could be the common mechanism for both comprehension-based and production-based priming. References Bock, K. (1989). Closed-class immanence in sentence production. Cognition, 31(2), 163-186. Bock (2002, March) Persistent structural priming from comprehension to production. Presented at the CUNY Conference on Human Sentence Processing, New York, NY. Bock& Griffin (2000) The persistence of structural priming: Transient activation or implicit learning? Journal of Experimental Psychology: General, 129, 177-192. Bock& Loebell (1990) Framing sentences. Cognition, 35, 1-39. Branigan, H. P., Pickering, M.J.,& Cleland, A.A. (2000). Syntactic co-ordination in dialogue. Cognition, 75, B13-25 Chang (2002) Symbolically speaking: A connectionist model of sentence production. Cognitive Science, 26, 609-651. Chang, Dell, Bock,& Griffin (2000) Structural priming as implicit learning: A comparison of models of sentence production. Journal of Psycholinguistic Research, 29, 217-229 Fodor, J. A.,& Pylyshyn, Z. (1988). Connectionism and cognitive architecture: A critical analysis. Cognition, 28, 3-71. Marcus, G. F. (1998). Rethinking eliminative connectionism. Cognitive Psychology, 37, 243-282. Pickering, M. J.,& Branigan, H. P. (1998). The representation of verbs: Evidence from syntactic priming in language production. Journal of Memory and Language, 39, 633-651. Rohde, D. L. T. (2002 March). Syntactic and semantic processing in a connectionist model of complex sentence comprehension and production. Poster presented at the 15th Annual CUNY Conference on Human Sentence Processing, New York City. Presented at the CUNY Sentence Processing Conference, 2003, MIT, Boston, MA
John gives the cake to the dog John pushes the cake to the dog Sally passes a beer to Mary Structures
PD - DO 12
PD-DO= PL-DO 10
PL - DO 11
Human 5
John carries Mary Mary is carried by John Mary is walking by John The dog touched the cat.
AC - PA 6
Model
AC-PA= AC-LO 6
AC - LO 8
These results suggest that the model uses abstract structures that are shared between prepositional datives and prepositional locatives, as well as passives and locatives (supporting critical finding 3).
Priming Difference (%)
Human-Prod Human-Comp Model


Transitive Verbs & Intransitive Verbs_英语考试_外语学习_教育专区。Transitive verbs & intransitive verbs Class two grade three Jiaotingting verbs predicate Main...
Inanimate Intransitive A... 暂无评价 1页 免费 dynamic 29页 免费 Dynamic...ed using transitive noninterference, and showed that intransitive noninterference...
Intransitive Noninterference in Dependence Graphs Abstract — In classic information flow control (IFC), noninterference guarantees that no information flows ...
M7 Unit 1 transitive and intransitive verb_英语考试_外语学习_教育专区。transitive and intransitive verb 学案,包括练习今日推荐 ...
(1) Verb classes: ii Inanimate intransitive ai Animate intransitive ti Transitive inanimate ta Transitive animate (2) Animacy, Obviation (3) Pronominal ...
Locational verbs iru (animate) and aru (inanimate) express locative-existential meanings when used as intransitive, and possessive meaning when used as ...
passive (complement of by-phrase) Reference by animate personal pronoun (noun occurs as intransitive subject in a sentence preceding an initial animate ...
What, Indeed, is Intransitive Noninterference (Preliminary Report) Abstract. This paper argues that Haigh and Young’s definition of noninterference for ...
inanimate 无机的 inc. incerta,incertorum,uncertain 不确定 ind. indicative ...intransitive verb 材料属格 genitive of material 差异夺格 ablative of degree ...
3). Verbs from inanimate nous: shadow, balloon, flood, ghost, mushroom,...3.Adjective-Verb Conversion (a)Intransitive verbs meaning” to be , become...
热门文档