Code for "Semantic Role Labeling as Dependency Parsing: Exploring Latent Tree Structures Inside Arguments".

Last update: Nov 08, 2022

Overview

crfsrl

Yu Zhang, Qingrong Xia, Shilin Zhou, Yong Jiang, Zhenghua Li, Guohong Fu, Min Zhang. Semantic Role Labeling as Dependency Parsing: Exploring Latent Tree Structures Inside Arguments. 2021. [arxiv]

Setup

The following packages should be installed:

SuPar: == 1.1.3
PyTorch: >= 1.7
Transformers: >= 4.0

Run the following scripts to obtain the training data. Please make sure PTB and OntoNotes are available:

bash scripts/conll05.sh PTB=<path-to-ptb>             SRL=data
bash scripts/conll12.sh ONTONOTES=<path-to-ontonotes> SRL=data

Run

Try the following commands to train first-order CRF and second-order CRF2o models:

# LSTM
# CRF
python -u crf.py   train -b -c configs/conll05.crf.srl.lstm.char-lemma.ini   -d 0 -f char lemma -p exp/conll05.crf.srl.lstm.char-lemma/model
# CRF2o
python -u crf2o.py train -b -c configs/conll05.crf2o.srl.lstm.char-lemma.ini -d 0 -f char lemma -p exp/conll05.crf2o.srl.lstm.char-lemma/model
# BERT finetuning
# CRF
python -u crf.py   train -b -c configs/conll05.crf.srl.bert.ini   -d 0 -p exp/conll05.crf.srl.bert/model   --batch-size=1000 --encoder bert --bert bert-large-cased 
# CRF2o
python -u crf2o.py train -b -c configs/conll05.crf2o.srl.bert.ini -d 0 -p exp/conll05.crf2o.srl.bert/model --batch-size=1000 --encoder bert --bert bert-large-cased

To do evaluation:

# end-to-end
python -u crf.py   evaluate -c configs/conll05.crf.srl.bert.ini  -d 0 -p exp/conll05.crf.srl.bert/model    --data data/conll05/test.conllu
# w/ gold predicates
python -u crf.py   evaluate -c configs/conll05.crf.srl.bert.ini  -d 0 -p exp/conll05.crf.srl.bert/model    --data data/conll05/test.conllu --prd

To make predictions:

python -u crf.py   predict  -c configs/conll05.crf.srl.bert.ini   -d 0 -p exp/conll05.crf.srl.bert/model   --data data/conll05/test.conllu --pred pred.conllu
bash scripts/eval.sh pred=pred.conllu gold=data/conll05/test.conllu

Contact

If you have any questions, feel free to contact me via emails.

Code for "Semantic Role Labeling as Dependency Parsing: Exploring Latent Tree Structures Inside Arguments".

Related tags

Overview

crfsrl

Setup

Run

Contact

Owner

Yu Zhang

The Internet Archive Research Assistant - Daily search Internet Archive for new items matching your keywords

XLNet: Generalized Autoregressive Pretraining for Language Understanding

A simple Speech Emotion Recognition (SER) API created using Flask and running in a Docker container.

Python port of Google's libphonenumber

【原神】自动演奏风物之诗琴的程序

GCRC: A Gaokao Chinese Reading Comprehension dataset for interpretable Evaluation

BPEmb is a collection of pre-trained subword embeddings in 275 languages, based on Byte-Pair Encoding (BPE) and trained on Wikipedia.

基于百度的语音识别，用python实现，pyaudio+pyqt

Ongoing research training transformer language models at scale, including: BERT & GPT-2

Stack based programming language that compiles to x86_64 assembly or can alternatively be interpreted in Python

Topic Inference with Zeroshot models

Words-per-minute - A terminal app written in python utilizing the curses module that tests the user's ability to type

Pre-Training with Whole Word Masking for Chinese BERT

A library for end-to-end learning of embedding index and retrieval model

Creating an LSTM model to generate music

Practical Machine Learning with Python

This repository collects together basic linguistic processing data for using dataset dumps from the Common Voice project

100+ Chinese Word Vectors 上百种预训练中文词向量

pysentimiento: A Python toolkit for Sentiment Analysis and Social NLP tasks

中文問句產生器；使用台達電閱讀理解資料集(DRCD)