ictnlp / Multiscale-Contextualization Public

Notifications You must be signed in to change notification settings
Fork 1
Star 6

ACL2024 Integrating Multi-scale Contextualized Information for Byte-based Neural Machine Translation

6 stars 1 fork Branches Tags Activity

Name		Name	Last commit message	Last commit date
Latest commit History 2 Commits
fairseq		fairseq
scripts		scripts
tools		tools
README.md		README.md

Repository files navigation

Multiscale-Attention

Description

Codes and scripts for ACL2024 Findings paper "Integrating Multi-scale Contextualized Information for Byte-based Neural Machine Translation".

Changes to fairseq files

add the file multiscale_transformer.py to fairseq/models
add the file multiscale_attention.py to fairseq/modules
add the file transformer_multiscale_layer.py to fairseq/modules
change fairseq/modules/init.py to import the added packages

How to use it?

Add pathes to the scripts in the scripts folder, and run them.

About

ACL2024 Integrating Multi-scale Contextualized Information for Byte-based Neural Machine Translation

Custom properties

Report repository

Releases

No releases published

Packages

No packages published

Languages