-
Fast Training of NMT Model with Data Sorting
Authors:
Daniela N. Rim,
Kimera Richard,
Heeyoul Choi
Abstract:
The Transformer model has revolutionized Natural Language Processing tasks such as Neural Machine Translation, and many efforts have been made to study the Transformer architecture, which increased its efficiency and accuracy. One potential area for improvement is to address the computation of empty tokens that the Transformer computes only to discard them later, leading to an unnecessary computat…
▽ More
The Transformer model has revolutionized Natural Language Processing tasks such as Neural Machine Translation, and many efforts have been made to study the Transformer architecture, which increased its efficiency and accuracy. One potential area for improvement is to address the computation of empty tokens that the Transformer computes only to discard them later, leading to an unnecessary computational burden. To tackle this, we propose an algorithm that sorts translation sentence pairs based on their length before batching, minimizing the waste of computing power. Since the amount of sorting could violate the independent and identically distributed (i.i.d) data assumption, we sort the data partially. In experiments, we apply the proposed method to English-Korean and English-Luganda language pairs for machine translation and show that there are gains in computational time while maintaining the performance. Our method is independent of architectures, so that it can be easily integrated into any training process with flexible data lengths.
△ Less
Submitted 16 August, 2023;
originally announced August 2023.
-
Semantic Segmentation for Fully Automated Macrofouling Analysis on Coatings after Field Exposure
Authors:
Lutz M. K. Krause,
Emily Manderfeld,
Patricia Gnutt,
Louisa Vogler,
Ann Wassick,
Kailey Richard,
Marco Rudolph,
Kelli Z. Hunsucker,
Geoffrey W. Swain,
Bodo Rosenhahn,
Axel Rosenhahn
Abstract:
Biofouling is a major challenge for sustainable shipping, filter membranes, heat exchangers, and medical devices. The development of fouling-resistant coatings requires the evaluation of their effectiveness. Such an evaluation is usually based on the assessment of fouling progression after different exposure times to the target medium (e.g., salt water). The manual assessment of macrofouling requi…
▽ More
Biofouling is a major challenge for sustainable shipping, filter membranes, heat exchangers, and medical devices. The development of fouling-resistant coatings requires the evaluation of their effectiveness. Such an evaluation is usually based on the assessment of fouling progression after different exposure times to the target medium (e.g., salt water). The manual assessment of macrofouling requires expert knowledge about local fouling communities due to high variances in phenotypical appearance, has single-image sampling inaccuracies for certain species, and lacks spatial information. Here we present an approach for automatic image-based macrofouling analysis. We created a dataset with dense labels prepared from field panel images and propose a convolutional network (adapted U-Net) for the semantic segmentation of different macrofouling classes. The establishment of macrofouling localization allows for the generation of a successional model which enables the determination of direct surface attachment and in-depth epibiotic studies.
△ Less
Submitted 21 November, 2022;
originally announced November 2022.
-
Detection of Malicious Websites Using Machine Learning Techniques
Authors:
Adebayo Oshingbesan,
Courage Ekoh,
Chukwuemeka Okobi,
Aime Munezero,
Kagame Richard
Abstract:
In detecting malicious websites, a common approach is the use of blacklists which are not exhaustive in themselves and are unable to generalize to new malicious sites. Detecting newly encountered malicious websites automatically will help reduce the vulnerability to this form of attack. In this study, we explored the use of ten machine learning models to classify malicious websites based on lexica…
▽ More
In detecting malicious websites, a common approach is the use of blacklists which are not exhaustive in themselves and are unable to generalize to new malicious sites. Detecting newly encountered malicious websites automatically will help reduce the vulnerability to this form of attack. In this study, we explored the use of ten machine learning models to classify malicious websites based on lexical features and understand how they generalize across datasets. Specifically, we trained, validated, and tested these models on different sets of datasets and then carried out a cross-datasets analysis. From our analysis, we found that K-Nearest Neighbor is the only model that performs consistently high across datasets. Other models such as Random Forest, Decision Trees, Logistic Regression, and Support Vector Machines also consistently outperform a baseline model of predicting every link as malicious across all metrics and datasets. Also, we found no evidence that any subset of lexical features generalizes across models or datasets. This research should be relevant to cybersecurity professionals and academic researchers as it could form the basis for real-life detection systems or further research work.
△ Less
Submitted 13 September, 2022;
originally announced September 2022.
-
Generalisation of Cyberbullying Detection
Authors:
Khoury Richard,
Larochelle Marc-André
Abstract:
Cyberbullying is a problem in today's ubiquitous online communities. Filtering it out of online conversations has proven a challenge, and efforts have led to the creation of many different datasets, all offered as resources to train classifiers. Through these datasets, we will explore the variety of definitions of cyberbullying behaviors and the impact of these differences on the portability of on…
▽ More
Cyberbullying is a problem in today's ubiquitous online communities. Filtering it out of online conversations has proven a challenge, and efforts have led to the creation of many different datasets, all offered as resources to train classifiers. Through these datasets, we will explore the variety of definitions of cyberbullying behaviors and the impact of these differences on the portability of one classifier to another community. By analyzing the similarities between datasets, we also gain insight on the generalization power of the classifiers trained from them. A study of ensemble models combining these classifiers will help us understand how they interact with each other.
△ Less
Submitted 1 September, 2020;
originally announced September 2020.
-
Perceptual analyses of action-related impact sounds
Authors:
Marie-Céline Bezat,
Vincent Roussarie,
Kronland-Martinet Richard,
Solvi Ystad,
Stephen Mcadams
Abstract:
Among environmental sounds, we have chosen to study a class of action-related impact sounds: automobile door closure sounds. We propose to describe these sounds using a model composed of perceptual properties. The development of the perceptual model was derived from the evaluation of many door closure sounds measured under controlled laboratory listening conditions. However, listening to such soun…
▽ More
Among environmental sounds, we have chosen to study a class of action-related impact sounds: automobile door closure sounds. We propose to describe these sounds using a model composed of perceptual properties. The development of the perceptual model was derived from the evaluation of many door closure sounds measured under controlled laboratory listening conditions. However, listening to such sounds normally occurs within a natural context, which probably modifies their perception. We therefore need to study differences between the real situation and the laboratory situation by following standard practices in order to specify the precise listening conditions and observe the influence of previous learning, expectations, action-perception interactions, and attention given to sounds. Our process consists in doing in situ experiments that are compared with specific laboratory experiments in order to isolate certain influential, context dependent components.
△ Less
Submitted 25 March, 2010;
originally announced March 2010.
