Showing 1–3 of 3 results for author: Rushkin, I

Document Similarity from Vector Space Densities

Authors: Ilia Rushkin

Abstract: We propose a computationally light method for estimating similarities between text documents, which we call the density similarity (DS) method. The method is based on a word embedding in a high-dimensional Euclidean space and on kernel regression, and takes into account semantic relations among words. We find that the accuracy of this method is virtually the same as that of a state-of-the-art meth… ▽ More We propose a computationally light method for estimating similarities between text documents, which we call the density similarity (DS) method. The method is based on a word embedding in a high-dimensional Euclidean space and on kernel regression, and takes into account semantic relations among words. We find that the accuracy of this method is virtually the same as that of a state-of-the-art method, while the gain in speed is very substantial. Additionally, we introduce generalized versions of the top-k accuracy metric and of the Jaccard metric of agreement between similarity models. △ Less

Submitted 1 September, 2020; originally announced September 2020.

Comments: 12 pages, 3 figures

MSC Class: I.2.7

Journal ref: In: Arai K., Kapoor S., Bhatia R. (eds) Intelligent Systems and Applications. IntelliSys 2020. Advances in Intelligent Systems and Computing, vol 1251. Springer, Cham

Time-on-Task Estimation with Log-Normal Mixture Model

Authors: Ilia Rushkin

Abstract: We describe a method of estimating a user's time-on-task in an online learning environment. The method is agnostic of the details of the user's mental activity and does not rely on any data except timestamps of user's interactions, accounting for individual user differences. The method is implemented in R (the code is open-source) and has been tested in the data from a large sample of HarvardX MOO… ▽ More We describe a method of estimating a user's time-on-task in an online learning environment. The method is agnostic of the details of the user's mental activity and does not rely on any data except timestamps of user's interactions, accounting for individual user differences. The method is implemented in R (the code is open-source) and has been tested in the data from a large sample of HarvardX MOOCs. △ Less

Submitted 4 May, 2018; originally announced May 2018.

Modelling and Using Response Times in Online Courses

Authors: Ilia Rushkin, Isaac Chuang, Dustin Tingley

Abstract: Each time a learner in a self-paced online course seeks to answer an assessment question, it takes some time for the student to read the question and arrive at an answer to submit. If multiple attempts are allowed, and the first answer is incorrect, it takes some time to provide a second answer. Here we study the distribution of such "response times." We find that the log-normal statistical model… ▽ More Each time a learner in a self-paced online course seeks to answer an assessment question, it takes some time for the student to read the question and arrive at an answer to submit. If multiple attempts are allowed, and the first answer is incorrect, it takes some time to provide a second answer. Here we study the distribution of such "response times." We find that the log-normal statistical model for such times, previously suggested in the literature, holds for online courses. Users who, according to this model, tend to take longer on submits are more likely to complete the course, have a higher level of engagement, and achieve a higher grade. This finding can be the basis for designing interventions in online courses, such as MOOCs, which would encourage "fast" users to slow down. △ Less

Submitted 5 February, 2020; v1 submitted 23 January, 2018; originally announced January 2018.

Journal ref: Journal of Learning Analytics, 2019, Volume 6(3), 76-89