Iryna Humeniuk
State Agrarian and Engineering University in Podilya, Ukraine
E-mail: rynahumenyuk79@gmail.com
Oksana Kuntso
State Agrarian and Engineering University in Podilya, Ukraine
E-mail:
ok.kuntso@gmail.com
Natalia Lebedieva
Vinnytsia Mykhailo Kotsiubynskyi State Pedagogical
University, Ukraine
E-mail:
nataliswon@gmail.com
Olga Osaulchyk
Vinnytsia Institute of Trade and Economics, Kyiv
National University of Trade and Economics, Ukraine
E-mail: aulolga55@gmail.com
Olha Dakaliuk
Vasyl' Stus Donetsk National University, Ukraine
E-mail:
olhadakaliuk@gmail.com
Submission:
8/7/2021
Revision: 9/13/2021
Accept: 9/23/2021
ABSTRACT
The aim of the paper is to examine the correlation of the knowledge gained by students in online and offline classes, consequently, the overall performance of e-learning, as well as the effectiveness of the certain language skills among the main four (listening, speaking, reading, writing) by virtue of students’ feedback and objective experimental results using statistical methods data processing. The paper demonstrates the results of the e-learning experimental research conducted during the academic year 2020/21, including the remote learning period due to the Covid19 pandemic situation in the spring semester, at the State Agrarian and Engineering University in Podilya, Kamianets-Podilskyi, Ukraine. Online study support for ESP was personally created as a four-credit course due to ECTS in the Moodle Learning Management System (LMS) with the application of Big
Blue Button. The research sample is represented by 100 students majoring in veterinary medicine and enrolled in the mandatory subject of English for Specific Purposes. The group of students was enrolled in the lessons based on their bachelor curriculum. The subjects, referred to as experimental and control groups, accordingly, both wrote the primary test, at the beginning of the course, and the final one at the end. For pre-test content, the online standard test for B1 level was applied. The post-test was created by the educators, who were involved in the experiment. Due to the results procession and test analysis, it is admitted that the students of the experimental group showed slightly worse results in listening comprehension section, while having the same indicators concerning writing skills, and they had essentially worse outcomes in speaking and reading comprehension if compared to their peers from the control group. Mann-Whitney and Wilcoxon non-parametrical pair tests were selected to check the statistical hypotheses, due to the character of input data.
Keywords: ESP; Moodle; e-learning; primary test; final test; questionnaire analysis
1.
INTRODUCTION
Nowadays E-learning, highly
dependent on transformations within the internet, becomes a crucial part of the
conventional educational process. This enables learners to gather knowledge,
both synchronously and asynchronously, to successfully meet the urgent
requirement to acquire practical knowledge and skills within educational and
productive environments. That is, in e-learning the content is delivered via
electronic information and communications technologies (ICTs) (Oye, Salleh & Iahad, 2012,
p.50).
It should be noted there has been
used a number of terms denoting e-learning, such as Internet learning,
tele-learning, and telematics distributed learning, network learning, etc.
(Bates, 2005).
In our research, we will stick to
the term e-learning as the widest one covering all methods and tools of digital
education.
The article is dedicated to the
results processing of the e-learning experimental research conducted during the
academic year 2020/21 on the lessons of English for Specific Purposes (ESP)
(with students of Specialty 211 “Veterinary Medicine”) at the State Agrarian
and Engineering University in Podilia, Ukraine. The
tested period included a completely remote learning time of the spring semester
(due to the Covid19 pandemic situation). Online study support for ESP was
personally created as a four-credit educational course on the Moodle Platform
which was appropriate for students of B1 language level, using the Big Blue
Button application for speaking skills evaluation.
The research sample is represented
by 100 students majoring in veterinary medicine and enrolled in the mandatory
subject of English for Specific Purposes. Formerly,
the respondents were students of 6 subgroups with two educators,
conventionally divided into 2 groups as being taught by the same educator due
to the same curriculum. One teacher worked with 3 subgroups separately using
the exact learning material and tools for each subgroup predominantly offline
(the control group), while the other 50 students were taught by the different
educator with online learning application (the experimental group). The full
ESP course was a yearlong, the first semester – was predominantly offline
education with open access to Moodle, while the second semester was completely
online just for the experimental group but the last credit class which was
face-to-face. The group of students was enrolled in the lessons based on their
bachelor schedules.
The aim of the experiment and the objective of
the current paper is to analyze the expediency of Moodle application for ESP
class, to evaluate the efficiency of online education
if compared to the offline one. Admittedly, only students from the
experimental group were engaged in fully online education, while the students
of the control group had a blended learning semester.
At the final stage of the experiment, the learners were suggested to fill in
the questionnaires on the effectiveness of e-learning education. The
questionnaires consisted of 5 evaluating questions concerning e-learning study in general and mastering every single language skill
separately.
Ethical principles such as freewill
participation, informed consent (all students were warned about the experiment,
its stages, and consequences and agreed to participate), objectivity and
justice, anonymity, and confidentiality were fully accomplished in the
research.
2.
LITERATURE REVIEW
Analyzing some recent papers
connected with the topic of our research, we have concentrated on the following
items: ICT, ESP, e-learning, lifelong learning, blended learning, remote
learning, and e-learning efficacy. The research outcomes of e-learning applied
for ESP teaching can find confirmation in thesis and dissertations, conference
proceedings indexed in Scopus and WoS databases, etc.
It should be noted that currently,
the number of studies on the abovementioned subjects has increased
significantly in the European and Ukrainian environment due to the situation
the whole world exists in right now (Hurevych, Kademiia & Koziar, 2011).
That is why this problem seems to be international and global, not limited to
certain communities or countries. This is the challenge provoked by Covid 19 we
have to deal with all over the world.
Thus, various prominent scientists
studied peculiarities of teaching EFL, namely Flowerdew and Miller (2014);
distance learning challenges, Bates (2021), Knysh and
Dudziak (2020), Humeniuk
(2021); e-learning environment in education, Hamburg
and Lindecke (2003), Liu et al. (2010), Donesch-Jezo and Misztal
(2012), Roliak
(2019); the nature of listening, Derrington and Groom
(2004), Donesch-Jezo
and Misztal (2012); methods, and tool of
teaching the language acquisition skill, Byrne (2007), Chaikovska,
Zbaravska and Bilyk (2019),
Oye, Salleh and Iahad (2012);
etc. Some of the abovementioned papers influenced greatly the current research
and therefore need deeper analysis.
Studying Virtual Learning
Environment (VLE), Oproiou and Chicioreanu
stated that different platforms have been recently used in lots of universities
and are rather complicated and not easy to manage (Oproiou
& Chicioreanu, 2012).
Roliak
(2019), a Ukrainian scientist, thoroughly analyzed the process of information
and communication technologies implementation in the teacher education system
of Nordic countries and their influence on the Ukrainian dimension (Roliak, 2019). The researcher applied a comparative
analysis of the key development stages of the ICT in the systems of teachers’
professional training in Scandinavia, namely Denmark, Finland, Norway, and
Sweden, which keep the lead in this field globally, concerning the positive
effect of Information and Communication Technologies on education and society
(p.258). The mentioned countries are also experienced in reforming the relevant
elements of teacher education with the concern of the extensive use of
information and communication technologies.
According to Roliak (2019), Nordic innovation and digital literacy
capacity are highly dependent on progress simultaneously taking place in both,
applying ICT in the system of professional teacher training and current rapid
technology growth, widespread of informatization, priority to multi-skills
development in the region of Scandinavian countries. Consequently, the
following stages of ICT implementation in the Scandinavian sphere of education
were verified: induction (or introductory) stage, stage of infusion (or partial
use), and incorporation (or systematic integration) stage. And each of the
mentioned stages is distinguished by the key alike and contrasting regulations
inherent to the Nordic pedagogical environment in concern to the information
technologies application (Roliak, 2019). Though the
findings of the research conducted by Roliak (2019)
are mainly focused on teacher education, they can significantly contribute to
applying the information and communication technologies into the Ukrainian
education system in general 9 (p.258).
The problem of e-learning can be
also traced in the paper by Chaikovska, et al.
(2019), where the authors investigated the current e-learning process, using
podcasts particularly, at the Engineering Faculty of the State Agrarian and
Engineering University in Podilia, having conducted
and analyzed the pedagogical experiment engaging 50 first-year students, majoring
in “Electrical Engineering” (p.1915). The research was focused on speaking and
listening comprehension evaluation with the help of a quasi-experiment,
applying two evaluation tests at the beginning of the course, and at the end,
respectively, and a questionnaire, designed by the authors of the paper.
The study, aiming at investigating
the podcasts’ practicability for students’ improving their listening
comprehension and speaking performance, showed that the students of the
experimental group achieved way better results. The learners, involved in the
experiment, demonstrated enthusiasm while working with the engineering podcasts
and approved this kind of IC technology to be capable of improving their
professional conversational skills, explaining pronunciation and dialect
varieties, facilitating social engagement and self-education. Thereby,
professional podcasts can be recommended for teaching ESP to students of
agricultural universities (Chaikovska, Zbaravska & Bilyk, 2019).
The advantages and drawbacks of
distance learning were described in the research by Humeniuk
et al. (2021). The author analyzed different
platforms to be used while remote learning and distinguished their pluses and
minuses (Humeniuk et al., 2021).
Social aspects of e-learning and
combining different learning methods were analyzed by Hamburg and Lindecke (2003). Due to the researchers, it is consequently
crucial to “blend” different means and approaches of pedagogical science (e.g.,
constructivism, behaviorism, cognitivism), various modes of learning in both
online (e.g., web-based ones) and offline classrooms, and independent and joint
training for producing an optimal learning outcome. According to the authors,
it is necessary to mix instructional technology with certain job assignments
for balancing learning and working.
They stated some advantages
concerning blended learning: organizations are gradually changing the students’
educational environment - from school classrooms to e-learning at home, trying
to make these changes easier to accept, and supplementing or complementing
available learning tools and materials (usually high-priced) rather than
replacing them; trainers and tutors uploading little segments of their
materials to the Internet and gradually developing the skills required for
e-learning; learners are choosing an education method that suits their
abilities, goals, and preferences (Hamburg & Lindecke,
2003).
In this study, we also consider the
research on developing ESP e-learning course for medical university students,
namely therapeutic professionals, conducted by Donesch-Jezo
and Misztal (2012). The authors (Donesch-Jezo
& Misztal, 2012) thoroughly elaborate on content,
development stages, and kinds of interactive tasks. The latter together with
computer-assisted exercises, foreseen within the course, contribute to
interactive language acquisition, in which the role of the teacher is reduced
exclusively to educational process management and learners' progress assessment
(Donesch-Jezo & Misztal,
2012).
The educational process in Ukrainian
agricultural institutions, facing the COVID-19 challenges, was analyzed by Knysh and Dudziak (2020). The
scholars underlined the need to review the existing teaching and learning
strategies. This significant and much-needed transformation also means moving
from declarative statements to achievable goals and short-term priorities.
Thus, exposing problems can be an impetus for radical solutions. Today's
challenges will not stay here for just a few weeks, as they will be followed by
major economic challenges.
The experience gained under the new
conditions is a prerequisite for rapid adaptation to the requirements of the
agricultural sector. Improving the quality of higher agricultural education
will help increase the efficiency of agricultural production in one of the key
sectors of the Ukrainian economy. This, in turn, is crucial to the global
challenges governing the impact of the epidemic, as well as the economic crisis
(Knysh & Dudziak, 2020,
p.166).
Despite many papers written on the
subject in Ukraine and abroad, there are so many issues to be covered as
technology and education are growing so rapidly and therefore the learning
process has to be up-to-date, always engaging modern and technological tools
for achieving educational goals and meeting the societies’ requirements.
The current paper aims to analyze
the interdependence of the knowledge students obtained via online and offline
classes, therefore the general productivity of e-learning, as well as the
efficiency of every single language skill among the basic four (listening,
speaking, reading, writing) due to the students’ feedback and objective results
of the experiment, with statistical methods of data processing application.
3.
METHODOLOGY
Present researches in education
cannot do without the implementation of various research methods. Currently,
mixed methods are considered to be the best choice for researches in education
and pedagogics (Halcomb & Hickman, 2015).
Thus, to conduct a full-fledged
study and obtain objective results, qualitative and quantitative (Bryman,
2006), including statistical (for processing test results when checking the
achievements of language skills acquisition) were used.
The
research endeavor and analysis of the problem were carried out simultaneously
due to the research aim in the following forms:
· a descriptive method for analyzing
the result of students' pre- and post-tests, surveys, and general research
results;
· experiment as a targeted observation
for analyzing the achievements and success of students in acquiring language
skills.
The content for the pre-test was
taken from the site
https://learnenglish.britishcouncil.org/online-english-level-test, which is
quite a standard test to check the level of language competence. The content of
the post-test was selected by the educators considering the educational
material had been covered and previously discussed in the department of foreign
languages of the university.
Thus, the final test involved 4
sections: listening, writing, reading, and speaking respectively. Each section
consisted of 3 tasks of different types including covered lexical and
grammatical material. All the students’ results were entered into the charts
previously processed into a percentage. These procedures were performed using
quantitative research methods, while it is sharply recommended to use
statistical analysis methods to obtain objective results (McLeod, 2019).
Thus, making the comparison of
online and offline knowledge perception, the need to figure out the
distributions of both data sources arises. For this purpose, the statistical
significance tests (Brownlee, 2019), quantifying the likelihood that the
samples have the same distribution, were applied.
Mann-Whitney and Wilcoxon
non-parametrical pair tests were selected to check the statistical hypotheses,
due to the character of input data. Wilcoxon pair test was used for the
dependent samples (the primary and final tests within the same group). For
testing independent samples - the primary and final tests within separate
groups consequently Mann-Whitney test (U statistic) is applied foremost
(Sharpe, De Veaux & Velleman, 2010). The tests
were performed at the standard significance level α = 0.05, which is typically used in
statistics (Kucirkova et al., 2014, p.84). The
program Statistic 10 was applied for the calculation.
The results in the primary and final
tests were compared for the control and experimental group independently so
that it was probable to deduce if the differences considerable for the
statistics in individual skills occurred and to check the level of students’
success within the examined groups.
After that, the outcomes in the primary and final tests of definite skills among both groups were compared and analyzed to inquire the effectiveness of the e-learning method and discover the statistically considerable evidence in both groups’ outcomes. To get some feedback from students the questionnaire (survey) was performed on the final stage of the experiment. The questionnaires involved five questions about personal attitude to the e-learning process and its constituents. The data processing was done by the educators themselves.
4.
RESULTS
Four basic skills for language
learning were checked and analyzed during the experiment: listening, speaking,
reading, and writing.
|
The primary and final test |
P-value |
Comments |
Skills |
Listening |
0,000000 |
The index of
P-value is considered to be lower than the significance level. A statistically
considerable contrast is found between the primary and the final tests.
Students succeeded a lot in mastering listening skills. |
Speaking |
0.021960 |
P-value is
under the significance level. The distinction between the primary and the final
tests is statistically essential. Students increased the vocabulary level a
bit. |
|
Reading |
0.000013 |
Due to the
p-value indicator, the variation between the tests is statistically
essential. The subjects highly increased their reading comprehension skills. |
|
Writing |
0.029194 |
The level of
significance is higher than the obtained p-value, thus a statistically
considerable contrast exists between the primary and the final tests.
Therefore, the subjects slightly improved their writing skill. |
|
Totally |
0.000000 |
The indicator
of p-value proves statistically essential distinction between total results
in the primary and the final tests. Generally, the subjects succeeded
greatly. |
|
The primary and final test |
P-value |
Comments |
Skills |
Listening |
0.000003 |
As the p-value
index is under the required 0.05 index, the
statistically essential distinctions between the primary and the final test
are observed concerning listening
comprehension. Students improved a lot. |
Speaking |
0.000240 |
The index of
p-value is lower than 0.05 index. Thus, a
statistically essential distinction is evident while comparing the primary
and the final tests. The subjects enhanced greatly in the awareness of
professional lexis. |
|
Reading |
0.000051 |
Learners demonstrated
an advance in reading comprehension. The distinction between the primary and
final tests is statistically essential. |
|
Writing |
0.019239 |
The index of
p-value is lower than the significant one so the statistically essential distinctions
are characteristic for writing. The subjects succeeded not particularly. |
|
Totally |
0.000000 |
Students
succeeded greatly. Due to the p-value, the difference between the primary and
final tests is statistically essential. |
Due to Figure 1, every p-value
indicator in tests is lower than 0.05 point, which is
the necessary significance level. Hence, having analyzed the students’
improvements in the experimental and control groups, the distinctions between
tested skills of ESP at the primary research stage and the final one, are
statistically essential in both cases.
To evaluate the results a
non-parametrical analog to the parametric two-sample T-test
was applied. There were not any statistically essential distinctions in
single skills while doing primary tests. The subjects had almost equal results.
Also, totally there were not any statistically essential discords.
Primary tests |
Final tests |
||||
Skills |
p-value |
comments |
skills |
p-value |
comments |
Listening |
0.086470 |
Statistically, essential contrast is absent
between the groups, although students of the experimental group had a bit
better result. |
Listening |
0.043689 |
Due to the low p-value, the groups' difference in
listening comprehension is statistically essential. The
experimental group showed a better result. |
Speaking |
0.446861 |
The difference between both groups in their
results is statistically insignificant, although students of the experimental
group had a little better result. |
Speaking |
0.338342 |
Both groups’ results are almost equal, with a
statistically insignificant difference between the results. |
Reading |
0.221575 |
Statistically, essential contrast is absent between two groups in
their outcomes |
Reading |
0.131053 |
Both groups’ results are almost equal, with a statistically
insignificant difference between the results. |
Writing |
0.887681 |
The difference between both groups in their results is statistically
insignificant. |
Writing |
0.906610 |
No statistically essential discords in the groups’ outcomes. |
Totally |
0.716381 |
At the beginning of the spring semester, there were not any
statistically essential differences between the groups. The experimental
group was a bit better but not statistically significant. |
Totally |
0.823319 |
At the end of the spring semester, the differences in the final test
results of both groups were statistically unimportant |
Thus, as it is obvious from the
Table 3, the two groups’ overall scores in the final tests are similar. It can
be stated that the e-learning method is as efficient as the traditional offline
method. The only difference among groups can be observed in obtaining listening
skills. As for the rest skills, the differences in compared groups were
statistically insignificant.
Generally, the diapason of p-value
indicators from 0.05 to 0.75 testifies a minor distinction between tested
groups, while p-values higher than 0.75 do not indicate any contrast.
The data processing is grounded on
statistical calculation. The aim of the questionnaires, given to the subjects,
was to express a personal opinion on the appropriateness of the e-learning
inclusion into ESP classes within the remote studying period and the efficacy
of e-learning since the language skills are concerned. 100 paper questionnaires
were suggested to the selected students (50 respondents participated in the
e-learning process) on the last offline class of spring semester 2020/2021. All
the forms were given back filled in. The obtained data were processed by the
quantitative method.
The respondents were asked 5
questions about the general expediency of e-learning and the effectiveness of
every single skill consequently. The questions, namely: 1) Do you consider
e-learning to be an effective language acquisition tool?; 2) Can your listening
skills be improved by involving e-learning means?; 3) Can your speaking skills
be improved by involving e-learning means?; 4) Can your reading skills be
improved by involving e-learning means?; 5) Can your writing skills be improved
by involving e-learning means?
The results of the questionnaire
were processed into percentages and are shown in Table 4.
|
Effectiveness
in % |
||
|
Yes |
No |
Cannot answer |
E-learning |
82% |
8% |
10% |
Listening |
90% |
5% |
5% |
Speaking |
70% |
20% |
10% |
Reading |
95% |
5% |
0% |
Writing |
70% |
15% |
15% |
Due to the questionnaire analysis,
82 (82% consequently) respondents consider e-learning to be highly productive,
10% of respondents could not answer the question, while 8% of students think it
is unproductive, mainly because of poor internet connection in their areas. It
also should be mentioned that predominantly the students not participating in
the fully online studying process answered negatively or could not answer at
all. Those respondents who took part in the experiment mostly considered it to
be effective and productive.
The subjects considered reading and
listening comprehension to be the most productive skills while learning online
while speaking and writing is a little bit problematic but not that
significantly. As far as the statistical significance is concerned, no
statistically essential contrasts characterized for both groups were
determined. The total results at the end of the semester in final tests were
equal, therefore there were no statistically essential distinctions. Moreover,
the experiment results prove that students involved in e-learning may master
some skills even better than those having offline classes.
5.
CONCLUSIONS
Thousands of schools and
universities worldwide are focusing on online learning as a precaution against
the Coronavirus COVID-19 outbreak. So, this situation with the pandemic all
over the world and the high necessity of remote studying require new priorities
alongside with flexibility of the education process, the focus on innovative
approaches to student learning, including e-learning, blended learning, remote
learning should be done.
E-learning allows students to
rearrange the learning process in accordance with their individual needs and
agenda, as it is rather flexible and therefore available. It was substantiated
and proven that Moodle provides a teacher with a range of activities and
educational tools that can be used online; tests and quizzes are immediately
assessed and analyzed, while the evaluation is fully automatic; the lesson
content can be repeated and gone over several times even using one’s mobile
device. Although some drawbacks should be mentioned – such particular skills as
speaking, for instance, are a bit problematic for mastering online without a
mentor, also some technical issues can arise.
As the experiment results showed the
students succeeded in their language skills having been involved in the online
course of ESP and gave a generally positive evaluation of the e-learning
process.
Further research is intended to
study the effect of e-learning with different modern methods and tools applied
for teaching ESP and other subjects to full-time and part-time high school
students.
REFERENCES
Bates, T. (2021). Online learning and distance education
resources. Retrieved from https://www.tonybates.ca/. Access: May 05, 2021.
Brownlee, J. (2019). Statistical methods for machine learning.
Discover how to Transform Data into Knowledge with Python. Machine
Learning Mastery Pty. Ltd.
Bryman, A. (2006). Integrating
quantitative and qualitative research: how is it done? Qualitative research, 6(1), 97-113. DOI: 10.1177/1468794106058877.
Byrne, T. (2007). Marrying two
existing software packages into an efficient online tutoring tool. Computer Assisted Language Learning,
20(5), 459-469.
Chaikovska, O., Zbaravska,
L., & Bilyk, T. (2019). Podcasts in teaching EFL
for students majoring in engineering. 18th
International Scientific Conference “Engineering for rural development”,
Latvia: Jelgava, p. 1915-1920. DOI: 10.22616/ERDev2019.18.N344.
Derrington, C., & Groom, B. (2004). Different
types of listening. Retrieved from http://www.paulchapmanpublishing.co.uk/upmdata/9772_036767pg42_45.pdf
. Access: March 05, 2021.
Donesch-Jezo, E., & Misztal, I. (2012). Developing ESP e-learning course:
How an e-learning course was created for medical university students. International Journal of Learning,
18(8), 317-324.
Ginther, A. (2002). Context and
content visuals and performance on listening comprehension stimuli. Language Testing, 19(2), 133-167.
Halcomb, E. J., & Hickman, L.
(2015). Mixed methods research. Nursing Standard, No. 29(32), 41-47. DOI: 10.7748/ns.29.32.41.e8858.
Hamburg, H., & Lindecke, C. (2003). Social aspects of e-learning and
blending learning methods. 4th EUROPEAN CONFERENCE E-COMM-LINE 2003, Bucharest.
Humeniuk, I. (2018). Modern issues
in teaching English for specific purposes. II International scientific and practical
conference “Problems of training agrarian specialists in educational
institutions of higher and vocational education”, Ternopil, 25-27.
Humeniuk,
I., Kuntso, O., Popel, N., & Voloshchuk, Y. (2021). Mastering listening comprehension at
ESP classes using TED Talks. Advanced Education, 8(17), 27-34. DOI:
10.20535/2410-8286.226733.
Hurevych, R., Kademiia,
M., & Koziar, M. (2011). Educational
information technologies: an integrated approach. Lviv: “SPOLOM”.
Knysh, O., & Dudziak,
O. (2020). Overcoming the Challenges – the Impact of COVID-19 on Agricultural
Higher Education in Ukraine. Revista
Romaneasca Pentru Educatie Multidimensionala, 12 (2Sup1), 162-167. DOI: 10.18662/rrem/12.2Sup1/302.
Oproiu, G. C.,
& Chicioreanu, T. D. (2012). Using Virtual Learning Environments in Adult Education. Scientific Research & Education in the Air
Force-AFASES,1.
Kucirkova, L., Kucera, P., Vostra Vydrova, H. (2014). English for specific purposes
e-learning experimental research. Journal on Efficiency and
Responsibility in Education and Science, 7(3-4), 80-86. DOI: 10.7160/eriesj.2014.070306.
Liu, M. et al. (2010). ‘A Look at the Research
on Computer-Based Technology Use in Second Language Learning’: Review of
Literature from 1990-2000. Retrieved from http://jabba.edb.utexas.edu/it/seclangtechrev.pdf.
Access: December 25, 2020.
McLeod, S. (2019). What a p-value tells
you about statistical significance. Simply
Psychology. Retrieved from https://www.simplypsychology.org/p-value.html.
Access: December 26, 2020.
Ockey, G. J. (2007). Construct
implications of including still image or video in computer-based listening tests.
Language Testing, 24(4), 517-537.
Oproiou, G. C., & Chicioreanu,
T. D. (2012). Using Virtual Learning Environments in Adult Education. Scientific
Research and Education in the Air Force – AFASES, 1.
Oye, N. D., Salleh, M., & Iahad, N. A. (2012). E-Learning Methodologies and Tools. International
Journal of Advanced Computer Science and Applications, 3(2), 48-52.
Renukadevi, D. (2014). The Role of Listening
in Language Acquisition; the Challenges & Strategies in Teaching Listening.
International
Journal of Education and Information Studies, 4(1), 59-61.
Reynolds, B. L., &
Anderson, T. A. (2015). Extra-dimensional in-class communications: Action
research exploring text chat support of face-to-face writing. Computers and Composition, 35, 52-64. DOI:
10.1016/j.compcom.2014.12.002.
Roliak, A. (2019). ICT
implementation in the system of teacher education: Nordic dimension. Information Technologies and Learning
Tools, 69(1), 258-267. DOI: 10.33407/itlt.v69i1.2361.
Shadiev, R., Hwang, W.-Y.,
& Huang, Y.-M. (2017). Review of research on mobile language learning in
authentic environments. Computer
Assisted Language Learning, 30(3-4), 284-303. DOI:
10.1080/09588221.2017.1308383.
Sharpe, N. R., De Veaux,
R. D., & Velleman, P. F. (2010). Business Statistics. Boston: Addison Wesley.