scholarly journals Evaluation of Online Information in University Students: Development and Scaling of the Screening Instrument EVON

2020 ◽  
Vol 11 ◽  
Author(s):  
Carolin Hahnel ◽  
Beate Eichmann ◽  
Frank Goldhammer

As Internet sources provide information of varying quality, it is an indispensable prerequisite skill to evaluate the relevance and credibility of online information. Based on the assumption that competent individuals can use different properties of information to assess its relevance and credibility, we developed the EVON (evaluation of online information), an interactive computer-based test for university students. The developed instrument consists of eight items that assess the skill to evaluate online information in six languages. Within a simulated search engine environment, students are requested to select the most relevant and credible link for a respective task. To evaluate the developed instrument, we conducted two studies: (1) a pre-study for quality assurance and observing the response process (cognitive interviews of n = 8 students) and (2) a main study aimed at investigating the psychometric properties of the EVON and its relation to other variables (n = 152 students). The results of the pre-study provided first evidence for a theoretically sound test construction with regard to students’ item processing behavior. The results of the main study showed acceptable psychometric outcomes for a standardized screening instrument with a small number of items. The item design criteria affected the item difficulty as intended, and students’ choice to visit a website had an impact on their task success. Furthermore, the probability of task success was positively predicted by general cognitive performance and reading skill. Although the results uncovered a few weaknesses (e.g., a lack of difficult items), and the efforts of validating the interpretation of EVON outcomes still need to be continued, the overall results speak in favor of a successful test construction and provide first indication that the EVON assesses students’ skill in evaluating online information in search engine environments.

2020 ◽  
Vol 20 (1) ◽  
Author(s):  
Trustsavin Lohanan ◽  
Thanakorn Leesawat ◽  
Tinakon Wongpakaran ◽  
Nahathai Wongpakaran ◽  
Nuntaporn Karawekpanyawong ◽  
...  

Abstract Background The screening instrument for borderline personality disorder (SI-Bord) consists of a 5-item self-reported questionnaire on the key features of BPD from the DSM-5 using a 5-point Likert scale. This study investigated its validity and reliability in screening for BPD in university students. Methods A cross-sectional study was conducted on a sample of university students in Thailand between November and December 2019. An online assessment gathered demographic data and results from the SI-Bord, the Perceived Stress Scale-10 (PSS-10) and the Patient Health Questionnaire-9 (PHQ-9). Participants whose SI-Bord scores were ≥ 1 were randomly selected to be interviewed and assessed for a BPD diagnosis by four psychiatrists using the Structured Clinical Interview for DSM-IV Axis II Personality Disorders (SCID-II) as a reference point. An intraclass correlation coefficient (ICC) of 0.925 (95% CI, 0.805–0.979) ensured inter-rater reliability between the four psychiatrists. The diagnostic sensitivity and specificity of the SI-Bord, as compared to that of the SCID-II, were determined to indicate the cut-off score. The Receiver Operating Characteristics (ROC) was analyzed to evaluate its diagnostic accuracy. Results The study included 342 students aged 18–25 years (the mean age was 20.25 ± 1.4 years), 80.4% of whom were female. Among the 68 participants selected for an online interview, 16 were diagnosed with BPD. The cut-off score of the SI-Bord was > 9, as suggested by the Youden index, yielding a sensitivity of 56.3% and a specificity of 92.3%. It had a positive predictive value of 69.2% and negative predictive value of 87.3%. The SI-Bord had adequate discriminative power between cases and non-cases of BPD, with the area under the ROC curve being 0.83. Cronbach’s alpha for the SI-Bord was 0.76, indicating acceptable internal consistency. The SI-Bord score was positively correlated to PHQ-9 and PSS-10 scores (r = 0.67 and r = 0.69, p < 0.001, respectively) and negatively correlated to MSPSS (r = − 0.50, p < 0.001). The prevalence of BPD in the sample was 6.4%, according to the cut-off score > 9. Conclusion The SI-Bord demonstrated good reliability and validity for screening BPD in university students. However, a study in non-Thai and other population groups should be warranted.


Author(s):  
Qing Ma

Language learners can now access language learning information anywhere and anytime with handheld mobile devices connected to unlimited online information. Searching the meaning of unknown language items encountered online may be the first step for language learning to take place. Making good use of e-dictionaries and dictionary apps is a key factor that affects learning efficiency. Using a survey questionnaire completed by more than 200 participants and examining both quantitative and qualitative data, this study investigated how Hong Kong university L2 learners make use of dictionary apps and probed into what dictionary functions they actually use and what functions they desire when they engage in MALL. Four categories of dictionary functions, including lexical information, extra resources, lexical tutors, and lexical tools, are used to describe all dictionary functions that students accessed or desired. The results show that dictionary apps have become essential tools for Hong Kong university students to learn an L2 as well as facilitate their academic studies; bilingual dictionaries with multiple functions and rich resources are meaning decoders that help students engage in learning both in their subject courses and English learning. Some discrepancies exist in learners' actual use and desired use of dictionary functions, which deserve the further attention of both app developers and language teachers to improve learners' efficiency of vocabulary learning. In addition, teachers play an important role in guiding students' lexical learning. Based on the findings, a framework for understanding Hong Kong university students' choice and use of dictionary apps is provided, based on which implications are offered and discussed.


Author(s):  
Hengki Tamando Sihotang

Online information needs have evolved in the real direction. These needs include the latest information, government services, and commercial products. The research question is how to describe and optimize keyword research with the allintitle technique on the google search engine. The development method used in this research is the prototype method because it is considered able to be evaluated directly on the user. The system testing is done for 3 months by placing keywords on several websites on Google. The conclusion that can be taken is to use the allintitle technique, the search results for the web are easier to find. And this web-based allintitle technique can overcome the challenges of captcha verification from the Google search engine.   Keywords: Allintitle, Google's Search Engine, Keyword competition.


2006 ◽  
Vol 24 (18_suppl) ◽  
pp. 6086-6086
Author(s):  
F. Meric-Bernstam ◽  
M. Walji ◽  
D. Sagaram ◽  
S. Sagaram ◽  
C. W. Johnson ◽  
...  

6086 Introduction: Cancer patients and oncologists are increasingly using the Internet. Online information is affecting patient decisions regarding treatment. Therefore, multiple organizations published advice on how to screen out problematic information online. In the present study, we sought to determine whether existing quality assessment tools can screen out false or inaccurate breast cancer information online. Methods: Using 15 representative search queries on five popular search engines and only the first page of results, we generated a list of 1,585 Web pages. After eliminating irrelevant, broken and duplicate links 343 unique web pages were downloaded and evaluated for website characteristics, information accuracy and 15 quality criteria: authorship identified, author credentials identified, physician credentials stated, author affiliation stated, sources clear, general disclosures, attribution/references provided, disclosure of ownership, date created displayed, date of last update displayed, date of creation or last updated displayed, editorial process stated, internal search engine present, feedback mechanism provided and copyright notice. Quality criteria were evaluated by an independent evaluator blinded to the accuracy information. Accuracy was determined independently by a pair of clinically trained evaluators. Results: Of 343 pages evaluated, 41 false/misleading statements were displayed on 18 distinct pages. The presence of an internal search engine was correlated most strongly (r = .196, r2 = .038) with health information accuracy. However, all quality criteria (alone or in combinations tested exhaustively) were linearly associated with less than 7% of the variance in number of inaccuracies per website. Conclusion: Currently available technical quality criteria do not identify false or misleading online information about breast cancer. At this time, directing patients to websites with known content appears to be the only way to ensure patients will not encounter false or misleading online information. No significant financial relationships to disclose.


2010 ◽  
Vol 55 (2) ◽  
pp. 374-386
Author(s):  
Joan Miquel-Vergés ◽  
Elena Sánchez-Trigo

The use of the Internet as a source of health information is greatly increasing. However, identifying relevant and valid information can be problematic. This paper firstly analyses the efficiency of Internet search engines specialized in health in order to then determine the quality of the online information related to a specific medical subdomain like that of neuromuscular diseases. Our aim is to present a model for the development and use of a bilingual electronic corpus (MYOCOR), related to the said neuromuscular diseases in order to: a) on one hand, provide a quality health information tool for health professionals, patients and relatives, as well as for translators and writers of specialized texts, and software developers, and b) on the other hand, use the same as a base for the implementation of a search engine (using keywords and semantics), like the ASEM (Federación Española Contra las Enfermedades Neuromusculares) search engine for neuromuscular diseases.


Author(s):  
Oleg Tarnopolsky ◽  
Marina Kabanova

The article analyzes using Content and Language Integrated Learning (CLIL) for teaching one of the optional humanities disciplines to Ukrainian university students of different majors. The discipline discussed in the article as an example of using CLIL methodology is “The Fundamentals of Psychology and Pedagogy” and it is in the list of optional humanities subjects for the first-year students of Alfred Nobel University in Dnipro, Ukraine. However, unlike the other optional humanities disciplines, the methodology underlying this course is based on teaching the subject in English, instead of Ukrainian, following the CLIL approach widely used in the European education but still little known in Ukraine. The purpose of the paper is to expose and analyze the original methodology developed that conditioned the specific structure of the relevant course, and the specific learning activities used in it. The essence of the developed CLIL theory-based methodology and its practical application are manifested through learning activities that include students’ mini-lectures/workshop-type presentations, brainstorming, case-studies, discussions, and a learning project with its results summarized in students’ essays, abstracts, and summaries written in English. The students collect the information required for completing their tasks not only from the teacher’s lectures and the recommended literature but also (and mostly) by way of doing extensive Internet-search on psychological and pedagogical sites in English. All this makes CLIL in the case under discussion experiential-interactive (through personal experience in extra-linguistic subject-related activities gained in interaction with other students), blended (with the organic combination of traditional in-class learning and out-of-class online information search), autonomous (students’ autonomous learning activities-centered), and cooperative (with those activities being done in students’ cooperative interaction). As the result, students mostly self-construct their knowledge of the discipline by way of using the target language as the tool for such self-construction. This makes the elaborated course a clear-cut case of constructivism in CLIL pedagogy. Subject Classification Numbers: PACS 01.40.-d (Education)


2021 ◽  
Vol 1 (1) ◽  
pp. 29-35
Author(s):  
Ismail Majid

Abstrak Sistem Pencarian merupakan aplikasi penting diterapkan pada sebuah media informasi online, namun sejak hadirnya mesin pencari seperti Google orang lebih suka menggunakan alat ini untuk menemukan informasi. Karena metode pencarian yang digunakan terbukti keandalannya. Apakah kita mampu seperti itu? Penelitian ini membuktikan bahwa dengan menerapkan metode Google Custom Search API, kita dapat membangun sistem pencarian layaknya seperti mesin pencari Google, hasil pengujian menunjukkan hasil pencarian yang ditampilkan sangat relevan dan rata-rata berada pada peringkat pertama. Keuntungan lainnya metode ini dilengkapi koreksi ejaan salah untuk menyempurnakan kata kunci sebenarnya.   Abstract Search system is an important application applied to an online information media, but since the presence of search engines like Google, people prefer to use this tool to find information. Because the search method used is proven to be reliable. Are we able to be like that? This research proves that by implementing the Google Custom Search API method, we can build a search system like Google's search engine, the test results show that the search results displayed are very relevant and on average are ranked first. Another advantage of this method is that it includes incorrect spelling corrections to perfect the actual keywords.


2021 ◽  
Vol 31 (Supplement_3) ◽  
Author(s):  
R Rosário ◽  
C Augusto ◽  
MJ Silva ◽  
S Martins ◽  
A Duarte ◽  
...  

Abstract Background Worldwide there is an overwhelming amount of information about COVID-19 circulating online, also named infodemic. Misinformation (the unintentional) and disinformation (the intentional) spreading of false information have proven to be very dangerous to public health. Hence, more than ever, people need skills for searching, evaluating and integrating information related to health in daily life, i.e., health literacy. Until now, little is known about the digital health literacy of university students and their information-seeking behaviour. Hence, this study aimed to analyse the associations between university students' digital health literacy and online information queries during the beginning of the COVID-19 pandemic (and infodemic) in Portugal. Methods A cross-sectional study of 3.084 Portuguese university students (75.7% females), with an average age of 24.2 (SD = 7.5), was conducted using an online survey. We used sociodemographic data (sex, age, subjective social status) and the digital health literacy questionnaire adapted to the specific COVID-19 context. Online information queries included the topics related to SARS-CoV-2 and COVID-19 searched by students. Logistic regression models were performed. Results Online information queries (e.g., individual measures to protect against infection, current spread of the virus, current situation assessments and recommendations) were associated with an increased odds of achieving sufficient digital health literacy. Conclusions Online information queries related to epidemiological and public health topics are significantly associated with digital health literacy in times of COVID-19. Further studies are needed, including programs that improve digital health literacy among university students and increase the availability of high-quality content information.


2020 ◽  
Author(s):  
Kevin Dadaczynski ◽  
Orkan Okan ◽  
Melanie Messer ◽  
Angela Y. M. Leung ◽  
Rafaela Rosário ◽  
...  

BACKGROUND Digital communication technologies play an important role in governments’ and public health authorities’ health communication strategies during the COVID-19 pandemic. The internet and social media have become important sources of health-related information on the coronavirus and on protective behaviours. In addition, the COVID-19 infodemic spreads faster than the coronavirus itself, which interferes with governmental health-related communication efforts. This puts national public health containment strategies in jeopardy. Therefore, digital health literacy is a key competence to navigate coronavirus-related information and service environments. OBJECTIVE This study aimed to investigate university students’ digital health literacy and online information seeking behaviours during the early stages of the coronavirus pandemic in Germany. METHODS A cross-sectional study among N=14,916 university students aged ≥18 from 130 universities across all sixteen federal states of Germany was conducted using an online survey. Along with sociodemographic characteristics (sex, age, subjective social status) measures included five subscales from the Digital Health Literacy Instrument (DHLI), which was adapted to the specific coronavirus context. Online information seeking behaviour was investigated by examining the online sources used by university students and the topics that students search for in connection with the coronavirus. Data were analysed using univariate and bivariate analyses. RESULTS Across digital health literacy dimensions, the greatest difficulties could be found for assessing the reliability of health-related information (42.3%) and the ability to determine whether the information was written with commercial interest (38.9%). Moreover, respondents also indicated that they most frequently have problems finding the information they are looking for (30.4%). When stratified according to sociodemographic characteristics, significant differences were found with female university students reporting a lower DHLI for the dimensions of ‘information searching’ and of ‘evaluating reliability’. Search engines, news portals and public bodies’ websites were most often used by the respondents as sources to search for information on COVID-19 and related issues. Female students were found to use social media and health portals more frequently, while male students used Wikipedia and other online encyclopaedias as well as YouTube more often. The use of social media was associated with a low ability to critically evaluate information, while opposite differences were observed for the use of public websites. CONCLUSIONS Although digital health literacy is, in summary, well developed in university students, a significant proportion of students still face difficulties with certain abilities to deal with information. There is need to strengthen the digital health literacy capacities of university students using tailored interventions. Improving the quality of health-related information on the internet is also key. CLINICALTRIAL


Sign in / Sign up

Export Citation Format

Share Document