Lessons Learnt from Experiments on the Ad Hoc Multilingual Test Collections at CLEF

2019 ◽  
pp. 177-200 ◽  
Author(s):  
Jacques Savoy ◽  
Martin Braschler
Keyword(s):  
Ad Hoc ◽  
Test Collections ◽  
Lessons Learnt

Report on CLEF 2019

2019 ◽  
Vol 53 (2) ◽  
pp. 108-118
Author(s):  
Martin Braschler ◽  
Linda Cappellato ◽  
Fabio Crestani ◽  
Nicola Ferro ◽  
Gundula Heinatz Bürki ◽  
...  
Keyword(s):  
Standard Test ◽  
Future Perspectives ◽  
Research Papers ◽  
Test Collections ◽  
Lessons Learnt ◽  
Wide Range ◽  
The Future ◽  
20Th Anniversary

This is a report on the tenth edition of the Conference and Labs of the Evaluation Forum (CLEF 2019), held from September 9--12, 2019, in Lugano, Switzerland. CLEF was a four day event combining a Conference and an Evaluation Forum. The Conference featured keynotes by Bruce Croft, Yair Neuman, and Miguel Martínez, and presentation of peer reviewed research papers covering a wide range of topics in addition to many posters. The Evaluation Forum consisted to nine Labs: CENTRE, CheckThat, eHealth, eRisk, ImageCLEF, LifeCLEF, PAN, PIR-CLEF, and ProtestNews, addressing a wide range of tasks, media, languages, and ways to go beyond standard test collections. CLEF 2019 marked the 20th anniversary of CLEF, which was celebrated with a dedicated session and a book on the lessons learnt in twenty years of evaluation activities and the future perspectives for CLEF. CLEF 2019 also introduced the Industry Days to further extend the reach and impact of CLEF.

Evaluating and Enhancing Contextual Search with Semantic Similarity Data

2011 ◽  
pp. 163-182
Author(s):  
Ana Gabriela Maguitman ◽  
Carlos M. Lorenzetti ◽  
Rocío L. Cecchini
Keyword(s):  
Performance Evaluation ◽  
Semantic Similarity ◽  
Ad Hoc ◽  
Evaluation Framework ◽  
Digital Information ◽  
Test Collections ◽  
Similarity Data ◽  
Ad Hoc Retrieval ◽  
Traditional Approaches ◽  
Search Systems

Performance evaluation plays a crucial role in the development and improvement of search systems in general and context-based systems in particular. In order to evaluate search systems, test collections are needed. These test collections typically involve a corpus of documents, a set of queries and a series of relevance assessments. In traditional approaches users or hired evaluators provide manual assessments of relevance. However this is difficult and expensive, and does not scale with the complexity and heterogeneity of available digital information. This chapter proposes a semantic evaluation framework that takes advantages of topic ontologies and semantic similarity data derived from these ontologies. The structure and content of the Open Directory Project topic ontology is used to derive semantic relations among a massive number of topics and to implement classical and ad hoc retrieval performance evaluation metrics. In addition, this chapter describes an incremental method for context-based retrieval, which is based on the notions of topic descriptors and topic discriminators. The incremental context-based retrieval method is used to illustrate the application of the proposed semantic evaluation framework. Finally, the chapter discusses the advantages of applying the proposed framework.

Committees: Standing and Ad Hoc

1965 ◽  
Vol 1 (3) ◽  
pp. 68-68
Keyword(s):  
Ad Hoc

Die COVID-19-Pandemie im akutstationären Setting aus Sicht von Führungspersonen und Hygienefachkräften in der Pflege

Pflege ◽  
2020 ◽  
Vol 33 (5) ◽  
pp. 289-298
Author(s):  
Katharina Silies ◽  
Angelika Schley ◽  
Janna Sill ◽  
Steffen Fleischer ◽  
Martin Müller ◽  
...  
Keyword(s):  
Ad Hoc ◽  
Qualitative Studie ◽  
Skill Mix ◽  
Task Forces

Zusammenfassung. Hintergrund: Die COVID-19-Pandemie ist eine Ausnahmesituation ohne Präzedenz und erforderte zahlreiche Ad-hoc-Anpassungen in den Strukturen und Prozessen der akutstationären Versorgung. Ziel: Ziel war es zu untersuchen, wie aus Sicht von Führungspersonen und Hygienefachkräften in der Pflege die stationäre Akutversorgung durch die Pandemiesituation beeinflusst wurde und welche Implikationen sich daraus für die Zukunft ergeben. Methoden: Qualitative Studie bestehend aus semistrukturierten Interviews mit fünf Verantwortlichen des leitenden Pflegemanagements und drei Hygienefachkräften in vier Krankenhäusern in Deutschland. Die Interviews wurden mittels qualitativer Inhaltsanalyse ausgewertet. Ergebnisse: Die Befragten beschrieben den auf die prioritäre Versorgung von COVID-19-Fällen hin umstrukturierten Klinikalltag. Herausforderungen waren Unsicherheit und Angst bei den Mitarbeiter_innen, relative Ressourcenknappheit von Material und Personal und die schnelle Umsetzung neuer Anforderungen an die Versorgungleistung. Dem wurde durch gezielte Kommunikation und Information, massive Anstrengungen zur Sicherung der Ressourcen und koordinierte Steuerung aller Prozesse durch bereichsübergreifende, interprofessionelle Task Forces begegnet. Schlussfolgerungen: Die in der COVID-19-Pandemie vorgenommenen Anpassungen zeigen Entwicklungspotenziale für die zukünftige Routineversorgung auf, z. B. könnten neue Arbeits- und Skill Mix-Modelle aufgegriffen werden. Für die Konkretisierung praktischer Implikationen sind vertiefende Analysen der Daten mit zeitlichem Abstand erforderlich.

Tests und Tools

2006 ◽  
Vol 5 (2) ◽  
pp. 68-71 ◽  
Author(s):  
Simone Kauffeld
Keyword(s):  
Ad Hoc ◽  
Non Profit

Zusammenfassung. Der FEO, der in Kooperation mit betrieblichen Praktikern entwickelt wurde, dient der Erfassung des Organisationsklimas. Er umfasst 82 Items und bildet 12 Skalen ab. Eine Stärke des FEO im Gegensatz zu ad hoc entwickelten Befragungsinstrumenten sind die Vergleichsdaten, die für Profit- und Non-Profit-Organisationen bereit gestellt werden. Kritisch diskutiert wird die theoretische Verortung, die Anwenderfreundlichkeit sowie der Nutzen der individuellen Auswertung. Die konsensuale, konvergente, diskriminante und kriterienbezogene Validierung steht aus.

Test Use in Spain, Portugal and Latin American Countries

1999 ◽  
Vol 15 (2) ◽  
pp. 151-157 ◽  
Author(s):  
José Muñiz ◽  
Gerardo Prieto ◽  
Leandro Almeida ◽  
Dave Bartram
Keyword(s):  
Latin American ◽  
Ad Hoc ◽  
Task Force ◽  
Test Construction ◽  
European Federation ◽  
Psychometric Characteristics ◽  
Testing Practices ◽  
Professional Psychologists ◽  
Test Use ◽  
Latin American Countries

Summary: The two main sources of errors in educational and psychological evaluation are the lack of adequate technical and psychometric characteristics of the tests, and especially the failure to properly implement the testing process. The main goal of the present research is to study the situation of test construction and test use in the Spanish-speaking (Spain and Latin American countries) and Portuguese-speaking (Portugal and Brazil) countries. The data were collected using a questionnaire constructed by the European Federation of Professional Psychologists Association (EFPPA) Task Force on Tests and Testing, under the direction of D. Bartram . In addition to the questionnaire, other ad hoc data were also gathered. Four main areas of psychological testing were investigated: Educational, Clinical, Forensic and Work. Key persons were identified in each country in order to provide reliable information. The main results are presented, and some measures that could be taken in order to improve the current testing practices in the countries surveyed are discussed. As most of the tests used in these countries were originally developed in other cultures, a problem that appears to be especially relevant is the translation and adaptation of tests.

Ad Hoc Reviewers 2015

2015 ◽  
Vol 31 (4) ◽  
pp. 313-314
Keyword(s):  
Ad Hoc
Sign in / Sign up

Export Citation Format

Share Document