Register event
1 event found

Event types: Workshops and courses 


Country: Switzerland 


Content provider: ELIXIR 


City: Bogota  or Heidelberg  or Fribourg  or Basel  or Amsterdam UMC (location AMC)  or Norwich  or Utrecht  or Lund 

  • Benchmarking: Incentives and Best Practises across Scientific Disciplines - Abstracting from Established Evaluations

    12 September 2017

    Basel, Switzerland

    Benchmarking: Incentives and Best Practises across Scientific Disciplines - Abstracting from Established Evaluations The ELIXIR EXCELERATE Framework focuses on key aspects of modern research by bringing together method and infrastructure developers as well as researchers who aim to provide the scientific community with novel scientific tools, and cutting edge research results at the same time. New developments are generally benchmarked during development, with a certain composition of data and methods to benchmark against. Internal benchmarks often suffer from an incompleteness concerning both the test data and competing methods. Independent and community-driven blind benchmarks are addressing these issues and have been shown to be crucial for objectively assessing scientific methods in various communities, including substantial commitment from industry.   CASP is the prime example of community-driven benchmarking activities, with bi-annual editions from 1994. Since then, many other communities have come together to design and run their own benchmarking activities e.g. CAFA and Quest for Orthologs. The main benefit of recurring independent assessments is the task composition, which is varied from what was initially used to develop the methods. Since the tasks evolve over time, new aspects become crucial to be evaluated, reflecting current developments in the community. By being able to compare various methods on the same data set at the same point in time, new methods can prove their superiority in a much more transparent way as past individual benchmarks inherently suffer from the temporal focus on the methods available at that particular time. This workshop integrates experiences from various community-driven benchmarking efforts, illustrating key common elements. More importantly, these examples illustrate how benchmarking activities bring together to their members and foster new interactions and developments. The program comprises two main parts: (1) speakers from diverse communities reporting on successful recurring benchmarking implementations and (2) plenary discussions to identify common approaches, resulting in refined guidelines for establishing community based benchmarking. Further information for this workshop and Call for Abstracts is available at: 2017-09-12 09:00:00 UTC 2017-09-12 21:00:00 UTC University of Basel, Basel, Switzerland University of Basel Basel Switzerland [] [] [] workshops_and_courses [] []

Note, this map only displays events that have geolocation information in TeSS.
For the complete list of events in TeSS, click the grid tab.