dashboard.living-labs.net

living-labs.net

LLC’14 | Living Labs

http://living-labs.net/llc

Living Labs for IR. Living Labs Challenge workshop. 6 June, 2014, Amsterdam, The Netherlands. The aim of the workshop is to test and further develop a living labs for IR methodology and a living labs for IR platform, to be used in a community challenge. With two specific use-cases:. The documentation and details of the challenge API is available at: http:/ doc.living-labs.net/. The workshop is free and open to all interested participants, but registration is required. Registration closed on May 29. Dubli...

living-labs.net

LLC | Living Labs

http://living-labs.net/category/llc

Living Labs for IR. Results for LL4IR Round #2. The results for LL4IR Round #2 have just been made available on this page. Also, you can (still) join us at any moment! We’ll be running evaluation rounds the last two weeks of every month, please find details on our Challenge page. July 1st, 2015. Living Labs challenge workshop in Amsterdam. In preparation for the challenge. We are organising for LL’14, a dedicated Living Labs Challenge workshop. We thank the ELIAS programme. And the ILPS group.

living-labs.net

Test period begins for CLEF 2015 Lab | Living Labs

http://living-labs.net/test-period-begins-for-clef-2015-lab

Living Labs for IR. Test period begins for CLEF 2015 Lab. Today, we are officially entering into the test phase of the LL4IR CLEF 2015 Lab. There are some changes, detailed on this page. Below is an executive summary:. Only 2 of the 3 use-cases will be evaluated: product search and web search (local-domain search will not run this year). These two use-cases are fully operational; see this page. For updated technical details on the product search use-case. Click to share on Twitter (Opens in new window).

living-labs.net

LL4IR Challenge | Living Labs

http://living-labs.net/ll4ir-challenge

Living Labs for IR. We are happy to announce that our living labs platform will continue to operate as the LL4IR Challenge. The second evaluation round, using the same setup and test queries as the CLEF 2015 Lab. Will run from June 15 to 30. Note that late-breaking results from round #2 can still be included in the CLEF working notes papers. Click to share on Twitter (Opens in new window). Click to share on Google (Opens in new window). Share on Facebook (Opens in new window). May 28th, 2015.

living-labs.net

LL4IR Challenge | Living Labs

http://living-labs.net/challenge

Living Labs for IR. The Living Labs for Information Retrieval (LL4IR) Challenge provides research teams the opportunity to evaluate their systems with real users in production environments. The LL4IR CLEF 2016 Lab. Represents the 8th round of the challenge. CLEF LL4IR 2015, Round #1. May 1, 2015. May 15, 2015. Jun 15, 2015. Jun 30, 2015. July 15, 2015. July 30, 2015. Aug 15, 2015. Aug 30, 2015. Sep 15, 2015. Sep 30, 2015. Feb 15, 2015. Mar 2, 2015. Mar 15, 2015. Mar 30, 2015. CLEF LL4IR 2016, Round #8.

living-labs.net

Uncategorized | Living Labs

http://living-labs.net/category/uncategorized

Living Labs for IR. Living Labs for IR Evaluation will be running again at CLEF. September 11th, 2015. CLEF Lab Overview Paper Available. Our CLEF lab overview paper. Is now available online. Inproceedings{schuth 2015 overview,. Title = {Overview of the Living Labs for Information Retrieval Evaluation (LL4IR) CLEF Lab 2015},. Author = {Anne Schuth and Krisztian Balog and Liadh Kelly},. Year = {2015},. Date = {2015-09-08},. Booktitle = {CLEF 2015},. Publisher = {Springer},. June 29th, 2015.

living-labs.net

Funding for hosting, maintenance and development | Living Labs

http://living-labs.net/funding-for-hosting-maintenance-and-development

Living Labs for IR. Funding for hosting, maintenance and development. We just received some good news from ESF ELIAS. We received funding to host of our LL4IR API. There will also be funding to hire someone for development and maintenance of our API. So keep your ideas and bug reports coming in through our issue tracker. Stay tuned, things will be faster soon! Click to share on Twitter (Opens in new window). Click to share on Google (Opens in new window). Share on Facebook (Opens in new window).

living-labs.net

LL’13 | Living Labs

http://living-labs.net/ll13

Living Labs for IR. Workshop on Living Labs for Information Retrieval Evaluation @ CIKM 2013. 1 November, 2013, San Francisco, USA. The workshop proceedings are now available in the ACM Digital Library. Some of the presentations made at the workshop are now available, as indicated below; see Schedule. IR Evaluation: Perspectives From Within a Living Lab. Georg. Buscher, Microsoft Bing. Using CrowdLogger for In Situ Information Retrieval System. Evaluation. Henry A. Feild, James Allan. The Best Demo Award...

living-labs.net

Anne Schuth | Living Labs

http://living-labs.net/author/anne-schuth

Living Labs for IR. LiLa’16 Tutorial at ECIR’16. In Padova will feature LiLa 2016. The first edition of our tutorial on Living Labs for Online Evaluation. October 21st, 2015. Our CLEF LL4IR will have a sister running at TREC. The TREC OpenSearch. Track has been accepted. More info will follow soon, we’ll be running TREC and CLEF in parallel. October 21st, 2015. Living Labs for IR Evaluation will be running again at CLEF. September 11th, 2015. Results for LL4IR Round #3. July 31st, 2015. July 2nd, 2015.

living-labs.net

Updates to API and Website | Living Labs

http://living-labs.net/updates-to-api-and-website

Living Labs for IR. Updates to API and Website. We’ve just made some improvements to our API and website. We are deploying the API using Tornado. Now, which should give a performance boost. Errors and warnings are now kept track off using Rollbar. This will allow us to act faster when something goes wrong. If there are errors, you will receive a traceback with link to the code on bitbucket making it easier for you to understand what went wrong. Please let us know what you think! June 25th, 2015.