Workshop on Fairness, Accountability, Confidentiality, Transparency, and Safety in Information Retrieval (FACTS-IR)

@article{Olteanu2019WorkshopOF,
  title={Workshop on Fairness, Accountability, Confidentiality, Transparency, and Safety in Information Retrieval (FACTS-IR)},
  author={Alexandra Olteanu and Jean I. Garcia-Gathright and M. de Rijke and Michael D. Ekstrand},
  journal={Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval},
  year={2019}
}
This workshop explores challenges in responsible information retrieval system development and deployment. The focus is on determining actionable research agendas on five key dimensions of responsible information retrieval: fairness, accountability, confidentiality, transparency, and safety. Rather than just a mini-conference, this workshop is an event during which participants are expected to work. The workshop brings together a diverse set of researchers and practitioners interested in… 
FACTS-IR: Fairness, Accountability, Confidentiality, Transparency, and Safety in Information Retrieval
TLDR
The purpose of the SIGIR 2019 workshop on Fairness, Accountability, Confidentiality, Transparency, and Safety (FACTS-IR) was to explore challenges in responsible information retrieval system development and deployment and draft an actionable research agenda.
FACTS-IR
TLDR
The purpose of the SIGIR 2019 workshop on Fairness, Accountability, Confidentiality, Transparency, and Safety (FACTS-IR) was to explore challenges in responsible information retrieval system development and deployment and draft an actionable research agenda.
Some Reflections on the Use of Structural Equation Modeling for Investigating the Causal Relationships that Affect Search Engine Results
TLDR
Whether Structural Equation Modeling (SEM) can be a useful methodology to investigate the causal relationships between the variables describing the content representation and retrieval processes of search engines and recommender systems is discussed.
When Are Search Completion Suggestions Problematic?
TLDR
This study explores when system-provided suggestions might be perceived as problematic through a series of crowd-experiments where they are systematically manipulate: the search query fragments provided by users, possible user search intents, and the list of query completion suggestions.
ExDocS: Evidence based Explainable Document Search
TLDR
It is found that ExDocS provides an explanation for rankings that are understandable and complete but the explanation comes at the cost of a drop in ranking quality, in line with the “no free lunch” theorem.
RelDiff: Enriching Knowledge Graph Relation Representations for Sensitivity Classification
TLDR
This work proposes a novel method for representing entities and relations within a single embedding to better capture the relationship between the entities and shows that the proposed entity-relation-entity embedding approach can significantly improve the effectiveness of sensitivity classification.

References

SHOWING 1-10 OF 24 REFERENCES
Privacy-Preserving IR 2016: Differential Privacy, Search, and Social Media
TLDR
This workshop targets on three themes, differential privacy and IR dataset release, privacy in search and browsing, and privacy in social media, bringing together the two research fields, and yielding fruitful collaborations.
Shaping the Web: Why the Politics of Search Engines Matters
TLDR
It is argued that search engines raise not merely technical issues but also political ones, raising doubts whether, in particular, the market mechanism could serve as an acceptable corrective.
Shaping the Web: Why the Politics of Search Engines Matters
This article argues that search engines raise not merely technical issues but also political ones. Our study of search engines suggests that they systematically exclude (in some cases by design and
Social Data: Biases, Methodological Pitfalls, and Ethical Boundaries
TLDR
A framework for identifying a broad range of menaces in the research and practices around social data is presented, including biases and inaccuracies at the source of the data, but also introduced during processing.
Research Frontiers in Information Retrieval Report from the Third Strategic Workshop on Information Retrieval in Lorne (SWIRL 2018)
TLDR
The intent is that this description of open problems will help to inspire researchers and graduate students to address the questions, and will provide funding agencies data to focus and coordinate support for information retrieval research.
Beliefs and biases in web search
TLDR
Targeting yes-no questions in the critical domain of health search, it is shown that Web searchers exhibit their own biases and are also subject to bias from the search engine, and that search engines strongly favor a particular, usually positive, perspective, irrespective of the truth.
Auditing Search Engines for Differential Satisfaction Across Demographics
TLDR
A framework for internally auditing such services for differences in user satisfaction across demographic groups, using search engines as a case study is presented, and three methods for measuring latent differences inuser satisfaction from observed differences in evaluation metrics are proposed.
Big Data's Disparate Impact
Advocates of algorithmic techniques like data mining argue that these techniques eliminate human biases from the decision-making process. But an algorithm is only as good as the data it works with.
Explainable AI: Beware of Inmates Running the Asylum Or: How I Learnt to Stop Worrying and Love the Social and Behavioural Sciences
TLDR
From a light scan of literature, it is demonstrated that there is considerable scope to infuse more results from the social and behavioural sciences into explainable AI, and some key results from these fields that are relevant to explainableAI are presented.
50 Years of Test (Un)fairness: Lessons for Machine Learning
TLDR
This work traces how the notion of fairness has been defined within the testing communities of education and hiring over the past half century, exploring the cultural and social context in which different fairness definitions have emerged.
...
...