You are here

'Big Data'

LLMs in Content Coding: The 'Expertise Paradox' and Other Challenges

And the final speaker in this final AoIR 2024 conference session is the excellent Fabio Giglietto, whose focus is on coding Italian news data using Large Language Models. This worked with some 85,000 news articles shared on Facebook during the 2018 and 2022 Italian elections, and first classified such URLs as political or non-political; it then produced and clustered text embeddings for these articles, and used GPT-4-turbo to classify the dominant topics in these clusters.

LLMs and Transformer Models in News Content Coding

The next speaker in this final AoIR 2024 conference session is the great Hendrik Meyer, whose interest is in detecting stances in climate change coverage. This focusses especially on climate change debates in German news media, focussing on climate protests, discussions about speed limits, and discussions about heating and heat pump regulations.

Towards an LLM-Enhanced Pipeline for Better Stance Detection in News Content

The next speaker in this session at the AoIR 2024 conference is my QUT colleague Tariq Choucair, whose focus is especially on the use of LLMs in stance detection in news content. A stance is a public act by a social actors, achieved dialogically through communication, which evaluates objects, positions the self and other subjects, and aligns with other subjects within a sociocultural field.

Using LLMs to Code Problematic Content in the Brazilian Manosphere

The second speaker in this final session at the AoIR 2024 conference is Bruna Silveira de Oliveira, whose focus is on using LLMs to study content in the Brazilian manosphere. Extremist groups in this space seek legitimisation, and the question here is whether LLMs can be used productively to analyse their posts.

Paying Attention to Marginalised Groups in Human and Computational Content Coding

The final (!) session at this wonderful AoIR 2024 conference is on content analysis, and starts with Ahrabhi Kathirgamalingam. Her interest is especially on questions of agreement and disagreement between content codings; the gold standard here has for a long time been intercoder reliability, but this tends to presume a single ground truth which may not exist in all coding contexts.

Assessing Partisanship and Polarisation at Various Stages of News Production and Engagement

I presented in and chaired the Saturday morning session at the AoIR 2024 conference, which was on polarisation in news publishing and engagement, so no liveblogging this time. However, here are the slides from the three presentations that our various teams and I were involved in.

We started with my QUT DMRC colleague Laura Vodden, who discussed our plans for manual and automated content coding of news content for indicators of polarisation, and especially highlighted the surprising difficulties in getting access to quality and comprehensive news content data:

I presented the next paper, which explored the evidence for polarisation in news recommendations from Google News, building on our Australian Search Experience project in the ARC Centre of Excellence for Automated Decision-Making and Society (ADM+S):

How Meta’s Third-Party Fact-Checkers Are Learning to Think Like the Machine

The final presenters in this session at the AoIR 2024 conference are Yarden Skop and Anna Schjøtt Hansen; their interests are in the third-party fact-checking network employed by Meta. This operates on the basis of a Meta-provided online dashboard that highlights potentially problematic content, and the dashboard’s operation directs fact-checking away from political content spread by major political figures, and towards other forms of content.

The Platformisation of Newsroom Data Intermediaries in India

The next speaker in this AoIR 2024 conference session is Simran Agarwal, whose interest is in platformisation intermediaries in the Indian news industry. Her interest here is especially in the meso-layer of intermediaries, where AI-driven machine learning tools provide strategic counsel to newsrooms, broker interactions between platforms and publishers with the aim to ‘help’, ‘assist’, or ‘free’ journalists, and appear as certified partners.

The Platformisation of Digital Platforms’ Climate Pledges

The first full day at the AoIR 2024 conference starts with a panel on climate change, and the first speaker is Emily West, whose interest is in the climate policies of the large digital platform companies – such as Amazon’s ‘Climate Pledge’ initiative. This is supposed to provide an opportunity for involvement by other stakeholders, and some energy transparency measures.

Pages

Subscribe to RSS - 'Big Data'