Artificial Intelligence

The second speaker in this final session at the AoIR 2024 conference is Bruna Silveira de Oliveira, whose focus is on using LLMs to study content in the Brazilian manosphere. Extremist groups in this space seek legitimisation, and the question here is whether LLMs can be used productively to analyse their posts.

This analysis focusses on some 2,500 episodes of Brazilian masculinist podcasts across ten streaming platforms. It engaged in an assisted content analysis using OpenAI’s GPT-4 model, and explored whether this could identify detailed variables in the content. The podcast episodes were transcribed using automated tools, and 52 episodes …

The final (!) session at this wonderful AoIR 2024 conference is on content analysis, and starts with Ahrabhi Kathirgamalingam. Her interest is especially on questions of agreement and disagreement between content codings; the gold standard here has for a long time been intercoder reliability, but this tends to presume a single ground truth which may not exist in all coding contexts.

The concept of ‘constructs of marginalisation’ might be useful here: marginalised people are underrepresented; existing structural power defines who defines such constructs; they are historically and culturally shaped; and explicit as well as ambiguous and evasive language that discriminates …

The final presenters in this session at the AoIR 2024 conference are Yarden Skop and Anna Schjøtt Hansen; their interests are in the third-party fact-checking network employed by Meta. This operates on the basis of a Meta-provided online dashboard that highlights potentially problematic content, and the dashboard’s operation directs fact-checking away from political content spread by major political figures, and towards other forms of content.

Many fact-checking organisations around the world now substantially rely on income from Meta through their engagement in its fact-checking programme; this is part of a global post-publication debunking turn, but also creates a dependency on …

The next speaker in this AoIR 2024 conference session is Simran Agarwal, whose interest is in platformisation intermediaries in the Indian news industry. Her interest here is especially in the meso-layer of intermediaries, where AI-driven machine learning tools provide strategic counsel to newsrooms, broker interactions between platforms and publishers with the aim to ‘help’, ‘assist’, or ‘free’ journalists, and appear as certified partners.

Such intermediaries may be understood as cultural intermediaries, algorithmic experts, metricians, or content recommendation platforms; they may complement platforms or assist content production, and AI systems in particular retool, reshape, and rationalise the news. To explore this …

The next speaker in this AoIR 2024 conference session is Nanna Bonde Thylstrup, who begins by noting the critical role of data annotation practices in shaping the machine learning process underlying generative AI; such annotation is a world-making practice, must align with editorial values and the journalistic ethos of objectivity, and can of course also reproduce pre-existing societal biases.

In a sense, then, the algorithms of generative AI must also seek to reproduce (and perhaps improve upon) the famous ‘gut feeling’ of conventional human journalism. The present project worked with developers and data annotations at Danish news organisations – but …

The next speaker in this AoIR 2024 conference session is Nadja Schaetz, whose interest is in AI hype in news coverage. Journalism has often uncritically covered the rise of generative AI, and swallowed the claims of AI companies about the capacities of their tools; this project collaborated with the Associated Press Local AI Initiative and conducted participant observation in local newsrooms to understand journalistic reactions to this initiative. Through the project AP worked with five newsrooms to provide AI-supported technologies.

What the study observed was not AI hype as such, however: not simply a gap between expectations and reality of …

I’m chairing the next session at this AoIR 2024 conference, which is on the intersections (or collision) between journalism and AI. We start with Sangeet Kumar, who notes the long history of complex interactions between digital media platforms and news publishers; news is just a type of content for platforms, while for news producers it is a mission and vocation. There is a substantial amount of traffic coming from digital search and social media platforms to journalistic sites, and therefore a substantial level of dependency.

This has led to some controversial government interventions like the Australian News Media Bargaining Code …

The first full day at the AoIR 2024 conference starts with a panel on climate change, and the first speaker is Emily West, whose interest is in the climate policies of the large digital platform companies – such as Amazon’s ‘Climate Pledge’ initiative. This is supposed to provide an opportunity for involvement by other stakeholders, and some energy transparency measures. There are also the Carbon Free Energy initiative; Frontier, an initiative of the online payment company Stripe, which provides carbon removal and sequestration credits; and some emerging approaches to make generative AI platforms more carbon-neutral.

Even before the rise of …

The final speaker in this Social Media & Society 2024 session is my excellent QUT colleague Dom Carlon, whose focus is on governance of bots by bots, and inter-bot communication more broadly, on Reddit. Bots are often understood based on how they communicate with humans, and there are often seen as a problem or nuisance, but bots have always also communicated with other bots; this is sometimes by design and sometimes by chance (as bots have unplanned encounters with other bots online). How are bots governing or moderating the behaviour of other bots, then?

Bots can be seen as natural …

And the next speaker in this Social Media & Society 2024 conference session is Damien Renard, whose interest is in the power dynamics between platform operators and user communities. The focus here is on StackExchange, where moderators went on strike in protest against the platform’s May 2023 policy change to allow AI-generated content.

Moderators saw this as breaking an implicit contract between platform operators and moderators; they were worried about the impact on content quality and concerned that this policy change was implemented without consultation with the platform community. This is an example of digital power struggles on platforms, which …