The Dark Side of Algorithms: From Big Data-Driven Price Discrimination to Tacit Collusion

The authors have found that pressuring businesses to implement a completely fair pricing system may actually backfire and lead to tacit collusion where consumers will ultimately suffer. In today’s wave of big data, companies are building more complex advanced algorithms to categorise consumers and set different price points. The goal is to help businesses identify…


The authors have found that pressuring businesses to implement a completely fair pricing system may actually backfire and lead to tacit collusion where consumers will ultimately suffer.

In today’s wave of big data, companies are building more complex advanced algorithms to categorise consumers and set different price points. The goal is to help businesses identify loyal customers and discriminate against them by charging them more. This practice has alerted regulators across the world. They have either drafted or enacted laws to clamp down on price discrimination behaviours to promote price fairness. Still, this pursuit of price fairness consequently shines a light on an emerging hidden risk: companies could use pricing algorithms to form tacit collusion and maintain monopoly pricing in a competitive market (see Note 1). Even though many regulatory bodies remain highly concerned about algorithmic discrimination and algorithmic collusion, very few studies have been conducted with a focus on crucial links between the two. As such, the authors of this article have delved deep into this problem and put forward important policy suggestions. They present fresh ideas on ways to tackle algorithmic discrimination and algorithmic collusion.

Regulatory Dilemma: Caught Between a Rock and a Hard Place

In 2018, the United Kingdom’s Financial Conduct Authority issued a discussion paper which highlighted a common and widespread problem in the country’s financial services industry – the “loyalty penalty”. This is where loyal customers are unable to enjoy special prices when they renew their contracts (see Note 2). Even if the risk levels of long-standing customers have not increased, insurers still charged them higher premiums. This practice often puts loyal customers in an even more unfavourable situation (see Note 3). In 2021, a court in China’s Zhejiang province ruled in favour of a consumer of Trip.com who accused the travel services provider of price discrimination. The plaintiff, a “Diamond member” with Trip.com, took legal action after being charged more than double the hotel’s room rate. Similar practices of big data price discrimination have also been heavily criticised by Chinese consumers (see Note 4). In response, China’s Ministry of Culture and Tourism issued new regulations in 2020, forbidding online booking platforms from taking advantage of their loyal users. Over in the United Kingdom, the Financial Conduct Authority also introduced new rules. From 2022, insurers have been banned from quoting customers a higher price for renewing their home or motor insurance when compared to a new customer.

While both policy intentions and regulatory means are fundamentally alike, their respective impact on the economy could not be more different. For the travel booking industry, the same type of hotel is generally listed on multiple platforms. This means different travel platforms end up providing homogenous products and competition remains relatively fierce. For industries with a high degree of homogeneity, barring price discrimination can often promote consumer surplus and further suppress a potential price collusion between businesses. However, when it comes to the insurance market, companies often develop products with varying terms, scope and length to set themselves apart from competitors. When it comes to these highly differentiated markets, imposing a completely fair pricing system could backfire: companies could use this to their advantage and collectively raise prices set by algorithms. This will lead to tacit collusion and consumers will ultimately suffer. In fact, not long after the Financial Conduct Authority issued new restrictions, the premiums on home and motor insurance registered their biggest month-on-month increase in the United Kingdom in over eight years (see Note 5). Such a difference serves as a reminder to regulators that perfect price fairness and an entirely competitive market are contradictory – Prohibiting behaviours of price discrimination may induce problems and hinder healthy market competition. This shows that regulators should exercise caution when dealing with social problems arising from algorithmic pricing and prevent causing a butterfly effect.

Future Regulations: Targeting Both the Symptoms and Root Causes

As businesses create more comprehensive algorithms, regulating price discrimination and tacit collusion will also require more targeted methods. The authors’ research provides two feasible regulatory routes:

First of all, restricting – rather than banning – price discrimination is a more stable and realistic approach. This approach can impair the ability of companies to engage in price collusion by stimulating competition. It can also improve social welfare more so than having an unregulated environment or a complete ban on price discrimination. Secondly, rather than pursuing absolute price fairness, regulators should consider adopting randomised pricing interventions and turn to probability on whether or not to impose price fairness. This kind of randomised regulation can also promote a higher degree of price fairness whilst weakening the chances of businesses colluding together. In addition, this research has emphasised on the need for regulators to rely on more advanced technologies to audit pricing algorithms and increase algorithmic transparency. When there is a two-pronged approach directed at algorithm abuse that facilitates discriminatory and predatory pricing; when fairness and anti-monopoly have been taken into full account; only then can we ensure that the whole society can enjoy technology dividends brought about by companies who make advances in product development.

The authors of this article are Prof. Xiao LEI, Assistant Professor in Innovation and Information of HKU Business School; Prof. Pin GAO, Assistant Professor of CUHK (Shenzhen) School of Data Science, Mr. Zongsen YANG, Ph.D. student of CUHK (Shenzhen) School of Data. This article is based on their joint research paper “Regulatory Discriminatory Pricing in the Presence of Tacit Collusion”.

Note 1: https://www.justice.gov/opa/pr/justice-department-and-federal-trade-commission-file-statement-interest-hotel-room
Note 2: https://www.fca.org.uk/publication/discussion/dp18-09.pdf
Note 3: https://www.bbc.com/news/business-57270415
Note 4: https://technode.com/2021/07/15/regulators-target-price-discrimination
Note 5: https://www.raconteur.net/finance/fca-ban-price-walking-rebound-consumers

Professor Xiao LEI
Assistant Professor in Innovation and Information, HKU Business School

Professor Pin GAO
Assistant Professor, School of Data Science, CUHK (Shenzhen)

Mr. Zongsen YANG
Ph.D. student in Data Science, CUHK (Shenzhen)

This article was also published on September 5, 2024 on the Financial Times’ Chinese website

Translation

算法孿生:從大數據殺熟到隱性合謀


學者研究發現,向企業施加完全的價格公平可能適得其反,形成隱性合謀,最終將負面影響轉嫁給消費者。

在大數據的浪潮下,企業搭建日益複雜的先進算法,將消費者分類,制定不同價格,目的在于識別幷鎖定忠實客戶,向他們收取歧視性的高價。這一做法引發了各國監管者的關注,令他們紛紛擬定或出臺法令,試圖限制企業的歧視性定價行爲,以促進消費者間的價格公平。然而,追求價格公平的同時,一個更爲隱蔽的風險逐漸浮現:企業可能會利用定價算法達成隱性合謀,從而在競爭市場中維持壟斷價格【注 1】。儘管許多監管機構高度關注算法歧視和算法合謀,但鮮有研究關注二者之間的重要關聯。爲此,筆者就這一問題進行深入剖析,幷提出重要的政策建議,爲如何應對算法歧視與算法合謀提供新的思路。

監管窘境:按下葫蘆浮起瓢


2018年,英國金融行爲監管局(Financial Conduct Authority)發布一則報告,指英國金融服務行業普遍和廣泛存在 “忠誠度懲罰”,即忠誠用戶在續簽服務合同時未能享受優惠價格【注 2】。即便這些忠實用戶的風險水平幷未增加,保險公司依舊會向他們收取高昂的保費。這種做法往往令這些忠實客戶處于更不利的位置【注 3】。2021年,中國浙江省一家法院支持一位携程的會員用戶,對該旅游平臺涉嫌價格歧視的控訴,因携程向該位“鑽石會員”,收取比酒店實際價格貴一倍的房費。類似的大數據“殺熟”做法也受到衆多中國消費者的抨擊【注 4】。有鑒于此,中國文旅部于2020年發布新規定,禁止在綫預訂平臺對用戶的“殺熟”行爲;英國金融行爲監管局亦于2022年實施新規則,嚴禁保險行業爲客戶續保家庭或汽車保險時,報出較新客戶更高的價格。

但是,筆者發現,儘管二者政策意圖和規制手段基本一致,但其經濟影響可能大相徑庭。對于機票酒店預訂行業,普遍是相同的酒店類型由多個平臺進行分銷,因此對于不同旅游平臺提供的産品往往同質化程度高,競爭也相對激烈。針對這些同質化程度高的行業,禁止價格歧視往往能促進消費者剩餘,甚至能進一步遏止企業潜在的價格合謀。然而,對于保險市場,不同企業往往會設定條款、效力、日期不同的産品,以期和對手實現差异化的競爭。對于這些差异化程度高的市場,施加完全的價格公平可能適得其反:企業們能借此集體抬高算法設定的價格,形成隱性合謀,最終將負面影響轉嫁給消費者。事實上,繼英國金融行爲監管局頒布禁令後不久,英國的家庭和汽車保險價格出現了八年多來最大的環比漲幅【注 5】。這種差异提醒監管者,有時候,完美的價格公平和完全的競爭市場是相互矛盾的——禁止價格歧視的行爲可能會按下葫蘆浮起瓢,阻礙了市場的良性競爭。由此可見,監管者在應對算法定價帶來的諸般社會議題時,必須審勢而行,避免牽一髮而動全身。

監管未來:雙管齊下標本兼治


當企業定價算法越來越精細,規制定價算法帶來的歧視和隱性合謀問題也需要更精准的舉措。筆者的研究提供兩種可行的規制路徑:

首先,限制算法歧視相比禁止算法歧視更爲穩妥可行,這種做法可以通過促進競爭來抑制企業參與價格合謀的能力,幷且較放任自流或者完全禁止這兩種非此即彼的策略,更能提高社會福利;其次,相比追求一個絕對的價格公平,監管者可以考慮頒布隨機化的價格規制,即以一定概率决定施不施加價格公平。這種隨機化的規制可以促進實踐一個較高程度的價格公平,同時削弱企業合謀的可能性。此外,本研究還强調,監管者應當依賴更先進的技術手段,加强對企業定價算法的審計,提高算法透明度。只有對濫用算法進行歧視性和掠奪性定價的行爲雙管齊下,兼顧公平與反壟斷,才能確保全社會能共享由企業發展産品進步所帶來的技術紅利。

本文作者爲港大經管學院創新及資訊管理學助理教授雷驍、香港中文大學(深圳)數據科學學院助理教授高品及香港中文大學(深圳)數據科學學院博士生楊宗森。文章基于三位最近共同撰寫的論文:“Regulating Discriminatory Pricing in the Presence of Tacit Collusion”。

【注 1】:https://www.justice.gov/opa/pr/justice-department-and-federal-trade-commission-file-statement-interest-hotel-room
【注 2】:https://www.fca.org.uk/publication/discussion/dp18-09.pdf
【注 3】:https://www.bbc.com/news/business-57270415
【注 4】:https://technode.com/2021/07/15/regulators-target-price-discrimination
【注 5】:https://www.raconteur.net/finance/fca-ban-price-walking-rebound-consumers

雷驍博士
港大經管學院創新及資訊管理學助理教授

高品博士
香港中文大學(深圳)數據科學學院助理教授

楊宗森先生
香港中文大學(深圳)數據科學學院博士生

(本文同時于二零二四年九月六日載于《FT中文網》「明德商論」專欄)