In the Age of AI, to Whom is Power Shifting?

Is the future where artificial intelligence replaces humans still a long way off? Some have already begun to worry about having their jobs snatched from under them. Meanwhile, the widespread deployment of algorithms in sectors such as food delivery and retail has already transformed the way ordinary people eat.

Yet does new technology necessarily guarantee a progressive future? Are there costs behind it that algorithms simply cannot calculate?

I. Whose steering wheel has AI taken?

In July 2024, the widespread deployment of Baidu’s autonomous taxi service, “Luobo Kuaipao” (Radish Express), across Wuhan sparked intense public debate, even tipping into “panic”.

Following call centre operators, ride-hailing drivers now seem poised to be the next group to lose their jobs to AI.

Experts have previously drawn up lengthy lists of occupations vulnerable to AI displacement, including designers, editors, translators, lawyers, and accountants… even programmers themselves, operating on the premise that AI could eventually write code in their stead.

Yet optimists maintain that the fresh demands spawned by industrial upgrading will generate new roles. Technological progress will ultimately benefit society as a whole.

Ride-hailing drivers hold deeply conflicted views on autonomous driving. On one hand, they insist with some pride that “driverless cars can simply never match a human’s ability to handle ever-changing, complex road conditions”, even mocking the service as a “苕萝卜” (a Wuhan dialect term roughly translating to “silly radish”). Beneath this bravado, however, lies a quiet fear that they truly will be made redundant.

The irony is that the service has indeed been plagued by a string of “silly radish” mishaps: colliding with pedestrians, stalling at green lights, bolting into junctions on reds, and freezing mid-turn. When these incidents occur, the platform is forced to call on humans to clean up the machine’s mess. Although technically driverless, the service actually recruits ride-hailing drivers to work as safety monitors. For every three autonomous cars on the road, one monitor is stationed remotely, ready to take control via a “racing simulator” setup whenever a vehicle encounters trouble.

● Baidu’s cloud-based driving control centre. Under the *Guidelines for Safe Operation and Service of Autonomous Vehicles in Transport (Trial)* issued by the General Office of the Ministry of Transport in November 2023, fully autonomous vehicles operating as taxis may employ remote safety operators in designated zones, provided safety is guaranteed and with the approval of the relevant municipal government. The ratio of remote safety personnel to vehicles must not fall below 1:3. Source: Internet

So, will ride-hailing drivers be entirely replaced? Rather than dwell on a question without a definitive answer, what we can be certain of is that power is steadily consolidating with the platforms, and drivers will lose their hold on the “steering wheel”. Though monitoring a “simulator” may look much like driving a real car, the bulk of the operational work is now handled by the autonomous system, significantly curtailing the driver’s decision-making authority.

Apollo Go is no mere interlude. The “steering wheel” that artificial intelligence may ultimately take from every ordinary person in the future is the real issue. Beyond this sector, will humans truly see their livelihoods snatched away by AI?

● Wuhan, an Apollo Go autonomous vehicle stopped in the middle of a junction. Source: Internet

II. Bianlifeng’s “foolish machine”

Whether ‘Tiaoluobo’ can actually become smarter remains to be seen, but similar ‘dumb machines’ have long been in existence.

As early as 2018, convenience retailer Bianlifeng embarked on a radical experiment: handing complete operational decision-making for its stores over to algorithms.

Within this system, power is highly centralised. Store staff are granted no autonomy whatsoever; they are confined to mechanically executing a series of simple, repetitive duties such as sweeping, wiping surfaces, restocking shelves, and preparing meals. Even the precise placement of individual products is dictated by the algorithm. Before this, no company had ever conducted such an extreme trial. Even industry peers who were keen advocates of digitalisation felt Bianlifeng might have gone too far.

● Handheld terminals used by Bianlifeng staff, displaying current tasks and deadlines. The algorithm breaks down a staff member’s daily work into 70–80 simple tasks, issuing instructions via the handheld devices.

Bianlifeng founder Zhuang Chenchao has pinned his hopes on algorithmic systems to precisely calculate the optimal balance between supply and demand, thereby boosting efficiency.

Yet, in our earlier investigation, Is Bianlifeng, Which Turns People Into Machines, Truly Intelligent?, we found no evidence to suggest the algorithmic system actually enhances efficiency.

While Bianlifeng may indeed cut staffing by one or two per outlet compared with traditional convenience stores such as FamilyMart and 7-Eleven, the substantial costs of developing, operating, and maintaining the system itself, alongside hardware installations such as sensors, robots, and cameras, do not simply vanish. Reports indicate that in 2021, Bianlifeng’s technology team numbered between 1,500 and 2,000 personnel. Whether the savings from reduced floor staff can offset the investment in technical personnel and infrastructure remains highly questionable.

● Inside a Bianlifeng outlet, cameras mounted on the ceiling continuously monitor staff activity. According to former branch manager Ms L, her store was equipped with approximately one camera for every three square metres.
Bianlifeng appears to be banking on the hope that, following rapid store expansion, it can further spread the costs of its algorithmic system and supply chain to reach a break-even point. Yet, with its store count having plummeted from over 3,000 at the end of 2021 to just over 1,000, that objective remains increasingly out of reach.

Worse still, the system’s decision-making capabilities fall short of human intuition, ultimately eroding Bianlifeng’s profitability. Stripped of store managers’ frontline experience, the company has suffered basic errors in restocking fast-moving items like bread and beverages. The algorithm fails to accurately anticipate consumer demand or meaningfully improve inventory turnover rate. According to franchisees, the rigid system routinely results in overstocked hot food, leading to significant waste. Consequently, what appears highly intelligent to outsiders has earned the derogatory nickname “the idiot” among staff.

Zhuang Chenchao readily admits that the algorithmic system is prone to errors. Yet, as a staunch advocate of technological progress, he argues the answer does not lie in bolstering managers’ decision-making authority or relying on human intuition to patch the system’s flaws. Instead, he believes the path forward is to keep refining the algorithms, fortify the machine’s “brain”, and enable it to self-correct through continuous learning.

In short, he maintains that machines only appear “foolish” because the technology has not yet matured.

III. Humans Have Their Place

Within Bianlifeng stores, staff are restricted to tasks such as stocking shelves, cleaning, and food preparation. Employees function much like mechanical appendages: capable of movement, but devoid of any cognitive input.

Yet human insight remains invaluable. Seasoned Bianlifeng managers possess a wealth of practical strategies for running their shops. They intuitively understand how to adapt product ranges and shelf layouts in response to shifting seasons, temperature fluctuations, weather patterns, and holidays.

Yet the company’s system maintains a stranglehold on decision-making, providing not even a formal channel to ‘deign’ to consider a manager’s input.

In truth, from the earliest days of mechanisation, human roles have almost always involved tidying up the mess left by machines. During the dawn of the Industrial Revolution, machinery boasted overwhelming advantages in power and mechanical drive. Highly efficient as they were, they were nowhere near as “intelligent” as modern systems. They invariably required workers to step in, adapting on the fly to handle unexpected glitches.

Once mechanised spinning was introduced, manual spinning became obsolete, yet female workers still had to stand ready to splice broken threads the moment they snapped. Victorian-era textile mills routinely employed child labour to crawl beneath moving machinery and sweep away waste cotton.

Contemporary AI may appear highly intelligent, but the unglamorous task of error-correction and crisis management still falls squarely on human shoulders. Even Baidu’s Apollo Go autonomous taxis require safety officers to manage emergencies, proving that when it truly counts, human intervention remains indispensable.

IV. Can Algorithms Truly Account for Workers?

The belief that algorithmic systems can eventually evolve to perfection is perhaps a shared obsession among all internet technology companies.

Meituan also claims that the “real-time intelligent dispatch system” it developed for food delivery services is exceptionally powerful.

The data highlight its computational power: during peak order volumes, it can execute 2.9 billion route calculations per hour. Within tens of milliseconds, it computes the optimal matching of orders, riders, and routes, while simultaneously accounting for dozens of variables such as weather conditions, traffic, rider availability, and restaurant preparation speeds.

● A delivery map from a day I was working as a food delivery rider. Delivery riders typically take on multiple orders at once, and the platform’s algorithmic system plans the route in advance. For more stories from my time delivering food, see the earlier Food Talk podcast episode “Movies vs Reality: What Is the Real Life of Delivery Riders Like?”.

According to sources within Meituan, the “Real-Time Intelligent Dispatch System” adjusts delivery windows based not only on real-time variables—such as the locations of riders, customers, and merchants, along with weather conditions—but also on historical data from previous deliveries.

When delivery riders run red lights or cycle against the flow of traffic on a given route for fear of exceeding their deadline, the time they save at the cost of their own safety is absorbed by the algorithm, establishing a new benchmark. In this continuous loop, delivery times for every route are ultimately squeezed to the absolute limit.

Thus, the rise in efficiency is not simply because the system has become better at “calculating”, but more because it can monitor and control countless delivery riders, absorbing their desperate, self-driven “calculations” into the system.

The cost of this heightened efficiency, however, is the riders’ lives and safety.

According to a 2023 survey, during peak delivery hours at an intersection in Beijing, 53 riders passed through in half an hour; of these, 37 were cycling against traffic, cutting diagonally across roads, or running red lights. Shanghai has also published stark figures: in the first half of 2017, a delivery rider was killed or injured every 2.5 days on average. In 2023, the total number of traffic offences committed by Meituan delivery riders in Shanghai reached as high as 6,500 in a single week.

I have experienced this myself: on a rainy night, anxious about running late, I slammed heavily into the central guardrail. My electric bike was wrecked, but the order could not wait. I had no choice but to complete the delivery on a shared bicycle.

● In the film *Reversal of Life*, rider Lao Kou is chatting with a colleague one moment, only to be knocked down by a car the next. Traffic accidents have become a staple in cultural works depicting the lives of delivery riders. I previously wrote a film review titled “The Hardships of Riders and the Anxieties of the Middle Class: Who Can Save Whom?”. Image source: Official movie trailer

In retrospect, I have often imagined: even at the very least, the platform could simply allow riders to log a traffic accident to the system immediately and grant them a delivery extension. At the minimum, I would not have been left in such a predicament, and an injured rider would have had the breathing room to deal with the aftermath.

The platform has invested heavily in optimising its system to slash delivery times and maximise profits; is it really that difficult to leave a “back door” open for riders caught up in accidents? Is the inability to engineer a flawless system down to a lack of technical expertise, or is it the designers’ own notions of power dictating the outcome?

Public discourse surrounding rider accidents has persisted for years, yet we have seen no tangible improvements to the system. Whether delivery platforms are genuinely willing to take action speaks for itself.

We can never be certain whether “technical constraints” are merely a pretext for refusing to change. Ultimately, the power to shape algorithmic rules rests entirely with the corporations, while labourers remain perpetually locked out of the decision-making process.

● Still from the film *Another Day Full of Hope*. In the film, a delivery rider is forced to drive the wrong way and speed to meet delivery deadlines, resulting in a traffic accident. The platform-mandated insurance, costing a mere three yuan per trip, proves exceedingly difficult to claim. This stands as one of the rare realist films in recent years to authentically depict the realities of algorithmic management. Image source: Official film poster

V. The Blindness of “Technological Progressivism”

Adherents of “technological progressivism” tend to be deeply optimistic. They believe that technology’s current “foolishness” and “clumsiness” stem merely from its infancy, and that it will ultimately benefit society. Consequently, companies are keen to pour vast capital into technological development.

But what if, from the outset, the “nurturing path” chosen for this infant was flawed? A danger is already emerging: waving the banner of “technology boosting productivity” becomes a convenient excuse to overlook the alienating labour conditions endured by the workforce.

The pursuit of progress has devolved into a blind faith. Even when a technology reveals numerous flaws in practice, repackaging it for a new field reignites public excitement, as if a progressive future lies just ahead, while its negative impacts are conveniently forgotten.

In Wuhan, despite Apollo Go’s series of bewildering manoeuvres, the public still tends to dismiss these incidents as mere glitches in the autonomous system that can be resolved through technical upgrades. Some even argue that Apollo Go’s current vehicle-level AI driving capabilities will eventually be superseded by smarter “end-to-end” solutions.

Once again, the mantra of technological progressivism is being chanted. We are handed a promise indefinitely deferred: so long as information technology continues to iterate, a fully automated and intelligent society will inevitably arrive somewhere down the line.

Yet concerns are already mounting: On what grounds can we be certain that we will be the beneficiaries of digital technology, rather than those left behind by it? Much like the drivers displaced by Apollo Go, or the delivery couriers pushed into ever-faster, more grueling cycles by food-delivery platforms.

The developmental trajectory of artificial intelligence is not monolithic. We must interrogate the underlying technological philosophies held by its designers and ask who will ultimately reap the benefits. Shedding our naive fantasies about progress, subjecting technology to rigorous scrutiny within the framework of power structures, and conducting a thorough assessment of current AI development paths are all tasks that are still well within our grasp.

References

1.     Humans behind Apollo Go! A viral image reveals the final line of defence for autonomous driving safetyhttps://m.thepaper.cn/newsDetail_forward_28245164

2.     ConvenienceBee’s “Conjecture”

https://www.huxiu.com/article/362539.html

3.     ConvenienceBee sells “hives”: A 210,000 yuan “game for the brave”

https://www.36kr.com/p/2489124121450374

4.     The DNA and Ambition of ConvenienceBee

https://new.qq.com/rain/a/20220331A02X9H00

5.     Ending the “race against time” for delivery riders: Optimising and adjusting platform algorithms is imperative

https://new.qq.com/rain/a/20230816A07CUP00

6.     One delivery rider injured or killed every 2.5 days in Shanghai: How did this job become so dangerous?

http://news.cctv.com/m/index.shtml?article_id=ARTIE7WENh6GehvE8fgiyDy0170914

7.     Shanghai releases data on traffic accidents and violations in the courier and food-delivery sectors

https://www.cnr.cn/shanghai/gstjshanghai/20230807/t20230807_526367609.shtml

Foodthink Author

Zheng Yuyang

Originally from the Second Livestock Farm in Bayan County, Heilongjiang Province, Zheng is an INTP now navigating life in Beijing. He previously spent four months working as a delivery rider in the capital. His current focus lies in digital technology, agricultural innovation, and sustainable development.

 

 

 

Editor: Wang Hao