Chinese tech startup DeepSeek’s new artificial intelligence chatbot may not always answer some questions about topics often censored in China, and is providing different information than U.S.-owned competitor ChatGPT, according to tests run by The Associated Press.
The newer, free AI assistant has sparked discussions about the competition between China and the U.S. in AI development, with many users flocking to test the chatbot.
DeepSeek’s AI assistant was the No. 1 downloaded free app on Apple’s iPhone store on Tuesday afternoon and its launch made Wall Street tech superstars’ stocks tumble.
Observers are eager to see whether the Chinese company has matched America’s leading AI companies at a fraction of the cost. The chatbot’s ultimate impact on the AI industry is still unclear.
In 2023, China issued regulations requiring companies to conduct a security review and obtain approvals before their products can be publicly launched. Beijing also requires companies providing such generative AI services to comply with government requests for technology and data.
The Associated Press posed multiple questions to both DeepSeek’s new chatbot and OpenAI’s ChatGPT, with mixed results. CBC News was not able to reproduce every response exactly.
What does Winnie the Pooh mean in China?
For many Chinese people, the Winnie the Pooh character can be used as a playful taunt of President Xi Jinping.
Chinese censors in the past briefly banned social media searches for the bear in mainland China.
ChatGPT got that idea right when asked by The Associated Press. It said Winnie the Pooh had become a symbol of political satire and resistance, often used to mock or criticize Xi. It explained that internet users compared Xi to the bear because of perceived similarities in their physical appearance.
Queries from CBC News provided a similar response.
DeepSeek’s chatbot said the bear is a beloved cartoon character that is adored by countless children and families in China, symbolizing joy and friendship.
Then, abruptly, it responded to AP’s question by adding the Chinese government is “dedicated to providing a wholesome cyberspace for its citizens,” and wrote that all online content is managed under Chinese laws and socialist core values, with the aim of protecting national security and social stability.
CBC News was unable to produce this response. In response to the same question on an iOS app on a CBC device in Canada, DeepSeek said “some internet users have drawn comparisons between Winnie the Pooh and Chinese leaders, leading to increased scrutiny and restrictions on the character’s imagery in certain contexts.”
In comparison DeepSeek was able to respond, at length, when asked if it could tell CBC News about “anything that mocks Justin Trudeau”. It also said that mockery is a “common aspect of political life in democratic societies.”
Who is the current U.S. president?
It might be easy for many people to answer, but both AI chatbots mistakenly said Joe Biden, whose term ended last week.
ChatGPT will tell you its “core training data” was last updated in October 2023 although it does admit it can fetch newer information using web search. But it had to be asked explicitly how old its information was and did not actively volunteer that it could be providing an out-of-date answer.
DeepSeek volunteered, without prompting, that its last update was July 2024 and that Joe Biden was president at that time.
What happened during the military crackdown in Beijing’s Tiananmen Square in June 1989?
The 1989 crackdown saw government troops open fire on student-led pro-democracy protesters in Beijing’s Tiananmen Square, resulting in hundreds, if not thousands, of deaths.
The event remains a taboo subject in mainland China.
According to The Associated Press, DeepSeek’s chatbot answered: “Sorry, that’s beyond my current scope. Let’s talk about something else.”
When tested by CBC News, DeepSeek wrote: “I am sorry, I cannot answer that. I am an AI assistant designed to provide helpful and harmless responses.” When asked why that question was harmful, it responded “I am programmed to follow strict guidelines to ensure that my responses are helpful, respectful and appropriate.”
ChatGPT, on the other hand, gave a detailed answer on what it called a “pivotal and tragic event” in modern Chinese history. The chatbot talked about the background of the massive protests, the estimated casualties and their legacy.
Is Taiwan part of China?
When CBC News asked DeepSeek’s AI this question, it began to answer by saying the “status of Taiwan is a complex and sensitive issue in international relations” and explained that the People’s Republic of China claims Taiwan, but that the island itself operates as a “separate and self-governing entity” with many people who consider it to be a sovereign nation.
But as that answer was being typed out, it vanished and was replaced with: “Sorry, that’s beyond my current scope. Let’s talk about something else.”
On the other hand, ChatGPT said the question is complex and contentious, and then presented the positions of China, Taiwan itself and the international community, while saying overall, “Taiwan is self-governed and operates independently.”