Users of privacy-focused search engine DuckDuckGo have been unable to site search the domains of some well-known pirated media sites recently, as reported by TorrentFreak on Friday. This follows a News Punch article last month calling out DuckDuckGo for “purging” independent media sources from search results, and naming them “Google Lite”. DuckDuckGo’s CEO Gabriel Weinberg called the News Punch piece “completely made up” in a Twitter thread over the weekend to respond to the public and address both issues.
To observers, it seemed as if DuckDuckGo had de-indexed searches for copyright-flouting media download sites like The Pirate Bay and Fmovies, and even a site search for the open-source tool youtube-dl came up empty. TorrentFreak later updated its report citing a company spokesperson blaming the issue on Bing search data, which DuckDuckGo relies upon. Weinberg insisted the company is not purging any results and said that site search results are not appearing due to the site operator error “Anyone can verify this by searching for an outlet and see it come up in results,” Weinberg tweeted.
Similarly, we are not "purging" YouTube-dl or The Pirate Bay and they both have actually been continuously available in our results if you search for them by name (which most people do). Our site: operator (which hardly anyone uses) is having issues which we are looking into.
— Gabriel Weinberg (@yegg) April 17, 2022
We reached out to DuckDuckGo about the issue and received this response from senior communications manager Allison Goodman:
After looking into this, our records indicate that YouTube-dl and The Pirate Bay were never removed from our search results when you searched for them directly by name or URL, which the vast majority of people do (it’s rare for people to use site operators or query operators in general).
The Verge was told the new behavior is not targeted to piracy-linked sites. “We are having issues with our site: operator, and not just for these sites,” wrote Goodman. “Some of the other sites routinely change domain names and have spotty availability, and so naturally come in and out of the index but should be available as of now.” The Verge was able to observe these changes: a Friday search for “site:thepiratebay.org spider-man” gave zero results (including the absence of the main site), but today, the search does at least yield the thepiratebay.org website — but not anything within.
Like Goodman, Weinberg claimed site operators are sparingly used and downplayed it as an issue:
Similarly, we are not “purging” YouTube-dl or The Pirate Bay and they both have actually been continuously available in our results if you search for them by name (which most people do). Our site: operator (which hardly anyone uses) is having issues which we are looking into.
No matter what’s causing the change, this is the second recent dust-up for DuckDuckGo over its search results. In March, the company responded to Russia’s invasion of Ukraine by saying it would down-rank sites spreading Russian misinformation. Right-wing figures who had promoted it as an alternative to Google claimed it had abandoned principles of free speech for censorship, while DDG spokesperson Kamyl Bazbaz told Recode, “This isn’t censorship. It’s just search rankings.”
Correction April 19th, 8:55AM ET: A previous version of the article incorrectly suggested that Weinberg’s initial tweet calling out a “made up” headline was in response to the TorrentFreak article. Weinberg was actually talking about the News Punch article. We regret the error.