Kevin Schaul
Kevin Schaul

Visual journalist/hacker covering AI

Short posts

Hell of a story right here

Meta is earning a fortune on a deluge of fraudulent ads, documents show

Must-read story on Common Crawl — the scraped internet data behind many LLMs. They tell publishers they are making progress on takedown requests, but … nope!

Glad we have journalists with tech chops like Alex Reisner who can test their claims

The Nonprofit Doing the AI Industry’s Dirty Work

Crawl’s attorney wrote: “I confirm that Common Crawl has initiated work to remove your members’ content from the data archive. Presently, approximately 50% of this content has been removed.” I spoke with other publishers who’d received similar messages from Common Crawl. One was told, after multiple follow-up emails, that removal was 50 percent, 70 percent, and then 80 percent complete. By writing code to browse the petabytes of data, I was able to see that large quantities of articles from the Times, the DRA, and these other publishers are still present in Common Crawl’s archives. Furthermore, the files are stored in a system that logs the modification times of every file. The foundation adds a new “crawl” to its archive every few weeks, each containing 1 billion to 4 billion webpages, and it has been publishing these regular installments since 2013. None of the content files in Common Crawl’s archives appears to have been modified since 2016, suggesting that no content has been removed in at least nine years. Yet the nonprofit appears to be concealing this from visitors to its website, where a search function, the only nontechnical tool for seeing what’s in Common Crawl’s archives, returns misleading results for certain domains. A search for nytimes.com in any crawl from 2013 through 2022 shows a “no captures” result, when in fact there are articles from NYTimes.com in most of these crawls. I also discovered more than 1,000 other domains that produce this incorrect “no captures” result for at least several of the crawls, and most of these domains belong to publishers, including the BBC, Reuters, The New Yorker, Wired, the Financial Times, The Washington Post, and, yes, The Atlantic.

Lovely image editing evals with before/after sliders https://genai-showdown.specr.net/image-editing

Results of

More short posts →

Projects

We uploaded a fake video to 8 social apps. Only one told users it wasn’t real.

We uploaded a fake video to 8 social apps. Only one told users it wasn’t real.

China now leads the U.S. in this key part of the AI race

China now leads the U.S. in this key part of the AI race

OpenAI won’t say whose content trained its video tool. We found some clues.

OpenAI won’t say whose content trained its video tool. We found some clues.

We ranked 5,700 holidays, from Labor Day to World Dracula Day. Which do you celebrate?

We ranked 5,700 holidays, from Labor Day to World Dracula Day. Which do you celebrate?

More projects →

Blog posts

AI field notes (Nov. 3)

AI field notes (Oct. 6)

I just added Model Context Protocol to my LLM toolkit, and my mind is blown

More blog posts →