The New York Instances has blocked OpenAI’s internet crawler, that means that OpenAI can’t use content material from the publication to coach its AI fashions. If you happen to test the NYT’s robots.txt page, you may see that the NYT disallows GPTBot, the crawler that OpenAI launched earlier this month. Based mostly on the Web Archive’s Wayback Machine, it seems NYT blocked the crawler as early as August seventeenth.
The change comes after the NYT up to date its phrases of service initially of this month to ban the usage of its content material to train AI models. The NYT and OpenAI didn’t instantly reply to a request for remark.