The best websites you didn't know
Affiliate recommendation: Rewardful Try Rewardful
← All websites

people.kernel.org

Creepy crawlies

Notes on AI crawlers and their impact on open-source data.

Creepy crawlies website preview

About Creepy crawlies

Analyze how AI crawlers affect open-source data and server load for developers and system operators. It discusses the data-heavy approach of rendering commits as HTML and details blocking scrapers by IP or ASN as a countermeasure.

Categories

Published

Discussion

No comments yet. Have you tried it?

by @Micadep