monperrus/crawler-user-agents (v1.52.0)
syndicated from packagist.org
on June 19, 2026
This repository contains a list of of HTTP user-agents used by robots, crawlers, and spiders as in single JSON file.
This repository contains a list of of HTTP user-agents used by robots, crawlers, and spiders as in single JSON file.