Horseman

Horseman Overview

Horseman is a highly configurable web crawling tool designed for frontend developers, performance analysts, digital agencies, accessibility experts, SEO specialists, and JavaScript engineers. It allows users to crawl the web the way they want, providing expert insights across their whole site. With its latest version, v0.3.2, Horseman introduces GPT integration and a host of other features. It is available for Windows, Mac OS (Intel and M1/M2), and Linux. Horseman is powered by snippets, tiny pieces of JavaScript code that allow users to interact with a website, manipulate it, and return information. For those unfamiliar with JavaScript, Horseman provides over 120 built-in snippets and an AI helper to create snippets.

Horseman Highlights

• Web crawling with GPT3.5: Horseman v0.3 allows users to crawl the web using GPT3.5 and use page content with prompts. Users can combine any piece of page data or send the entire page to GPT for analysis.
• AI helper for snippet creation: For users who do not know JavaScript, Horseman v0.3 offers an AI helper to create snippets. Users can describe the information they want to extract and let the AI write the snippet for them.
• Insights feature: Horseman v0.3 introduces a new Insights feature for deeper exploration of the web.