httpx-toolkit
Fast and multi-purpose HTTP toolkit that runs multiple probers using retryablehttp library to maintain result reliability with increased threads. Supports probing hosts, URLs, and CIDRs with smart auto-fallback from HTTPS to HTTP.
Description
httpx-toolkit is a fast and multi-purpose HTTP toolkit developed by ProjectDiscovery, packaged in Kali Linux to avoid conflicts with python3-httpx. It enables running multiple HTTP-based probings with features like status code display, technology detection via Wappalyzer, content length, server headers, and response analysis. Designed for efficiency, it handles edge cases with retries and backoffs to manage WAFs while supporting high thread counts.
Use cases include reconnaissance for web applications, where it probes lists of hosts or URLs to gather HTTP response details, detect technologies, and filter results based on status codes, content lengths, or strings. It's ideal for large-scale scanning of hosts, CIDRs, or extracted domains from TLS/CSP probes, providing reliable results even under rate limiting or blocking conditions.
The tool's modular codebase facilitates contributions and custom configurations, with output options in plain text, CSV, or JSONL formats, including full response storage and redirect chains. It supports advanced features like VHost enumeration, HTTP/2 probing, and pipeline requests.
How It Works
httpx-toolkit uses the retryablehttp library to execute multiple concurrent HTTP probers with configurable threads (default 50) and rate limits (default 150 req/s). It performs smart protocol fallback from HTTPS to HTTP, handles retries, backoffs for WAF evasion, and processes inputs as hosts, URLs, or CIDRs. Probes extract response elements like status codes, headers, body stats, and perform specialized checks like favicon hashing, TLS data grabbing, CSP/TLS domain extraction, VHost enumeration, HTTP/2, and pipelining. Matchers and filters apply conditions on codes, lengths, strings, regex, line/word counts, and favicons to include or exclude results, with output serialization supporting JSONL with request/response chains.
Installation
sudo apt install httpx-toolkitFlags
Examples
httpx-toolkit -hhttpx-toolkit -l hosts.txthttpx-toolkit -l hosts.txt -sc -td -clhttpx-toolkit -l hosts.txt -mc 200,302httpx-toolkit -l hosts.txt -fc 403,401httpx-toolkit -l hosts.txt -o results.txt -jsonhttpx-toolkit -l hosts.txt -t 100 -rl 200httpx-toolkit -l hosts.txt -favicon -tls-grab -vhost