httprobe
httprobe takes a list of domains and probes for working HTTP and HTTPS servers. It is a tool to test a domains list by checking for active web servers.
Description
httprobe is designed to efficiently verify which domains from a provided list have working HTTP or HTTPS servers. This is particularly useful in reconnaissance phases of security assessments where large lists of potential domains need to be checked for live web services.
The tool supports customizable concurrency levels, allowing users to balance speed and resource usage. It can prioritize HTTPS probes or add custom protocol-port combinations, making it adaptable to various probing scenarios.
By focusing on quick HTTP/HTTPS detection, httprobe helps narrow down active hosts from extensive domain inventories, streamlining further analysis workflows.
How It Works
httprobe reads a list of domains and sends concurrent HTTP and HTTPS requests, split equally by default. It uses a configurable concurrency level (default 20) to probe multiple domains simultaneously, checking for responses that indicate working servers. Additional probes can be specified with proto:port, and HTTPS can be preferred over HTTP.
Installation
sudo apt install httprobeFlags
Examples
httprobe -hcat domains.txt | httprobehttprobe -c 50 domains.txthttprobe -method HEAD domains.txthttprobe -p https:8443 domains.txthttprobe -prefer-https domains.txthttprobe -c 10 -method GET -prefer-https domains.txt