Heritrix alternatives
Heritrix is an open-source web crawler developed by the Internet Archive. It is designed for large-scale web archiving and preserving digital content for future use. The tool is available for Linux, macOS, and Windows platforms.