Kapisi/roles/WolfPack

WolfPack is a webcrawler for the AniNIX. Public results from Core's instance will be available from [https://wolfpack.aninix.net/wolfpack the WebServer] -- this may be locked to admins, for reproducibility reasons.

Note: Code for this service is encoded in the WolfPack repo rather than here -- we just include the package.

Etymology

WolfPack is named for its operation. "Pups" live on disk as .pup files -- these will grow up and retrieve the results that feed the system. An alpha sends pack members to raise a pup and collect the results for the pack. This role will update configuration to the configuration directory.

VPN protection and Offloading.

Some countries and areas take issue with some searches and downloads. As such, the offload-wolfpack executable will allow a DarkNet service, deployed on a unique host, to merge results. In your Ansible inventory, set the wolfpack_service YAML variable for the host to offload-wolfpack@somehost.timer to enable that service instead of the normal wolfpack.timer.

This requires SSH keys to be set up between the offloading hosts and the target location, but this will run some version of wolfpack and send the results to the target. This is helpful for a server like Core that requires network uptime and stable external accessibility but needs VPN functionality for anonymity. This requires significant user intervention and customization -- this option is provided as a stub.

Alternatives

Google Alerts can provide an alternative to the Wolfpack's search pup type. Downloads can be done manually, and some torrent clients will have search and queuing options.