An official WireGuard client is available for Windows on the Wireguard page..
Once installed with administrator rights and started, a small icon is available in the notification area or the start menu. Clicking on that, you can import a new tunnel using the downloaded configuration file.
Click on "Activate" and you will be connected to your IPFire using WireGuard.