Testing a software automatically against more than 50 windows builds using VMware scripting?

Lets say you have a software (installer), and you want to automatically test it against more than 50-60 builds of windows (from windows xp to 10), and make sure it installs successfully, and do some stress testing and make sure there is no process crash or bugcheck (BSOD) happening.

​

The best thing that came to my mind was using VMware scripting and writing a script that uploads the latest build (installer) to the VMs (obviously on a very high end server), install it, does some stress testing stuff, collects some logs and reports backs the results.

​

Is this the best way to approach this? How do big companies deal with this? Is there any open source project for this?

​