That makes sense.If it was not working from Windows. It sounds like you did not have enough VRAM configured for all displays to be covered. Bumping it up to 4 increased the configured VRAM. The only odd part is you need to power it off and on. A reboot will not let the VRAM kick in.
WP