As part of SharePoint 2016 pre-requisite, you need to install AppFabric 1.1 for Windows Server.
I ran the executable and select the features (Hosting Services, Cache Client and Hosting Administration) and began to install.
On the installation summary page, the features had failed to installed. No information about why it failed. Clicked on the Detailed Installation Report hyperlink.

After checking the Detailed Installation report the only error was a 1603 error. Nothing helpful.

The below link provides a full list of App Fabric install errors:
Hmmm weird, not a lot of useful information for my particular issue.
I then started hunting for a fix based off the error message.
During some research on several different websites, found that AppFabric uses the Powershell Modules to install.
I had a look at the Path in the Environment Variables. There was path to the SQL Server Powershell Modules. This is because it was a standalone SharePoint 2016 install and I installed SQL Server before installing the Pre-Reqs.

The solution:
- Install SQL Server after the SharePoint 2016 Pre-Reqs.
- If you have already installed SQL Server before the Pre-Reqs, then copy the SQL Server Powershell Modules out from the System Variables. Install the Pre-Reqs and add the SQL Server PowerShell Modules back into the System Variable.