More information found. The N3E connected to a consumer router (old dlink ebr-2310) received an address with no issues and received it very fast (~30mS), the isc-dhcp-server has about a ~1 second delay on the response to the dhcp discover. My theory is the slower response by the isc-dhcp-server is causing the N3E to timeout waiting for the response.
This thread is where my theory is coming from. Is there a way to have the N3E be patient waiting for the dhcp server?
The first 3 lines are the dlink router and the second 2 are the isc-dhcp-server