The LEDs should start blinking slightly faster after the the button is released. Have tried both, holding the button for 4 and 8 seconds, but the device I tested entered bootloader menu without any issues.
In this case, return the device.
Best regards.