Leaving the root cause here in case someone eventually has a similar issue: By mistake I used the M4F library instead of the M4 one which would have been correct for my core.
It might be a good thing to check for the presence of the FPU during initialization in the M4F library and return an error in case it is not present.
