Problem linking libomp.dylib when trying to build package for OSX ARM

I’m currently trying to migrate a package (uproc) to OSX ARM (Feedstock, Pull Request). However, the build fails with the following error (actually a warning, but it crashes directly after that):

ld: warning: ignoring file /Users/runner/miniforge3/conda-bld/uproc_1692694922416/_build_env/lib/libomp.dylib, building for macOS-arm64 but attempting to link with file built for macOS-x86_64

The full pipeline output can be found here. The build is successful for all other targets (including OSX x86).

For me this looks like I have to somehow specify that conda (or the linker) should use the ARM OpenMP library and not the x86 one. However, I’m quite new to Conda and packaging and I have no idea how to do that. Therefore I would appreciate any help with this problem.