FYI, the following worked:
LD_PRELOAD=/soft/restricted/CNDA/sdk/2021.10.30.001/oneapi/compiler/pseudo-20211026/compiler/linux/lib/libsycl.so.5 libtbx.python modules/cctbx_project/simtbx/kokkos/tst_kokkos_lib.py
But this seems like a total hack. I suspect that there is a Python-specific issue lurking here, where Python isn’t configured to load dependent *.so files.
--Bill
From: Ecp-aurora-sdk-discuss <ecp-aurora-sdk-discuss-bounces@lists.jlse.anl.gov>
On Behalf Of Hart, William E via Ecp-aurora-sdk-discuss
Sent: Wednesday, December 15, 2021 12:44 PM
To: Zhang, Junchao <jczhang@mcs.anl.gov>; ecp-aurora-sdk-discuss@lists.jlse.anl.gov
Subject: Re: [Ecp-aurora-sdk-discuss] [EXTERNAL] Re: A sycl linking issue
Hmmm. I tried this without luck.
I’m linking libraries compiled with C++11 and C++17. Do you think that could be a root cause of this?
This error occurs when importing a *.so file into python. So maybe I need to load the symbols from the sycl library first before loading that *.so file? (I’ve tried this without luck so far…)
--Bill
From: Zhang, Junchao <jczhang@mcs.anl.gov>
Sent: Tuesday, December 14, 2021 10:34 PM
To: Hart, William E <wehart@sandia.gov>;
ecp-aurora-sdk-discuss@lists.jlse.anl.gov
Subject: [EXTERNAL] Re: [Ecp-aurora-sdk-discuss] A sycl linking issue
I met similar problems. It seems RPATH does not work. I had to set LD_LIBRARY_PATH to solve the problem. Maybe you can try that.
Thanks
-- Junchao Zhang
From:
Ecp-aurora-sdk-discuss <ecp-aurora-sdk-discuss-bounces@lists.jlse.anl.gov> on behalf of "Hart, William E via Ecp-aurora-sdk-discuss"
<ecp-aurora-sdk-discuss@lists.jlse.anl.gov>
Reply-To: "Hart, William E" <wehart@sandia.gov>
Date: Tuesday, December 14, 2021 at 12:06 PM
To: "ecp-aurora-sdk-discuss@lists.jlse.anl.gov" <ecp-aurora-sdk-discuss@lists.jlse.anl.gov>
Subject: [Ecp-aurora-sdk-discuss] A sycl linking issue
Hi, all:
I’m seeing an unusual issue loading a shared object library on Arcticus, where a Sycl library doesn’t seem to be found while resolving symbols.
I’m running a *.so file from Python on Arcitcus, and I’m getting a missing symbol error.
Traceback (most recent call last):
File "/home/ac.wehart/exafel/alcc-recipes/cctbx/modules/cctbx_project/boost_adaptbx/boost/python.py", line 22, in import_ext
try: mod = __import__(name)
ImportError: /home/ac.wehart/exafel/alcc-recipes/cctbx/build/lib/libsimtbx_kokkos.so: undefined symbol: _ZN2cl4sycl7handler24GetRangeRoundingSettingsERmS2_S2_
I’ve confirmed that the libsimtbx_kokkos.so file knows about the sycl library:
ldd /home/ac.wehart/exafel/alcc-recipes/cctbx/build/lib/libsimtbx_kokkos.so
linux-vdso.so.1 (0x00007fff01949000)
libomptbx.so => not found
libboost_thread.so.1.74.0 => not found
libboost_system.so.1.74.0 => not found
libboost_python37.so.1.74.0 => not found
libimf.so => /soft/restricted/CNDA/sdk/2021.10.30.001/oneapi/compiler/pseudo-20211026/compiler/linux/compiler/lib/intel64_lin/libimf.so (0x00007fcfd5c4c000)
libm.so.6 => /lib64/libm.so.6 (0x00007fcfd590b000)
libscitbx_boost_python.so => not found
libcctbx.so => not found
libsycl.so.5 => /soft/restricted/CNDA/sdk/2021.10.30.001/oneapi/compiler/pseudo-20211026/compiler/linux/lib/libsycl.so.5 (0x00007fcfd5628000)
Further, I’ve confirmed that the missing symbol is in this particular libsycl library:
nm -o /soft/restricted/CNDA/sdk/2021.10.30.001/oneapi/compiler/pseudo-20211026/compiler/linux/lib/libsycl.so.5 | grep GetRang
/soft/restricted/CNDA/sdk/2021.10.30.001/oneapi/compiler/pseudo-20211026/compiler/linux/lib/libsycl.so.5:00000000002b7270 T _ZN2cl4sycl7handler24GetRangeRoundingSettingsERmS2_S2_
Any clue what might be going on?
--Bill
-----Original Appointment-----
From: Muralidharan, Servesh <servesh@anl.gov>
Sent: Tuesday, December 14, 2021 11:45 AM
To: Muralidharan, Servesh; Hart, William E
Subject: [EXTERNAL] CCTBX - ExaFEL Kickoff
When: Thursday, December 16, 2021 4:00 PM-5:00 PM (UTC-06:00) Central Time (US & Canada).
Where:
________________________________________________________________________________
Microsoft Teams meeting
Join on your computer or mobile app
Or call in (audio only)
+1 630-556-7958,,480495794#
United States, Big Rock
Phone Conference ID:
480 495 794#
________________________________________________________________________________