The module was the following: python/2020.09.15.001 The oneapi module is supposed to provide python3 not sure if it provides as conda. If so ill see if that works.

On May 10, 2021, at 3:10 PM, Muralidharan, Servesh <[email protected]> wrote:

Hi Shahzeb,

I don’t have access to those files. I don’t think there was a generic version of Conda maintained via module file at JLSE, so I’m not sure where you picked this up from.

JLSE is not a production system, it’s an evolving environment that is focused on improving and supporting early testbed platforms, so there will be deprecation/updates on a regular basis. That said we don’t generally remove module file unless there was a very specific reason, i.e. The old versions of the SDK are no longer supported, or the specific platform was migrated to a new version.

Could you clarify which module file you were using and from where and I can point you to the reason and when it was removed. Also, which platform/project are you focusing on? If its related Intel testbeds users get regular updates on this mailing list related to these changes.

-- Servesh

From: Shahzeb Siddiqui <[email protected]> Date: Monday, May 10, 2021 at 1:49 PM To: Muralidharan, Servesh <[email protected]> Cc: [email protected] <[email protected]> Subject: Re: [Ecp-aurora-sdk-discuss] Need help setting up conda environment

Hi Servesh,

I had a CI setup for running regression test for buildtest https://gitlab.jlse.anl.gov/e4s/shahzebsiddiqui/buildtest <https://gitlab.jlse.anl.gov/e4s/shahzebsiddiqui/buildtest> that relied on python module see gitlab pipeline https://gitlab.jlse.anl.gov/e4s/shahzebsiddiqui/buildtest/-/blob/devel/.gitl... <https://gitlab.jlse.anl.gov/e4s/shahzebsiddiqui/buildtest/-/blob/devel/.gitlab/jlse.yml>. Once this python module was removed the CI job failed now i have to retool my CI job to fix this. It was not cool, removing a modulefile if someone else depends on it and break their workflow. I have been deploying software stack for past 5 yearss and I never removed modulefile because of this exact reason. You don’t know who relies on the modulefile and their workflows are broken and now i have to spend time figuring this out.

I will work through the link perhaps in oneapi https://wiki.jlse.anl.gov/display/inteldga/oneAPI+Software <https://wiki.jlse.anl.gov/display/inteldga/oneAPI+Software> and see if that works. As a end-user it is confusing which sub-page i should reference https://wiki.jlse.anl.gov/display/inteldga/Frameworks+and+Libraries <https://wiki.jlse.anl.gov/display/inteldga/Frameworks+and+Libraries>, i am just interested in conda. Most of the pages are geared towards setting up an environment for a specific tool pytorch, numpy, oneDNN, etc… I just need conda. Perhaps there should be a main page just to outline which module to load to get conda.

It is not clear to me which module i should be loading to get conda as there are too several modules that provide conda tool but modulefile are tailored to the tool.

Regards, Shahzeb

On May 10, 2021, at 2:35 PM, Muralidharan, Servesh <[email protected] <mailto:[email protected]>> wrote:

Hi Shahzeb,

What is your specific requirement?

If you are looking for standard Conda install you are welcome to install this to your home directory of GPFS filesystem. JLSE has too many different architectures and platforms to maintain a conda version for each environment. If your focus is more towards Intel GPUs then the recommendation is to use the Conda env or follow the instructions specific to the frameworks section of the wiki,https://wiki.jlse.anl.gov/display/inteldga/Frameworks+and+Libraries <https://wiki.jlse.anl.gov/display/inteldga/Frameworks+and+Libraries>

JLSE doesn’t have a dedicated software support staff maintaining the packages and most that are present are through user driven collaboration and specific Intel/Argonne POCs.

-- Servesh

From: Ecp-aurora-sdk-discuss <[email protected] <mailto:[email protected]>> on behalf of Shahzeb Siddiqui via Ecp-aurora-sdk-discuss <[email protected] <mailto:[email protected]>> Date: Monday, May 10, 2021 at 12:23 PM To: [email protected] <mailto:[email protected]> <[email protected] <mailto:[email protected]>> Subject: [Ecp-aurora-sdk-discuss] Need help setting up conda environment

Hi Ben,

This is in response to AREQ0437155 <https://servicenow.anl.gov/nav_to.do?uri=u_ad_hoc_request.do%3Fsys_id=b5caf6491b6ba4500205ed3ce54bcb08%26sysparm_stack=u_ad_hoc_request_list.do%3Fsysparm_query=active=true> I tried using module load pytorch/2020.12.31.001-conda to setup a blank conda environment and i am running into issue.

shahzebsiddiqui@jlselogin6:~> conda create env -n buildtest -y Solving environment: failed

PackagesNotFoundError: The following packages are not available from current channels:

- env

Current channels:

- https://repo.anaconda.com/pkgs/main/linux-64 <https://repo.anaconda.com/pkgs/main/linux-64> - https://repo.anaconda.com/pkgs/main/noarch <https://repo.anaconda.com/pkgs/main/noarch> - https://repo.anaconda.com/pkgs/free/linux-64 <https://repo.anaconda.com/pkgs/free/linux-64> - https://repo.anaconda.com/pkgs/free/noarch <https://repo.anaconda.com/pkgs/free/noarch> - https://repo.anaconda.com/pkgs/r/linux-64 <https://repo.anaconda.com/pkgs/r/linux-64> - https://repo.anaconda.com/pkgs/r/noarch <https://repo.anaconda.com/pkgs/r/noarch> - https://repo.anaconda.com/pkgs/pro/linux-64 <https://repo.anaconda.com/pkgs/pro/linux-64> - https://repo.anaconda.com/pkgs/pro/noarch <https://repo.anaconda.com/pkgs/pro/noarch>

To search for alternate channels that may provide the conda package you're looking for, navigate to

https://anaconda.org <https://anaconda.org/>

and use the search bar at the top of the page.

Can you send me instructions on how to setup a blank conda environment, the instructions are bit unclear. There should be a conda or python module doesn’t make sense i have to load pytorch to access conda binaries. It already setups up an active conda environment named “preview3_pt” this doesn’t work well in a CI workflow if i already have something activated Shown below is the output of “conda env list” it shows many environment but this one is active

preview3_pt * /soft/restricted/CNDA/pytorchPOC/install/anaconda3/envs/preview3_pt

I tried to deactivate environment but and rerun same command it didn’t work. It would be helpful to get some instructions in wiki for loading conda at JLSE without using pytorch since i dont need this tool. What i expect ismodule load conda and it should give me binaries to conda package and drop me into an empty environment then we can just create environment in our user space.

Regards, Shahzeb