November 2015 - commits - mailman3.cels.anl.gov

[mpich] MPICH primary repository annotated tag, v3.2, created. v3.2
by noreply＠mpich.org 11 Nov '15

11 Nov '15

This is an automated email from the git hooks/post-receive script. It was generated because a ref change was pushed to the repository containing the project "MPICH primary repository". The annotated tag, v3.2 has been created at 6fd39af121412720ed4406928716cbdf6f18e6f6 (tag) tagging a4121ab15f4660041503b9f967afded35c2024ad (commit) replaces v3.2rc2 tagged by Ken Raffenetti on Wed Nov 11 22:34:45 2015 -0600 - Log ----------------------------------------------------------------- tagging 'v3.2' Pavan Balaji (1): Update version string for the 3.2 release. ----------------------------------------------------------------------- hooks/post-receive -- MPICH primary repository

1 0

[mpich] MPICH primary repository branch, master, updated. v3.2rc2-1-ga4121ab
by noreply＠mpich.org 10 Nov '15

10 Nov '15

This is an automated email from the git hooks/post-receive script. It was generated because a ref change was pushed to the repository containing the project "MPICH primary repository". The branch, master has been updated via a4121ab15f4660041503b9f967afded35c2024ad (commit) from ac88ffc3e89d838d786d52580b12d6863864ecc8 (commit) Those revisions listed above that are new to this repository have not appeared on any other notification email; so we list those revisions in full, below. - Log ----------------------------------------------------------------- http://git.mpich.org/mpich.git/commitdiff/a4121ab15f4660041503b9f967afded35… commit a4121ab15f4660041503b9f967afded35c2024ad Author: Pavan Balaji <balaji(a)anl.gov> Date: Mon Nov 9 19:17:02 2015 -0600 Update version string for the 3.2 release. ABI string is set to 13:0:1 since we added the NBC I/O routines, but are still backward compatible with the previous libmpi-12 series. Signed-off-by: Ken Raffenetti <raffenet(a)mcs.anl.gov> diff --git a/maint/version.m4 b/maint/version.m4 index fa5951e..d3e271e 100644 --- a/maint/version.m4 +++ b/maint/version.m4 @@ -14,7 +14,7 @@ # changing this by playing with diversions, but then we would probably be # playing with autotools-fire. -m4_define([MPICH_VERSION_m4],[3.2rc2])dnl +m4_define([MPICH_VERSION_m4],[3.2])dnl m4_define([MPICH_RELEASE_DATE_m4],[unreleased development copy])dnl # For libtool ABI versioning rules see: @@ -35,6 +35,6 @@ m4_define([MPICH_RELEASE_DATE_m4],[unreleased development copy])dnl # libmpi so version only includes functionality defined in the MPI # standard, and does not include MPIX_ functions and C++ bindings. -m4_define([libmpi_so_version_m4],[0:0:0])dnl +m4_define([libmpi_so_version_m4],[13:0:1])dnl [#] end of __file__ ----------------------------------------------------------------------- Summary of changes: maint/version.m4 | 4 ++-- 1 files changed, 2 insertions(+), 2 deletions(-) hooks/post-receive -- MPICH primary repository

1 0

[mpich] MPICH primary repository annotated tag, v3.2rc2, created. v3.2rc2
by noreply＠mpich.org 04 Nov '15

04 Nov '15

This is an automated email from the git hooks/post-receive script. It was generated because a ref change was pushed to the repository containing the project "MPICH primary repository". The annotated tag, v3.2rc2 has been created at 7e42991d5e3a62c86449e50b73fe65ca3f5f7354 (tag) tagging ac88ffc3e89d838d786d52580b12d6863864ecc8 (commit) replaces v3.2rc1 tagged by Ken Raffenetti on Wed Nov 4 09:59:53 2015 -0600 - Log ----------------------------------------------------------------- tagging 'v3.2rc2' Hajime Fujita (1): Correct Compare_and_swap usage in test cases Halim Amer (2): Fixed the incorrect BLCR linking flag in configure.ac Added an Allgather test with an int+long struct DDT Hari Subramoni (1): test/mpi/pt2pt: check large message count Jeff Squyres (1): MPI_Aint_* tests: use MPI_INTEGER datatype in Fortran Ken Raffenetti (4): netmod/portals4: better check for datatype mismatch ch3/vc: set g_num_nodes directly from mapping ch3/vc: changes to node id mapping test/mpi/.gitignore: add missing f90 test Lena Oden (1): netmod/mxm: mask error bits for tags Pavan Balaji (2): Check if the names are identical before creating symlinks. Update version number of release. Sangmin Seo (2): Add the use_rmk parameter to HYDT_bsci_launch_procs. Use strtok_r to parse the same string recursively. Yanfei Guo (11): maint/jenkins: print hostname in test worker scripts maint/jenkins: add multi-node test scripts maint/jenkins: remove killing for hydra_pmi_proxy maint/jenkins: remove MXM_SHM_KCOPY_MODE=off for testing maint/jenkins: build mpich-tarball on /sandbox maint/jenkins: xfail test failing on Portals 4 bug maint/jenkins: add timeout script for multinode jobs maint/jenkins: fix tarball build script maint/jenkins: fix git clean maint/jenkins: add MPICH copyright to Jenkins scripts maint: remove Jenkins scripts ----------------------------------------------------------------------- hooks/post-receive -- MPICH primary repository

1 0

[mpich] MPICH primary repository branch, master, updated. v3.2rc1-25-gac88ffc
by noreply＠mpich.org 03 Nov '15

03 Nov '15

This is an automated email from the git hooks/post-receive script. It was generated because a ref change was pushed to the repository containing the project "MPICH primary repository". The branch, master has been updated via ac88ffc3e89d838d786d52580b12d6863864ecc8 (commit) from 78e8ff9e910e2c1b9e7add0eaf844c8205dd9c21 (commit) Those revisions listed above that are new to this repository have not appeared on any other notification email; so we list those revisions in full, below. - Log ----------------------------------------------------------------- http://git.mpich.org/mpich.git/commitdiff/ac88ffc3e89d838d786d52580b12d6863… commit ac88ffc3e89d838d786d52580b12d6863864ecc8 Author: Ken Raffenetti <raffenet(a)mcs.anl.gov> Date: Tue Nov 3 09:31:57 2015 -0600 test/mpi/.gitignore: add missing f90 test No reviewer. diff --git a/test/mpi/.gitignore b/test/mpi/.gitignore index aa8caa4..9be20f6 100644 --- a/test/mpi/.gitignore +++ b/test/mpi/.gitignore @@ -293,6 +293,7 @@ /f90/attr/commattrf90.f90 /f90/attr/commattr2f90.f90 /f90/attr/commattr3f90.f90 +/f90/attr/commattr4f90.f90 /f90/attr/typeattrf90.f90 /f90/attr/typeattr2f90.f90 /f90/attr/typeattr3f90.f90 ----------------------------------------------------------------------- Summary of changes: test/mpi/.gitignore | 1 + 1 files changed, 1 insertions(+), 0 deletions(-) hooks/post-receive -- MPICH primary repository

1 0

[mpich] MPICH primary repository branch, master, updated. v3.2rc1-24-g78e8ff9
by noreply＠mpich.org 02 Nov '15

02 Nov '15

This is an automated email from the git hooks/post-receive script. It was generated because a ref change was pushed to the repository containing the project "MPICH primary repository". The branch, master has been updated via 78e8ff9e910e2c1b9e7add0eaf844c8205dd9c21 (commit) from 0c42a934a6275f42faba8f397ae15957de3893dd (commit) Those revisions listed above that are new to this repository have not appeared on any other notification email; so we list those revisions in full, below. - Log ----------------------------------------------------------------- http://git.mpich.org/mpich.git/commitdiff/78e8ff9e910e2c1b9e7add0eaf844c820… commit 78e8ff9e910e2c1b9e7add0eaf844c8205dd9c21 Author: Pavan Balaji <balaji(a)anl.gov> Date: Mon Nov 2 17:01:33 2015 -0600 Update version number of release. Signed-off-by: Ken Raffenetti <raffenet(a)mcs.anl.gov> diff --git a/maint/version.m4 b/maint/version.m4 index 4fe0acd..fa5951e 100644 --- a/maint/version.m4 +++ b/maint/version.m4 @@ -14,7 +14,7 @@ # changing this by playing with diversions, but then we would probably be # playing with autotools-fire. -m4_define([MPICH_VERSION_m4],[3.2rc1])dnl +m4_define([MPICH_VERSION_m4],[3.2rc2])dnl m4_define([MPICH_RELEASE_DATE_m4],[unreleased development copy])dnl # For libtool ABI versioning rules see: ----------------------------------------------------------------------- Summary of changes: maint/version.m4 | 2 +- 1 files changed, 1 insertions(+), 1 deletions(-) hooks/post-receive -- MPICH primary repository

1 0

[mpich] MPICH primary repository branch, master, updated. v3.2rc1-23-g0c42a93
by noreply＠mpich.org 02 Nov '15

02 Nov '15

This is an automated email from the git hooks/post-receive script. It was generated because a ref change was pushed to the repository containing the project "MPICH primary repository". The branch, master has been updated via 0c42a934a6275f42faba8f397ae15957de3893dd (commit) via 51cf1990939292842d323456218a3b8e6cee0086 (commit) from b5625665e0bbf4df1e8c44a18b7a9634e0ebea39 (commit) Those revisions listed above that are new to this repository have not appeared on any other notification email; so we list those revisions in full, below. - Log ----------------------------------------------------------------- http://git.mpich.org/mpich.git/commitdiff/0c42a934a6275f42faba8f397ae15957d… commit 0c42a934a6275f42faba8f397ae15957de3893dd Author: Ken Raffenetti <raffenet(a)mcs.anl.gov> Date: Tue Sep 22 10:10:25 2015 -0500 ch3/vc: changes to node id mapping Failures occurred with several of the spawn tests when run across multiple nodes. The problem was the result of the node id mapping for the spawned processes. If the spawned processes launched on only a subset of nodes, they incorrectly reported a maximum node id in MPID_Get_max_node_id. Our approach to fix this is to report the maximum node id as simply the largest id found during mapping. All references to the value are updated to reflect it as the maximum node id, not a calculation of the number of nodes, as that was inaccurate. Reported-by: Artem Yalozo <artem.v.yalozo(a)intel.com> Signed-off-by: Pavan Balaji <balaji(a)anl.gov> diff --git a/src/mpid/ch3/src/mpid_vc.c b/src/mpid/ch3/src/mpid_vc.c index 010aeb7..8a616e1 100644 --- a/src/mpid/ch3/src/mpid_vc.c +++ b/src/mpid/ch3/src/mpid_vc.c @@ -655,7 +655,7 @@ int MPIDI_VC_Init( MPIDI_VC_t *vc, MPIDI_PG_t *pg, int rank ) /* ----------------------------------------------------------------------- */ /* Routines to vend topology information. */ -static MPID_Node_id_t g_num_nodes = 0; +static MPID_Node_id_t g_max_node_id = -1; char MPIU_hostname[MAX_HOSTNAME_LEN] = "_UNKNOWN_"; /* '_' is an illegal char for a hostname so */ /* this will never match */ @@ -678,7 +678,7 @@ int MPID_Get_node_id(MPID_Comm *comm, int rank, MPID_Node_id_t *id_p) int MPID_Get_max_node_id(MPID_Comm *comm, MPID_Node_id_t *max_id_p) { /* easiest way to implement this is to track it at PG create/destroy time */ - *max_id_p = g_num_nodes - 1; + *max_id_p = g_max_node_id; MPIU_Assert(*max_id_p >= 0); return MPI_SUCCESS; } @@ -922,26 +922,11 @@ done: #endif -#if defined HAVE_QSORT -static int compare_ints(const void *orig_x, const void *orig_y) -{ - int x = *((int *) orig_x); - int y = *((int *) orig_y); - - if (x == y) - return 0; - else if (x < y) - return -1; - else - return 1; -} -#endif - #undef FUNCNAME #define FUNCNAME populate_ids_from_mapping #undef FCNAME #define FCNAME MPL_QUOTE(FUNCNAME) -static int populate_ids_from_mapping(char *mapping, MPID_Node_id_t *num_nodes, MPIDI_PG_t *pg, int *did_map) +static int populate_ids_from_mapping(char *mapping, MPID_Node_id_t *max_node_id, MPIDI_PG_t *pg, int *did_map) { int mpi_errno = MPI_SUCCESS; /* PMI_process_mapping is available */ @@ -952,7 +937,6 @@ static int populate_ids_from_mapping(char *mapping, MPID_Node_id_t *num_nodes, M int block, block_node, node_proc; int *tmp_rank_list, i; int found_wrap; - MPIU_CHKLMEM_DECL(1); *did_map = 1; /* reset upon failure */ @@ -992,50 +976,14 @@ static int populate_ids_from_mapping(char *mapping, MPID_Node_id_t *num_nodes, M } } -break_out: - /* Find the number of unique node ids. This is the classic - * element distinctness problem, for which the lower bound time - * complexity is O(N log N). Here we use a simple algorithm to - * sort the array and find the number of changes in the array - * through a linear search. There are certainly better algorithms - * available, which can be employed. */ - MPIU_CHKLMEM_MALLOC(tmp_rank_list, int *, pg->size * sizeof(int), mpi_errno, "tmp_rank_list"); + break_out: + /* identify maximum node id */ + *max_node_id = -1; for (i = 0; i < pg->size; i++) - tmp_rank_list[i] = pg->vct[i].node_id; - -#if defined HAVE_QSORT - qsort(tmp_rank_list, pg->size, sizeof(int), compare_ints); -#else - /* fall through to insertion sort if qsort is unavailable/disabled */ - { - int j, tmp; - - for (i = 1; i < pg->size; ++i) { - tmp = tmp_rank_list[i]; - j = i - 1; - while (1) { - if (tmp_rank_list[j] > tmp) { - tmp_rank_list[j+1] = tmp_rank_list[j]; - j = j - 1; - if (j < 0) - break; - } - else { - break; - } - } - tmp_rank_list[j+1] = tmp; - } - } -#endif - - *num_nodes = 1; - for (i = 1; i < pg->size; i++) - if (tmp_rank_list[i] != tmp_rank_list[i-1]) - (*num_nodes)++; + if (pg->vct[i].node_id + 1 > *max_node_id) + *max_node_id = pg->vct[i].node_id; fn_exit: - MPIU_CHKLMEM_FREEALL(); MPIU_Free(mb); return mpi_errno; fn_fail: @@ -1054,8 +1002,8 @@ fn_fail: Fallback Algorithm: Each process kvs_puts its hostname and stores the total number of - processes (g_num_global). Each process determines the number of nodes - (g_num_nodes) and assigns a node id to each process (g_node_ids[]): + processes (g_num_global). Each process determines maximum node id + (g_max_node_id) and assigns a node id to each process (g_node_ids[]): For each hostname the process seaches the list of unique nodes names (node_names[]) for a match. If a match is found, the node id @@ -1089,7 +1037,7 @@ int MPIDI_Populate_vc_node_ids(MPIDI_PG_t *pg, int our_pg_rank) MPL_env2int("PMI_SUBVERSION", &pmi_subversion); if (pg->size == 1) { - pg->vct[0].node_id = g_num_nodes++; + pg->vct[0].node_id = ++g_max_node_id; goto fn_exit; } @@ -1112,7 +1060,7 @@ int MPIDI_Populate_vc_node_ids(MPIDI_PG_t *pg, int our_pg_rank) if (no_local) { /* just assign 0 to n-1 as node ids and bail */ for (i = 0; i < pg->size; ++i) { - pg->vct[i].node_id = g_num_nodes++; + pg->vct[i].node_id = ++g_max_node_id; } goto fn_exit; } @@ -1133,7 +1081,7 @@ int MPIDI_Populate_vc_node_ids(MPIDI_PG_t *pg, int our_pg_rank) if (mpi_errno) MPIR_ERR_POP(mpi_errno); MPIR_ERR_CHKINTERNAL(!found, mpi_errno, "PMI_process_mapping attribute not found"); /* this code currently assumes pg is comm_world */ - mpi_errno = populate_ids_from_mapping(process_mapping, &g_num_nodes, pg, &did_map); + mpi_errno = populate_ids_from_mapping(process_mapping, &g_max_node_id, pg, &did_map); if (mpi_errno) MPIR_ERR_POP(mpi_errno); MPIR_ERR_CHKINTERNAL(!did_map, mpi_errno, "unable to populate node ids from PMI_process_mapping"); } @@ -1163,7 +1111,7 @@ int MPIDI_Populate_vc_node_ids(MPIDI_PG_t *pg, int our_pg_rank) if (pmi_errno == 0) { int did_map = 0; /* this code currently assumes pg is comm_world */ - mpi_errno = populate_ids_from_mapping(value, &g_num_nodes, pg, &did_map); + mpi_errno = populate_ids_from_mapping(value, &g_max_node_id, pg, &did_map); if (mpi_errno) MPIR_ERR_POP(mpi_errno); if (did_map) { goto odd_even_cliques; @@ -1193,22 +1141,22 @@ int MPIDI_Populate_vc_node_ids(MPIDI_PG_t *pg, int our_pg_rank) node_names[i][0] = '\0'; } - g_num_nodes = 0; /* defensive */ + g_max_node_id = 0; /* defensive */ for (i = 0; i < pg->size; ++i) { - MPIU_Assert(g_num_nodes < pg->size); + MPIU_Assert(g_max_node_id < pg->size); if (i == our_pg_rank) { /* This is us, no need to perform a get */ - MPL_snprintf(node_names[g_num_nodes], key_max_sz, "%s", MPIU_hostname); + MPL_snprintf(node_names[g_max_node_id], key_max_sz, "%s", MPIU_hostname); } else { memset(key, 0, key_max_sz); MPL_snprintf(key, key_max_sz, "hostname[%d]", i); - pmi_errno = PMI_KVS_Get(kvs_name, key, node_names[g_num_nodes], key_max_sz); + pmi_errno = PMI_KVS_Get(kvs_name, key, node_names[g_max_node_id], key_max_sz); MPIR_ERR_CHKANDJUMP1(pmi_errno != PMI_SUCCESS, mpi_errno, MPI_ERR_OTHER, "**pmi_kvs_get", "**pmi_kvs_get %d", pmi_errno); } @@ -1216,13 +1164,13 @@ int MPIDI_Populate_vc_node_ids(MPIDI_PG_t *pg, int our_pg_rank) /* FIXME:need a better algorithm -- this one does O(N^2) strncmp()s! */ /* The right fix is to get all this information from the process manager, rather than bother with this hostname hack at all. */ - for (j = 0; j < g_num_nodes; ++j) - if (!strncmp(node_names[j], node_names[g_num_nodes], key_max_sz)) + for (j = 0; j < g_max_node_id + 1; ++j) + if (!strncmp(node_names[j], node_names[g_max_node_id], key_max_sz)) break; - if (j == g_num_nodes) - ++g_num_nodes; + if (j == g_max_node_id + 1) + ++g_max_node_id; else - node_names[g_num_nodes][0] = '\0'; + node_names[g_max_node_id][0] = '\0'; pg->vct[i].node_id = j; } @@ -1234,8 +1182,8 @@ odd_even_cliques: I think this is OK */ for (i = 0; i < pg->size; ++i) if (i & 0x1) - pg->vct[i].node_id += g_num_nodes; - g_num_nodes *= 2; + pg->vct[i].node_id += g_max_node_id + 1; + g_max_node_id = (g_max_node_id + 1) * 2; } #endif http://git.mpich.org/mpich.git/commitdiff/51cf1990939292842d323456218a3b8e6… commit 51cf1990939292842d323456218a3b8e6cee0086 Author: Ken Raffenetti <raffenet(a)mcs.anl.gov> Date: Wed Oct 28 09:09:08 2015 -0500 ch3/vc: set g_num_nodes directly from mapping Eliminate unneeded and incorrectly typed temporary variable. Set the global directly. Signed-off-by: Pavan Balaji <balaji(a)anl.gov> diff --git a/src/mpid/ch3/src/mpid_vc.c b/src/mpid/ch3/src/mpid_vc.c index 8090a16..010aeb7 100644 --- a/src/mpid/ch3/src/mpid_vc.c +++ b/src/mpid/ch3/src/mpid_vc.c @@ -941,7 +941,7 @@ static int compare_ints(const void *orig_x, const void *orig_y) #define FUNCNAME populate_ids_from_mapping #undef FCNAME #define FCNAME MPL_QUOTE(FUNCNAME) -static int populate_ids_from_mapping(char *mapping, int *num_nodes, MPIDI_PG_t *pg, int *did_map) +static int populate_ids_from_mapping(char *mapping, MPID_Node_id_t *num_nodes, MPIDI_PG_t *pg, int *did_map) { int mpi_errno = MPI_SUCCESS; /* PMI_process_mapping is available */ @@ -1128,16 +1128,14 @@ int MPIDI_Populate_vc_node_ids(MPIDI_PG_t *pg, int our_pg_rank) int rank; int block, block_node, node_proc; int did_map = 0; - int num_nodes = 0; mpi_errno = PMI2_Info_GetJobAttr("PMI_process_mapping", process_mapping, sizeof(process_mapping), &found); if (mpi_errno) MPIR_ERR_POP(mpi_errno); MPIR_ERR_CHKINTERNAL(!found, mpi_errno, "PMI_process_mapping attribute not found"); /* this code currently assumes pg is comm_world */ - mpi_errno = populate_ids_from_mapping(process_mapping, &num_nodes, pg, &did_map); + mpi_errno = populate_ids_from_mapping(process_mapping, &g_num_nodes, pg, &did_map); if (mpi_errno) MPIR_ERR_POP(mpi_errno); MPIR_ERR_CHKINTERNAL(!did_map, mpi_errno, "unable to populate node ids from PMI_process_mapping"); - g_num_nodes = num_nodes; } #else /* USE_PMI2_API */ if (our_pg_rank == -1) { @@ -1164,11 +1162,9 @@ int MPIDI_Populate_vc_node_ids(MPIDI_PG_t *pg, int our_pg_rank) pmi_errno = PMI_KVS_Get(kvs_name, "PMI_process_mapping", value, val_max_sz); if (pmi_errno == 0) { int did_map = 0; - int num_nodes = 0; /* this code currently assumes pg is comm_world */ - mpi_errno = populate_ids_from_mapping(value, &num_nodes, pg, &did_map); + mpi_errno = populate_ids_from_mapping(value, &g_num_nodes, pg, &did_map); if (mpi_errno) MPIR_ERR_POP(mpi_errno); - g_num_nodes = num_nodes; if (did_map) { goto odd_even_cliques; } ----------------------------------------------------------------------- Summary of changes: src/mpid/ch3/src/mpid_vc.c | 106 ++++++++++--------------------------------- 1 files changed, 25 insertions(+), 81 deletions(-) hooks/post-receive -- MPICH primary repository

1 0