***************************************** *** Specfem3D MPI database generation *** ***************************************** Running Git package version of the code: v2.0.2-3292-g7ab2414 which is Git commit 7ab2414052ea4f35752821a1e137ac94c9aa7b59 dating From Date: Sat Jul 3 01:19:44 2021 +0200 This is process 0 There are 64 MPI processes Processes are numbered from 0 to 63 There is a total of 64 slices NGLLX = 5 NGLLY = 5 NGLLZ = 5 Shape functions defined by NGNOD = 8 control nodes Surface shape functions defined by NGNOD2D = 4 control nodes Beware! Curvature (i.e. HEX27 elements) is not handled by our internal mesher velocity model: tomo using UTM projection in region 44 no attenuation no anisotropy no oceans incorporating Stacey absorbing conditions using a CMTSOLUTION source with a Gaussian source time function ************************************ reading partition files in the model ************************************ external mesh points : 49245888 defined materials : 1 undefined materials : 0 total number of spectral elements: 5898240 absorbing boundaries: xmin,xmax : 12288 12288 ymin,ymax : 12288 12288 bottom,top: 36864 589824 total number of C-PML elements in the global mesh: 0 number of MPI partition interfaces: 420 minimum memory used so far : 329.534851 MB per process minimum total memory requested : 1488.57397 MB per process create regions: ...allocating arrays NGLLX = 5 NGLLY = 5 NGLLZ = 5 NGNOD = 8 NGNOD2D = 4 main process setup: nspec = 92160 separating regular/irregular element shapes nspec regular = 0 nspec irregular = 92160 absorbing boundary faces: num_abs_boundary_faces = 3648 free surface faces: num_free_surface_faces = 9216 File DATA/Par_file_faults not found: assuming that there are no faults ...setting up jacobian ...indexing global points creating ibool indexing : x min/max = 449544.719 / 1036138.75 creating indirect addressing: nglob = 6026357 creating unique point locations ...preparing MPI interfaces number of interfaces : 3 creating MPI indexing : x min/max = 449544.719 / 1036138.75 tolerance = 5.8659401601366896E-005 total MPI interface points: 5621364 total assembled MPI interface points: 5562956 ...setting up absorbing boundaries boundary xmin : 1536 boundary xmax : 0 boundary ymin : 1536 boundary ymax : 0 boundary bottom : 576 boundary top : 9216 absorbing boundary: total number of free faces = 589824 total number of faces = 86016 ...setting up mesh surface ...determining velocity model number of tomographic models = 1 maximum number of data records = 8000000 size of required tomography arrays = 122.070312 MB per process material id: -1 file : ../DATA/tomo_files/tomography_model.xyz data format: #x #y #z #vp #vs #density number of grid points = NX*NY*NZ: 8000000 10 % time remaining: 2.8502050709893226E-008 s 20 % time remaining: 2.5172665237366517E-008 s 30 % time remaining: 2.1894492742895436E-008 s 40 % time remaining: 1.8731489124976639E-008 s 50 % time remaining: 1.5611487812855287E-008 s 60 % time remaining: 1.2476644787932341E-008 s 70 % time remaining: 9.3533773080745672E-009 s 80 % time remaining: 6.2349042936678234E-009 s 90 % time remaining: 3.1198479141472145E-009 s 100 % time remaining: 0.0000000000000000 s ...detecting acoustic-elastic-poroelastic surfaces total acoustic elements : 0 total elastic elements : 5898240 total poroelastic elements: 0 acoustic - elastic coupling : total number of faces = 0 acoustic - poroelastic coupling : total number of faces = 0 elastic - poroelastic coupling : total number of faces = 0 ...element inner/outer separation for overlapping of communications with calculations: percentage of edge elements 3.52322388 % percentage of volume elements 96.4767761 % ...element mesh coloring use coloring = F ...external binary models no external binary model used ...creating mass matrix ...saving databases using binary file format database file (for rank 0): ../OUTPUT_FILES/DATABASES_MPI/proc000000_external_mesh.bin ...checking mesh resolution Mesh resolution: ******** minimum and maximum number of elements and points in the CUBIT + SCOTCH mesh: NSPEC_global_min = 92160 NSPEC_global_max = 92160 NSPEC_global_max / NSPEC_global_min imbalance = 1.00000000 = 0.00000000 % NSPEC_global_sum = 5898240 NGLOB_global_min = 6026357 NGLOB_global_max = 6026357 NGLOB_global_max / NGLOB_global_min imbalance = 1.00000000 = 0.00000000 % NGLOB_global_sum = 385686848 If you have elements of a single type (all acoustic, all elastic, all poroelastic, and without CPML) in the whole mesh, then there should be no significant imbalance in the above numbers. Otherwise, it is normal to have imbalance in elements and points because the domain decomposer compensates for the different cost of different elements by partitioning them unevenly among processes. ******** ******** Model: P velocity min,max = 1137.50000 5600.00000 Model: S velocity min,max = 650.000000 3200.00000 Model: Poisson's ratio min,max = 0.257568449 0.257582456 ******** ********************************************* *** Verification of simulation parameters *** ********************************************* *** Xmin and Xmax of the model = 449544.719 1036138.75 *** Ymin and Ymax of the model = 2765040.75 3220485.75 *** Zmin and Zmax of the model = -60000.0000 7965.12207 *** Max GLL point distance = 1000.06250 *** Min GLL point distance = 70.1468506 *** Max/min ratio = 14.2566986 *** Max element size = 3055.21875 *** Min element size = 406.240967 *** Max/min ratio = 7.52070570 *** Minimum period resolved = 1.87500000 *** Maximum suggested time step = 6.26311172E-03 Elapsed time for checking mesh resolution in seconds = 0.81209895014762878 mesh regions done min and max of elevation (i.e. height of the upper surface of the mesh) included in mesh in m is 31.205253937166059 7965.1218614569589 done mesh setup Repartition of elements: ----------------------- total number of elements in mesh slice 0: 92160 total number of regular elements in mesh slice 0: 0 total number of irregular elements in mesh slice 0: 92160 total number of points in mesh slice 0: 6026357 total number of elements in entire mesh: 5898240 approximate total number of points in entire mesh (with duplicates on MPI edges): 385686848 approximate total number of DOFs in entire mesh (with duplicates on MPI edges): 1157060544 total number of time steps in the solver will be: 200000 using single precision for the calculations smallest and largest possible floating-point numbers are: 1.17549435E-38 3.40282347E+38 Elapsed time for mesh generation and buffer creation in seconds = 88.678866080939770 End of mesh generation done