Commit 18b414dc authored by Alex Breuer's avatar Alex Breuer
Browse files

Added input and output data for SGT test case using GCE

parent 4391ae1f
vis_point_forces_2em11_cut.pvsm filter=lfs diff=lfs merge=lfs -text
This source diff could not be displayed because it is stored in LFS. You can view the blob instead.
This source diff could not be displayed because it is stored in LFS. You can view the blob instead.
This source diff could not be displayed because it is stored in LFS. You can view the blob instead.
[![CC0](http://i.creativecommons.org/p/zero/1.0/88x31.png)](http://creativecommons.org/publicdomain/zero/1.0/)
To the extent possible under law, [Alexander Nikolas Breuer](http://dial3343.org) has waived all copyright and related or neighboring rights to the following work:
* `scorep_hom_point_forces_100_32_6.tar.bz2`
* `scorep_hom_ricker_100_32_8.tar.bz2`
* `hom_point_forces_100_32.tar.bz2`
* `hom_ricker_100_32.tar.bz2`
This work is published from: United States.
# Runs of the 3D testcase using the Google Compute Engine
## Notes:
* The naming scheme of the point force simulation uses the term "_forward_" for the output dirs, that of the ricker wavelet in volume "_ricker_".
* GCP image:
```
gcloud compute instances create edge-skx-image \
--zone=us-west1-b \
--machine-type=n1-highcpu-96 \
--subnet=default \
--network-tier=PREMIUM \
--no-restart-on-failure \
--maintenance-policy=TERMINATE \
--preemptible \
--min-cpu-platform="Intel Skylake" \
--image=family/centos-7 \
--image-project=centos-cloud \
--boot-disk-size=30GB \
--boot-disk-type=pd-standard \
--boot-disk-device-name=edge-skx-image
gcloud compute ssh edge-skx-image --command "bash <(curl -s https://raw.githubusercontent.com/3343/edge/develop/tools/build/install_tools.sh); \
source /etc/bashrc; \
bash <(curl -s https://raw.githubusercontent.com/3343/edge/develop/tools/build/install_libs.sh); \
source /etc/bashrc; \
bash <(curl -s https://raw.githubusercontent.com/3343/edge/develop/tools/build/install_hpc.sh);" 2>&1 | tee 18_12_17_gcp_image.log
gcloud compute instances stop edge-skx-image
gcloud compute images create edge-centos-7-181217 \
--source-disk edge-skx-image \
--family edge-centos-7
```
* EDGE's Slurm GCP version:
```
commit 55435e0e3565c66013f5be284fce2ac59c870b08
Author: Alexander Nikolas Breuer <anbreuer@ucsd.edu>
Date: Mon Dec 17 18:24:17 2018 -0800
Disabled preemptible compute nodes in cluster config.
```
* Cluster creation:
```
gcloud deployment-manager deployments create edge-cluster --config edge-cluster.yaml
```
Manually removed enable-oslogin-flag.
EDGE version:
```
commit 263edfc0b03662ac44bba800827e6bca38ec1ece
Author: Alexander Nikolas Breuer <anbreuer@ucsd.edu>
Date: Mon Dec 17 18:10:21 2018 -0800
Switched point source setup to double precision, independent of the solver's precision.
```
* Compilation:
```
gcloud compute ssh anbreuer_ucsd_edu@edge-cluster-controller
ssh-keygen -t rsa
cat .ssh/id_rsa.pub >> .ssh/authorized_keys
git clone https://github.com/3343/edge.git
cd edge
git checkout develop
git submodule init
git submodule update
OMPI_CXX=g++ CXX=/usr/local/bin/mpiCC scons arch=skx xsmm=yes parallel=mpi+omp zlib=yes hdf5=yes moab=yes inst=yes cfr=16 order=5 -j 16 2>&1 | tee 18_12_17_build_edge_moab_16.log
mv build/edge edge_moab_16
OMPI_CXX=g++ CXX=/usr/local/bin/mpiCC scons arch=skx xsmm=yes parallel=mpi+omp zlib=yes hdf5=yes moab=yes inst=yes cfr=1 order=5 -j 16 2>&1 | tee 18_12_17_build_edge_moab_1.log
mv build/edge edge_moab_1
```
* Runs:
```
sbatch hom_point_forces_100_32.slurm
sbatch hom_ricker_100_32.slurm
```
../../configs/
\ No newline at end of file
This source diff could not be displayed because it is stored in LFS. You can view the blob instead.
This source diff could not be displayed because it is stored in LFS. You can view the blob instead.
#!/bin/bash
#SBATCH --job-name=parkfield_hom_point_forces_100_32
#SBATCH -N 16
#SBATCH -n 32
#SBATCH --cpus-per-task=48
#SBATCH --output=edge_hom_point_forces_100_32_%j.log
#SBATCH --no-requeue
date
echo "our nodes: "
echo $SLURM_JOB_NODELIST
date
echo "running EDGE:"
SCOREP_EXPERIMENT_DIRECTORY=scorep_hom_point_forces_100_32_${SLURM_JOB_ID} OMP_NUM_THREADS=23 GOMP_CPU_AFFINITY=2-23,1 OMP_SCHEDULE=static OMP_DISPLAY_ENV=TRUE GOMP_DEBUG=1 scalasca --analyze mpiexec "-report-bindings -map-by socket --mca btl_tcp_links 2" -n 1 ./edge_moab_16 -x hom_point_forces_100_32.xml \
: -n 1 -x GOMP_CPU_AFFINITY=26-47,25 ./edge_moab_16 -x hom_point_forces_100_32.xml \
: -n 1 ./edge_moab_16 -x hom_point_forces_100_32.xml \
: -n 1 -x GOMP_CPU_AFFINITY=26-47,25 ./edge_moab_16 -x hom_point_forces_100_32.xml \
: -n 1 ./edge_moab_16 -x hom_point_forces_100_32.xml \
: -n 1 -x GOMP_CPU_AFFINITY=26-47,25 ./edge_moab_16 -x hom_point_forces_100_32.xml \
: -n 1 ./edge_moab_16 -x hom_point_forces_100_32.xml \
: -n 1 -x GOMP_CPU_AFFINITY=26-47,25 ./edge_moab_16 -x hom_point_forces_100_32.xml \
: -n 1 ./edge_moab_16 -x hom_point_forces_100_32.xml \
: -n 1 -x GOMP_CPU_AFFINITY=26-47,25 ./edge_moab_16 -x hom_point_forces_100_32.xml \
: -n 1 ./edge_moab_16 -x hom_point_forces_100_32.xml \
: -n 1 -x GOMP_CPU_AFFINITY=26-47,25 ./edge_moab_16 -x hom_point_forces_100_32.xml \
: -n 1 ./edge_moab_16 -x hom_point_forces_100_32.xml \
: -n 1 -x GOMP_CPU_AFFINITY=26-47,25 ./edge_moab_16 -x hom_point_forces_100_32.xml \
: -n 1 ./edge_moab_16 -x hom_point_forces_100_32.xml \
: -n 1 -x GOMP_CPU_AFFINITY=26-47,25 ./edge_moab_16 -x hom_point_forces_100_32.xml \
: -n 1 ./edge_moab_16 -x hom_point_forces_100_32.xml \
: -n 1 -x GOMP_CPU_AFFINITY=26-47,25 ./edge_moab_16 -x hom_point_forces_100_32.xml \
: -n 1 ./edge_moab_16 -x hom_point_forces_100_32.xml \
: -n 1 -x GOMP_CPU_AFFINITY=26-47,25 ./edge_moab_16 -x hom_point_forces_100_32.xml \
: -n 1 ./edge_moab_16 -x hom_point_forces_100_32.xml \
: -n 1 -x GOMP_CPU_AFFINITY=26-47,25 ./edge_moab_16 -x hom_point_forces_100_32.xml \
: -n 1 ./edge_moab_16 -x hom_point_forces_100_32.xml \
: -n 1 -x GOMP_CPU_AFFINITY=26-47,25 ./edge_moab_16 -x hom_point_forces_100_32.xml \
: -n 1 ./edge_moab_16 -x hom_point_forces_100_32.xml \
: -n 1 -x GOMP_CPU_AFFINITY=26-47,25 ./edge_moab_16 -x hom_point_forces_100_32.xml \
: -n 1 ./edge_moab_16 -x hom_point_forces_100_32.xml \
: -n 1 -x GOMP_CPU_AFFINITY=26-47,25 ./edge_moab_16 -x hom_point_forces_100_32.xml \
: -n 1 ./edge_moab_16 -x hom_point_forces_100_32.xml \
: -n 1 -x GOMP_CPU_AFFINITY=26-47,25 ./edge_moab_16 -x hom_point_forces_100_32.xml \
: -n 1 ./edge_moab_16 -x hom_point_forces_100_32.xml \
: -n 1 -x GOMP_CPU_AFFINITY=26-47,25 ./edge_moab_16 -x hom_point_forces_100_32.xml
echo "funished EDGE"
date
echo "finished Slurm script"
<?xml version="1.0" encoding="UTF-8"?>
<!--
@file This file is part of EDGE.
@author Alexander Breuer (anbreuer AT ucsd.edu)
@section LICENSE
Copyright (c) 2018, Regents of the University of California
All rights reserved.
Redistribution and use in source and binary forms, with or without modification, are permitted provided that the following conditions are met:
1. Redistributions of source code must retain the above copyright notice, this list of conditions and the following disclaimer.
2. Redistributions in binary form must reproduce the above copyright notice, this list of conditions and the following disclaimer in the documentation and/or other materials provided with the distribution.
3. Neither the name of the copyright holder nor the names of its contributors may be used to endorse or promote products derived from this software without specific prior written permission.
THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
@section DESCRIPTION
Config for mountain topography with homogeneous material parameters.
-->
<edge>
<cfr>
<mesh>
<files>
<in>meshes/gen/volume_hom/hdf5/volume_hom_100_32.h5m</in>
</files>
<options>
<read>PARALLEL=READ_PART;PARALLEL_RESOLVE_SHARED_ENTS;PARTITION=PARALLEL_PARTITION;</read>
</options>
<boundary>
<free_surface>101</free_surface>
<outflow>105</outflow>
</boundary>
</mesh>
<velocity_model>
<domain>
<half_space>
<origin>
<x>0</x>
<y>0</y>
<z>9999</z>
</origin>
<normal>
<x>0</x>
<y>0</y>
<z>-1</z>
</normal>
</half_space>
<rho>2800</rho>
<lambda>17136000000</lambda>
<mu>4032000000</mu>
</domain>
</velocity_model>
<setups>
<point_sources>
<file>sources/point_forces/VC2E_x.h5</file>
<file>sources/point_forces/VC2E_y.h5</file>
<file>sources/point_forces/MFU_x.h5</file>
<file>sources/point_forces/MFU_y.h5</file>
<file>sources/point_forces/DFU_x.h5</file>
<file>sources/point_forces/DFU_y.h5</file>
<file>sources/point_forces/FFU_x.h5</file>
<file>sources/point_forces/FFU_y.h5</file>
<file>sources/point_forces/UPSAR01_x.h5</file>
<file>sources/point_forces/UPSAR01_y.h5</file>
<file>sources/point_forces/FZ8_x.h5</file>
<file>sources/point_forces/FZ8_y.h5</file>
<file>sources/point_forces/GH3E_x.h5</file>
<file>sources/point_forces/GH3E_y.h5</file>
<file>sources/point_forces/SC3E_x.h5</file>
<file>sources/point_forces/SC3E_y.h5</file>
</point_sources>
<end_time>25.0</end_time>
</setups>
<output>
<receivers>
<path_to_dir>hom_forward_100_32</path_to_dir>
<freq>0.01</freq>
<receiver>
<name>GH2W</name>
<coords>
<x>-2348.86735907</x>
<y>-554.244078741</y>
<z>460.643778241</z>
</coords>
</receiver>
<receiver>
<name>GH2E</name>
<coords>
<x>1535.22000673</x>
<y>2772.91988286</y>
<z>429.10505392</z>
</coords>
</receiver>
<receiver>
<name>GH3W</name>
<coords>
<x>-4156.52198347</x>
<y>-2328.15581852</y>
<z>616.827361013</z>
</coords>
</receiver>
<receiver>
<name>GH3E</name>
<coords>
<x>2798.53465586</x>
<y>5878.7647557</y>
<z>485.522447446</z>
</coords>
</receiver>
<receiver>
<name>FZ6</name>
<coords>
<x>-4965.82843697</x>
<y>4659.68415147</y>
<z>445.469444922</z>
</coords>
</receiver>
<receiver>
<name>FZ8</name>
<coords>
<x>-1444.25976682</x>
<y>6765.7376032</y>
<z>467.975832315</z>
</coords>
</receiver>
<receiver>
<name>FZ7</name>
<coords>
<x>-3520.69294233</x>
<y>5989.9354849</y>
<z>450.947313959</z>
</coords>
</receiver>
<receiver>
<name>SC1E</name>
<coords>
<x>6416.14466905</x>
<y>-3214.0931254</y>
<z>400.020533028</z>
</coords>
</receiver>
<receiver>
<name>SC2E</name>
<coords>
<x>7498.49610978</x>
<y>-773.200334448</y>
<z>464.168363821</z>
</coords>
</receiver>
<receiver>
<name>GH4W</name>
<coords>
<x>-7139.35896207</x>
<y>-3546.2718188</y>
<z>550.48758297</z>
</coords>
</receiver>
<receiver>
<name>SC3E</name>
<coords>
<x>8580.14086749</x>
<y>1778.74629069</y>
<z>541.008889578</z>
</coords>
</receiver>
<receiver>
<name>EFU</name>
<coords>
<x>-5053.89271711</x>
<y>8541.66752861</y>
<z>498.916076349</z>
</coords>
</receiver>
<receiver>
<name>FZ9</name>
<coords>
<x>-7221.20878552</x>
<y>6879.48640251</y>
<z>488.05956096</z>
</coords>
</receiver>
<receiver>
<name>FZ12</name>
<coords>
<x>-6136.40678862</x>
<y>9207.8310012</y>
<z>466.054241588</z>
</coords>
</receiver>
<receiver>
<name>GH5W</name>
<coords>
<x>-10123.5251542</x>
<y>-5207.02366663</y>
<z>489.924210983</z>
</coords>
</receiver>
<receiver>
<name>CH2W</name>
<coords>
<x>7144.00596278</x>
<y>-9313.60176941</y>
<z>345.914158308</z>
</coords>
</receiver>
<receiver>
<name>CH3W</name>
<coords>
<x>6240.24723989</x>
<y>-10090.6513313</y>
<z>351.209418271</z>
</coords>
</receiver>
<receiver>
<name>CH3E</name>
<coords>
<x>10665.8570977</x>
<y>-5206.38738416</y>
<z>460.329481113</z>
</coords>
</receiver>
<receiver>
<name>CH2E</name>
<coords>
<x>9583.47158339</x>
<y>-7314.92142637</y>
<z>430.717907841</z>
</coords>
</receiver>
<receiver>
<name>CH4W</name>
<coords>
<x>5426.9121378</x>
<y>-11089.3717208</y>
<z>367.380000568</z>
</coords>
</receiver>
<receiver>
<name>UPSAR01</name>
<coords>
<x>-12826.9857467</x>
<y>452.947700124</y>
<z>567.467630997</z>
</coords>
</receiver>
<receiver>
<name>CH4AW</name>
<coords>
<x>4432.53181467</x>
<y>-12199.0172284</y>
<z>342.347660005</z>
</coords>
</receiver>
<receiver>
<name>CH5W</name>
<coords>
<x>3347.43172696</x>
<y>-13308.5838259</y>
<z>338.720882193</z>
</coords>
</receiver>
<receiver>
<name>DFU</name>
<coords>
<x>-5411.81910738</x>
<y>13532.9708123</y>
<z>517.518512493</z>
</coords>
</receiver>
<receiver>
<name>JFU</name>
<coords>
<x>-6043.19808887</x>
<y>13533.3815107</y>
<z>574.588745576</z>
</coords>
</receiver>
<receiver>
<name>FFU</name>
<coords>
<x>-10917.6851661</x>
<y>10432.4989551</y>
<z>548.233521958</z>
</coords>
</receiver>
<receiver>
<name>CH6W</name>
<coords>
<x>2171.76777595</x>
<y>-15194.3997399</y>
<z>334.32064814</z>
</coords>
</receiver>
<receiver>
<name>GH6W</name>
<coords>
<x>-12840.3248553</x>
<y>-8752.63585544</y>
<z>361.432074635</z>
</coords>
</receiver>
<receiver>
<name>VC1W</name>
<coords>
<x>-11906.7544882</x>
<y>12984.7895347</y>
<z>591.142225505</z>
</coords>
</receiver>
<receiver>
<name>VC2W</name>
<coords>
<x>-12990.3324273</x>
<y>12209.9254424</y>
<z>573.191451201</z>
</coords>
</receiver>
<receiver>
<name>VFU</name>
<coords>
<x>-15246.5601077</x>
<y>11658.9730806</y>
<z>785.055681564</z>
</coords>
</receiver>
<receiver>
<name>VC4W</name>
<coords>
<x>-16783.8297355</x>
<y>9776.23620135</y>
<z>585.043876365</z>
</coords>
</receiver>
<receiver>
<name>MFU</name>
<coords>
<x>-11813.2768266</x>
<y>15424.7692036</y>
<z>738.201540204</z>
</coords>
</receiver>
<receiver>
<name>VC5W</name>
<coords>
<x>-18051.6701658</x>
<y>7560.47405183</y>
<z>511.46381489</z>
</coords>
</receiver>
<receiver>
<name>VC2E</name>
<coords>
<x>-9196.15161302</x>
<y>17307.1852508</y>
<z>739.469003818</z>
</coords>
</receiver>
<receiver>
<name>VC6W</name>
<coords>
<x>-21217.1154158</x>
<y>4905.60188896</y>
<z>402.353960983</z>
</coords>
</receiver>
<receiver>
<name>PHOB</name>
<coords>
<x>28618.3981336</x>
<y>5591.97010447</y>
<z>193.014266605</z>
</coords>
</receiver>
<receiver>
<name>hypocenter</name>
<coords>
<x>0</x>
<y>0</y>
<z>-7622.4</z>
</coords>