Benchmark 1#

All shell command blocks begin at the folder root: benchmark_1

Description#

benchmark_1 is technical test on simulated mdcg instances

Install & configurations#

1. Python environment#

  • You need to install virtualenv

    pip install virtualenv
    
  • Create python virtual environment

    ./config/install_venv39.sh
    
  • Activate the environment

    source .venv_39/bin/activate
    

Always make sure the environment is activated!

(.venv_39) # command lines may be prefix by the environment name

Usage#

  • source the environment

    source .venv_39/bin/activate
    
  • run the benchmark

    rm -rf run 2>&1  # if you want new results, remove old directory
    python3.9 scripts/run_benchmark_1.py  # [-h] see help
    
  • extract stats in a tex table

    python3.9 scripts/stats_to_tex.py -d run_directory_path  # [-h] see help