Hi,

I am opening separate issue for this task of adapting the core python script - update.py - for the MS Windows platform.

Currently it is throwing this error below. Any help is appreciated.

C:\Users\milias\Documents\work\software\autocmake\autocmake\test\fc\cmake>python update.py  --self
- fetching lib/config.py
Traceback (most recent call last):
  File "update.py", line 308, in <module>
    main(sys.argv)
  File "update.py", line 264, in main
    dst='lib/config.py'
  File "update.py", line 42, in fetch_url
    opener.retrieve(src, dst)
  File "C:\Python27\lib\urllib.py", line 245, in retrieve
    fp = self.open(url, data)
  File "C:\Python27\lib\urllib.py", line 213, in open
    return getattr(self, name)(url)
  File "C:\Python27\lib\urllib.py", line 443, in open_https
    h.endheaders(data)
  File "C:\Python27\lib\httplib.py", line 997, in endheaders
    self._send_output(message_body)
  File "C:\Python27\lib\httplib.py", line 850, in _send_output
    self.send(msg)
  File "C:\Python27\lib\httplib.py", line 812, in send
    self.connect()
  File "C:\Python27\lib\httplib.py", line 1216, in connect
    server_hostname=server_hostname)
  File "C:\Python27\lib\ssl.py", line 350, in wrap_socket
    _context=self)
  File "C:\Python27\lib\ssl.py", line 566, in __init__
    self.do_handshake()
  File "C:\Python27\lib\ssl.py", line 788, in do_handshake
    self._sslobj.do_handshake()
IOError: [Errno socket error] [SSL: UNKNOWN_PROTOCOL] unknown protocol (_ssl.c:581)

C:\Users\milias\Documents\work\software\autocmake\autocmake\test\fc\cmake>

As discussed in #219 we need to make sure that using bare CMake and the frontend script gives the same result. i admit that using the frontend script should be preferred: it can be more concise and actually saves the setup command for later use. However, some users might be already very familiar with bare CMake and we need to make sure not to confuse them.

The strategy here is to make sure that options defined in modules always have a default value. The Python frontend script defines all such options with sensible defaults, the mechanism for this is the define section on top of the module files. This has to be replicated for bare CMake and I've added three macros (thanks @loriab and @ryanmrichard 🎉) to the top of the autogenerated root CMakeLists.txt that can be used for the purpose:

• print_option(<option to print> <was specified>). Pretty-prints an option.
• option_with_print(<option name> <description> <default value>). Wraps an ON/OFF option and pretty-prints it too.
• option_with_default(<option name> <description> <default value>). Wraps any other type of option and pretty-prints it too.

I have fixed some bugs and "fortified" math_libs.cmake to illustrate how this works. Basically, any -DTHIS and -DTHAT that appear in the define sections need to be also listed in the CMake script using option_with_print or option_with_default. This is tedious, but saves a lot of WTF moments and imposing one way of doing on users. As a byproduct of hande-qmc/hande#3, detection and linkage of Intel MKL ScaLAPACK works slightly better. ScaLAPACK from other vendors can be set via SCALAPACK_LIBRARIES.

When printing CMAKE_Fortran_FLAGS, I see they are empty (see https://testboard.org/cdash/buildSummary.php?buildid=32904 ).

However, they are appearing in the compiling command of cmake, what is correct. Any help how to fill this variable in autocmake module(s) ?

Hi,

probably Python 2.6.6, which is on Slovakia clusters, is not equipped with the 'skipif' feature. Any help, please ?

[email protected]:/shared/home/ilias/Work/programming_stuff/autocmake/.py.test -v test/test.py 
================================================================= test session starts =================================================================
platform linux2 -- Python 2.6.6 -- pytest-2.3.5 -- /usr/bin/python
collected 10 items 

test/test.py:120: test_cxx_custom PASSED
test/test.py:126: test_extra_cmake_options PASSED
test/test.py:132: test_cxx PASSED
test/test.py:138: test_fc PASSED
test/test.py:144: test_fc_git_info PASSED
test/test.py:150: test_fc_int64 PASSED
test/test.py:156: test_fc_mpi ERROR
test/test.py:163: test_fc_omp ERROR
test/test.py:171: test_fc_blas ERROR
test/test.py:178: test_fc_lapack ERROR

======================================================================= ERRORS ========================================================================
____________________________________________________________ ERROR at setup of test_fc_mpi ____________________________________________________________
Error evaluating 'skipif' expression
    False
Failed: expression is not a string

____________________________________________________________ ERROR at setup of test_fc_omp ____________________________________________________________
Error evaluating 'skipif' expression
    False
Failed: expression is not a string

___________________________________________________________ ERROR at setup of test_fc_blas ____________________________________________________________
Error evaluating 'skipif' expression
    False
Failed: expression is not a string

__________________________________________________________ ERROR at setup of test_fc_lapack ___________________________________________________________
Error evaluating 'skipif' expression
    False
Failed: expression is not a string

========================================================= 6 passed, 4 error in 29.38 seconds ==========================================================
ilia[email protected]:/shared/home/ilias/Work/programming_stuff/autocmake/.

Hi,

I wanted explicit libraries to be passed to compiled objects.

I put into autocmake.cfg (after DIRAC autocmake.cfg)

[explicit]
docopt: --explicit-libs=<LIBS> Explicit linker specification for extra libraries passed directly to the linker [default: off].
define: '-DEXPLICIT_LIBS=%s' % arguments['--explicit-libs'].strip()

did setup

python setup --fc=gfortran --blas=off --lapack=off --explicit-libs="/u/milias/Work/qch/software/lapack/lapack-3.6.0/build/lib/liblapack.a  /u/milias/Work/qch/software/lapack/lapack-3.6.0/build/lib/libblas.a"  build_gfortran_lapack3.6.0

but the linking command is not complete:

/usr/bin/gfortran       -O3 -funroll-all-loops CMakeFiles/dsyerv_check.dir/dsyerv_check.F90.o CMakeFiles/dsyerv_check.dir/eispack.F.o  -o dsyerv_check -rdynamic /u/milias/Work/qch/software/lapack/lapack-3.6.0/build/lib/liblapack.a

The reason could be the python strip() command. Could we have an autocmake example of explicit libs adding ?

I am opening this issue to discuss how to implement the determination of compilers versions as was implemented in DIRAC by Ivan Hrasko ( @ihrasko ).

Should I create a subdirectory modules/compilers_version and put python script and a new cmake module there ?

Comments, hints & tips ?

Hi,

concerning the current openblas support we have: https://github.com/scisoft/autocmake/blob/master/modules/math_libs.cmake#L115

we are missing the Windows OpenBLAS support, which is described here: https://github.com/xianyi/OpenBLAS/issues/461#issuecomment-74715665

According to this thread it would be good to incorporate OpenBLASConfig.cmake commands into math_libs.cmake to enable linking against "libopenblas.dll".

For example, passing (and linking) of openblas library works for DIRAC on MS Windows (https://gitlab.com/dirac/dirac/blob/master/maintenance/cdash/cdash.WinS12-Miro.bat#L67, see also https://gitlab.com/dirac/dirac/blob/master/cmake/math/MathLibs.cmake#L80 ).

Windows OpenBLAS version (libopenblas.dll) is needed for the new fc_openblas test I am currently working on.

Simple modification of autocmake/test/fc/src/CMakeLists.txt

add_executable(example example.f90 module.f90)
if (FOO)
 message(STATUS "FOO active!")
 message(WARNING "FOO warning")
endif()

gives i) nothing swallowed when FOO inactive:

[email protected]:~/Work/qch/software/small_projects/autocmake/test/fc/.python ./setup --cmake-options="-D FOO=OFF" build_x1
FC=gfortran cmake -DEXTRA_FCFLAGS="''" -DCMAKE_BUILD_TYPE=release -G "Unix Makefiles" -D FOO=OFF /u/milias/Work/qch/software/small_projects/autocmake/test/fc

-- The C compiler identification is GNU 4.7.2
-- The CXX compiler identification is GNU 4.7.2
-- Check for working C compiler: /usr/bin/cc
-- Check for working C compiler: /usr/bin/cc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- The Fortran compiler identification is GNU 4.7.2
-- Check for working Fortran compiler: /usr/bin/gfortran
-- Check for working Fortran compiler: /usr/bin/gfortran  -- works
-- Detecting Fortran compiler ABI info
-- Detecting Fortran compiler ABI info - done
-- Checking whether /usr/bin/gfortran supports Fortran 90
-- Checking whether /usr/bin/gfortran supports Fortran 90 -- yes
-- Configuring done
-- Generating done
-- Build files have been written to: /u/milias/Work/qch/software/small_projects/autocmake/test/fc/build_x1

   configure step is done
   now you need to compile the sources:
   $ cd build_x1
   $ make

or all STATUS messages are swallowed when FOO variable is active:

[email protected]:~/Work/qch/software/small_projects/autocmake/test/fc/.python ./setup --cmake-options="-D FOO=ON" build_x
FC=gfortran cmake -DEXTRA_FCFLAGS="''" -DCMAKE_BUILD_TYPE=release -G "Unix Makefiles" -D FOO=ON /u/milias/Work/qch/software/small_projects/autocmake/test/fc

CMake Warning at src/CMakeLists.txt:4 (message):
  FOO warning

• checked with GNU/Intel/PGI compilers and the MKL library
  • also fixed tests fc, fc_blas for PGI compiler

Wished to have core autocmake-blas/lapack tests running with many compilers as prelude for developing autocmake-DIRAC/

As I am trying to adapt tests for https://github.com/miroi/mathlibs-tester, I am missing working ctest-autocmake example.

Is it worth for consideration ?

Parse language field in YAML to generate project(<PROJECT_NAME <PROJECT_LANGUAGE>) in CMakeLists.txt

Why? Delayed enabling of languages within the cc.cmake, cxx.cmake and fc.cmake causes CMake to load C and C++ as default languages for a project. This is in principle unnecessary for a project that only needs one language. The "only one language" behavior can be enforced by setting the language when declaring the project.

Questions

• [x] This line uses a ternary if to check whether a list of languages or a single language was given. It might not be exactly the most readable piece of code.

• [x] The enable_language in cc.cmake, cxx.cmake and fc.cmake is probably redundant.

• [x] Ready to go

If I run update.py --self and then run ./setup <build_directory> I get python error message: Traceback (most recent call last): File "/home/rasmus/ReSpect/source/./setup", line 120, in configure.configure(root_directory, build_path, cmake_command, arguments['--show']) File "/home/rasmus/ReSpect/source/cmake/autocmake/configure.py", line 152, in configure if not arguments['--show']: TypeError: 'bool' object is not subscriptable

Hi Rado,

any help why tests are crashing ?

[email protected]:~/work/software/theoretical_chemistry/autocmake/.py.test -vv test/test.py
============================================================= test session starts =============================================================
platform linux -- Python 3.7.3, pytest-7.1.1, pluggy-1.0.0 -- /usr/bin/python3
cachedir: .pytest_cache
rootdir: /home/milias/work/software/theoretical_chemistry/autocmake
collected 14 items

test/test.py::test_extra_cmake_options FAILED                                                                                           [  7%]
test/test.py::test_cxx FAILED                                                                                                           [ 14%]
test/test.py::test_fc FAILED                                                                                                            [ 21%]
test/test.py::test_fc_git_info FAILED                                                                                                   [ 28%]
test/test.py::test_fc_int64 FAILED                                                                                                      [ 35%]
test/test.py::test_fc_omp FAILED                                                                                                        [ 42%]
test/test.py::test_fc_blas FAILED                                                                                                       [ 50%]
test/test.py::test_fc_lapack FAILED                                                                                                     [ 57%]
test/test.py::test_cxx_cblas FAILED                                                                                                     [ 64%]
test/test.py::test_cxx_accelerate FAILED                                                                                                [ 71%]
test/test.py::test_python_interpreter FAILED                                                                                            [ 78%]
test/test.py::test_python_interpreter_custom FAILED                                                                                     [ 85%]
test/test.py::test_python_libs FAILED                                                                                                   [ 92%]
test/test.py::test_python_libs_custom FAILED                                                                                            [100%]

================================================================== FAILURES ===================================================================
__________________________________________________________ test_extra_cmake_options ___________________________________________________________

    def test_extra_cmake_options():
        configure_build_and_exe(
            'extra_cmake_options',
>           'python setup --cxx=g++ --cmake-options="-DENABLE_SOMETHING=OFF -DENABLE_FOO=ON"'
        )

/home/milias/work/software/theoretical_chemistry/autocmake/test/test.py:89:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _

name = 'extra_cmake_options'
setup_command = 'python setup --cxx=g++ --cmake-options="-DENABLE_SOMETHING=OFF -DENABLE_FOO=ON" build-2022-03-22-20-38-02', launcher = None

    def configure_build_and_exe(name, setup_command, launcher=None):

        stamp = datetime.datetime.fromtimestamp(
            time.time()).strftime('%Y-%m-%d-%H-%M-%S')

        os.chdir(os.path.join(HERE, name, 'cmake'))
        shutil.copy(os.path.join('..', '..', '..', 'update.py'), 'update.py')

        if os.path.exists('autocmake'):
            shutil.rmtree('autocmake')
        shutil.copytree(os.path.join('..', '..', '..', 'autocmake'), 'autocmake')

        stdout, stderr = exe('python update.py ..')
        os.chdir(os.path.join(HERE, name))

        make_command = 'make'
        binary = './bin/example'
        if sys.platform == 'win32':
            setup_command += ' --generator="MinGW Makefiles"'
            make_command = 'mingw32-make'
            binary = 'bin\\\example.exe'

        if launcher:
            binary = '%s %s' % (launcher, binary)

        setup_command += ' build-%s' % stamp

        stdout, stderr = exe(setup_command)
>       assert stderr == ''
E       assert "python: can't open file 'setup': [Errno 2] No such file or directory\n" == ''
E         + python: can't open file 'setup': [Errno 2] No such file or directory

/home/milias/work/software/theoretical_chemistry/autocmake/test/test.py:73: AssertionError
------------------------------------------------------------ Captured stderr call -------------------------------------------------------------
ERROR: you need to install the pyyaml package
python: can't open file 'setup': [Errno 2] No such file or directory
__________________________________________________________________ test_cxx ___________________________________________________________________

    def test_cxx():
>       configure_build_and_exe('cxx', 'python setup --cxx=g++')

/home/milias/work/software/theoretical_chemistry/autocmake/test/test.py:94:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _

name = 'cxx', setup_command = 'python setup --cxx=g++ build-2022-03-22-20-38-02', launcher = None

    def configure_build_and_exe(name, setup_command, launcher=None):

        stamp = datetime.datetime.fromtimestamp(
            time.time()).strftime('%Y-%m-%d-%H-%M-%S')

        os.chdir(os.path.join(HERE, name, 'cmake'))
        shutil.copy(os.path.join('..', '..', '..', 'update.py'), 'update.py')

        if os.path.exists('autocmake'):
            shutil.rmtree('autocmake')
        shutil.copytree(os.path.join('..', '..', '..', 'autocmake'), 'autocmake')

        stdout, stderr = exe('python update.py ..')
        os.chdir(os.path.join(HERE, name))

        make_command = 'make'
        binary = './bin/example'
        if sys.platform == 'win32':
            setup_command += ' --generator="MinGW Makefiles"'
            make_command = 'mingw32-make'
            binary = 'bin\\\example.exe'

        if launcher:
            binary = '%s %s' % (launcher, binary)

        setup_command += ' build-%s' % stamp

        stdout, stderr = exe(setup_command)
>       assert stderr == ''
E       assert "python: can't open file 'setup': [Errno 2] No such file or directory\n" == ''
E         + python: can't open file 'setup': [Errno 2] No such file or directory

/home/milias/work/software/theoretical_chemistry/autocmake/test/test.py:73: AssertionError
------------------------------------------------------------ Captured stderr call -------------------------------------------------------------
ERROR: you need to install the pyyaml package
python: can't open file 'setup': [Errno 2] No such file or directory
___________________________________________________________________ test_fc ___________________________________________________________________

    def test_fc():
>       configure_build_and_exe('fc', 'python setup --fc=gfortran')

/home/milias/work/software/theoretical_chemistry/autocmake/test/test.py:98:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _

name = 'fc', setup_command = 'python setup --fc=gfortran build-2022-03-22-20-38-02', launcher = None

    def configure_build_and_exe(name, setup_command, launcher=None):

        stamp = datetime.datetime.fromtimestamp(
            time.time()).strftime('%Y-%m-%d-%H-%M-%S')

        os.chdir(os.path.join(HERE, name, 'cmake'))
        shutil.copy(os.path.join('..', '..', '..', 'update.py'), 'update.py')

        if os.path.exists('autocmake'):
            shutil.rmtree('autocmake')
        shutil.copytree(os.path.join('..', '..', '..', 'autocmake'), 'autocmake')

        stdout, stderr = exe('python update.py ..')
        os.chdir(os.path.join(HERE, name))

        make_command = 'make'
        binary = './bin/example'
        if sys.platform == 'win32':
            setup_command += ' --generator="MinGW Makefiles"'
            make_command = 'mingw32-make'
            binary = 'bin\\\example.exe'

        if launcher:
            binary = '%s %s' % (launcher, binary)

        setup_command += ' build-%s' % stamp

        stdout, stderr = exe(setup_command)
>       assert stderr == ''
E       assert "python: can't open file 'setup': [Errno 2] No such file or directory\n" == ''
E         + python: can't open file 'setup': [Errno 2] No such file or directory

/home/milias/work/software/theoretical_chemistry/autocmake/test/test.py:73: AssertionError
------------------------------------------------------------ Captured stderr call -------------------------------------------------------------
ERROR: you need to install the pyyaml package
python: can't open file 'setup': [Errno 2] No such file or directory
______________________________________________________________ test_fc_git_info _______________________________________________________________

    def test_fc_git_info():
>       configure_build_and_exe('fc_git_info', 'python setup --fc=gfortran')

/home/milias/work/software/theoretical_chemistry/autocmake/test/test.py:102:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _

name = 'fc_git_info', setup_command = 'python setup --fc=gfortran build-2022-03-22-20-38-02', launcher = None

    def configure_build_and_exe(name, setup_command, launcher=None):

        stamp = datetime.datetime.fromtimestamp(
            time.time()).strftime('%Y-%m-%d-%H-%M-%S')

        os.chdir(os.path.join(HERE, name, 'cmake'))
        shutil.copy(os.path.join('..', '..', '..', 'update.py'), 'update.py')

        if os.path.exists('autocmake'):
            shutil.rmtree('autocmake')
        shutil.copytree(os.path.join('..', '..', '..', 'autocmake'), 'autocmake')

        stdout, stderr = exe('python update.py ..')
        os.chdir(os.path.join(HERE, name))

        make_command = 'make'
        binary = './bin/example'
        if sys.platform == 'win32':
            setup_command += ' --generator="MinGW Makefiles"'
            make_command = 'mingw32-make'
            binary = 'bin\\\example.exe'

        if launcher:
            binary = '%s %s' % (launcher, binary)

        setup_command += ' build-%s' % stamp

        stdout, stderr = exe(setup_command)
>       assert stderr == ''
E       assert "python: can't open file 'setup': [Errno 2] No such file or directory\n" == ''
E         + python: can't open file 'setup': [Errno 2] No such file or directory

/home/milias/work/software/theoretical_chemistry/autocmake/test/test.py:73: AssertionError
------------------------------------------------------------ Captured stderr call -------------------------------------------------------------
ERROR: you need to install the pyyaml package
python: can't open file 'setup': [Errno 2] No such file or directory
________________________________________________________________ test_fc_int64 ________________________________________________________________

    def test_fc_int64():
>       configure_build_and_exe('fc_int64', 'python setup --fc=gfortran --int64')

/home/milias/work/software/theoretical_chemistry/autocmake/test/test.py:106:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _

name = 'fc_int64', setup_command = 'python setup --fc=gfortran --int64 build-2022-03-22-20-38-02', launcher = None

    def configure_build_and_exe(name, setup_command, launcher=None):

        stamp = datetime.datetime.fromtimestamp(
            time.time()).strftime('%Y-%m-%d-%H-%M-%S')

        os.chdir(os.path.join(HERE, name, 'cmake'))
        shutil.copy(os.path.join('..', '..', '..', 'update.py'), 'update.py')

        if os.path.exists('autocmake'):
            shutil.rmtree('autocmake')
        shutil.copytree(os.path.join('..', '..', '..', 'autocmake'), 'autocmake')

        stdout, stderr = exe('python update.py ..')
        os.chdir(os.path.join(HERE, name))

        make_command = 'make'
        binary = './bin/example'
        if sys.platform == 'win32':
            setup_command += ' --generator="MinGW Makefiles"'
            make_command = 'mingw32-make'
            binary = 'bin\\\example.exe'

        if launcher:
            binary = '%s %s' % (launcher, binary)

        setup_command += ' build-%s' % stamp

        stdout, stderr = exe(setup_command)
>       assert stderr == ''
E       assert "python: can't open file 'setup': [Errno 2] No such file or directory\n" == ''
E         + python: can't open file 'setup': [Errno 2] No such file or directory

/home/milias/work/software/theoretical_chemistry/autocmake/test/test.py:73: AssertionError
------------------------------------------------------------ Captured stderr call -------------------------------------------------------------
ERROR: you need to install the pyyaml package
python: can't open file 'setup': [Errno 2] No such file or directory
_________________________________________________________________ test_fc_omp _________________________________________________________________

    @skip_on_osx
    def test_fc_omp():
        os.environ['OMP_NUM_THREADS'] = '2'
>       configure_build_and_exe('fc_omp', 'python setup --omp --fc=gfortran')

/home/milias/work/software/theoretical_chemistry/autocmake/test/test.py:112:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _

name = 'fc_omp', setup_command = 'python setup --omp --fc=gfortran build-2022-03-22-20-38-02', launcher = None

    def configure_build_and_exe(name, setup_command, launcher=None):

        stamp = datetime.datetime.fromtimestamp(
            time.time()).strftime('%Y-%m-%d-%H-%M-%S')

        os.chdir(os.path.join(HERE, name, 'cmake'))
        shutil.copy(os.path.join('..', '..', '..', 'update.py'), 'update.py')

        if os.path.exists('autocmake'):
            shutil.rmtree('autocmake')
        shutil.copytree(os.path.join('..', '..', '..', 'autocmake'), 'autocmake')

        stdout, stderr = exe('python update.py ..')
        os.chdir(os.path.join(HERE, name))

        make_command = 'make'
        binary = './bin/example'
        if sys.platform == 'win32':
            setup_command += ' --generator="MinGW Makefiles"'
            make_command = 'mingw32-make'
            binary = 'bin\\\example.exe'

        if launcher:
            binary = '%s %s' % (launcher, binary)

        setup_command += ' build-%s' % stamp

        stdout, stderr = exe(setup_command)
>       assert stderr == ''
E       assert "python: can't open file 'setup': [Errno 2] No such file or directory\n" == ''
E         + python: can't open file 'setup': [Errno 2] No such file or directory

/home/milias/work/software/theoretical_chemistry/autocmake/test/test.py:73: AssertionError
------------------------------------------------------------ Captured stderr call -------------------------------------------------------------
ERROR: you need to install the pyyaml package
python: can't open file 'setup': [Errno 2] No such file or directory
________________________________________________________________ test_fc_blas _________________________________________________________________

    def test_fc_blas():
>       configure_build_and_exe('fc_blas', 'python setup --fc=gfortran --blas')

/home/milias/work/software/theoretical_chemistry/autocmake/test/test.py:116:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _

name = 'fc_blas', setup_command = 'python setup --fc=gfortran --blas build-2022-03-22-20-38-02', launcher = None

    def configure_build_and_exe(name, setup_command, launcher=None):

        stamp = datetime.datetime.fromtimestamp(
            time.time()).strftime('%Y-%m-%d-%H-%M-%S')

        os.chdir(os.path.join(HERE, name, 'cmake'))
        shutil.copy(os.path.join('..', '..', '..', 'update.py'), 'update.py')

        if os.path.exists('autocmake'):
            shutil.rmtree('autocmake')
        shutil.copytree(os.path.join('..', '..', '..', 'autocmake'), 'autocmake')

        stdout, stderr = exe('python update.py ..')
        os.chdir(os.path.join(HERE, name))

        make_command = 'make'
        binary = './bin/example'
        if sys.platform == 'win32':
            setup_command += ' --generator="MinGW Makefiles"'
            make_command = 'mingw32-make'
            binary = 'bin\\\example.exe'

        if launcher:
            binary = '%s %s' % (launcher, binary)

        setup_command += ' build-%s' % stamp

        stdout, stderr = exe(setup_command)
>       assert stderr == ''
E       assert "python: can't open file 'setup': [Errno 2] No such file or directory\n" == ''
E         + python: can't open file 'setup': [Errno 2] No such file or directory

/home/milias/work/software/theoretical_chemistry/autocmake/test/test.py:73: AssertionError
------------------------------------------------------------ Captured stderr call -------------------------------------------------------------
ERROR: you need to install the pyyaml package
python: can't open file 'setup': [Errno 2] No such file or directory
_______________________________________________________________ test_fc_lapack ________________________________________________________________

    def test_fc_lapack():
>       configure_build_and_exe('fc_lapack', 'python setup --fc=gfortran --lapack')

/home/milias/work/software/theoretical_chemistry/autocmake/test/test.py:120:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _

name = 'fc_lapack', setup_command = 'python setup --fc=gfortran --lapack build-2022-03-22-20-38-03', launcher = None

    def configure_build_and_exe(name, setup_command, launcher=None):

        stamp = datetime.datetime.fromtimestamp(
            time.time()).strftime('%Y-%m-%d-%H-%M-%S')

        os.chdir(os.path.join(HERE, name, 'cmake'))
        shutil.copy(os.path.join('..', '..', '..', 'update.py'), 'update.py')

        if os.path.exists('autocmake'):
            shutil.rmtree('autocmake')
        shutil.copytree(os.path.join('..', '..', '..', 'autocmake'), 'autocmake')

        stdout, stderr = exe('python update.py ..')
        os.chdir(os.path.join(HERE, name))

        make_command = 'make'
        binary = './bin/example'
        if sys.platform == 'win32':
            setup_command += ' --generator="MinGW Makefiles"'
            make_command = 'mingw32-make'
            binary = 'bin\\\example.exe'

        if launcher:
            binary = '%s %s' % (launcher, binary)

        setup_command += ' build-%s' % stamp

        stdout, stderr = exe(setup_command)
>       assert stderr == ''
E       assert "python: can't open file 'setup': [Errno 2] No such file or directory\n" == ''
E         + python: can't open file 'setup': [Errno 2] No such file or directory

/home/milias/work/software/theoretical_chemistry/autocmake/test/test.py:73: AssertionError
------------------------------------------------------------ Captured stderr call -------------------------------------------------------------
ERROR: you need to install the pyyaml package
python: can't open file 'setup': [Errno 2] No such file or directory
_______________________________________________________________ test_cxx_cblas ________________________________________________________________

    @skip_on_osx
    def test_cxx_cblas():
>       configure_build_and_exe('cxx_cblas', 'python setup --cxx=g++ --cblas')

/home/milias/work/software/theoretical_chemistry/autocmake/test/test.py:125:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _

name = 'cxx_cblas', setup_command = 'python setup --cxx=g++ --cblas build-2022-03-22-20-38-03', launcher = None

    def configure_build_and_exe(name, setup_command, launcher=None):

        stamp = datetime.datetime.fromtimestamp(
            time.time()).strftime('%Y-%m-%d-%H-%M-%S')

        os.chdir(os.path.join(HERE, name, 'cmake'))
        shutil.copy(os.path.join('..', '..', '..', 'update.py'), 'update.py')

        if os.path.exists('autocmake'):
            shutil.rmtree('autocmake')
        shutil.copytree(os.path.join('..', '..', '..', 'autocmake'), 'autocmake')

        stdout, stderr = exe('python update.py ..')
        os.chdir(os.path.join(HERE, name))

        make_command = 'make'
        binary = './bin/example'
        if sys.platform == 'win32':
            setup_command += ' --generator="MinGW Makefiles"'
            make_command = 'mingw32-make'
            binary = 'bin\\\example.exe'

        if launcher:
            binary = '%s %s' % (launcher, binary)

        setup_command += ' build-%s' % stamp

        stdout, stderr = exe(setup_command)
>       assert stderr == ''
E       assert "python: can't open file 'setup': [Errno 2] No such file or directory\n" == ''
E         + python: can't open file 'setup': [Errno 2] No such file or directory

/home/milias/work/software/theoretical_chemistry/autocmake/test/test.py:73: AssertionError
------------------------------------------------------------ Captured stderr call -------------------------------------------------------------
ERROR: you need to install the pyyaml package
python: can't open file 'setup': [Errno 2] No such file or directory
_____________________________________________________________ test_cxx_accelerate _____________________________________________________________

    @skip_on_linux
    def test_cxx_accelerate():
        configure_build_and_exe('cxx_accelerate',
>                               'python setup --cxx=g++ --accelerate')

/home/milias/work/software/theoretical_chemistry/autocmake/test/test.py:131:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _

name = 'cxx_accelerate', setup_command = 'python setup --cxx=g++ --accelerate build-2022-03-22-20-38-03', launcher = None

    def configure_build_and_exe(name, setup_command, launcher=None):

        stamp = datetime.datetime.fromtimestamp(
            time.time()).strftime('%Y-%m-%d-%H-%M-%S')

        os.chdir(os.path.join(HERE, name, 'cmake'))
        shutil.copy(os.path.join('..', '..', '..', 'update.py'), 'update.py')

        if os.path.exists('autocmake'):
            shutil.rmtree('autocmake')
        shutil.copytree(os.path.join('..', '..', '..', 'autocmake'), 'autocmake')

        stdout, stderr = exe('python update.py ..')
        os.chdir(os.path.join(HERE, name))

        make_command = 'make'
        binary = './bin/example'
        if sys.platform == 'win32':
            setup_command += ' --generator="MinGW Makefiles"'
            make_command = 'mingw32-make'
            binary = 'bin\\\example.exe'

        if launcher:
            binary = '%s %s' % (launcher, binary)

        setup_command += ' build-%s' % stamp

        stdout, stderr = exe(setup_command)
>       assert stderr == ''
E       assert "python: can't open file 'setup': [Errno 2] No such file or directory\n" == ''
E         + python: can't open file 'setup': [Errno 2] No such file or directory

/home/milias/work/software/theoretical_chemistry/autocmake/test/test.py:73: AssertionError
------------------------------------------------------------ Captured stderr call -------------------------------------------------------------
ERROR: you need to install the pyyaml package
python: can't open file 'setup': [Errno 2] No such file or directory
___________________________________________________________ test_python_interpreter ___________________________________________________________

    def test_python_interpreter():
>       configure_build_and_exe('python_interpreter', 'python setup --cxx=g++')

/home/milias/work/software/theoretical_chemistry/autocmake/test/test.py:135:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _

name = 'python_interpreter', setup_command = 'python setup --cxx=g++ build-2022-03-22-20-38-03', launcher = None

    def configure_build_and_exe(name, setup_command, launcher=None):

        stamp = datetime.datetime.fromtimestamp(
            time.time()).strftime('%Y-%m-%d-%H-%M-%S')

        os.chdir(os.path.join(HERE, name, 'cmake'))
        shutil.copy(os.path.join('..', '..', '..', 'update.py'), 'update.py')

        if os.path.exists('autocmake'):
            shutil.rmtree('autocmake')
        shutil.copytree(os.path.join('..', '..', '..', 'autocmake'), 'autocmake')

        stdout, stderr = exe('python update.py ..')
        os.chdir(os.path.join(HERE, name))

        make_command = 'make'
        binary = './bin/example'
        if sys.platform == 'win32':
            setup_command += ' --generator="MinGW Makefiles"'
            make_command = 'mingw32-make'
            binary = 'bin\\\example.exe'

        if launcher:
            binary = '%s %s' % (launcher, binary)

        setup_command += ' build-%s' % stamp

        stdout, stderr = exe(setup_command)
>       assert stderr == ''
E       assert "python: can't open file 'setup': [Errno 2] No such file or directory\n" == ''
E         + python: can't open file 'setup': [Errno 2] No such file or directory

/home/milias/work/software/theoretical_chemistry/autocmake/test/test.py:73: AssertionError
------------------------------------------------------------ Captured stderr call -------------------------------------------------------------
ERROR: you need to install the pyyaml package
python: can't open file 'setup': [Errno 2] No such file or directory
_______________________________________________________ test_python_interpreter_custom ________________________________________________________

    def test_python_interpreter_custom():
        setup = 'python setup --cxx=g++ --python=%s' % sys.executable
>       configure_build_and_exe('python_interpreter_custom', setup)

/home/milias/work/software/theoretical_chemistry/autocmake/test/test.py:140:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _

name = 'python_interpreter_custom', setup_command = 'python setup --cxx=g++ --python=/usr/bin/python3 build-2022-03-22-20-38-03'
launcher = None

    def configure_build_and_exe(name, setup_command, launcher=None):

        stamp = datetime.datetime.fromtimestamp(
            time.time()).strftime('%Y-%m-%d-%H-%M-%S')

        os.chdir(os.path.join(HERE, name, 'cmake'))
        shutil.copy(os.path.join('..', '..', '..', 'update.py'), 'update.py')

        if os.path.exists('autocmake'):
            shutil.rmtree('autocmake')
        shutil.copytree(os.path.join('..', '..', '..', 'autocmake'), 'autocmake')

        stdout, stderr = exe('python update.py ..')
        os.chdir(os.path.join(HERE, name))

        make_command = 'make'
        binary = './bin/example'
        if sys.platform == 'win32':
            setup_command += ' --generator="MinGW Makefiles"'
            make_command = 'mingw32-make'
            binary = 'bin\\\example.exe'

        if launcher:
            binary = '%s %s' % (launcher, binary)

        setup_command += ' build-%s' % stamp

        stdout, stderr = exe(setup_command)
>       assert stderr == ''
E       assert "python: can't open file 'setup': [Errno 2] No such file or directory\n" == ''
E         + python: can't open file 'setup': [Errno 2] No such file or directory

/home/milias/work/software/theoretical_chemistry/autocmake/test/test.py:73: AssertionError
------------------------------------------------------------ Captured stderr call -------------------------------------------------------------
ERROR: you need to install the pyyaml package
python: can't open file 'setup': [Errno 2] No such file or directory
______________________________________________________________ test_python_libs _______________________________________________________________

    def test_python_libs():
>       configure_build_and_exe('python_libs', 'python setup --cxx=g++')

/home/milias/work/software/theoretical_chemistry/autocmake/test/test.py:144:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _

name = 'python_libs', setup_command = 'python setup --cxx=g++ build-2022-03-22-20-38-03', launcher = None

    def configure_build_and_exe(name, setup_command, launcher=None):

        stamp = datetime.datetime.fromtimestamp(
            time.time()).strftime('%Y-%m-%d-%H-%M-%S')

        os.chdir(os.path.join(HERE, name, 'cmake'))
        shutil.copy(os.path.join('..', '..', '..', 'update.py'), 'update.py')

        if os.path.exists('autocmake'):
            shutil.rmtree('autocmake')
        shutil.copytree(os.path.join('..', '..', '..', 'autocmake'), 'autocmake')

        stdout, stderr = exe('python update.py ..')
        os.chdir(os.path.join(HERE, name))

        make_command = 'make'
        binary = './bin/example'
        if sys.platform == 'win32':
            setup_command += ' --generator="MinGW Makefiles"'
            make_command = 'mingw32-make'
            binary = 'bin\\\example.exe'

        if launcher:
            binary = '%s %s' % (launcher, binary)

        setup_command += ' build-%s' % stamp

        stdout, stderr = exe(setup_command)
>       assert stderr == ''
E       assert "python: can't open file 'setup': [Errno 2] No such file or directory\n" == ''
E         + python: can't open file 'setup': [Errno 2] No such file or directory

/home/milias/work/software/theoretical_chemistry/autocmake/test/test.py:73: AssertionError
------------------------------------------------------------ Captured stderr call -------------------------------------------------------------
ERROR: you need to install the pyyaml package
python: can't open file 'setup': [Errno 2] No such file or directory
___________________________________________________________ test_python_libs_custom ___________________________________________________________

    def test_python_libs_custom():
        python_executable = sys.executable
        configure_build_and_exe(
            'python_libs_custom',
>           'python setup --cxx=g++ --python={0}'.format(python_executable))

/home/milias/work/software/theoretical_chemistry/autocmake/test/test.py:151:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _

name = 'python_libs_custom', setup_command = 'python setup --cxx=g++ --python=/usr/bin/python3 build-2022-03-22-20-38-03', launcher = None

    def configure_build_and_exe(name, setup_command, launcher=None):

        stamp = datetime.datetime.fromtimestamp(
            time.time()).strftime('%Y-%m-%d-%H-%M-%S')

        os.chdir(os.path.join(HERE, name, 'cmake'))
        shutil.copy(os.path.join('..', '..', '..', 'update.py'), 'update.py')

        if os.path.exists('autocmake'):
            shutil.rmtree('autocmake')
        shutil.copytree(os.path.join('..', '..', '..', 'autocmake'), 'autocmake')

        stdout, stderr = exe('python update.py ..')
        os.chdir(os.path.join(HERE, name))

        make_command = 'make'
        binary = './bin/example'
        if sys.platform == 'win32':
            setup_command += ' --generator="MinGW Makefiles"'
            make_command = 'mingw32-make'
            binary = 'bin\\\example.exe'

        if launcher:
            binary = '%s %s' % (launcher, binary)

        setup_command += ' build-%s' % stamp

        stdout, stderr = exe(setup_command)
>       assert stderr == ''
E       assert "python: can't open file 'setup': [Errno 2] No such file or directory\n" == ''
E         + python: can't open file 'setup': [Errno 2] No such file or directory

/home/milias/work/software/theoretical_chemistry/autocmake/test/test.py:73: AssertionError
------------------------------------------------------------ Captured stderr call -------------------------------------------------------------
ERROR: you need to install the pyyaml package
python: can't open file 'setup': [Errno 2] No such file or directory
=========================================================== short test summary info ===========================================================
FAILED test/test.py::test_extra_cmake_options - assert "python: can't open file 'setup': [Errno 2] No such file or directory\n" == ''
FAILED test/test.py::test_cxx - assert "python: can't open file 'setup': [Errno 2] No such file or directory\n" == ''
FAILED test/test.py::test_fc - assert "python: can't open file 'setup': [Errno 2] No such file or directory\n" == ''
FAILED test/test.py::test_fc_git_info - assert "python: can't open file 'setup': [Errno 2] No such file or directory\n" == ''
FAILED test/test.py::test_fc_int64 - assert "python: can't open file 'setup': [Errno 2] No such file or directory\n" == ''
FAILED test/test.py::test_fc_omp - assert "python: can't open file 'setup': [Errno 2] No such file or directory\n" == ''
FAILED test/test.py::test_fc_blas - assert "python: can't open file 'setup': [Errno 2] No such file or directory\n" == ''
FAILED test/test.py::test_fc_lapack - assert "python: can't open file 'setup': [Errno 2] No such file or directory\n" == ''
FAILED test/test.py::test_cxx_cblas - assert "python: can't open file 'setup': [Errno 2] No such file or directory\n" == ''
FAILED test/test.py::test_cxx_accelerate - assert "python: can't open file 'setup': [Errno 2] No such file or directory\n" == ''
FAILED test/test.py::test_python_interpreter - assert "python: can't open file 'setup': [Errno 2] No such file or directory\n" == ''
FAILED test/test.py::test_python_interpreter_custom - assert "python: can't open file 'setup': [Errno 2] No such file or directory\n" == ''
FAILED test/test.py::test_python_libs - assert "python: can't open file 'setup': [Errno 2] No such file or directory\n" == ''
FAILED test/test.py::test_python_libs_custom - assert "python: can't open file 'setup': [Errno 2] No such file or directory\n" == ''
============================================================= 14 failed in 0.69s ==============================================================
[email protected]:~/work/software/theoretical_chemistry/

Hello,

would it be possible for setup to print out wrong keyword ? For instance, --debug flag disappeared from DIRAC setup...why ?

[email protected]:~/work/software/dirac/master_trunk/../setup --fc=ifort --mkl=parallel --debug  --int64  build_ifort_mklpar_i8_debug
ERROR: bad input to ./setup

Usage:
  ./setup [options] [<builddir>]
  ./setup (-h | --help)

Bumps py from 1.7.0 to 1.10.0.

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Bumps pyyaml from 4.2b4 to 5.4.

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.