Magento application testing

In a Cloud Docker development environment, you can use the Magento Functional Testing Framework (MFTF) for Magento application testing. In this environment, you run MFTF commands using the mftf-command (CLI container command). For example, the following command generates the MFTF tests:

1
docker-compose run test mftf-command generate:tests --debug=none

Support for MFTF requires magento/magento-cloud-docker version 1.0 or later.

To set up and run MFTF tests in a Cloud Docker environment:

  1. Prepare the local environment.

    • Add the MFTF dependency to your project using Composer.

      1
      
      composer require "magento/magento2-functional-testing-framework" --no-update
      
    • Install the new Composer dependencies.

      1
      
      composer update
      
  2. Generate the docker-compose.yml file.

    1
    
    ./vendor/bin/ece-docker build:compose --with-selenium
    
  3. Start the Magento Cloud Docker environment. Optionally, you can set up Magento Cloud Docker to work in Developer Mode.

    1
    
    ./bin/magento-docker up
    
    1
    
    ./bin/magento-docker ece-redeploy
    
  4. Prepare the Magento application by adding environment variables that are specific to MFTF.

    1
    2
    3
    4
    5
    6
    
    CONFIG="MAGENTO_BASE_URL=http://magento2.docker/
    MAGENTO_BACKEND_NAME=admin
    MAGENTO_ADMIN_USERNAME=admin
    MAGENTO_ADMIN_PASSWORD=123123q
    MODULE_WHITELIST=Magento_Framework,Magento_ConfigurableProductWishlist,Magento_ConfigurableProductCatalogSearch
    SELENIUM_HOST=selenium"
    
    1
    
    docker-compose run deploy bash -c "echo \"$CONFIG\" > /app/dev/tests/acceptance/.env"
    

    In this example, the variable configuration is for testing a Magento application deployed to the Docker environment. To run tests in a remote environment, change the value of MAGENTO_BASE_URL to the remote URL and update the credentials as needed.

  5. Disable the Magento settings that conflict with MFTF functionality.

    1
    
    docker-compose run deploy magento-command config:set admin/security/admin_account_sharing 1
    
    1
    
    docker-compose run deploy magento-command config:set admin/security/use_form_key 0
    
    1
    
    docker-compose run deploy magento-command config:set web/secure/use_in_adminhtml 0
    
  6. Enable the Varnish cache for the Magento application.

    1
    
    docker-compose run deploy magento-command config:set  system/full_page_cache/caching_application 2 --lock-env
    
    1
    
    docker-compose run deploy magento-command setup:config:set  --http-cache-hosts=varnish
    
  7. Clear the cache.

    1
    
    docker-compose run deploy magento-command cache:clean
    
  8. Generate MFTF tests.

    1
    
    docker-compose run test mftf-command build:project
    
    1
    
    docker-compose run test mftf-command generate:tests --debug=none
    
  9. Run the generated tests.

    1
    
    docker-compose run test mftf-command run:test AdminLoginTest --debug=none
    
    1
    
    docker-compose run test mftf-command run:test AddProductBySkuWithEmptyQtyTest --debug=none