CHANGES
=======

0.90
----

* Remove all order in testcases.yaml
* Wrap long env values
* Fix duration calculation
* Remove order in testcases.yaml
* Make testcases descriptions optional
* Suppress admin password in default logs
* Stop building xtesting-mts for arm32
* Updated from global requirements
* Install py3-wheel in xtesting
* Build arm\* xtesting-mts on TravisCI
* Fix bash mistakes
* Set CFLAGS="-O0" when cross-compiling lxml
* Add MTS driver
* Update to alpine3.12
* Drop py27
* Updated from global requirements

0.88
----

* Fix behave-html-formatter py conditions

0.87
----

* Post-processed data from DB
* Publish Xtesting2020
* Publish CNTT Snezka RC Cookbook
* Switch to multiarch binfmt
* Select arm32v6 et arm64v8 repos
* Fix tox env list in travis-ci
* Add python3.8-distutils when verifying vs travis-ci
* Update Alpine to 3.11
* Fix behave driver and its related unit tests
* Compress Campaign data (zip)
* Dump DB and artifacts for third-party certification
* Disable false ansible list warnings
* Mock os.path.join in push\_to\_db
* Postprocess the TestAPI href returned
* Run update package index before installing pkg in Circle CI
* Forbid multipart upload if google storage
* Add ContentType when publishing artifacts
* Improve file scanning when publishing artifacts
* Add links in testcase details
* Print Test API links in console
* Add S3 env vars in env.py
* Generate Html and Xunit Behave reports
* Create Bucket if it doesn't exist
* Publish artifacts to S3 repository
* Override default Xtesting Ansible role values
* Improve dependency list (CircleCI)
* Run Xtesting unit tests via CircleCI
* Run perm when verifying changes
* Override the right default testcases.yaml
* Fix remaining py36 testenv
* Fix ssl issues in travis-ci
* Override the new testcases.yaml
* Updated from global requirements
* Switch to Python 3.7 and Alpine 3.10
* Adding first patch for behave feature

0.70
----

* Remove energy modules
* Updated from global requirements
* Run bandit when verifying changes
* Set utf-8 in decode and encode calls
* Fix unit tests (py36)
* Stop setting utf-8 in decode/encode calls
* Rename HelloWorld.txt to HelloWorld.robot
* Update to Python3

0.62
----

* Enable debug messages via env var
* Update to opendev.org in tox.ini
* Update all OpenStack refs to opendev.org
* Updated from global requirements
* Add python3.6-dev
* Run tox in .travis-ci
* Build Raspberry PI image via travis-ci
* Publish the presentation for ONS 2019
* Fix manifest-tool builds
* Update Alpine tag in build.sh
* Update to Apine 3.9
* Updated from global requirements
* Fix default host in ansible (127.0.0.1)
* Remove former ci jobs
* Fix typo
* Remove url from logs
* Updated from global requirements
* Apply operations via sixer
* Allow printing bash cmd output in console
* Generate reports for unit tests
* Fix OpenStack version (master) in tox.ini
* Verify the Ansible playbook via ansible-lint
* Verify missing yaml files via yamllint
* Deploy CI/CD toolchains for any Xtesting-based project
* Enable robot sample in the container
* Set shell=True in subprocess.check\_call
* Stop returning values in run()
* Temporarily disable py36
* Fix a wierd pylint error
* Update python3 to python3.6
* Updated from global requirements
* Follow OpenStack master
* Rewrite git clone

0.60
----

* Publish daily and gating jjbs
* Update to Alpine 3.8
* Remove former samples/testcases.yaml
* Stop verifying ResultWriter.write\_results exit codes
* Change output dir
* Update RobotFramework config
* Initialize testcase results to EX\_TESTCASE\_FAILED

0.57
----

* Protect vs None when calling regex
* Leverage on abc and stevedore

0.56
----

* Skip the selected testcase too
* Generate robot reports
* Allow calling a skip test
* Stop skipping testcases if one raises exceptions

0.53
----

* Stop printing exceptions twice
* Fix results when only one skipped test

0.52
----

* Allow dynamically skipping testcases

0.51
----

* Skip testcases by any env var
* Improve dependency management

0.42
----

* Remove Feature logger
* Check shell scripts via bashate

0.41
----

* Create a static method to configure logger

0.40
----

* Update to stable/queens
* Updated from global requirements
* Exclude doc/reveal.js from perm
* Updated from global requirements
* Check README.rst by doc8
* Check API doc via doc8
* Ignore output dirs and files
* Fix software names (uppercase letters)
* Update Xtesting presentation
* Publish xtesting presentation

0.31
----

* Fix regex when INSTALLER\_TYPE is unset
* Update api/index.rst

0.24
----

* Add classifiers (pypi)
* Add README.rst (pypi)
* Add a travis-ci config file
* Add build.sh for functest-xtesting
* Add tags support using include options

0.23
----

* Add py3 support in samples

0.22
----

* Return all status when running tiers

0.21
----

* Stop filtering the project when calculating results
* Remove Functest-related env vars
* Leverage on tags for all versions

0.2
---

* Set universal wheels
* Ensure py27 and py35 supports
* Add mandatory package infos (PyPI)
* Switch from /home/opnfv/functest to /var/lib/xtesting
* Remove obsolete Alpine packages
* Publish Dockerfile and samples
* Fully cover tier\_builder.py
* Remove all OpenStack operations in vnf.py
* Rename all Functest refs to Xtesting
* Clean all OpenStack related modules
* Raise exceptions when SDN\_CONTROLLER\_IP is None
* Stop raising keystoneauth1 exceptions in odl unit tests
* Remove openstack utils
* Fix KeyError of OS\_AUTH\_URL
* Switch to snaps in orchestra testcases
* Fix default identity version in conf\_utils
* Set Energy default values to None
* Switch to $REPO in travis-ci jobs
* Print env vars and env\_file
* Automatically download defcore.txt
* Update Functest to meet last snaps updates
* Use functest repo variable
* Switch from CONST to CONF
* Use constants for Functest config file
* Print stdout and stderr when calling commands over SSH
* Unify security group operations
* Leverage of snaps creds to get the right region name
* Create a second user in cloudify\_vrouter
* Remove deprecated monkey patches
* Remove last CONST.\_\_getattribute\_\_()
* Manage region in cloudify\_ims.py
* Fix credentials in cloudify\_vrouter
* Generate tempest verification report (HTML)
* Disable orchestra\_clearwaterims in functest-vnf
* Precise Tempest tests list
* Enhance variable manipulation in tempest
* Remove one debug print
* Mock additional methods related to OpenStackFlavor
* Add suffixes in vnf keypair names
* Get properly env vars or their default values
* Add suffixes to OpenStack resource names
* Fix typos in cloudify\_ims
* Stop reading SDN\_CONTROLLER env var
* Removed os\_utils and fully switched to snaps
* Stop reading NODE\_NAME in tempest and refstack
* Enable doctor-notification
* Only filter boot\_server\_from\_volume\_and\_delete via scenario
* Remove INSTALLER\_IP from Functest
* Enhance variable manipulation in rally
* Test vnf in all os-nosdn-nofeature scenarios
* Temporarily disable doctor-notification
* Remove obsolote env var IS\_CI\_RUN
* Improve the way of getting env values
* Improve the way of setting values in CONST
* Simplify functest/cli/commands/cli\_env.py
* Read env vars instead of using CONST in API
* Export env vars instead of CONST in refstack
* Fix the config of fixed\_network\_name in tempest
* Enable invalid-name warnings in tempest modules
* Export env vars via os.environ in test\_openstack\_utils.py
* Export env vars via os.environ in test\_cli\_env.py
* Decrease log level in Energy messages
* Run all daily testcases if CI\_LOOP is unset
* Read the env file only if exists
* Ensure logging is disabled when unit testing feature
* Unlink robotframework from constants
* Fix pylint errors/warnings in tempest modules
* Remove one obsolete var
* Unlink feature from constants
* Unlink vnf from constants
* Unlink run\_tests from constants
* Unlink Energy from functest utils and constants
* Move get\_dict\_by\_test() into run\_tests.py
* Conform with OpenStackUser.get\_os\_creds() in juju\_epc
* Get neutron endpoint via snaps in odl
* Move source\_credentials() into run\_tests.py
* Refactor tempest resource manager
* Add variablefile as possible robot.run() args
* Revert "Temporary disable one unstable snaps test"
* Temporary disable one unstable snaps test
* Remove dns server from juju\_epc config
* Fix rally cinder volume attach scenarios
* Disable orchestra\_\* testcases
* Stop printing data sent to DB
* Fix docstrings
* Switch to the readthedocs theme for api docs
* Remove yamllint from upper-constraints.txt
* Add build\_sphinx section in setup.cfg
* Blacklist Quotas.nova\_update\_and\_delete test
* Increase Rally full criteria
* Add modules docstrings in snaps
* Update results printed in configguide.rst
* Fix links in configguide.rst
* Fix JujuEpc prepare() and deploy\_orchestrator()
* Do not use shell to execute commands in tempest
* Stop setting ext net in config
* Rename a common credential file for OS and K8S
* Install vEPC dependencies in Dockerfile
* Fix a typo in docstring
* Add tempest and rally in functest-features
* Use snaps\_utils to get credentials in tempest
* Removal of deprecated SNAPS-OO classes in juju\_epc
* Fix pylint errors/warnings in rally
* Remove duplicated code related to snaps creds
* Fix pylint errors about refstack
* Enable epc unit tests
* Fix the connect issue when checking deployment
* Create subnet and net within the same project
* Fix warnings in all snaps-related modules
* Fix pylint errors in several utils modules
* Avoid duplicating get\_parameter\_from\_yaml
* Fix last Pylint error in Functest
* Refactor rally report generation
* proper instance status handling
* Fix pylint warnings/errors in cli
* Delete functest\_vacation.py
* Disable all missing-docstring warnings in unit tests
* Partially rewrite test\_run\_tests.py
* Fully test and cover functest/ci/tier\_\*
* Move push\_results\_to\_db to TestCase
* Configure password for the user in vnf
* Fix Rally output retrieval
* Update set of region identity attribut
* Build functest-parser for arm64 via travis-ci
* Switch to absolute paths in Dockerfiles
* Delete the updated Alpine image
* Build vnf and restapi containers for ARM
* Fix tempest error on Apex
* Introduce Euphrates main changes
* Remove the judgement of OS\_ENDPOINT\_TYPE
* Modify cmd for parser
* Remove the obsolete configs in config yaml
* Configure physical\_network when creating network
* Disable keystone v2 if keystone v3 is available
* Update Alpine to 3.7
* Execute feature command by subprocess directly
* Config physical network when creating tempest net
* Clean base images only if 1 container was built
* Clean Docker images after builds
* Dynamic region name of juju cloud
* Add Docker build opts
* Add euphrates as a docker tag to the release notes
* Update cirros image to 0.4.0
* Enable orchestra testcases for Daisy only
* Suggest to pull manifests instead of arch tags
* Remove logger\_test\_results
* Fix typos in test\_details.rst and test\_overview.rst
* Get auth token when checking deployment
* Remove openstack\_[clean,snapshot]
* Delete TestCase.create\_snapshot()
* Blacklist rally ceilometer scenarios
* Remove OSGCTestCase
* Switch to public keystone endpoint
* Enforce a versioned public identity endpoint
* Filter out orchestra for ssl enabled deployments
* Inject all envs in openrc into CONST
* [vyos\_vrouter] Support https endpoints
* Improve the pylint score of functest-core
* Change the name of flavor and disabled ssh-hostname verification
* Fix yamllint errors in functest/api
* Add missing character to aarch functest conf file
* All patching config files in memory
* Ensure that all energy modules are fully covered
* Update release notes for Euphrates 5.1
* Add python3 support in cli
* Add python3 support in energy
* Mock time.sleep() to decrease test duration
* Add python3 for Functest utils
* vEPC tests with juju as an VNF manager
* Set the ram of flavor 1024
* Add Python3 support in functest/ci
* Fix yaml format errors in vnf
* Pull functest-core when only building childs
* Assign heat\_stack\_owner role to the new user
* Remove the config of promise
* Fix the yamllint errors in functest/ci
* Fix pylint errors of vping
* Create a tox env to check yaml files
* Adjust timeouts in Vnfs
* Reorder Vnf testcases
* Stop updating test\_db\_url in config file by env var
* Filter installers for cloudify\_vrouter
* Skip modifying creds if Variables.robot is missing
* Update documentation of Functest
* Force Framework to be fully covered
* Remove one obsolete test in test\_odl.py
* Cover vnf.prepare()
* Fix the doc of snaps test
* Fully cover vnf
* Create RobotFramework class
* Remove os\_utils call from cloudify ims and vrouter
* Enable Doctor testcase for F-release
* Enable baro\_tests testcase for F-release
* Fix relative imports in cloudify\_ims\_perf
* Remove iniparse and urllib3 dependencies
* Remove \_set\_others() from config
* Fix how tier\_handler is imported
* Remove openstack utils calls in rally and tempest
* Remove prepare\_env
* Removal of deprecated SNAPS-OO classes
* Fix "Broken pipe" IOErrors of rally run
* Fix the way of getting endpoint port
* Fix rally db issue
* Enable sdnvpn testcase for F-release
* Support to specify the valid external network name
* Check external network
* Update documentation for Functest
* Enable sfc testcase for F-release
* Remove Domino and Promise testcases
* Updated from global requirements
* Remove the tox venv patcharm64
* Update unit test related to vyos\_vrouter
* Update the version of refstack set to 2017.09
* Fix the regular expression for refstack
* Remove opnfv module from functest-core
* Do not use cache when building the image
* Add shebang in snaps\_suite\_builder.py
* Remove $BRANCH in healthcheck/Dockerfile
* Update INFO file with new PTL information
* Move rally and tempest in functest-restapi
* Remove rally and tempest from core/Dockerfile
* Move rally and tempest out of functest-core
* Add BRANCH as Docker build arg
* Select the subset of snaps test cases
* Remove the former Dockerfile
* Stop installing docker/config\_install\_env.sh
* Stop installing enable\_remote\_api.sh
* Patch Functest docker images for ARM
* Fix the format of getting upper-constraints
* Move fds to features tier
* Protect vs exceptions when ext\_nets is empty
* Define thirdparty-requirements.txt for functest-parser
* Allow building containers from a gerrit change
* Update Functest to OpenStack stable/pike
* Fix rally cinder scenarios
* Add new cinder scenarios for rally sanity/full
* Remove the constraint of INSTALLER\_TYPE
* Add new neutron scenarios for rally sanity/full
* Adopt new config schema for rally 0.10
* Update INFO file
* Add new nova scenarios for rally sanity/full
* Add new glance scenarios for rally 0.10
* Remove some obsolete scenarios for rally 0.10
* Update Rally to 0.10
* Bump os-faults version to 0.1.15
* Update INFO file
* Wrap Functest Ascii Diagram in literal text block
* Save Euphrates results in repo
* Get the right git commit ids for ubuntu image
* Take into account a feedback from the meeting
* Release notes for Euphrates 5.0
* Switch from BashFeature to Feature of bgpvpn testcase
* Fix another typos in dockerslicing.md
* Fix 1 typo in dockerslicing.md
* Harmonization titles of the testing project
* Complete dockerslicing.md
* Update blacklist about migration tests for rally
* Update Docker slicing presentation
* Update requests to 2.13.0 in virtualenvs
* Enhance the compatibility judgement of INSTALLER
* Update project field of fds testcase to fastdatastacks
* Force requests===2.13.0
* Fix former default values in build.sh
* Get the right git commit ids
* Conform with Docker ARCH names
* Allow building aarch64 images
* Publish Docker Slicing Presentation
* Update userguide and configguide
* Fix fail of vRouter on Orange POD
* Include tempest\_custom in the documentation
* Fix the format issue of documentation
* Modify the egg name for parser
* Complete framework documentation part for VNF
* Add UEFI image extra properties for CentOS image for aarch64
* Update Config Guide
* Live migration support determination in rally
* Disable vyos\_vrouter
* Report duration and result when vping fails
* Create a router in both vping scenarii
* Add icmp rules for clearwaterims case
* Bug fix: vping\_userdata test status was not properly reported
* Add ${DOCKER\_TAG} in Docker hooks
* Enable promise on all fuel and joid scenarii
* Remove tempest\_custom from testcases configs
* Fix userdata issue for vping and orchestra
* remove icmp rules from secgroups
* Force python2 when creating venv for refstack
* Fix connection error due to invalid lib version usage
* Switch to OS\_PROJECT\_NAME
* Update Functest documentation for Euphrates
* Add log details on SDK first connection
* Fix timeout for socket connection
* Disable Promise testsuite on Fuel installer
* Fix creds still used by vrouter
* Support https when testing ODL
* Adding orchestra test cases to orchestra project
* Remove void return value mocks in rally unit tests
* Remove false hooks for functest-parser
* Add python3-dev and python3-pip in former Dockerfile
* Remove white space when listing testcases
* Dedicated flavors for rally tests
* Remove restriction to fuel on vyosvrouter case in Alpine
* Add swagger support for Rest API
* Select ansible 2.3.2.0
* Return Functest status to Jenkins
* Fix image name in rally scenarios
* increase timeout of NFVO installation
* Enable parser testcase
* Enable Doctor testcase
* Enable Domino testcase
* Remove securityscanning testcase
* Fix one whitespace character
* Remove useless enabled: true in testcases.yaml
* Bug fix: wrong dependency filter for lxd scenarios
* Refactor resource creation and cleanup in rally
* Enable tempest run concurrently
* New testcase creation named "cloudify\_ims\_perf"
* Override tempest upper-constraints in functest-parser
* Select $OPENSTACK\_TAG instead of stable/ocata
* Optimize Alpine Dockerfiles
* Add packages in docker alpine containers
* Allow reading log file with byte offset
* Disable urllib3 warnings
* Add Functest restapi container
* Remove thirdparty-requirements.txt in smoke
* Add Docker automated build hooks for Parser
* Fix some errors about getting tiers resources
* set marketplace port to 8080 for NFVO
* Fix bug in cloudify\_ims: no return code
* Remove volume type handling
* Re-enable orchestra tests (VNF)
* Allow live migration related tests to run
* Remove Parser from the former Container
* Use git commit id for refstack-client
* Update ODL testcase to Keystone v3
* Exclude api\_check on lxd scenarios
* Fix pylint errors in test\_refstack\_client
* Use git commit id for ODL
* [Fuel/MCP] Set opendaylight web/restconf ports
* Publish a container for Parser
* Use custom images and flavors for aarch64
* Unify the key as testcase in result
* Remove redundant tempest cleanup utility
* Fix creds used by vrouter
* Unlink Functest and FDS tags
* Fix all refstack-client requirements on-the-fly
* Set os-faults 0.1.10
* Integrate doctor-test package
* Create VNF user with admin role
* unify all the return status as number
* Stop using master for pip
* Stop downloading openbaton image
* Integrate new Domino package
* Create results/tempest dir for refstack config
* Fix the cloudify\_ims update quotas error
* Delete some unittest which block the verify job
* More support of snaps for VNF
* Remove get\_repo\_tag
* Blacklist CeilometerTraits tests
* Fix get\_port\_by\_name in ims testcases
* Stop cloning doctor and domino
* Allow building Alpine containers from any gerrit changes
* Unlink Functest and Domino tags
* Remove openstack-requirements from requirements.txt
* Enable tempest multinode tests
* Remove all useless dependencies
* Stop removing /src/openstack-requirements/.git
* Add all missing dependencies
* Fix all rally requirements on-the-fly
* Add UEFI support in functest
* Remove tacker library from functest
* Activate SFC testcases in CI (alpine)
* Activate SFC testcases in CI
* Blacklist CeilometerEvents tests
* Allow building functest-vnf via build.sh
* Remove installer constraint on vyos\_vrouter test case
* Make the vnf images public
* Revert cirros downloading urls to official ones
* Put vnf\_test pass if more than 80% of vnf test result are OK
* Fix securityscanning/config.ini path
* Refactor the vyos\_vrouter to adopt VNF abstraction
* Remove get\_installer\_type
* Temporarily download cirros from artifacts
* Avoid exiting when snapshot initialization failed
* Clean repo: mano directory not used
* Obtain scenario by CONST instead of get function
* Launch Functest RestApi once the container is run
* Add log info of refstack tests into functest.log
* Get rid of tacker\_client\_install.sh
* Remove Onos in Functest
* download\_images.sh: add --keep option to avoid redownloading images
* Updated sfc section in testcases
* Fix args parsing in run\_tests
* Fix the config of vping net
* Create API to update hosts info
* Create API to get log for each task
* Patch Read aarch64 architecture
* bug fix download\_images.sh
* Fix the tempest error when creating snapshot
* Prevent KeyError during main args parsing
* Add Rally scenarios for telemetry
* Ensure that aarch64 patch can be applied
* Fix aarch64 patch
* Download images from marketplace.openbaton.org:8082
* Refactor resource creation and cleanup in Tempest
* Read aarch64 architecture
* AArch64: SNAPS: CentOS, Ubuntu image config
* Fixes image download script
* Complete caching images for vnf testcases
* Use dnsmasq to cache DNS queries
* Functest Doc: first update for Euphrates - move part of the dev group to the testing document - move reporting into user guide - update logs - introduce alpine - introduce functest API - split documents per chapter
* Config test\_accounts\_file for refstack\_defcore
* Specify physical\_network when creating network
* Add the skipped testcases into details
* Added means to override the RC file credentials
* Euphrates cleaning: remove any reference to aaa vnf
* Allow caching images for vnf testcases
* Give a list of links to wget
* Remove opera testcase as Opera is inactive
* Create API to run a test case
* Complete the container opnfv-vnf
* Fix ci\_loop conditions for vnf
* Allow defining CI\_LOOP via env
* Updating the constrains for the Barometer test-suite
* Create API to update openrc
* Remove the tenant and user created for tempest
* Integrate cloudify\_ims in functest-features
* Fix summary in run\_tests.py
* Put domain name in CONST
* Remove multisite support
* Switch to blocking: false for ODL in functest-smoke
* Disable temporarily Doctor from Functest
* Specify valid external network as an env
* Obtain pod\_name by CONST instead of get function
* API proposal for functest
* Switch to blocking: false for ODL testcase
* Clean run\_tests.py and the related ut
* Update ODL tag to release/carbon
* Use separate timeouts for connection and reading
* Revert "Enable parser project"
* Fix domain in tenant creation
* Obtain build\_tag by CONST instead of get function
* Remove timestamp in the details for tempest
* Fully integrate promise in functest-features
* Remove copper refs
* Remove netready refs
* Update promise upper constraint
* add orchestra\_clearwaterims testcase
* Keep the promise working dir in /src
* Fix the logic of adding/updating tempest.conf
* Integrate the netready package
* Integrate the promise package
* Add/Update tempest.conf via a specific file
* Record the test cases passed in tempest
* Improved error handling when Energy recorder API is unavailable
* Configure AARCH64 image settings for UEFI
* Add copper and domino in functest-features
* Switch to Docker post\_checkout hooks
* Fix import and docstrings in onos/teston
* Remove rnc unit test dir as empty
* Add functest-components based on Alpine
* Add functest-features based on Alpine
* Clean smoke requirements
* Add all ODL testcases in functest-smoke
* Fixed test description for snaps\_smoke
* Restrict ping only once in ping.sh
* update/improve orchestra\_ims
* Omit space line in openrc file
* Fix dockerfile patch for aarch64
* Enable parser project
* Modified Dockerfile.aarch to a patch
* Add id to test\_list for tempest\_custom
* Add AARCH64 images back to Functest
* Save space in Alpine containers
* Add script to build all containers
* Conform the RefStack testcase with the Rally context
* Wait for refstack-client to finish
* Change calls to SNAPS library exposing OpenStack instance objects
* Release notes for Danube.3.0
* Remove add\_images.sh
* Add reporting results for Danube 3.0
* Fix some issues in cloudify\_ims
* Correct odl port for compass installer
* Release notes for Danube 2.0
* Switch to check\_deployment instead of check\_os.sh
* Add odl configurations for odl testcase in daisy environment
* Use decorators for mock patching
* Add openssh-client in core
* Add decorators in testcases for energy recording
* New python script to check openstack deployment
* Allow regex for blacklist scenarios/installers
* Define CMD in smoke and healthcheck containers
* Download Functest's upper-constraints.txt
* Add upper-constraints.txt for Functest
* Add lesser containers based on Alpine
* Stop redefining $HOME
* Get rid of install\_rally.sh
* Inherit packages when creating /src/tempest/.venv
* Stop using tempest version in Dockerfile
* Fix get\_endpoint
* Remove setup\_env for refstack in Dockerfile
* Move rally and tempest to requirements.txt
* Fix logger name in vping\_base.py
* Add a default value to protect add\_images.sh
* Set repo\_tempest to /src/tempest
* Enable cloudify\_ims
* Enable refstack work on https without SSL checks
* Convert files to Unix format
* Clone tempest before installing the package
* bugfix: vping support not\_hugepage\_configured pod
* Fix environment variables in Dockerfile
* Cleanup Tempest blacklist for Euphrates
* Sync thirdparty-requirements.txt
* Fix upper-constraints.txt url
* Update the link to firewall\_block\_image.img
* [cloudify\_ims] Support Cloudify 4.0
* Remove the former link /home/opnfv/repos/functest
* Update cli commands to call console scripts
* Apply restrictive file permissions
* Stop modifying unix perm in cloudify\_ims
* Fix unix permissions in docs/com
* Remove useless files in docs/com
* Fix typos in docs
* Energy monitoring SDK update
* Define download\_images.sh and check\_os.sh as scripts
* Define console\_scripts
* Fix unix permissions
* Update securityscanning section in testcases.yaml
* Define ODL console\_script
* Remove networking-bgpvpn from Functest requirements
* Remove BGPVPN utils in Functest
* Get install\_rally.sh from git.openstack.org
* Switch to official tosca-parser and heat-translator
* Leverage on parser python packages in Dockerfile
* Update paths in functest/ci/testcases.yaml
* Fix refstack\_defcore
* Added unit tests for vping
* SNAPS tests now support offline testing
* Remove Rally requests scenario
* Updated fds testcase criteria
* Add sfc in thirdparty-requirements.txt
* Increase timeout of Open Baton installation
* Remove Tempest repo and use the one created by Refstack
* enable doctor-notification test case
* Fix floating ips issue in openstack\_clean
* Fixed problem to vping userdata introducted by SNAPS-OO patch
* Add securityscanning in thirdparty-requirements.txt
* Remove obsolete repos in functest/ci/config\_functest.yaml
* Change floating ips management from nova to neutron
* Don't display functest report for single test cases
* Take OpenStack's constraints into account
* Make rally support https insecure deployment
* Use glance to list images
* Enable vping offline
* Remove calls to deployment handler in prepare env
* Revert rally version to 0.8.1
* Clone tempest repository in the Docker image
* Fix command in prepare env to execute check\_os.sh
* Define logger as Feature instance attribute
* Install opera via python package
* Install OPNFV sdnvpn via python package
* Stop personalizing the common Dockerfile
* Enable https insecure for functest
* Use directly OpenStack project packages
* Change barometer module to load
* Added unit tests for api\_check, health\_check, and smoke tests
* Remove all references to /home/opnfv/repos/functest
* Stop getting git data from functest dir
* Clean requirements.txt
* Remove module references \_\_file\_\_
* Update Suite details pushed to DB
* Update (test-)requirements.txt
* Promote Linda Wang as a committer
* Bugfix: fix the return value
* Leverage on pbr (Python Build Reasonableness)
* Configure the param auth\_version in tempest.conf
* Remove call to fetch\_os\_creds.sh
* Update setuptools version to 30.0.0
* Refactor core VNF class
* Remove a former action listed in framework.md
* Add the copyright header to decorators.py
* Use PrettyTable to show functest env
* Use constants in odl
* Make tempest user\_password more complicated
* Update setuptools version to 35.0.2
* Use CONST to retrieve db\_url rather than getter function
* Added unit tests for the connection\_check test case
* Return pylint status code for modules rated 10/10
* Enable tempest offline by use\_custom\_images=True
* Fix a typo in framework.md
* Fix a typo in docstring
* Define create\_snapshot() and clean() in TestCase
* Chmod 755 functest/ci/download\_images.sh
* Fix one email address in INFO
* Rename framework.html to index.html
* Move api out of the docs directory
* Rename logger to \_\_logger in unit.py
* Protect against self.suite = None
* Switch shebangs to /usr/bin/env python
* Export the Pylint results via pylint.out
* vping&snaps\_xxx support not\_hugepage\_supported pod
* Fix some pylint errors in onos package
* Stop printing in console when testing functest\_utils.py
* Add docstrings in unit
* Rename the class TestSuiteRunner to Suite
* Rename test\_pytest\_suite\_runner.py to test\_unit.py
* Rename pytest\_suite\_runner.py to unit.py
* Call fetch\_os\_creds.sh from $PATH
* Bugfix: fix two typos
* Update test\_vnf.py to support py3
* Test decorators.py in testenv:py35
* Turn Sphinx warnings into errors
* Remove former run\_unit\_tests.sh
* Check python3 support when running tox
* Generate api doc when running tox
* Update apidoc to conform with vnf module
* Analyse code when running tox
* Check style when running tox
* Delete line breaks before binary operator
* Sort keys when dumping json
* Ignore .tox
* Tox utility to run unit tests
* Update requests as defined in releng
* Add baro\_tests as requirements
* Install releng via requirements.txt
* Set default value for CONFIG\_FUNCTEST\_YAML
* Activating SDNVPN test cases for master
* Re-Enable Promise testcases
* Bugfix: fix the errors of onos\_sfc
* Fully cover pytest\_suite\_runner.py
* Precise self.result in pytest\_suite\_runner.py
* Replace CONST.\* by getattribute/setattr for refstack
* Replace CONST.\* by getattribute/setattr for rally and tempest
* Print stack when catching exceptions in run\_tests.py
* Modify how to disable logging in unit test
* Use StringIO in odl.py
* Use logger instead of printing in console
* Remove check\_success\_rate
* Replace CONST.\* by getattribute/setattr for cli
* Add a new directory to hold pre-downloaded images
* Fix 2 issues related to logger in pytest\_suite\_runer.py
* Allow running unittest.TestCase via run\_tests.py
* Clean test-requirements.txt
* Update self.result value to INT
* Conform constants.py with the minimal standards
* Fix an unorderable types error (if python 3)
* Add Python3 support to the ODL testcase
* Update/Add requirements to run ODL robot CSIT
* Converted vPing to leverage the object-oriented SNAPS library
* Define Runner class
* Add enabled flag in testcases.yaml
* Switch from generate\_report to PrettyTable
* Update framework pres
* Fix how to get tier\_name
* Fix one minor typo
* Additional Unit Tests for core modules
* Get a logger before printing
* Fully cover the decorator
* Assign the wrapped function’s attributes
* Upgrade robotframework-sshlibrary to 2.1.3
* Modify TestCase.\_\_str\_\_() to use PrettyTable
* Remove the former results in DB url
* Add Energy recording support
* Conform ODL with last framework updates
* Rename VnfOnBoardingBase to VnfOnBoarding
* Rename vnf\_base to vnf
* Bugfix: initialize the logger for snaps
* Fix the opera ims instance initialization error
* Implement TestCase \_\_str\_\_()
* Rename TestCase check\_result() to is\_successful()
* Print the real testcase duration
* Replace CONST.\* by getattribute/setattr
* Replace project\_name by case\_name in result file name
* Add iniparse to requirements.txt
* Check open args in test\_odl
* Add Danube 2.0 reporting status
* Forbid calling generate\_report from cmdline
* Define loggers as class-private members
* Delete functest.utils.functest\_logger
* Move few local ODL SFC confs to global functest confs
* Extended the timeout for Opera
* Remove openstack directory
* Update tempest.conf to enable tempest from external server
* refstack-client userguide
* Updated basic attributes for opera testcase
* Remove create\_instance\_and\_ip.py
* Publish framework presentation
* Add the choice of interface for keystoneclient
* Remove missing statements in test\_odl
* Restrict coverage output to all functest packages
* Fix pylint warnings in snaps
* Update rally\_conf.json for creating deployment
* Fix the instance initialization error for OnosSfc
* Logger must be a singleton
* Documentation for unit test project
* Fix false positives in test\_tempest
* Catch os.makedirs() exceptions in tempest.py
* Manage criteria in TestCase
* Switch TestCase attribute criteria to result
* Remove the useless opnfv\_tests dir in tests
* Remove useless lines of code in barometer.py
* rename tempest.conf to refstack\_tempest.conf
* Switch testcase to test case in docstrings
* [VNF\_base] Support existing tenant and user
* Remove exec right for ci config files
* Ignore \_build (sphinx output dir)
* Fix pylint warnings in decorators.py
* Minor changes in docstrings
* Stop hardcoding results suffix in push\_to\_db
* Add mock to requirements.txt
* Update INFO file for Euphrates
* Add docstings in feature.py
* Remove former cmd instance attribute
* Fix Sphinx warnings/errors
* Use Sphinx to create API documentation
* Fix the irc channel
* Add class attribute docstrings in testcase.py
* Fix typos in vnf\_base.py
* Add copper section in testcases.yaml
* Add license in feature.py
* Remove deprecated feature modules
* update check\_os.sh admin port seds to match public
* Set image and flavor id in tempest config file
* Updated method calls to SNAPS tests
* Refactor the Feature framework
* Modify TestCase constructor attributes
* Rename test\_ims\_base.by to test\_ims\_base.py
* Write feature case names in testcases.yaml
* Add unit tests for parser
* Bugfixing the testcases execusion
* Bugfix: Add case\_name as constructor arg for snaps\_smoke
* Increase ram for tempest tests (aarch64)
* Add case\_name as args in all features
* Bugfix: Add case\_name as constructor arg for snaps and rally
* Fix VIM onboarding and ims deployment
* refstack client: improvement and fix of TestCase usage
* Add unit tests for feature
* Add unit tests for security\_scan
* Add unit tests for sdnvpn
* Add unit tests for promise
* Add unit tests for odl\_sfc
* Add unit tests for netready
* Add unit tests for domino
* Add unit tests for doctor
* Add unit tests for copper
* Add unit tests for barometer
* Add case\_name as constructor arg
* Backup of reporting status for Danube 1.0
* [Clearwater Test] Fix bug in error message
* Enable the deployment info print for compass
* Adding label for userguide
* Make tempest cleanup resources after running
* Check a rule existence for a specific security group
* Upgrade to the latest kingbird version
* Re-enable rally and tempest full for weekly
* Release notes for Danube 1.0
* modify old naming testcase\_base to testcase
* Clean up Tempest blacklist
* Disable tempest server reboot test for SDNVPN and Gluon
* More Unit Tests for tempest and IMS module
* Added test case for opera vims
* refstack: bugfix of name TestCase
* Add docstrings in odl
* Fully fix pylint warnings in test\_testcase
* Rename test\_testcase\_base to test\_testcase
* rename FeatureBase to Feature
* rename feature\_base to feature
* Fix pylint warnings in test\_odl
* modify old naming Testcase\_base to TestCase
* Revert "Make SFC test a python call to main()"
* refstack client: manually running improvement
* More Unit Tests for utils module
* Remove vping\_ssh from bgpvpn and gluon scenario
* Fix pylint warnings in odl
* Add docstrings in testcase.py
* Changing project name of vRouter
* More Unit Tests for ci directory
* Rename testcase\_base to testcase
* Switch TestcaseBase to TestCase
* Fix pylint warnings in test\_testcase\_base
* Fix pylint warnings in testcase\_base
* Fix Dockerfile.aarch64
* Update documentation for Danube
* Printing the flavor\_metadata for SnapsTestRunner
* Change api version
* Fix VIM onboarding
* bug fix: unit test on openstack\_utils
* Clean redundant error logs of refstack\_defcore in the console
* Replace domain name from Default to default
* Ignore certain modules for logging
* Make SFC test a python call to main()
* Disable blocking status for odl\_netvirt
* Fix Dockerfile
* Switch test\_db\_url to a directory
* bugfix: fail to push odl-sfc test result to TestDB
* refstack: bugfix of testcase failure
* Change execute bits
* Improve unix permissions fixes
* Respect common unix permissions
* Update keys of details dic for refstack\_defcore
* Set refstack\_defcore criteria to 100%
* [cloudify\_ims] Change VNF flavor value
* Fix usage of v3 APIs of OpenStack
* Add reveal.js as a submodule
* [vnf\_base] improve exception
* bug fix: version not retrieved on weekly jobs
* Enable functest offline by installing tempest system wide
* [cloudify\_ims] fix signaling test error
* Fix deployment flavor of orchestra machine; Improve bootstrap
* Bug Fix: retrieve version from build tag in weekly jobs
* Remove functest\_defcore testcases
* Bugfix: fix the criteria of refstack\_defcore
* Parse refstack\_defcore results
* refstack-client: arm dockerfile support
* [fuel] Skip test\_server\_basic\_ops tempest test
* refstack client integration
* env variable support for test DB url
* Added Unit Tests for ci/tier\_builder
* Added Unit Tests for ci/tier\_handler
* Added Unit Tests for ci/run\_tests
* Added Unit Tests for ci/generate\_report with argument refactoring for main and init functions in generate\_reports
* bug fix: remove reference to ovno
* [snaps] Pass flavor metadata to smoke tests
* [tempest/defcore] Configure volume device name
* Support running on openstack which enabled https
* Remove raise exceptions
* cloudify\_ims: fix error on account creation
* cloudify\_ims: fix sip public domain name
* Exclude Doctor from Joid scnenarios
* Change scenario for odl\_netvirt tests to be os-odl\_l3-nofeature
* fix vnf deployment
* Change the order of HealthCheck tests
* Show verification details in tempest log
* Introduce smoke tests for FDS
* Revert "Change barometer target log file"
* Optimize releng cloning when running unit tests
* Change barometer target log file
* Install kingbird verifier extension for tempest
* Improve error log into vnf test step
* Aarch64 adaption in functest for snaps smoke
* Adding Labels
* Exclude SNAPS smoke for lxd scenario
* Added support for scenario-based flavor creation
* Modification of repo path for vrouter
* Bugfix: modify test\_prepare\_env to make verify job successful
* delete ft\_constants and file functest\_constants.py
* Aarch64 adaption in functest for snaps healthcheck
* Update tempest to the latest 15.0.0
* [cloudify\_ims] New requirement for ims testing
* Add extra check to avoid double delete of instances
* Bugfix: make security\_scan authorized
* fix KeyError: 'clean\_flag'
* unify TestAPI naming
* Integration of orchestra project
* Remove exec\_test.sh
* Adopt TestcaseBase for ONOS and ONOS SFC
* Unit tests added for openstack/tempest
* Added Unit Tests for ci/prepare\_env
* Restructure docs
* Fix bad log message when trying to create an existing sec group
* Bugfix: fix the CI failure for compass and joid
* Correct one reference url
* Add clean\_flag to test cases
* Update cirros image to latest version
* Use python setup.py develop to install repos
* [odl-sfc] Add function to retrieve a resource from HEAT
* Bugfix: fix the cirros path for aarch64
* Add aarch64 custom config
* Re-enable the tests for bgpvpn scenario wich use floating ips
* Add custom tempest test
* Add Tempest Defcore test case
* Adding vRouter test codes using TestCasesBase
* Integration of orchestra\_ims test
* Bugfix:Added the adapter info for compass and joid
* Add domino testcase
* Add documentation of testapi internship
* Use new-style classes which inherit from object
* WIP: Cirros TestVM: Allow config of username/password
* Remove shell Healtcheck test case
* Prepare env will exit when an error is raised
* Unit tests for vnf/ims
* Restore Kingbird functest
* Integrate BAROMETER feature test case
* Add deployment\_handler printout to prepare env
* Fix neutron auth issue
* [odl-sfc] Fix wait\_for\_vnf returning vnf\_id on timeout
* [odl-sfc] Add function get\_vnf and fix endless loop in get\_vnf\_id
* Refactoring of cloudify\_ims
* [odl-sfc] Add timeout to get\_vnf\_id and create\_vnf functions
* Undo setting CI\_DEBUG to true by default
* Remove cloudify\_ims from ci daily loop
* Swap SNAPS repo from Cablelabs to OPNFV
* Modifies check\_os.sh to check services and cinder is optional
* Fix flavor config and error log
* Revert "Add deployment\_handler printout to prepare env"
* config\_functest support muiltilevel query
* [odl-sfc] Add symmetric option for sfc\_create
* [odl-sfc] Fix bug when getting the params for create\_vnf
* Fix auth error
* Bugfix: update from security\_scan to securityscanning
* Integration of NETREADY test case
* Add parameterized vnfd capabilities on vnf create
* update cloudify\_ims case
* Fix tempest multisite config
* Add deployment\_handler printout to prepare env
* Limit the substitution of ' in env vars
* Fix config file name setting
* Fix again unix permissions
* Bugfix: remove double quotes from environment variables
* Add ODL netvirt connectivity suites to list of robot tests
* Add can\_dump\_request\_to\_file decorator
* Revert "write test results to a local file"
* Use Exception instead of return code
* Put the Logger as Object oriented
* Refactoring of args and parser variable
* Fix source\_credentials in openstack\_utils
* [WIP] update cloudify\_ims case
* delete useless file multisite.py
* Logic to trigger Security Scan project
* Refactor configure\_tempest() function
* Integrating PyTest contained in SNAPS as a replacement to the old bash healthcheck
* Exclude Moon feature for Danube
* Releng environment in unit testing
* Change endpoint type for Kingbird
* Change log level when pod, scenario or build\_tag cannot be retrieved
* Migrates more commands to openstack-pythonclient cmds
* bugfix for finding tempest failed testcase
* Fix template error log
* Add dockerfile for aarch64
* Add netvirt to odl tests
* Move api\_check and connection check to healthcheck category
* Freeze the rally version
* Migrates glance commands to OSCLI
* Unit tests for openstack/rally
* Allow multiple sets of suites in ODL
* Remove all the results from previous releases
* Add flavor creation in functest env prepare
* Upgrade High level architecture config guide
* Bugfix: multisite test case fails
* Get tacker client using session authentication
* Exclude Copper until copper/installer integration completed
* Add tempest test details to results report
* Change permissions of python files
* Convert files to Unix format
* bug fix: no status returned at the end of a Tempest/Rally run
* Define how to pass args to TestcaseBase.run
* Adapt Promise to new framework
* [rally] Get keystone auth endpoint as request\_url
* First update of dev guide for dnaube
* Update Configuration guide
* Extract util functions from tempest.py to conf\_utils
* Tempest and SNAPS not pushing results to DB in case of FAIL
* First update of Functest user guide for Danube
* Adapt doctor test case to the FeatureBase framework
* Make sure we have installed python\_novaclient==6.0.0
* Support newton in tempest
* [doctor] allow testing with fuel and joid
* Refactor Rally to adopt OO
* Bugfix: fix the error of no sh file
* Fix for opnfv onos-sfc scripts
* bug fix case name for VNFonboarding
* VNF\_BASE - fix quota update failed
* Leverage logging config and refactor the logger
* Bugfix: delete the wrong path in functest\_constants.py
* Bugfix: fix wrong path to vims-test repo
* Use 8081 for apex's restconfport robot variable
* Add VnfOnBoarding Abstraction
* Bugfix: fix the execution way in copper
* write test results to a local file
* Rally keystone test scenarios for v3
* Setting level to the Functest logger's parent logger to ensure log output from Python libraries being used by framework does not get sent to dev/null
* Fixes ODL rest port for Apex
* [Netvirt-pipeline] Exclude unwanted testcases
* Bugfix: fix the wrong return code
* [FUNCTEST] Correct right ip is used for public endpoint
* Bugfix: fix the wrong path in copper
* Remove cmd to OpenStack, use python client
* Added unit tests for utils/openstack\_utils.py
* Refactoring of args and parser variable in ci/run\_tests, prepare\_env
* Tests added for utils
* Cover ODLTests.parse\_results()
* Switch to assert\_any\_call in test\_show\_credentials
* Remove clean\_results\_dir
* Create ODLParser to parse sys.argv
* Fully cover set\_robotframework\_vars
* Use mock\_open() to prevent stdout.txt
* Patch logging.FileHandler
* Added Unit Tests for cli
* Reverted the file permission
* Tackerclient added in test-requirement
* Added unit tests for utils/functest\_utils.py
* Unit tests utils added
* use working zmail rather than private gmail
* Set flavor's page size to support dpdk enabled vms
* bugfix: clean results directory error
* Enable the tenant related features
* Adapt create\_tenant and create\_user to keystone v3
* refactor rally using new constants provider
* Add a flag in the CLI to report results to DB
* Bugfix: fix the wrong path for security scan
* Fix Tempest push results to DB
* refactor snaps and example using new constants provider
* bugfix: get git branch failed when only 'git fetch' is provided
* refactor cli module using new constants provider
* Refactor domino using FeatureBase and new constants provider
* Refactor tempest using new constants provider
* Adapt SDNVPN tests using Featurebase
* Updated vims to support keystone v3
* Refactor test run related modules using new constants provider
* refactor vping using new constants provider
* Bugfix in passing parameters to logger\_debug
* Add default env variables in ENV class
* Remove backslash to meet PEP8 requirement
* Remove old tempest implementation
* Adapt Tempest to the new template
* Allow executing several testcases with the CLI
* Bug-Fix: No module named feature.copper
* Cover ODLResultVisitor
* Set SNAPS tests as non blocking
* Avoid side effects induced by functest\_constants in ODL UT
* Fix the issue of unexpected keyword argument 'endpoint\_type'
* Add check\_criteria() in testcase\_base
* Convert files to Unix format
* Fix find in Dockerfile
* Fix file permissions
* Install sdnvpn as a python package
* Fix path for SFC package installation
* Promote Helen Yao as commiter in Functest
* Install SFC python modules in Functest
* Unified way to provide configurations and env variables(proposal 1)
* Switch to ODL beryllium-sr4
* Bug fix: precise testcase name to push results into DB
* Authenticate clients with keystoneauth1.session
* Adapt Copper to Abstraction framework
* Adapt Domino to FeatureBase
* Create internship dir in docs
* Conform SFC test case to FeatureBase
* rename openstack to components
* Add timing decorator utility
* CI-Build-Fix: Move the connection check to smoke
* Rename add\_floating\_ip arg to floatingip\_addr
* Upgraded the virtualenv
* Install releng as a python module
* Support rally configuration for both Newton and Mitaka
* Move api\_check test in smoke category
* Snaps integration
* Add host aggregate / av zones util functions
* Added test cases for running the Python Tests included with SNAPS
* Update the logic to support both Newton and Mitaka
* Revert commits that handle tacker objects
* Get rid of easy\_install in unit test
* Bugfix: fix the wrong class name
* abstract umbrella part to make integration code simpler
* test-requirements.txt is added for unit test
* Tacker objects in openstack clean
* Tacker objects in openstack snapshot
* Fix Pep8 issues related to \
* Fix typo in openstack\_tacker
* Concatenate the RUN commands
* Sort multi-line arguments alphanumerically
* Rename TestCasesBase into TestcaseBase
* Update release notes with arm results
* remove functest\_repo from TestBase, move it to vPingBase
* Revert "solve failure testcases are not pushed to testDB problem"
* Remove Notion of SKIP in test cases
* Allow unit testing w/o internet connectivity
* bug fix: bad ping.sh path after refactoring
* Fix tacker util script
* Bugfix: fix the wrong path for vping\_ssh
* Bugfix: fix the wrong script path for healthcheck
* Lifted requirements.pip one level up to meet the basic structure of OpenStack project
* Add suffix '\_DIR' to some constants that point to directories
* file/dir renaming for consistency
* Adapt Parser test case to the new template
* Fix bug repos\_dir -> REPOS\_DIR
* Consider criteria as exit condition in odl test
* Extracted all global parameters into functest\_constants.py
* bugfix: correct test report status
* Adapt check\_os to OpenStack Newton
* Conform SDNVPN test case to TestCaseBase
* Adapt vping testcases to the new template
* solve failure testcases are not pushed to testDB problem
* Fix path for Promise testcase call
* Fix path for Tacker installation
* Switch SFC call to sfc repository
* bugfix: domino test can not be executed
* Create directory and empty files for the new openstack utils
* Create ovs log artifact on odl-sfc fail
* Adapt Domino to Test Abstraction
* Update Promise repository
* Remove Harcoded version for ruby (vIMS)
* Installing SNAPS library to Docker image
* Bug fix odl-sfc
* Wrap the Functest and install it as module by pip
* Downgrade keystone client only for SFC testcase
* Update OpenStack python clients to Newton version
* Bug fix in odl-sfc
* Fix path in CLI after directory restructure
* Add script to enable Docker Remote API by updating Docker Daemon configuration
* Fix path for vping\_ssh after refactor
* Bug fix: fix path in run\_tests.py
* Make the healthcheck sleep time configurable
* Phase out sfc\_colorado1 from the CI
* change path for python ci files
* Feature to know the time it takes to update OVS
* Fix paths in SFC testcase configuration
* Fix path issue in Docker file
* Remove kingbird installation
* Repo structure modification
* Update rally version
* Restructure SFC-ODL test cases
* Upgrade python-keystoneclient
* Adapting testcase to Boron SR1
* Add security group rule for DHCP
* Delete the reachability tests
* Do not modify unix rights in case of unit tests
* Remove python-keystoneclient downgrade and keep the newer version
* Fix typo in Dockerfile
* bug fix on log file creation for unit tests
* Add exit return code for unit tests
* Update onos scenarios in the release notes for Colorado 2.0
* Fix bug in ovs utils
* Update release notes for Colorado 2.0
* Bug fix for odl-sfc
* Complete OVS logging for sfc testcases
* Add ovs logging in sfc\_colorado1
* Add OVS logger
* Ignore files created by run\_unit\_tests.sh
* Cover KeyError in ODLTestCases.run()
* Added more logs to track better errors
* Fix nosetests call in run\_unit\_tests.sh
* Add Copyright headers
* Move unit tests in unit\_tests
* Import TestCasesBase from functest dir
* Add unittests dir
* Add full Apache 2.0 licence in LICENSE
* Add wrappers for Tacker Python client
* Get OS\_ env vars via os.environ
* Extend rally test case exclusion feature
* Use importlib to load testcases
* Add OpenDaylightTesting unit tests
* Remove exits in OpenStack client utils
* Multi-compute support and python refactoring
* Ignore rally\_conf.json
* Conform ODL to TestCasesBase
* Add a parent class for test cases
* Unify rally test case exclusion mechanisms
* remove 3rd part files with MIT or BSD license
* Stop copying obsolete files
* Spawn instances in nova availability zone
* Bug fixes and updates to fit ODL Boron SR0
* Remove exit() in ft\_utils.execute\_command
* Delete obsolete robot files
* Create shallow clones with a history truncated
* Bug fix in odl-sfc testcase
* Small fixes in sfc testcase
* Update INFO information after PTL election
* Use huge page for dpdk (ovs) scenario
* Remove old tacker setup
* Add Serena update on Functest Dashboard
* Refactor rally task scenario files
* Move sfc custom flavor creation
* make logger in vping a local variable
* SFC test: Add port 80 to security groups
* vPing ssh outpust wrong logger
* Fix tag version for documentation
* Increment counter in sfc\_colorado1
* Open secgroups and add check\_ssh in sfc\_colorado1
* Add SSH connectivity check
* Update release note
* Add odl\_sfc test in apex as the scenario is run
* Review release note for COlorado
* Bug fix for the SFC-CI test case
* [ODL-SFC] Bugfix: replace string "22" by "22/tcp"
* [ODL-SFC] Open port 22 in default secgroup for sfc scenario
* Remove parser test case from bgpvpn scenarios
* Style the headers for release-notes
* Update results on ARM
* Remove TODO in Functest user guide - Add links to feature project user guide - Add links to external web site - Change Dashboard picture
* Updated results info for os-odl\_l2-fdio-noha
* Add user guide link for copper
* Fix formatting error
* Update release notes with ARM results
* Corrected Promise links (According to final opnfvdocs directives)
* Added support for custom images and flavors in tempest
* Update release Note
* fixed updating of hugepage flavors
* Exclude Doctor from Functest for fuel scenarios
* Exclude copper, doctor and security\_scan from apex/fdio scenarios
* Add delay after SF floating IP assignment
* Include latest tag for Multisite Kingbird
* Added missing parameter into logger warning message
* Push FAIL to DB for onos-sfc
* Add utils for getting bgpvpn information
* Doc for Xreview by other test projects
* Refactored support for flavor and image hugepages based on Morgan's suggestins
* SFC testcase IP tables policy
* Add CI link for ARM
* [SDNVPN] Disable Rally Sanity test case for bgpvpn scenarios
* [ODL-SFC] Add push resulst to DB
* Added support for creating images and flavors with hugepages for fdio scenarios
* Exclude Tempest basicops case also in noha scenarios
* Optimize onos-sfc
* [Promise] Use the repository from github
* Exclude some Rally/Nova tests from lxd noha scenario
* Tempest release verion updated 12.1.0 -> 12.2.0
* make use of functest\_utils.get\_parameter\_from\_yaml
* Exclude Rally/Nova tests for lxd scenario
* remove imported FUNCTEST\_REPO object
* Clone the proper branches in the dockerfile
* Fix image format set for rally test cases
* Remove source-sans-pro directory, fonts not used and license conflict
* Reduce logging in the SFC test case
* [Promise] Fix bug opening the json result file
* Add support of arm for doctor
* [Promise test case] Use proper way to get parameters from yaml
* Add blacklist handling for rally test cases
* Redirect dominio's output to a log file
* [Doctor test case] Redirect output to a log file
* Revert excluding floating IP cases from odl\_l3
* solve bidirectional dependencies between ci and utils modules
* Exclude test cases that use floating IP from odl\_l3 scenarios
* Print all the Copper test output to a log file
* Print all the Parser test output to a log file
* Fixes cleaning up HA Neutron objects
* Change debug mode for commands that generate too much output in sec\_scan
* Change default memory for Promise flavor
* Add router association utility function
* Add print-to-a-file option when executing a command in functest\_utils
* Fix some bugs
* Switch print to logging.info
* Force python-keystoneclient to version 2.3.1 for tacker to work
* stop hardcoded FUNCTEST\_REPO path everywhere
* Remove copper from lxd scenario
* Refactor SFC testcase
* Add a specific logger for orchestrator class
* unify functest\_yaml obtain process
* Remove all logers as utils method args
* Use a global logger instead of method args
* parser fails on virtual environement
* Fix problem with SFC test
* Committer promotion: Cedric Ollivier
* unify testcases.yaml obtain process
* delete useless FUNCTEST\_REPO variable
* Release note: add restriction for joid/domino
* disable test case does not make sense for LXD
* Exclude healthcheck from lxd scenarios
* update fuel ref in tacker setup script
* Allow realtime Jenkins' console output
* Force stdin, stdout and stderr to be totally unbuffered
* Exclude floating-ip related tempest tests to blacklist for bgpvpn scenario
* Stop hard-coding db url
* Flush stdout as it can be redirected to log
* Update Release note
* Review dev guide
* Set env vars as mandatory to push to DB
* configuration guide review
* refactor create shared network process to eliminate reduplicate
* refactor create or get image process to eliminate reduplicate
* Stop calling exec\_test.sh in the middle of python scripts
* Use by default the default ODL web port
* Fixing commit f1054f8f
* Included correct links (Colorado) to Doctor/Promise user guides
* [SFC] Fixing CI
* Committer promotion: Serena Feng
* Avoid duplicating logs in run\_tests.py
* when create/get/update failed return None rather than False
* Enable security scan for apex scenarios
* [Fuel] Skip test\_server\_basic\_ops tempest test
* refactor push\_result\_to\_db print thing
* Create tempest resources before generating tempest.conf
* Add logger to push\_results\_to\_db args
* delete useless image\_exists in vping
* doctor test support fuel installer
* Fix typos in OpenDaylightTesting
* Mend create\_image() function
* Avoid opening tmp files twice
* Add logs (info)
* bugfix: push\_result\_to\_db exception show
* Improve errors and status codes management
* Point tempest to stable 12.1.0
* Catch exception if output.xml failed
* refactor vping
* Protect again changes of unix permissions
* Chmod 755 all py files which can be executed
* Add reporting to DB in OpenDaylightTesting
* Add exec right
* Fix print when push\_results\_to\_db fails
* Bug fix - Better way to grab file from gerrit
* Pull down default instance flavor
* Modify data sent to testAPI
* Colorado Release note
* fix Pillow version 3.3.0
* functest compass usage document
* complement Parser related userguide
* Config guide workflow simplification
* Remove useless odlreport2db args
* Add report flag for moon
* Minor fixes for Doctor Project
* delete extra slash while execute cases test in exec\_test.sh
* resume Parser test run on fuel onos
* Reorder imports
* Convert to Unix format
* Check the response status code
* bugfix: wrong directory
* Remove parser tests from fuel onos
* Add reporting flag to push reuslts only from CI
* [moon] install moonclient in docker
* [multisite] set the criteria as 100%
* Modify joid tempest list for onos
* blacklist.txt file format corrected
* output logger info for Parser tests
* Add Domino user guide link, modified description text, remove trailing spaces in index.rst
* Repoint security\_scanning to its own repository
* Add onos blacklist for tempest
* Fix joid test bug that creation of vm fails
* [multisite]push result to db
* Call moon python script to run the moon tests
* Update cli output text
* add parser to feature tier to make it run daily
* Update user guide for Colorado
* Provides connection check for package download
* copper push to DB fix
* Fixing a typo
* Improve LXD scenario support
* Tacker post script link changed
* [bugfix] should create result folder for multisite
* [bugfix] pass the wrong argument to rally
* Add conf directory to Dockerfile
* Bug fix to eliminate undeterministic behaviour
* add report flag to parser
* [multisite] refactor the scripts of multiste
* change parser path from RNC to vRNC
* update pip version of functest docker image
* Create config\_functest patch to update the conf with scenario
* Add SKIP status if Domino Test Case is skipped
* parser integration bugfix
* Bug fix in functest ODL-SFC
* Update test with the new SF and new tacker script
* Use Kingbird Bind host URL for Tempest
* Bug fixes odl-sfc + new features
* Reduced timeout for SSH connection attempt in tempest.conf
* Re-generating tempest.conf file before starting tests
* unify test result check for feature project and apply to parser
* support "" equals to None check in Testcase.is\_compatible
* Set lnfo logging level for Doctor tests
* Enable Copper functest under JOID
* Shorter test case names are accepted for tempest blacklist file
* functest utils - get\_resolvconf\_ns() Ensure that dns works with dns name resolution
* Fix for the endpoint URL for kingbird
* use configured success\_rate to check tempest test status
* Fix missing directory when calling bgpvpn tests
* Several bug fixes in ODL-SFC functest testcase
* modfied to mute object storage test on joid
* Wrap call to the rest api with try-except while generating report
* Add onos\_sfc scenario
* Add dir\_repo\_domino to fix bug
* Return with exit code in Doctor testcase
* Return with exit code in Promise testcase
* Return -1 in Rally if the success criteria is not met
* correct rally criteria check
* unify test results logger and apply to parser
* Select test cases in tempest to be blacklisted per each scenario
* Bug fix of the CI script in the ODL-SFC test case
* Prevent exiting the overall execution when there is a failed test case
* Scripts added to enable the SFC-ODL test in CI
* Add configure options for healthcheck
* Add region name to OpenStack credentials
* Functional testing for tosca2heat translation
* Bugfix: dont stop execution when a test case is not blocking
* Add endpoint type support on functest
* logger the push result of rally test
* Disable security scan tests
* Make openstack\_clean be aware of the names and not only the IDs
* Fix the proper version output for kingbird
* Return -1 in Tempest if the success criteria is not passed
* Return -1 if copper test fails
* [bugfix] issures in multisite testcase
* Enable odl-sfc in CI
* Bump rally to 0.5.0 and add shyaml
* [bugfix] miss a argument
* substitue misused variable 'total\_success' with 'success\_rate'
* Generate Functest report at the end of the execution
* delete useless stop\_time initialization in run\_rally-cert.py
* Bug fix for ODL-SFC testcase
* Bad status on rally\_sanity
* add .idea directory to gitignore
* Turn off vPing\_ssh for odl\_l3 scenarios due to odl bug
* Create a flag in the tests to indicate if they should be blocking or not
* Bug fix for SFC test case
* Add duration message after test execution
* bugfix: Don't try to run a tier if it doesn't contain any enabled test
* Fix execute\_command function to show all the output
* Add cd to test directory
* Bugfix: ODL report to DB fails
* Remove logger as input parameter of functions in openstack\_utils
* Add kingbird endpoint information to functest
* Add logger to openstack\_utils to output error messages
* Show real time tempest test execution
* Catch timeout exception in vIMS
* Exit with -1 return code if something fails in vping tests
* Extend timeout to check vm in onos-sfc testcase
* Don't take openstack snapshot when "-n" option is set
* [multisite] run on the env of fuel and compass
* Use blacklist of Tempest test cases for SDNVPN scenario
* Fixed typo in config.ini for reports.html
* Add functest logger in ODL script
* Push sfc result into DB
* Revert "Disable ODL test."
* Disable ODL test
* Disable ODL reporting to DB
* [bug] miss a ; in case statement
* Enable domino multi-node test case in Functest
* Enable new SDNVPN test cases in Functest
* Use common way to get the openstack clients
* Switch to $SDN\_CONTROLLER\_IP instead of $neutron\_ip
* [multisite] add kingbird repo and install python lib in docker
* [multisite] integrate kingbird tempest testcases
* Improve timeout management with python
* Bump to cloudify-manager 3.3.1
* Propose a new python file to launch ODL testing
* Enhance ips, ports and creds management
* [multisite] add interface of multisite test suite
* Add sfc support for all installers
* Use flavor m1.tiny in healthcheck
* BugFix --noclean option in the CLI
* Chmod 755 all sh files which can be executed
* Chmod 755 all py files which can be executed
* Stop creating the useless ODL results dir
* Add fixed\_ip and files parameters in openstack\_utils in create\_instance
* bug fix: use PASS/FAIL in Onos instead of passed/failed
* Fix one pep8 violation
* Add --noclean option in the CLI
* Add delete bgpvpn function in openstack utils
* SFC Testcase for functest
* Fix onos sfc's block. Add ping check before login
* Create vnf directory in testcases
* Conform start\_tests.sh to last ODL patches
* Update developer guide  documentation
* Fix function get\_hypervisors in openstack utils
* Added 'vacation' test case
* [SDNVPN] Bugfix bgpvpn functions in openstack utils
* [SDNVPN] Add helper functions to create bgpvpn and associations
* [SDNVPN] Adding sdnvpn repo to functest
* Add Moon in Functest
* Add BGPVPN neutron client extension for SDNVPN project
* Add tacker-client in the functest Docker image
* Adding security\_scan section to functest userguide
* Add support functions for SDNVPN test cases
* bug fix: use PASS/FAIL for rally
* bug fix use FAIL/PASS as criteria for integration in automatic reporting
* Add copper for CI integration
* Move copper.py to functest repo
* Fix tacker client dependencies installation
* Bug fix of tacker\_client\_install
* Add tacker installation to odl-sfc
* Enable doctor test scenario in master
* Fix doctor test return check
* Change methods to call openstack utils
* Fix incorrect path for createfiles.py and amended hiera path
* Functest Userguide update for Colorado
* Add support for Copper project
* Add example script creating an instance
* Delete robotframework files hosted by ODL
* Add openstack clients and create instance in openstack\_utils
* Add interface to run sfc functests
* add missing symbols in Results section
* Change OpenStack clean behaviour
* ONOS sfc scripts
* Remove OVNO test for Colorado
* update Test Dashboard & API description in devguide
* Remove old test dependency in config\_functest.yaml
* Suspend Doctor execution on Master for apex scenario
* bug fix: use FAIL/PASS as criteria for vping\_userdata and rally\_sanity
* Switch to ODL\_SYSTEM\_IP and OPENSTACK vars
* Functest Config Guide - Text updates to reflect new CLI
* Change step 4 to step 3 in healtcheck
* bug fix: duplicate start\_date var with different type
* modify onos tests' link to support onos 1.6
* Final version of testAPI presentation
* Serena's presentation review
* bugfix: name format and testcase start time
* Added content for StorPerf
* add slides for qtip
* update team image
* Update image, add Qtip and minor formatting changes
* Check resources exist before testing delete
* change cloudify cli version from 3.3 to 3.3.1
* adjust testAPI presentation
* fix format problem
* Align test names in DB and config file
* Remove default values if the os credentials are not set
* Fixed auth url in v2.Password
* bugfix: import module
* Added use of OS\_AUTH\_URL to security\_scan and exec\_test.sh
* Add documentation to conform to odlreport2db.py
* Try/except ODL push to DB until ODL tests are refactored
* Replace deprecated keywords
* format fix + KPI section update
* Update css and team image
* Lessons learned for Tempest into Berlin presentation
* Remove unused librairies in robot files
* Enable security scanning
* Add reachability testcase for ODL
* Reduce rally run script log output
* Add yardstick section into Presentation
* SSH key key type select improvements and jump host rename
* Remove unnecessary defaults from rally task file
* Fix bug: use right format for date when pushing to DB
* Remove external server references on Rally scenarios
* Creating Glance image for Tempest suite
* Fix flake8 violations
* bug fix: end\_time var does not exist to calculate duration
* little changes in testapi presentation
* Update testapi presentation
* Fixes and Docker Specific Attributes on security\_scan
* Fix vPing success criteria evaluation bugfix
* Add CPerf slide to OPNFV Summit Berlin deck
* Fixes incorrect parenthesis format & adds ft\_logger import
* Adapt functest testcase to APi refactoring
* Added paramiko.util.log\_to\_file
* Use current ODL Integration/Test repo
* Add presentation for test API
* Presentation Test community Design Summit
* Stop the job and quit with error if a test case fails
* Replace subnet by port
* Rename Robot Framework sources to \*.robot
* Fix duplicated output when using the functest logger
* Check correctly arguments
* Add criteria in testcases.yaml and Test class
* bug fix: pb when pushing bgpvpn results when no failed failed field is empty (not equal to 0)
* Avoid tuples when printing multiple strings
* Write login correctly
* Add Apex based security scan code
* Remove unused CI\_DEBUG
* Bugfix: can not find tempest.log
* bug fix: if all tests passed failed could be empty
* Take report arg into account
* Add simple error logs in result DB
* Use flavor name instead of flavor id
* Add security\_scan in Functest CI pipeline
* Push results if INSTALLER\_TYPE and NODE\_NAME are defined
* Allow unknown ci\_installer or ci\_scenario in is\_compatible
* Added 60 sec delay before launching instances in healthcheck
* Join Rally\_full and Tempest\_full in the same Tier
* Add framework for presentations
* Push bgpvpn\_api results into Test DB
* Preserving Nova instances from os\_defaults.yaml
* Fix path for vping.sh and exit if SCP fails
* fix vPing paths post refactoring effect
* Change 'testcases' directory structure
* BGPVPN test case refactored
* Refactor ODL vars in ci/exec\_test.sh
* Replace error in ci/exec\_test.sh
* Catch TypeError exceptions in ci/tier\_handler.py
* Added handling of blacklist for tempest
* Add protections if INSTALLER\_TYPE is unset
* Fix typos in testcases.yaml
* Respect multiline syntax in Dockerfile
* Fix a few nits in prepare\_env and dockerfile
* Specify the field id in neutron arguments
* Removed obsolete modules
* Split tempest into smoke and full modes
* Enable sanity mode of Rally test for the CI runs
* Adapt tiers to run depending on WEEKLY/DAILY
* Create a private shared network for Rally
* Creating private network for Tempest
* CLI implementation
* Generic Function to create a private network
* Fix shebang of python scripts
* Add results dir to Dockerfile
* Don't exit on error when destroying rally deployment
* Fix bug config\_functest.yaml location
* Refactor, add logger handler to collect all the logs to a file as well
* Refactor improvements
* Add command to execute the actual tests
* Enhance output when showing tiers and testcases info
* Create CLI template for Functest
* Source the credentials in run\_tests.py
* Functest - documentation small corrections
* Execute successive scenarios after task failure
* Add a step to enable docker run without sudo
* Create run\_test.py using the tier mechanism to run the tests
* Prepare Brahmaputra 3.0 release
* Replace all the loggers by the functest logger module
* Create prepare\_env.py from prepare\_env.sh and config\_functest.py
* Corrected path for clean\_openstack.py
* Move functest\_utils and openstack\_utils to directory /utils
* Add Functest Logger centralized Class
* Corrected logging.Formatter parameters
* Corrected if statement for clean\_openstack
* Remove backslashs for line continuation
* Add untracked files to ignore
* Add tier\_handler and tier\_builder
* ConfigParser is used for tempest.conf updating
* Introduce a sanity test mode for Rally test
* Fix regex to exclude vPing\_ssh and vIMS for scenario dealing with bgpvpn
* Affect version field in results for all the testcases
* Enable PYTHONPATH env variable inside the container
* prepare\_env CI\_DEBUG when calling generate\_defaults.py
* Remove cleanup from vPing scripts, and use the existing cleanup script
* Fix Flake8 Violations in the Functest scripts
* Add Tier scripts handlers and list of test cases yaml
* Print openstack info only if CI\_DEBUG==true
* Remove RALLY\_REPO in config\_functest since it is not used
* Dockerfile, fix typo in git clone command
* Small adaptations in prepare\_env,run\_tests and common
* Adapt Functest output to the env variable CI\_DEBUG
* Quote missing
* Remove all the repo handling in prepare\_env
* Allow rally to use existing glance image
* Author: Luke Hinds <lhinds@redhat.com> Date:   Mon 18 Apr 11:48:27 2016 +0100
* Generating test lists for tempest
* Add healthcheck test case to test\_exec\_priority
* Update python-openstackclient to version 2.3.0
* [BGPVPN] Exclude vims and vping\_ssh from testlist
* [BGPVPN] Use system wide installation of tempest
* Revert "[BGPVPN] Rally create the v-env which is needed"
* [BGPVPN] Rally create the v-env which is needed
* Adding Apex able to run BGPVPN tests
* Add healthcheck test case to config\_functest.yaml
* Create health check test case
* Lack of Internet connectivity is not treated as fatal
* add bash script to config pip and easy\_install
* Remove unused Rally scenarios and run script
* [BGPVPN] Remove odl-vpnservice test cases
* Split functest\_utils.py into 2 scripts
* [BGPVPN] Bugfix for /etc/tempest/ no there
* Allow vping to use existing glance image
* update of INFO file
* bugfix single quote
* Bugfix result criteria
* Add status when pushing Tempest results
* ONOS can now support vPing\_userdata testcase, remove the exception in the config for CI
* Try configdrive in vping userdata test case
* improve status criteria
* Fix support for CACERT and set OS\_INSECURE=true
* Revert "Checkout the Latest stable Tempest"
* Add criteria and version when pushing the results into test DB
* Checkout the Latest stable Tempest
* Add exception handling for output processing
* Test numbers creation before starting the signal test
* A non default argument cannot be placed before a default one
* Have vIMS and Promise packages pre installed in the docker image
* Add support for SSL endpoints in Functest
* Rally and Tempest pre-installed in the Docker image
* Add Proxy section in the config guide
* Fix Dockerfile to use proper bashrc file for the alias 'll'
* Samll corrections in the config guide
* remove ref to Opencontrail
* Updates and fixes in the Config Guide
* Add release note
* Updates and fixes to the user guide
* docs: fix pdf creation bug in userguide
* Fix tables in the troubleshooting guide
* Add rally troubleshooting guide
* minor fix on format + add doctor references
* Add vPing troubleshooting guides
* Adjusting the heading level for composite doc rendering
* Fix Doc errors detected in opnfv-docs-verify and add license
* Change table format
* Add jenkins build tag for result api
* Fix formatting for compass and joid scenarios
* Correct rst formatting for fuel scenarios and set proper order
* Add the missing scenario results to the doc html page
* Add doctor results to apex-odl-l2 scenario
* Add result docs for apex, compass, joid
* Add fuel scenarios test report
* Moving testusage.rst to introduction.rst to avoid being pulled into the userguide
* remove "print" in tempest to avoid having a message "None" in the output
* Create troubleshooting guide as a separate .rst
* Add git support for Doctor repo in config\_functest.yaml
* Fix message outputs taken from the console log in vPing\_ssh
* Corrected using of echo command
* Remove network failed message check form vping\_ssh
* Add VI and alias support in the docker container
* Release floating ip after vPing\_ssh test
* Create vPing\_userdata instances with dynamic ports created by nova/neutron
* Create vPing instances with dynamic ports created by nova/neutron
* Renaming the description text to include in composite docs
* Add compass onos and odl\_l2 scenario
* Rally live migration case selection
* Add result overview and onos-nosdn-ha scenario reults
* Adding a structure for the reporting of test cases for functest
* bug fiw syntax when calling push to db from vIMS
* Add project in push\_to\_db function of functests utils to allow external project onboarded in Functest to push their results
* Push results without extra formating
* Enadled --serial option for run\_tests.sh
* Bugfix add "fi" at the end of the if-else statement in run\_tests.sh
* Add -n|--no-clean flag to vPing,Tempest,Rally,vIMS scripts
* Rename the vPing scripts proplery and adapt documentation
* Doc updates
* Create Rally summary report also for verbose mode
* Push rally summary results into DB
* docs: add userguide file for the central doc
* Create Rally output summary at the end of the tests
* Remove obsolete public network definitions
* doctor: adds logger
* update doc - update external test cases - add chapter on push to DB
* Used sed instead of crudini for updating regex
* Added configuration of ssh\_user\_regex parameter
* enable doctor test scenario
* Reduce the number of iterations to ten in rally scenarios
* update user guide - change vIMS logs - add Promise logs - modify section on OpenStack audit (now dynamic) - minor reformating of tables - typos - add troubleshooting section on vPing and vPing\_userdata
* Import request python module for promise test case
* Fix success status parsing of rally results
* Use python json parser to get the results form the Promise json report
* Revert "bug fix: get installer using functest\_utils"
* bug fix: get installer using functest\_utils
* FIX: sleep 3 second to release create\_venv.sh from chmod command
* FIX:use 'info' after sourcing the common.sh
* Show Promise results output and push results to DB
* Consider volumes and floatingips as defaults in clean\_openstack
* bug fix to run tempest and minor display error in run\_test.sh
* Create security groups with ICMP and SSH rules for vPing tests
* Report vPing timeouts to the DB with duration = 0 and test status=NOK
* Remove error message if instance is not found
* Small improvements with output messages
* Use openstack client to avoid keystone deprecation warnings
* Use promise-flavor if exists and don't try to create it again
* Use generate\_defaults instead of os\_defaults fixed parameters
* Add script to generate the OpenStack defaults
* Enable all rally outputs in verbose mode
* Adding structure to pull content into central docs
* Export private net OS\_TEST\_NETWORK for Promise tests
* Replace openstack single clients by python-openstackcclient
* Add testcases results to DB
* Add aodh default user for apex
* use scenario instead of git info in version field of the test results
* Copy tempest.conf to results dir to be uploaded to artifacts
* Add promise section from patch 8361 of Gerald
* Create stdout and stderr files for Tempest results
* bugfix: self.logger
* Editorials
* fix the bug of onos test report
* Change scenario start/result messages in run\_rally-cert.py
* Add some error result in result db api
* Update doc
* Add scenario name to Rally result message
* Changed to use $(repos\_dir) and removed #
* Change to logger.error when there is an error in clean\_openstack
* Small typos fixes in functest\_utils.py
* Refactor functest\_utils.py
* change for get joid onos ip
* Follow change in joid use SDN\_CONTROLLER\_IP env var instead of ODL\_CONTROLLER\_IP
* Reduce Rally output
* Volume type management moved from run\_tests.sh to run\_rally-cert.py
* Fix promise test output
* Bugfix print arguments in functest\_utils.py
* Print json result file of Promise testcase
* Refactor functest\_utils.py script
* Option to redirect stderr output to a file for Tempest test
* Remove possible message "No handlers could be found for logger paramiko"
* FUNCTEST-128 Modify the ssh output match
* FUNCTEST-127 FIx the condition judgment of vping
* bug fix bad var affection when running ODL
* typo fix on odl
* Add bgpvpn and odl\_vpnservice in config\_yaml
* Add timeout in paramiko ssh command
* Add more OS defaults for Fuel 8.0
* Patch ODL scenario to support joid (different keystone and neutron API IP)
* Replace 'No vPing detected' by a better understandable message
* Allow executing ODL test as many times as wanted on the same env
* Add whitespace in the vPing2 command
* Add missing directories env variables in common.sh
* Add function for Promise libraries pre-install
* Fix typo in requirements.pip
* Remove vPing\_userdata and vIMS from onos scenario
* Use paramiko library to SSH and SCP the instances in vPing2
* Use rally cert script
* bugfix: syntax error
* Add copy of packages.json to the features path before running npm install
* Adding BGPVPN and VPNSERVICE testcases
* test db migration
* FIX: args of push\_result\_to\_db changed from git\_version to version
* bug fix: when running manually a test, get stuck in echo
* Removed unnecessary references to public subnet cidr
* Put scenario in version field on the Test DB (rather that git indication)
* Added --no-clean option for run\_tests.sh
* Add support for Promise test cases
* Push ODL results to DB
* modify onos functest to suit joid CI
* Add control to redirect rally stderr
* Temp solution to workaround the problem with pip when installing tempest
* Add default admin\_floating for Fuel 8.0
* Check if rally image already exist and don't create it again if so
* Detect if userdata is not supported by nova in vPing-userdata test
* create 2 vPing scenario:vping and vping-userdata
* add doc of onos usergide
* Added vPing2 using SCP and SSH instead of nova userdata
* Modify ONOS CI running
* Ensure nameserver ip works
* Add mention to apache 2 license in Functest files and remove unused files
* Remove rally stderr output from rally-cert
* Updated Tempest related parts into User guide
* Remove --offline flag
* Bugfix Missing "$" in front of some variables
* Remove all the unnecessary Rally output
* Fix array of test in run\_tests.sh
* Add developer guide
* bug fix: duration time not initialized in case of VPing error (timeout)
* Add 'neutron' default user for joid
* Prepare integration of ovno
* Print openstack defaults before running clean\_openstack.py
* Add --debug flag to first clean\_functest.py
* Remove FUNCTEST\_BRANCH and FUNCTEST\_COMMIT from the output
* Replace command "pass" in the shell script by ":"
* bugfix: update cinder quota strange space
* Remove ODL and ONOS from base scenarios
* Change novaclient usage
* Remove extra output if CI\_DEBUG is false
* Add onos in the list of executable tests
* Added more consistency when getting the config\_functest.yaml
* Add explicit logs when creating list of runnable tests
* Fix bug ruby sig test
* add doctor test case
* Modify ONOS test for CI running
* Adds check to make deploy scenario is also not "none" (default)
* Fixes syntax error on if statement with run\_tests.sh
* set up mechanism to tun only runnable tests in CI based on scenario
* Use the env variable NODE\_NAME for pod\_name
* Add rvm use system to bundle install for vIMS
* Remove bundle install from Dockerfile
* Change functest branch to stable/brahmaputra
* Bugfix: create functest conf dir
* Fix dns problem on E/// pod
* Remove arg.repo\_path in run\_rally\_cert.py
* Create volume type before running Rally tests
* Place config\_functest.yaml outside the functest repo
* Remove references to foreman installer
* Add cinderv2 and ceilometer to default users for Apex
* Change MTU size in the container
* Fixes netcat for multiple platforms
* Rally test case troubleshooting
* Cleanup functionality improved
* Prepare Promise integration in Functest
* Add timeout for cloudify-manager deployment
* Update rally version to 0.2.0
* make doctor tester available in functest docker image
* Add mechanism to check whether the test can be run or not according to the scenario/controller
* Prepare onos integration in Functest
* bugfix: get admin role on joid installer
* Add ext network for joid
* Add check of external network before running any test
* Add 'service' tenant to os\_defaults for apex
* typo it should be services not service
* added the quantum\_nova user as well for joid
* User and installation guide
* Add joid defaults to clean openstack
* add .gitignore
* Fix path of os\_defaults.yaml
* Searching for shared private networks
* Move openstack defaults to a yaml file
* Bugfix: cfy teardown -f
* Bugfix: indent ........
* Bugfix: logger .
* bugfix: indentation error
* Ensure no ssh key file already exists before launch cloudify deployment
* Using shared private network
* Bugfix : Ensure that ruby libraries was installed before running vims test-case
* Ensure that ruby libraries was installed before running vims test-case
* Configuring non-admin credentials for tempest
* Give the right repo path for vIMS to send report
* Update cinder volume quota for new tenant 'vIMS'
* Support for customized tempest case list
* Add ruby 1.9.1 installation in docker image
* Support for removing hanging ports
* Refactor run\_rally-cert.py
* Update orchestrator (cloudify) version from 3.2 to 3.3
* Update rally to lastest release 0.1.2
* Fix timeout in vPing when booting a VM
* Fix: do not remove network/router created by functest preparation
* Add 'check if file exists' when creating the glance image
* Add 'rvm use system;' to Dockerfile for vIMS
* Fix bug 'unrecognized arguments: start'
* Move check\_os call to prepare\_env.sh
* Use repos\_dir env variable in all Functest scripts
* Add more compass defaults to clean\_openstack
* Wait for floatingips to be released in clean\_openstack script
* Change ping command by netcat to check OpenStack endpoint
* Remove hardcoded IP in check\_os
* Script to check the basic OpenStack services
* bugfix: vIMS blueprint branch
* Move 'wait for instances to be terminated' after deleting them when cleaning openstack
* Add cinder check to support NoneType object
* Parameterize Rally scenarios
* Add more defaults to clean\_openstack script
* Fix the call to the ODL test
* Adding more robust check to delete a port in clean\_openstack
* Fix bug clean\_openstack if the function return a None
* fix bug of cleaning the openstack env, the tenant"service" cannot be deleted
* Add debug information for ports in clean\_openstack
* Change print statement to logger.debug for the separator in clean\_openstack
* Fix bug clean\_openstack if there are no users and tenants
* Fix bug clean\_openstack if there are no networks
* Add path to credentials env variable in Docker file
* Add clean\_openstack script call in clean functest environment
* Update rally commit to version 0.1.1
* Fix run\_rally.py to create image using glance python client
* Creation of image using python glance client instead of CLI
* Add openstack cleanup after running the tests
* Add template for BGPVPN test case in run\_tests.sh
* Add a flag to push the results to the DB optionaly
* OpenStack cleanup script
* Adding BGPVPN repository to the Docker image and scripts
* Run tempest from docker using run\_tempest
* First upload of Functest Doc for Brahmaputra
* Remove gsutil python module in the docker image
* fix path bug add / in cofig file for rally res dir
* fix path for rally result
* fiw path bug for run\_rally remove HOME as path are now absolute path in docker file
* Add gsutil python module in the docker image
* Add WORKDIR in Dockerfile
* Create a common network for functest for all the tests
* Add test dependencies in Functest config files to know if the tescase/test suite can be run (or not)
* Add ssh 700 rights to the .ssh directory in the docker image
* condensing python code in utils check\_credentials
* Add support of joid, apex and compass when running odl
* Add functions to retrieve POD name in Functest
* Add cinder python client library to Docker container
* Added customized tempest test case list
* Clean Functest repo, dashboard fully migrated to Releng
* Don't check for env variables if openstack credentials are given
* use joid rather juju
* Rally 'module' parameter not needed any more
* Refactoring of committers
* Use only Rally as tescase name
* [functest] modify functest prepare scripts to adapt compass
* Bugfix: cloudify deployment error
* Add possibility to give Openstack creds file to the docker container
* add load of functest-img-rally for vm and cinder tests
* Bugfix: test payload value
* Updated vIMS result format
* Change default order of tests
* Fix so that given config\_functest.yaml is copied to functest repo dir
* Add vIMS test-case in run\_tests script
* Added functionnal test and push result to db
* Fix error when deleting the network in vPing test
* Small correction of the --test flag in run\_test.sh
* Move creation of glance image to vPing
* Reversed: Added reset to rally commit ID in prepare\_env.sh
* Added reset to rally commit ID in prepare\_env.sh
* ODL script bugfixes
* PGP network problems Fix
* vIMS test integration and move "push\_results\_to\_db" method
* Move git clone of ODL tests repo to Dockefile
* Include cirros image in the docker container
* Add possibility to run specific set of tests
* Refactor Functest docker container
* Remove start.sh in the dockerfile since it is splitted by 2 scripts
* Removed ODL create\_env from config\_functest.py
* Change duration to integer seconds in tempest results
* set nb test run and failure tests as int
* change expected response to 404
* ODL test suite requirements.pip moved to general requirements
* Create run\_tempest out of run\_rally
* refactor run-rally and integrate API to push results into DB heavier refactoring due to new verison of Rally will probably needed
* Bugfix: Add default DNS on subnet
* Move the configuration from test scripts to config\_functest.yaml
* Bugfix: venv path
* Bugfix: venv path
* intergrate the basic function senario and testcases in TESTON
* Fix version number return
* forget to clean push function in vPing
* add functions in utils and fix vPing
* Write a simple adapter in functest project to run TESTON
* remove chitti.nimmagadda@ericsson.com fro committer list
* Use new client script to run onos test
* Bugfix: urllib-->urllib2
* Create demo.sh cloned from start.sh to run Functest demos without executing the full Rally bench suites
* Add small checks to avoid possible 'No such file or directory' errors in the Docker automation procedure
* Bigfix : function "download\_and\_add\_image\_on\_glance"
* Fix rally installation path in config yaml file
* update of the INFO file
* Add 2 libraries for Rally to the Functest Dockerfile
* Dockerfile for Functest
* vIMS deployment and cleanup
* Added configure\_tempest() function
* Use new environment script to setup env to run onos function test JIRA:FUNCTEST-60
* Write a simple adapter in functest project to run TESTON JIRA:FUNCTEST-46
* Add get\_networks\_list function in functest\_utils.py
* Add SLA to Rally test cases
* Use new connection script to be the connection adapter to run onos JIRA:FUNCTEST-59
* Adapt installation of Tempest from rally with new command line https://review.openstack.org/#/c/225479/
* Removed command 'exit 0'
* Fix for ODL suite
* Minor corrections for SR1
* added flag --yes to install\_rally to force install dependencies
* added yum install of needed packages on jumphost
* onos-test:basic frame work of running onos TestOn test
* creation of scripts to generate Dashboard compatible json result files
* Adding some methods on functest\_utils.py
* Remove OS\_REGION\_NAME from OpenStack credentials check
* clean INFO file
* script to transfor vPing raw results into a json file to be used by the future dashboard
* change vPing to push results in Test DB
* Baseline of mobility traffic profile. JIRA: FUNCTEST-33
* workaround order of env settings to all ODL tests to be run
* README for vIMS testcase Note that vIMS shall be also documented in the global functest rst guideline
* first upload for traffic profiles management
* add 3 new commiters and remove 2 ghost committers iMeeting minutes approving the 3 new committers: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2015/opnfv-meeting.2015-07-07-12.59.html
* Add check for ownership in ~/.cache/pip
* Doc: added required libraries and python modules JIRA: FUNCTEST-9
* config\_functest.py: Rally installed with sudo JIRA: FUNCTEST-19
* Doc: Fixed weird chars for the tree directory structure JIRA: FUNCTEST-9
* functet\_utils: bugfix check\_internet\_connectivity except JIRA: FUNCTEST-17
* replace default web site for testing internet connectivity previous one was filtered in China
* Doc: adapted table page 6. "The procedure to set up functional testing environment can be described as follow:" JIRA: FUNCTEST-9
* Doc: adapted image size for pdf as Victor suggested JIRA: FUNCTEST-9
* modify functest config to prepare result folder
* remove date stamping in run\_rally rally results shall be pushed to result folder but date stamping shall be done at CI level not test by test
* Put ToC after heading
* fix ODL image bug
* Update for Arno
* config\_functest.py : bugfix: removed "sudo" from installing rally command JIRA: FUNCTEST-10
* functest\_utils.py : bugfix: logg-->logger JIRA: FUNCTEST-10
* update doc for Arno
* remove unused doc file
* correct doc after CI job refactoring
* vPing.py: Fixed IPs for VMs, Not DHCP JIRA: FUNCTEST-3
* Improvements - Added: functest\_utils.py for common util functions - Moved: a lot of functions from config\_functest.py to functest\_utils.py - Moved: create of functest-net from config\_functest.py to vPing.py - Improvements and code cleaned
* Fix relative path issue in custom test
* fix absolute/relative issue in start\_test.sh
* vPing.py: bugfix: removed cgit download of scenarios JIRA: FUNCTEST-3
* Refactor functest environment. Bugfixes: arguments missing
* Refactor functest environment. Bugfixes: arg dependencies
* Refactor functest environment. Config\_functest.yaml comments added. Depends on: https://gerrit.opnfv.org/gerrit/#/c/642/
* Refactor functest environment Depends on: https://gerrit.opnfv.org/gerrit/#/c/642/
* vPing.py: bugfix: EXIT\_CODE not defined JIRA: FUNCTEST-3
* Add $BASEDIR var to all paths
* due to cleaning issue the order of the tests may have some consequences. Running list of images first reduce the risk of false errors
* This version of script was tested on POD1 manualy
* vPing.py: added timeout when building the VMs JIRA: FUNCTEST-3
* fix bug due to removal of VM scenario
* remove test VM to test CI (could be reintrouduced later)
* run\_rally.py: added consistent path for functest.yaml JIRA:FUNCTEST-1
* Fix requests scenario for rally bench suite (re import from rally)
* fix cinder scenario bug (bad scenario format)
* config\_functest.py : added --force flag to force clean functest without prompting. JIRA: FUNCTEST-10
* Corrected project lead
* config\_functet.py: bug while creating router and interface. Other minor improvements. JIRA: FUNCTEST-10
* remove heat from the list of rally benchs to execute for R1 (out of scope)
* change default public network name in VM scenario
* change result structure, put all results in a date directory instead of suffixing file with date
* fix link error, rename default pre loaded image, change formating for config function description
* vPing.py: code cleaned. JIRA: FUNCTEST-3
* Doc updates:   vPing picture updated to check console for ping   Removed configuration of external network
* change default image name for bench testing
* Change default image name for tests (in ligne with config script), use the one preloaded by the config script
* vPing.py : changed #cloud-config to inject an sh script functest.yaml : vPing works now with a Cirros image JIRA: FUNCTEST-3
* config\_functest.py : removed public network creating
* fix bug on error detection
* config.py bug fix: NEUTRON\_NET\_NAME parameter changed to NEUTRON\_PRIVATE\_NET\_NAME
* Updated doc with more info about functest\_config.py JIRA: FUNCTEST-9
* config\_functest.py: 1) Added create public network. 2) functest.yaml is now copied instead of downloaded. JIRA: FUNCTEST-10
* Added links to voting results for new commiters
* Update doc, include config\_functest.py, remove manual operations, remove vIMS testcase
* config\_functest.py: added create neutron network. vPing.py: some adaptations and bug fixes JIRA: FUNCTEST-1 JIRA: FUNCTEST-3
* config\_functest.py download functest.yaml if not present
* Added functest.yaml to centralize the common parameters for all scripts of functest adapted scripts to get the parameters from the yaml
* vPing.py: improved, updated and working with Ubuntu Cloud image. TBD: get deployment from a functest configuration file
* Added smoke bench scenarios: complete smoke and green list of working tests. Include smoke as input parameter for run\_rally.py to run as bench test. JIRA: FUNCTEST-2
* update of the script, change tempest management, set smoke test by default, generate log file for Tempest result
* config\_functest.py: added ODL config support
* change path to create rally forlder and scenarios+results subfolders, change image for vping to Ubuntu
* config\_functest.py: improved output and error handling. Added download of run\_rally.py
* Script for creating virtual environment added
* config\_functest.py: Added Rally and Robot automatic installation and configuration
* Added first draft config\_functest.py
* Remove unused image
* Remove not used image
* reformat CI part, add vPing description, remove images, replace them with ASCII description
* Add 2 new committers. Vote by Mail 10+1 on 14 voters 2 mail address no more responding, correct 1 (with alternate known address)
* run\_rally: added quotas and requests as input parameters
* JIRA:FUNCTEST-1 -run\_rally: added cinder as input parameter and other minor changes
* JIRA:FUNCTEST-1 -removed multibackend bench test in opnfv-cinder.json
* add bench scenario for glance
* Add links to images
* Add figure for rst document
* update python script to manage Rally bench tests, add help section, exclude Tempest from all bench tests
* Add Rally request scenario in OPNFV Rally scenario
* First upload of vPing script, one of the 5 functest testcase. This Hello world example consists in - Booting 2 VMs - Performing basic Ping - Check the Ping
* Update document for functest R1, add description section, split tooling installation from test running, add illustration
* Moved functest.rst under docs/ and removed docs/main.rst
* Remove hardcoded path, retrieve scenario file dynamically, create results and scenario folder
* small fixes to script starting odl suite
* Script for starting Robotframework ODL suites
* Renamed and moved functest.rst as docs/main.rst
* Complete Automation section Correct previous sections: installation tools on jumphost server (not in a dedicated VM) Minor wording correction
* script to launch Rally bench scenario per module or all one after the other from CI the script get the test ID and generate reporting
* Add Rally based bench scenario for OPNFV Add md document to explain how to install Rally and run test manually towards OPNFV solution
* Add ODL tests from ODL integration suites
* Functional test documentation
* Adding LICENSE file (whitespace removed)
* JIRA: FUNCTEST-8 Adding the INFO file with committers and key project facts inserted
* Adding .gitreview to functest more information at https://wiki.opendaylight.org/view/Git-review\_Workflow
* Initial empty repository
