CHANGES
=======

1.4.0
-----

* Release 1.4.0
* Fix bug in scenario validation
* Fix the cleanup issue of NeutronTrunk
* Add change log for committed patch #624036
* Add FloatingIP scenarios
* Fix validation of required services
* Use OctaviaBase class from utils
* Add more trunk scenarios
* Pass insecure to manila client
* Enhance NeutronSecurityGroup.create\_and\_list\_security\_group\_rules
* Add barbican scenario for symmetric secret
* Bump upper constraints to fix conflicts
* Add missing ws seperator between words
* Removed deprecated optional\_action\_timer
* Add tox python3 overrides
* Add barbican container scenarios
* Fix content of CONTRIBUTING.rst
* Bump version of os-faults to 0.2.0
* Fix the misspelling of "except"
* Add neutron trunk utility to add ausbports to existing trunk
* Change openstack-dev to openstack-discuss
* Make open file as rb mode for murano rally test
* Add missing test for atomic action timer in trunk utility
* Enhance Trunk port scenarios to create multiple trunks
* Remove check of deployment type in OS-Faults hook
* Remove support for py34
* Add pools scenarios for octavia
* Add additional loadbalancer scenarios for octavia
* [ci] run osresources script from proper python binary
* Add verify option to scale webhook request
* Check compute\_nodes before live-migrate and migrate
* Add missing property on magnum plugin
* Move some step into "if not skip\_host\_check"
* Check the state and status in hypervisor
* Change openstack-dev to openstack-discuss
* Change "%s:::1" to "%s:::0" in block\_device\_mapping
* Make sure that NeutronScenario implementation supports ipv4 and ipv6
* Add missing ws separator between words
* [cleanup]catch 404 exception while there is not any neutron security group
* Add OSPROFILER\_CONNECTION\_STRING option to Devstack plugin
* Fix fetching osprofiler trace-info
* Simplify jsonschema of existin@openstack plugin
* Add integration with osprofiler in devstack plugin
* Port CreateAndListLoadbalancers for Octavia
* [ci] get back several tox jobs
* Fix missing "is None" for check\_metrics in grafana
* [ci] Temporary remove pep8,py27,py35 jobs
* Update txo minversion to 2.0
* Remove python 3.4
* Small fix in grafana service
* Fix the missing region name information for Keystone client
* Add barbican scenarios
* [ci] Switch docker job rally-docker-check to ubuntu bionic
* Extend list\_volumes arguments
* Add an example configuration that does not use an admin user
* [ci] Fix checking cleanup
* Add neutron trunk port scenarios

1.3.0
-----

* Get back min versions to our requirements
* Adds barbican to osclient
* Propose a new release 1.3.0
* fix tox python3 overrides
* Rename nova.create\_image action
* Remove deprecated NovaImages.list\_images scenario
* Specify keystone version while creating env from system environment
* [docs] Remove outdated docs
* [docs] Update docs for existing@openstack platform
* Improve Elasticsearch scenario
* Fix Dockerfile for support mysql and postgres
* Import consts from rally\_openstack instead of rally
* [api\_versions]Add api check into health check
* Support cinder api v3 and make it as the default version
* Fix kwargs for Grafana service in scenario plugin
* [api\_versions]Deprecate and remove passed api\_info argument
* [api\_versions]Merge version info of api\_versions context into credential
* [ci] Try fixing floating bug at functional tests
* [api versions]Support to specify api versions in the spec of env
* Extend existing@openstack platform with cert keys
* Add functional tests for env check
* Do not mute errors on check health of existing@openstack
* Remove deprecated properties of OpenStackCredentials
* Remove the sample of using endpoint deployment
* Launch functional test
* Correct snapshot ordering
* Add py37 support
* Update requirements
* Fixed README typo
* Fix documentation
* Fix coverage test
* Remove the wrappers and scenario utils of keystone, cinder, glance
* Restore coverage job
* [trival] fix the indent of roles key
* Fix the gates about cinder
* Fix rally-task-neutron-with-extensions job
* Fix keypairs clean up in magnum tests
* Temporary make heat job non-voting

1.2.0
-----

* Propose 1.2.0 release
* Add py36 testenv
* fix misspelling of 'volume'
* [ci] Turn on all jobs
* Fix loading plugins in tests and CI
* Add required\_platform@openstack validator
* Add a reminder for compatibility workarounds
* [ci] Use proper driver for ironic job
* Add Grafana plugin for monitoring testing
* Add Elasticsearch plugin for logging testing
* Trivial: update pypi url to new url

1.1.0
-----

* Release 1.1.0
* Set endpoint interface to gnocchi client
* [ResourceTypes] Add ability to pick the latest available resource
* Redesign ResourceTypes
* Add E731,W503 hacking rule to ignore list and H703 from it
* Add \_\_version\_\_ and \_\_version\_tuple\_\_ properties
* Load config options
* [docs] fix invalid "rst" usage
* Fix duplicate entry in rally-jobs/telemetry.yaml
* Remove atomic timer from nova.bind\_actions method
* Add new Gnocchi resource scenario
* Port rally-jobs/telemetry.yaml to new format
* Remove name generation in resource type creation
* [ci] Add docker-check job
* Several small improvements for README
* Add CREATE\_FAILED as a failure state in magnum cluster tests
* Add Gnocchi scenario for resource creation
* [ci] Enable heat for magnum job
* Make cert generation rbac compatible for kubernetes
* Fix k8s APIClient when k8s-client >= 4.0.0
* [ci] Launch magnum job only for mangum changes
* Fix check for api\_versions ctx at required\_services
* Add Gnocchi metric scenarios
* [ci] Use proper link for ara report
* [ci] Do not transmit plugins dir as cli argument

1.0.0
-----

* Propose a release notes for 1.0.0
* Fix consts imports
* Clarify some items in changelog
* Fix neutron with extensions job
* [ci] Fix osresources to use proper modules
* Update image in magnum jobs
* Neutron scenario to delete subnets for the same network concurrently
* [envs] Creating a spec from system environment variables
* [docs] Add changelog file
* Adds Octavia to OSClient
* Enhance Gnocchi resource cleanup
* Add Gnocchi resource type scenarios
* Remove some redundant stuff
* [ci] Fix murano job
* Rework novaclient floating ips actions
* Add Gnocchi archive policy scenarios
* Add new Gnocchi scenarios
* Restore jobs for all projects
* Various improvements for rally-task-at-devstack job
* [openstack] Remove nova hosts specific logic
* Fix code block in README.rst
* Add usage section to README
* Run integration testing in gates
* [ci] Try simplify rally-task-at-devstack job
* Add basic job for Rally task
* Fix support for k8s-client 4.0
* Remove redundant mock
* Modify .gitreview
* Fix the order of imports
* Remove redundant test
* [ci] Add base python jobs
* Change structure and imports
* [docs] Fix date of Rally 0.11.0 release
* Fix uc for PrettyTable
* Release notes for 0.11.0
* [envs] Implmenet Env CLI commands
* [testing] Refactor CLI tests and utils
* [cfg] Use stderr for logging by default
* [docs] Fix several deployment configs
* Update requirements
* [cfg] Introduce rally.common.cfg
* [env][openstack] Change format of info method
* port more things to use envmanager
* Fix default values in OpenStack platform
* Fix grammar error
* update documentation reference
* [openstack] Change identifiers for floating ips
* Dockerfile - trivial fixes
* Add release notes for 0.10.1
* Improve Env Manager Interface
* Modify grammatical errors
* modify keystone spelling errors
* Add Gnocchi status scenario
* [jsonschema] Require specifying \`additionalProperties\` explicitly
* setup roles before validating resource and cleanup just after it
* Ability to specify external gateway info for router while creating network context
* Endpoint\_type of private is not valid
* [cleanup] Fix identifiers for Mistral resources
* Add Gnocchi capabilities scenario
* Replace Chinese punctuation with English punctuation
* Update quick\_start step\_1
* Modify the link to secure and correct
* Introduce Gnocchi metric service
* Use upper-constraints.txt in tox envs
* Update image-show command
* [envs] Remove credentials base
* Update install\_rally.sh all available options
* Correct link address in doc
* [unittests]Port to new atomic actions
* Replace DeploymentEngine with EnvManager
* [envs] Add OpenStack platform (part 2)
* fix misspelling of 'configuration'
* modify sphinx-doc links
* Update links in bindep.txt
* Add timeout value into TimeoutException message
* keystone spelling errors
* Ensure cleanup is performed correctly on roles
* Change unsecure link to use https
* Revert "[CI] Unblock cinder job"
* [CI] Unblock cinder job
* [CI] Fix Cinder update volume type scenario & service
* Fix the misspelling of "configuration" and "scenario"
* Can not create Gnocchi client due to deprecated session options
* Fix the misspelling of "migration"
* [ci] remove legacy things from install job
* Make new report to support task file and remove old report
* Use atomic actions in cinder contexts
* Modify Bgpvpn scenarios to test true bgpvpn
* Matching the tenant\_id when removing default security\_group
* [docker] Fix configuration
* Simplify usage of docker container
* OSProfiler Intergration
* [docs] Update info about cores
* Add option arguments of scenarios of floating ip creation
* Do not use own function to find migration target
* Fix JSON generation when scenario has hooks
* [ci] Split legacy-rally-dsvm-cli job
* Make the error code diffrent between running error and sla error
* Add correct version for pyOpenSSL
* Do not use latest k8s client
* Change command return value
* Allow to pass list kwargs to image resource type
* [CLI] Improve Rally DB UX
* [ci] Start migrating to zuul v3
* [CLI] Add rally db ensure command
* [requirements] Stop using upper limits for all cases
* Propose release notes for Rally 0.10.0
* Remove trialing space from docs to fix py27 job
* Propose release notes for 0.9.2
* [docs] Fix displaying task exporters plugins ref
* Add release notes for 0.9.1
* Add ElasticSearch exporter plugin
* import new json report into rally db
* [ci] Launch tox at real requirements
* Create new json exporter
* Fix trend reports
* Add task for getting OpenStack key performance metrics
* [functional] Fix hooks failures
* Fix certification task
* Fix the atomic action table of task results
* Finish work on renaming namespace to platform
* Specify platform in default contexts of GlanceImages.create\_and\_download\_image
* [functional] Fix failures in DeploymentTestCase
* [functional] Fix wrong way to obtaine the task uuid
* [functional] Fix trivial failures in TaskTestCase
* [ci] Start fixing CLI job
* update wait\_for to wait\_for\_status
* [opts] Register options with loading plugins
* [glance] mesure upload data to the image
* Add glance.DownloadImageData scenario
* Update Rally config sample
* Unifies plugin configuration groups
* Rename config section of benchmark & tempest to openstack
* VMTasks.dd\_load: No random input for write test
* Deprecate install\_test.sh script
* Deprecate NovaImages.list\_images scenario
* Allow to specify resource name pattern via rally.conf
* Revert "[CI] Unblock CI by introducing Nova VMs cleanup bug"
* Use rally.plugins.openstack.osclients import everywhere
* Move rally.osclients to rally.plugins.openstack.osclients
* Remove oslo.serialization dependency
* Remove the direct dependency to oslo.i18n
* Save task's title and description
* Port inner stuff to the new task format
* [heat] Add "ERROR" status in wait\_for
* Port hooks to the new format
* Improve Rally Logging (part 3)
* Improve Rally Logging (part 2)
* [CI] Unblock CI by introducing Nova VMs cleanup bug
* Add a comment for a workload in rally-neutron.yaml
* Fix docstring of VMTasks.dd\_load\_test scenario
* Deprecate 'command' argument of VMTasks.dd\_load\_test
* Wrap several actions in VMTask with atomic timer
* Bump os-faults version to 0.1.15
* Use html-static instead of html\_static when exporting report from one file
* Make Cinder Job more stable (part 2)
* Fix the problem of switching hooks format
* [ci] Make cinder job more stable
* Improve Rally Logging (part 1)
* Fix auth issue in verification
* create a new server in each iteration when making snapshots from a server
* [ci] Fix path to a script to execute in hook
* [ci] Temporary workaround. Unblock gates
* Fix image list atomic action for both v1 and v2
* Fix api\_versions@openstack context plugin
* [validators] Port validators to use context object
* Improve context manager setup()/cleanup() logging
* [validators] Unify the order of arguments
* Rename arguments of workbook\_contains\_workflow validator
* use exception in validators
* Use full context names in scenario context configuration
* [plugins] Introduce <name>@<platform> syntax
* Fix Openstack.dummy plugin implementation
* Use "anyOf" instead of "oneOf" in users@openstack plugin
* Rename certification/ to tasks/
* Temporary fix for new ansible release
* Remove dead code from task.types
* Simplify & Improve Dockerfile
* [ci] Update magnum, manila, mistral and monasca jobs to task v2
* [ci] Make rally-keystone-api-v2.yaml link to rally.yaml
* [ci] Update nova.yml to use task v2 format
* [ci] Update rally-designate.yml and rally-ironic.yml to use task v2 format
* Fix listing images in Glance V2
* [CLI] Add support for emtpy deployment
* [CI] Update the magnum image name & increase timeouts
* [ci] Update rally-heat.yml to use task v2 format
* Fix "-" and "\_" samples check
* Update requirements
* Make self-rally more stable
* Code optimization for detach volume
* Reword "benchmark" word in code base
* Switch Cinder Input Task to v2 format
* Update network wrapper to handle neutron plugins router handling
* [CI] Move to v2 format: senlin, watcher, zaqar
* Use new validators in Manila shares
* Move all defaults to TaskConfig
* Add a single workload subtask
* Fix to use "." to source script files
* [samples] Speed up checking samples
* Switch everything to \`rally db\`
* [CLI] Introduce rally db <command>
* Make task format v2 more user-friendly
* Fix Glance v1 update call
* Stop reinventing the is\_public filter for Glance v1
* Update requirments
* Update versions of python clients from global requirments
* Move old validators to the new style
* modify some misspellings
* Add NovaServerGroups.create\_and\_delete\_server\_group
* Simplify deployment config format
* Add analog of collections.namedtuple
* Handle log message interpolation by the logger in common/
* Remove redundant parent atomic action
* Fix cleaning action plan resources on watcher
* Add neutron.CreateAndDeleteSecurityGroupRule scenario
* Update and replace http with https for doc links in rally
* mofify gate reports to use static html because of some unreachable links
* Add GlanceImages.create\_and\_deactivate\_image
* Allow passing image properties to image creation scenarios
* Add cinder.CreatQosAssociateAndDisassociateType
* Reword samples and setup.cfg
* Do not pass enable\_snat if ext-gw-mode extension is disabled
* Use prpoper wording instead of benchmark in rally-jobs
* Rephrase docs call things properly
* Remove redundant cleanup
* Add sla section to samples
* [ci]move unexpected resources table to console html
* Fixed order of arguments in assertEqual
* [ci] Rework launching cli job
* Reduce 2 minutes of sleeps in functional cli task trends test
* Ceilometer Samples Context should wait until samples are processed
* Fix step number in tutorial section in rally doc
* Fix Designate Plugins
* Reduce load in Nova and Cinder CI jobs
* Reduce load in gates in long running jobs
* Rename namespace -> platform in scenarios
* Rename namespace -> platform in context & validators plugins
* [ci] Use not the latest xdist package
* Add nova.BootServerAttachVolumeAndListAttachemnt
* Fix assertRaise cli output to only generate one file per test
* Add allow/deny access scenario to Manila
* Move os\_faults import from the root of module
* Put db requirements to extra requirements
* [ci] do not fail on glance resources
* remove runtime dep on sphinx
* Added user creds in 'rally deployment check' err debug msg with tests
* Improve tox -e cli write to report failed commands as well
* Remove existing\_users context
* Expand user path in Murano plugins
* Remove Cinder create and delete volume v1 API
* Update the documentation links for doc migration
* [cli] "rally task list" improvements
* Update URL home-page in documents according to document migration
* [ci] Turn off glance scenarios
* Extend volume\_type\_exists with nullable option
* Prepare for rally-openstack package
* [CI] Do not print logs when using JSON format
* Fix murano package scenarios
* Remove old way to describe scenario plugin via method
* Add NovaServers.boot\_and\_get\_console\_url
* Update .gitignore
* add to judge whether resources end up with 'y' when clean up
* [ci] Experiment with check\_random\_request
* Fix floating bug with osprofiler test
* Update requirements
* [ci] Fail job in case if there are undeleted resources
* Add BGP VPN scenarios
* 'File exists' validator and Utils class for validators
* [ci] Turn off failed cinder test
* Fixed shebang and permissions for scripts
* [docs] Fix representation of items
* fix router context to cleanup routers resources
* Switch to kubernetes upstream python client
* Fix enum validation in manila shrink and extend scenarios
* [ci]merge 3 patchs to unblock our ci
* Extend tags feature of tasks
* Fixup Rally Tutorial Page Link in README
* Refactor the related command of task report and export
* add check 'rally verify' related job in our CLI
* Add router in context
* Add manila extend/shrink scenarios
* [verify] Fix setting auth\_url
* Improve plugin sample and corresponding 'creating a plugin' tutorial
* Add neutron.CreateAndShowSecurityGroupRule scenario
* fix Rally task [NovaServers.list\_servers] failed with network problems
* [docs] include required platforms of plugins
* cleanup old required\_services
* [ci] Test openstack deployment without admin
* make verification job great again
* Deprecate CinderUtils and CinderWrapper
* cleanup bgp resources
* Add neutron.CreateAndListSecurityGroupRules scenario
* Allow deployment without admin creds
* Move 'volume\_type\_exists' scenario to '../validators.py'
* Deprecate optional\_action\_timer
* [raas] Adding a decorator of api\_wrapper
* Revert "[ci] remove pytest-xdist dependency"
* Fix a typo and update a link address
* Remove usage of parameter enforce\_type
* Using fixtures instead of deprecated mockpatch module
* Various changes in custom\_image context
* [validator]cleanup required\_contexts warning
* Bugfix: fix the auth\_version
* Add CinderVolumeTypes.create\_volume\_type\_add\_and\_list\_type\_access
* [cleanup][network-wrapper] Handle auto-removed ports
* [cleanup] Fix flavors context
* Move 'required-param-or-context' validator to '../validators.py'
* Revert "Temporary disable Cinder scenario that creating volume from image"
* OSprofiler support
* Allow CEPHFS as a valid share type in manila scenarios
* Move 'required\_contexts' validator to '../validators.py'
* Fix unit test of rally ci
* [validator]remove redundant validator and cleanup warning
* [validators] Cleanup warnings
* Move required-api-versions validator to '../validators.py'
* modify the annotations of delete\_snapshot
* Adds Networking-bgpvpn tests
* Moving of 'required\_cinder\_services' validator to '../validators.py'
* Temporary disable Cinder scenario that creating volume from image
* Add cinder.CreateAndSetQos scenario
* Replace kwargs with specific arguments
* Move 'restricted-parameters' validator to '../validators.py'
* [flavor]replace kwargs with details args
* [glance]delete redundant validation
* [Magnum] Context and scenario for Kubernetes
* Add cinder.CreateAndUpdateVolumeType scenario
* Replace assertRaisesRegexp with assertRaisesRegex
* Move 'validate\_heat\_template' validator to '../validators.py'
* Refactor exceptions
* Move 'required\_services' validator to 'openstack/validators.py'
* [ci] Remove NovaSecGroup scenarios from rally-ci
* update requirements
* Fix an issue with image interface of nova
* Fix allow\_ssh context
* Magnum: Move keypair handling at the cluster level
* Add task command \`rally task import\`
* Remove all calls to network interface via Nova
* Remove serverproviders & rarely used deployers
* Update requirements
* [plugins] Introduce plugins as python-packages
* Adds Networking-bgpvpn scenarios
* Add CinderVolumeTypes.create\_and\_update\_encryption\_type
* Add cinder.CreateAndListVolumeTypes scenario
* Add NeutronNetworks.create\_and\_show\_routers
* Move 'required\_clients' validator to '../validators.py'
* Move 'image-valid-on-flavor' validator to 'openstack/validators.py'
* Move 'required\_neutron\_extension' validator to '.../validators.py'
* Move 'external-network-exists' validator to 'openstack/validators.py'
* Fix identity v3 detection
* [image] Extract the common function
* Remove UnifiedOpenStackService
* [manila] Fix cleanup of manila\_share\_networks ctx
* Add CinderVolumeTypes.create\_get\_and\_delete\_encryption\_type
* Extend images@openstack context
* [cleanup] Add cinder.image\_volumes\_cache resource
* [cleanup] Introduce matcher for real names
* Adds Networking-bgpvpn tests
* fix list\_volumes in case image has no name
* [atomic\_actions]Port report to new atomic actions
* Add NovaServers.boot\_server\_and\_list\_interfaces
* Port context of volume type to block service
* [API] Abandon usage of classmethods & staticmethods in API
* [spec] OSProfiler integration in Rally
* Fix details of nova\_utils
* Remove nova-networks
* Move 'image-exists' validator to 'openstack/validators.py'
* Unify QoSSpecs returned data
* Deprecate rally.osclients.EC2
* 'network-exists' validator removed
* Fix atomic wrapper
* Add cinder.CreateAndGetQos scenario
* fix type in name of EC2 service
* Fix the choice of default\_role
* Make openrc deployment file work with keystone v3
* Prepare tests to moving validators to 'openstack/validators.py'
* Fix doc generation for Python3
* [osclients] do not always strip auth\_url
* Split validation at 3 layers
* [validators] Port 'number' validator to plugin base
* [validation] Replace required\_openstack in neutron/network.py
* Add cinder.CreateAndListQos scenario
* GlanceImages.create\_and\_update\_image
* Extend required\_paramaters validator
* Revert "Unblock other projects"
* Fix devstack rally deployment config
* Unblock other projects
* Add nova.BootServerAndAttachInterface scenario
* Add neutron.CreateAndShowSecurityGroup scenario
* Replace 'assertEqual(True, a)' with 'assertTrue(a)' and add hacking rule
* [ci] print available images, volumes, nets
* Fixing of creating of images for rally verify
* Add samples to context directory
* [core] Refactor validation
* [ci] add task file for telemetry job
* Remove OPTs from 'utils.py'
* Optimize the link address
* [ci] remove pytest-xdist dependency
* Fix insecure and cacert warnings
* Fix list\_and\_get\_host scenario bug
* Fixed project creation with Keystone v3
* Add cinder qos and nova server groups in ci/osresources
* Add properties argument when create ironic node
* Add NeutronNetworks.set\_and\_clear\_router\_gateway
* Add GlanceImages.create\_and\_get\_image
* [validation] Use jsonschema validator in ScenarioRunner plugins
* [validation] Use jsonschema validator in Context plugins
* credentials is not updated after deployment is recreated
* [cleanup] Fix neutron quotas resource
* Propose a spec for Rally-as-a-Service
* Reduce hardcode to OpenStack
* [cleanup] Fix ec2 credential resource
* Switch glance wrapper to image service that cinder service calls
* [plugins] Fix ironic scenarios
* [validation] Use jsonschema validator in SLA plugins
* [Service] Update get\_image functions' input and add a param in UnifiedImage
* [validation] Use jsonschema validator in Hook and Trigger plugins
* [cleanup] Use workload uuid in resource names
* [validation] Replace required\_openstack in all scenarios
* [ci] Change image name for senlin job
* Add py files in doc directories to pep8 check
* Requirements file missing python-virtualenv
* [Service] Port all glanceWrapper to image\_service
* Use cinder service in cinder volumes context
* [cleanup] Restrict "cleanup" to scenario resources only
* [cleanup] Fix neutron resources
* [CI] Merge subtasks in self-rally.yaml
* [cleanup] Restrict "admin\_cleanup" to scenario resources only
* [CI] Fix typo in osresources.py
* Switch cinder scenarios to cinder service
* [Validator] Add validator plugin base
* [Service] Fix some details in image\_service
* [cleanup] Modify quotas resources
* Add  neutron.CreateAndShowSubnet scenario
* Corrected the grammar mistake
* [Service] Port all glance scenarios to Image Service
* [CI] Move default rally scenarios to rally-tox-self job
* [ci] Add features.yaml file
* [Core] Add support for default platform and rally self job
* Make return data of Deployment API serializable
* [verify] Fix \`rally verify rerun\`
* [CI] Show test names in job logs
* Fix MagnumClusters.create\_and\_list\_clusters
* refactor atomics actions
* [CI] Enable embedded css on py.test report
* Add "description" to task config
* [CI] Add tox self env that do nothing
* Avoid shell=True in subprocess
* Add NeutronNetworks.create\_and\_show\_ports scenario
* OSResources should be extended to cover all resorces
* Update deployment samples
* Fix deployment --fromenv option
* Adjusting introduction of gate
* Port CinderWrapper to service modules
* Fix nics format in servers ctx
* [Core] Create new plugin based class for credentials
* Make return data of Verify/Verification API serializable
* add release notes for 0.9.0
* [docs] Update docs in jsonschema
* [requirements] Sync requirements
* [cleanup] Introduce NoName obj for res without name field
* [cleanup] Remove old nova\_client judge in NovaServer
* Revert "Neutron's floatingip add desc param"
* [verify] Extend rerun cmd with tag and concurrency args
* Enabling support of 'script\_inline' option
* [CI] Show all attributes in osresources check
* [verify] Extend rerun cmd with detailed and no-use args
* Neutron's floatingip add desc param
* Do not check Glance V1
* [CI] skip some resources while checking cleanup
* [CLEANUP] Add ability to specify superclass for cleanup
* Change volumes size or time of cind ci
* Add cinder backups quota support
* Add hacking rules for deprecated LOG.warn
* Add cinder.CreateAndGetVolumeType scenario
* Corrected the sentence in problem description
* [ci] Add status field to resource identifiers
* [img] changed the spelling of third party in the image
* Add nova.CreateAndGetKeypair scenario
* Modifing of test on docstrings
* [FIX] Port some cleanup to admin\_cleanup in scenarios
* Add CinderVolumeTypes.create\_and\_delete\_encryption\_type
* [Core] Make task engine more abstract
* [CI] Update hacking and fix pep8 errors
* Add NovaServerGroups.create\_and\_get\_server\_group
* Refactoring of deployment credentials
* [DOC] Remove redundant info of 'rally show' in docs
* Update core members
* Fix simple typo in file network.py
* [validation] validate scenario default\_context
* [CI] Fix neutron job
* removed extra 'can' from description
* [CI] Increase SLA values to improve stability of CI
* [CI] Fix image regexp and version
* Remove logging import unused
* Improve Task status list
* pprint jsonschema in plugin reference
* Fix used jsonschemas
* [FIX] fix params in creating floating-ip
* Remove BootRuncommandDeleteCustomImage scenario
* [ci] Check all rally-jobs tasks
* Fix race-condition while making dirs in cli tests
* Switch deployment and verify to custom yaml
* Typo fix: interupt => interrupt
* Switch task parser to custom yaml
* [docs] reduce sphinx warnings
* Move DD\_Load task from BASH script to Rally scenario
* [Verify] Refactoring of Tempest verifier plugin
* Add cinder.CreateAndSetVolumeType scenario
* Add keystone.CreateAndUpdateUser scenario
* Typo fix: splitted => split
* Correct some annotation errors
* [docs] Improve plugins and cli references
* Add keystone.CreateAndListAllRoles
* Use \_create\_network in \_create\_network\_structure
* Fix backup create and restore scenario race problem
* add more badges
* Release 0.8.1
* Fix novaclient requirement
* [doc] Add documentation for hook and trigger plugins
* Use new network for each subnet scenario run
* [doc][verify] Some more changes in docs before release
* Typo fix: mentiones => mentioned
* [docs] several fixes before release
* [Verify] Add docs with common workflow for verifications
* [CLI] Allow changing deployment config on recreate
* Add nova.ResizeShutoffServer scenario
* Add quotas.CinderGet scenario
* Add release notes for 0.8.0
* Sync requirements
* [docs] Describe verification component
* [Verify] Add 'crashed' status to verifications
* [verification] Introduce rally verify show-verifier command
* Add argument to test boot server with file
* [Verify] Add --detailed flag to \`rally verify start\` cmd
* [Verify] Add tags to verifications
* [verification] add junit reporter
* [docs] Move several docs
* [docs] Several improvements for extensions
* [Verify] The latest cleanup before new release
* Add neutron lbaasv2 loadbalancer scenarios
* [Test] Add test for simple app based on rally api
* [Context] Add region\_name in credential
* Add CinderVolumeTypes.create\_and\_list\_encryption\_type
* Add cinder.CreateIncrementalVolumeBackup scenario
* Replace yaml.load() with yaml.safe\_load()
* [Verify] Improve names of args for configure\_verifier method
* Make glance v2 the default
* [docs][7] Re-design docs to cover all user-groups
* [docs][6] Re-design docs to cover all user-groups
* [plugins][cli] Include plugin base in plugins list
* Make verification reporter pluggable
* [verification] add force flag to configure verifier
* Switch admin\_cleanup to usercleanup
* [Verify] Introduce \`rally verify rerun\` cmd
* Get glance+rally to work under python3
* Support PYTHON3 gate jobs
* [Core] Show proper error message when db is missing
* Additional checks for ceilometers and designate scenarios
* Add NovaServerGroups.create\_and\_list\_server\_groups
* Fix a typo
* Removes unnecessary utf-8 encoding
* Add neutron.CreateAndShowNetwork scenario
* [install] Add iputils to bindep
* [install] Fix install\_rally.sh
* [Verify] Small improvements for verification component
* Check verification component refactoring
* [verification] Fix small bugs in verification component
* Save raw task results in chunks
* [verification] Introduce Tempest verifier
* Add nova.CreateFlavorAndAddTenantAccess scenario
* [verification] Add CLI interface
* Change "a SQL" to "an SQL"
* Fix simple typos in file hypervisors.py
* Remove cueclient
* [cli]remove deprecated \`rally show\` command
* [Bindep]Use bindep lib to install system packages
* [verification] Introduce new objects
* Fix the link in rally-jobs
* [API] Add API class
* [verification] Remove outdated stuff
* Replace six.iteritems with dict.items()
* Use assertGreater(len(x), y) instead of assertTrue(len(x) > y)
* [db] Migrate old verification results to new format
* [ci] Use neutron quotas for security groups
* Additional checks for nova scenarios
* [jobs] Test all keystone scenarios
* [Core] Remove map\_for\_scenario
* Port all keystone scenarios to Identity Service
* [Services] redesign metaclass to support subclasses
* Make our CI great again
* Use \_list\_hypervisors() method in nova aggregates
* Add Apache 2.0 license to source file
* [ci] stop checking verification component
* [Core][Bug] Fix 'task start --abort-on-sla-failure'
* [CI][cli] use env variable to determine KeystoneV3
* [docs][5] Re-design docs to cover all user-groups
* [docs][4] Re-design docs to cover all user-groups
* [ci] Fix our jobs
* [docs][3] Re-design docs to cover all user-groups
* [docs][2] Re-design docs to cover all user-groups
* CreateAggregateAddHostAndBootServer scenario for aggregates
* [CLI] group commands in help message
* Show team and repo badges on README
* update keypair's context
* Fix rally verify ci test
* Refactor DB shema for task results
* [gates] Fix rally gates
* Remove extra field from watcher plugin
* [docs]add info about trello board and gitter chat
* [docs][1] Re-design docs to cover all user-groups
* [Rally profile] Increase sla rates for generate names
* Add CinderVolumeTypes.create\_volume\_type\_and\_encryption\_type
* Add an option to pass workflow input and parms to mistral execution
* Add ability to increase rps with certain duration
* [requirements] Sync requirements
* [Manila] Add scenarios for Manila share metadata
* Add CinderVolumes.create\_and\_accept\_transfer
* Remove hosts in a nova aggregate before deleting the aggregate
* [ci] add test hook for certificaiton task
* Add NeutronNetworks.list\_agents
* [Rally profile] Performance of creating atomic timers
* Add cinder.CreateVolumeType scenario
* Allow create image params in glance scenario
* [Services] Introduce Identity Service
* Add CeilometerAlarms.create\_and\_get\_alarm
* Add missing device\_owner for L3 HA's case
* [Manila] Fix CI job configuration
* Add nova resources in ci/osresources
* Fault injection hook plugin
* Update wait\_for to wait\_for\_status
* Fix simple typos in file hypervisors.py
* [Services] Add base class Service
* Replace six iteration methods with standard ones
* Add nova.ListAndGetHosts scenario
* Add test and sample to CreateAndListNetworks
* Add nova.ListAndSearchHypervisors scenario
* Add Quotas.nova\_get The scenario list the quotas for nova
* Increase number of iterations in RallyProfile.generate\_names\_in\_atomic
* Use upper-constraints for tox envs
* Benchmark for generate\_random\_name
* Add cinder.ListAndGetVolume scenario
* Add CinderVolumes.create\_volume\_and\_update\_readonly\_flag
* Add CinderVolumes.list\_transfers
* Fix some typos in release note
* Add nova.CreateAndDeleteFlavor scenario
* Add CinderVolumes.list\_types
* Add keystone.CreateAndGetRole scenario
* [Manila] Add create\_and\_list\_share scenario for Manila
* Avoid variables overwrite by keystone default config
* [CLI] Fix mentions of deprecated command \`rally verify compare'
* [Reports] Get rid of Mako in reports, finally
* Add nova.getHypervisorStatistics
* [Tests] Fix functional test\_time\_hook
* [Reports] Significant improvements in verification report
* Add v3 role create usage
* Add NovaAggregates.create\_and\_get\_aggregate\_details
* Add nova.ListAndGetHypervisorUptime
* Add nova.BootServerAndAddSecgroup
* Add option to create mistral execution from workbook
* [release] notes for 0.7.0
* Remove pycparser restriction from requirements
* Move 'hook\_section.rst' spec to doc/specs/implemented/hook\_plugins.rst
* Sync requirements before release
* [Gates] Synchronize script instance\_test.sh
* Add NovaAggregates.create\_aggregate\_and\_add\_host
* [Tests] Improve RallyCliError exception
* Add nova.CreateFlavorAndSetKeys
* Add nova.ListAndGetHypervisors
* Add NovaAggregates.create\_and\_update\_aggregate
* [Plugins] Replace instance\_dd\_test.sh with instance\_test.sh
* [Verify] Fix \`rally verify installplugin\` cmd
* Moving of Nova.Servers scenarios into separate classes
* [Hooks][Reports] Show Hooks output in HTML report
* Port all Sahara scenarios to new style
* Moving of Neutrone scenarios into separate classes
* Add Keystone token validation
* [Verify] Fixing issue with downloading images for the tests
* Moving of Nova scenarios into separate classes
* Update of docstrings to support common-style scenarios
* Port of Auth and Desicnate to new style
* Moving of EC2, Fuel and Glance scenarios into separate classes
* Add periodic trigger plugin
* Pin pycparser version to ==2.13
* Refactor hook stuff
* Add timeout for tests execution
* Add NovaAggregates.create\_and\_delete\_aggregate
* allow passing of specific volume type
* Add Apache 2.0 license to source file
* Using sys.exit(main(sys.argv)) exit the program
* Add BootServerAssociateAndDissociateFloatingIp
* [magnum] Rename to cluster and cluster\_template
* Remove unnecessary \_\_init\_\_
* Remove admin\_domain\_name from Credetials
* Using sys.exit(main()) instead of main()
* Use assertEqual() instead of assertDictEqual()
* Add NovaAggregates.create\_and\_list\_aggregates
* Fix typos in release note
* Update config sample file with latest config options
* Add NovaFlavors.create\_and\_get\_flavor
* [Magnum] Scenario to create a Magnum bay
* Use hook executer inside task engine
* Revert "[rally-jobs] unblock gates"
* Fixing docker-check jenkins job
* Moving of Heat scenarios into separate classes
* Moving of Ironic and Keystone scenarios into separate classes
* Remove unnecessary setUp
* [Magnum] Context and scenario for Magnum baymodel
* Moving of Volumes scenarios into separate classes
* Moving set of scenarios into separate classes
* New plugin type - Hook
* Moving of Ceilometer Alarms scenarios into separate classes
* [rally-jobs] unblock gates
* Port Senlin and others scenarios to new style
* Rework optional-requirements
* Moving of Ceilometer scenarios into separate classes
* [Tests] Ignore too long mock names
* Refactor sleep\_between
* Update error messages for ceilometer event scenarios
* [gatest] Comment several ceilometer scenarios
* [Manila] Add security-services context
* [requirements] Update requirements
* [Plugins] Remove deprecated Dummy.dummy\_with\_scenario\_output
* Remove time.sleep
* Add simple wrapper for pytest
* [release] Rally 0.6.0
* Sync and add upper limit to requirements
* Bump pytest-html version to 1.10.0
* [senlin]Add context support for Senlin profile
* Add \_\_ne\_\_ built-in function
* [verify] Fix obtaining project id
* [Plugins] Rename workload dammy.failure -> Dummy.failure
* [osclients] use keystone auth\_ref directly
* [devstack] fix keystone v3 deployemnt config
* Fix some typos in hosts.py
* Moving of Quotas scenarios into separate classes
* Fix neutron gate jobs
* TrivialFix: Remove logging import unused
* Add watcher audit template context and 2 scenarios
* Fix typos in the docs
* Remove useless \_\_init\_\_
* Use more specific asserts in tests
* Put in more propriate place test results
* Allow volume\_type to be None since None is a valid value
* [Verify] Adding 'add-options' arg to \`rally verify genconfig\` cmd
* Fix some typos in the files
* [Plugins] Add executable availability check to instance\_test.sh
* [Doc][Reports] New documentation chapter about HTML reports
* Moving of Ceilometer Eventss scenarios into separate classes
* Use attachment\_id instead of volume\_id when detaching volume
* Moving of CeilometerQueries scenarios into separate classes
* Skip checking samples in coverage job
* [Verify] Deprecating 'tests-file' and 'xfails-file' args
* Update requirements
* Remove deprecated log module
* Add create\_audit\_template\_and\_delete scenario
* Fix the action name about multiple murano.create\_service
* [Manila] Add share-network autocreation context support
* Add Senlin plugin for profile and cluster
* [Verify] Discover tests for system-wide Tempest installation
* [Plugins] Fix vm.utils.\_run\_command\_over\_ssh
* Fix broken gate
* [Verify] New command to uninstall Tempest plugins
* Add monasca benchmark in plugin - Part 0: metrics
* [Verify] New command to list Tempest plugins
* modify the home-page info with the developer documentation
* Fix bash error in raally-gate script
* [existing users] Restore original quotas
* [docker] fix ability to use \`rally verify install\`
* launch tests in parallel
* Fix python3.5 unit test failure
* Make our docker-image more user-friendly
* Add performance degradation SLA plugin
* [Verify] Adding '--skip-list' arg to \`rally verify start\` cmd
* Refactor osclients
* Add default role name to rally config
* Add cover-master to gitignore list
* Sync requirements
* Add the unit-test of add\_and\_remove\_user\_role
* add release notes for 0.5.0
* Modify rally requirements while preparing to release
* [requirements] Add helper for managing requirements
* Add support for watcher osclient and watcher related types
* Use flavor name for checking flavor existence
* [Core] Make iterations numeration starting from \`1'
* Added auto-configure for node group
* replace assertNotEqual(\*,None) to assertIsNotNone
* Replace deprecated LOG.warn with warning
* Validate scenario arguments
* [Verify] New command to install Tempest plugins
* Add Python 3.5 classifier and venv
* [Spec] Spec class-based-scenarios.rst is implemented
* Remove unused LOG to keep code clean
* Add volume type argument in volume context
* Add param volume\_type when creating volume in nova scenarios
* Add \_\_ne\_\_ built-in function
* Add dns\_nameservers option to network context
* Updated const.py file with new versions of plugins
* [feature request] Check queue perfdata
* Add keystone validate token using ceilometer scenario
* Fix bug on image\_valid\_on\_flavor
* [Plugins] Add cleanup context for security groups scenarios
* Add NoverServers.boot\_server\_from\_volume\_snapshot
* [CI] Fix coverage job
* Fix 'existing\_users' context against keystone v3
* Use pytest instead of testr
* [Plugins] Class-based scenario DummyFailure
* [ci] rename rally-gate.py to wip-rally-gate.py
* Stopping server is redundant before cold-migrating server
* Make dict.keys() PY3 compatible
* Ensure consistent naming of sample scenarios
* [CI]Disable failing tests for Neutron with existing users
* Modify nested\_level from dict to integer
* Mark several cleanup resources as tenant\_resource
* [Plugins] Improve scenario output from boot\_runcommand\_delete
* Add the nics argument in servers context
* Fix scenario examples for vm
* [CI] Move create\_and\_delete\_vips to unstable job
* Add boot\_and\_delete\_server samples and functional test
* Remove redundant lines
* [Core] Introduce class-based scenarios
* [CI]Prepare for gate job testing existing users context
* Revert "Gate: prepopulate cluster with one server"
* Use Nova only when Nova is available
* [Verify] Add tempest configs and move to new section
* Updated from global requirements
* Create deployment conf depend on identity version
* Update create\_nested\_snapshots\_and\_attach\_volume
* [Requirements] Remove \`fixtures' package
* Fix ceilometer bug with required contexts
* Add a required\_api\_version validator
* Updated from global requirements
* Expose ssh timeout and interval in vm scenarios
* Make custom\_image context glance v2 compatible
* [Verify][CI] Add 'ctx-create-resources' arg to rally\_verify.py
* Make sahara\_image context glance v2 compatible
* Add CinderVolumes.create\_volume\_from\_snapshot
* Updated from global requirements
* Fixed syntax in share\_networks example comment
* Add NovaServers.boot\_and\_update\_server
* Updated from global requirements
* Updated from global requirements
* Change list\_samples to invoke new\_sample.list
* Fix CinderVolumes.create\_volume\_and\_clone
* [magnum] Change  magnum service type
* [Plugins] Fix custom output from boot\_runcommand\_delete()
* Mock generate\_cidr in unit test
* Fix "AttributeError" when using "existing\_users" context
* Updated from global requirements
* [Reports][CLI] Introduce Trends report
* Add missing sla section to the input task
* Add the argument image into create\_and\_upload\_volume\_to\_image
* [CI] Add missing SLA to actually bugs check bugs in gates
* Gate: prepopulate cluster with one server
* Add heat dataplane context
* Add Murano environments context
* Wait for should consider pending\_delete
* [Verify] Changes related to \`rally verify discover\`
* Updated from global requirements
* [Docs] Add glossary page
* Updated from global requirements
* Fix runner timeout
* [gates][requirements] move gnocchiclient to optional
* Add flavor\_name variable to the nova job template
* Add possibility to balance usage of users
* Fix mistake parameter auto\_assign\_nics in nova.jaml
* Delete depracated types stuff from Rally
* [Magnum] Add Magnum client to Rally
* Updated from global requirements
* Add create-flavor and flavor-access-list scenario
* Refactor unit test for nova scenario utils
* Remove use of is\_temporary() in resource cleanup
* Fix random fail on rally-ci cli tests
* Use optional atomic action in proper place
* Support single-AZ deployment
* Add CinderVolumes.create\_volume\_and\_clone
* [Doc] Fix small typo in cli\_reference
* Rectify indentation in scenario YAMLs
* Fix bugs on booting a server from volume like "Change #312845"
* Add import\_opt for CONF.benchmark.glance\_image\_delete\_\*
* [Verify] Add 'version' arg to install/reinstall cmd
* fix bug on booting server from volume
* [Context] Fix side effect changes of context config
* Remove unused requirements
* Fix randomly fail keystone roles tests
* Fix keystone unit tests
* Fix randomly failed unit test
* Add configs to MapR plugin
* Fix Keystone wrapper argument order
* Add Cinder volume\_types context
* Use glance wrapper where appropriate
* Adding gnocchi client and keystoneauth to rally
* [Scenario] Remove unnecessary cleanup
* [Docs] use openstack theme outside rtd
* fix up the formatting of the readme for the announce script
* Fix empty config error message
* Release notes for 0.4.0
* De-duplicate consume() for delete in users context
* Use Broker Pattern for Keystone roles context
* [Verify] Fixing issue with discovering images
* [CI] Move cinder scenarios to cinder job from neutron\_unstable
* Updated from global requirements
* Isolate scenario args between iterations
* Use "visibility" param in create\_image() for V1
* Fix filters in glance v1 wrapper
* Refactor neutron utils
* Fix various bugs in tests/code that creates
* [Docstrings] Improvements for docstings
* Use real creadentials object at sahara tests
* Add basic support for Senlin service
* Updated from global requirements
* Add functional tests to task detailed with errors
* Test: Compare resources even if SLA fails
* Add more bindings for bounce server scenario
* Updated from global requirements
* Test: Distinguish expected added resources
* Test: don't stringify cloud resources until printing
* Test: switch osresources to Credential class
* [Bug1535948] Add Heat template validator
* Glance wrapper: De-obfuscate image fetching
* Updated from global requirements
* Make glance web uploads streamable
* Make sure we don't have a stale package cache
* [ci] Workaround for siege workload template
* Remove hardcode from heat service
* Move unstable scenario to neutron unstable job
* Restrict deletion of "default" security group
* Cleanup: Fix getting name from neutron resources
* Add exact error message into runcommand\_heat scenario
* Allow max\_avg\_sla per atomic actions
* Reduce default speed of users creation in users context
* [CI] add --debug flag to deployment check
* Fix typos in Rally files
* Change deployment model schema
* Add task exporter to the file system
* [Tests] Some fixes in SaharaInputDataSourcesTestCase
* Add heat scenarios: output-show, output-list
* Fix typos in comments and docstrings
* Release notes for 0.3.3
* Update release notes for 0.3.2
* devstack: support to be enabled with different plugin name
* devstack: removed uncalled code
* Cleanup threads config option
* [Plugins] New scenario Dummy.dummy\_random\_action
* Add configuration for Heat caching during validation
* Automatically configure mock context clients
* Convert existing scenarios to new types plugins
* Updated from global requirements
* Convert ResourceType classes to plugins
* [CI] Check nova is available in deployment
* Delete only images created by images context
* Fix glance cleanup filter
* [CI] Fix mos jobs to work with keysone v2.0 and v3
* Always assign a name to created images
* Use proper attribute to get heat stack name
* Release notes for 0.3.2
* Clean cleanup context
* Add backwards compat for server\_kwargs name change
* [docs] Add code block types into docstrings
* Updated from global requirements
* [ci] Remove sla from heat-runcmd job
* unify \*\_kwargs name in scenarios
* Add name() to ResourceManager
* Remove deprecated 'script' and 'interpreter' in favor of 'command'
* [Docs] Rework "Rally Plugins Reference"
* [CI] Fix rally-mos job to work with mos-8.0
* Updated from global requirements
* Change unstable neutron rally job's flavors
* Refactored atomic action in authenticate scenario
* Fixed imcompatible argument in service create with keystone v2/3 API
* Documentation tox fix
* Add support for nova service-list
* [Docs] Add cli reference to docs
* Designate V2 - Add recordset scenarios
* Updated from global requirements
* Expand Nova API benchmark in Rally
* [Bug1509027] Add failure statuses into HEAT utils
* [Docs] create utils for sphinx extensions
* Updated from global requirements
* [Doc] Make documentation for output plugins
* Make sure VolumeGenerator uses the api version info  while cleanup
* [spec] Refactoring scenario utils
* Overhaul SeekAndDestroy.\_get\_cached\_client()
* Using 'dt' as alias for datetime imports
* [Verify] Deprecate for removal '--tempest-config' for 'reinstall' cmd
* Updated from global requirements
* Use new-style Python classes
* Release notes for 0.3.1
* Fix cleanup manager with api\_versions context
* Restore ability to pass kwargs to glance \_create\_image
* [Verify] Don't create new flavor when flavor already exists
* Test: Stop using non-existent method of Mock
* [Sahara] Fix flavor for cloudera manager
* Pass api\_versions info to glance images context
* Fix release notes for v0.3.0
* Add v0.3.0 release notes
* Add wrapper for Glance API versions
* Avoid using range() of len() to get index of iterable
* Ensure cleanup context uses the supplied api\_versions in the task
* [Verify] Don't create new image when image already exists
* Fix quotas to use the supplied context
* Fix volumes to use the supplied context
* Remove unnecessary second argument from get method
* Add heat siege workload scenario
* Log VM console when Rally fails to connect to VM
* Updated from global requirements
* Updating the rally.conf.sample file
* [Verify] Adding new command \`rally verify discover\`
* Fix liberty Neutron client incompatiblity
* Use booleans to check for empty lists
* Add the scenario of list-flavors
* Fix Ceilometer scenarios against Keystone API v3
* Move OpenStack cleanup utils out of context
* Re-run failed Tempest tests
* [CI]Split Rally gate scenarios for Keystone API v2.0 and v3
* Fix unit tests for authenticate scenarios
* Updated from global requirements
* [CI]Restore disabled scenarios in Rally gate job
* Add Cinder v1 test to gate
* Fix typo
* Fix gates against Keystone V3
* Integrate Rally & Alembic
* Default cinder to v2
* Updated from global requirements
* Update plugin image in documentation
* Move "tempest concurrency" feature request to implemented
* Remove \`None\` as a redundant second argument to \`dict.get()\`
* Updated from global requirements
* Updated from global requirements
* [cli] Remove "rally info" command
* Fix deprecated import of rally.common.log
* Deprecated tox -downloadcache option removed
* Consistent resource names spec is implemented
* Regenerated the sample configuration file
* Pass environment variables of proxy to tox
* [Sahara] Improved flavor paramter for clusters
* [Gates] Avoid duplication in logging
* [docs] Increase an understanding of api\_versions context
* [Gates] Remove redundant args from \`rally verify ...\` commands
* Fix release 0.2.0 notes
* [Spec] Refactoring Rally Cleanup, Part II
* [gates] Speed up gate-rally-dsvm-verify-light
* [Scenario][Reports] Improve scenario output format
* Add release notes for 0.2.0
* [Verify] Deprecating --no-tempest-venv for \`rally verify [re]install\`
* Remove EC2 from Nova gate job
* [Spec] Update and move spec about new output format
* Additional argument support for CinderVolumes
* [Reports] Improve HTML report and add dummy\_output scenario
* [Scenario] Add method \`Scenario.add\_output'
* Use assertTrue/False instead of assertEqual(T/F)
* Updated from global requirements
* Fix hacking checks
* Images context: accept arbitrary image create args
* Test image downloading in image\_context
* [VM] refactor wait\_for\_ping
* Split hacking check for db and objects call from cli
* Fix for the deprecated library function
* [Docs] Remove \_build directory before main cmd
* test: make enforce\_type=True in CONF.set\_override
* Updated from global requirements
* Put py34 first in the env order of tox
* [Docs] improve cli docs
* Fix some inconsistency with docstrings in rally
* Python 3 deprecated the logger.warn method in favor of warning
* py33 is no longer supported by Infra's CI
* Drop py26 from tox
* Remove extra link in \`All release notes\`
* [Verify] Deprecating --system-wide-install in favor of --system-wide
* Relese notes 0.1.2
* [Verify] Adding "xfail" mechanism for Tempest tests
* Updated from global requirements
* tests: add ContextTestCase that mocks clients
* Add hacking rules for CLI import
* Adds Designate domain-update test
* Remove rally show commands from rally gate job
* Fix placements of docs, samples, certification in the Dockerfile
* Make Neutron router scenarios work with network context
* specify required services for all resources
* Fix Rally Version in Docs
* Adding Cue client to osclients
* [Verify] Adding possibility to specify concurrency for tests
* change name of rally.common.log module
* Designate V2 support - part 2
* Remove excessive quotes in \_revert\_resize()
* Fix format of existing network in \_get\_or\_create\_network()
* [Sahara] Added spark and ambari plugins
* [Neutron] Fix \_get\_or\_create\_subnets() return value
* [Sahara] Fix for Sahara cluster context
* [gates] move ceilometer alarts scenarios to non-voting job
* [Sahara] Remove volumes from non-workers
* Make disk\_format configurable
* Add Workload object
* Minor change in docstring
* Rename "endpoint" to "credential" (part 4)
* [Verify] \`rally verify install/reinstall\` with --no-tempest-venv
* Add batching for samples creation in context
* Rename "endpoint" to "credential" (part 3)
* [CI] Remove HttpRequests scenario from MOS job
* [requirements] Change requirements to support py26
* Add Designate API V2 support - part 1
* Fix timeout for scenario runners
* Extend statistic benchmarks for Ceilometer
* [api\_versions] Allow to use unknown services
* Updated from global requirements
* Replacing application\_catalog with application-catalog
* Add region\_name in devstack plugin script
* Remove unnecessary shell=True in subprocess calls
* Remove old random name generator
* [verify] add ability to turn off compare in job
* Remove old generate\_random\_name() use from sahara context
* Using 'ready\_statuses' instead of 'is\_ready'
* [CI] Join together mos and mos\_neutron files
* [Reports] Add an option for embedding JS/CSS libs into report
* Rename "endpoint" to "credential" (part 1)
* Implement new random name generator for wrapper plugins
* [Ci] Check Heat service availability in tests.ci.osresources
* [Verify] Fixing issue with SSL deployments
* Updating rally.conf.sample
* Updated from global requirements
* Fix floating ip setting name in samples
* Fix some typos by toolkit typo
* Extend samples list benchmarks for Ceilometer
* [Spec]Add a spec for distiributed load generation
* Drop python 2.6 classifier
* Updated from global requirements
* Fix broken logic in some neutron scenarios
* [Sahara] Move sahara data to sahara context
* [Ci] Get changes in resources after task run
* [Sahara] Add Swift to output data sources
* Updated from global requirements
* OpenStack typo
* Extend list benchmarks for ceilometer
* Rename BenchmarkEngine to TaskEngine
* Updated from global requirements
* [verify] move report template for job to jinja2
* [Swift] Add additional Swift scenarios
* Fix docker build command
* Use network context for Neutron scenarios
* [verify] Add new script to launch verification job
* Add quotation marks
* [spec] Improve and make pluggable type conversion
* Add timestamps and metadata into creating samples
* Add boot-server-from-volume-and-resize for nova benchmark
* Add wrapper to support different API versions
* [Sahara] Add Swift to input data sources
* [Sahara] Split Data Sources context
* Add AST checker for missing @ddt.ddt decorators
* Support jinja2 in rally.ui.utils
* Adds nova show and nova console output plugins
* Creation a list of samples in sample generator
* Add boot-server-attach-created-volume-and-resize nova benchmark
* Refactoring log utils
* [Sahara] Added latest versions of sahara plugins
* Add missing ddt class decorator
* Updated from global requirements
* Fix \`raise\` section in docstrings
* Fix sahra-dsvm and sahara-mos jobs
* Add Neutron Security Groups scenarios
* Check nova v2.2 in gates
* Updated from global requirements
* Add new context plugin to support different API versions
* Move rally.osclients.Clients to plugin base
* Implement new random name generator for remaining scenario plugins
* Use local.conf instead of localrc
* Fix Murano delete environment
* Add backwards compat for Keystone name\_length
* Updated from global requirements
* Add validate monasca service to authenticate.py
* Fix Sahara service type
* Add parameter --tests-file to 'verify start'
* Implement new random name generator for keystone scenarios
* Convert scenarios to optional\_action\_timer
* [Sahara] Split EDP context
* Updated from global requirements
* Adding command to show tempest.conf
* Fix random miss in comsumer/publisher broker
* New optional\_action\_timer decorator
* Make Docker Container work out of the box
* Add task format converter
* Fix nested atomic action in VMTask scenario
* Use wait\_for\_status instead of wait\_for\_delete
* Implement new random name generator for context plugins
* Extract random nested level from Cinder scenario
* Add Neutron LBaaS V1 healthmonitor scenarios
* Updated from global requirements
* Generate report at the end of rally-dsvm job
* [Swift] Add objects context class
* Updated from global requirements
* Release notes v0.1.1
* [Sahara] Add support for proxy node
* Updated scenario boot-and-delete-server-with-keypairs
* Fix & Restore cover job
* config: fix missing benchmark opts
* Reworked script generating tempest.conf
* workload: fix and rename benchmark script
* workload: fix custom\_image cleanup
* Updating Tempest test sets
* Small improvements for \`rally verify import\`
* Nova-network: disassociate networks before deletion
* Fix LB create and delete VIPs failure when concurrency > 1
* Add task argument to network wrapper
* Remove psycopg2 from requirements
* Run test\_task\_samples in separate sqlite db
* Adds nova image list plugin
* Make code blocks in documentation prettier
* Remove task validation from api.Task.start
* Add Neutron Floating IP benchmark scenarios
* Import tempest results into Rally database
* Release notes v0.1.0
* Add 'Who Is Using Rally' paragraph to the docs
* Add new Murano scenarios
* Set smoke in rally-jobs/rally-neutron.yaml
* Disable smoke-test mode for Neutron gate job
* Moving commands for (re,un)instaling Tempest to "verify" category
* Implementation of 'rally task abort' command
* [docs] Imporve Plugin Reference
* Add context to plugin tests
* Remove required admin=True in LB VIP scenario
* Add missing lbaas extensions check
* Updated from global requirements
* [cli] Remove "rally info" command
* Make network context more configurable
* [COVERAGE] Turn off coverage
* Adding possibility to generate tempest.conf, not running tempest
* Auto assign nic for servers context
* Fix typo in the README.rst in tests/ci/
* [docs] Add plugin reference
* Fix users/tenants in Neutron job and sample tasks
* [cli] Introduce "rally plugin" show and list commands
* Updated from global requirements
* [VMTask] Avoid Floating IP leakage
* New nova jobs: boot\_and\_delete\_multiple\_servers
* Revert "[JOBS] disable several ceilometer scenarios to unblock gates"
* Allow non virtual environment option for verify
* Add create\_and\_update\_secgroups scenario
* [feature request] Check queue perfdata
* Updated from global requirements
* [JOBS] disable several ceilometer scenarios to unblock gates
* Fix typo in rally/consts.py
* Add Neutron Loadbalancer v1 create and update vips
* Add Neutron LoadBalancer v1 create and delete vips
* Add Neutron LoadBalancer v1 create and list vips
* Nova: Support auto\_assign\_nic when booting multiple servers
* [BugFix] Add ability to install tempest in docker
* Add check for neutron extension support in utils
* Updated from global requirements
* [JOBS] Return dummy scenario for nova quotas
* Add usage of os.path.expanduser to Murano context
* [Bug-Fix] use project\_id while creating networks via nova-net
* Fix the rally gates doc link
* Do not remove network from dhcp agent if they are not supported
* [gates] Convert Rally to the new Devstack plugin model
* Fix typos in Rally code
* Add attachment-related scenarios to test on gates
* [Bug-Fix]: Remove ability to put incorrect kwargs for an exception
* Fix argument name in Murano context
* Fix the typos and description of functions
* Updated from global requirements
* Fixed description sentences of functions
* Fixed some typos in the files
* Removing unused dependency: discover
* [feature request] Add abbility to caputre logs from tested services
* [feature request] Allows specific repos & packages in install-rally.sh
* Updated from global requirements
* Updated from global requirements
* Switch scenarios plugins to plugin base
* Set samples default flavor to m1.tiny
* Add Cinder create\_and\_update\_volume scenario
* Updated from global requirements
* Word spells have been corrected
* Word spells have been corrected
* Word spelling have been corrected conficuration --> configuration
* Create pool in lbaas context with correct tenant\_id
* Quick fix for broken dependency on bare-centos VM
* Fix some CI task files
* Add FilePathOrUrlType
* Add release notes section in Rally's doc
* Expose config for timeout of resource deletion
* Updated from global requirements
* [spec] Refactoring Rally cleanup
* Add boot\_runcommand\_delete\_custom\_image scenario
* Move existing\_network context class to proper directory
* Nova: make nova server scenarios easier with existing users
* Rename Manila context
* Move auto\_assign\_nic to class method
* add .eggs to git ignore file
* Add existing\_network context
* Better error messages from invalid sample tasks
* Updated from global requirements
* Refactoring of scenario plugin base
* Expand script path by os.path.expanduser
* Fix six typos and grammar inaccuracies in Rally Readme Files
* Fixed create\_user\_update\_password scenario with keystone v3 endpoint
* Updated from global requirements
* Fixed insecure and cacert not passed to user context
* Fix sample json file
* Add EC2 api scenario that list all servers
* [Manila] Add share networks context for existing users
* Add kwargs to list\_pools function
* Make context plugins decide how to map their data for scenario
* Updated from global requirements
* Update Dockerfile to use new install\_rally.sh
* Add context that creates servers using EC2 api
* Use config file for genconfig and update sample config
* This submission fixes typos for the following files -
* Modify atomic action timer in lb scenarios
* Update to latest available CirrOS version 0.3.4
* Add Nova network scenarios
* Move rally/objects -> rally/common/objects
* Fix instance name created by vm scenarios
* Fixes Typos in rally files
* Move rally/db -> rally/common/db
* Updated from global requirements
* Neutron: Make resource update methods more generic
* Add unit test to check create\_router with ext\_gw
* Rename context.context -> context.configure
* Refactoring cinder create\_volume\_backup scenario
* [Bash-Completion] Fix bash completon for files paths
* Change endpoint initialization
* Add image\_command\_customizer context
* Updated from global requirements
* Add Cinder create\_and\_list\_volume\_backups scenario
* Add ability to specify directory with murano package files
* Remove call to nonexistent NoSuchContext exception
* Fix eight typos on Rally documentation
* Adds LBaaS context, verify network extension
* Add Ironic scenarios
* VMTasks: Make waiting for ping timing configurable
* Updated from global requirements
* openstack: make scenario able to reuse clients
* Updated from global requirements
* Use proper fixtures for manila utils tests
* Reorganize Openstack context plugins
* [Manila] Add scenario for attach of security service to share network
* Updated from global requirements
* Add command-dict option to specify command args
* Add command-dict option to upload a local command
* Keystone: Add scenarios to benchmark user disable/enable
* Modify unit tests to DDT format
* Keystone: do not allow specifying service names
* Introduce rally.plugins.openstack.OpenStackScenario
* Remove osclients from runner and scenario signature
* Fix typo docs at User stories
* Make \`boot\_runcommand\_delete' accept command-dict
* unit-tests: inception: add mock check unit-tests
* Change neutron command to validate token
* Updated from global requirements
* Turn on coverage job
* Fix broken unit-tests
* Improve hacking rule that checks that [] & {} are used
* Some files missing newline at end of file
* Revert "Disable sahara scenarios from dsvm-rally"
* Optimize Rally imports to reduce start time
* [Manila] Add scenario for creation and deletion of security services
* Disable sahara scenarios from dsvm-rally
* Add Heat scenario to test scaling policies
* Add Keystone ec2-credentials scenarios
* Fix EC2 utils and tests
* Better Scenario test case fixtures
* Replace 'unicode()' function with 'six.text\_type'
* Rename rally/benchmark to rally/task
* Updated from global requirements
* Restore coverage test functionality
* Remove extraneous failed server/image tests
* unit-tests: fix mock check errors messages
* Move CeilometerResource.get\_tenant\_resource to unstable
* Support validate parameters list for restricted\_parameters
* Updated from global requirements
* Handle NoneType error from pool\_create\_args
* [Heat] create-snapshot-restore-delete stack scenario
* Keystone get\_entities scenario backwards compat
* Add specs in doc/README.rst file
* Fix typo in ServiceType map
* unit-tests: add mock decorators usage test checker
* unit-tests: fix mocks' naming
* [Manila] Add benchmark for Manila list share servers operation
* [Heat] Add rally template with Heat Resource Group
* [Manila] Add scenario for creation and listing of Manila share networks
* [Manila] Add scenario for creation/deletion of Manila share networks
* Don't change global environment in functionaltests
* Fix timeout option in Cinder upload volume util
* [Manila] Add scenario for creation and deletion of Manila shares
* Add Neutron Loadbalancer v1 create and update pools
* Add Neutron Loadbalancer v1 create and delete pools
* Add rally.common.plugin.discover module
* [Floating IP] Remove port creation on fip creation
* [Sahara] More debug logging
* [Ceilometer] Add  scenario for events and traits
* Add smoke mode for neutron jobs
* [Manila] Add context for Manila quotas
* [Manila] Add base benchmark for list shares operation
* Add role assignment in keystone wrapper for both v2 and v3
* Add Neutron Loadbalancer v1 create and list pool
* Change "find" command path in tox.ini
* Overhaul ceilometer utils unit tests
* Remove deprecated code
* Better mocking for self.[admin\_]clients in Scenario tests
* Install data files in proper path
* Eliminated string formatting with single mapping key
* Remove 'pyc' files before running tests
* Switch to plugin base: context, sla, runners
* Feature request improve install script
* Split slow rally job to several small ones
* Fix super() invocation in DBTestCase.setUp()
* Introduce command-dict and validator
* Fix Designate record deletion utility function
* Move rally.benchmark.scenarios.utils
* Move rally.benchmark.context.base module
* Updated from global requirements
* tempest: add \`admin\_domain\_name' to generated conf
* Add functional test for --plugin-paths parameter
* Authenticate scenario unit test improvements
* Add Nova scenario to boot multiple servers in one request
* Move rally.benchmark.runners.base module
* Fix cinder scenario: create nested snapshots
* Add scenario to modify Cinder volume metadata
* [wrappers] Move wrappers under plugins.openstack
* [Heat] Pass parameters, files and env  for heat stacks
* Change logic of wait\_for\_ping
* task report: generate a JUnit report
* Improvement of cover script
* Remove break from case statement to allow for parsing of CLI args
* Set Python2.7 as basepython for testenv
* Nova: Refactor utils.\_boot\_servers to generate its own name prefix
* [Feature request] Explicitly specify existing users for scenarios
* Add keystone benchmark scenarios for roles
* Rename rally.cmd to rally.cli
* [Spec] Move plugins spec to implemented
* Add Cinder create\_and\_restore\_volume\_backup scenario
* [Scenario] Split Scenarios - P6
* [Scenario] Split Scenarios - P5
* [Scenario] Split Scenarios - P4
* Server Group quotas support
* Minor install script improvements
* Add functional test for task samples
* [Scenario] Split Scenarios - P3
* [Scenario] Split Scenarios - P2
* [CTX] Moves context.cleanup under plugins
* [CTX] Split context into plugins
* [Docs] Existing users and other fixes
* Added configuration parameter for cirros base url
* Add E126 pep8 rule
* Release 0.0.4
* Improve installation script
* Add Cinder create\_backup volume scenario
* Add deploy environment murano benchmark
* Updated from global requirements
* Remove executable bit from files that should not be executable
* Fix grammatical and formatting errors in documentation
* [gates] Upated cirros image version in heat templates
* Fix flavor issues in samples
* Add MuranoPackage context
* Setup volume detach timings separately
* Speed up and reorganize rally jobs
* Updated from global requirements
* Updated from global requirements
* Creates "plugins" tree
* Remove sla from Heat scenarios in MOS job
* Fix broken samples scenario for CinderVolumes.create-and-attach-volume
* Fix validation for rps parameter
* Add Nova lock and unlock scenario
* [Ceilometer] Add context and scenario for resources
* Updated from global requirements
* Add Nova scenario to boot and associate a floating IP
* Add Nova scenario to list hypervisors
* Print Rally debug logs in Rally dsvm gate jobs
* Restore coverage job
* Fix pbr and it's version checks (unblock gates)
* Support size range in Cinder create\_volume and extend\_volume
* Add streaming algorithms and SLA to check for outliers
* Add Http Request Scenario
* Change file loading mechanism for heat tests
* Add Ceilometer list samples
* Adds Nova floating IPs bulk tests
* Finish support of benchmarking with existing users
* Install optional-requirement packages for Rally docker image
* Fix coverage job to compare proper git diff and make it more strict
* [Sahara] Fix the config descriptions
* [Feature request] Specify what benchmarks to execute in task
* Improve coverage job
* Add sample for the server block migration scenario
* Add keystone update\_user\_password scenario
* Fix rally plugins relative imports
* Add keystone create\_update\_and\_delete\_tenant scenario
* Add Nova shelve and unshelve scenario
* [Docs] Various fixes
* Update stackforge to openstack
* Update git review + hosting/mirroring links
* Update .gitreview file to reflect repo rename
* Make coverage job voting
* [Swift] Add base for Swift API Benchmarks: Patch-2
* Data structs declared with constructor replaced with literal
* Release 0.0.3
* Add aborted and broken flags to sla checker
* Add scenario to boot and rebuild server
* Add to constant and rps runneres limits for maximun Core usage
* Remove DeployEngines in favor of DeploymentEngine
* Replaced deprecated 'use deployment' with 'deployment use'
* Add create\_and\_upload\_volume\_to\_image scenario to rally-neutron job
* Remove keystone v3 jobs from MOS
* Updated from global requirements
* [Vm] Restore fixed IP support in boot\_runcommand\_delete
* Add heat list\_stack\_and\_events scenario
* Add keystone create\_and\_list\_services scenario
* Remove redundant option "detailed: True"
* Add "pause and unpause" scenario for Nova
* configure ssl in deployment config
* Add "suspend and resume" scenario for Nova
* Add murano benchmarks
* Add a --uuids-only option to rally task list
* Add keystone create\_and\_delete\_service scenario
* Add boot server scenario for EC2 API
* [spec] Proposal for new task input file format
* Updated from global requirements
* Fix permissions issue in docker image
* Show precision of 2 in coverage job
* Add keystone get\_entities scenario
* Removes from tox.ini flake configuration \_ as builtin
* [Ceilometer] Add CeilometerAlarms.create\_alarm\_and\_get\_history scenario
* Improve hacking and remove useless unit tests
* Add a maximum concurrency option to rps runner
* [unblock-gates] Reduce cirteria of success for Neutron
* Move create-update-delete-stack-inplace test
* Release 0.0.2
* Updated from global requirements
* Add murano client to osclient
* Updated from global requirements
* Add Python 3.4 as supported interpreters
* Fix texts and images in docs
* Fix bash autocompletion of "rally task sla\_check"
* Introduce in-tree Rally specs
* Unify RPS and constant runners and tune constant runner
* Implement create\_and\_upload\_volume\_to\_image scenario for Cinder
* Unblock gates
* Add create-check-delete stack scenario
* Add create-suspend-resume-delete stack scenario
* Add scenarios for live migration of an instance with volumes
* Add security group for neutron ports
* [Sahara] added a cluster delete timeout
* Updated from global requirements
* Refactor ImageGenerator and validation
* Adds Designate server-list scenario
* Default DNS servers for servers in Neutron network
* Updated from global requirements
* Add base for Swift API Benchmarks - Patch-1
* Remove all non-incubated oslo code
* Adds Nova keypair tests
* Updated from global requirements
* Updated from global requirements
* Add new script for gate jobs
* Add list-stack-with-resources scenario
* Updated from global requirements
* Add create and delete routers scenarios for Neutron
* Abort scenario execution on SLA failure
* Updated from global requirements
* Fix rally task detailed --iterations-data
* Store keypair and secgroup data on per-user basis
* Mention Rally ReadTheDocs in README
* Add update + add/delete resource cases
* Add "update-inplace/replace resource" cases
* Add create-update-delete stack scenario
* Support scenarios for updating neutron quotas
* Publishing functional tests reports
* Implement abort in scenario runners
* Add Mistral benchmark
* Replace ' with " in rally/benchmark and tests/unit
* Replace ' with " in tests/unit/[aas,cmd]
* Add option to keep db settings in functional tests
* Replace ' with " in tests/unit/[common,deploy,doc,fixtures]
* Switch to the new Rally API
* Adds Designate server tests
* Add aliases "rally task|deployment|verify use"
* Adds "scenario" to available verify sets
* Replace ' with " in [doc, samples]
* Unblock Rally gates
* Replace deprecated max\_failure\_precent sla
* Fix all py3 related issues
* Refactor oslo.foo as oslo\_foo
* Updated from global requirements
* Allow setting DB for unittests via env & add psql support
* Updated from global requirements
* Add cinder scenario: create volume from volume(clone)
* Add image arg for creating volume from image
* Update location to samples
* Add cold migrate scenario for Nova test
* Add extend\_volume scenario for Cinder test
* Add list\_snapshots scenario for Cinder test
* Re-enabling Heat/Neutron resources test
* Restructure Rally docs
* Improvements for scenario VMTasks.boot\_runcommand\_delete
* Make Rally gates more stable by moving things to unstable job
* Add unstable job file + return SLA for boot from volume
* Replace ' with " in rally/\*.py
* Moving rally/doc/samples to rally/samples
* Unblock Rally gates cause by nova bug 1411525
* Input task templates and task cmd cleanup
* Adding dict.items() concatenate validation
* Pulls up \_test\_atomic\_action\_timer to TestCase
* Updated from global requirements
* Optional parameter "endpoint" is added to deployment configuration
* Adding documentation
* Changes Timestamp to hold float instead of datetime
* Adds timestamps to scenarios iterations
* Move files to common lib(Part 4)
* Add list\_volumes scenario for Cinder test
* Updated from global requirements
* Move JSON\_SCHEMA to rally.consts
* Updated from global requirements
* Support generation of report from N task
* Fix py3k issues
* Add the flavor context
* use function next() instead of next() method on iterator objects
* Move files to common lib(Part 3)
* Use string.ascii\_lowercase and string.ascii\_uppercase only
* Move CinderVolumes tasks from rally.yaml to rally-neutron.yaml
* Use six.moves.range instead of xrange
* Use six.moves.map instead of itertools.imap
* Use from six.moves.urllib.parse instead of urlparse
* Refactor validation (part 1)
* Add Dockerfile
* Use six.moves.StringIO instead of StringIO.StringIO
* Use six.string\_types instead of basestring
* Move files to common lib(Part 2)
* Fix docstring checker
* Cover Rally with docstrings & Test this coverage
* Adding iteritems validation
* Use Network Context in security groups scenario
* Add Network Context Class
* Add list\_servers scenario for Nova
* Remove SLA checks for NovaServers.boot\_server\_from\_volume\_and\_delete
* Python 3 incompatible issue: iteritems
* Add swift service to pre-defined service list
* Adds Zaqar consumer-producer scenario
* Context tenants refactoring
* 100% coverage in functional tests
* Updated from global requirements
* Configure gate-rally-dsvm-verify
* Fix nested snapshot job
* Updated from global requirements
* Change TaskNotFound traceback info to user-friendly message
* Add cinder stress scenario: nested snapshots
* Updated from global requirements
* Add scenario for booting vm with security groups
* Adds trove python client to rally.osclients
* Updated from global requirements
* Added hacking rule for assertEqual(A in/not in B, True/False)
* add 'rally task list' filters
* Fix functional test doc
* Add several new hacking rules
* Reduce amount of time in gates
* Add benchmark overview page to html report
* Add scenarios for security group
* Introudce benchmark.context() decorator
* Adds Nova vm live migration benchmark scenarios
* Add a servers context and a cinder stress scenario
* Add force\_delete to safely delete created VMs
* Rename rally-scenarios to rally-jobs & add readme
* TEMPEST: refactor error handling while installation
* Modify sla failure rate
* Updated from global requirements
* Updated from global requirements
* add ability to refer deployment by uuid or name
* Fix defect of 'separate log level for Rally'
* Port to use oslo.config.fixture
* Updated from global requirements
* Base HTML templates and improvements for task report
* Remove check of verification smoke tests
* Updated from global requirements
* Refactor generic cleanup mechanism part 3
* Updated from global requirements
* Updated from global requirements
* Updated from global requirements
* Modify rally commands deployment, task, and verify
* Fixes fakes and adds version param
* Updated from global requirements
* Add functional tests for rally verify
* Improve plugins and apply loading for runners and contexts plugins
* Port to use oslo.i18n
* Port to use oslo.serialization
* Adding logic to clean up old rally installs
* Fix TempestConfig generator keystone API v3 issue
* Port to use oslo.utils
* Updated from global requirements
* Improvements for task plot2html
* Updated from global requirements
* Fix bash completition setup
* Display proper missing argument name
* Adds Neutron update Port and router benchmarks:
* add bash completion script
* Updated from global requirements
* Reorganize test module structure
* Allow user specified endpoint\_type in config
* Stop using intersphinx
* User story - booting 400 servers on real cluster
* Updated from global requirements
* Adds the Zaqar client
* update rally.conf.sample
* Updated from global requirements
* Add hacking checks
* User\_stories and feature requests appended to sphinx
* Updated from global requirements
* Updated from global requirements
* Updated from global requirements
* Rename doc environment to docs
* Updated from global requirements
* Add feature\_request mechanism
* Add designate support with domain scenarios
* Updated from global requirements
* Fix failing tests in gates
* Updated keystone authenticate user\_story
* Updated from global requirements
* Add "rally info" command
* Added Sahara Clusters scenario
* Fix copyright in doc/source/config.py
* Amended sphinx documents
* Remove openstack-rally entry point
* Updated from global requirements
* Added Sahara Node Group Templates scenarios
* Fix side menu depth
* Updated from global requirements
* Periodic runner refactoring
* Updated from global requirements
* Added Sahara client
* Add basic tools for integration tests
* Patched version of hacking library
* Check if required services are available before starting the scenario
* Updated from global requirements
* Updated from global requirements
* Updated from global requirements
* Improve doc/source
* use oslo.db module
* Updated from global requirements
* Changes tempest subunit log handling
* Updated from global requirements
* Rename api directory to rest
* Added user\_stories section
* Fixes typo error in rally/README.rst
* Prepare documentation for readthedocs
* Increase http client timeout from 30s to 180s
* The configs in osclients.py are not in rally.conf.sample
* Add documentation for plugins
* Add command-line integrated tests
* Fix check for tempest tests name
* Updated from global requirements
* Add Ironic client
* Integrate the new oslotest library
* Runner Type as consts
* Improve User context
* Updated from global requirements
* Updated from global requirements
* Improve tempest.conf generation
* Add multihost engine
* Updated from global requirements
* Sync common db code from Oslo
* Use float values in cfg.FloatOpt() options
* Sync modules from oslo, excluding db related
* Updated from global requirements
* Updated from global requirements
* Base part of a server REST API
* New task config and verification refactoring
* Switch to oslosphinx
* Updated from global requirements
* Updated from global requirements
* ignore build dir in tox.ini
* use CONF in glance benchmark
* Updated from global requirements
* Updated from global requirements
* Add yaml file support
* Add ceilometer python client to rally.osclients
* Improve README.rst
* Add task result graphic ploter command
* Updated from global requirements
* Updated from global requirements
* UPDATED README to make it detailed
* UPDATED README to make it detailed
* Rally & Tempest integration (base) - part 1
* Add support for user/admin permissions in endpoints
* Added SSL support for OpenStack services clients
* Added Heat client initialization
* Replace the call to default\_deployment\_id() by a decorator
* Fix rally benchmark's timeout mechanism
* Fix misspellings in rally
* Remove magic numbers from benchmark utils
* Temporary fix testtols version to unblock gate
* Call rally-manage with warning when openstack-rally-manage is used
* Add FuelClient
* Omit openstack/common/ in test coverage reports
* Add support to build docs by Sphinx
* Deprecate openstack- console scripts, introduce rally, rally-manage
* Switch rally.sshutils from 'eventlet' to 'time'
* Sync with global requirements
* Remove mox
* Use hacking import\_exceptions for gettextutils.\_
* Remove unused sh requirments
* Add .venv to git ignore
* Get rid of fuel-ostf-tests
* Add cover to gitignore
* Update completed tasks status to "finished"
* Introduce the deployment
* Added Deployment model
* Fixed typos into constants
* Move fixtures from test-requirments to requirments
* Fixed some formatting and typos in the README
* Update short description language
* update rally conf sample
* Remove vim header
* Make devstack engine more flexible
* Rally logging: test engine
* Added Devstack deploy engine
* Move and refactor ImmutableMixin & EnumMixin to rally.utils
* Bump oslo config
* Implement task cli list method
* Added cli scripts to package config
* Fixed incorrect timeout tests
* Add task status tracking
* Adding new test execution layer
* Benchmark test framework for Rally
* Improve readme
* Add .gitreview file
* Force tox version to 1.6
* Add author and fix .gitignore
* A fix for tox.ini
* Adding cleanup for all test runner calls
* Init benchmark framework
* README for Rally
* Move tests to root dirrectory and fix tox
* Add Task Model
* Add base for DB API
* Fix test-requirements.txt
* Add rally.sample.conf to project
* Add tox, pep and requirements to project
* Rename README.md to README.rst
* Initial commit
