Merge lp://staging/~canonical-platform-qa/qakit/app_startup_poc into lp://staging/qakit

Process to parse logs, upload data to mongo db and plot the app startup times for the last builds.

Dependencies:
Install pip by doing: "sudo apt-get install python-pip python-dev build-essential"

Download and Install eve (http://python-eve.org/install.html)
Run eve by doing python qakit/appstartup/eve/run.py (you can define the env variables, see in file settings.py)

Download and install mongodb (https://docs.mongodb.org/manual/tutorial/install-mongodb-on-ubuntu/)
Create a user for mongo and remember to update the eve settings file
To create the mongo user type: "mongo" and then
db.createUser(
   {
     user: "ubuntuUser",
     pwd: "ubuntuPassword",
     roles: [ { role: "readWrite", db: "test" } ]
   }
)
Note: eve code is ready to run with python 2.7 and 3.X

Network configuration when the eve machine is hosted in canonistack:

  1- Allow ip routing by doing:
  sysctl -w net.ipv4.ip_forward=1

  2- Make sure the os allow to route to localnet by doing:
  sudo sysctl -w net.ipv4.conf.eth0.route_localnet=1

  3- configure iptables by doing:
  sudo iptables -A PREROUTING -t nat -i eth0 -p tcp --dport 5000 -j DNAT
  --to-destination 127.0.0.1:5000

To run the import and plotting process it is needed to run the following tests with the command "./run-system-tests ubuntu_system_tests.tests.app_startup.test_application_startup" for the branch lp:~canonical-platform-qa/ubuntu-system-tests/app_startup_poc.

Then, having a test-results.subunit file, run as following: python3 qakit/appstartup/orchestrator.py ~/Desktop/app_startup/test-results.subunit

The html report will be generated in ~/Desktop/app_startup/app_startup_report.html

The eve service is currently available on:

  http://10.55.61.109:5000/appstartup

Jenkins job available on:

  https://platform-qa-jenkins.ubuntu.com/job/cachio-appstarup