services/jenkins-scripts.git
10 years agoStore pre-release images information into projet description
Hasan Wan [Mon, 19 Aug 2013 08:46:05 +0000 (11:46 +0300)]
Store pre-release images information into projet description

Fixes: #1179

Change-Id: Ie1b620d91d8f32150de1d54b098e7c2b85405c29
Signed-off-by: Hasan Wan <hasan.wan@intel.com>
Reviewed-on: https://otctools.jf.intel.com/review/5998
Tested-by: OTC Tools Tester <ed.bartosh@linux.intel.com>
Reviewed-by: Eduard Bartosh <eduard.bartosh@intel.com>
10 years agoImplemented image creation for submit groups
Ed Bartosh [Sat, 17 Aug 2013 12:56:48 +0000 (15:56 +0300)]
Implemented image creation for submit groups

Fixes: #1189

Change-Id: If4f91ebf3907c9e52ff90e7ba89d7908a3490d08
Signed-off-by: Ed Bartosh <eduard.bartosh@intel.com>
Reviewed-on: https://otctools.jf.intel.com/review/5985
Tested-by: OTC Tools Tester <ed.bartosh@linux.intel.com>
10 years agoFix a require mistake
Hasan Wan [Fri, 16 Aug 2013 09:22:01 +0000 (12:22 +0300)]
Fix a require mistake

jenkins-scripts should exactly require jenkins-scripts-common in same release

Change-Id: Iaca126378b6d1caa6b5e6f6e0c4cd7f64aa58431
Signed-off-by: Hasan Wan <hasan.wan@intel.com>
Reviewed-on: https://otctools.jf.intel.com/review/5938
Tested-by: OTC Tools Tester <ed.bartosh@linux.intel.com>
Reviewed-by: Eduard Bartosh <eduard.bartosh@intel.com>
10 years agofix a typo in job_pre_release_gerrit
Hasan Wan [Fri, 16 Aug 2013 09:47:56 +0000 (12:47 +0300)]
fix a typo in job_pre_release_gerrit

Change-Id: I7a6ae4e0e98963fdb48ecb2fac68f8e312f5bc96
Signed-off-by: Hasan Wan <hasan.wan@intel.com>
Reviewed-on: https://otctools.jf.intel.com/review/5941
Tested-by: OTC Tools Tester <ed.bartosh@linux.intel.com>
Reviewed-by: Eduard Bartosh <eduard.bartosh@intel.com>
10 years agoImprove feedback message about submit open change
Lin Yang [Fri, 16 Aug 2013 03:38:37 +0000 (11:38 +0800)]
Improve feedback message about submit open change

When developer submit an open change, give back a message to ask to re-trigger
submission after code passed review.

Fixes: #1184

Change-Id: I8ba1ead4e017144bb389a36adf47a33226b46716
Signed-off-by: Lin Yang <lin.a.yang@intel.com>
Reviewed-on: https://otctools.jf.intel.com/review/5929
Reviewed-by: Eduard Bartosh <eduard.bartosh@intel.com>
Tested-by: Eduard Bartosh <eduard.bartosh@intel.com>
Conflicts:
job_submitobs.py

10 years agoAdd an arch compatible table to map different arch
Zhang Qiang [Thu, 15 Aug 2013 02:05:14 +0000 (10:05 +0800)]
Add an arch compatible table to map different arch
to one directory

Fixes: #1134

Change-Id: Ic0469470dedc3d21a3742ce8173ee6b8bcdbece0
Signed-off-by: Hasan Wan <hasan.wan@intel.com>
Reviewed-on: https://otctools.jf.intel.com/review/5903
Tested-by: OTC Tools Tester <ed.bartosh@linux.intel.com>
Reviewed-by: Eduard Bartosh <eduard.bartosh@intel.com>
10 years agoClone project if it don't exist in git cache
Lin Yang [Thu, 15 Aug 2013 07:14:43 +0000 (15:14 +0800)]
Clone project if it don't exist in git cache

Generally when receive a request event, it means jenkins already handled this
project, and it should exist in git cache. But in exceptional case, git cache
don't contain such project, so clone it from remote to local workspace.

Change-Id: I292c8d028ef0277c761890c403b4f80fb7e049eb
Signed-off-by: Lin Yang <lin.a.yang@intel.com>
Reviewed-on: https://otctools.jf.intel.com/review/5907
Reviewed-by: Hasan Wan <hasan.wan@intel.com>
Tested-by: Hasan Wan <hasan.wan@intel.com>
10 years agoFix miss gerrit project under git cache issue
Lin Yang [Thu, 15 Aug 2013 10:15:44 +0000 (18:15 +0800)]
Fix miss gerrit project under git cache issue

Because all git cache project have been changed to bare, add '.git' postfix to
fit the project path.

Change-Id: I77d8268ef0fff7feda81affccf75fcde53cc33ad
Signed-off-by: Lin Yang <lin.a.yang@intel.com>
Reviewed-on: https://otctools.jf.intel.com/review/5910
Tested-by: OTC Tools Tester <ed.bartosh@linux.intel.com>
Reviewed-by: Eduard Bartosh <eduard.bartosh@intel.com>
10 years agoFix the inconsistency between project and desp, fix group submission
Hasan Wan [Tue, 13 Aug 2013 03:12:07 +0000 (06:12 +0300)]
Fix the inconsistency between project and desp, fix group submission
issues.

Fixes: #1135

Change-Id: Id4e1faf04bbeb298dae2ab26f46e1ab9b41d7ea5
Signed-off-by: Hasan Wan <hasan.wan@intel.com>
Reviewed-on: https://otctools.jf.intel.com/review/5870

10 years agoFix a potential error about git cache
Hasan Wan [Tue, 13 Aug 2013 02:27:36 +0000 (05:27 +0300)]
Fix a potential error about git cache

Fixes: #1145

Change-Id: I60c71c35ef21978695e38c16fb08b86977734835
Signed-off-by: Hasan Wan <hasan.wan@intel.com>
Reviewed-on: https://otctools.jf.intel.com/review/5857
Tested-by: OTC Tools Tester <ed.bartosh@linux.intel.com>
Reviewed-by: Eduard Bartosh <eduard.bartosh@intel.com>
10 years agoFix protential error when creating pre-release project
Hasan Wan [Fri, 9 Aug 2013 05:55:54 +0000 (08:55 +0300)]
Fix protential error when creating pre-release project

Fixes: #1094

Change-Id: I14efb72930332600311294e212190b60b367f269
Signed-off-by: Hasan Wan <hasan.wan@intel.com>
Reviewed-on: https://otctools.jf.intel.com/review/5766
Tested-by: OTC Tools Tester <ed.bartosh@linux.intel.com>
Reviewed-by: Eduard Bartosh <eduard.bartosh@intel.com>
10 years agoFix get_gerrit_event import error
Lingchaox Xin [Wed, 7 Aug 2013 07:45:21 +0000 (15:45 +0800)]
Fix get_gerrit_event import error

Change-Id: Ia85da46de9b7ab6e9e1e10100fd608b29f464a0d
Signed-off-by: Lingchaox Xin <lingchaox.xin@intel.com>
Reviewed-on: https://otctools.jf.intel.com/review/5791
Tested-by: OTC Tools Tester <ed.bartosh@linux.intel.com>
Reviewed-by: Eduard Bartosh <eduard.bartosh@intel.com>
10 years agoUpdate dependency of common package
Lin Yang [Mon, 5 Aug 2013 23:52:12 +0000 (07:52 +0800)]
Update dependency of common package

1. move gbs to common package dependency
2. remove createrepo from common package

Change-Id: I9a0abd296d092bb3725583475618392df55347a1
Signed-off-by: Lin Yang <lin.a.yang@intel.com>
Reviewed-on: https://otctools.jf.intel.com/review/5775
Tested-by: OTC Tools Tester <ed.bartosh@linux.intel.com>
Reviewed-by: Hasan Wan <hasan.wan@intel.com>
11 years agoImprove feedback message about no git commit issue
Lin Yang [Wed, 31 Jul 2013 02:19:32 +0000 (10:19 +0800)]
Improve feedback message about no git commit issue

Change-Id: Iced02e79f8a4d4a065aa7eff3df5dd65c8350b3f
Signed-off-by: Lin Yang <lin.a.yang@intel.com>
Reviewed-on: https://otctools.jf.intel.com/review/5701
Tested-by: OTC Tools Tester <ed.bartosh@linux.intel.com>
Reviewed-by: Hasan Wan <hasan.wan@intel.com>
11 years agoGet gerrit parent project name from global config
Lin Yang [Tue, 30 Jul 2013 07:10:09 +0000 (15:10 +0800)]
Get gerrit parent project name from global config

Change-Id: Ib29935ce9bdd38ef134b0b2724261edc7cdb4c3e
Signed-off-by: Lin Yang <lin.a.yang@intel.com>
Reviewed-on: https://otctools.jf.intel.com/review/5683

11 years agoAvoid use specific domain name in script
Lin Yang [Tue, 30 Jul 2013 07:40:44 +0000 (15:40 +0800)]
Avoid use specific domain name in script

Change-Id: Ib2616f80c50469be779140e2a7bd16e564aeabe9
Signed-off-by: Lin Yang <lin.a.yang@intel.com>
Reviewed-on: https://otctools.jf.intel.com/review/5687
Reviewed-by: Eduard Bartosh <eduard.bartosh@intel.com>
Tested-by: Eduard Bartosh <eduard.bartosh@intel.com>
11 years agoDisable send out email if silent mode
Lin Yang [Tue, 30 Jul 2013 08:38:16 +0000 (16:38 +0800)]
Disable send out email if silent mode

Change-Id: I5f326efee984d9d5f932664c0d4511ca2b998074
Signed-off-by: Lin Yang <lin.a.yang@intel.com>
Reviewed-on: https://otctools.jf.intel.com/review/5693
Tested-by: OTC Tools Tester <ed.bartosh@linux.intel.com>
Reviewed-by: Eduard Bartosh <eduard.bartosh@intel.com>
11 years agoRemove source project check from script
Lin Yang [Tue, 30 Jul 2013 05:06:42 +0000 (13:06 +0800)]
Remove source project check from script

Which project will be synced to target gerrit should be control by
gerrit-trigger-plugins in job conf. No need to check it again.

Change-Id: I090b4ab1093077bd4e8a4821e583a271555bc791
Signed-off-by: Lin Yang <lin.a.yang@intel.com>
Reviewed-on: https://otctools.jf.intel.com/review/5680
Tested-by: OTC Tools Tester <ed.bartosh@linux.intel.com>
Reviewed-by: Eduard Bartosh <eduard.bartosh@intel.com>
11 years agoConvert global parameter GERRIT_SILENT_MODE to int
Lin Yang [Tue, 30 Jul 2013 04:43:10 +0000 (12:43 +0800)]
Convert global parameter GERRIT_SILENT_MODE to int

Because os.getenv will return string and current use 0 and 1 in configurations
to control this switch, we should convert it to int.

Change-Id: I2d68d2f188b53f476d05546c73fd07ab5608af42
Signed-off-by: Lin Yang <lin.a.yang@intel.com>
Reviewed-on: https://otctools.jf.intel.com/review/5679
Tested-by: OTC Tools Tester <ed.bartosh@linux.intel.com>
Reviewed-by: Eduard Bartosh <eduard.bartosh@intel.com>
11 years agoDelete duplicate sync git script
Lin Yang [Mon, 29 Jul 2013 04:44:36 +0000 (12:44 +0800)]
Delete duplicate sync git script

There should be no difference of sync git script between synctd and syncto
domain.

Change-Id: Ia950f2527af4691608c877af0974c064acdafc80
Signed-off-by: Lin Yang <lin.a.yang@intel.com>
Reviewed-on: https://otctools.jf.intel.com/review/5657
Tested-by: OTC Tools Tester <ed.bartosh@linux.intel.com>
Reviewed-by: Hasan Wan <hasan.wan@intel.com>
Reviewed-by: Eduard Bartosh <eduard.bartosh@intel.com>
11 years agoAdded -synctd -syncto and -common binary packages
Ed Bartosh [Thu, 25 Jul 2013 22:51:33 +0000 (01:51 +0300)]
Added -synctd -syncto and -common binary packages

-synctd and --syncto are to be installed on tizendev and tizen.org
Jenkins instances. -common is to keep common APIs for all binary
packages.

Change-Id: I51256ef26f2c93ec4ca6381c2edd82752ebe64f8
Signed-off-by: Ed Bartosh <eduard.bartosh@intel.com>
Reviewed-on: https://otctools.jf.intel.com/review/5635
Tested-by: OTC Tools Tester <ed.bartosh@linux.intel.com>
Reviewed-by: Hasan Wan <hasan.wan@intel.com>
Reviewed-by: Lin A Yang <lin.a.yang@intel.com>
11 years agorefined the notification msg for submission
JF Ding [Mon, 29 Jul 2013 02:01:46 +0000 (10:01 +0800)]
refined the notification msg for submission

according Anas' suggestion

Change-Id: I6d6eb4c23a70f9f8a90c32605c4aa629582f55fb
Reviewed-on: https://otctools.jf.intel.com/review/5654
Reviewed-by: Lin A Yang <lin.a.yang@intel.com>
Tested-by: Lin A Yang <lin.a.yang@intel.com>
11 years agoImplemented silent mode for gerrit review
Ed Bartosh [Fri, 26 Jul 2013 21:00:26 +0000 (00:00 +0300)]
Implemented silent mode for gerrit review

Added silent_mode parameter to Gerrit constructor. If silent_mode is
True gerrit review command is not called and review mark is not reported
back to Gerrit.

job_submitobs gets value of silent mode from GERRIT_SILENT_MODE
environment variable. This variable must be set in jobs/configuration
file for Jenkins instances, where reporting back to Gerrit is
prohibited.

Change-Id: I78a57885d3619eee01f48227bb6a299d3b1c8a06
Signed-off-by: Ed Bartosh <eduard.bartosh@intel.com>
Reviewed-on: https://otctools.jf.intel.com/review/5651
Tested-by: OTC Tools Tester <ed.bartosh@linux.intel.com>
Reviewed-by: Hasan Wan <hasan.wan@intel.com>
11 years agoChanged pre-release project name
Ed Bartosh [Thu, 25 Jul 2013 18:31:14 +0000 (21:31 +0300)]
Changed pre-release project name

Included full tag name. Previously it was just a timestamp suffix.
Having full tag name would help RE to find tag more easy.

Change-Id: I106f4a474fcf50492cdff20a6c411a3c31930b23
Signed-off-by: Ed Bartosh <eduard.bartosh@intel.com>
Reviewed-on: https://otctools.jf.intel.com/review/5629
Tested-by: OTC Tools Tester <ed.bartosh@linux.intel.com>
Reviewed-by: Hasan Wan <hasan.wan@intel.com>
11 years agoUsed mic directly in image-creator job
Ed Bartosh [Sun, 21 Jul 2013 22:06:51 +0000 (01:06 +0300)]
Used mic directly in image-creator job

Kvmic is a questionable solution as it's just a wrapper above mic with
it's own config. I'm considering it as a one more point of failure.

Also I failed to make it to work from sudo.

This change is a reimplementation of the job using mic.

Mic is also quite a dangerous pile of "code", but adding even more code
around it makes system even more fagile.

Change-Id: I4ed80712a049f5e5daa73360be64aec6a4cbeba3
Signed-off-by: Ed Bartosh <eduard.bartosh@intel.com>
Reviewed-on: https://otctools.jf.intel.com/review/5545
Tested-by: OTC Tools Tester <ed.bartosh@linux.intel.com>
Reviewed-by: Hasan Wan <hasan.wan@intel.com>
11 years agoHandle gbperror when parse specfile
Lin Yang [Fri, 19 Jul 2013 09:23:37 +0000 (17:23 +0800)]
Handle gbperror when parse specfile

Change-Id: I1ec42fb401883e2efd0323c6da65b57a26ddf1d0
Signed-off-by: Lin Yang <lin.a.yang@intel.com>
Reviewed-on: https://otctools.jf.intel.com/review/5531
Tested-by: OTC Tools Tester <ed.bartosh@linux.intel.com>
Reviewed-by: Hasan Wan <hasan.wan@intel.com>
Reviewed-by: Eduard Bartosh <eduard.bartosh@intel.com>
11 years agoCatch gbs export failure
Lin Yang [Fri, 19 Jul 2013 07:52:20 +0000 (15:52 +0800)]
Catch gbs export failure

Because it's not easily to call gbs export python interface, have to prepare
all export env parameters, current we still call commandline interface and
depend on return code to check result.

Change-Id: Ifc08be290449e0702b3ac84f2680086a3a8ffe2d
Signed-off-by: Lin Yang <lin.a.yang@intel.com>
Change-Id: I9764ed6e5a5955ac9e3e71a173b0beb8bdcfdf05
Reviewed-on: https://otctools.jf.intel.com/review/5527
Tested-by: OTC Tools Tester <ed.bartosh@linux.intel.com>
Reviewed-by: Hasan Wan <hasan.wan@intel.com>
Reviewed-by: Eduard Bartosh <eduard.bartosh@intel.com>
11 years agoClone projects into bare repositories to save disk space
Lingchaox Xin [Tue, 16 Jul 2013 08:03:10 +0000 (16:03 +0800)]
Clone projects into bare repositories to save disk space

Change-Id: I206eeb20ee9a6bcbc68095a69dfd2527d1152d1d
Signed-off-by: Lingchaox Xin <lingchaox.xin@intel.com>
Reviewed-on: https://otctools.jf.intel.com/review/5480
Tested-by: OTC Tools Tester <ed.bartosh@linux.intel.com>
Reviewed-by: Eduard Bartosh <eduard.bartosh@intel.com>
11 years agoFix keyword missing issue after upgrade OBS to 2.4
Lin Yang [Tue, 16 Jul 2013 07:34:06 +0000 (15:34 +0800)]
Fix keyword missing issue after upgrade OBS to 2.4

In OBS 2.4 OBS_SRCSRV_REQUEST_.* event, only deletion event have 'deleteproject'
and 'deletepackage' keyword, so query it in a safe way.

Change-Id: Id14cc7ab8ba4598945430bd80ecc89db221437e5
Signed-off-by: Lin Yang <lin.a.yang@intel.com>
Reviewed-on: https://otctools.jf.intel.com/review/5479
Tested-by: OTC Tools Tester <ed.bartosh@linux.intel.com>
Reviewed-by: Eduard Bartosh <eduard.bartosh@intel.com>
11 years agoFix job_mail_sender.py logic
Lingchaox Xin [Wed, 17 Jul 2013 02:00:58 +0000 (10:00 +0800)]
Fix job_mail_sender.py logic

Change-Id: I835ad45e8bcd113e3da0eddd053bf395e6a58d31
Signed-off-by: Lingchaox Xin <lingchaox.xin@intel.com>
Reviewed-on: https://otctools.jf.intel.com/review/5498
Tested-by: OTC Tools Tester <ed.bartosh@linux.intel.com>
Reviewed-by: Lin A Yang <lin.a.yang@intel.com>
Reviewed-by: Eduard Bartosh <eduard.bartosh@intel.com>
11 years agoUpdate install dependency
Lin Yang [Thu, 11 Jul 2013 06:15:14 +0000 (14:15 +0800)]
Update install dependency

Current jenkins-scripts depends on "gbs remotebuild" and "gbs export", so it
will depend on whole gbs before seperate remotebuild to another package.

Change-Id: I306461a731563b8be36d3f81a9be991046b233c6
Signed-off-by: Lin Yang <lin.a.yang@intel.com>
Reviewed-on: https://otctools.jf.intel.com/review/5442
Reviewed-by: Hasan Wan <hasan.wan@intel.com>
Tested-by: Hasan Wan <hasan.wan@intel.com>
11 years agoRemove unused rpmlint module
Lin Yang [Thu, 11 Jul 2013 06:12:46 +0000 (14:12 +0800)]
Remove unused rpmlint module

Change-Id: I9ebc97aa017ddf2737de85c44ed893d08783e1da
Signed-off-by: Lin Yang <lin.a.yang@intel.com>
Reviewed-on: https://otctools.jf.intel.com/review/5441
Tested-by: OTC Tools Tester <ed.bartosh@linux.intel.com>
Reviewed-by: Eduard Bartosh <eduard.bartosh@intel.com>
11 years agoRemove unneeded exceptions handle and cleanups
Lingchaox Xin [Wed, 10 Jul 2013 08:21:02 +0000 (16:21 +0800)]
Remove unneeded exceptions handle and cleanups

Change-Id: Iee9fbe16a9911351f74a0b4032becaecb9211065
Signed-off-by: Lingchaox Xin <lingchaox.xin@intel.com>
Reviewed-on: https://otctools.jf.intel.com/review/5433
Tested-by: OTC Tools Tester <ed.bartosh@linux.intel.com>
Reviewed-by: Lin A Yang <lin.a.yang@intel.com>
11 years agoRemoved unused code from tempbuildpkg
Ed Bartosh [Sun, 7 Jul 2013 09:50:11 +0000 (12:50 +0300)]
Removed unused code from tempbuildpkg

Change-Id: I9cfc335980d9708b5eb5e8bde0624d06321b6dae
Signed-off-by: Ed Bartosh <eduard.bartosh@intel.com>
Reviewed-on: https://otctools.jf.intel.com/review/5351
Tested-by: OTC Tools Tester <ed.bartosh@linux.intel.com>
Reviewed-by: Hasan Wan <hasan.wan@intel.com>
11 years agodisable ssl cert check to make jobs easy to run on Jenkins slave
Hasan Wan [Tue, 9 Jul 2013 08:10:26 +0000 (11:10 +0300)]
disable ssl cert check to make jobs easy to run on Jenkins slave

Signed-off-by: Hasan Wan <hasan.wan@intel.com>
Change-Id: I7ea268aa326be07a856c3f137c031ebc6397a21b
Reviewed-on: https://otctools.jf.intel.com/review/5398
Tested-by: OTC Tools Tester <ed.bartosh@linux.intel.com>
Reviewed-by: Eduard Bartosh <eduard.bartosh@intel.com>
11 years agouse a function to get obs project and timestamp from prerelease project name
Hasan Wan [Tue, 9 Jul 2013 08:08:35 +0000 (11:08 +0300)]
use a function to get obs project and timestamp from prerelease project name

Signed-off-by: Hasan Wan <hasan.wan@intel.com>
Change-Id: I90da68e8ab55afec9655ca814e92cc6100bc4ced
Reviewed-on: https://otctools.jf.intel.com/review/5397
Tested-by: OTC Tools Tester <ed.bartosh@linux.intel.com>
Reviewed-by: Eduard Bartosh <eduard.bartosh@intel.com>
11 years agoRemove usused changelog check for submission
Lin Yang [Mon, 8 Jul 2013 07:56:18 +0000 (15:56 +0800)]
Remove usused changelog check for submission

Change-Id: I4a6db3ba0ed21762a9b092573cac66e705d758f8
Signed-off-by: Lin Yang <lin.a.yang@intel.com>
Reviewed-on: https://otctools.jf.intel.com/review/5367

11 years agoMake prerelease project name shorter
Ed Bartosh [Sat, 6 Jul 2013 17:14:46 +0000 (20:14 +0300)]
Make prerelease project name shorter

Let's create prerelease projects under home:prerelease. This makes it
shorter and more logical as home:<username>:prerelease doesn't bring any
useful information to the name.

Note that jenkins jobs and obs plugin configuration have to be modified
accordingly.

Change-Id: Ibd4ba88dbf6def4353f7e8c0b0a63dfdc59467b9
Signed-off-by: Ed Bartosh <eduard.bartosh@intel.com>
11 years agoFix exceptions handle and cleanups
Lingchaox Xin [Mon, 8 Jul 2013 08:35:39 +0000 (16:35 +0800)]
Fix exceptions handle and cleanups

Change-Id: I5e3d2ca54f86928109144c6a1c6da44ea1299d5a

11 years agoFix multiply lines error
Lin Yang [Mon, 8 Jul 2013 06:37:50 +0000 (14:37 +0800)]
Fix multiply lines error

Change-Id: Ib6a2020442baa3b1eb3490bb98e9ef0cfde43907
Signed-off-by: Lin Yang <lin.a.yang@intel.com>
Signed-off-by: Lingchaox Xin <lingchaox.xin@intel.com>
11 years agoRemove unused policy check rule
Lin Yang [Mon, 8 Jul 2013 08:00:35 +0000 (16:00 +0800)]
Remove unused policy check rule

Remove following check:
1. Rpmlint check for specfile. Origin implementation is use local filter to
   check, later we will try to get result from OBS.
2. Check whether packaging dir and specfile exists. Because several projects do
   not need to submit OBS.
Current only check build result in OBS.

Change-Id: I0c79db86c4342b826141bfbd7f53596e261252f9
Signed-off-by: Lin Yang <lin.a.yang@intel.com>
11 years agoRemoved unused code from common/gerrit.py
Ed Bartosh [Sun, 7 Jul 2013 10:59:40 +0000 (13:59 +0300)]
Removed unused code from common/gerrit.py

Change-Id: I3b04b698a86a08635eb6cc39fa0ddfb826353ee5
Signed-off-by: Ed Bartosh <eduard.bartosh@intel.com>
11 years agoRemoved unused code from common/obspkg.py
Ed Bartosh [Sun, 7 Jul 2013 10:11:14 +0000 (13:11 +0300)]
Removed unused code from common/obspkg.py

Change-Id: I479ac2da104021bf9244f28deb69c55d90c852b1
Signed-off-by: Ed Bartosh <eduard.bartosh@intel.com>
11 years agoRemoved unused code from common/git.py
Ed Bartosh [Sun, 7 Jul 2013 10:36:24 +0000 (13:36 +0300)]
Removed unused code from common/git.py

Change-Id: I8489cf0b51e0254c1ee5a8fdcfd2e318836bf6ea
Signed-off-by: Ed Bartosh <eduard.bartosh@intel.com>
11 years agoRemoved unused code from job_policycheck.py
Ed Bartosh [Sun, 7 Jul 2013 10:24:32 +0000 (13:24 +0300)]
Removed unused code from job_policycheck.py

Change-Id: I559cccc7c12518f46daa8b76741a2e8cb7335be8
Signed-off-by: Ed Bartosh <eduard.bartosh@intel.com>
11 years agoRemoved unused code from common/buildservice.py
Ed Bartosh [Sun, 7 Jul 2013 10:56:08 +0000 (13:56 +0300)]
Removed unused code from common/buildservice.py

Change-Id: I431097c987b684c40167ebb22c4e0e6b240f76db
Signed-off-by: Ed Bartosh <eduard.bartosh@intel.com>
11 years agoRemoved unused code from common/mapping.py
Ed Bartosh [Sun, 7 Jul 2013 10:20:43 +0000 (13:20 +0300)]
Removed unused code from common/mapping.py

Change-Id: I279e7e878330133a1e4d404fbbf44043c68eabe2
Signed-off-by: Ed Bartosh <eduard.bartosh@intel.com>
11 years agoUsed get_prerelease_project_name API
Ed Bartosh [Sat, 6 Jul 2013 17:07:41 +0000 (20:07 +0300)]
Used get_prerelease_project_name API

Used get_prerelease_project_name in 2 places.
Moved it to common/prerelease.py

Change-Id: I24f45b3ae5d0dfa1f7875db4bf68475182e33570
Signed-off-by: Ed Bartosh <eduard.bartosh@intel.com>
11 years agoPylint for requests/mailer.py
Lingchaox Xin [Thu, 4 Jul 2013 02:48:39 +0000 (10:48 +0800)]
Pylint for requests/mailer.py

Change-Id: I9dd63af3776022f53bafb7590f0bb549907c8335

11 years agoDo NOT keep json backwards compatibility with Python 2.5
Lingchaox Xin [Wed, 3 Jul 2013 08:18:47 +0000 (16:18 +0800)]
Do NOT keep json backwards compatibility with Python 2.5

Change-Id: Ieb0e96aa79a9a3b2e91eb27ad269a2b8479f632c

11 years agoMove get_gerrit_event method to common/gerrit.py
Lingchaox Xin [Wed, 3 Jul 2013 08:11:22 +0000 (16:11 +0800)]
Move get_gerrit_event method to common/gerrit.py

No need to remain gerritevent module to keep get_gerrit_event method.

Change-Id: I76cb0419255e8bdcb495305b69594809ca15457d

11 years agoPylint for job_mail_sender.py
Lingchaox Xin [Tue, 2 Jul 2013 08:35:51 +0000 (16:35 +0800)]
Pylint for job_mail_sender.py

Remove base64 encoded judgement, thanks Ed's suggestion,
"it's better to ask for forgiveness than permission".

Change-Id: I8df8a40c55a9aace811f1c1ebabcb8ecf7a1316d

11 years agoFix multiple exceptions handle
Lingchaox Xin [Wed, 3 Jul 2013 06:28:15 +0000 (14:28 +0800)]
Fix multiple exceptions handle

Change-Id: I95483f488a7a1a6487c9a3c6cec95829eb9e19b9

11 years agoPylint for job_jobs_dispatcher.py
Lingchaox Xin [Tue, 2 Jul 2013 07:12:07 +0000 (15:12 +0800)]
Pylint for job_jobs_dispatcher.py

Change-Id: Iaa8150a9f03db2030549791823ccebef03979df8

11 years agoPylint for job_imager.py
Lingchaox Xin [Tue, 2 Jul 2013 06:50:36 +0000 (14:50 +0800)]
Pylint for job_imager.py

Change-Id: I0aab62dd84faa0c9b1426ab0cf9789afc24bedcc

11 years agoRevert Exception handle in 2c7ea4c
Lingchaox Xin [Mon, 1 Jul 2013 08:33:51 +0000 (16:33 +0800)]
Revert Exception handle in 2c7ea4c

Change-Id: I0f9f21abf483f47339bcf2d153b7f65e211e9db0

11 years agoPylint for job_request.py and cleanups
Lingchaox Xin [Mon, 1 Jul 2013 07:38:09 +0000 (15:38 +0800)]
Pylint for job_request.py and cleanups

Change-Id: Ia47b56ba66211374a4c3b145953155f45fdc54aa

11 years agoAdd more specific exception for backenddb Entity
Lin Yang [Mon, 1 Jul 2013 08:18:52 +0000 (16:18 +0800)]
Add more specific exception for backenddb Entity

Change-Id: Ie232a034c1fc753d3c07d83b4a612a51ac395890
Signed-off-by: Lin Yang <lin.a.yang@intel.com>
11 years agoAdapted for new git describe method in gbp
Lingchaox Xin [Mon, 1 Jul 2013 06:49:55 +0000 (14:49 +0800)]
Adapted for new git describe method in gbp

Change-Id: Ia7e4dbbb44dcfa0587c65f9d83d0c7ece280ecd4

11 years agoPylint for job_submitobs.py
Lingchaox Xin [Mon, 1 Jul 2013 02:17:06 +0000 (10:17 +0800)]
Pylint for job_submitobs.py

Change-Id: Ie15d2abe06bbfc65ae288ffbf5bdd1f5068be2e2

11 years agofix several errors to make prerelease process work again
Hasan Wan [Mon, 1 Jul 2013 07:11:44 +0000 (15:11 +0800)]
fix several errors to make prerelease process work again

Change-Id: I3b9ea88daf18f03cf4b257d82af9404dd76fdf0a
Signed-off-by: Hasan Wan <hasan.wan@intel.com>
11 years agoAvoid import whole gbp.rpm module
Lin Yang [Mon, 1 Jul 2013 03:00:31 +0000 (11:00 +0800)]
Avoid import whole gbp.rpm module

Change-Id: I5b5cf368f968690b93bff8c30f0428038f1e9e9f
Signed-off-by: Lin Yang <lin.a.yang@intel.com>
11 years agoCatch exception when git describe
Lin Yang [Mon, 1 Jul 2013 02:58:27 +0000 (10:58 +0800)]
Catch exception when git describe

Change-Id: I0c5b19348ae8b4a09f884929dd40aa129a6b3ebb
Signed-off-by: Lin Yang <lin.a.yang@intel.com>
11 years agoFix call get_obs_repo_map error
Lin Yang [Mon, 1 Jul 2013 04:18:46 +0000 (12:18 +0800)]
Fix call get_obs_repo_map error

Change-Id: I005c26b0d1af84d50419ebd6b6a2fdd37383bd67
Signed-off-by: Lin Yang <lin.a.yang@intel.com>
11 years agoRepomaker related codes cleanups
Lingchaox Xin [Fri, 28 Jun 2013 09:01:48 +0000 (17:01 +0800)]
Repomaker related codes cleanups

Change-Id: I4b8baceb14063997b1ca01246b5a650a8f10f6e7
Signed-off-by: Lingchaox Xin <lingchaox.xin@intel.com>
11 years agoFill obsrepomaps when reading repos.yaml
Ed Bartosh [Fri, 28 Jun 2013 12:17:25 +0000 (15:17 +0300)]
Fill obsrepomaps when reading repos.yaml

obsrepomaps is a mapping between OBS project name and repo name from
repos.yaml. This change implements filling mappings while parsing
repo.yaml in BackendDb::read_repos()

Fixes: #1031

Change-Id: I01efb4b1717e5971a83a1984dc2e3245244977d5
Signed-off-by: Ed Bartosh <eduard.bartosh@intel.com>
11 years agoBackendDB: Get rid of latest-snapshot field
Ed Bartosh [Fri, 28 Jun 2013 11:36:22 +0000 (14:36 +0300)]
BackendDB: Get rid of latest-snapshot field

All application-level fields should be filled in get_prerelease_data API.
Redis db now contains only data from repos.yaml. if something else is
needed on application level it should be handled in get_prerelease_data
or another application level API.

As latest-snapshot field is not used anywhere it doesn't need to
be moved to get_prerelease_data. So, removing it should be safe.

Change-Id: I442d2be43e8fd1b66a8e6e4e73288b421f0c0f7a
Signed-off-by: Ed Bartosh <eduard.bartosh@intel.com>
11 years agoImplemented BackendDB/get_releases API
Ed Bartosh [Fri, 28 Jun 2013 10:49:47 +0000 (13:49 +0300)]
Implemented BackendDB/get_releases API

This API should be used to get latest release for the product.

Fixes: #1027

Change-Id: Id05bf798557dccc60ebd5cd5c19a20b345e3c8e2
Signed-off-by: Ed Bartosh <eduard.bartosh@intel.com>
11 years agoadd new job to store repos.yaml to redis
Lin Yang [Fri, 28 Jun 2013 08:45:32 +0000 (16:45 +0800)]
add new job to store repos.yaml to redis

This job will monitor repos.yaml project maintained in gerrit, if anything
change, it will store this change to redis.

Change-Id: I0ed3bc7f4a2a83a9ef7a4ce53fbb8971de4a6e1e
Signed-off-by: Lin Yang <lin.a.yang@intel.com>
11 years agofix mistakes in job_pre_releas_obs
Hasan Wan [Fri, 28 Jun 2013 03:20:47 +0000 (11:20 +0800)]
fix mistakes in job_pre_releas_obs

Change-Id: I3a090b04471e2cb5360a89a967073d5cb1cc34e8
Signed-off-by: Hasan Wan <hasan.wan@intel.com>
11 years agoImplemented BackendDB/get_obs_repo_map API
Ed Bartosh [Thu, 27 Jun 2013 13:22:08 +0000 (16:22 +0300)]
Implemented BackendDB/get_obs_repo_map API

This API should be used to map OBS project to 'repo' value used in .ks
file for the repository from this OBS project.

Change-Id: I9047e31a9ab604a8d3f504077817c2c9618e1d7d

11 years agoSpec clean with spec-cleaner
Lingchaox Xin [Thu, 27 Jun 2013 01:42:01 +0000 (09:42 +0800)]
Spec clean with spec-cleaner

Maybe we should execute it when we change specfile each time to keep
a consistent style.

Change-Id: I28fb0b6a85f89ef95609c78a5a3d654428b54b83

11 years agoAdd python-Cheetah dependence
Lingchaox Xin [Thu, 27 Jun 2013 01:26:53 +0000 (09:26 +0800)]
Add python-Cheetah dependence

This patch should fix `unable to import Cheetah.Template` in
requests/mailer.py.

Change-Id: I72dd92be5203772d64753e276b19f0927b2c475c

11 years agoclean up group/patterns/buildconf files in repodata
Zhang Qiang [Fri, 31 May 2013 08:53:34 +0000 (16:53 +0800)]
clean up group/patterns/buildconf files in repodata

Change-Id: I49223221b477510a8d43386248df662eaaa6e71c

11 years agoput build conf file under repodata directory
Zhang Qiang [Fri, 31 May 2013 08:45:52 +0000 (16:45 +0800)]
put build conf file under repodata directory

Change-Id: I77444c09559eb244e200db5f74bd53e132df1580

11 years agocleanup should be called when SR end-of-life
Hasan Wan [Wed, 26 Jun 2013 03:23:18 +0000 (11:23 +0800)]
cleanup should be called when SR end-of-life

Change-Id: Ibbc123ee5c71513d07a6fbf62e0f108d751305fa
Signed-off-by: Hasan Wan <hasan.wan@intel.com>
11 years agoadapted to new trigger method
Hasan Wan [Wed, 26 Jun 2013 03:02:53 +0000 (11:02 +0800)]
adapted to new trigger method

Change-Id: Iaed4a53cf6896f956b326dc47580c5ac7e63603f
Signed-off-by: Hasan Wan <hasan.wan@intel.com>
11 years agomodify to fit obs event keyword change
Lin Yang [Wed, 26 Jun 2013 07:27:27 +0000 (15:27 +0800)]
modify to fit obs event keyword change

Change-Id: I0ea579bb83271c5f5ce99619ea0c5223ca6b4625
Signed-off-by: Lin Yang <lin.a.yang@intel.com>
11 years agoRemove common/errors.py, no need to keep it
Lingchaox Xin [Wed, 26 Jun 2013 03:07:48 +0000 (11:07 +0800)]
Remove common/errors.py, no need to keep it

Change-Id: Id0a8f8e8f6acd70625c15d4b88210a3b8c64cae6

11 years agoAdd blocked as a OBS active status
Lin Yang [Tue, 25 Jun 2013 08:35:40 +0000 (16:35 +0800)]
Add blocked as a OBS active status

OBS build status blocked means its dependency package is still building, in
this situation, it should continue to wait until next repo publish event.

Change-Id: I338a50a6cc7dc29ded3b9b0f07c3bcdc98006c6d
Signed-off-by: Lin Yang <lin.a.yang@intel.com>
11 years agoAdd buildcheck project name check
Lin Yang [Tue, 25 Jun 2013 08:29:11 +0000 (16:29 +0800)]
Add buildcheck project name check

Check whether this repo publish event is from build check project at the
beginning. If not, exit directly.

Change-Id: I9c5973a3b426f294ac7697e6ea76d8b4a3e013cf
Signed-off-by: Lin Yang <lin.a.yang@intel.com>
11 years agoPylint for common/gerrit.py
Lingchaox Xin [Thu, 20 Jun 2013 07:32:06 +0000 (15:32 +0800)]
Pylint for common/gerrit.py

Change-Id: I756344890766eafbbebe382f78a28f6418600471

11 years agoPylint for common/runner.py and cleanups
Lingchaox Xin [Thu, 20 Jun 2013 02:55:25 +0000 (10:55 +0800)]
Pylint for common/runner.py and cleanups

Change-Id: I384d50dc13c07f129e1e8f30bbd4691c671e7f1e

11 years agoPylint for common/repomaker.py
Lingchaox Xin [Thu, 20 Jun 2013 02:36:09 +0000 (10:36 +0800)]
Pylint for common/repomaker.py

In hashlib module, md5, sha256 ... are defined dynamically according to
Openssl library availability in order to use the fastest available
implementation, but pylint can NOT understand it, so diable it.

Change-Id: I5f43625fe87aa0971a9a109258b6529c2ab9857f

11 years agoFix self.describe method call in gbp.git.repository
Lingchaox Xin [Wed, 19 Jun 2013 09:04:59 +0000 (17:04 +0800)]
Fix self.describe method call in gbp.git.repository

A new method named describe appeared in gbp 36341dda, so use it instead
of using customed describe method.

Change-Id: Ie9cf5f8c61246f957789a102930e3b81cafac98d
Reported-by: Hao H Huang <hao.h.huang@intel.com>
Signed-off-by: Lingchaox Xin <lingchaox.xin@intel.com>
11 years agoFixed packaging
Ed Bartosh [Tue, 18 Jun 2013 16:51:46 +0000 (19:51 +0300)]
Fixed packaging

Fixed empty binary package
Changed versioning scheme

Change-Id: I01e0083e9c79c6d9784b5ba0197a598a94ee00cd
Signed-off-by: Ed Bartosh <eduard.bartosh@intel.com>
11 years agoPylint for common/imagedata.py
Lingchaox Xin [Wed, 19 Jun 2013 08:43:34 +0000 (16:43 +0800)]
Pylint for common/imagedata.py

Change-Id: I7203dd08ff9454c4f45bffa6d851377b7f38442f

11 years agoPylint for common/mapping.py
Lingchaox Xin [Tue, 18 Jun 2013 09:39:33 +0000 (17:39 +0800)]
Pylint for common/mapping.py

Change-Id: Ibbac7014c7c02daeb4f034a504e1b96587128b1c

11 years agoPylint for common/obspkg.py
Lingchaox Xin [Tue, 18 Jun 2013 06:22:44 +0000 (14:22 +0800)]
Pylint for common/obspkg.py

Use absolute import instead of relative import, replace `cmp` parameter
with `key` since the latter is faster.

Change-Id: I004dff6de87c17935e8bb6ec36a3426b94bdd4d6

11 years agoAdded support of complex data types to BackendDB
Ed Bartosh [Mon, 17 Jun 2013 12:50:53 +0000 (15:50 +0300)]
Added support of complex data types to BackendDB

It's implemented using json. When some key or list item or string is
marked as jsoned BackendDB will try to encode it to json before
storing in Redis and decode it when retriving.

Change-Id: Ifdba0453fa9bbef173cef301e587ded536c98be3
Signed-off-by: Ed Bartosh <eduard.bartosh@intel.com>
11 years agoPylint for job_obsevent_dispatcher.py
Lingchaox Xin [Mon, 17 Jun 2013 06:44:33 +0000 (14:44 +0800)]
Pylint for job_obsevent_dispatcher.py

Use pylint disable-msg=E1101 since sys.setdefaultencoding is special
and gets removed from the namespace.

In dict, `in` is not just pythonic but also in performance than `has_key`, e.g.:

$ python -mtimeit -s'd=dict.fromkeys(range(99))' '12 in d'
10000000 loops, best of 3: 0.0492 usec per loop
$ python -mtimeit -s'd=dict.fromkeys(range(99))' 'd.has_key(12)'
10000000 loops, best of 3: 0.0937 usec per loop

In addition, has_key() is deprecated in favor of key in d:

http://docs.python.org/2/library/stdtypes.html#dict.has_key

Change-Id: Ic8b087d99ff8557c0c7f6a786478c037be03f0cf
Signed-off-by: Lingchaox Xin <lingchaox.xin@intel.com>
11 years agoPylint for common/git.py
Lingchaox Xin [Fri, 14 Jun 2013 03:05:45 +0000 (11:05 +0800)]
Pylint for common/git.py

Change-Id: Ibcafeff673d52193c8a9e66ead89904211a49005

11 years agoPylint for common/utils.py
Lingchaox Xin [Fri, 14 Jun 2013 02:20:10 +0000 (10:20 +0800)]
Pylint for common/utils.py

Replace apply() with the extended call syntax:
function(*args, **keywords).

Fix no RuntimeException found error.

Change-Id: I6dbe96c23e982726d4ac0281cb2075288d5f24b9

11 years agoPylint for common/buildtrigger.py
Lingchaox Xin [Fri, 14 Jun 2013 01:19:05 +0000 (09:19 +0800)]
Pylint for common/buildtrigger.py

Change-Id: I0ae68ca260ad6397e96baca25d4968ea1224ce46

11 years agoPylint for common/buildservice.py and typo fixed
Lingchaox Xin [Fri, 14 Jun 2013 01:09:28 +0000 (09:09 +0800)]
Pylint for common/buildservice.py and typo fixed

Change-Id: I17568aec04f840765ea57146d838fbba2ad9073b

11 years agoRemove unused mysql lib
Lingchaox Xin [Fri, 14 Jun 2013 00:24:40 +0000 (08:24 +0800)]
Remove unused mysql lib

Change-Id: Id88cdb9fe96811142900b03796da23e9f988707d

11 years agoPylint for common/rpmlint.py
Lingchaox Xin [Thu, 13 Jun 2013 07:38:45 +0000 (15:38 +0800)]
Pylint for common/rpmlint.py

Change-Id: Ib69c6c20cc6db5191517e1c49e0e14a854b745e0

11 years agoPylint for common/tempbuildpkg.py
Lingchaox Xin [Thu, 13 Jun 2013 05:41:16 +0000 (13:41 +0800)]
Pylint for common/tempbuildpkg.py

Change-Id: I04695536c813585e54eee1a4b9ad998ddc37f050

11 years agoImplemented get_prerelease_data
Ed Bartosh [Sat, 8 Jun 2013 20:54:31 +0000 (23:54 +0300)]
Implemented get_prerelease_data

Collected all pre-release paths and url making in one place:
application level pre-release API get_prerelease_data. This function
returns all data, required by prerelease applications.

This function can be moved under common/ when there will be more than
one consumers of prerelease data.

Left only read_ and get_ methods in BackendDB as the rest of
functionality is implemented in get_prerelease_data.

Change-Id: I40a311f98d32002cdd10931baa80b75f9b2955de
Signed-off-by: Ed Bartosh <eduard.bartosh@intel.com>
11 years agoPylint for common/send_mail.py
Lingchaox Xin [Sun, 9 Jun 2013 03:17:07 +0000 (11:17 +0800)]
Pylint for common/send_mail.py

The various uppercase names were renamed in Python 2.5. The base email
package's __init__.py does some tricks to make the old names work in
python, but because pylint has its own separate method of doing imports,
those tricks don't work in pylint. So obey pylint.

Change-Id: If03641ae94e7f1da34a2593913f80c2e5bc7034a