tools/depanneur.git
11 years agoAdd packaging files
Zhang Qiang [Tue, 11 Sep 2012 06:07:54 +0000 (14:07 +0800)]
Add packaging files

$ cd packaging
$ make all

Change-Id: I804e7376f1ce740a241565ce16eda376a63b11f4

11 years agomove buildlog to avoid copying by mistake in next build
Zhang Qiang [Thu, 13 Sep 2012 13:12:19 +0000 (21:12 +0800)]
move buildlog to avoid copying by mistake in next build

For example:
run depannur to build ail succeeded, and the build log left in that
build root, next time run ail again, depanneur request root passwd
and user cancelled by Ctrl + C, then the build log for previous build
will be copied to fail dir by mistake.

Change-Id: Iff50f4a1378ba135c6763fc6f279bc689a6928ef

11 years agocheck and use scratch.incremental first
Zhang Qiang [Thu, 13 Sep 2012 08:55:01 +0000 (16:55 +0800)]
check and use scratch.incremental first

Without this patch, if scratch.incremental already exsit and
scratch.{arch}.0 exists too, depanneur still need to create new
scrach.incremental buildroot

Change-Id: I26855f36eada3216c9f7ea75efe2967b93ad1301

11 years agocall sudo -v with lock protect
Zhang Qiang [Thu, 13 Sep 2012 12:59:47 +0000 (20:59 +0800)]
call sudo -v with lock protect

Without this multiple thread workers may request passwd at the same
time, then depanneur will destroy current terminal or system.

Change-Id: I784a9474d8c182e4429085962f41b0f81149b890

11 years agoUse remote RPM to build if its dependency has expansion error
Zhang Qiang [Thu, 13 Sep 2012 12:46:49 +0000 (20:46 +0800)]
Use remote RPM to build if its dependency has expansion error

Without this patch, if one packages has expansion error, all packages
depend on it will be reportted as expansion error, even if it can be
built from remote repo.

Change-Id: I040467899e61c433896fcd640a4a225c78781d3a

11 years agoAdd missing $dist dir while reporting error log
Zhang Qiang [Wed, 12 Sep 2012 04:41:14 +0000 (12:41 +0800)]
Add missing $dist dir while reporting error log

Change-Id: Ibc75c9b7780ff1c680dea4c4b0c96d7a41cadced

11 years agoresolve deps before running scheduler #336
Zhang Qiang [Tue, 11 Sep 2012 07:59:50 +0000 (15:59 +0800)]
resolve deps before running scheduler #336

This is refinement about current scheduler to speed up resolve
dependency. Generate %pkgdeps, which is a map with key as pkgname,
and value is a list of dependencies. %pkgdeps can be used directly
by scheduler and don't need parse spec file everytime.

This patch also update %pkgdeps once local repo has been updated.

This also can fix #336, #337.

Change-Id: I6289a8df14d8cb027c6f6494efb4f45910d24fe2

11 years agoerror handle: return directly if specfile parse error, #335
Zhang Qiang [Tue, 11 Sep 2012 07:33:52 +0000 (15:33 +0800)]
error handle: return directly if specfile parse error, #335

Change-Id: Ic043076c25864ff5301db17f5e5475051c145fc4

11 years agoAdd --ccache option to speedup build using ccahe
Zhang Qiang [Tue, 11 Sep 2012 04:42:11 +0000 (12:42 +0800)]
Add --ccache option to speedup build using ccahe

Change-Id: I91f4cab5c13b715632b419b388063bacc92edbf0

11 years agoRefine scheduler to keep max threads running #269
Zhang Qiang [Sat, 8 Sep 2012 09:26:47 +0000 (17:26 +0800)]
Refine scheduler to keep max threads running #269

If there're free build threads idle, calculating new ready packages to
be built immediately. Don't need wait all candidate packages built finished.

Change-Id: Idc4c03f038de6215744024abdf5aa22ea3663e21

11 years agosort workers use the first idle thread to build packages
Zhang Qiang [Mon, 10 Sep 2012 22:44:35 +0000 (06:44 +0800)]
sort workers use the first idle thread to build packages

sort workers using keys to use the build worker with smallest
id. Without this patch build worker use order is 1,3,0,2,...
but it should be 0,1,2,3,...

This is necessary to make gbs back compatible while building single
package.

Change-Id: Ief248542194d697535387753a13200b426b8fcb6

11 years agoIgnore exclude packages in parsing phrase
Zhang Qiang [Sat, 8 Sep 2012 05:44:40 +0000 (13:44 +0800)]
Ignore exclude packages in parsing phrase

skip exclude packages while parsing packs, and don't need care about
exclude packages in build scheduler, and make scheduler more clear.

Change-Id: I02be218bf0c329d6953feea5b61759dd5e0c2a3d

11 years agoadd --extra-packs option to add install additinal packs to build root
Zhang Qiang [Mon, 10 Sep 2012 13:00:18 +0000 (21:00 +0800)]
add --extra-packs option to add install additinal packs to build root

This is very usefull for developer to create full build env, including
many dev tools, such as vim,zypper,gdb, ect.

Change-Id: Ie4032e9525bc3f1b91cda2921103008bbff40119

11 years agoremove export cache if gbs export fails
Zhang Qiang [Mon, 10 Sep 2012 06:32:22 +0000 (14:32 +0800)]
remove export cache if gbs export fails

Change-Id: I48264a6bac288c5de3ca3e4a548f14e0ad532338

11 years agoAdd --clean option if build root is not ready
Zhang Qiang [Fri, 7 Sep 2012 11:37:45 +0000 (19:37 +0800)]
Add --clean option if build root is not ready

Change-Id: Ibf2347a1f7ddb8d6f713014f17428ad1e93fe8a1

11 years agoreturn 0, instead of 1 while incremental build finished
Zhang Qiang [Wed, 5 Sep 2012 02:44:33 +0000 (10:44 +0800)]
return 0, instead of 1 while incremental build finished

Change-Id: I05bffaad99293f5b0ece63aac0c1b9e20e2f4418

11 years agoremove --turbo option
Zhang Qiang [Thu, 30 Aug 2012 09:44:24 +0000 (17:44 +0800)]
remove --turbo option

download repodata code has been move out of scheduler loop and
createrepomddeps can reuse local repodata cache, so this option is
useless now.

Change-Id: I194c8329acd3016953c9e7aa4bc25ded39299d96

11 years agoGive error and exit if no packages found
Zhang Qiang [Thu, 30 Aug 2012 09:34:15 +0000 (17:34 +0800)]
Give error and exit if no packages found

Change-Id: I084324a5b202dd6688cf932c121edcfacdbece92

11 years agoshare cached repodata between depanneur and build, #291
Zhang Qiang [Thu, 30 Aug 2012 01:55:39 +0000 (09:55 +0800)]
share cached repodata between depanneur and build, #291

Change-Id: If6a114faaa3e9eeacc4e0b2c40db5b9b1506a0e9

11 years agoFixed typo
Anas Nashif [Wed, 29 Aug 2012 16:18:15 +0000 (09:18 -0700)]
Fixed typo

Change-Id: If770918f2de99959a9e416d01ba8c2bce032b9c5

11 years agoadd --include-all and --commit option for gbs export use.
Zhang Qiang [Wed, 29 Aug 2012 07:32:25 +0000 (15:32 +0800)]
add --include-all and --commit option for gbs export use.

generally --include-all and --commit options are used to build
single package. if build multiple packages, --commit is not available.

Change-Id: I7b13257f458bedc6b3313bb70fb0ab7d644f7d8c

11 years agoAdjust the output information to make it unified with gbs
Zhang Qiang [Wed, 29 Aug 2012 07:28:34 +0000 (15:28 +0800)]
Adjust the output information to make it unified with gbs

Feature#287

Change-Id: Iff17ff59112c8ad3bc0af41070146fd035a5fcb9

11 years agomore code optimizations
Zhang Qiang [Wed, 29 Aug 2012 07:19:16 +0000 (15:19 +0800)]
more code optimizations

1) move creating repo cache code out from scheduler loop, and repo
cache should be generated before using it, or --binary will fail
to find repo cache file.
2) move finding skipped list packages out of sched loop

Change-Id: I5278d8183b5a635c41ac3176c1a09420c8617ff0

11 years agoMerge branch 'typo' into devel
Anas Nashif [Tue, 28 Aug 2012 18:14:04 +0000 (11:14 -0700)]
Merge branch 'typo' into devel

11 years agoadd --configdir option
Zhang Qiang [Tue, 28 Aug 2012 12:20:43 +0000 (20:20 +0800)]
add --configdir option

Change-Id: I8980723c68088640170264f92d6efbc2b6f9d79e

11 years agouse --repository instead of --rpms
Zhang Qiang [Fri, 24 Aug 2012 02:33:35 +0000 (10:33 +0800)]
use --repository instead of --rpms

always set local repo dir as the first repo, so that build can using
local packages as higher priority to create build root.

Change-Id: Idde5ef5fdb0fdbd16ac53724484eb136782778ad

11 years agoadd --repository option
Zhang Qiang [Mon, 27 Aug 2012 02:58:34 +0000 (10:58 +0800)]
add --repository option

If --repository specified, repos in conf would be skipped.

Change-Id: I527ebdc870d1c87397e581581d944f92ca65025a

11 years agofixed typos
Anas Nashif [Wed, 15 Aug 2012 04:42:02 +0000 (21:42 -0700)]
fixed typos

Change-Id: Ibaa5a087b2210aaed5da8e37adb9e38280b3d419

11 years agoremove unused file
Anas Nashif [Tue, 7 Aug 2012 16:18:55 +0000 (17:18 +0100)]
remove unused file

Change-Id: I0c94b971f38ef8214072a8681a547a1e84f2ff33

11 years agoadd debugging, touch repos
Anas Nashif [Tue, 7 Aug 2012 14:34:36 +0000 (15:34 +0100)]
add debugging, touch repos

Change-Id: I4ed0883810eead616638b774889aaa0fb99d6974

11 years agohandle exclusivearch correctly
Anas Nashif [Sun, 5 Aug 2012 17:46:58 +0000 (18:46 +0100)]
handle exclusivearch correctly

Change-Id: I0a6ecc51c6179f0cc6467550d0723a7d15ef7876

11 years agoconstruct build command using array
Anas Nashif [Sun, 5 Aug 2012 00:42:22 +0000 (01:42 +0100)]
construct build  command using array

- construct build command for various scenarios using array
- added turbu commad to skip repo parsing step,
  useful with incremental builds

Change-Id: I02ebf558b4088d393ac8c0c1ab97576fc0ad616e

11 years agoremove unused options, add help
Anas Nashif [Fri, 3 Aug 2012 00:56:24 +0000 (01:56 +0100)]
remove unused options, add help

Change-Id: I9ed337d3b1732303bf915c7cca9fb35987da6dfe

11 years agoremove unused options, add help
Anas Nashif [Fri, 3 Aug 2012 00:50:05 +0000 (01:50 +0100)]
remove unused options, add help

Change-Id: I73e2961ae358763f59669d3713e6c167827f2016

11 years agodo cross compiling for arm
Anas Nashif [Thu, 2 Aug 2012 09:36:28 +0000 (10:36 +0100)]
do cross compiling for arm

Change-Id: Ibeb843614e5f3ffc508b311d77880fbc0fb37256

11 years agofirst attempt to build arm packages
Anas Nashif [Thu, 2 Aug 2012 00:18:53 +0000 (01:18 +0100)]
first attempt to build arm packages

Change-Id: Ib2b190c711281b44744d6f7298f596d102f7a1cd

12 years agofixed mount path
Anas Nashif [Thu, 26 Jul 2012 21:34:28 +0000 (22:34 +0100)]
fixed mount path

Change-Id: Ie5f8504c908a8f14e7e1d86eb494558f51c894f1

12 years agofix deps for images
Anas Nashif [Wed, 25 Jul 2012 22:33:28 +0000 (23:33 +0100)]
fix deps for images

Change-Id: I1651d6ce0b53e46f4f7a7564e1d347aebe75846e

12 years agoremove external scripts
Anas Nashif [Wed, 25 Jul 2012 14:54:08 +0000 (15:54 +0100)]
remove external scripts

Change-Id: I406f5f6392b00d4c74bd21381561c6eb66452d01

12 years agomore optimizations
Anas Nashif [Wed, 25 Jul 2012 14:52:08 +0000 (15:52 +0100)]
more optimizations

Change-Id: Id616ffb9e30e92f82a91d0d57b8aada5053f8902

12 years agomore cleanup
Anas Nashif [Tue, 24 Jul 2012 17:15:47 +0000 (18:15 +0100)]
more cleanup

Change-Id: I5c6331040d6e2d80ff8e7d7a519c5ca456e71f4b

12 years agoand more cleanup
Anas Nashif [Tue, 24 Jul 2012 15:52:40 +0000 (16:52 +0100)]
and more cleanup

Change-Id: I80a2637458b240b3a3c65badd198b4675dc0e682

12 years agoimage dep calculation
Anas Nashif [Tue, 24 Jul 2012 03:49:01 +0000 (04:49 +0100)]
image dep calculation

Change-Id: I2e5b78e7118a2a2d55d33b56cf4a48c8475567ed

12 years agomove dep code into sub
Anas Nashif [Tue, 24 Jul 2012 02:31:24 +0000 (03:31 +0100)]
move dep code into sub

Change-Id: Ib9c812adb02bc0c0f09294391285931283b3593e

12 years agomore cleanup
Anas Nashif [Tue, 24 Jul 2012 02:10:14 +0000 (03:10 +0100)]
more cleanup

Change-Id: I935e19da8bcdca5ff0efe5cbd191822da2157f70

12 years agocleanup
Anas Nashif [Tue, 24 Jul 2012 01:31:48 +0000 (02:31 +0100)]
cleanup

Change-Id: I84cb61a4549f9e9f550e1efc3a57db86b13150d3

12 years agoremove hardcoded arches
Anas Nashif [Tue, 24 Jul 2012 00:47:57 +0000 (01:47 +0100)]
remove hardcoded arches

Change-Id: I6f3a8fa786d1e3241e1d7a1d2d78ce1444f4d3a5

12 years agoimplement incremental build
Anas Nashif [Mon, 23 Jul 2012 23:48:16 +0000 (00:48 +0100)]
implement incremental build

Change-Id: I87f8310a6f582e5d41de84e28a89d8aebabacc18

12 years agobuild with short-circuit
Anas Nashif [Mon, 23 Jul 2012 21:23:37 +0000 (22:23 +0100)]
build with short-circuit

Change-Id: I8fb1bbfa38f97626d3906e058c9f92beaa68a53f

12 years agoincremental option
Anas Nashif [Mon, 23 Jul 2012 21:22:23 +0000 (22:22 +0100)]
incremental option

Change-Id: I27a6ccb34075cc82b33b6874d28570827de6294d

12 years agoimprove dependency calculation
Anas Nashif [Mon, 23 Jul 2012 20:11:58 +0000 (21:11 +0100)]
improve dependency calculation

Change-Id: I1a688a31a0be801086bcc4438ee886aa5511a42e

12 years agobetter dep resolver
Anas Nashif [Mon, 23 Jul 2012 19:29:41 +0000 (20:29 +0100)]
better dep resolver

Change-Id: Id14236857dfef28e524b3ddeb7259383f7ef8f7e

12 years agobetter dep resolver
Anas Nashif [Mon, 23 Jul 2012 19:28:49 +0000 (20:28 +0100)]
better dep resolver

Change-Id: I14d59d9b73f6a8be3bb0269b04a238b4c8fd2227

12 years agobuild using uid/gid of user
Anas Nashif [Mon, 23 Jul 2012 17:24:22 +0000 (18:24 +0100)]
build using uid/gid of user

Change-Id: Ieb3740ab48a8e4f6e48c1ad718d161f7a59d3887

12 years agoclose open file
Anas Nashif [Mon, 23 Jul 2012 10:08:24 +0000 (11:08 +0100)]
close open file

Change-Id: Id93fa6feb052a089aca5084de2f6f3fc9fc7972e

12 years agobetter dependency matching
Anas Nashif [Mon, 23 Jul 2012 08:29:28 +0000 (09:29 +0100)]
better dependency matching

Change-Id: If75b4fd78599eb82e88dbe4e4cc0eef3d9054af9

12 years agohandle uncommitted changes
Anas Nashif [Mon, 23 Jul 2012 07:55:11 +0000 (08:55 +0100)]
handle uncommitted changes

Change-Id: I00fc4b4d5eb08a6e9a4bfc456836bdffa46796b1

12 years agohandle uncommitted changes
Anas Nashif [Mon, 23 Jul 2012 07:54:58 +0000 (08:54 +0100)]
handle uncommitted changes

Change-Id: Ib5ef09f53cd027331b43c8cf048cc89335fa87e9

12 years agobuild individual packages
Anas Nashif [Sun, 22 Jul 2012 16:01:16 +0000 (17:01 +0100)]
build individual packages

Change-Id: Ifbfd76cef3c75a7b74e2c3e16a7200176861179f

12 years agodefault style is git
Anas Nashif [Sun, 22 Jul 2012 03:13:01 +0000 (04:13 +0100)]
default style is git

Change-Id: I81c4ef841c0d9bfc8aacf472c51dfc2ae30a88ff

12 years agomore dependency improvements
Anas Nashif [Fri, 20 Jul 2012 14:40:05 +0000 (15:40 +0100)]
more dependency improvements

Change-Id: I09d183202010ca357f41873a52a5e22d67a226df

12 years agomore dependency improvements
Anas Nashif [Fri, 20 Jul 2012 14:28:06 +0000 (15:28 +0100)]
more dependency improvements

Change-Id: I0179db9ff52281c79fc822b3727f8d2dbcf867b7

12 years agosome verbosity
Anas Nashif [Tue, 26 Jun 2012 21:02:22 +0000 (17:02 -0400)]
some verbosity

12 years agouse yaml config file for repos
Anas Nashif [Tue, 26 Jun 2012 11:01:35 +0000 (12:01 +0100)]
use yaml config file for repos

12 years agoNew way for generating tarballs from git
Anas Nashif [Thu, 31 May 2012 11:10:42 +0000 (12:10 +0100)]
New way for generating tarballs from git

12 years agoenhanced builds from git
Anas Nashif [Thu, 24 May 2012 13:00:25 +0000 (14:00 +0100)]
enhanced builds from git

12 years agoadd more debugging
Anas Nashif [Tue, 22 May 2012 23:15:43 +0000 (00:15 +0100)]
add more debugging

12 years agoerror out instead od dying
Anas Nashif [Tue, 22 May 2012 18:09:49 +0000 (19:09 +0100)]
error out instead od dying

12 years agodebug messages
Anas Nashif [Wed, 16 May 2012 10:01:16 +0000 (11:01 +0100)]
debug messages

12 years agomanage variables
Anas Nashif [Tue, 15 May 2012 11:57:52 +0000 (12:57 +0100)]
manage variables

12 years agocoloring messages
Anas Nashif [Tue, 15 May 2012 11:00:16 +0000 (12:00 +0100)]
coloring messages

12 years agoadd threading support
Anas Nashif [Mon, 14 May 2012 23:36:15 +0000 (00:36 +0100)]
add threading support

12 years agodebugging
Anas Nashif [Mon, 14 May 2012 14:10:34 +0000 (15:10 +0100)]
debugging

12 years agocleanup
Anas Nashif [Wed, 9 May 2012 07:24:00 +0000 (08:24 +0100)]
cleanup

12 years agocleanup
Anas Nashif [Wed, 9 May 2012 05:35:13 +0000 (06:35 +0100)]
cleanup

12 years agofixed path to spec when spec is given as package name
Anas Nashif [Tue, 8 May 2012 21:21:44 +0000 (22:21 +0100)]
fixed path to spec when spec is given as package name

12 years agocleanup
Anas Nashif [Tue, 8 May 2012 03:41:27 +0000 (04:41 +0100)]
cleanup

12 years agocreate groups
Anas Nashif [Sat, 5 May 2012 22:14:26 +0000 (23:14 +0100)]
create groups

12 years agoimage support
Anas Nashif [Fri, 4 May 2012 17:07:54 +0000 (18:07 +0100)]
image support

12 years agosupport images
Anas Nashif [Fri, 4 May 2012 10:47:15 +0000 (11:47 +0100)]
support images

12 years agooptimize
Anas Nashif [Thu, 3 May 2012 15:18:12 +0000 (16:18 +0100)]
optimize

12 years agoincremental enhancements
Anas Nashif [Wed, 2 May 2012 18:06:41 +0000 (19:06 +0100)]
incremental enhancements

12 years agoadd --build-all option
Anas Nashif [Tue, 1 May 2012 22:46:42 +0000 (23:46 +0100)]
add --build-all option

12 years agoinstall command correctly
Anas Nashif [Tue, 1 May 2012 22:37:41 +0000 (23:37 +0100)]
install command correctly

12 years agogo through git repos
Anas Nashif [Tue, 1 May 2012 18:04:27 +0000 (19:04 +0100)]
go through git repos

12 years agocleanup path and fix directories
Anas Nashif [Tue, 1 May 2012 14:59:41 +0000 (15:59 +0100)]
cleanup path and fix directories

12 years agocleanup path and fix directories
Anas Nashif [Tue, 1 May 2012 13:28:11 +0000 (14:28 +0100)]
cleanup path and fix directories

12 years agocleanup
Anas Nashif [Tue, 1 May 2012 13:22:17 +0000 (14:22 +0100)]
cleanup

12 years agocleanup
Anas Nashif [Tue, 1 May 2012 13:20:18 +0000 (14:20 +0100)]
cleanup

12 years agoinitialize
Anas Nashif [Thu, 26 Apr 2012 10:42:02 +0000 (11:42 +0100)]
initialize