tools/mic.git
9 years agobump up to 0.27 45/38845/2
Lihong Sun [Wed, 29 Apr 2015 09:16:08 +0000 (05:16 -0400)]
bump up to 0.27

Change-Id: Iee735c8320ee6f38e13c9c3ec8711a1695d112f3

9 years agoUpdate tar command option 63/38163/1
Lihong Sun [Thu, 11 Dec 2014 06:56:25 +0000 (01:56 -0500)]
Update tar command option

List whole files to the tar command instead of giving a dir

Change-Id: I1916924eaf63876c9d4fe0bcfa64f4f8e142a42e

9 years agoDrop mic native support 45/37345/5
Lihong Sun [Wed, 25 Mar 2015 02:53:24 +0000 (22:53 -0400)]
Drop mic native support

mic option --runtime=native has been broken for more than one year,
maintain this mode requires more effort for new distribution support,
so drop this mode without risk.

Fixes: #DEVT-248

Change-Id: Iaee916889fabfe62f6a507781f9ca1c3d01ee5a2

9 years agoMount option is modified to be more general 43/31243/5
Gyeoungmin Kim [Wed, 3 Dec 2014 05:43:52 +0000 (14:43 +0900)]
Mount option is modified to be more general
Supporting for using command line tools as toybox, busybox.

Fixes: #2359

Change-Id: I3b5935609d83601900f03c978e48e95490559143
Signed-off-by: Gyeoungmin Kim <g5.kim@samsung.com>
9 years agoPut log file in 'release' output always.
Lihong [Tue, 11 Nov 2014 03:26:44 +0000 (22:26 -0500)]
Put log file in 'release' output always.

When image creation failed, log created by '--release' will be
located under 'outdir' instead of 'release_dir'. Also put the
log file under 'release_dir' when image creation failed.

mic-appliance create images through executing '/etc/init.d/mic'
script in the appliance. 'time mic cr auto $extra /media/out/$ks'
is called, and '--release' option is used when creating images.

In the past, 3 points about the logfile created by '--release':
1. Create logfile in default 'out_dir' which is specified in
'/etc/mic/mic.conf'. 2. Before creating images, check whether the
'release_dir' exists, if it exists, remove the whole directory. 3.
After the image creation finished, copy the logfile to the final
'release_dir' where the images located. So when the image creation
failed, no logfile found in 'release_dir', the logfile is under default
'out_dir'.

If directly change the 'out_dir' to 'dest_dir' in conf.py, the image
creation will fail if there already exist a same 'release_dir', because
this existed 'release_dir' will be removed when creating images, but the
logfile use this dir at the time, so it cannot be removed, then mic will
fail and exit. So right now, if 'release_dir' already existed, just remove
the files under it except the newly created logfile, and remain the dir.

Fixes: #2212

Change-Id: Ibdc9af3d0e03ca966517d05b1e519d4d9fb3ad43

9 years agoAdd copyright to files that miss copyright
Lihong Sun [Fri, 12 Dec 2014 05:45:00 +0000 (00:45 -0500)]
Add copyright to files that miss copyright

Fixes: #2250

Change-Id: I4e1fa970229b460053671c325ba469a542f83806

9 years agoUpdata manual page in /doc 19/29519/3
Gyeoungmin.kim [Thu, 6 Nov 2014 05:41:01 +0000 (14:41 +0900)]
Updata manual page in /doc

Change-Id: I7144355d94a6c4b02a6d9fe47178c8bdd38d6691
Signed-off-by: Gyeoungmin.kim <g5.kim@samsung.com>
Signed-off-by: Lihong Sun <lihongx.sun@intel.com>
10 years agoFix syslinux installation path issue in Arch Linux
Junchun Guan [Thu, 23 Oct 2014 03:27:57 +0000 (11:27 +0800)]
Fix syslinux installation path issue in Arch Linux

isolinux.bin and mbr.bin is installed to /usr/lib/syslinux/bios in arch linux

Change-Id: Iaa737b7fb277b5b7dee0ebb97a2523722f60e65d
Signed-off-by: Junchun Guan <junchunx.guan@intel.com>
10 years agobump up to release 0.26 release-0.26 0.26
Gui Chen [Tue, 14 Oct 2014 22:58:08 +0000 (22:58 +0000)]
bump up to release 0.26

Change-Id: Ic291b2c7fbe8c09a1bdf341d35740f9f639cc5cf
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agobump up to 0.26 rc1
Gui Chen [Tue, 14 Oct 2014 04:26:07 +0000 (04:26 +0000)]
bump up to 0.26 rc1

Change-Id: I47f65df512e74b7ba82efcaf0b81b75f9795bcea
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agoadd mipsel register on binfmt_misc
Gui Chen [Tue, 14 Oct 2014 02:23:14 +0000 (02:23 +0000)]
add mipsel register on binfmt_misc

Change-Id: I15de4df594dec507344db2069723a2fec88c9e38
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agoAdd support of qemu-mipsel 67/24867/2
Andrii Boichuk [Thu, 22 May 2014 07:27:31 +0000 (10:27 +0300)]
Add support of qemu-mipsel

Change-Id: I18e694d820fd8523cf2f0e1a8f98e0dd1b642926

10 years agoAdded mipsel support 66/24866/2
Andrii.Boichuk [Wed, 14 May 2014 06:18:01 +0000 (09:18 +0300)]
Added mipsel support

Change-Id: Ie7704cc6fbc5ead62cb9ff4437b97966dbd796f2

10 years agoadd qcow image support
Gui Chen [Mon, 29 Sep 2014 03:50:20 +0000 (03:50 +0000)]
add qcow image support

Change-Id: I5d357a162b2227beaff35f4a5ef913d36a2a6972
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agochange __imgdir to protect member
Gui Chen [Mon, 29 Sep 2014 04:59:59 +0000 (04:59 +0000)]
change __imgdir to protect member

Change-Id: I2da8fc9d549374877f00c51924df4f7d0425d2c7
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agoAdd 'ValueError' exception.
lihongsx [Thu, 28 Aug 2014 09:42:45 +0000 (17:42 +0800)]
Add 'ValueError' exception.

Change-Id: I22021ebea6bd2db34150c15f588289c18929d63a

10 years agoAdd 'get_VcsInfo' function part to yumpkgmgr.py
lihongsx [Tue, 26 Aug 2014 06:54:17 +0000 (14:54 +0800)]
Add 'get_VcsInfo' function part to yumpkgmgr.py

Fixes: #2081

Change-Id: Id780d02d38cbfccf6d4bb6e9eb37d709db0dd336

10 years agofix static qemu-arm failed issue
Gui Chen [Mon, 18 Aug 2014 03:31:20 +0000 (23:31 -0400)]
fix static qemu-arm failed issue

Change-Id: I44a2c69f4292306405857a0b8545d231f2b635f3
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agoMerge "copy the real device mapper" into devel
Gui Chen [Fri, 15 Aug 2014 06:01:54 +0000 (09:01 +0300)]
Merge "copy the real device mapper" into devel

10 years agoMerge "add real path of device mapper to partition dict" into devel
Gui Chen [Fri, 15 Aug 2014 06:01:41 +0000 (09:01 +0300)]
Merge "add real path of device mapper to partition dict" into devel

10 years agoCheck whether '/usr/bin/qemu-aarch64' exist.
lihongsx [Wed, 13 Aug 2014 11:34:16 +0000 (19:34 +0800)]
Check whether '/usr/bin/qemu-aarch64' exist.

Change-Id: I3d15f5ee386802c23e438e453aedfdace72739d5

10 years agocopy the real device mapper
Gui Chen [Wed, 13 Aug 2014 08:25:32 +0000 (04:25 -0400)]
copy the real device mapper

some operation like initrd creation need the real device actually,
so copy it into _instroot as well

Change-Id: Id45680bc2407bfc9e07e90753b9696bb1066db12
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agoadd real path of device mapper to partition dict
Gui Chen [Wed, 13 Aug 2014 08:19:36 +0000 (04:19 -0400)]
add real path of device mapper to partition dict

actually /dev/mapper/loop0p1 is symbol link in some distros,
so add its real path to dict

Change-Id: I2c9655e61e8878c3bbf5ea134f28996df1c6d78a
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agoaarch64: use qemu-aarch64 instead qemu-arm64
Chanho Park [Fri, 27 Jun 2014 05:28:50 +0000 (14:28 +0900)]
aarch64: use qemu-aarch64 instead qemu-arm64

In qemu version 2.0, we use qemu-aarch64 instead of qemu-arm64. Thus,
this mic script should be changed to use correct qemu path of arm64
platform.

Change-Id: I3d910511cbece0cafdfb72f7846cbdadcd6c1f2d
Signed-off-by: Chanho Park <chanho61.park@samsung.com>
10 years agoAdd 'python-xml' dependency of mic
lihongsx [Tue, 5 Aug 2014 02:38:37 +0000 (10:38 +0800)]
Add 'python-xml' dependency of mic

Fixes: #2028

Change-Id: Ib8eec98150115bb4b36e7226d1cfa91e29de682c

10 years agoAdd sha1sum and sha256sum
lihongsx [Mon, 4 Aug 2014 15:23:47 +0000 (23:23 +0800)]
Add sha1sum and sha256sum

Fixes: #1956

Change-Id: I9eca40309e4a7eabb1cbc46424266312b3f2b10c

10 years agoadd strict-mode feature for zypp backend
Gui Chen [Tue, 5 Aug 2014 07:01:31 +0000 (03:01 -0400)]
add strict-mode feature for zypp backend

Fixes: #2056

Change-Id: I4858a52364189d5985c90b4bc6a0d435507be758
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agoadd strict_mode(MHA-1115)
Andrii Boichuk [Wed, 23 Jul 2014 13:35:36 +0000 (16:35 +0300)]
add strict_mode(MHA-1115)

10 years agoEnable ssl_veirify option in mic config file
Huanhuan Li [Mon, 14 Jul 2014 02:45:12 +0000 (10:45 +0800)]
Enable ssl_veirify option in mic config file

There is an option 'ssl_veirfy=no' in mic.conf, but it is commented. Now enable
this feature.

Fixes: #2017
Change-Id: I92c98cfd7a399bed4d5e955681e857ea7990ad8d

10 years agofix md5sum format able to check by 'md5sum -c'
Gui Chen [Mon, 9 Jun 2014 03:11:19 +0000 (23:11 -0400)]
fix md5sum format able to check by 'md5sum -c'

use two spaces instead of ' *' as seprator in MD5SUM

Change-Id: I0f37c3366d9e0c44c82b74c78d49a9647ce477ad
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agofix Package_constPtr AttributeError: status
Gui Chen [Mon, 9 Jun 2014 02:33:48 +0000 (22:33 -0400)]
fix Package_constPtr AttributeError: status

actually the modified 'item' should be PoolItem, which has 'status',
instead of Package

Change-Id: Ib29bc770281a5d32773a2165c65cc6c4431cb51b
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agotypo fix
Huanhuan Li [Fri, 6 Jun 2014 01:23:50 +0000 (09:23 +0800)]
typo fix

Change-Id: Id451840526902cbca9e5dd6a4cd0b730bb2bebfa

10 years agoMerge branch 'release-0.25' into devel
Gui Chen [Thu, 29 May 2014 10:21:31 +0000 (06:21 -0400)]
Merge branch 'release-0.25' into devel

Signed-off-by: Gui Chen <gui.chen@intel.com>
Conflicts:
debian/changelog

Change-Id: Ia1ff5d0d0ae4ced64cffd3547bee0ffd02fb3976

10 years agobump up to 0.25.1 0.25.1
Gui Chen [Wed, 28 May 2014 10:15:05 +0000 (06:15 -0400)]
bump up to 0.25.1

Change-Id: Iafafcc2d03f58881d9907003c61c72f102e91845
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agoadd requires for cElementTree module
Gui Chen [Wed, 28 May 2014 05:42:44 +0000 (01:42 -0400)]
add requires for cElementTree module

Change-Id: Id0a92e7a68677c1ab51b13401a6befb6a2b72f7a
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agoRevert "Add config file path to 'bindmount' list"
Gui Chen [Wed, 28 May 2014 02:37:09 +0000 (22:37 -0400)]
Revert "Add config file path to 'bindmount' list"

This reverts commit 2f2b3e972600db0562855d63a67d4a808eaf208c.

10 years agoAdd unitest for mic/archive.py
Huanhuan Li [Thu, 24 Apr 2014 09:54:15 +0000 (17:54 +0800)]
Add unitest for mic/archive.py

Change-Id: Ic75ef5a31a5b935958de7eaa3f2995dfdaad86ef

10 years agobump up to release 0.25
Gui Chen [Thu, 22 May 2014 12:29:28 +0000 (08:29 -0400)]
bump up to release 0.25

Change-Id: I9dfe1537173e9521d04ac06e98316fed28f407e4
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agobump up to release 0.25 0.25
Gui Chen [Thu, 22 May 2014 12:29:28 +0000 (08:29 -0400)]
bump up to release 0.25

Change-Id: I9dfe1537173e9521d04ac06e98316fed28f407e4
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agobump up to 0.25-rc1
Gui Chen [Wed, 21 May 2014 05:47:38 +0000 (01:47 -0400)]
bump up to 0.25-rc1

Change-Id: Ie870a858727935eb6de19a6b6494c471de66e2a0
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agoMake the error more precise
Huanhuan Li [Wed, 21 May 2014 02:43:18 +0000 (10:43 +0800)]
Make the error more precise

Change-Id: I11879de8063534eb5a59b80edbfcd9a73aefdc5d

10 years agoMerge "remove --preserve-order option in tar fs image" into devel
Gui Chen [Mon, 19 May 2014 10:58:03 +0000 (13:58 +0300)]
Merge "remove --preserve-order option in tar fs image" into devel

10 years agoremove --preserve-order option in tar fs image
Gui Chen [Mon, 19 May 2014 06:45:32 +0000 (02:45 -0400)]
remove --preserve-order option in tar fs image

Change-Id: Ib510143290f49c1b791424201401085368b9d1bb
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agoMerge "put logfile setting up prior to other error output" into devel
Gui Chen [Mon, 19 May 2014 06:54:58 +0000 (09:54 +0300)]
Merge "put logfile setting up prior to other error output" into devel

10 years agoFix pylint tips
Huanhuan Li [Mon, 21 Apr 2014 05:52:27 +0000 (13:52 +0800)]
Fix pylint tips

Change-Id: Id323538fd9bb643bdf4d5f94e77f7578eb85f14e
C:  1,0: Missing docstring
E: 19,0: No name '__version__' in module 'mic'
E: 20,0: No name 'utils' in module 'mic'
E: 21,0: No name 'conf' in module 'mic'
E: 22,0: No name 'plugin' in module 'mic'
W:101,14:MicCmd.help_create: Access to a protected member _help_reindent of a client class
W:102,14:MicCmd.help_create: Access to a protected member _help_preprocess of a client class
R: 94,4:MicCmd.help_create: Method could be a function
C:108,4:MicCmd.do_create: Missing docstring
R:108,4:MicCmd.do_create: Method could be a function
C:112,4:MicCmd._root_confirm: Missing docstring
R:112,4:MicCmd._root_confirm: Method could be a function
R:120,4:MicCmd.do_convert: Too many local variables (16/15)
E:148,8:MicCmd.do_convert: Instance of 'ConfigMgr' has no 'convert' member
W:120,25:MicCmd.do_convert: Unused argument 'subcmd'
R:120,4:MicCmd.do_convert: Too many branches (16/12)
E:216,8:MicCmd.do_chroot: Instance of 'ConfigMgr' has no 'chroot' member
W:192,24:MicCmd.do_chroot: Unused argument 'subcmd'

10 years agoput logfile setting up prior to other error output
Gui Chen [Mon, 19 May 2014 05:41:14 +0000 (01:41 -0400)]
put logfile setting up prior to other error output

except release optioin applied

Change-Id: I10eaac322424460694566a79eda5e53642d798fe
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agofix incorrect location outdir to destdir
Gui Chen [Wed, 14 May 2014 10:36:16 +0000 (06:36 -0400)]
fix incorrect location outdir to destdir

Change-Id: Ic0ec2d5ed9cefbc90d8a4b1149ecb7d984ad1e9f
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agorelocate create.logfile to conf module
Gui Chen [Wed, 14 May 2014 06:37:16 +0000 (02:37 -0400)]
relocate create.logfile to conf module

Change-Id: I276069bb1c33c1ef9a6c3eaac5ce409c211a9a51
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agorelocate create.outdir to conf module
Gui Chen [Wed, 14 May 2014 06:03:20 +0000 (02:03 -0400)]
relocate create.outdir to conf module

Change-Id: I1a9007e9b3d8abfa91091ab063f75bb1f6cd3808
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agorelocate create.name to conf module
Gui Chen [Wed, 14 May 2014 05:57:26 +0000 (01:57 -0400)]
relocate create.name to conf module

Change-Id: Id3e8d2cbf0a4e08ecfbe7941c4967206cd40cd88
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agoAdd more log info to show compress command.
Sun Lihong [Thu, 15 May 2014 09:18:04 +0000 (17:18 +0800)]
Add more log info to show compress command.

Fixes: #1880

Change-Id: I9d81991364aaa57504777e530ba75129dbbcf0f8

10 years agoMerge "Add config file path to 'bindmount' list" into devel
Gui Chen [Fri, 16 May 2014 03:07:57 +0000 (06:07 +0300)]
Merge "Add config file path to 'bindmount' list" into devel

10 years agoAArch64 binformat line fix
Vyacheslav Barinov [Tue, 6 May 2014 10:57:46 +0000 (14:57 +0400)]
AArch64 binformat line fix

There was a typo in binformat line for an AArch64 which made it impossible to
perform firmware builds for this architecture.

Change-Id: I7cc300a5a58dc9fee353f314677d6ab4b2e37d6b
Signed-off-by: Vyacheslav Barinov <v.barinov@samsung.com>
10 years agoAdd config file path to 'bindmount' list
Sun Lihong [Fri, 9 May 2014 00:57:22 +0000 (08:57 +0800)]
Add config file path to 'bindmount' list

In bootstrap mode, if the config file specified by '-c' is not under
the current dir, its sub dirs or the ks dir, it cannot be found, mic
will uses the default '/etc/mic/mic.conf', add 'configmgr._siteconf'
to bind list to also mount conf dir in bootstrap.

Change-Id: I4477466289fdf7542b959c227935b542eaf36e77

10 years agoMerge "duplicate locale setting under /etc/locale.conf" into devel
Gui Chen [Thu, 8 May 2014 10:08:22 +0000 (13:08 +0300)]
Merge "duplicate locale setting under /etc/locale.conf" into devel

10 years agoduplicate locale setting under /etc/locale.conf
Gui Chen [Thu, 8 May 2014 06:21:07 +0000 (02:21 -0400)]
duplicate locale setting under /etc/locale.conf

to be compatible with systemd and system V, /etc/sysconfig/i18n and /etc/locale.conf are both existed

Fixes: #1745

Change-Id: I4d508d506161371765cfab6821da9a61223493ef
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agoRaise exception if fail to extract archived file
Huanhuan Li [Wed, 7 May 2014 06:47:36 +0000 (14:47 +0800)]
Raise exception if fail to extract archived file

It's meaningless to return the value if the source archive name exists

Change-Id: Ifc06a09243c56d6035ef233debd9267f053669e0

10 years agomore check before extracting archive
Huanhuan Li [Wed, 7 May 2014 05:38:00 +0000 (13:38 +0800)]
more check before extracting archive

Change-Id: Ieca43aa54cd384392b288aadd66c3e443eaca701

10 years agoMerge "more check before making archive" into devel
Gui Chen [Wed, 7 May 2014 06:17:19 +0000 (09:17 +0300)]
Merge "more check before making archive" into devel

10 years agomore check before making archive
Gui Chen [Tue, 6 May 2014 10:43:08 +0000 (06:43 -0400)]
more check before making archive

Change-Id: I5a205a06d354e559e7c62767661738a59585788b
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agoAdd two output info to avoid duplicat "Checking filesystem"
Sun Lihong [Tue, 6 May 2014 10:08:44 +0000 (18:08 +0800)]
Add two output info to avoid duplicat "Checking filesystem"

"loop", "liveusb", "livecd" image creation logs all have duplicate
info of "Checking filesystem", add more info to avoid misunderstanding.

Change-Id: I416e71cd312ae5cad23468bb2d7d191358bf4309

10 years agoMerge "Pylint error of partitionedfs.py and proxy.py" into devel
Gui Chen [Tue, 6 May 2014 07:32:49 +0000 (10:32 +0300)]
Merge "Pylint error of partitionedfs.py and proxy.py" into devel

10 years agoMerge "Pylint warnings." into devel
Gui Chen [Tue, 6 May 2014 07:32:16 +0000 (10:32 +0300)]
Merge "Pylint warnings." into devel

10 years agoFix pylint tips
Huanhuan Li [Mon, 21 Apr 2014 06:52:55 +0000 (14:52 +0800)]
Fix pylint tips

Change-Id: Ic0805cc13abc16afd1881c7513edf2f9f980d0fc
C: 58,0: Line too long (87/80)
W: 20,24: Redefining built-in 'id'
C:  1,0: Missing docstring
C: 11,4: Invalid name "version" for type constant (should match (([A-Z_][A-Z0-9_]*)|(__.*__))$)
C: 13,4: Invalid name "version" for type constant (should match (([A-Z_][A-Z0-9_]*)|(__.*__))$)
W: 26,8: No exception type(s) specified
C: 20,13: Invalid name "dist" for type constant (should match (([A-Z_][A-Z0-9_]*)|(__.*__))$)
C: 20,19: Invalid name "ver" for type constant (should match (([A-Z_][A-Z0-9_]*)|(__.*__))$)
C: 20,24: Invalid name "id" for type constant (should match (([A-Z_][A-Z0-9_]*)|(__.*__))$)
C: 43,0: Invalid name "prefix" for type constant (should match (([A-Z_][A-Z0-9_]*)|(__.*__))$)
C: 45,0: Invalid name "root" for type constant (should match (([A-Z_][A-Z0-9_]*)|(__.*__))$)
C: 47,0: Invalid name "conffile" for type constant (should match (([A-Z_][A-Z0-9_]*)|(__.*__))$)
C: 49,0: Invalid name "conf_str" for type constant (should match (([A-Z_][A-Z0-9_]*)|(__.*__))$)
C: 50,0: Invalid name "conf_str" for type constant (should match (([A-Z_][A-Z0-9_]*)|(__.*__))$)

10 years agotypo fix
Gui Chen [Tue, 6 May 2014 07:06:43 +0000 (03:06 -0400)]
typo fix

Change-Id: I0bc9288562694f3a12bb6cf46ffa5c0cadebd236
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agoarchive.py: refine extract_archive to extract tarball file
Gui Chen [Sat, 26 Apr 2014 04:23:30 +0000 (00:23 -0400)]
archive.py: refine extract_archive to extract tarball file

Change-Id: I5af9f17de9d1ac5d12bf1706ce7609ea4c4e201f
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agoarchive.py: auto detect format in decompression and refine get_xxx_formats/get_xxx_su...
Gui Chen [Sat, 26 Apr 2014 04:03:35 +0000 (00:03 -0400)]
archive.py: auto detect format in decompression and refine get_xxx_formats/get_xxx_suffixes

it will detect the format automatically when decompressing
add get_compress_suffixes to list all supported suffixes in compression
clear get_compress_formats
clear get_archive_formats

Change-Id: I1fb2117e4b04c382836b81760bb423cc62f2fd5e
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agoavoid to compress/decompress a non-file object
Gui Chen [Fri, 25 Apr 2014 06:13:28 +0000 (02:13 -0400)]
avoid to compress/decompress a non-file object

Change-Id: I0c43f449175325ba9314e56151a822b3aee0ec21
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agoPylint warnings.
Sun Lihong [Wed, 30 Apr 2014 07:01:31 +0000 (15:01 +0800)]
Pylint warnings.

C:139,8:Zypp._zyppQueryPackage: Comma not followed by a space
        query.addAttribute(zypp.SolvAttr.name,pkg)
                                             ^^
C:146,8:Zypp._splitPkgString: Comma not followed by a space
        sp = pkg.rsplit(".",1)
                           ^^
C:213,12:Zypp.selectPackage: Comma not followed by a space
            q.addAttribute(zypp.SolvAttr.name,pattern)
                                             ^^
C:217,12:Zypp.selectPackage: Comma not followed by a space
            q.addAttribute(zypp.SolvAttr.name,name)
                                             ^^
C:221,12:Zypp.selectPackage: Comma not followed by a space
            q.addAttribute(zypp.SolvAttr.name,pkg)
                                             ^^
W: 19,0: Unused import sys
W: 35,0: Unused import BaseImageCreator
W: 20,0: Unused import re

Change-Id: Ie6bdff4de495e93b0dd534c276cb77d5270db114

10 years agoPylint error of partitionedfs.py and proxy.py
Sun Lihong [Fri, 18 Apr 2014 09:04:52 +0000 (17:04 +0800)]
Pylint error of partitionedfs.py and proxy.py

C: 44,8:unset_proxy_environ: Operator not preceded by a space
        ENV=env.upper()
           ^
C: 44,8:unset_proxy_environ: Invalid name "ENV" (should match [a-z_][a-z0-9_]{2,30}$)
C: 77,4:_ip_to_int: Operator not preceded by a space
    ipint=0
         ^
C: 78,4:_ip_to_int: Operator not preceded by a space
    shift=24
C: 85,4:_int_to_ip: Operator not preceded by a space
    ipaddr=""
          ^
C: 86,4:_int_to_ip: Operator not preceded by a space
    shift=0
         ^
C:111,12:_set_noproxy_list: Comma not followed by a space
            _my_noproxy_list.append({"match":0,"needle":item})
                                              ^^
C:115,12:_set_noproxy_list: Comma not followed by a space
            _my_noproxy_list.append({"match":1,"needle":item})
                                              ^^
C:127,16:_set_noproxy_list: Invalid name "ip" (should match [a-z_][a-z0-9_]{2,30}$)
C:129,16:_set_noproxy_list: Operator not preceded by a space
                shift=24
                     ^
C:130,16:_set_noproxy_list: Operator not preceded by a space
                netmask=0
                       ^
C:136,12:_set_noproxy_list: Comma not followed by a space
            _my_noproxy_list.append({"match":2,"needle":ip,"netmask":netmask})

Change-Id: Iaf24729b3231b9f313af333fe58096d234d3e515

10 years agoadd _do_tar and _do_untar to utilize 'tar' command
Gui Chen [Fri, 25 Apr 2014 06:04:46 +0000 (02:04 -0400)]
add _do_tar and _do_untar to utilize 'tar' command

Change-Id: Iefc0ca78636e07ffe125560c3336031c5be4f9fb
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agoclean up unused code
Gui Chen [Wed, 23 Apr 2014 08:43:41 +0000 (04:43 -0400)]
clean up unused code

Change-Id: I483e4253437a3fa9905ff354f7739b15f71ec2c2
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agoswitch to use new archive module
Gui Chen [Wed, 23 Apr 2014 08:37:30 +0000 (04:37 -0400)]
switch to use new archive module

Change-Id: Ibe1f956b178952f150b4d2285d3642dc73a06bb5
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agoadd rewritten moudle archive to handle archiving and compressing
Gui Chen [Wed, 23 Apr 2014 08:33:06 +0000 (04:33 -0400)]
add rewritten moudle archive to handle archiving and compressing

Change-Id: I9fd94ca3b3d3460ecb2af618baa329f04a6a3bfb
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agoAdd lzop compress format
Sun Lihong [Fri, 21 Mar 2014 07:30:37 +0000 (15:30 +0800)]
Add lzop compress format

Add '.lzo' compression format to option '--compress-image' and
'--compress-disk-image' of 'raw' and 'loop' type image.

Fixes: #1282

Change-Id: Ic19faa2b9c2ee13a74a6cd2ce9153ce7feea276c

10 years agotypo fix
Huanhuan Li [Mon, 31 Mar 2014 06:31:22 +0000 (14:31 +0800)]
typo fix

Change-Id: Id8a274534f299381453dda400308a1073c6f4b99

10 years agoGenerate manifest file
Huanhuan Li [Fri, 21 Mar 2014 09:51:49 +0000 (17:51 +0800)]
Generate manifest file

The manifest file stores important infomation such as image file name,
package format, compress format, partitions or disks. So when another program
want to parse image files, it can get the infomation more easily by reading
manifest file. There are two important kinds of format, see bellow:
loop:
   {
       "format": "loop",
       "version": "0.24",
       "loop": {
           "image_files": [
               "whole_rd_210-201403211800.tar.gz"
           ],
           "pack": ".tar.gz",
           "partitions": {
              "/opt": "data",
              "/opt/usr": "ums",
              "/": "platform"
          }
      },
      "created": "2014-03-21 18:02:07"
  }
raw:
   {
       "raw": {
          "image_files": [
               "ivi-201403211803-sda.raw.bz2",
               "ivi-201403211803-sdb.raw.bz2"
           ],
           "disks": [
               "sda",
               "sdb"
          ],
          "compress": "bz2",
          "sda": {
              "image": "ivi-201403211803-sda.raw.bz2",
              "bmap": "ivi-201403211803-sda.bmap"
          },
          "sdb": {
              "image": "ivi-201403211803-sdb.raw.bz2",
              "bmap": "ivi-201403211803-sdb.bmap"
          }
      },
      "format": "raw",
      "version": "0.24",
      "created": "2014-03-21 18:06:10"
  }
Change-Id: Ie9682bad79337319d1c1e6534b3cd4db25271124
Fixes: #1583

10 years agohandle not found exception
Gui Chen [Thu, 6 Mar 2014 06:12:53 +0000 (01:12 -0500)]
handle not found exception

Change-Id: Id4a3d99da61bac50be02bee1213d38ea70b4c4ec
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agoremove dash in debian version
Gui Chen [Wed, 12 Mar 2014 06:18:09 +0000 (02:18 -0400)]
remove dash in debian version

Change-Id: I41d35391cf292abf0537833bce200a786b18fad5
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agobump up to 0.24 0.24
Gui Chen [Wed, 12 Mar 2014 02:19:11 +0000 (22:19 -0400)]
bump up to 0.24

Change-Id: I83e7b595fb6e0895d1c54569e30510d3a15192ea
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agobump up to 0.24-rc1
Gui Chen [Tue, 11 Mar 2014 10:00:37 +0000 (06:00 -0400)]
bump up to 0.24-rc1

Change-Id: Ia819fc5e63b69b5e4b0b7f2d174cd95f1243e9a1
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agofix ssl conection caused by wrong paramter in zypp query
Gui Chen [Thu, 6 Mar 2014 06:27:45 +0000 (01:27 -0500)]
fix ssl conection caused by wrong paramter in zypp query

Change-Id: If3e17df6c15e81827e69e36c3409d1b03dada946
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agofix includepkgs and excludepkgs lost during translating
Gui Chen [Thu, 6 Mar 2014 03:38:25 +0000 (22:38 -0500)]
fix includepkgs and excludepkgs lost during translating

Change-Id: Ia34191428f3dd99cd596aa4520e18a29a839edfc
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agoAdd unit test for proxy
Huanhuan Li [Thu, 22 Aug 2013 23:11:09 +0000 (07:11 +0800)]
Add unit test for proxy

Change-Id: Ic3f5567df03125ef28ca96e16b23869996a6d6ed

10 years agofix obsoletes ignored version issue
Gui Chen [Wed, 5 Mar 2014 05:32:31 +0000 (00:32 -0500)]
fix obsoletes ignored version issue

Fixes: #1382

Change-Id: I663a80703ba02091f87fa9aca23be9ec5ba0d1b9
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agofix local repository failed to perform urlgrabber
Gui Chen [Wed, 5 Mar 2014 05:58:56 +0000 (00:58 -0500)]
fix local repository failed to perform urlgrabber

Change-Id: I80873c643d207b348c77057c600ce20c6797b3d7
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agoRaise exception if fail to install mic-bootstrap
Huanhuan Li [Thu, 27 Feb 2014 07:08:36 +0000 (15:08 +0800)]
Raise exception if fail to install mic-bootstrap

When installing rpm, only None means install rpm successfully,
so raise exception if not
Fixes: #1564

Change-Id: I09bbb39f68eff72a4769e9732c5ab505cdef8313

10 years agochange tizen-python-zypp to python-zypp-tizen
Gui Chen [Tue, 4 Mar 2014 07:46:10 +0000 (02:46 -0500)]
change tizen-python-zypp to python-zypp-tizen

Change-Id: I78c8c9f3bdadd4cb49b4dd6cecf8ccfb8e34a36c
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agoimplement '--repo' option and '--ignore-ksrepo'
Gui Chen [Thu, 13 Feb 2014 05:12:12 +0000 (00:12 -0500)]
implement '--repo' option and '--ignore-ksrepo'

option '--repo' is to append a new repo to repo pool, like
  --repo "name=main;baseurl=http://repo"
option '--ignoe-ksrepo' is to ignore repos in ks file, only valid when '--repo' used

Change-Id: I38586f2e587904e0f4fe2d901597f7231a248b97
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agoadd two new options '--repo' and '--ignore-ksrepo'
Gui Chen [Thu, 13 Feb 2014 04:06:18 +0000 (23:06 -0500)]
add two new options '--repo' and '--ignore-ksrepo'

option '--repo' is to append a new repo to repo pool
option '--ignore-ksrepo' is to ignore repos in ks file

Change-Id: I10280f0c3f40b2f68186240f3694d2eb14104e10
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agosleep earlier to prepare loop device creation
Gui Chen [Tue, 4 Mar 2014 06:33:06 +0000 (01:33 -0500)]
sleep earlier to prepare loop device creation

Fixes: #1646

Change-Id: If8e4fbe27e9320abf203eca82de6666271b00f86
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agoFix zypp fail to download packages
Huanhuan Li [Mon, 3 Mar 2014 07:03:11 +0000 (15:03 +0800)]
Fix zypp fail to download packages

If we changed all configuration in '/etc/mic/mic.conf' to other dirs
like '/home/build/xx' instead of '/var/tmp/xx', mic wouldn't mount
or create '/var/tmp' any more, then it would result in zypp can't download
packages, becuase zypp will use '/var/tmp' to build cache as default

Fixes: #1623

Change-Id: I6f69c4a6f9655f70d3cbfa6670756255bca171a4

10 years agopackaging: use gbp packaging service
Gui Chen [Thu, 27 Feb 2014 05:51:03 +0000 (00:51 -0500)]
packaging: use gbp packaging service

Change version in debian/changelog to Debian source package format "1.0
native".

Change-Id: I6a4017a814cb04a808389e9b11851ce49e8765e0
Signed-off-by: Gui Chen <gui.chen@intel.com>
Signed-off-by: Markus Lehtonen <markus.lehtonen@linux.intel.com>
10 years agouse nametuple to represent repo info
Gui Chen [Thu, 13 Feb 2014 06:54:47 +0000 (01:54 -0500)]
use nametuple to represent repo info

Change-Id: I9e3268ce91bd60739172520756790712085e0e04
Signed-off-by: Gui Chen <gui.chen@intel.com>
10 years agoFix duplicate log shows when run mic with 'yum'
Huanhuan Li [Wed, 25 Sep 2013 05:38:41 +0000 (13:38 +0800)]
Fix duplicate log shows when run mic with 'yum'

Fixes: #1585

Change-Id: Ie5b39b055198b3f023819993b56a4dfc6c92e8dc

10 years agoShow hostname in log
Sun Lihong [Thu, 27 Feb 2014 02:17:24 +0000 (10:17 +0800)]
Show hostname in log

Show hostname before distro info in log.

Fixes: #1644

Change-Id: Ibb9bdfa8bd1920084fbcdcec7a233102aeda0762

10 years agoBmap: sync with the latest bmap-tools
Artem Bityutskiy [Wed, 22 Jan 2014 08:04:06 +0000 (10:04 +0200)]
Bmap: sync with the latest bmap-tools

This patch syncs MIC's copy of BmapCreate with the latest contents of the
bmap-tools project. The reason for syncing is to fix DEVT-139. The bugreport
tells that MIC cannot generate the bmap file when the image resides on tmpfs.
And now this is fixed.

We also re-named the Fiemap module to Filemap, because now this module supports
both FIEMAP ioctl and the SEEK_HOLE method. Here is some more description from
the bmap-tools release notes.

"
Make 'bmaptool create' (and hence, the BmapCreate module) work with the
"tmpfs" file-system. This file-system does not, unfortunately, support the
"FIEMAP" ioctl, but it supports the "SEEK_HOLE" option of the "lseek" system
call, which can also be used to find where the holes are. In this release we
have implemented support for "SEEK_HOLE" to cover tmpfs. Generally, FIEMAP
is faster than "SEEK_HOLE" for large files, so we always try to start with
using FIEMAP, and if it is not supported, we fall-back to using "SEEK_HOLE".
Therefore, the "Fiemap" module was re-named to "Filemap", since it is now
supports more than just the FIEMAP ioctl.

Unfortunately, the SEEK_HOLE method requires the directory where the image
resides to be accessible for writing, because in current implementation we
need to create a temporary file there for a short time. The temporary file
is used to detect whether SEEK_HOLE is really implemented, or the system
just fakes it by always returning EOF.
"

Change-Id: I75522cab3c32c9b0879967f8fa2587c71bae0395
Signed-off-by: Artem Bityutskiy <artem.bityutskiy@intel.com>
10 years agoFix chroot failure caused by out-of-disk-space error.
Xiaoning Zhu [Wed, 15 Jan 2014 05:39:30 +0000 (13:39 +0800)]
Fix chroot failure caused by out-of-disk-space error.

If there is no space left on loop device, creation of mount points
will fail. In this case, mic will catch and ignore this failure.
Mic make its best effort to chroot.

Fix: #701

Change-Id: Ifb7666ec27f8bdb560983a9966ef171cb2a8a14b
Signed-off-by: Xiaoning Zhu <xiaoning.zhu@intel.com>
10 years agoFix a bug that raise AttributeError.
Huang Hao [Tue, 14 Jan 2014 04:43:14 +0000 (12:43 +0800)]
Fix a bug that raise AttributeError.

When download attachment packages by using yum pkgmgr, the url
variable below is a unicode instead of SafeURL object.

Traceback (most recent call last):
......
  File "/home/huanghao/workspace/mic/plugins/imager/loop_plugin.py", line 127, in do_create
    creator.install()
  File "/usr/local/lib/python2.7/dist-packages/mic/imager/baseimager.py", line 1051, in install
    self.__attachment_packages(pkg_manager)
  File "/usr/local/lib/python2.7/dist-packages/mic/imager/baseimager.py", line 966, in __attachment_packages
    fpath = grabber.myurlgrab(url.full, fpath, proxies, None)
AttributeError: 'unicode' object has no attribute 'full'

Change-Id: Ib5c03ef053b8cf22f1b8ef1868ad244427df7cc6

10 years agokickstart: remove old installerfw keywords
Artem Bityutskiy [Wed, 15 Jan 2014 11:45:05 +0000 (13:45 +0200)]
kickstart: remove old installerfw keywords

The story: the installer framework keyword in KS files originally was
"installerfw", and the keyword for the first plugin was "extlinux". However,
we realized that this is bad naming, and commit changed the names in commit
'0bafaa1b31a0 kickstart: add an alias for installerfw'. That commit preserved
the old name as aliases for compatibility reasons. And added scary warnings
which are printed when the old names are used.

The only user user of the old names was Tizen IVI, and it stopped using them
very long time ago. Now it uses the new 'installerfw_plugins' and 'bootloader'
keywords instead.

So it is time to kill the old keywords completely and clean the code up. And
this is exactly what this patch does.

Change-Id: I23ef6c5850744734816974233229cf99fca05f38
Signed-off-by: Artem Bityutskiy <artem.bityutskiy@intel.com>