services/createrepo_c.git
10 years agoNew approach for loading of metadata 3/3
Tomas Mlcoch [Wed, 5 Mar 2014 22:03:11 +0000 (23:03 +0100)]
New approach for loading of metadata 3/3

New bitfield in cr_Package loadingflags, that contains information
about what was loaded to the package (primary, filelists, other) and
where is the package from (parsed from rpm header, from xml, etc..)

Thanks to this field, the XML metadata parser can recognize that
a XML chunk with files (filelists.xml) or changelos (other.xml)
was already parsed for the package and skip duplicit chunks.

10 years agoNew approach for loading of metadata 2/3
Tomas Mlcoch [Wed, 5 Mar 2014 19:42:42 +0000 (20:42 +0100)]
New approach for loading of metadata 2/3

Add cr_HashTableKeyDupAction that specify behavior of metadata loader in case of duplicated items.

See comment at cr_HashTableKeyDupAction enum.

10 years agoNew approach for loading of metadata 1/3.
Tomas Mlcoch [Wed, 5 Mar 2014 18:47:47 +0000 (19:47 +0100)]
New approach for loading of metadata 1/3.

Description:

If there are two (or more) the same packages (same mtime, size and basename)
with the same checksum. Load the metadata only once (such packages can have
and probably have a different local_href (different directory))
but the directory is not important during --update.

If there are two (or more) seemingly the same packages (the packages have the
same checksum, but different mtime, size or basename). Ignore all of these packages!
The checksum is internally blacklisted during the loading of metadata, and
metadata of each package wich has the checksum will be skiped.

Important note:

As you can see, this approach is not optimal if you want to load a
whole metadata. But it is great if you wan to load a metadata which
are gonna be used during --update.

If you don't like this behaviour during use of cr_metadata_locate_and_load_xml()
then just quit using the function and use
the cr_xml_parse_(primary|filelists|other) directly by yourself.

10 years agocreaterepo_c: Support for changelog-limit = -1 (Dumps all changelogs)
Tomas Mlcoch [Tue, 4 Mar 2014 09:27:53 +0000 (10:27 +0100)]
createrepo_c: Support for changelog-limit = -1 (Dumps all changelogs)

10 years agocmd_parser: Changed int to gint.
Tomas Mlcoch [Tue, 4 Mar 2014 09:23:06 +0000 (10:23 +0100)]
cmd_parser: Changed int to gint.

10 years agoRemove strerror() from error messages for rpmReadPackageFile() error
Tomas Mlcoch [Mon, 3 Mar 2014 14:58:10 +0000 (15:58 +0100)]
Remove strerror() from error messages for rpmReadPackageFile() error

10 years agoCMake: Modify debug compilation flags.
Tomas Mlcoch [Mon, 3 Mar 2014 12:22:07 +0000 (13:22 +0100)]
CMake: Modify debug compilation flags.

10 years agoUpdate man pages
Tomas Mlcoch [Mon, 3 Mar 2014 08:59:42 +0000 (09:59 +0100)]
Update man pages

10 years agoFix usage strings in help.
Tomas Mlcoch [Mon, 3 Mar 2014 08:42:10 +0000 (09:42 +0100)]
Fix usage strings in help.

10 years agoCMake: Remove deltarepo
Tomas Mlcoch [Sun, 2 Mar 2014 18:11:40 +0000 (19:11 +0100)]
CMake: Remove deltarepo

10 years agodeltarepo: Removed from createrepo_c
Tomas Mlcoch [Tue, 25 Feb 2014 17:05:20 +0000 (18:05 +0100)]
deltarepo: Removed from createrepo_c

DeltaRepo is now standalone project.
DeltaRepo's homepage: https://github.com/Tojaj/DeltaRepo

10 years agoutils: Update make_rpm.sh script
Tomas Mlcoch [Tue, 25 Feb 2014 16:58:52 +0000 (17:58 +0100)]
utils: Update make_rpm.sh script

10 years agodeltarepo: Implemented Updater().update_from_origin()
Tomas Mlcoch [Tue, 25 Feb 2014 12:06:20 +0000 (13:06 +0100)]
deltarepo: Implemented Updater().update_from_origin()

10 years agodeltarepo: Download only necessary delta metadata
Tomas Mlcoch [Mon, 24 Feb 2014 20:59:44 +0000 (21:59 +0100)]
deltarepo: Download only necessary delta metadata

10 years agodeltarepo: use real cost during solving
Tomas Mlcoch [Mon, 24 Feb 2014 18:20:47 +0000 (19:20 +0100)]
deltarepo: use real cost during solving

10 years agodeltarepo: sizes in deltarepos.xml
Tomas Mlcoch [Mon, 24 Feb 2014 17:44:41 +0000 (18:44 +0100)]
deltarepo: sizes in deltarepos.xml

10 years agodeltarepo: support for <data> elements in deltarepos.xml
Tomas Mlcoch [Mon, 24 Feb 2014 16:03:24 +0000 (17:03 +0100)]
deltarepo: support for <data> elements in deltarepos.xml

10 years agodeltarepos: fix gen scripts for acceptance tests
Tomas Mlcoch [Mon, 24 Feb 2014 13:06:32 +0000 (14:06 +0100)]
deltarepos: fix gen scripts for acceptance tests

10 years agoDeltaRepo: Implemented apply_resolved_path
Tomas Mlcoch [Mon, 24 Feb 2014 12:49:48 +0000 (13:49 +0100)]
DeltaRepo: Implemented apply_resolved_path

10 years agoUpdate repocontenthash.py
Tomas Mlcoch [Mon, 24 Feb 2014 11:20:44 +0000 (12:20 +0100)]
Update repocontenthash.py

10 years agoprogress on deltarepo
Tomas Mlcoch [Thu, 20 Feb 2014 16:06:01 +0000 (17:06 +0100)]
progress on deltarepo

10 years agoVersion bump to 0.2.2
Tomas Mlcoch [Thu, 20 Feb 2014 13:27:50 +0000 (14:27 +0100)]
Version bump to 0.2.2

10 years agoREADME: Add sphinx into doc deps
Tomas Mlcoch [Thu, 20 Feb 2014 12:28:39 +0000 (13:28 +0100)]
README: Add sphinx into doc deps

10 years agoFix few warnings in python bindings
Tomas Mlcoch [Thu, 20 Feb 2014 11:41:03 +0000 (06:41 -0500)]
Fix few warnings in python bindings

10 years agoFix python bindings to be compatible with Python < 2.7
Tomas Mlcoch [Thu, 20 Feb 2014 11:27:02 +0000 (06:27 -0500)]
Fix python bindings to be compatible with Python < 2.7

10 years agoFew fixes to compatibility with glib 2.28
Tomas Mlcoch [Thu, 20 Feb 2014 11:22:21 +0000 (06:22 -0500)]
Few fixes to compatibility with glib 2.28

10 years agomisc: Add cr_spawn_check_exit_status()
Tomas Mlcoch [Thu, 20 Feb 2014 11:15:40 +0000 (06:15 -0500)]
misc: Add cr_spawn_check_exit_status()

10 years agoerror: New error codes for process spawning
Tomas Mlcoch [Thu, 20 Feb 2014 11:10:34 +0000 (06:10 -0500)]
error: New error codes for process spawning

10 years agoFix building on RHEL6
Tomas Mlcoch [Thu, 20 Feb 2014 09:45:15 +0000 (04:45 -0500)]
Fix building on RHEL6

10 years agocmake: Do not install deltarepo stuff yet
Tomas Mlcoch [Thu, 20 Feb 2014 09:18:22 +0000 (10:18 +0100)]
cmake: Do not install deltarepo stuff yet

10 years agohelper: Removed cr_remove_metadata() and cr_get_list_of_md_locations()
Tomas Mlcoch [Wed, 19 Feb 2014 22:49:04 +0000 (23:49 +0100)]
helper: Removed cr_remove_metadata() and cr_get_list_of_md_locations()

10 years agohelpers: cr_remove_metadata_classic now uses cr_repodata_blacklist_classic
Tomas Mlcoch [Wed, 19 Feb 2014 22:33:39 +0000 (23:33 +0100)]
helpers: cr_remove_metadata_classic now uses cr_repodata_blacklist_classic

10 years agohelpers: Add cr_repodata_blacklist and cr_repodata_blacklist_classic functions
Tomas Mlcoch [Wed, 19 Feb 2014 21:55:08 +0000 (22:55 +0100)]
helpers: Add cr_repodata_blacklist and cr_repodata_blacklist_classic functions

10 years agoSome progress on helpers module
Tomas Mlcoch [Mon, 17 Feb 2014 21:17:07 +0000 (22:17 +0100)]
Some progress on helpers module

10 years agoAdd module helpers
Tomas Mlcoch [Mon, 17 Feb 2014 16:16:35 +0000 (17:16 +0100)]
Add module helpers

10 years agoNew function: cr_old_metadata_retention()
Tomas Mlcoch [Mon, 17 Feb 2014 15:29:12 +0000 (16:29 +0100)]
New function: cr_old_metadata_retention()

10 years agoGrrr, remove forgotten debug print :)
Tomas Mlcoch [Mon, 17 Feb 2014 15:03:28 +0000 (16:03 +0100)]
Grrr, remove forgotten debug print :)

10 years agoSanitize strings before writting them to XML or sqlitedb (ISSUE #3)
Tomas Mlcoch [Mon, 17 Feb 2014 14:32:54 +0000 (15:32 +0100)]
Sanitize strings before writting them to XML or sqlitedb (ISSUE #3)

Exclude chars with val <32 (except the 9, 10, 13) from the strings.

10 years agodeltarepo: Another progress...
Tomas Mlcoch [Thu, 13 Feb 2014 15:53:14 +0000 (16:53 +0100)]
deltarepo: Another progress...

10 years agodeltarepo: Implemented Dijkstra's algorithm.
Tomas Mlcoch [Tue, 11 Feb 2014 21:45:40 +0000 (22:45 +0100)]
deltarepo: Implemented Dijkstra's algorithm.

10 years agodeltarepo: Implemented graph_from_links method of Graph class.
Tomas Mlcoch [Tue, 11 Feb 2014 20:12:07 +0000 (21:12 +0100)]
deltarepo: Implemented graph_from_links method of Graph class.

10 years agoUnfinished implementation of managedeltarepos and repoupdater.
Tomas Mlcoch [Tue, 11 Feb 2014 13:28:24 +0000 (14:28 +0100)]
Unfinished implementation of managedeltarepos and repoupdater.

10 years agoUse g_once for initialization and cleanup of package parser.
Tomas Mlcoch [Tue, 11 Feb 2014 12:14:13 +0000 (13:14 +0100)]
Use g_once for initialization and cleanup of package parser.

10 years agopython example of calculation of contenthash
Tomas Mlcoch [Tue, 11 Feb 2014 09:18:14 +0000 (10:18 +0100)]
python example of calculation of contenthash

10 years agoUpdate cleanup.sh script
Tomas Mlcoch [Mon, 10 Feb 2014 13:21:20 +0000 (14:21 +0100)]
Update cleanup.sh script

10 years agoAdd new python example of repomd.xml parsing.
Tomas Mlcoch [Mon, 10 Feb 2014 13:21:00 +0000 (14:21 +0100)]
Add new python example of repomd.xml parsing.

10 years agoAdd implementation for the --ignore-lock option
Tomas Mlcoch [Mon, 27 Jan 2014 14:01:10 +0000 (15:01 +0100)]
Add implementation for the --ignore-lock option

10 years agoAdd new cmd option --ignore-lock.
Tomas Mlcoch [Mon, 27 Jan 2014 14:00:20 +0000 (15:00 +0100)]
Add new cmd option --ignore-lock.

10 years agomisc: Add cr_append_pid_and_datetime()
Tomas Mlcoch [Mon, 27 Jan 2014 13:58:53 +0000 (14:58 +0100)]
misc: Add cr_append_pid_and_datetime()

10 years agoFor final move use dynamically generated temporary dirname.
Tomas Mlcoch [Mon, 27 Jan 2014 11:20:39 +0000 (12:20 +0100)]
For final move use dynamically generated temporary dirname.

10 years agoSet own (cleanup) handler for signals that can terminated the process
Tomas Mlcoch [Mon, 20 Jan 2014 08:50:13 +0000 (09:50 +0100)]
Set own (cleanup) handler for signals that can terminated the process

10 years agoRemove .repodata on failure exits
Tomas Mlcoch [Fri, 17 Jan 2014 12:34:26 +0000 (13:34 +0100)]
Remove .repodata on failure exits

10 years agoDeltarepo: Use contenthash element instead of repoid
Tomas Mlcoch [Mon, 16 Dec 2013 15:14:19 +0000 (16:14 +0100)]
Deltarepo: Use contenthash element instead of repoid

10 years agoAdd support for <contenthash> tag in repomd.xml
Tomas Mlcoch [Mon, 16 Dec 2013 15:09:32 +0000 (16:09 +0100)]
Add support for <contenthash> tag in repomd.xml

10 years agoDeltarepo: Several bugfixes
Tomas Mlcoch [Mon, 16 Dec 2013 14:46:55 +0000 (15:46 +0100)]
Deltarepo: Several bugfixes

10 years agoDeltarepo: Refactoring
Tomas Mlcoch [Wed, 11 Dec 2013 15:27:08 +0000 (16:27 +0100)]
Deltarepo: Refactoring

10 years agodeltarepo: New plugin GroupsDeltaRepoPlugin
Tomas Mlcoch [Mon, 9 Dec 2013 14:11:10 +0000 (15:11 +0100)]
deltarepo: New plugin GroupsDeltaRepoPlugin

10 years agodeltarepo: Switch from OptionParser to ArgumentParser.
Tomas Mlcoch [Mon, 9 Dec 2013 14:10:40 +0000 (15:10 +0100)]
deltarepo: Switch from OptionParser to ArgumentParser.

10 years agodeltarepo: Fix python imports
Tomas Mlcoch [Thu, 5 Dec 2013 10:49:32 +0000 (11:49 +0100)]
deltarepo: Fix python imports

10 years agoCMake support for deltarepo
Tomas Mlcoch [Wed, 4 Dec 2013 10:17:22 +0000 (11:17 +0100)]
CMake support for deltarepo

10 years agoDeltarepo: Add --database and --ignore-missing options
Tomas Mlcoch [Tue, 3 Dec 2013 13:16:13 +0000 (14:16 +0100)]
Deltarepo: Add --database and --ignore-missing options

10 years agoDeltarepo: More tests
Tomas Mlcoch [Tue, 3 Dec 2013 13:15:40 +0000 (14:15 +0100)]
Deltarepo: More tests

10 years agoFix moving of old metadata
Tomas Mlcoch [Tue, 3 Dec 2013 11:05:48 +0000 (12:05 +0100)]
Fix moving of old metadata

10 years agoRefactored deltarepo
Tomas Mlcoch [Mon, 2 Dec 2013 16:56:58 +0000 (17:56 +0100)]
Refactored deltarepo

10 years agoFix support of --retain-old-md
Tomas Mlcoch [Mon, 2 Dec 2013 09:55:23 +0000 (10:55 +0100)]
Fix support of --retain-old-md

10 years agoFinal move with better atomicity
Tomas Mlcoch [Thu, 28 Nov 2013 16:54:40 +0000 (17:54 +0100)]
Final move with better atomicity

10 years agomisc: Add cr_rm()
Tomas Mlcoch [Thu, 28 Nov 2013 16:54:04 +0000 (17:54 +0100)]
misc: Add cr_rm()

10 years agoFix empty if statement.
Tomas Mlcoch [Thu, 28 Nov 2013 15:09:34 +0000 (16:09 +0100)]
Fix empty if statement.

10 years agomisc: Add cr_cp() function.
Tomas Mlcoch [Thu, 28 Nov 2013 15:08:50 +0000 (16:08 +0100)]
misc: Add cr_cp() function.

10 years agodeltarepo: More tests, better behaviour with incomplete repos.
Tomas Mlcoch [Fri, 15 Nov 2013 08:53:53 +0000 (09:53 +0100)]
deltarepo: More tests, better behaviour with incomplete repos.

10 years agodeltarepo: Better delta behaviour when delta has to add filelists or other.
Tomas Mlcoch [Thu, 7 Nov 2013 15:39:17 +0000 (16:39 +0100)]
deltarepo: Better delta behaviour when delta has to add filelists or other.

11 years agodeltarepo: New test data
Tomas Mlcoch [Thu, 7 Nov 2013 15:37:24 +0000 (16:37 +0100)]
deltarepo: New test data

11 years agoUpdate gitignore
Tomas Mlcoch [Thu, 7 Nov 2013 13:21:01 +0000 (14:21 +0100)]
Update gitignore

11 years agodeltarepo: Remove pre-generated repodata from acceptance tests.
Tomas Mlcoch [Thu, 7 Nov 2013 13:15:21 +0000 (14:15 +0100)]
deltarepo: Remove pre-generated repodata from acceptance tests.

11 years agodeltarepo: Better acceptance tests.
Tomas Mlcoch [Thu, 7 Nov 2013 12:59:29 +0000 (13:59 +0100)]
deltarepo: Better acceptance tests.

11 years agoacceptance tests: More tests
Tomas Mlcoch [Thu, 7 Nov 2013 08:54:40 +0000 (09:54 +0100)]
acceptance tests: More tests

11 years agoUpdate .gitignore
Tomas Mlcoch [Wed, 6 Nov 2013 15:54:20 +0000 (16:54 +0100)]
Update .gitignore

11 years agoacceptance tests: Replace real packages with smaller (mocked) packages.
Tomas Mlcoch [Wed, 6 Nov 2013 15:46:45 +0000 (16:46 +0100)]
acceptance tests: Replace real packages with smaller (mocked) packages.

11 years agoacceptance tests: Update test repositories
Tomas Mlcoch [Wed, 6 Nov 2013 14:19:53 +0000 (15:19 +0100)]
acceptance tests: Update test repositories

11 years agorepomd: In new RepomdRecords set the open_size to -1.
Tomas Mlcoch [Wed, 6 Nov 2013 14:12:39 +0000 (15:12 +0100)]
repomd: In new RepomdRecords set the open_size to -1.

11 years agoSupport for other then primary, filelists and other metadata
Tomas Mlcoch [Thu, 31 Oct 2013 10:12:12 +0000 (11:12 +0100)]
Support for other then primary, filelists and other metadata

11 years agodeltarepo: Add acceptance tests
Tomas Mlcoch [Tue, 29 Oct 2013 14:32:52 +0000 (15:32 +0100)]
deltarepo: Add acceptance tests

11 years agoWhen package's description is not defined, use NULL (None) instead of empty string.
Tomas Mlcoch [Tue, 29 Oct 2013 14:28:34 +0000 (15:28 +0100)]
When package's description is not defined, use NULL (None) instead of empty string.

11 years agoexample: Update simple_createrepo.py example
Tomas Mlcoch [Tue, 29 Oct 2013 13:22:36 +0000 (14:22 +0100)]
example: Update simple_createrepo.py example

11 years agoUpdate bash completion upstream/0.2.1
Tomas Mlcoch [Tue, 15 Oct 2013 10:40:48 +0000 (12:40 +0200)]
Update bash completion

11 years agomodifyrepo_c: Sort repomd records before dump.
Tomas Mlcoch [Tue, 15 Oct 2013 10:29:57 +0000 (12:29 +0200)]
modifyrepo_c: Sort repomd records before dump.

11 years agoAdd cr_repomd_sort_records() function.
Tomas Mlcoch [Mon, 14 Oct 2013 14:54:43 +0000 (16:54 +0200)]
Add cr_repomd_sort_records() function.

11 years agoREADME.md update
Tomas Mlcoch [Thu, 10 Oct 2013 13:57:03 +0000 (15:57 +0200)]
README.md update

11 years agoNew Deltarepo
Tomas Mlcoch [Thu, 10 Oct 2013 13:30:09 +0000 (15:30 +0200)]
New Deltarepo

11 years agoMisc: Add cr_decompress_file_with_stat function (in Python: createrepo_c.decompress_f...
Tomas Mlcoch [Thu, 10 Oct 2013 12:58:28 +0000 (14:58 +0200)]
Misc: Add cr_decompress_file_with_stat function (in Python: createrepo_c.decompress_file())

11 years agopython: Add createrepo_c.compression_type() function.
Tomas Mlcoch [Thu, 10 Oct 2013 10:56:04 +0000 (12:56 +0200)]
python: Add createrepo_c.compression_type() function.

11 years agoG_LOG_DOMAIN definition moved to CMake (removed logging.h)
Tomas Mlcoch [Mon, 30 Sep 2013 11:52:54 +0000 (13:52 +0200)]
G_LOG_DOMAIN definition moved to CMake (removed logging.h)

11 years agomodifyrepo: Add new option 'path' useful in situations where filename contains '...
Tomas Mlcoch [Mon, 30 Sep 2013 11:23:02 +0000 (13:23 +0200)]
modifyrepo: Add new option 'path' useful in situations where filename contains '[' or ']' character(s).

11 years agomodifyrepo_c: Don't print repomd.xml content on stdout
Tomas Mlcoch [Thu, 19 Sep 2013 14:55:03 +0000 (16:55 +0200)]
modifyrepo_c: Don't print repomd.xml content on stdout

11 years agomodifyrepo: Put records in the same order as defined in batch file
Tomas Mlcoch [Thu, 19 Sep 2013 14:49:01 +0000 (16:49 +0200)]
modifyrepo: Put records in the same order as defined in batch file

11 years agoREADME: Add info about modifyrepo_c
Tomas Mlcoch [Thu, 19 Sep 2013 14:43:02 +0000 (16:43 +0200)]
README: Add info about modifyrepo_c

11 years agodoc: Update manpages
Tomas Mlcoch [Thu, 19 Sep 2013 14:28:01 +0000 (16:28 +0200)]
doc: Update manpages

11 years agoAdd modifyrepo_c
Tomas Mlcoch [Thu, 19 Sep 2013 14:20:23 +0000 (16:20 +0200)]
Add modifyrepo_c

11 years agorepomd: Remove broken record sorting.
Tomas Mlcoch [Thu, 19 Sep 2013 13:30:06 +0000 (15:30 +0200)]
repomd: Remove broken record sorting.

11 years agocompression_wrapper: Fix memory leak in cr_compression_type.
Tomas Mlcoch [Thu, 19 Sep 2013 13:29:22 +0000 (15:29 +0200)]
compression_wrapper: Fix memory leak in cr_compression_type.