Update md5sums logic in tsp/scripts/crawler.py 15/79915/5
authorAleksander Mistewicz <a.mistewicz@samsung.com>
Wed, 13 Jul 2016 10:05:20 +0000 (12:05 +0200)
committerAleksander Mistewicz <a.mistewicz@samsung.com>
Fri, 7 Oct 2016 15:29:30 +0000 (17:29 +0200)
commitdf86143ffedec31ecc5287f627a670dc2a14c204
treea335dc9121e9dcc4f7eef047b9b38331709107e1
parente201c2f2eacf602e9091c8eed00ff60a3f5e3008
Update md5sums logic in tsp/scripts/crawler.py

If any of the md5sums_url is missing (http error code 404 was returned)
from md5sums_urls list then it will be skipped and not dispatched.
It saves http requests so that it won't timeout if the server is busy.

For url to be added to dispatched_urls it must:
 * have every md5sums_url from md5sums_urls list available
   (no 404 error returned)
 * have any of the md5sums_urls modified since last timestamp

Change-Id: Ie790f1039e91003b0da85c19d7db11ac160007da
Signed-off-by: Aleksander Mistewicz <a.mistewicz@samsung.com>
tsp/scripts/crawler.py