projects / tools / testlab / major.git / commit
? search:
summary | shortlog | log | commit | commitdiff | tree
(parent: 8af0911) | patch
Replace urllib2 with requests in crawler.py 98/95298/6
authorAleksander Mistewicz <a.mistewicz@samsung.com>
Wed, 19 Oct 2016 14:52:39 +0000 (16:52 +0200)
committerAleksander Mistewicz <a.mistewicz@samsung.com>
Tue, 10 Jan 2017 09:49:05 +0000 (10:49 +0100)
commit5211c9869327081c197a8d352cc79fd83d6093d9
tree53b3b307f8b73cd5a1fadae1c9b19e98c322da96tree | snapshot
parent8af09112f889409415c66ed3ad687b6ebb7f484ecommit | diff
Replace urllib2 with requests in crawler.py

It uses urllib3 connection pooling what dramatically increases
performance. Also changed link discovery to follow latest guide.

Package "python-requests" is now required.

Change-Id: Ide3e3c9dd290c2ce01137c00fa2f01cd29e35712
Signed-off-by: Aleksander Mistewicz <a.mistewicz@samsung.com>
tsp/scripts/crawler.py diff | blob | history
Domain: SCM / Uncategorized;