1 Star 0 Fork 1

Mike_W / downloader

forked from python / downloader 
加入 Gitee
与超过 1200万 开发者一起发现、参与优秀开源项目,私有仓库也完全免费 :)
免费加入
克隆/下载
downloader_processpool.py 794 Bytes
一键复制 编辑 原始数据 按行查看 历史
Jiabao 提交于 2017-07-14 17:23 . 添加线程池
#!/usr/bin/python
# -*- coding: utf-8 -*-
from multiprocessing import Pool
from downloader import Downloader
def _download_process(url, file_path, file_name, session, forced, thread_num):
downloader = Downloader(session)
downloader.download(url, file_path, file_name, forced, thread_num)
class DownloaderProcessPool(object):
def __init__(self, pool_size=5) -> None:
super().__init__()
if 0 >= pool_size:
pool_size = 5
self._pool = Pool(pool_size)
def wait(self):
self._pool.close()
self._pool.join()
def add_task(self, url, file_path='', file_name='', session=None, forced=False, thread_num=5):
self._pool.apply_async(func=_download_process, args=(url, file_path, file_name, session, forced, thread_num,))
Python
1
https://gitee.com/Mike_W/downloader.git
git@gitee.com:Mike_W/downloader.git
Mike_W
downloader
downloader
master

搜索帮助