利用python多線程以及文件讀行高效率實(shí)現(xiàn)redis過期時(shí)間批量快速修改。

• 更新300萬數(shù)據(jù)預(yù)計(jì)耗時(shí)在20分鐘。

• 1.在命令行中鍵入導(dǎo)出所有keys

redis-cli -h 127.0.0.1 -a password -n 0 keys "*" > keys.txt

• 2.編寫python腳本

import redis
from concurrent.futures import ThreadPoolExecutor

pool = redis.ConnectionPool(host="127.0.0.1 ", password="password",
                            port=6379, db=0)
r = redis.StrictRedis(connection_pool=pool)
executor = ThreadPoolExecutor(max_workers=100)


def change_exp(line):
    line = line.strip('\n')
    r.expire(line, 2592000)
    return line


result = []
count = 0
with open("keys.txt") as f:
    tasks = [executor.submit(change_exp, line) for line in f.readlines()]
    for task in tasks:
        if task.done():
            result.append(task.result())

• 3.執(zhí)行腳本

python ./test.py