我编写了一个执行多处理并执行扫描、获取和设置到 Redis 的程序。我们选择 Redis 的原因是为了加快速度。
有没有人有什么建议。我尝试在 get 语句周围放置一个重试循环(对于 set 也可以这样做),但 Scan 语句会更加棘手。是否有一些我扫描更改或增加的参数来避免这种情况?
错误:
redis.exceptions.ConnectionError: Error 10048 connecting to 192.168.5.51:6379. Only one usage of each socket address (protocol/network address/port) is normally permitted.
File "C:\Apps\ProcessData\redis\connection.py", line 1192, in get_connection
connection.connect()
File "C:\Apps\ProcessData\redis\connection.py", line 563, in connect
raise ConnectionError(self._error_message(e))
File "C:\Apps\ProcessData\redis\connection.py", line 563, in connect
raise ConnectionError(self._error_message(e))
我认为错误的第二部分是这样的:等待它再次发生以获得确切的文本:
Error 10048 connecting to 192.168.5.51:6379. Only one usage of each socket address (protocol/network address/port) is normally permitted.
对于执行 redis-get 的代码,我正在尝试以下操作:
redis_max_retries = 72
redis_retries = 0
redis_get_success = False
sleep_time_in_seconds = .1
while not redis_get_success and redis_retries < redis_max_retries:
try:
json_str = redis_obj.get(redis_key)
redis_get_success = True
except redis.exceptions.ConnectionError as e:
redis_retries += 1
time.sleep(sleep_time_in_seconds)
if not redis_get_success:
print("redis_retries=", redis_retries, " on json_str = redis_obj.get(redis_key) in process_intervals" )
sys.exit(0)
但是我在扫描时也遇到了错误,这看起来更难重试。
for keybatch in batcher(redis_obj.scan_iter(key_pattern), 1500):
batch_counter += 1
# print(batch_counter, "keybatch=", keybatch)
for key in keybatch:
if key is not None:
#print("Trying key=", key)
matching_keys_found += 1
etc...