我已经用Django配置了 VPS 服务器,并且我正在运行一个计划任务,我正在使用CELERY。我正在使用主管来运行芹菜。
当我直接运行 celery 命令时,所有的事情都很好,我的计划作业也可以工作(如果我点击运行任务按钮,任务也会快速启动)。
但是,当我使用主管配置 celery 时,它从不运行任务(在计划时),并且运行任务在第一次也没有工作(当我尝试 4-5 次任务开始运行时)。
这是我的主管文件-
; ==================================
; celery worker supervisor example
; ==================================
; the name of your supervisord program
[program:ip_tambola]
#Set full path to celery program if using virtualenv
command=/home/django/venv/bin/celery -A Tambola worker --beat --scheduler django_celery_beat.schedulers:DatabaseScheduler --loglevel=debug
#The directory to your Django project
directory=/home/django/ip_tambola/Tambola
#If supervisord is run as the root user, switch users to this UNIX user account before doing any pr
user=root
#Supervisor will start as many instances of this program as named by numprocs
numprocs=1
#Put process stdout output in this file
stdout_logfile=/home/django/ip_tambola/celery_out.log
#Put process stderr output in this file
stderr_logfile=/home/django/ip_tambola/celery_err.log
#If true, this program will start automatically when supervisord is started
autostart=true
#May be one of false, unexpected, or true. If false, the process will never be autorestarted. If un
autorestart=true
#The total number of seconds which the program needs to stay running after a startup to consider th
startsecs=10
#Need to wait for currently executing tasks to finish at shutdown. ; Increase this if you have very
stopwaitsecs = 10000
# When resorting to send SIGKILL to the program to terminate it ; send SIGKILL to its whole process
killasgroup=true
#if your broker is supervised, set its priority higher so it starts first
priority=999
当我看到这个主管的错误日志时,我看到Schedule Changed但是当我的任务运行时间到来时,什么也没有发生。
错误日志 -
worker: Warm shutdown (MainProcess)
[2021-06-20 17:30:39,010: INFO/MainProcess] beat: Shutting down...
/home/django/venv/lib/python3.8/site-packages/celery/platforms.py:796: RuntimeWarning: You're running the worker with superuser privileges: this is
absolutely not recommended!
Please specify a different user using the --uid option.
User information: uid=0 euid=0 gid=0 egid=0
warnings.warn(RuntimeWarning(ROOT_DISCOURAGED.format(
[2021-06-20 17:30:43,441: DEBUG/MainProcess] | Worker: Preparing bootsteps.
[2021-06-20 17:30:43,443: DEBUG/MainProcess] | Worker: Building graph...
[2021-06-20 17:30:43,444: DEBUG/MainProcess] | Worker: New boot order: {Beat, Timer, Hub, Pool, Autoscaler, StateDB, Consumer}
[2021-06-20 17:30:43,460: DEBUG/MainProcess] | Consumer: Preparing bootsteps.
[2021-06-20 17:30:43,461: DEBUG/MainProcess] | Consumer: Building graph...
[2021-06-20 17:30:43,501: DEBUG/MainProcess] | Consumer: New boot order: {Connection, Events, Heart, Agent, Mingle, Tasks, Control, Gossip, event loop}
[2021-06-20 17:30:43,527: DEBUG/MainProcess] | Worker: Starting Beat
[2021-06-20 17:30:43,530: DEBUG/MainProcess] ^-- substep ok
[2021-06-20 17:30:43,532: DEBUG/MainProcess] | Worker: Starting Hub
[2021-06-20 17:30:43,532: DEBUG/MainProcess] ^-- substep ok
[2021-06-20 17:30:43,532: DEBUG/MainProcess] | Worker: Starting Pool
[2021-06-20 17:30:43,538: INFO/Beat] beat: Starting...
[2021-06-20 17:30:43,542: DEBUG/Beat] DatabaseScheduler: initial read
[2021-06-20 17:30:43,542: DEBUG/Beat] Writing entries...
[2021-06-20 17:30:43,543: DEBUG/Beat] DatabaseScheduler: Fetching database schedule
[2021-06-20 17:30:43,560: DEBUG/Beat] Current schedule:
<ModelEntry: celery.backend_cleanup celery.backend_cleanup(*[], **{}) <crontab: 0 4
* *
* (m/h/d/dM/MY), Asia/Kolkata>
>
[2021-06-20 17:30:43,588: DEBUG/Beat] beat: Ticking with max interval->5.00 seconds
[2021-06-20 17:30:43,594: DEBUG/Beat] beat: Waking up in 5.00 seconds.
[2021-06-20 17:30:43,762: DEBUG/MainProcess] ^-- substep ok
[2021-06-20 17:30:43,763: DEBUG/MainProcess] | Worker: Starting Consumer
[2021-06-20 17:30:43,763: DEBUG/MainProcess] | Consumer: Starting Connection
[2021-06-20 17:30:43,782: INFO/MainProcess] Connected to redis://localhost:6379/2
[2021-06-20 17:30:43,782: DEBUG/MainProcess] ^-- substep ok
[2021-06-20 17:30:43,782: DEBUG/MainProcess] | Consumer: Starting Events
[2021-06-20 17:30:43,792: DEBUG/MainProcess] ^-- substep ok
[2021-06-20 17:30:43,792: DEBUG/MainProcess] | Consumer: Starting Heart
[2021-06-20 17:30:43,796: DEBUG/MainProcess] ^-- substep ok
[2021-06-20 17:30:43,796: DEBUG/MainProcess] | Consumer: Starting Mingle
[2021-06-20 17:30:43,797: INFO/MainProcess] mingle: searching for neighbors
[2021-06-20 17:30:44,820: INFO/MainProcess] mingle: all alone
[2021-06-20 17:30:44,821: DEBUG/MainProcess] ^-- substep ok
[2021-06-20 17:30:44,821: DEBUG/MainProcess] | Consumer: Starting Tasks
[2021-06-20 17:30:44,825: DEBUG/MainProcess] ^-- substep ok
[2021-06-20 17:30:44,826: DEBUG/MainProcess] | Consumer: Starting Control
[2021-06-20 17:30:44,829: DEBUG/MainProcess] ^-- substep ok
[2021-06-20 17:30:44,829: DEBUG/MainProcess] | Consumer: Starting Gossip
[2021-06-20 17:30:44,832: DEBUG/MainProcess] ^-- substep ok
[2021-06-20 17:30:44,833: DEBUG/MainProcess] | Consumer: Starting event loop
[2021-06-20 17:30:44,833: DEBUG/MainProcess] | Worker: Hub.register Pool...
[2021-06-20 17:30:44,834: WARNING/MainProcess] /home/django/venv/lib/python3.8/site-packages/celery/fixups/django.py:203: UserWarning: Using settings.DEBUG leads to a memory
leak, never use this setting in production environments!
warnings.warn('''Using settings.DEBUG leads to a memory
[2021-06-20 17:30:44,835: INFO/MainProcess] celery@django-ubuntu-s-2vcpu-4gb-blr1-01 ready.
[2021-06-20 17:30:44,835: DEBUG/MainProcess] basic.qos: prefetch_count->8
[2021-06-20 17:30:48,599: DEBUG/Beat] beat: Synchronizing schedule...
[2021-06-20 17:30:48,599: DEBUG/Beat] Writing entries...
[2021-06-20 17:30:48,603: DEBUG/Beat] beat: Waking up in 5.00 seconds.
[2021-06-20 17:30:53,609: DEBUG/Beat] beat: Waking up in 5.00 seconds.
[2021-06-20 17:30:58,614: DEBUG/Beat] beat: Waking up in 5.00 seconds.
worker: Warm shutdown (MainProcess)
[2021-06-20 17:31:00,211: DEBUG/MainProcess] | Worker: Closing Beat...
[2021-06-20 17:31:00,211: DEBUG/MainProcess] | Worker: Closing Hub...
[2021-06-20 17:31:00,211: DEBUG/MainProcess] | Worker: Closing Pool...
[2021-06-20 17:31:00,212: DEBUG/MainProcess] | Worker: Closing Consumer...
[2021-06-20 17:31:00,212: DEBUG/MainProcess] | Worker: Stopping Consumer...
[2021-06-20 17:31:00,212: DEBUG/MainProcess] | Consumer: Closing Connection...
[2021-06-20 17:31:00,212: DEBUG/MainProcess] | Consumer: Closing Events...
[2021-06-20 17:31:00,212: DEBUG/MainProcess] | Consumer: Closing Heart...
[2021-06-20 17:31:00,212: DEBUG/MainProcess] | Consumer: Closing Mingle...
[2021-06-20 17:31:00,212: DEBUG/MainProcess] | Consumer: Closing Tasks...
[2021-06-20 17:31:00,212: DEBUG/MainProcess] | Consumer: Closing Control...
[2021-06-20 17:31:00,212: DEBUG/MainProcess] | Consumer: Closing Gossip...
[2021-06-20 17:31:00,212: DEBUG/MainProcess] | Consumer: Closing event loop...
[2021-06-20 17:31:00,213: DEBUG/MainProcess] | Consumer: Stopping event loop...
[2021-06-20 17:31:00,213: DEBUG/MainProcess] | Consumer: Stopping Gossip...
[2021-06-20 17:31:00,219: DEBUG/MainProcess] | Consumer: Stopping Control...
[2021-06-20 17:31:00,221: DEBUG/MainProcess] | Consumer: Stopping Tasks...
[2021-06-20 17:31:00,221: DEBUG/MainProcess] Canceling task consumer...
[2021-06-20 17:31:00,222: DEBUG/MainProcess] | Consumer: Stopping Mingle...
[2021-06-20 17:31:00,222: DEBUG/MainProcess] | Consumer: Stopping Heart...
[2021-06-20 17:31:00,224: DEBUG/MainProcess] | Consumer: Stopping Events...
[2021-06-20 17:31:00,224: DEBUG/MainProcess] | Consumer: Stopping Connection...
[2021-06-20 17:31:00,224: DEBUG/MainProcess] | Worker: Stopping Pool...
[2021-06-20 17:31:01,234: DEBUG/MainProcess] | Worker: Stopping Hub...
[2021-06-20 17:31:01,234: DEBUG/MainProcess] | Worker: Stopping Beat...
[2021-06-20 17:31:01,234: INFO/MainProcess] beat: Shutting down...
[2021-06-20 17:31:01,235: DEBUG/Beat] Writing entries...
[2021-06-20 17:31:01,235: DEBUG/Beat] Writing entries...
[2021-06-20 17:31:01,241: DEBUG/MainProcess] | Consumer: Shutdown Gossip...
[2021-06-20 17:31:01,241: DEBUG/MainProcess] | Consumer: Shutdown Control...
[2021-06-20 17:31:01,241: DEBUG/MainProcess] | Consumer: Shutdown Tasks...
[2021-06-20 17:31:01,241: DEBUG/MainProcess] Canceling task consumer...
[2021-06-20 17:31:01,241: DEBUG/MainProcess] Closing consumer channel...
[2021-06-20 17:31:01,242: DEBUG/MainProcess] | Consumer: Shutdown Heart...
[2021-06-20 17:31:01,242: DEBUG/MainProcess] | Consumer: Shutdown Events...
[2021-06-20 17:31:01,243: DEBUG/MainProcess] | Consumer: Shutdown Connection...
[2021-06-20 17:31:01,244: DEBUG/MainProcess] removing tasks from inqueue until task handler finished
/home/django/venv/lib/python3.8/site-packages/celery/platforms.py:796: RuntimeWarning: You're running the worker with superuser privileges: this is
absolutely not recommended!
Please specify a different user using the --uid option.
User information: uid=0 euid=0 gid=0 egid=0
warnings.warn(RuntimeWarning(ROOT_DISCOURAGED.format(
[2021-06-20 17:31:03,820: DEBUG/MainProcess] | Worker: Preparing bootsteps.
[2021-06-20 17:31:03,822: DEBUG/MainProcess] | Worker: Building graph...
[2021-06-20 17:31:03,823: DEBUG/MainProcess] | Worker: New boot order: {StateDB, Beat, Timer, Hub, Pool, Autoscaler, Consumer}
[2021-06-20 17:31:03,843: DEBUG/MainProcess] | Consumer: Preparing bootsteps.
[2021-06-20 17:31:03,843: DEBUG/MainProcess] | Consumer: Building graph...
[2021-06-20 17:31:03,877: DEBUG/MainProcess] | Consumer: New boot order: {Connection, Agent, Events, Heart, Mingle, Tasks, Control, Gossip, event loop}
[2021-06-20 17:31:03,904: DEBUG/MainProcess] | Worker: Starting Beat
[2021-06-20 17:31:03,908: DEBUG/MainProcess] ^-- substep ok
[2021-06-20 17:31:03,909: DEBUG/MainProcess] | Worker: Starting Hub
[2021-06-20 17:31:03,909: DEBUG/MainProcess] ^-- substep ok
[2021-06-20 17:31:03,909: DEBUG/MainProcess] | Worker: Starting Pool
[2021-06-20 17:31:03,925: INFO/Beat] beat: Starting...
[2021-06-20 17:31:03,937: DEBUG/Beat] DatabaseScheduler: initial read
[2021-06-20 17:31:03,937: DEBUG/Beat] Writing entries...
[2021-06-20 17:31:03,937: DEBUG/Beat] DatabaseScheduler: Fetching database schedule
[2021-06-20 17:31:03,968: DEBUG/Beat] Current schedule:
<ModelEntry: celery.backend_cleanup celery.backend_cleanup(*[], **{}) <crontab: 0 4
* *
* (m/h/d/dM/MY), Asia/Kolkata>
>
[2021-06-20 17:31:04,019: DEBUG/Beat] beat: Ticking with max interval->5.00 seconds
[2021-06-20 17:31:04,032: DEBUG/Beat] beat: Waking up in 5.00 seconds.
[2021-06-20 17:31:04,208: DEBUG/MainProcess] ^-- substep ok
[2021-06-20 17:31:04,209: DEBUG/MainProcess] | Worker: Starting Consumer
[2021-06-20 17:31:04,209: DEBUG/MainProcess] | Consumer: Starting Connection
[2021-06-20 17:31:04,238: INFO/MainProcess] Connected to redis://localhost:6379/2
[2021-06-20 17:31:04,238: DEBUG/MainProcess] ^-- substep ok
[2021-06-20 17:31:04,238: DEBUG/MainProcess] | Consumer: Starting Events
[2021-06-20 17:31:04,248: DEBUG/MainProcess] ^-- substep ok
[2021-06-20 17:31:04,248: DEBUG/MainProcess] | Consumer: Starting Heart
[2021-06-20 17:31:04,255: DEBUG/MainProcess] ^-- substep ok
[2021-06-20 17:31:04,255: DEBUG/MainProcess] | Consumer: Starting Mingle
[2021-06-20 17:31:04,256: INFO/MainProcess] mingle: searching for neighbors
[2021-06-20 17:31:05,293: INFO/MainProcess] mingle: all alone
[2021-06-20 17:31:05,294: DEBUG/MainProcess] ^-- substep ok
[2021-06-20 17:31:05,294: DEBUG/MainProcess] | Consumer: Starting Tasks
[2021-06-20 17:31:05,300: DEBUG/MainProcess] ^-- substep ok
[2021-06-20 17:31:05,300: DEBUG/MainProcess] | Consumer: Starting Control
[2021-06-20 17:31:05,306: DEBUG/MainProcess] ^-- substep ok
[2021-06-20 17:31:05,306: DEBUG/MainProcess] | Consumer: Starting Gossip
[2021-06-20 17:31:05,312: DEBUG/MainProcess] ^-- substep ok
[2021-06-20 17:31:05,313: DEBUG/MainProcess] | Consumer: Starting event loop
[2021-06-20 17:31:05,313: DEBUG/MainProcess] | Worker: Hub.register Pool...
[2021-06-20 17:31:05,315: WARNING/MainProcess] /home/django/venv/lib/python3.8/site-packages/celery/fixups/django.py:203: UserWarning: Using settings.DEBUG leads to a memory
leak, never use this setting in production environments!
warnings.warn('''Using settings.DEBUG leads to a memory
[2021-06-20 17:31:05,315: INFO/MainProcess] celery@django-ubuntu-s-2vcpu-4gb-blr1-01 ready.
[2021-06-20 17:31:05,316: DEBUG/MainProcess] basic.qos: prefetch_count->8
[2021-06-20 17:31:09,037: DEBUG/Beat] beat: Synchronizing schedule...
[2021-06-20 17:31:09,037: DEBUG/Beat] Writing entries...
[2021-06-20 17:31:09,041: DEBUG/Beat] beat: Waking up in 5.00 seconds.
[2021-06-20 17:31:14,051: DEBUG/Beat] beat: Waking up in 5.00 seconds.
[2021-06-20 17:31:19,060: DEBUG/Beat] beat: Waking up in 5.00 seconds.
[2021-06-20 17:31:24,065: DEBUG/Beat] beat: Waking up in 5.00 seconds.
[2021-06-20 17:31:29,074: DEBUG/Beat] beat: Waking up in 5.00 seconds.
[2021-06-20 17:31:34,083: DEBUG/Beat] beat: Waking up in 5.00 seconds.
[2021-06-20 17:31:39,090: DEBUG/Beat] beat: Waking up in 5.00 seconds.
[2021-06-20 17:31:44,097: DEBUG/Beat] beat: Waking up in 5.00 seconds.
[2021-06-20 17:31:49,104: INFO/Beat] DatabaseScheduler: Schedule changed.
[2021-06-20 17:31:49,104: DEBUG/Beat] Writing entries...
[2021-06-20 17:31:49,104: DEBUG/Beat] DatabaseScheduler: Fetching database schedule
[2021-06-20 17:31:49,111: DEBUG/Beat] Current schedule:
<ModelEntry: celery.backend_cleanup celery.backend_cleanup(*[], **{}) <crontab: 0 4
* *
* (m/h/d/dM/MY), Asia/Kolkata>
>
<ModelEntry: TambolaGame game.tasks.run_game(*[], **{}) <clocked: 2021-06-20 12:10:00+00:00>>
[2021-06-20 17:31:49,115: DEBUG/Beat] beat: Waking up in 5.00 seconds.
[2021-06-20 17:31:54,123: DEBUG/Beat] beat: Waking up in 5.00 seconds.
[2021-06-20 17:31:59,132: DEBUG/Beat] beat: Waking up in 5.00 seconds.
[2021-06-20 17:32:04,142: DEBUG/Beat] beat: Waking up in 5.00 seconds.
[2021-06-20 17:32:09,152: DEBUG/Beat] beat: Waking up in 5.00 seconds.
[2021-06-20 17:32:14,162: DEBUG/Beat] beat: Waking up in 5.00 seconds.
[2021-06-20 17:32:19,171: DEBUG/Beat] beat: Waking up in 5.00 seconds.
[2021-06-20 17:32:24,180: DEBUG/Beat] beat: Waking up in 5.00 seconds.
[2021-06-20 17:32:29,189: DEBUG/Beat] beat: Waking up in 5.00 seconds.
[2021-06-20 17:32:34,198: DEBUG/Beat] beat: Waking up in 5.00 seconds.
[2021-06-20 17:32:39,204: INFO/Beat] DatabaseScheduler: Schedule changed.
[2021-06-20 17:32:39,204: DEBUG/Beat] Writing entries...
[2021-06-20 17:32:39,205: DEBUG/Beat] DatabaseScheduler: Fetching database schedule
[2021-06-20 17:32:39,211: DEBUG/Beat] Current schedule:
<ModelEntry: celery.backend_cleanup celery.backend_cleanup(*[], **{}) <crontab: 0 4
* *
* (m/h/d/dM/MY), Asia/Kolkata>
>
<ModelEntry: TambolaGame game.tasks.run_game(*[], **{}) <clocked: 2021-06-20 12:20:00+00:00>>
[2021-06-20 17:32:39,216: DEBUG/Beat] beat: Waking up in 5.00 seconds.
[2021-06-20 17:32:44,226: DEBUG/Beat] beat: Waking up in 5.00 seconds.
[2021-06-20 17:32:49,233: DEBUG/Beat] beat: Waking up in 5.00 seconds.
[2021-06-20 17:32:54,241: DEBUG/Beat] beat: Waking up in 5.00 seconds.
[2021-06-20 17:32:59,250: DEBUG/Beat] beat: Waking up in 5.00 seconds.
[2021-06-20 17:33:04,258: DEBUG/Beat] beat: Waking up in 5.00 seconds.
[2021-06-20 17:33:09,268: DEBUG/Beat] beat: Waking up in 5.00 seconds.
[2021-06-20 17:33:14,274: DEBUG/Beat] beat: Waking up in 5.00 seconds.
[2021-06-20 17:33:19,284: DEBUG/Beat] beat: Waking up in 5.00 seconds.
[2021-06-20 17:33:24,295: DEBUG/Beat] beat: Waking up in 5.00 seconds.
[2021-06-20 17:33:29,304: DEBUG/Beat] beat: Waking up in 5.00 seconds.
[2021-06-20 17:33:34,312: DEBUG/Beat] beat: Waking up in 5.00 seconds.
[2021-06-20 17:33:39,317: DEBUG/Beat] beat: Waking up in 5.00 seconds.
[2021-06-20 17:33:44,325: DEBUG/Beat] beat: Waking up in 5.00 seconds.
[2021-06-20 17:33:49,335: DEBUG/Beat] beat: Waking up in 5.00 seconds.
[2021-06-20 17:33:54,342: DEBUG/Beat] beat: Waking up in 5.00 seconds.
[2021-06-20 17:33:59,351: DEBUG/Beat] beat: Waking up in 5.00 seconds.
[2021-06-20 17:34:04,359: DEBUG/Beat] beat: Waking up in 5.00 seconds.
[2021-06-20 17:34:09,365: DEBUG/Beat] beat: Synchronizing schedule...
[2021-06-20 17:34:09,365: DEBUG/Beat] Writing entries...