/home/scrapyd/scrapydweb_data/history_log/timer_tasks_history.log ################################################## [2024-03-20 17:09:24,186] WARNING in apscheduler: Shutting down the scheduler for timer tasks gracefully, wait until all currently executing tasks are finished [2024-03-20 17:09:24,192] WARNING in apscheduler: The main pid is 3893. Kill it manually if you don't want to wait [2024-05-25 20:23:41,080] WARNING in apscheduler.executors.default: Run time of job "create_jobs_snapshot (trigger: interval[0:05:00], next run at: 2024-05-25 20:22:18 UTC)" was missed by 0:01:22.405491 [2024-05-25 20:43:00,120] WARNING in apscheduler.executors.default: Run time of job "create_jobs_snapshot (trigger: interval[0:05:00], next run at: 2024-05-25 20:32:18 UTC)" was missed by 0:14:43.812494 [2024-05-25 21:00:07,585] WARNING in apscheduler.executors.default: Run time of job "create_jobs_snapshot (trigger: interval[0:05:00], next run at: 2024-05-25 20:47:18 UTC)" was missed by 0:17:48.490824 [2024-05-25 21:10:00,434] WARNING in apscheduler.executors.default: Run time of job "create_jobs_snapshot (trigger: interval[0:05:00], next run at: 2024-05-25 21:12:18 UTC)" was missed by 0:02:41.759428 [2024-06-29 21:17:34,751] WARNING in apscheduler.executors.default: Run time of job "create_jobs_snapshot (trigger: interval[0:05:00], next run at: 2024-06-29 21:19:54 UTC)" was missed by 0:02:40.447037 [2024-07-23 11:44:31,305] WARNING in apscheduler.executors.default: Run time of job "create_jobs_snapshot (trigger: interval[0:05:00], next run at: 2024-07-22 21:47:57 UTC)" was missed by 13:56:33.958700 [2024-07-23 11:47:24,975] WARNING in apscheduler.executors.default: Run time of job "create_jobs_snapshot (trigger: interval[0:05:00], next run at: 2024-07-23 11:47:57 UTC)" was missed by 0:04:27.628715 [2025-02-13 19:22:22,366] WARNING in apscheduler.executors.default: Run time of job "create_jobs_snapshot (trigger: interval[0:05:00], next run at: 2025-02-13 19:26:02 UTC)" was missed by 0:01:12.996266 [2025-02-13 19:28:06,386] WARNING in apscheduler.executors.default: Run time of job "create_jobs_snapshot (trigger: interval[0:05:00], next run at: 2025-02-13 19:31:02 UTC)" was missed by 0:02:03.458472 [2025-02-14 17:14:01,813] WARNING in apscheduler.executors.default: Run time of job "create_jobs_snapshot (trigger: interval[0:05:00], next run at: 2025-02-14 16:46:02 UTC)" was missed by 0:30:59.367210 [2025-02-18 21:31:29,941] WARNING in apscheduler.executors.default: Run time of job "create_jobs_snapshot (trigger: interval[0:05:00], next run at: 2025-02-18 21:23:34 UTC)" was missed by 0:07:55.816627 [2025-11-19 22:06:31,228] WARNING in apscheduler: Add task #2 (task_2) successfully, next run at 2025-11-19 22:06:31.219953+00:00. [2025-11-19 22:06:31,228] WARNING in apscheduler: Added job_instance: { "id": "2", "kwargs": { "task_id": 2 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task_2", "next_run_time": "datetime.datetime(2025, 11, 19, 22, 6, 31, 219953, tzinfo=)", "trigger": "" } [2025-11-19 22:21:28,113] WARNING in apscheduler: Update task #2 (task #2 - edit) successfully, next run at 2025-11-19 22:25:00+00:00. [2025-11-19 22:21:28,114] WARNING in apscheduler: Updated job_instance: { "id": "2", "kwargs": { "task_id": 2 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task #2 - edit", "next_run_time": "datetime.datetime(2025, 11, 19, 22, 25, tzinfo=)", "trigger": "" } [2025-11-20 07:36:51,797] WARNING in apscheduler: Update task #2 (task #2 - edit) successfully, next run at 2025-11-20 07:40:00+00:00. [2025-11-20 07:36:51,798] WARNING in apscheduler: Updated job_instance: { "id": "2", "kwargs": { "task_id": 2 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task #2 - edit", "next_run_time": "datetime.datetime(2025, 11, 20, 7, 40, tzinfo=)", "trigger": "" } [2025-11-20 18:49:33,992] WARNING in apscheduler: EVENT_JOB_REMOVED: {'alias': None, 'code': 1024, 'job_id': '2', 'jobstore': 'default'} [2025-11-24 18:08:32,689] WARNING in apscheduler: Add task #3 (task_3) successfully, next run at 2025-11-24 18:08:32.682399+00:00. [2025-11-24 18:08:32,689] WARNING in apscheduler: Added job_instance: { "id": "3", "kwargs": { "task_id": 3 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task_3", "next_run_time": "datetime.datetime(2025, 11, 24, 18, 8, 32, 682399, tzinfo=)", "trigger": "" } [2025-11-24 18:10:25,564] WARNING in apscheduler: EVENT_JOB_REMOVED: {'alias': None, 'code': 1024, 'job_id': '3', 'jobstore': 'default'} [2025-11-24 18:28:52,952] WARNING in apscheduler: Update task #3 (task #3 - edit) successfully, next run at 2025-11-24 18:30:00+00:00. [2025-11-24 18:28:52,953] WARNING in apscheduler: Updated job_instance: { "id": "3", "kwargs": { "task_id": 3 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task #3 - edit", "next_run_time": "datetime.datetime(2025, 11, 24, 18, 30, tzinfo=)", "trigger": "" } [2025-11-24 18:29:20,734] WARNING in apscheduler: EVENT_JOB_REMOVED: {'alias': None, 'code': 1024, 'job_id': '3', 'jobstore': 'default'} [2025-11-24 18:38:09,693] WARNING in apscheduler: Add task #4 (task_4) successfully, next run at 2025-11-24 18:38:09.686385+00:00. [2025-11-24 18:38:09,694] WARNING in apscheduler: Added job_instance: { "id": "4", "kwargs": { "task_id": 4 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task_4", "next_run_time": "datetime.datetime(2025, 11, 24, 18, 38, 9, 686385, tzinfo=)", "trigger": "" } [2025-11-24 18:38:57,962] WARNING in apscheduler: Update task #4 (task #4 - edit) successfully, next run at 2025-11-24 18:40:00+00:00. [2025-11-24 18:38:57,962] WARNING in apscheduler: Updated job_instance: { "id": "4", "kwargs": { "task_id": 4 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task #4 - edit", "next_run_time": "datetime.datetime(2025, 11, 24, 18, 40, tzinfo=)", "trigger": "" } [2025-11-24 23:05:17,097] WARNING in apscheduler: EVENT_JOB_REMOVED: {'alias': None, 'code': 1024, 'job_id': '4', 'jobstore': 'default'} [2025-11-25 21:25:22,905] WARNING in apscheduler: Add task #5 (task_5) successfully, next run at 2025-11-25 21:25:22.898537+00:00. [2025-11-25 21:25:22,905] WARNING in apscheduler: Added job_instance: { "id": "5", "kwargs": { "task_id": 5 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task_5", "next_run_time": "datetime.datetime(2025, 11, 25, 21, 25, 22, 898537, tzinfo=)", "trigger": "" } [2025-11-25 21:30:22,180] WARNING in apscheduler: EVENT_JOB_REMOVED: {'alias': None, 'code': 1024, 'job_id': '5', 'jobstore': 'default'} [2025-11-25 21:38:15,415] WARNING in apscheduler: Add task #6 (task_6) successfully, next run at 2025-11-25 21:38:15.411664+00:00. [2025-11-25 21:38:15,416] WARNING in apscheduler: Added job_instance: { "id": "6", "kwargs": { "task_id": 6 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task_6", "next_run_time": "datetime.datetime(2025, 11, 25, 21, 38, 15, 411664, tzinfo=)", "trigger": "" } [2025-11-25 21:40:23,441] WARNING in apscheduler: EVENT_JOB_REMOVED: {'alias': None, 'code': 1024, 'job_id': '6', 'jobstore': 'default'} [2025-11-25 21:47:53,350] WARNING in apscheduler: Add task #7 (task_7) successfully, next run at 2025-11-25 21:47:53.345959+00:00. [2025-11-25 21:47:53,350] WARNING in apscheduler: Added job_instance: { "id": "7", "kwargs": { "task_id": 7 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task_7", "next_run_time": "datetime.datetime(2025, 11, 25, 21, 47, 53, 345959, tzinfo=)", "trigger": "" } [2025-11-25 21:48:19,390] WARNING in apscheduler: EVENT_JOB_REMOVED: {'alias': None, 'code': 1024, 'job_id': '7', 'jobstore': 'default'} [2025-11-25 21:50:53,853] WARNING in apscheduler: Add task #9 (task_9) successfully, next run at 2025-11-25 21:50:53.846966+00:00. [2025-11-25 21:50:53,853] WARNING in apscheduler: Added job_instance: { "id": "9", "kwargs": { "task_id": 9 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task_9", "next_run_time": "datetime.datetime(2025, 11, 25, 21, 50, 53, 846966, tzinfo=)", "trigger": "" } [2025-11-25 21:51:36,025] WARNING in apscheduler: EVENT_JOB_REMOVED: {'alias': None, 'code': 1024, 'job_id': '9', 'jobstore': 'default'} [2025-11-25 21:52:23,136] WARNING in apscheduler: Add task #10 (task_10) successfully, next run at 2025-11-25 21:52:23.126646+00:00. [2025-11-25 21:52:23,136] WARNING in apscheduler: Added job_instance: { "id": "10", "kwargs": { "task_id": 10 }, "max_instances": 1, "misfire_grace_time": 600, "name": "task_10", "next_run_time": "datetime.datetime(2025, 11, 25, 21, 52, 23, 126646, tzinfo=)", "trigger": "" } [2026-02-18 19:03:02,887] WARNING in apscheduler: Fail to execute task #10 (None) on node 1, would retry later: Request got {'status_code': 500, 'status': 'error', 'message': '500 Internal Server Error: The server encountered an internal error and was unable to complete your request. Either the server is overloaded or there is an error in the application.'}