Failed jobs do not become expired to allow you to re-queue them without any
time pressure. You should re-queue or delete them manually, or apply AutomaticRetry(OnAttemptsExceeded = AttemptsExceededAction.Delete)
attribute to delete them automatically.
An exception occurred during performance of the job. Fewer details...
11/17/2025 02:01:21
System.InvalidOperationException
An exception has been raised that is likely due to a transient failure.
System.InvalidOperationException: An exception has been raised that is likely due to a transient failure.
---> Npgsql.PostgresException (0x80004005): 57P03: the database system is shutting down
at Npgsql.Internal.NpgsqlConnector.<ReadMessage>g__ReadMessageLong|215_0(NpgsqlConnectorconnector, Booleanasync, DataRowLoadingModedataRowLoadingMode, BooleanreadingNotifications, BooleanisReadingPrependedMessage)
at Npgsql.Internal.NpgsqlConnector.Authenticate(Stringusername, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.Internal.NpgsqlConnector.<Open>g__OpenCore|195_1(NpgsqlConnectorconn, SslModesslMode, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken, BooleanisFirstAttempt)
at Npgsql.Internal.NpgsqlConnector.Open(NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.ConnectorPool.OpenNewConnector(NpgsqlConnectionconn, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.ConnectorPool.<Get>g__RentAsync|28_0(NpgsqlConnectionconn, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.NpgsqlConnection.<Open>g__OpenAsync|45_0(Booleanasync, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.Storage.RelationalConnection.OpenInternalAsync(BooleanerrorsExpected, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.Storage.RelationalConnection.OpenInternalAsync(BooleanerrorsExpected, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.Storage.RelationalConnection.OpenAsync(CancellationTokencancellationToken, BooleanerrorsExpected)
at Microsoft.EntityFrameworkCore.Storage.RelationalConnection.BeginTransactionAsync(IsolationLevelisolationLevel, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.Storage.RelationalConnection.BeginTransactionAsync(CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.Update.Internal.BatchExecutor.ExecuteAsync(IEnumerable`1commandBatches, IRelationalConnectionconnection, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.Update.Internal.BatchExecutor.ExecuteAsync(IEnumerable`1commandBatches, IRelationalConnectionconnection, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.Update.Internal.BatchExecutor.ExecuteAsync(IEnumerable`1commandBatches, IRelationalConnectionconnection, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.ChangeTracking.Internal.StateManager.SaveChangesAsync(IList`1entriesToSave, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.ChangeTracking.Internal.StateManager.SaveChangesAsync(StateManagerstateManager, BooleanacceptAllChangesOnSuccess, CancellationTokencancellationToken)
at Npgsql.EntityFrameworkCore.PostgreSQL.Storage.Internal.NpgsqlExecutionStrategy.ExecuteAsync[TState,TResult](TStatestate, Func`4operation, Func`4verifySucceeded, CancellationTokencancellationToken)
Exception data:
Severity: FATAL
SqlState: 57P03
MessageText: the database system is shutting down
File: postmaster.c
Line: 2381
Routine: ProcessStartupPacket
--- End of inner exception stack trace ---
at Npgsql.EntityFrameworkCore.PostgreSQL.Storage.Internal.NpgsqlExecutionStrategy.ExecuteAsync[TState,TResult](TStatestate, Func`4operation, Func`4verifySucceeded, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.DbContext.SaveChangesAsync(BooleanacceptAllChangesOnSuccess, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.DbContext.SaveChangesAsync(BooleanacceptAllChangesOnSuccess, CancellationTokencancellationToken)
at EkolPY.Integration.Service.IntegrationTaskService.AddTaskLog(TaskLogLevellogLevel, String[]messages) in /src/Integration/EkolPY.Integration.Service/IntegrationService.cs:line 163
at EkolPY.Integration.Service.IntegrationTaskService.AddTaskError(Exceptionex, String[]msgs) in /src/Integration/EkolPY.Integration.Service/IntegrationService.cs:line 151
at EkolPY.Integration.Service.IntegrationTaskService.SetFailedWithException(Stringmessage, Exceptionex) in /src/Integration/EkolPY.Integration.Service/IntegrationService.cs:line 264
at EkolPY.Integration.Manager.TaskBase`1.ProcessRecurringAsync(PerformContextcontext, StringqueueName, TaskTypetaskType) in /src/Integration/EkolPY.Integration.Manager/TaskBase.cs:line 162
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
An exception occurred during performance of the job. More details...
11/17/2025 02:01:21
System.InvalidOperationException
An exception has been raised that is likely due to a transient failure.
System.InvalidOperationException: An exception has been raised that is likely due to a transient failure.
---> Npgsql.PostgresException (0x80004005): 57P03: the database system is shutting down
at Npgsql.Internal.NpgsqlConnector.<ReadMessage>g__ReadMessageLong|215_0(NpgsqlConnectorconnector, Booleanasync, DataRowLoadingModedataRowLoadingMode, BooleanreadingNotifications, BooleanisReadingPrependedMessage)
at Npgsql.Internal.NpgsqlConnector.Authenticate(Stringusername, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.Internal.NpgsqlConnector.<Open>g__OpenCore|195_1(NpgsqlConnectorconn, SslModesslMode, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken, BooleanisFirstAttempt)
at Npgsql.Internal.NpgsqlConnector.Open(NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.ConnectorPool.OpenNewConnector(NpgsqlConnectionconn, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.ConnectorPool.<Get>g__RentAsync|28_0(NpgsqlConnectionconn, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.NpgsqlConnection.<Open>g__OpenAsync|45_0(Booleanasync, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.Storage.RelationalConnection.OpenInternalAsync(BooleanerrorsExpected, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.Storage.RelationalConnection.OpenInternalAsync(BooleanerrorsExpected, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.Storage.RelationalConnection.OpenAsync(CancellationTokencancellationToken, BooleanerrorsExpected)
at Microsoft.EntityFrameworkCore.Storage.RelationalConnection.BeginTransactionAsync(IsolationLevelisolationLevel, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.Storage.RelationalConnection.BeginTransactionAsync(CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.Update.Internal.BatchExecutor.ExecuteAsync(IEnumerable`1commandBatches, IRelationalConnectionconnection, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.Update.Internal.BatchExecutor.ExecuteAsync(IEnumerable`1commandBatches, IRelationalConnectionconnection, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.Update.Internal.BatchExecutor.ExecuteAsync(IEnumerable`1commandBatches, IRelationalConnectionconnection, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.ChangeTracking.Internal.StateManager.SaveChangesAsync(IList`1entriesToSave, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.ChangeTracking.Internal.StateManager.SaveChangesAsync(StateManagerstateManager, BooleanacceptAllChangesOnSuccess, CancellationTokencancellationToken)
at Npgsql.EntityFrameworkCore.PostgreSQL.Storage.Internal.NpgsqlExecutionStrategy.ExecuteAsync[TState,TResult](TStatestate, Func`4operation, Func`4verifySucceeded, CancellationTokencancellationToken)
Exception data:
Severity: FATAL
SqlState: 57P03
MessageText: the database system is shutting down
File: postmaster.c
Line: 2381
Routine: ProcessStartupPacket
--- End of inner exception stack trace ---
at Npgsql.EntityFrameworkCore.PostgreSQL.Storage.Internal.NpgsqlExecutionStrategy.ExecuteAsync[TState,TResult](TStatestate, Func`4operation, Func`4verifySucceeded, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.DbContext.SaveChangesAsync(BooleanacceptAllChangesOnSuccess, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.DbContext.SaveChangesAsync(BooleanacceptAllChangesOnSuccess, CancellationTokencancellationToken)
at EkolPY.Integration.Service.IntegrationTaskService.AddTaskLog(TaskLogLevellogLevel, String[]messages) in /src/Integration/EkolPY.Integration.Service/IntegrationService.cs:line 163
at EkolPY.Integration.Service.IntegrationTaskService.AddTaskError(Exceptionex, String[]msgs) in /src/Integration/EkolPY.Integration.Service/IntegrationService.cs:line 151
at EkolPY.Integration.Service.IntegrationTaskService.SetFailedWithException(Stringmessage, Exceptionex) in /src/Integration/EkolPY.Integration.Service/IntegrationService.cs:line 264
at EkolPY.Integration.Manager.TaskBase`1.ProcessRecurringAsync(PerformContextcontext, StringqueueName, TaskTypetaskType) in /src/Integration/EkolPY.Integration.Manager/TaskBase.cs:line 162
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
An exception occurred during performance of the job. More details...
11/17/2025 02:01:21
System.InvalidOperationException
An exception has been raised that is likely due to a transient failure.
System.InvalidOperationException: An exception has been raised that is likely due to a transient failure.
---> Npgsql.PostgresException (0x80004005): 57P03: the database system is shutting down
at Npgsql.Internal.NpgsqlConnector.<ReadMessage>g__ReadMessageLong|215_0(NpgsqlConnectorconnector, Booleanasync, DataRowLoadingModedataRowLoadingMode, BooleanreadingNotifications, BooleanisReadingPrependedMessage)
at Npgsql.Internal.NpgsqlConnector.Authenticate(Stringusername, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.Internal.NpgsqlConnector.<Open>g__OpenCore|195_1(NpgsqlConnectorconn, SslModesslMode, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken, BooleanisFirstAttempt)
at Npgsql.Internal.NpgsqlConnector.Open(NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.ConnectorPool.OpenNewConnector(NpgsqlConnectionconn, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.ConnectorPool.<Get>g__RentAsync|28_0(NpgsqlConnectionconn, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.NpgsqlConnection.<Open>g__OpenAsync|45_0(Booleanasync, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.Storage.RelationalConnection.OpenInternalAsync(BooleanerrorsExpected, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.Storage.RelationalConnection.OpenInternalAsync(BooleanerrorsExpected, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.Storage.RelationalConnection.OpenAsync(CancellationTokencancellationToken, BooleanerrorsExpected)
at Microsoft.EntityFrameworkCore.Storage.RelationalConnection.BeginTransactionAsync(IsolationLevelisolationLevel, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.Storage.RelationalConnection.BeginTransactionAsync(CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.Update.Internal.BatchExecutor.ExecuteAsync(IEnumerable`1commandBatches, IRelationalConnectionconnection, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.Update.Internal.BatchExecutor.ExecuteAsync(IEnumerable`1commandBatches, IRelationalConnectionconnection, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.Update.Internal.BatchExecutor.ExecuteAsync(IEnumerable`1commandBatches, IRelationalConnectionconnection, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.ChangeTracking.Internal.StateManager.SaveChangesAsync(IList`1entriesToSave, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.ChangeTracking.Internal.StateManager.SaveChangesAsync(StateManagerstateManager, BooleanacceptAllChangesOnSuccess, CancellationTokencancellationToken)
at Npgsql.EntityFrameworkCore.PostgreSQL.Storage.Internal.NpgsqlExecutionStrategy.ExecuteAsync[TState,TResult](TStatestate, Func`4operation, Func`4verifySucceeded, CancellationTokencancellationToken)
Exception data:
Severity: FATAL
SqlState: 57P03
MessageText: the database system is shutting down
File: postmaster.c
Line: 2381
Routine: ProcessStartupPacket
--- End of inner exception stack trace ---
at Npgsql.EntityFrameworkCore.PostgreSQL.Storage.Internal.NpgsqlExecutionStrategy.ExecuteAsync[TState,TResult](TStatestate, Func`4operation, Func`4verifySucceeded, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.DbContext.SaveChangesAsync(BooleanacceptAllChangesOnSuccess, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.DbContext.SaveChangesAsync(BooleanacceptAllChangesOnSuccess, CancellationTokencancellationToken)
at EkolPY.Integration.Service.IntegrationTaskService.AddTaskLog(TaskLogLevellogLevel, String[]messages) in /src/Integration/EkolPY.Integration.Service/IntegrationService.cs:line 163
at EkolPY.Integration.Service.IntegrationTaskService.AddTaskError(Exceptionex, String[]msgs) in /src/Integration/EkolPY.Integration.Service/IntegrationService.cs:line 151
at EkolPY.Integration.Service.IntegrationTaskService.SetFailedWithException(Stringmessage, Exceptionex) in /src/Integration/EkolPY.Integration.Service/IntegrationService.cs:line 264
at EkolPY.Integration.Manager.TaskBase`1.ProcessRecurringAsync(PerformContextcontext, StringqueueName, TaskTypetaskType) in /src/Integration/EkolPY.Integration.Manager/TaskBase.cs:line 162
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
An exception occurred during performance of the job. More details...
11/17/2025 02:01:26
System.InvalidOperationException
An exception has been raised that is likely due to a transient failure.
System.InvalidOperationException: An exception has been raised that is likely due to a transient failure.
---> Npgsql.NpgsqlException (0x80004005): Failed to connect to 192.168.100.3:5432
---> System.Net.Sockets.SocketException (111): Connection refused
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16token)
at System.Net.Sockets.Socket.<ConnectAsync>g__WaitForConnectWithCancellation|277_0(AwaitableSocketAsyncEventArgssaea, ValueTaskconnectTask, CancellationTokencancellationToken)
at Npgsql.TaskExtensions.ExecuteWithTimeout(Func`2func, NpgsqlTimeouttimeout, CancellationTokencancellationToken)
at Npgsql.Internal.NpgsqlConnector.ConnectAsync(NpgsqlTimeouttimeout, CancellationTokencancellationToken)
at Npgsql.Internal.NpgsqlConnector.ConnectAsync(NpgsqlTimeouttimeout, CancellationTokencancellationToken)
at Npgsql.Internal.NpgsqlConnector.RawOpen(SslModesslMode, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken, BooleanisFirstAttempt)
at Npgsql.Internal.NpgsqlConnector.<Open>g__OpenCore|195_1(NpgsqlConnectorconn, SslModesslMode, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken, BooleanisFirstAttempt)
at Npgsql.Internal.NpgsqlConnector.Open(NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.ConnectorPool.OpenNewConnector(NpgsqlConnectionconn, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.ConnectorPool.<Get>g__RentAsync|28_0(NpgsqlConnectionconn, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.NpgsqlConnection.<Open>g__OpenAsync|45_0(Booleanasync, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.Storage.RelationalConnection.OpenInternalAsync(BooleanerrorsExpected, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.Storage.RelationalConnection.OpenInternalAsync(BooleanerrorsExpected, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.Storage.RelationalConnection.OpenAsync(CancellationTokencancellationToken, BooleanerrorsExpected)
at Microsoft.EntityFrameworkCore.Storage.RelationalConnection.BeginTransactionAsync(IsolationLevelisolationLevel, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.Storage.RelationalConnection.BeginTransactionAsync(CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.Update.Internal.BatchExecutor.ExecuteAsync(IEnumerable`1commandBatches, IRelationalConnectionconnection, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.Update.Internal.BatchExecutor.ExecuteAsync(IEnumerable`1commandBatches, IRelationalConnectionconnection, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.Update.Internal.BatchExecutor.ExecuteAsync(IEnumerable`1commandBatches, IRelationalConnectionconnection, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.ChangeTracking.Internal.StateManager.SaveChangesAsync(IList`1entriesToSave, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.ChangeTracking.Internal.StateManager.SaveChangesAsync(StateManagerstateManager, BooleanacceptAllChangesOnSuccess, CancellationTokencancellationToken)
at Npgsql.EntityFrameworkCore.PostgreSQL.Storage.Internal.NpgsqlExecutionStrategy.ExecuteAsync[TState,TResult](TStatestate, Func`4operation, Func`4verifySucceeded, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at Npgsql.EntityFrameworkCore.PostgreSQL.Storage.Internal.NpgsqlExecutionStrategy.ExecuteAsync[TState,TResult](TStatestate, Func`4operation, Func`4verifySucceeded, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.DbContext.SaveChangesAsync(BooleanacceptAllChangesOnSuccess, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.DbContext.SaveChangesAsync(BooleanacceptAllChangesOnSuccess, CancellationTokencancellationToken)
at EkolPY.Integration.Service.IntegrationTaskService.AddTaskLog(TaskLogLevellogLevel, String[]messages) in /src/Integration/EkolPY.Integration.Service/IntegrationService.cs:line 163
at EkolPY.Integration.Service.IntegrationTaskService.AddTaskError(Exceptionex, String[]msgs) in /src/Integration/EkolPY.Integration.Service/IntegrationService.cs:line 151
at EkolPY.Integration.Service.IntegrationTaskService.SetFailedWithException(Stringmessage, Exceptionex) in /src/Integration/EkolPY.Integration.Service/IntegrationService.cs:line 264
at EkolPY.Integration.Manager.TaskBase`1.ProcessRecurringAsync(PerformContextcontext, StringqueueName, TaskTypetaskType) in /src/Integration/EkolPY.Integration.Manager/TaskBase.cs:line 162
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
An exception occurred during performance of the job. More details...
11/17/2025 02:01:30
System.InvalidOperationException
An exception has been raised that is likely due to a transient failure.
System.InvalidOperationException: An exception has been raised that is likely due to a transient failure.
---> Npgsql.NpgsqlException (0x80004005): Failed to connect to 192.168.100.3:5432
---> System.Net.Sockets.SocketException (111): Connection refused
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16token)
at System.Net.Sockets.Socket.<ConnectAsync>g__WaitForConnectWithCancellation|277_0(AwaitableSocketAsyncEventArgssaea, ValueTaskconnectTask, CancellationTokencancellationToken)
at Npgsql.TaskExtensions.ExecuteWithTimeout(Func`2func, NpgsqlTimeouttimeout, CancellationTokencancellationToken)
at Npgsql.Internal.NpgsqlConnector.ConnectAsync(NpgsqlTimeouttimeout, CancellationTokencancellationToken)
at Npgsql.Internal.NpgsqlConnector.ConnectAsync(NpgsqlTimeouttimeout, CancellationTokencancellationToken)
at Npgsql.Internal.NpgsqlConnector.RawOpen(SslModesslMode, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken, BooleanisFirstAttempt)
at Npgsql.Internal.NpgsqlConnector.<Open>g__OpenCore|195_1(NpgsqlConnectorconn, SslModesslMode, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken, BooleanisFirstAttempt)
at Npgsql.Internal.NpgsqlConnector.Open(NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.ConnectorPool.OpenNewConnector(NpgsqlConnectionconn, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.ConnectorPool.<Get>g__RentAsync|28_0(NpgsqlConnectionconn, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.NpgsqlConnection.<Open>g__OpenAsync|45_0(Booleanasync, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.Storage.RelationalConnection.OpenInternalAsync(BooleanerrorsExpected, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.Storage.RelationalConnection.OpenInternalAsync(BooleanerrorsExpected, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.Storage.RelationalConnection.OpenAsync(CancellationTokencancellationToken, BooleanerrorsExpected)
at Microsoft.EntityFrameworkCore.Storage.RelationalConnection.BeginTransactionAsync(IsolationLevelisolationLevel, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.Storage.RelationalConnection.BeginTransactionAsync(CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.Update.Internal.BatchExecutor.ExecuteAsync(IEnumerable`1commandBatches, IRelationalConnectionconnection, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.Update.Internal.BatchExecutor.ExecuteAsync(IEnumerable`1commandBatches, IRelationalConnectionconnection, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.Update.Internal.BatchExecutor.ExecuteAsync(IEnumerable`1commandBatches, IRelationalConnectionconnection, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.ChangeTracking.Internal.StateManager.SaveChangesAsync(IList`1entriesToSave, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.ChangeTracking.Internal.StateManager.SaveChangesAsync(StateManagerstateManager, BooleanacceptAllChangesOnSuccess, CancellationTokencancellationToken)
at Npgsql.EntityFrameworkCore.PostgreSQL.Storage.Internal.NpgsqlExecutionStrategy.ExecuteAsync[TState,TResult](TStatestate, Func`4operation, Func`4verifySucceeded, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at Npgsql.EntityFrameworkCore.PostgreSQL.Storage.Internal.NpgsqlExecutionStrategy.ExecuteAsync[TState,TResult](TStatestate, Func`4operation, Func`4verifySucceeded, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.DbContext.SaveChangesAsync(BooleanacceptAllChangesOnSuccess, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.DbContext.SaveChangesAsync(BooleanacceptAllChangesOnSuccess, CancellationTokencancellationToken)
at EkolPY.Integration.Service.IntegrationTaskService.AddTaskLog(TaskLogLevellogLevel, String[]messages) in /src/Integration/EkolPY.Integration.Service/IntegrationService.cs:line 163
at EkolPY.Integration.Service.IntegrationTaskService.AddTaskError(Exceptionex, String[]msgs) in /src/Integration/EkolPY.Integration.Service/IntegrationService.cs:line 151
at EkolPY.Integration.Service.IntegrationTaskService.SetFailedWithException(Stringmessage, Exceptionex) in /src/Integration/EkolPY.Integration.Service/IntegrationService.cs:line 264
at EkolPY.Integration.Manager.TaskBase`1.ProcessRecurringAsync(PerformContextcontext, StringqueueName, TaskTypetaskType) in /src/Integration/EkolPY.Integration.Manager/TaskBase.cs:line 162
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
An exception occurred during performance of the job. More details...
11/17/2025 02:01:21
System.InvalidOperationException
An exception has been raised that is likely due to a transient failure.
System.InvalidOperationException: An exception has been raised that is likely due to a transient failure.
---> Npgsql.PostgresException (0x80004005): 57P03: the database system is shutting down
at Npgsql.Internal.NpgsqlConnector.<ReadMessage>g__ReadMessageLong|215_0(NpgsqlConnectorconnector, Booleanasync, DataRowLoadingModedataRowLoadingMode, BooleanreadingNotifications, BooleanisReadingPrependedMessage)
at Npgsql.Internal.NpgsqlConnector.Authenticate(Stringusername, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.Internal.NpgsqlConnector.<Open>g__OpenCore|195_1(NpgsqlConnectorconn, SslModesslMode, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken, BooleanisFirstAttempt)
at Npgsql.Internal.NpgsqlConnector.Open(NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.ConnectorPool.OpenNewConnector(NpgsqlConnectionconn, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.ConnectorPool.<Get>g__RentAsync|28_0(NpgsqlConnectionconn, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.NpgsqlConnection.<Open>g__OpenAsync|45_0(Booleanasync, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.Storage.RelationalConnection.OpenInternalAsync(BooleanerrorsExpected, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.Storage.RelationalConnection.OpenInternalAsync(BooleanerrorsExpected, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.Storage.RelationalConnection.OpenAsync(CancellationTokencancellationToken, BooleanerrorsExpected)
at Microsoft.EntityFrameworkCore.Storage.RelationalConnection.BeginTransactionAsync(IsolationLevelisolationLevel, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.Storage.RelationalConnection.BeginTransactionAsync(CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.Update.Internal.BatchExecutor.ExecuteAsync(IEnumerable`1commandBatches, IRelationalConnectionconnection, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.Update.Internal.BatchExecutor.ExecuteAsync(IEnumerable`1commandBatches, IRelationalConnectionconnection, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.Update.Internal.BatchExecutor.ExecuteAsync(IEnumerable`1commandBatches, IRelationalConnectionconnection, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.ChangeTracking.Internal.StateManager.SaveChangesAsync(IList`1entriesToSave, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.ChangeTracking.Internal.StateManager.SaveChangesAsync(StateManagerstateManager, BooleanacceptAllChangesOnSuccess, CancellationTokencancellationToken)
at Npgsql.EntityFrameworkCore.PostgreSQL.Storage.Internal.NpgsqlExecutionStrategy.ExecuteAsync[TState,TResult](TStatestate, Func`4operation, Func`4verifySucceeded, CancellationTokencancellationToken)
Exception data:
Severity: FATAL
SqlState: 57P03
MessageText: the database system is shutting down
File: postmaster.c
Line: 2381
Routine: ProcessStartupPacket
--- End of inner exception stack trace ---
at Npgsql.EntityFrameworkCore.PostgreSQL.Storage.Internal.NpgsqlExecutionStrategy.ExecuteAsync[TState,TResult](TStatestate, Func`4operation, Func`4verifySucceeded, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.DbContext.SaveChangesAsync(BooleanacceptAllChangesOnSuccess, CancellationTokencancellationToken)
at Microsoft.EntityFrameworkCore.DbContext.SaveChangesAsync(BooleanacceptAllChangesOnSuccess, CancellationTokencancellationToken)
at EkolPY.Integration.Service.IntegrationTaskService.AddTaskLog(TaskLogLevellogLevel, String[]messages) in /src/Integration/EkolPY.Integration.Service/IntegrationService.cs:line 163
at EkolPY.Integration.Service.IntegrationTaskService.AddTaskError(Exceptionex, String[]msgs) in /src/Integration/EkolPY.Integration.Service/IntegrationService.cs:line 151
at EkolPY.Integration.Service.IntegrationTaskService.SetFailedWithException(Stringmessage, Exceptionex) in /src/Integration/EkolPY.Integration.Service/IntegrationService.cs:line 264
at EkolPY.Integration.Manager.TaskBase`1.ProcessRecurringAsync(PerformContextcontext, StringqueueName, TaskTypetaskType) in /src/Integration/EkolPY.Integration.Manager/TaskBase.cs:line 162
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
An exception occurred during performance of the job. More details...
10/16/2025 13:30:24
System.ObjectDisposedException
Cannot access a disposed object.
Object name: 'IServiceProvider'.
System.ObjectDisposedException: Cannot access a disposed object.
Object name: 'IServiceProvider'.
at Microsoft.Extensions.DependencyInjection.ServiceLookup.ThrowHelper.ThrowObjectDisposedException()
at Microsoft.Extensions.DependencyInjection.ServiceProvider.GetService(TypeserviceType, ServiceProviderEngineScopeserviceProviderEngineScope)
at Microsoft.Extensions.DependencyInjection.ServiceProviderServiceExtensions.GetRequiredService(IServiceProviderprovider, TypeserviceType)
at Microsoft.Extensions.DependencyInjection.ServiceProviderServiceExtensions.GetRequiredService[T](IServiceProviderprovider)
at EkolPY.Integration.Service.IntegrationTaskService.AddTaskLog(TaskLogLevellogLevel, String[]messages) in /src/Integration/EkolPY.Integration.Service/IntegrationService.cs:line 155
at EkolPY.Integration.Service.IntegrationTaskService.AddTaskError(Exceptionex, String[]msgs) in /src/Integration/EkolPY.Integration.Service/IntegrationService.cs:line 151
at EkolPY.Integration.Service.IntegrationTaskService.SetFailedWithException(Stringmessage, Exceptionex) in /src/Integration/EkolPY.Integration.Service/IntegrationService.cs:line 264
at EkolPY.Integration.Manager.TaskBase`1.ProcessRecurringAsync(PerformContextcontext, StringqueueName, TaskTypetaskType) in /src/Integration/EkolPY.Integration.Manager/TaskBase.cs:line 162
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
An exception occurred during performance of the job. More details...
10/16/2025 13:30:24
System.ObjectDisposedException
Cannot access a disposed object.
Object name: 'IServiceProvider'.
System.ObjectDisposedException: Cannot access a disposed object.
Object name: 'IServiceProvider'.
at Microsoft.Extensions.DependencyInjection.ServiceLookup.ThrowHelper.ThrowObjectDisposedException()
at Microsoft.Extensions.DependencyInjection.ServiceProvider.GetService(TypeserviceType, ServiceProviderEngineScopeserviceProviderEngineScope)
at Microsoft.Extensions.DependencyInjection.ServiceProviderServiceExtensions.GetRequiredService(IServiceProviderprovider, TypeserviceType)
at Microsoft.Extensions.DependencyInjection.ServiceProviderServiceExtensions.GetRequiredService[T](IServiceProviderprovider)
at EkolPY.Integration.Service.IntegrationTaskService.AddTaskLog(TaskLogLevellogLevel, String[]messages) in /src/Integration/EkolPY.Integration.Service/IntegrationService.cs:line 155
at EkolPY.Integration.Service.IntegrationTaskService.AddTaskError(Exceptionex, String[]msgs) in /src/Integration/EkolPY.Integration.Service/IntegrationService.cs:line 151
at EkolPY.Integration.Service.IntegrationTaskService.SetFailedWithException(Stringmessage, Exceptionex) in /src/Integration/EkolPY.Integration.Service/IntegrationService.cs:line 264
at EkolPY.Integration.Manager.TaskBase`1.ProcessRecurringAsync(PerformContextcontext, StringqueueName, TaskTypetaskType) in /src/Integration/EkolPY.Integration.Manager/TaskBase.cs:line 162
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
An exception occurred during performance of the job. More details...
10/16/2025 13:30:24
System.ObjectDisposedException
Cannot access a disposed object.
Object name: 'IServiceProvider'.
System.ObjectDisposedException: Cannot access a disposed object.
Object name: 'IServiceProvider'.
at Microsoft.Extensions.DependencyInjection.ServiceLookup.ThrowHelper.ThrowObjectDisposedException()
at Microsoft.Extensions.DependencyInjection.ServiceProvider.GetService(TypeserviceType, ServiceProviderEngineScopeserviceProviderEngineScope)
at Microsoft.Extensions.DependencyInjection.ServiceProviderServiceExtensions.GetRequiredService(IServiceProviderprovider, TypeserviceType)
at Microsoft.Extensions.DependencyInjection.ServiceProviderServiceExtensions.GetRequiredService[T](IServiceProviderprovider)
at EkolPY.Integration.Service.IntegrationTaskService.AddTaskLog(TaskLogLevellogLevel, String[]messages) in /src/Integration/EkolPY.Integration.Service/IntegrationService.cs:line 155
at EkolPY.Integration.Service.IntegrationTaskService.AddTaskError(Exceptionex, String[]msgs) in /src/Integration/EkolPY.Integration.Service/IntegrationService.cs:line 151
at EkolPY.Integration.Service.IntegrationTaskService.SetFailedWithException(Stringmessage, Exceptionex) in /src/Integration/EkolPY.Integration.Service/IntegrationService.cs:line 264
at EkolPY.Integration.Manager.TaskBase`1.ProcessRecurringAsync(PerformContextcontext, StringqueueName, TaskTypetaskType) in /src/Integration/EkolPY.Integration.Manager/TaskBase.cs:line 162
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
An exception occurred during performance of the job. More details...
10/16/2025 13:30:24
System.ObjectDisposedException
Cannot access a disposed object.
Object name: 'IServiceProvider'.
System.ObjectDisposedException: Cannot access a disposed object.
Object name: 'IServiceProvider'.
at Microsoft.Extensions.DependencyInjection.ServiceLookup.ThrowHelper.ThrowObjectDisposedException()
at Microsoft.Extensions.DependencyInjection.ServiceProvider.GetService(TypeserviceType, ServiceProviderEngineScopeserviceProviderEngineScope)
at Microsoft.Extensions.DependencyInjection.ServiceProviderServiceExtensions.GetRequiredService(IServiceProviderprovider, TypeserviceType)
at Microsoft.Extensions.DependencyInjection.ServiceProviderServiceExtensions.GetRequiredService[T](IServiceProviderprovider)
at EkolPY.Integration.Service.IntegrationTaskService.AddTaskLog(TaskLogLevellogLevel, String[]messages) in /src/Integration/EkolPY.Integration.Service/IntegrationService.cs:line 155
at EkolPY.Integration.Service.IntegrationTaskService.AddTaskError(Exceptionex, String[]msgs) in /src/Integration/EkolPY.Integration.Service/IntegrationService.cs:line 151
at EkolPY.Integration.Service.IntegrationTaskService.SetFailedWithException(Stringmessage, Exceptionex) in /src/Integration/EkolPY.Integration.Service/IntegrationService.cs:line 264
at EkolPY.Integration.Manager.TaskBase`1.ProcessRecurringAsync(PerformContextcontext, StringqueueName, TaskTypetaskType) in /src/Integration/EkolPY.Integration.Manager/TaskBase.cs:line 162
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)