Failed jobs do not become expired to allow you to re-queue them without any
time pressure. You should re-queue or delete them manually, or apply AutomaticRetry(OnAttemptsExceeded = AttemptsExceededAction.Delete)
attribute to delete them automatically.
Failed to change state to a 'Failed' one due to an exception after 10 retry attempts Fewer details...
System.NullReferenceException
Object reference not set to an instance of an object.
System.NullReferenceException: Object reference not set to an instance of an object.
at Hangfire.AutomaticRetryAttribute.ScheduleAgainLater(ElectStateContextcontext, Int32retryAttempt, FailedStatefailedState)
at Hangfire.AutomaticRetryAttribute.OnStateElection(ElectStateContextcontext)
at Hangfire.States.StateMachine.ApplyState(ApplyStateContextinitialContext)
at Hangfire.States.BackgroundJobStateChanger.ChangeState(StateChangeContextcontext)
at Hangfire.Server.Worker.TryChangeState(BackgroundProcessContextcontext, IStorageConnectionconnection, IFetchedJobfetchedJob, IStatestate, String[]expectedStates, CancellationTokencancellationToken)
Failed to change state to a 'Failed' one due to an exception after 10 retry attempts More details...
System.NullReferenceException
Object reference not set to an instance of an object.
System.NullReferenceException: Object reference not set to an instance of an object.
at Hangfire.AutomaticRetryAttribute.ScheduleAgainLater(ElectStateContextcontext, Int32retryAttempt, FailedStatefailedState)
at Hangfire.AutomaticRetryAttribute.OnStateElection(ElectStateContextcontext)
at Hangfire.States.StateMachine.ApplyState(ApplyStateContextinitialContext)
at Hangfire.States.BackgroundJobStateChanger.ChangeState(StateChangeContextcontext)
at Hangfire.Server.Worker.TryChangeState(BackgroundProcessContextcontext, IStorageConnectionconnection, IFetchedJobfetchedJob, IStatestate, String[]expectedStates, CancellationTokencancellationToken)
Failed to change state to a 'Failed' one due to an exception after 10 retry attempts More details...
System.NullReferenceException
Object reference not set to an instance of an object.
System.NullReferenceException: Object reference not set to an instance of an object.
at Hangfire.AutomaticRetryAttribute.ScheduleAgainLater(ElectStateContextcontext, Int32retryAttempt, FailedStatefailedState)
at Hangfire.AutomaticRetryAttribute.OnStateElection(ElectStateContextcontext)
at Hangfire.States.StateMachine.ApplyState(ApplyStateContextinitialContext)
at Hangfire.States.BackgroundJobStateChanger.ChangeState(StateChangeContextcontext)
at Hangfire.Server.Worker.TryChangeState(BackgroundProcessContextcontext, IStorageConnectionconnection, IFetchedJobfetchedJob, IStatestate, String[]expectedStates, CancellationTokencancellationToken)
Failed to change state to a 'Failed' one due to an exception after 10 retry attempts More details...
System.NullReferenceException
Object reference not set to an instance of an object.
System.NullReferenceException: Object reference not set to an instance of an object.
at Hangfire.AutomaticRetryAttribute.ScheduleAgainLater(ElectStateContextcontext, Int32retryAttempt, FailedStatefailedState)
at Hangfire.AutomaticRetryAttribute.OnStateElection(ElectStateContextcontext)
at Hangfire.States.StateMachine.ApplyState(ApplyStateContextinitialContext)
at Hangfire.States.BackgroundJobStateChanger.ChangeState(StateChangeContextcontext)
at Hangfire.Server.Worker.TryChangeState(BackgroundProcessContextcontext, IStorageConnectionconnection, IFetchedJobfetchedJob, IStatestate, String[]expectedStates, CancellationTokencancellationToken)
Harvest.Net.HarvestException
at Harvest.Net.Extensions.ThrowIfBadRequest(IRestResponseresponse)
at Harvest.Net.HarvestRestClient.Execute[T](IRestRequestrequest)
at Harvest.Net.HarvestRestClient.ListClients(Nullable`1updatedSince)
at Harvest.AccountRepository.<>c.<FindAll>b__1_0(IHarvestRestClientc) in C:\TeamServices\Agent\_work\395\s\Harvest\AccountRepository.cs:line 19
at System.Reactive.Linq.ObservableImpl.SelectMany`2.EnumerableSelector._.OnNext(TSourcevalue) in D:\a\1\s\Rx.NET\Source\src\System.Reactive\Linq\Observable\SelectMany.cs:line 1328
--- End of stack trace from previous location where exception was thrown ---
at System.Reactive.PlatformServices.ExceptionServicesImpl.Rethrow(Exceptionexception) in D:\a\1\s\Rx.NET\Source\src\System.Reactive\Internal\ExceptionServicesImpl.cs:line 16
at System.Reactive.ExceptionHelpers.ThrowIfNotNull(Exceptionexception) in D:\a\1\s\Rx.NET\Source\src\System.Reactive\Internal\ExceptionServices.cs:line 20
at System.Reactive.Subjects.AsyncSubject`1.GetResult() in D:\a\1\s\Rx.NET\Source\src\System.Reactive\Subjects\AsyncSubject.cs:line 437
at Domain.ObservableExtensions.<>c__DisplayClass2_0`2.<<MatchWith>g__Match|0>d.MoveNext() in C:\TeamServices\Agent\_work\395\s\Domain\ObservableExtensions.cs:line 49
--- End of stack trace from previous location where exception was thrown ---
at System.Reactive.PlatformServices.ExceptionServicesImpl.Rethrow(Exceptionexception) in D:\a\1\s\Rx.NET\Source\src\System.Reactive\Internal\ExceptionServicesImpl.cs:line 16
at System.Reactive.ExceptionHelpers.ThrowIfNotNull(Exceptionexception) in D:\a\1\s\Rx.NET\Source\src\System.Reactive\Internal\ExceptionServices.cs:line 20
at System.Reactive.Subjects.AsyncSubject`1.GetResult() in D:\a\1\s\Rx.NET\Source\src\System.Reactive\Subjects\AsyncSubject.cs:line 437
at Application.Sync.ProjectSyncTask.<Execute>d__4.MoveNext() in C:\TeamServices\Agent\_work\395\s\Application\Sync\ProjectSyncTask.cs:line 42
Failed to change state to a 'Failed' one due to an exception after 10 retry attempts More details...
System.NullReferenceException
Object reference not set to an instance of an object.
System.NullReferenceException: Object reference not set to an instance of an object.
at Hangfire.AutomaticRetryAttribute.ScheduleAgainLater(ElectStateContextcontext, Int32retryAttempt, FailedStatefailedState)
at Hangfire.AutomaticRetryAttribute.OnStateElection(ElectStateContextcontext)
at Hangfire.States.StateMachine.ApplyState(ApplyStateContextinitialContext)
at Hangfire.States.BackgroundJobStateChanger.ChangeState(StateChangeContextcontext)
at Hangfire.Server.Worker.TryChangeState(BackgroundProcessContextcontext, IStorageConnectionconnection, IFetchedJobfetchedJob, IStatestate, String[]expectedStates, CancellationTokencancellationToken)
Failed to change state to a 'Failed' one due to an exception after 10 retry attempts More details...
System.NullReferenceException
Object reference not set to an instance of an object.
System.NullReferenceException: Object reference not set to an instance of an object.
at Hangfire.AutomaticRetryAttribute.ScheduleAgainLater(ElectStateContextcontext, Int32retryAttempt, FailedStatefailedState)
at Hangfire.AutomaticRetryAttribute.OnStateElection(ElectStateContextcontext)
at Hangfire.States.StateMachine.ApplyState(ApplyStateContextinitialContext)
at Hangfire.States.BackgroundJobStateChanger.ChangeState(StateChangeContextcontext)
at Hangfire.Server.Worker.TryChangeState(BackgroundProcessContextcontext, IStorageConnectionconnection, IFetchedJobfetchedJob, IStatestate, String[]expectedStates, CancellationTokencancellationToken)
Access Denied: The Personal Access Token used has expired.
Microsoft.VisualStudio.Services.Common.VssUnauthorizedException: Access Denied: The Personal Access Token used has expired.
at Microsoft.VisualStudio.Services.Common.VssHttpMessageHandler.<SendAsync>d__17.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Tasktask)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.<SendAsync>d__50.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Tasktask)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.<SendAsync>d__47`1.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Tasktask)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.<GetResourceLocationsAsync>d__64.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Tasktask)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.<EnsureResourceLocationsPopulated>d__65.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Tasktask)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.<GetResourceLocationAsync>d__63.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Tasktask)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.<CreateRequestMessageAsync>d__34.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Tasktask)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.<SendAsync>d__28`1.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Tasktask)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
at TeamServices.WorkItemMaterializer.<Query>d__6.MoveNext() in C:\TeamServices\Agent\_work\395\s\TeamServices\WorkItemMaterializer.cs:line 53
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Tasktask)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
at TeamServices.WorkItemMaterializer.<<Query>b__5_0>d.MoveNext() in C:\TeamServices\Agent\_work\395\s\TeamServices\WorkItemMaterializer.cs:line 37
--- End of stack trace from previous location where exception was thrown ---
at System.Reactive.PlatformServices.ExceptionServicesImpl.Rethrow(Exceptionexception) in D:\a\1\s\Rx.NET\Source\src\System.Reactive\Internal\ExceptionServicesImpl.cs:line 16
at System.Reactive.ExceptionHelpers.ThrowIfNotNull(Exceptionexception) in D:\a\1\s\Rx.NET\Source\src\System.Reactive\Internal\ExceptionServices.cs:line 20
at System.Reactive.Subjects.AsyncSubject`1.GetResult() in D:\a\1\s\Rx.NET\Source\src\System.Reactive\Subjects\AsyncSubject.cs:line 437
at TeamServices.WorkItemRepository.<FindByReference>d__6`1.MoveNext() in C:\TeamServices\Agent\_work\395\s\TeamServices\WorkItemRepository.cs:line 73
--- End of stack trace from previous location where exception was thrown ---
at System.Reactive.PlatformServices.ExceptionServicesImpl.Rethrow(Exceptionexception) in D:\a\1\s\Rx.NET\Source\src\System.Reactive\Internal\ExceptionServicesImpl.cs:line 16
at System.Reactive.ExceptionHelpers.ThrowIfNotNull(Exceptionexception) in D:\a\1\s\Rx.NET\Source\src\System.Reactive\Internal\ExceptionServices.cs:line 20
at System.Reactive.Subjects.AsyncSubject`1.GetResult() in D:\a\1\s\Rx.NET\Source\src\System.Reactive\Subjects\AsyncSubject.cs:line 437
at Application.Sync.TimesheetSyncTask.<Execute>d__6.MoveNext() in C:\TeamServices\Agent\_work\395\s\Application\Sync\TimesheetSyncTask.cs:line 56
Access Denied: The Personal Access Token used has expired.
Microsoft.VisualStudio.Services.Common.VssUnauthorizedException: Access Denied: The Personal Access Token used has expired.
at Microsoft.VisualStudio.Services.Common.VssHttpMessageHandler.<SendAsync>d__17.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Tasktask)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.<SendAsync>d__50.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Tasktask)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.<SendAsync>d__47`1.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Tasktask)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.<GetResourceLocationsAsync>d__64.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Tasktask)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.<EnsureResourceLocationsPopulated>d__65.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Tasktask)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.<GetResourceLocationAsync>d__63.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Tasktask)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.<CreateRequestMessageAsync>d__34.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Tasktask)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.<SendAsync>d__28`1.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Tasktask)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
at TeamServices.WorkItemMaterializer.<Query>d__6.MoveNext() in C:\TeamServices\Agent\_work\395\s\TeamServices\WorkItemMaterializer.cs:line 53
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Tasktask)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
at TeamServices.WorkItemMaterializer.<<Query>b__5_0>d.MoveNext() in C:\TeamServices\Agent\_work\395\s\TeamServices\WorkItemMaterializer.cs:line 37
--- End of stack trace from previous location where exception was thrown ---
at System.Reactive.PlatformServices.ExceptionServicesImpl.Rethrow(Exceptionexception) in D:\a\1\s\Rx.NET\Source\src\System.Reactive\Internal\ExceptionServicesImpl.cs:line 16
at System.Reactive.ExceptionHelpers.ThrowIfNotNull(Exceptionexception) in D:\a\1\s\Rx.NET\Source\src\System.Reactive\Internal\ExceptionServices.cs:line 20
at System.Reactive.Subjects.AsyncSubject`1.GetResult() in D:\a\1\s\Rx.NET\Source\src\System.Reactive\Subjects\AsyncSubject.cs:line 437
at TeamServices.WorkItemRepository.<FindByReference>d__6`1.MoveNext() in C:\TeamServices\Agent\_work\395\s\TeamServices\WorkItemRepository.cs:line 73
--- End of stack trace from previous location where exception was thrown ---
at System.Reactive.PlatformServices.ExceptionServicesImpl.Rethrow(Exceptionexception) in D:\a\1\s\Rx.NET\Source\src\System.Reactive\Internal\ExceptionServicesImpl.cs:line 16
at System.Reactive.ExceptionHelpers.ThrowIfNotNull(Exceptionexception) in D:\a\1\s\Rx.NET\Source\src\System.Reactive\Internal\ExceptionServices.cs:line 20
at System.Reactive.Subjects.AsyncSubject`1.GetResult() in D:\a\1\s\Rx.NET\Source\src\System.Reactive\Subjects\AsyncSubject.cs:line 437
at Application.Sync.TimesheetSyncTask.<Execute>d__6.MoveNext() in C:\TeamServices\Agent\_work\395\s\Application\Sync\TimesheetSyncTask.cs:line 56
Access Denied: The Personal Access Token used has expired.
Microsoft.VisualStudio.Services.Common.VssUnauthorizedException: Access Denied: The Personal Access Token used has expired.
at Microsoft.VisualStudio.Services.Common.VssHttpMessageHandler.<SendAsync>d__17.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Tasktask)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.<SendAsync>d__50.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Tasktask)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.<SendAsync>d__47`1.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Tasktask)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.<GetResourceLocationsAsync>d__64.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Tasktask)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.<EnsureResourceLocationsPopulated>d__65.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Tasktask)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.<GetResourceLocationAsync>d__63.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Tasktask)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.<CreateRequestMessageAsync>d__34.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Tasktask)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.<SendAsync>d__28`1.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Tasktask)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
at TeamServices.Queries.IterationQueries.<GetRootIteration>d__3.MoveNext() in C:\TeamServices\Agent\_work\395\s\TeamServices\Queries\IterationQueries.cs:line 29
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Tasktask)
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
at TeamServices.Tasks.SyncIterationsTask.<Execute>d__12.MoveNext() in C:\TeamServices\Agent\_work\395\s\TeamServices\Tasks\SyncIterationsTask.cs:line 53