new info: aws sdk have same problem, code:
var rsp= await s3Client.GetObjectAsync(“bigfiles”,“/objectkey”);
I encountered the same issue as described here: Getting started using Tigris.net AWS SDK. My application is built using ASP.NET Core 9. The response is received after a very short wait, so it’s unlikely to be a timeout issue.
I believe the problem is not caused by the program because the code is very simple:
[HttpGet]
public async Task<IActionResult> GetAsync()
{
var client = httpClientFactory.CreateClient();
var presignedUrl = "https://fly.storage.tigris.dev/mybucketname/myobjectkey?***";
var rsq = new HttpRequestMessage(HttpMethod.Get, presignedUrl);
var response = await client.SendAsync(rsq);
return StatusCode((int)response.StatusCode, await response.Content.ReadAsStringAsync());
}
This program runs on a Fly app and only makes a simple GET request to a fixed and immutable pre-signed URL with a sufficient expiration time to Tigris.
This error always occurs when no machine is running, and a request triggers the device to start up. In such cases, the request is highly likely to result in this error: System.Net.Http.HttpIOException: The response ended prematurely. (ResponseEnded).
When it throws an error, if I retry the request, it often responds with a 200 successfully.
The code that throws the error is so simple that I don’t know how to fix it. I believe the error originates from Tigris’ server-side, but I haven’t found a way to view something like CDN logs for Tigris.
Therefore, I would like to understand the exact response from the server for this particular request and how I might avoid this issue. Thanks!
log:
bucketname: bigfiles
failed request response headers:
date: Mon, 27 Jan 2025 10:40:53 GMT
server: Fly/a3e18ae92 (2025-01-16)
via: 1.1 fly.io
fly-request-id: 01JJKNK138FF6PS0SE0T7AGMDX-sea
content-length: 0
failed trace log:
2025-01-27T10:40:17.144 app[32871252c63738] iad [info] dbug: Microsoft.Extensions.Hosting.Internal.Host[4]
2025-01-27T10:40:17.144 app[32871252c63738] iad [info] Hosting stopped
2025-01-27T10:40:17.931 app[32871252c63738] iad [info] INFO Main child exited normally with code: 0
2025-01-27T10:40:17.946 app[32871252c63738] iad [info] INFO Starting clean up.
2025-01-27T10:40:17.948 app[32871252c63738] iad [info] WARN could not unmount /rootfs: EINVAL: Invalid argument
2025-01-27T10:40:17.949 app[32871252c63738] iad [info] [ 33.806472] reboot: Restarting system
2025-01-27T10:40:25.895 proxy[32871252c63738] iad [error] [PC05] timed out while connecting to your instance. this indicates a problem with your app (hint: look at your logs and metrics)
2025-01-27T10:40:38.074 proxy[32871252c63738] iad [error] [PC05] timed out while connecting to your instance. this indicates a problem with your app (hint: look at your logs and metrics)
2025-01-27T10:40:43.187 proxy[32871252c63738] sea [error] [PR04] could not find a good candidate within 21 attempts at load balancing
2025-01-27T10:40:50.442 proxy[32871252c63738] iad [info] Starting machine
2025-01-27T10:40:50.519 app[32871252c63738] iad [info] 2025-01-27T10:40:50.519698736 [01JJKNE4KGB93K25S8V2J2TS2P:main] Running Firecracker v1.7.0
2025-01-27T10:40:51.262 app[32871252c63738] iad [info] INFO Starting init (commit: 3a6e10d0)...
2025-01-27T10:40:51.357 app[32871252c63738] iad [info] INFO Preparing to run: `dotnet *myappname*.dll` as root
2025-01-27T10:40:51.364 app[32871252c63738] iad [info] INFO [fly api proxy] listening at /.fly/api
2025-01-27T10:40:51.393 runner[32871252c63738] iad [info] Machine started in 945ms
2025-01-27T10:40:51.395 proxy[32871252c63738] iad [info] machine started in 953.403653ms
2025-01-27T10:40:51.707 app[32871252c63738] iad [info] 2025/01/27 10:40:51 INFO SSH listening listen_address=[****:d:45f2:a7b:374:c37c:d292:2]:22 dns_server=[****::3]:53
2025-01-27T10:40:51.972 app[32871252c63738] iad [info] dbug: Microsoft.AspNetCore.Mvc.ModelBinding.ModelBinderFactory[12]
2025-01-27T10:40:51.972 app[32871252c63738] iad [info] Registered model binder providers, in the following order: Microsoft.AspNetCore.Mvc.ModelBinding.Binders.BinderTypeModelBinderProvider, Microsoft.AspNetCore.Mvc.ModelBinding.Binders.ServicesModelBinderProvider, Microsoft.AspNetCore.Mvc.ModelBinding.Binders.BodyModelBinderProvider, Microsoft.AspNetCore.Mvc.ModelBinding.Binders.HeaderModelBinderProvider, Microsoft.AspNetCore.Mvc.ModelBinding.Binders.FloatingPointTypeModelBinderProvider, Microsoft.AspNetCore.Mvc.ModelBinding.Binders.EnumTypeModelBinderProvider, Microsoft.AspNetCore.Mvc.ModelBinding.Binders.DateTimeModelBinderProvider, Microsoft.AspNetCore.Mvc.ModelBinding.Binders.SimpleTypeModelBinderProvider, Microsoft.AspNetCore.Mvc.ModelBinding.Binders.TryParseModelBinderProvider, Microsoft.AspNetCore.Mvc.ModelBinding.Binders.CancellationTokenModelBinderProvider, Microsoft.AspNetCore.Mvc.ModelBinding.Binders.ByteArrayModelBinderProvider, Microsoft.AspNetCore.Mvc.ModelBinding.Binders.FormFileModelBinderProvider, Microsoft.AspNetCore.Mvc.ModelBinding.Binders.FormCollectionModelBinderProvider, Microsoft.AspNetCore.Mvc.ModelBinding.Binders.KeyValuePairModelBinderProvider, Microsoft.AspNetCore.Mvc.ModelBinding.Binders.DictionaryModelBinderProvider, Microsoft.AspNetCore.Mvc.ModelBinding.Binders.ArrayModelBinderProvider, Microsoft.AspNetCore.Mvc.ModelBinding.Binders.CollectionModelBinderProvider, Microsoft.AspNetCore.Mvc.ModelBinding.Binders.ComplexObjectModelBinderProvider
2025-01-27T10:40:52.051 app[32871252c63738] iad [info] dbug: Microsoft.Extensions.Hosting.Internal.Host[1]
2025-01-27T10:40:52.051 app[32871252c63738] iad [info] Hosting starting
2025-01-27T10:40:52.074 app[32871252c63738] iad [info] warn: Microsoft.AspNetCore.DataProtection.Repositories.FileSystemXmlRepository[60]
2025-01-27T10:40:52.074 app[32871252c63738] iad [info] Storing keys in a directory '/root/.aspnet/DataProtection-Keys' that may not be persisted outside of the container. Protected data will be unavailable when container is destroyed. For more information go to https://aka.ms/aspnet/dataprotectionwarning
2025-01-27T10:40:52.074 app[32871252c63738] iad [info] info: Microsoft.AspNetCore.DataProtection.KeyManagement.XmlKeyManager[62]
2025-01-27T10:40:52.074 app[32871252c63738] iad [info] User profile is available. Using '/root/.aspnet/DataProtection-Keys' as key repository; keys will not be encrypted at rest.
2025-01-27T10:40:52.086 app[32871252c63738] iad [info] dbug: Microsoft.AspNetCore.DataProtection.KeyManagement.DefaultKeyResolver[53]
2025-01-27T10:40:52.086 app[32871252c63738] iad [info] Repository contains no viable default key. Caller should generate a key with immediate activation.
2025-01-27T10:40:52.087 app[32871252c63738] iad [info] dbug: Microsoft.AspNetCore.DataProtection.KeyManagement.KeyRingProvider[57]
2025-01-27T10:40:52.087 app[32871252c63738] iad [info] Policy resolution states that a new key should be added to the key ring.
2025-01-27T10:40:52.090 app[32871252c63738] iad [info] info: Microsoft.AspNetCore.DataProtection.KeyManagement.XmlKeyManager[58]
2025-01-27T10:40:52.090 app[32871252c63738] iad [info] Creating key {******-6967-4fe6-a898-6ea4c699dcf4} with creation date 2025-01-27 10:40:52Z, activation date 2025-01-27 10:40:52Z, and expiration date 2025-04-27 10:40:52Z.
2025-01-27T10:40:52.126 app[32871252c63738] iad [info] dbug: Microsoft.AspNetCore.DataProtection.KeyManagement.XmlKeyManager[32]
2025-01-27T10:40:52.126 app[32871252c63738] iad [info] Descriptor deserializer type for key {******-6967-4fe6-a898-6ea4c699dcf4} is 'Microsoft.AspNetCore.DataProtection.AuthenticatedEncryption.ConfigurationModel.AuthenticatedEncryptorDescriptorDeserializer, Microsoft.AspNetCore.DataProtection, Version=9.0.0.0, Culture=neutral, PublicKeyToken=adb9793829ddae60'.
2025-01-27T10:40:52.131 app[32871252c63738] iad [info] dbug: Microsoft.AspNetCore.DataProtection.KeyManagement.XmlKeyManager[34]
2025-01-27T10:40:52.131 app[32871252c63738] iad [info] No key escrow sink found. Not writing key {******-6967-4fe6-a898-6ea4c699dcf4} to escrow.
2025-01-27T10:40:52.131 app[32871252c63738] iad [info] warn: Microsoft.AspNetCore.DataProtection.KeyManagement.XmlKeyManager[35]
2025-01-27T10:40:52.131 app[32871252c63738] iad [info] No XML encryptor configured. Key {******-6967-4fe6-a898-6ea4c699dcf4} may be persisted to storage in unencrypted form.
2025-01-27T10:40:52.137 app[32871252c63738] iad [info] info: Microsoft.AspNetCore.DataProtection.Repositories.FileSystemXmlRepository[39]
2025-01-27T10:40:52.137 app[32871252c63738] iad [info] Writing data to file '/root/.aspnet/DataProtection-Keys/key-******-6967-4fe6-a898-6ea4c699dcf4.xml'.
2025-01-27T10:40:52.137 app[32871252c63738] iad [info] dbug: Microsoft.AspNetCore.DataProtection.KeyManagement.XmlKeyManager[23]
2025-01-27T10:40:52.137 app[32871252c63738] iad [info] Key cache expiration token triggered by 'CreateNewKey' operation.
2025-01-27T10:40:52.139 app[32871252c63738] iad [info] dbug: Microsoft.AspNetCore.DataProtection.Repositories.FileSystemXmlRepository[37]
2025-01-27T10:40:52.139 app[32871252c63738] iad [info] Reading data from file '/root/.aspnet/DataProtection-Keys/key-******-6967-4fe6-a898-6ea4c699dcf4.xml'.
2025-01-27T10:40:52.142 app[32871252c63738] iad [info] dbug: Microsoft.AspNetCore.DataProtection.KeyManagement.XmlKeyManager[18]
2025-01-27T10:40:52.142 app[32871252c63738] iad [info] Found key {******-6967-4fe6-a898-6ea4c699dcf4}.
2025-01-27T10:40:52.147 app[32871252c63738] iad [info] dbug: Microsoft.AspNetCore.DataProtection.KeyManagement.DefaultKeyResolver[13]
2025-01-27T10:40:52.147 app[32871252c63738] iad [info] Considering key {******-6967-4fe6-a898-6ea4c699dcf4} with expiration date 2025-04-27 10:40:52Z as default key.
2025-01-27T10:40:52.149 app[32871252c63738] iad [info] dbug: Microsoft.AspNetCore.DataProtection.AuthenticatedEncryption.ManagedAuthenticatedEncryptorFactory[11]
2025-01-27T10:40:52.149 app[32871252c63738] iad [info] Using managed symmetric algorithm 'System.Security.Cryptography.Aes'.
2025-01-27T10:40:52.149 app[32871252c63738] iad [info] dbug: Microsoft.AspNetCore.DataProtection.AuthenticatedEncryption.ManagedAuthenticatedEncryptorFactory[10]
2025-01-27T10:40:52.149 app[32871252c63738] iad [info] Using managed keyed hash algorithm 'System.Security.Cryptography.HMACSHA256'.
2025-01-27T10:40:52.152 app[32871252c63738] iad [info] dbug: Microsoft.AspNetCore.DataProtection.KeyManagement.KeyRingProvider[2]
2025-01-27T10:40:52.152 app[32871252c63738] iad [info] Using key {******-6967-4fe6-a898-6ea4c699dcf4} as the default key.
2025-01-27T10:40:52.157 app[32871252c63738] iad [info] dbug: Microsoft.AspNetCore.DataProtection.Internal.DataProtectionHostedService[65]
2025-01-27T10:40:52.157 app[32871252c63738] iad [info] Key ring with default key {******-6967-4fe6-a898-6ea4c699dcf4} was loaded during application startup.
2025-01-27T10:40:52.157 app[32871252c63738] iad [info] warn: Microsoft.AspNetCore.Hosting.Diagnostics[15]
2025-01-27T10:40:52.157 app[32871252c63738] iad [info] Overriding HTTP_PORTS '8080' and HTTPS_PORTS ''. Binding to values defined by URLS instead 'http://+:8080'.
2025-01-27T10:40:52.169 app[32871252c63738] iad [info] dbug: Microsoft.AspNetCore.HostFiltering.HostFilteringMiddleware[7]
2025-01-27T10:40:52.169 app[32871252c63738] iad [info] Middleware configuration started with options: {AllowedHosts = *, AllowEmptyHosts = True, IncludeFailureMessage = True}
2025-01-27T10:40:52.171 app[32871252c63738] iad [info] dbug: Microsoft.AspNetCore.HostFiltering.HostFilteringMiddleware[0]
2025-01-27T10:40:52.171 app[32871252c63738] iad [info] Wildcard detected, all requests with hosts will be allowed.
2025-01-27T10:40:52.199 app[32871252c63738] iad [info] info: Microsoft.Hosting.Lifetime[14]
2025-01-27T10:40:52.199 app[32871252c63738] iad [info] Now listening on: http://[::]:8080
2025-01-27T10:40:52.199 app[32871252c63738] iad [info] dbug: Microsoft.AspNetCore.Hosting.Diagnostics[13]
2025-01-27T10:40:52.199 app[32871252c63738] iad [info] Loaded hosting startup assembly *myappname*
2025-01-27T10:40:52.199 app[32871252c63738] iad [info] info: Microsoft.Hosting.Lifetime[0]
2025-01-27T10:40:52.199 app[32871252c63738] iad [info] Application started. Press Ctrl+C to shut down.
2025-01-27T10:40:52.199 app[32871252c63738] iad [info] info: Microsoft.Hosting.Lifetime[0]
2025-01-27T10:40:52.199 app[32871252c63738] iad [info] Hosting environment: Production
2025-01-27T10:40:52.199 app[32871252c63738] iad [info] info: Microsoft.Hosting.Lifetime[0]
2025-01-27T10:40:52.199 app[32871252c63738] iad [info] Content root path: /app
2025-01-27T10:40:52.199 app[32871252c63738] iad [info] dbug: Microsoft.Extensions.Hosting.Internal.Host[2]
2025-01-27T10:40:52.199 app[32871252c63738] iad [info] Hosting started
2025-01-27T10:40:52.934 proxy[32871252c63738] iad [info] machine became reachable in 1.538492804s
2025-01-27T10:40:52.944 app[32871252c63738] iad [info] dbug: Microsoft.AspNetCore.Server.Kestrel.Connections[39]
2025-01-27T10:40:52.944 app[32871252c63738] iad [info] Connection id "0HN9UNS9AOLHJ" accepted.
2025-01-27T10:40:52.946 app[32871252c63738] iad [info] dbug: Microsoft.AspNetCore.Server.Kestrel.Connections[1]
2025-01-27T10:40:52.946 app[32871252c63738] iad [info] Connection id "0HN9UNS9AOLHJ" started.
2025-01-27T10:40:52.973 app[32871252c63738] iad [info] info: Microsoft.AspNetCore.Hosting.Diagnostics[1]
2025-01-27T10:40:52.973 app[32871252c63738] iad [info] Request starting HTTP/1.1 GET http://*myappname*.fly.dev/test - - -
2025-01-27T10:40:52.973 app[32871252c63738] iad [info] trce: Microsoft.AspNetCore.HostFiltering.HostFilteringMiddleware[2]
2025-01-27T10:40:52.973 app[32871252c63738] iad [info] All hosts are allowed.
2025-01-27T10:40:52.979 app[32871252c63738] iad [info] dbug: Microsoft.AspNetCore.HttpOverrides.ForwardedHeadersMiddleware[1]
2025-01-27T10:40:52.979 app[32871252c63738] iad [info] Unknown proxy: [::ffff:172.16.5.130]:60498
2025-01-27T10:40:53.033 app[32871252c63738] iad [info] dbug: Microsoft.AspNetCore.Routing.Matching.DfaMatcher[1001]
2025-01-27T10:40:53.033 app[32871252c63738] iad [info] 1 candidate(s) found for the request path '/test'
2025-01-27T10:40:53.033 app[32871252c63738] iad [info] dbug: Microsoft.AspNetCore.Routing.Matching.DfaMatcher[1005]
2025-01-27T10:40:53.033 app[32871252c63738] iad [info] Endpoint '*myappname*.Controllers.TestController.GetAsync (*myappname*)' with route pattern 'Test' is valid for the request path '/test'
2025-01-27T10:40:53.036 app[32871252c63738] iad [info] dbug: Microsoft.AspNetCore.Routing.EndpointRoutingMiddleware[1]
2025-01-27T10:40:53.036 app[32871252c63738] iad [info] Request matched endpoint '*myappname*.Controllers.TestController.GetAsync (*myappname*)'
2025-01-27T10:40:53.037 app[32871252c63738] iad [info] trce: Microsoft.AspNetCore.Routing.EndpointRoutingMiddleware[8]
2025-01-27T10:40:53.037 app[32871252c63738] iad [info] The endpoint does not specify the IRequestSizeLimitMetadata.
2025-01-27T10:40:53.113 app[32871252c63738] iad [info] info: Microsoft.AspNetCore.Authentication.JwtBearer.JwtBearerHandler[1]
2025-01-27T10:40:53.113 app[32871252c63738] iad [info] Failed to validate the token.
2025-01-27T10:40:53.113 app[32871252c63738] iad [info] Microsoft.IdentityModel.Tokens.SecurityTokenExpiredException: IDX10223: Lifetime validation failed. The token is expired. ValidTo (UTC): '01/27/2025 00:54:54', Current time (UTC): '01/27/2025 10:40:53'.
2025-01-27T10:40:53.113 app[32871252c63738] iad [info] at Microsoft.IdentityModel.Tokens.ValidatorUtilities.ValidateLifetime(Nullable`1 notBefore, Nullable`1 expires, SecurityToken securityToken, TokenValidationParameters validationParameters)
2025-01-27T10:40:53.113 app[32871252c63738] iad [info] at Microsoft.IdentityModel.Tokens.Validators.ValidateLifetime(Nullable`1 notBefore, Nullable`1 expires, SecurityToken securityToken, TokenValidationParameters validationParameters)
2025-01-27T10:40:53.113 app[32871252c63738] iad [info] at Microsoft.IdentityModel.JsonWebTokens.JsonWebTokenHandler.ValidateTokenPayloadAsync(JsonWebToken jsonWebToken, TokenValidationParameters validationParameters, BaseConfiguration configuration)
2025-01-27T10:40:53.113 app[32871252c63738] iad [info] at Microsoft.IdentityModel.JsonWebTokens.JsonWebTokenHandler.ValidateJWSAsync(JsonWebToken jsonWebToken, TokenValidationParameters validationParameters, BaseConfiguration configuration)
2025-01-27T10:40:53.116 app[32871252c63738] iad [info] info: Microsoft.AspNetCore.Authentication.JwtBearer.JwtBearerHandler[7]
2025-01-27T10:40:53.116 app[32871252c63738] iad [info] Bearer was not authenticated. Failure message: IDX10223: Lifetime validation failed. The token is expired. ValidTo (UTC): '01/27/2025 00:54:54', Current time (UTC): '01/27/2025 10:40:53'.
2025-01-27T10:40:53.119 app[32871252c63738] iad [info] info: Microsoft.AspNetCore.Routing.EndpointMiddleware[0]
2025-01-27T10:40:53.119 app[32871252c63738] iad [info] Executing endpoint '*myappname*.Controllers.TestController.GetAsync (*myappname*)'
2025-01-27T10:40:53.145 app[32871252c63738] iad [info] info: Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker[102]
2025-01-27T10:40:53.145 app[32871252c63738] iad [info] Route matched with {action = "Get", controller = "Test"}. Executing controller action with signature System.Threading.Tasks.Task`1[Microsoft.AspNetCore.Mvc.IActionResult] GetAsync() on controller *myappname*.Controllers.TestController (*myappname*).
2025-01-27T10:40:53.147 app[32871252c63738] iad [info] dbug: Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker[1]
2025-01-27T10:40:53.147 app[32871252c63738] iad [info] Execution plan of authorization filters (in the following order): None
2025-01-27T10:40:53.148 app[32871252c63738] iad [info] dbug: Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker[1]
2025-01-27T10:40:53.148 app[32871252c63738] iad [info] Execution plan of resource filters (in the following order): None
2025-01-27T10:40:53.149 app[32871252c63738] iad [info] dbug: Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker[1]
2025-01-27T10:40:53.149 app[32871252c63738] iad [info] Execution plan of action filters (in the following order): Microsoft.AspNetCore.Mvc.ModelBinding.UnsupportedContentTypeFilter (Order: -3000), Microsoft.AspNetCore.Mvc.Infrastructure.ModelStateInvalidFilter (Order: -2000)
2025-01-27T10:40:53.149 app[32871252c63738] iad [info] dbug: Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker[1]
2025-01-27T10:40:53.149 app[32871252c63738] iad [info] Execution plan of exception filters (in the following order): None
2025-01-27T10:40:53.149 app[32871252c63738] iad [info] dbug: Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker[1]
2025-01-27T10:40:53.149 app[32871252c63738] iad [info] Execution plan of result filters (in the following order): Microsoft.AspNetCore.Mvc.Infrastructure.ClientErrorResultFilter (Order: -2000)
2025-01-27T10:40:53.150 app[32871252c63738] iad [info] dbug: Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker[1]
2025-01-27T10:40:53.150 app[32871252c63738] iad [info] Executing controller factory for controller *myappname*.Controllers.TestController (*myappname*)
2025-01-27T10:40:53.151 app[32871252c63738] iad [info] dbug: Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker[2]
2025-01-27T10:40:53.151 app[32871252c63738] iad [info] Executed controller factory for controller *myappname*.Controllers.TestController (*myappname*)
2025-01-27T10:40:53.152 app[32871252c63738] iad [info] trce: Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker[52]
2025-01-27T10:40:53.152 app[32871252c63738] iad [info] Action Filter: Before executing OnActionExecuting on filter Microsoft.AspNetCore.Mvc.ModelBinding.UnsupportedContentTypeFilter.
2025-01-27T10:40:53.152 app[32871252c63738] iad [info] trce: Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker[53]
2025-01-27T10:40:53.152 app[32871252c63738] iad [info] Action Filter: After executing OnActionExecuting on filter Microsoft.AspNetCore.Mvc.ModelBinding.UnsupportedContentTypeFilter.
2025-01-27T10:40:53.152 app[32871252c63738] iad [info] trce: Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker[52]
2025-01-27T10:40:53.152 app[32871252c63738] iad [info] Action Filter: Before executing OnActionExecuting on filter Microsoft.AspNetCore.Mvc.Infrastructure.ModelStateInvalidFilter.
2025-01-27T10:40:53.156 app[32871252c63738] iad [info] trce: Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker[53]
2025-01-27T10:40:53.156 app[32871252c63738] iad [info] Action Filter: After executing OnActionExecuting on filter Microsoft.AspNetCore.Mvc.Infrastructure.ModelStateInvalidFilter.
2025-01-27T10:40:53.158 app[32871252c63738] iad [info] info: Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker[101]
2025-01-27T10:40:53.158 app[32871252c63738] iad [info] Executing action method *myappname*.Controllers.TestController.GetAsync (*myappname*) - Validation state: Valid
2025-01-27T10:40:53.177 app[32871252c63738] iad [info] info: System.Net.Http.HttpClient.Default.LogicalHandler[100]
2025-01-27T10:40:53.177 app[32871252c63738] iad [info] Start processing HTTP request GET https://fly.storage.tigris.dev/bigfiles/**mykeyobject**?*
2025-01-27T10:40:53.178 app[32871252c63738] iad [info] trce: System.Net.Http.HttpClient.Default.LogicalHandler[102]
2025-01-27T10:40:53.178 app[32871252c63738] iad [info] Request Headers:
2025-01-27T10:40:53.178 app[32871252c63738] iad [info] info: System.Net.Http.HttpClient.Default.ClientHandler[100]
2025-01-27T10:40:53.178 app[32871252c63738] iad [info] Sending HTTP request GET https://fly.storage.tigris.dev/bigfiles/**mykeyobject**?*
2025-01-27T10:40:53.178 app[32871252c63738] iad [info] trce: System.Net.Http.HttpClient.Default.ClientHandler[102]
2025-01-27T10:40:53.178 app[32871252c63738] iad [info] Request Headers:
2025-01-27T10:40:53.407 app[32871252c63738] iad [info] trce: Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker[52]
2025-01-27T10:40:53.407 app[32871252c63738] iad [info] Action Filter: Before executing OnActionExecuted on filter Microsoft.AspNetCore.Mvc.Infrastructure.ModelStateInvalidFilter.
2025-01-27T10:40:53.407 app[32871252c63738] iad [info] trce: Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker[53]
2025-01-27T10:40:53.407 app[32871252c63738] iad [info] Action Filter: After executing OnActionExecuted on filter Microsoft.AspNetCore.Mvc.Infrastructure.ModelStateInvalidFilter.
2025-01-27T10:40:53.407 app[32871252c63738] iad [info] trce: Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker[52]
2025-01-27T10:40:53.407 app[32871252c63738] iad [info] Action Filter: Before executing OnActionExecuted on filter Microsoft.AspNetCore.Mvc.ModelBinding.UnsupportedContentTypeFilter.
2025-01-27T10:40:53.407 app[32871252c63738] iad [info] trce: Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker[53]
2025-01-27T10:40:53.407 app[32871252c63738] iad [info] Action Filter: After executing OnActionExecuted on filter Microsoft.AspNetCore.Mvc.ModelBinding.UnsupportedContentTypeFilter.
2025-01-27T10:40:53.422 app[32871252c63738] iad [info] info: Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker[105]
2025-01-27T10:40:53.422 app[32871252c63738] iad [info] Executed action *myappname*.Controllers.TestController.GetAsync (*myappname*) in 259.199ms
2025-01-27T10:40:53.423 app[32871252c63738] iad [info] info: Microsoft.AspNetCore.Routing.EndpointMiddleware[1]
2025-01-27T10:40:53.423 app[32871252c63738] iad [info] Executed endpoint '*myappname*.Controllers.TestController.GetAsync (*myappname*)'
2025-01-27T10:40:53.432 app[32871252c63738] iad [info] fail: Microsoft.AspNetCore.Server.Kestrel[13]
2025-01-27T10:40:53.432 app[32871252c63738] iad [info] Connection id "0HN9UNS9AOLHJ", Request id "0HN9UNS9AOLHJ:00000001": An unhandled exception was thrown by the application.
2025-01-27T10:40:53.432 app[32871252c63738] iad [info] System.Net.Http.HttpRequestException: An error occurred while sending the request.
2025-01-27T10:40:53.432 app[32871252c63738] iad [info] ---> System.Net.Http.HttpIOException: The response ended prematurely. (ResponseEnded)
2025-01-27T10:40:53.432 app[32871252c63738] iad [info] at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
2025-01-27T10:40:53.432 app[32871252c63738] iad [info] --- End of inner exception stack trace ---
2025-01-27T10:40:53.432 app[32871252c63738] iad [info] at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
2025-01-27T10:40:53.432 app[32871252c63738] iad [info] at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)
2025-01-27T10:40:53.432 app[32871252c63738] iad [info] at System.Net.Http.DiagnosticsHandler.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
2025-01-27T10:40:53.432 app[32871252c63738] iad [info] at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)
2025-01-27T10:40:53.432 app[32871252c63738] iad [info] at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.<SendCoreAsync>g__Core|4_0(HttpRequestMessage request, Boolean useAsync, CancellationToken cancellationToken)
2025-01-27T10:40:53.432 app[32871252c63738] iad [info] at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<SendCoreAsync>g__Core|4_0(HttpRequestMessage request, Boolean useAsync, CancellationToken cancellationToken)
2025-01-27T10:40:53.432 app[32871252c63738] iad [info] at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
2025-01-27T10:40:53.432 app[32871252c63738] iad [info] at *myappname*.Controllers.TestController.GetAsync() in /src/Controllers/TestController.cs:line 21
2025-01-27T10:40:53.432 app[32871252c63738] iad [info] at Microsoft.AspNetCore.Mvc.Infrastructure.ActionMethodExecutor.TaskOfIActionResultExecutor.Execute(ActionContext actionContext, IActionResultTypeMapper mapper, ObjectMethodExecutor executor, Object controller, Object[] arguments)
2025-01-27T10:40:53.432 app[32871252c63738] iad [info] at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<InvokeActionMethodAsync>g__Logged|12_1(ControllerActionInvoker invoker)
2025-01-27T10:40:53.432 app[32871252c63738] iad [info] at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<InvokeNextActionFilterAsync>g__Awaited|10_0(ControllerActionInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
2025-01-27T10:40:53.432 app[32871252c63738] iad [info] at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Rethrow(ActionExecutedContextSealed context)
2025-01-27T10:40:53.432 app[32871252c63738] iad [info] at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Next(State& next, Scope& scope, Object& state, Boolean& isCompleted)
2025-01-27T10:40:53.432 app[32871252c63738] iad [info] at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<InvokeInnerFilterAsync>g__Awaited|13_0(ControllerActionInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
2025-01-27T10:40:53.432 app[32871252c63738] iad [info] at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<InvokeFilterPipelineAsync>g__Awaited|20_0(ResourceInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
2025-01-27T10:40:53.432 app[32871252c63738] iad [info] at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<InvokeAsync>g__Logged|17_1(ResourceInvoker invoker)
2025-01-27T10:40:53.432 app[32871252c63738] iad [info] at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<InvokeAsync>g__Logged|17_1(ResourceInvoker invoker)
2025-01-27T10:40:53.432 app[32871252c63738] iad [info] at Microsoft.AspNetCore.Routing.EndpointMiddleware.<Invoke>g__AwaitRequestTask|7_0(Endpoint endpoint, Task requestTask, ILogger logger)
2025-01-27T10:40:53.432 app[32871252c63738] iad [info] at Microsoft.AspNetCore.Authorization.AuthorizationMiddleware.Invoke(HttpContext context)
2025-01-27T10:40:53.432 app[32871252c63738] iad [info] at Microsoft.AspNetCore.Authentication.AuthenticationMiddleware.Invoke(HttpContext context)
2025-01-27T10:40:53.432 app[32871252c63738] iad [info] at Microsoft.AspNetCore.Server.Kestrel.Core.Internal.Http.HttpProtocol.ProcessRequests[TContext](IHttpApplication`1 application)
2025-01-27T10:40:53.434 app[32871252c63738] iad [info] dbug: Microsoft.AspNetCore.Server.Kestrel.Connections[9]
2025-01-27T10:40:53.434 app[32871252c63738] iad [info] Connection id "0HN9UNS9AOLHJ" completed keep alive response.
2025-01-27T10:40:53.437 app[32871252c63738] iad [info] info: Microsoft.AspNetCore.Hosting.Diagnostics[2]
2025-01-27T10:40:53.437 app[32871252c63738] iad [info] Request finished HTTP/1.1 GET http://*myappname*.fly.dev/test - 500 0 - 463.0823ms
2025-01-27T10:40:53.441 app[32871252c63738] iad [info] dbug: Microsoft.AspNetCore.Server.Kestrel.Transport.Sockets[6]
2025-01-27T10:40:53.441 app[32871252c63738] iad [info] Connection id "0HN9UNS9AOLHJ" received FIN.
2025-01-27T10:40:53.442 app[32871252c63738] iad [info] dbug: Microsoft.AspNetCore.Server.Kestrel.Connections[10]
2025-01-27T10:40:53.442 app[32871252c63738] iad [info] Connection id "0HN9UNS9AOLHJ" disconnecting.
2025-01-27T10:40:53.442 app[32871252c63738] iad [info] dbug: Microsoft.AspNetCore.Server.Kestrel.Connections[2]
2025-01-27T10:40:53.442 app[32871252c63738] iad [info] Connection id "0HN9UNS9AOLHJ" stopped.
2025-01-27T10:40:53.444 app[32871252c63738] iad [info] dbug: Microsoft.AspNetCore.Server.Kestrel.Transport.Sockets[7]
2025-01-27T10:40:53.444 app[32871252c63738] iad [info] Connection id "0HN9UNS9AOLHJ" sending FIN because: "The Socket transport's send loop completed gracefully."
if i retry sometimes it just work(sometimes , it failed again.):
sucess request response headers:
content-type: text/plain; charset=utf-8
date: Mon, 27 Jan 2025 10:42:42 GMT
server: Fly/a3e18ae92 (2025-01-16)
transfer-encoding: chunked
content-encoding: br
via: 1.1 fly.io
fly-request-id: 01JJKNPF82J67J475202EZX7N7-sea