Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
38 out of 60 is failed (threshold=3) [...............XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX...X....] duration:
228.643627ms
FAIL (2025-08-07 21:47:40 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 228.660437ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
44 out of 60 is failed (threshold=3) [...............XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXXXX] duration:
30.000611206s
FAIL (2025-08-07 21:47:37 UTC)
operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== shed. err: metaclient: context deadline exceeded Aug 7 21:38:26.513648977 (5h11m40.100705218s) [upload=5344]: Starting upload Aug 7 21:38:26.513731310 (5h11m40.100787552s) [upload=5344]: Done starting upload Aug 7 21:38:26.513792245 (5h11m40.100848496s) [upload=5344]: Uploading segments... Aug 7 21:38:26.513834112 (5h11m40.100890354s) [upload=5344]: Got next segment. Inline: true Aug 7 21:38:26.513839653 (5h11m40.100895904s) [upload=5344]: Waiting for error group managing segments... Aug 7 21:38:26.513884006 (5h11m40.100940247s) [upload=5344]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:38:26.513889947 (5h11m40.100946188s) [upload=5344]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:38:26.513893434 (5h11m40.100949675s) [upload=5344]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:38:56.502052245 (5h12m10.089108537s) [upload=5344]: Done uploading segments... Aug 7 21:38:56.502102730 (5h12m10.089158972s) [upload=5344]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:39:24.008006172 (5h12m37.595062394s) [upload=5359]: Starting upload Aug 7 21:39:24.008059211 (5h12m37.595115422s) [upload=5359]: Done starting upload Aug 7 21:39:24.008103604 (5h12m37.595159835s) [upload=5359]: Uploading segments... Aug 7 21:39:24.008156191 (5h12m37.595212413s) [upload=5359]: Got next segment. Inline: true Aug 7 21:39:24.008162193 (5h12m37.595218414s) [upload=5359]: Waiting for error group managing segments... Aug 7 21:39:24.008207327 (5h12m37.595263548s) [upload=5359]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:39:24.008212668 (5h12m37.595268878s) [upload=5359]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:39:24.008216064 (5h12m37.595272285s) [upload=5359]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:39:53.997226503 (5h13m7.584282744s) [upload=5359]: Done uploading segments... Aug 7 21:39:53.997270334 (5h13m7.584326586s) [upload=5359]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:40:36.779619947 (5h13m50.366676188s) [upload=5383]: Starting upload Aug 7 21:40:36.779696139 (5h13m50.36675238s) [upload=5383]: Done starting upload Aug 7 21:40:36.779752775 (5h13m50.366809016s) [upload=5383]: Uploading segments... Aug 7 21:40:36.779788803 (5h13m50.366845044s) [upload=5383]: Got next segment. Inline: true Aug 7 21:40:36.779794423 (5h13m50.366850655s) [upload=5383]: Waiting for error group managing segments... Aug 7 21:40:36.779835950 (5h13m50.366892191s) [upload=5383]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:40:36.779841010 (5h13m50.366897241s) [upload=5383]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:40:36.779844195 (5h13m50.366900437s) [upload=5383]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:41:06.765292852 (5h14m20.352349064s) [upload=5383]: Done uploading segments... Aug 7 21:41:06.765314052 (5h14m20.352370273s) [upload=5383]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:41:47.961322510 (5h15m1.548378802s) [upload=5399]: Starting upload Aug 7 21:41:47.961442915 (5h15m1.548499166s) [upload=5399]: Done starting upload Aug 7 21:41:47.961510201 (5h15m1.548566443s) [upload=5399]: Uploading segments... Aug 7 21:41:47.961591062 (5h15m1.548647313s) [upload=5399]: Got next segment. Inline: true Aug 7 21:41:47.961599218 (5h15m1.548655458s) [upload=5399]: Waiting for error group managing segments... Aug 7 21:41:47.961647759 (5h15m1.548703999s) [upload=5399]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:41:47.961653760 (5h15m1.548710001s) [upload=5399]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:41:47.961657546 (5h15m1.548713787s) [upload=5399]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:42:17.948677724 (5h15m31.535733945s) [upload=5399]: Done uploading segments... Aug 7 21:42:17.948691099 (5h15m31.53574731s) [upload=5399]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:42:18.081006705 (5h15m31.668062915s) [upload=5405]: Starting upload Aug 7 21:42:18.081065655 (5h15m31.668121866s) [upload=5405]: Done starting upload Aug 7 21:42:18.081113425 (5h15m31.668169635s) [upload=5405]: Uploading segments... Aug 7 21:42:18.081164870 (5h15m31.668221091s) [upload=5405]: Got next segment. Inline: true Aug 7 21:42:18.081169459 (5h15m31.66822568s) [upload=5405]: Waiting for error group managing segments... Aug 7 21:42:18.081201809 (5h15m31.66825803s) [upload=5405]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:42:18.081205546 (5h15m31.668261757s) [upload=5405]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:42:18.081208271 (5h15m31.668264483s) [upload=5405]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:42:18.161269758 (5h15m31.748325999s) [upload=5405]: Done uploading segments... Aug 7 21:42:18.161287411 (5h15m31.748343652s) [upload=5405]: Upload finished. err: <nil> Aug 7 21:43:12.878567983 (5h16m26.465624204s) [upload=5420]: Starting upload Aug 7 21:43:12.878678820 (5h16m26.465735041s) [upload=5420]: Done starting upload Aug 7 21:43:12.878731839 (5h16m26.46578806s) [upload=5420]: Uploading segments... Aug 7 21:43:12.878762908 (5h16m26.465819129s) [upload=5420]: Got next segment. Inline: true Aug 7 21:43:12.878766635 (5h16m26.465822856s) [upload=5420]: Waiting for error group managing segments... Aug 7 21:43:12.878799204 (5h16m26.465855425s) [upload=5420]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:43:12.878803332 (5h16m26.465859543s) [upload=5420]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:43:12.878805566 (5h16m26.465861787s) [upload=5420]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:43:42.863779226 (5h16m56.450835478s) [upload=5420]: Done uploading segments... Aug 7 21:43:42.863802450 (5h16m56.450858691s) [upload=5420]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:43:51.464096058 (5h17m5.051152299s) [upload=5431]: Starting upload Aug 7 21:43:51.464210432 (5h17m5.051266673s) [upload=5431]: Done starting upload Aug 7 21:43:51.464274041 (5h17m5.051330282s) [upload=5431]: Uploading segments... Aug 7 21:43:51.464330065 (5h17m5.051386366s) [upload=5431]: Got next segment. Inline: true Aug 7 21:43:51.464343630 (5h17m5.051399912s) [upload=5431]: Waiting for error group managing segments... Aug 7 21:43:51.464415315 (5h17m5.051471556s) [upload=5431]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:43:51.464424673 (5h17m5.051480923s) [upload=5431]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:43:51.464431204 (5h17m5.051487455s) [upload=5431]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:44:21.448488824 (5h17m35.035545036s) [upload=5431]: Done uploading segments... Aug 7 21:44:21.448528209 (5h17m35.03558443s) [upload=5431]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:44:50.396194570 (5h18m3.983250782s) [upload=5444]: Starting upload Aug 7 21:44:50.396243653 (5h18m3.983299864s) [upload=5444]: Done starting upload Aug 7 21:44:50.396286463 (5h18m3.983342684s) [upload=5444]: Uploading segments... Aug 7 21:44:50.396309054 (5h18m3.983365266s) [upload=5444]: Got next segment. Inline: true Aug 7 21:44:50.396312381 (5h18m3.983368592s) [upload=5444]: Waiting for error group managing segments... Aug 7 21:44:50.396342687 (5h18m3.983398908s) [upload=5444]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:44:50.396346635 (5h18m3.983402856s) [upload=5444]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:44:50.396348889 (5h18m3.98340511s) [upload=5444]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:45:20.384461417 (5h18m33.971517668s) [upload=5444]: Done uploading segments... Aug 7 21:45:20.384482547 (5h18m33.971538788s) [upload=5444]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:45:58.414522311 (5h19m12.001578522s) [upload=5465]: Starting upload Aug 7 21:45:58.414582292 (5h19m12.001638504s) [upload=5465]: Done starting upload Aug 7 21:45:58.414634661 (5h19m12.001690882s) [upload=5465]: Uploading segments... Aug 7 21:45:58.414662251 (5h19m12.001718462s) [upload=5465]: Got next segment. Inline: true Aug 7 21:45:58.414665918 (5h19m12.00172213s) [upload=5465]: Waiting for error group managing segments... Aug 7 21:45:58.414697247 (5h19m12.001753468s) [upload=5465]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:45:58.414700753 (5h19m12.001756975s) [upload=5465]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:45:58.414703007 (5h19m12.001759229s) [upload=5465]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:46:28.397843251 (5h19m41.984899492s) [upload=5465]: Done uploading segments... Aug 7 21:46:28.397885870 (5h19m41.984942112s) [upload=5465]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:47:07.964355881 (5h20m21.551412133s) [upload=5484]: Starting upload Aug 7 21:47:07.964442332 (5h20m21.551498584s) [upload=5484]: Done starting upload Aug 7 21:47:07.964529184 (5h20m21.551585426s) [upload=5484]: Uploading segments... Aug 7 21:47:07.964568658 (5h20m21.5516249s) [upload=5484]: Got next segment. Inline: true Aug 7 21:47:07.964573968 (5h20m21.551630209s) [upload=5484]: Waiting for error group managing segments... Aug 7 21:47:07.964617630 (5h20m21.551673881s) [upload=5484]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:47:07.964623640 (5h20m21.551679882s) [upload=5484]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:47:07.964628048 (5h20m21.55168429s) [upload=5484]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:47:37.944795042 (5h20m51.531851283s) [upload=5484]: Done uploading segments... Aug 7 21:47:37.944820539 (5h20m51.531876781s) [upload=5484]: Upload finished. err: metaclient: context deadline exceeded
Duration: 30.000631564s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
4 out of 60 is failed (threshold=3) [.........................X........XX...X....................] duration:
26.93027ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-07 21:47:29 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 26.947984ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
37 out of 60 is failed (threshold=3) [..............XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XX........] duration:
455.990209ms
FAIL (2025-08-07 21:47:26 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 456.009546ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
41 out of 60 is failed (threshold=3) [............XX..XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.X....] duration:
459.56859ms
FAIL (2025-08-07 21:47:25 UTC)
operation: Commit uplink: metaclient: context deadline exceeded
Duration: 459.589761ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
30 out of 60 is failed (threshold=3) [............................XXXXXXXXXXXXXXXXXXXXXXXXXXXX.X.X] duration:
1m0.000413183s
FAIL (2025-08-07 21:47:18 UTC)
operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 78296905s) [upload=5309]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:37:15.177436931 (5h10m28.764493172s) [upload=5324]: Starting upload Aug 7 21:37:15.177533852 (5h10m28.764590103s) [upload=5324]: Done starting upload Aug 7 21:37:15.177602810 (5h10m28.764659061s) [upload=5324]: Uploading segments... Aug 7 21:37:15.177645340 (5h10m28.764701581s) [upload=5324]: Got next segment. Inline: true Aug 7 21:37:15.177650961 (5h10m28.764707202s) [upload=5324]: Waiting for error group managing segments... Aug 7 21:37:15.177698649 (5h10m28.76475489s) [upload=5324]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:37:15.177704300 (5h10m28.764760541s) [upload=5324]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:37:15.177708177 (5h10m28.764764428s) [upload=5324]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:37:40.730185715 (5h10m54.317241957s) [upload=5324]: Done uploading segments... Aug 7 21:37:40.730203639 (5h10m54.31725988s) [upload=5324]: Upload finished. err: <nil> Aug 7 21:38:15.287715124 (5h11m28.874771365s) [upload=5341]: Starting upload Aug 7 21:38:15.287780276 (5h11m28.874836516s) [upload=5341]: Done starting upload Aug 7 21:38:15.287844856 (5h11m28.874901107s) [upload=5341]: Uploading segments... Aug 7 21:38:15.287889961 (5h11m28.874946201s) [upload=5341]: Got next segment. Inline: true Aug 7 21:38:15.287895600 (5h11m28.874951842s) [upload=5341]: Waiting for error group managing segments... Aug 7 21:38:15.287984066 (5h11m28.875040317s) [upload=5341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:38:15.287990077 (5h11m28.875046318s) [upload=5341]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:38:15.287993564 (5h11m28.875049804s) [upload=5341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:39:15.275679218 (5h12m28.862735459s) [upload=5341]: Done uploading segments... Aug 7 21:39:15.275708622 (5h12m28.862764883s) [upload=5341]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:39:15.358605080 (5h12m28.945661322s) [upload=5358]: Starting upload Aug 7 21:39:15.358690641 (5h12m28.945746882s) [upload=5358]: Done starting upload Aug 7 21:39:15.358748869 (5h12m28.945805111s) [upload=5358]: Uploading segments... Aug 7 21:39:15.358790938 (5h12m28.94584718s) [upload=5358]: Got next segment. Inline: true Aug 7 21:39:15.358796779 (5h12m28.94585302s) [upload=5358]: Waiting for error group managing segments... Aug 7 21:39:15.358840480 (5h12m28.945896721s) [upload=5358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:39:15.358846441 (5h12m28.945902683s) [upload=5358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:39:15.358849918 (5h12m28.945906159s) [upload=5358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:40:15.344303433 (5h13m28.931359654s) [upload=5358]: Done uploading segments... Aug 7 21:40:15.344323120 (5h13m28.931379331s) [upload=5358]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:40:15.438334176 (5h13m29.025390397s) [upload=5373]: Starting upload Aug 7 21:40:15.438379379 (5h13m29.025435601s) [upload=5373]: Done starting upload Aug 7 21:40:15.438418503 (5h13m29.025474714s) [upload=5373]: Uploading segments... Aug 7 21:40:15.438447206 (5h13m29.025503427s) [upload=5373]: Got next segment. Inline: true Aug 7 21:40:15.438450683 (5h13m29.025506894s) [upload=5373]: Waiting for error group managing segments... Aug 7 21:40:15.438481920 (5h13m29.025538141s) [upload=5373]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:40:15.438487511 (5h13m29.025543722s) [upload=5373]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:40:15.438489826 (5h13m29.025546047s) [upload=5373]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:41:15.423387101 (5h14m29.010443342s) [upload=5373]: Done uploading segments... Aug 7 21:41:15.423408011 (5h14m29.010464251s) [upload=5373]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:41:15.514709386 (5h14m29.101765628s) [upload=5390]: Starting upload Aug 7 21:41:15.514790870 (5h14m29.10184711s) [upload=5390]: Done starting upload Aug 7 21:41:15.514852845 (5h14m29.101909086s) [upload=5390]: Uploading segments... Aug 7 21:41:15.514892409 (5h14m29.10194865s) [upload=5390]: Got next segment. Inline: true Aug 7 21:41:15.514898240 (5h14m29.101954481s) [upload=5390]: Waiting for error group managing segments... Aug 7 21:41:15.514941951 (5h14m29.101998192s) [upload=5390]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:41:15.514947551 (5h14m29.102003793s) [upload=5390]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:41:15.514951138 (5h14m29.102007389s) [upload=5390]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:42:15.497042181 (5h15m29.084098402s) [upload=5390]: Done uploading segments... Aug 7 21:42:15.497058301 (5h15m29.084114512s) [upload=5390]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:42:15.596278951 (5h15m29.183335172s) [upload=5404]: Starting upload Aug 7 21:42:15.596337329 (5h15m29.183393541s) [upload=5404]: Done starting upload Aug 7 21:42:15.596382114 (5h15m29.183438324s) [upload=5404]: Uploading segments... Aug 7 21:42:15.596411919 (5h15m29.18346814s) [upload=5404]: Got next segment. Inline: true Aug 7 21:42:15.596415937 (5h15m29.183472158s) [upload=5404]: Waiting for error group managing segments... Aug 7 21:42:15.596447405 (5h15m29.183503626s) [upload=5404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:42:15.596451042 (5h15m29.183507263s) [upload=5404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:42:15.596453266 (5h15m29.183509487s) [upload=5404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:43:15.584735444 (5h16m29.171791655s) [upload=5404]: Done uploading segments... Aug 7 21:43:15.584747787 (5h16m29.171804008s) [upload=5404]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:43:22.691047415 (5h16m36.278103646s) [upload=5423]: Starting upload Aug 7 21:43:22.691110724 (5h16m36.278166955s) [upload=5423]: Done starting upload Aug 7 21:43:22.691177108 (5h16m36.278233338s) [upload=5423]: Uploading segments... Aug 7 21:43:22.691210019 (5h16m36.27826625s) [upload=5423]: Got next segment. Inline: true Aug 7 21:43:22.691214187 (5h16m36.278270418s) [upload=5423]: Waiting for error group managing segments... Aug 7 21:43:22.691250704 (5h16m36.278306925s) [upload=5423]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:43:22.691255263 (5h16m36.278311494s) [upload=5423]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:43:22.691258188 (5h16m36.278314419s) [upload=5423]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:43:22.751511620 (5h16m36.338567872s) [upload=5423]: Done uploading segments... Aug 7 21:43:22.751530204 (5h16m36.338586455s) [upload=5423]: Upload finished. err: <nil> Aug 7 21:44:13.185700222 (5h17m26.772756433s) [upload=5437]: Starting upload Aug 7 21:44:13.185766515 (5h17m26.772822736s) [upload=5437]: Done starting upload Aug 7 21:44:13.185811771 (5h17m26.772867981s) [upload=5437]: Uploading segments... Aug 7 21:44:13.185877192 (5h17m26.772933443s) [upload=5437]: Got next segment. Inline: true Aug 7 21:44:13.185884005 (5h17m26.772940226s) [upload=5437]: Waiting for error group managing segments... Aug 7 21:44:13.185926104 (5h17m26.772982314s) [upload=5437]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:44:13.185931043 (5h17m26.772987254s) [upload=5437]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:44:13.185934560 (5h17m26.77299077s) [upload=5437]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:45:13.172887995 (5h18m26.759944236s) [upload=5437]: Done uploading segments... Aug 7 21:45:13.172908133 (5h18m26.759964374s) [upload=5437]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:45:13.256441576 (5h18m26.843497827s) [upload=5449]: Starting upload Aug 7 21:45:13.256514653 (5h18m26.843570894s) [upload=5449]: Done starting upload Aug 7 21:45:13.256603699 (5h18m26.84365995s) [upload=5449]: Uploading segments... Aug 7 21:45:13.256644835 (5h18m26.843701076s) [upload=5449]: Got next segment. Inline: true Aug 7 21:45:13.256650195 (5h18m26.843706436s) [upload=5449]: Waiting for error group managing segments... Aug 7 21:45:13.256695270 (5h18m26.843751511s) [upload=5449]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:45:13.256701020 (5h18m26.843757262s) [upload=5449]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:45:13.256704657 (5h18m26.843760898s) [upload=5449]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:45:13.340684827 (5h18m26.927741079s) [upload=5449]: Done uploading segments... Aug 7 21:45:13.340709023 (5h18m26.927765264s) [upload=5449]: Upload finished. err: <nil> Aug 7 21:46:18.644805531 (5h19m32.231861771s) [upload=5472]: Starting upload Aug 7 21:46:18.644902892 (5h19m32.231959133s) [upload=5472]: Done starting upload Aug 7 21:46:18.644968324 (5h19m32.232024565s) [upload=5472]: Uploading segments... Aug 7 21:46:18.645015051 (5h19m32.232071292s) [upload=5472]: Got next segment. Inline: true Aug 7 21:46:18.645020682 (5h19m32.232076933s) [upload=5472]: Waiting for error group managing segments... Aug 7 21:46:18.645064344 (5h19m32.232120585s) [upload=5472]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:46:18.645070025 (5h19m32.232126266s) [upload=5472]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:46:18.645073771 (5h19m32.232130013s) [upload=5472]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:47:18.630338668 (5h20m32.217394879s) [upload=5472]: Done uploading segments... Aug 7 21:47:18.630353927 (5h20m32.217410137s) [upload=5472]: Upload finished. err: metaclient: context deadline exceeded
Duration: 1m0.00043238s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
35 out of 60 is failed (threshold=3) [.................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX..X......] duration:
362.039709ms
FAIL (2025-08-07 21:47:17 UTC)
operation: sync2.Copy
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
7 (5h14m28.062269058s) [upload=5388]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 21:41:25.266685321 (5h14m38.853741562s) [upload=5388]: Done uploading segments...
Aug 7 21:41:25.266706391 (5h14m38.853762631s) [upload=5388]: Upload finished. err: <nil>
Aug 7 21:41:41.070176076 (5h14m54.657232316s) [upload=5396]: Starting upload
Aug 7 21:41:41.070246557 (5h14m54.657302798s) [upload=5396]: Done starting upload
Aug 7 21:41:41.070459143 (5h14m54.657515385s) [upload=5396]: Uploading segments...
Aug 7 21:41:41.070697238 (5h14m54.657753479s) [upload=5396]: Got next segment. Inline: false
Aug 7 21:41:41.070732264 (5h14m54.657788505s) [upload=5396]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 21:41:41.070737293 (5h14m54.657793524s) [upload=5396]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 21:41:41.825834701 (5h14m55.412890922s) [seg_pos={0 0}, upload=5396]: Begin upload segment...
Aug 7 21:41:41.825865027 (5h14m55.412921237s) [seg_pos={0 0}, upload=5396]: Done begin upload segment.
Aug 7 21:41:41.825886015 (5h14m55.412942237s) [noise=true , address=77.90.31.12:4592 , piece_id=75OFHQZRJKZYL3QJ37T6QLDED663WXIEFAHTH2BQZLZ46PY5YPLQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.825988818 (5h14m55.413045068s) [noise=true , address=45.91.116.5:4298 , piece_id=C3BQRSMSRSM4FJ7SWEBPHH7UKNUJWCDD5AEEBEAYN6OMCM2VRSWA, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.826203979 (5h14m55.413260201s) [noise=true , address=45.91.116.4:4937 , piece_id=BYNKX2DGOGITTOYV7IH73WDLAPXHXWG5V5WFIJDTM5RUJQYP6MLQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.826435742 (5h14m55.413491953s) [noise=true , address=77.90.31.13:4627 , piece_id=7MG24AD6AUVL6X66RZJ43OSAM7FLBB33KQY4ENE4Q3NR6PA63YQQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.826541530 (5h14m55.41359777s) [noise=true , address=45.91.116.5:4299 , piece_id=XY3RW62XNQVLM6NTAZTBF26HWTY5KR3ZEJGVYTSTENY2B77YLBMA, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.826653037 (5h14m55.413709248s) [noise=true , address=77.90.31.14:4661 , piece_id=U3YYDMWVGG4NEV5OSK4ATJ2RNTEYCIXKH3KXY7UR3RGJXEUA25IA, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.826875332 (5h14m55.413931543s) [noise=true , address=77.90.31.10:4519 , piece_id=OQZPQPV2NUVKLMSHONEMH2HUK52KXL2E6NXXSO2J6CP7IDTRVT7Q, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.826921499 (5h14m55.41397774s) [noise=true , address=104.36.82.11:4114 , piece_id=KB2SDFXXBJDEYUHUNIO3YSANNDXVREF46SGOSWQ3YBHRR42TFD4A, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.827091606 (5h14m55.414147827s) [noise=true , address=45.91.116.4:4940 , piece_id=ETERKOUZIHEOKPCAJPSUBGXFMDLKEELCVMIW34LR7G66FBFMUNTA, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.827323819 (5h14m55.41438003s) [noise=true , address=77.90.31.17:4771 , piece_id=IYUYS3YHOD44ZF2OGKQX7JCFVW2GBU5S2TVC3FZ2M3JNF67TP4CQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.827393500 (5h14m55.414449742s) [noise=true , address=104.36.82.6:4875 , piece_id=B263E3OQZQDAAYHN3YIPJ4RBLTNOFNOXAZWYTVEGGVRM2YES3PBQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.827542938 (5h14m55.414599159s) [noise=true , address=104.36.82.7:4911 , piece_id=GLWOEWKACQVRHXQ6EY45IYR5N7VCP75FUZIYT5WRQG2VXULRUIUA, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.827778078 (5h14m55.414834318s) [noise=true , address=104.36.82.10:4077 , piece_id=LZBNWOC4E35SX6FKBLATK2QFZDUWA7CBA5RY422YHVMMKO5XDSBQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.827801491 (5h14m55.414857712s) [noise=true , address=104.36.82.5:4837 , piece_id=32VX7X2CPAQKJGKQYNDUF2U6GPAWZKEWYALRTRSFC6TPIQJBBXCQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.828365735 (5h14m55.415421976s) [noise=true , address=45.91.116.8:4048 , piece_id=XZNUB5SDPWSYVGHGMFFQZ4BZMBP2GMKF76GXWQ2MXAGT42I6I4FQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.828913136 (5h14m55.415969378s) [noise=true , address=104.36.82.2:4732 , piece_id=2HK2G5XCNE6UN3COUOG6V4IVCLTRVEMNNCQMV5SZLXRFTO2FJUYQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.934607129 (5h14m55.52166334s) [upload=5396]: Next returned nil segment
Aug 7 21:41:41.934619282 (5h14m55.521675503s) [upload=5396]: Waiting for error group managing segments...
Aug 7 21:41:41.945118551 (5h14m55.532174772s) [noise=true , address=45.91.116.4:4940 , piece_id=ETERKOUZIHEOKPCAJPSUBGXFMDLKEELCVMIW34LR7G66FBFMUNTA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.945901252 (5h14m55.532957473s) [noise=true , address=45.91.116.8:4048 , piece_id=XZNUB5SDPWSYVGHGMFFQZ4BZMBP2GMKF76GXWQ2MXAGT42I6I4FQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.946161258 (5h14m55.533217498s) [noise=true , address=45.91.116.5:4298 , piece_id=C3BQRSMSRSM4FJ7SWEBPHH7UKNUJWCDD5AEEBEAYN6OMCM2VRSWA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.946386648 (5h14m55.533442869s) [noise=true , address=77.90.31.12:4592 , piece_id=75OFHQZRJKZYL3QJ37T6QLDED663WXIEFAHTH2BQZLZ46PY5YPLQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.949024992 (5h14m55.536081243s) [noise=true , address=45.91.116.5:4299 , piece_id=XY3RW62XNQVLM6NTAZTBF26HWTY5KR3ZEJGVYTSTENY2B77YLBMA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.949218724 (5h14m55.536274945s) [noise=true , address=45.91.116.4:4937 , piece_id=BYNKX2DGOGITTOYV7IH73WDLAPXHXWG5V5WFIJDTM5RUJQYP6MLQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.949657033 (5h14m55.536713244s) [noise=true , address=77.90.31.13:4627 , piece_id=7MG24AD6AUVL6X66RZJ43OSAM7FLBB33KQY4ENE4Q3NR6PA63YQQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.949683371 (5h14m55.536739612s) [noise=true , address=104.36.82.2:4732 , piece_id=2HK2G5XCNE6UN3COUOG6V4IVCLTRVEMNNCQMV5SZLXRFTO2FJUYQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.950070354 (5h14m55.537126575s) [noise=true , address=104.36.82.11:4114 , piece_id=KB2SDFXXBJDEYUHUNIO3YSANNDXVREF46SGOSWQ3YBHRR42TFD4A, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.953623165 (5h14m55.540679407s) [noise=true , address=104.36.82.6:4875 , piece_id=B263E3OQZQDAAYHN3YIPJ4RBLTNOFNOXAZWYTVEGGVRM2YES3PBQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.957708261 (5h14m55.544764482s) [noise=true , address=104.36.82.5:4837 , piece_id=32VX7X2CPAQKJGKQYNDUF2U6GPAWZKEWYALRTRSFC6TPIQJBBXCQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.964243811 (5h14m55.551300021s) [noise=true , address=77.90.31.10:4519 , piece_id=OQZPQPV2NUVKLMSHONEMH2HUK52KXL2E6NXXSO2J6CP7IDTRVT7Q, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.964842018 (5h14m55.551898239s) [noise=true , address=77.90.31.14:4661 , piece_id=U3YYDMWVGG4NEV5OSK4ATJ2RNTEYCIXKH3KXY7UR3RGJXEUA25IA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.964860783 (5h14m55.551917004s) [seg_pos={0 0}, upload=5396]: Segment reached optimal threshold of 13 pieces.
Aug 7 21:41:41.964962292 (5h14m55.552018503s) [noise=true , address=77.90.31.17:4771 , piece_id=IYUYS3YHOD44ZF2OGKQX7JCFVW2GBU5S2TVC3FZ2M3JNF67TP4CQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2): protocol: expected piece hash; context canceled; EOF
Aug 7 21:41:41.965019739 (5h14m55.55207595s) [noise=true , address=104.36.82.10:4077 , piece_id=LZBNWOC4E35SX6FKBLATK2QFZDUWA7CBA5RY422YHVMMKO5XDSBQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF
Aug 7 21:41:41.965087696 (5h14m55.552143947s) [noise=true , address=104.36.82.7:4911 , piece_id=GLWOEWKACQVRHXQ6EY45IYR5N7VCP75FUZIYT5WRQG2VXULRUIUA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Aug 7 21:41:41.965118783 (5h14m55.552175005s) [seg_pos={0 0}, upload=5396]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug 7 21:41:41.965239138 (5h14m55.552295349s) [upload=5396]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 21:41:41.965243687 (5h14m55.552299898s) [upload=5396]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 21:41:46.509965896 (5h15m0.097022118s) [upload=5396]: Done uploading segments...
Aug 7 21:41:46.510002955 (5h15m0.097059167s) [upload=5396]: Upload finished. err: <nil>
Aug 7 21:42:01.196715658 (5h15m14.783771899s) [upload=5401]: Starting upload
Aug 7 21:42:01.196842946 (5h15m14.783899187s) [upload=5401]: Done starting upload
Aug 7 21:42:01.196915852 (5h15m14.783972103s) [upload=5401]: Uploading segments...
Aug 7 21:42:01.197283067 (5h15m14.784339309s) [upload=5401]: Got next segment. Inline: false
Aug 7 21:42:01.197355652 (5h15m14.784411984s) [upload=5401]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 21:42:01.197365230 (5h15m14.784421472s) [upload=5401]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 21:42:31.170606605 (5h15m44.757662826s) [upload=5401]: Next segment err: context deadline exceeded
Aug 7 21:42:31.170727651 (5h15m44.757783872s) [upload=5401]: Done uploading segments...
Aug 7 21:42:31.170749551 (5h15m44.757805773s) [upload=5401]: Upload finished. err: context deadline exceeded
Duration: 362.058604ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
3 out of 60 is failed (threshold=3) [........................................X...X...X...........] duration:
120.99797ms remote:
"tcp:136.0.77.2:443" target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
FAIL (2025-08-07 21:47:06 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": context deadline exceeded
Duration: 121.014362ms
edge
gateway
vhost
bgp
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
28 out of 60 is failed (threshold=3) [........................XX.XXXXXXXXXXXXXXXXXXXXXXXXXX.......] duration:
1.929242617s
FAIL (2025-08-07 21:47:05 UTC)
operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.929259016s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
37 out of 60 is failed (threshold=3) [...............XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XX.......] duration:
607.728793ms
FAIL (2025-08-07 21:47:02 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 607.744202ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
35 out of 60 is failed (threshold=3) [..................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX..X.....] duration:
539.435623ms
FAIL (2025-08-07 21:46:54 UTC)
operation: sync2.Copy
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
7 (5h14m28.062269058s) [upload=5388]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 21:41:25.266685321 (5h14m38.853741562s) [upload=5388]: Done uploading segments...
Aug 7 21:41:25.266706391 (5h14m38.853762631s) [upload=5388]: Upload finished. err: <nil>
Aug 7 21:41:41.070176076 (5h14m54.657232316s) [upload=5396]: Starting upload
Aug 7 21:41:41.070246557 (5h14m54.657302798s) [upload=5396]: Done starting upload
Aug 7 21:41:41.070459143 (5h14m54.657515385s) [upload=5396]: Uploading segments...
Aug 7 21:41:41.070697238 (5h14m54.657753479s) [upload=5396]: Got next segment. Inline: false
Aug 7 21:41:41.070732264 (5h14m54.657788505s) [upload=5396]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 21:41:41.070737293 (5h14m54.657793524s) [upload=5396]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 21:41:41.825834701 (5h14m55.412890922s) [seg_pos={0 0}, upload=5396]: Begin upload segment...
Aug 7 21:41:41.825865027 (5h14m55.412921237s) [seg_pos={0 0}, upload=5396]: Done begin upload segment.
Aug 7 21:41:41.825886015 (5h14m55.412942237s) [noise=true , address=77.90.31.12:4592 , piece_id=75OFHQZRJKZYL3QJ37T6QLDED663WXIEFAHTH2BQZLZ46PY5YPLQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.825988818 (5h14m55.413045068s) [noise=true , address=45.91.116.5:4298 , piece_id=C3BQRSMSRSM4FJ7SWEBPHH7UKNUJWCDD5AEEBEAYN6OMCM2VRSWA, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.826203979 (5h14m55.413260201s) [noise=true , address=45.91.116.4:4937 , piece_id=BYNKX2DGOGITTOYV7IH73WDLAPXHXWG5V5WFIJDTM5RUJQYP6MLQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.826435742 (5h14m55.413491953s) [noise=true , address=77.90.31.13:4627 , piece_id=7MG24AD6AUVL6X66RZJ43OSAM7FLBB33KQY4ENE4Q3NR6PA63YQQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.826541530 (5h14m55.41359777s) [noise=true , address=45.91.116.5:4299 , piece_id=XY3RW62XNQVLM6NTAZTBF26HWTY5KR3ZEJGVYTSTENY2B77YLBMA, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.826653037 (5h14m55.413709248s) [noise=true , address=77.90.31.14:4661 , piece_id=U3YYDMWVGG4NEV5OSK4ATJ2RNTEYCIXKH3KXY7UR3RGJXEUA25IA, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.826875332 (5h14m55.413931543s) [noise=true , address=77.90.31.10:4519 , piece_id=OQZPQPV2NUVKLMSHONEMH2HUK52KXL2E6NXXSO2J6CP7IDTRVT7Q, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.826921499 (5h14m55.41397774s) [noise=true , address=104.36.82.11:4114 , piece_id=KB2SDFXXBJDEYUHUNIO3YSANNDXVREF46SGOSWQ3YBHRR42TFD4A, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.827091606 (5h14m55.414147827s) [noise=true , address=45.91.116.4:4940 , piece_id=ETERKOUZIHEOKPCAJPSUBGXFMDLKEELCVMIW34LR7G66FBFMUNTA, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.827323819 (5h14m55.41438003s) [noise=true , address=77.90.31.17:4771 , piece_id=IYUYS3YHOD44ZF2OGKQX7JCFVW2GBU5S2TVC3FZ2M3JNF67TP4CQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.827393500 (5h14m55.414449742s) [noise=true , address=104.36.82.6:4875 , piece_id=B263E3OQZQDAAYHN3YIPJ4RBLTNOFNOXAZWYTVEGGVRM2YES3PBQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.827542938 (5h14m55.414599159s) [noise=true , address=104.36.82.7:4911 , piece_id=GLWOEWKACQVRHXQ6EY45IYR5N7VCP75FUZIYT5WRQG2VXULRUIUA, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.827778078 (5h14m55.414834318s) [noise=true , address=104.36.82.10:4077 , piece_id=LZBNWOC4E35SX6FKBLATK2QFZDUWA7CBA5RY422YHVMMKO5XDSBQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.827801491 (5h14m55.414857712s) [noise=true , address=104.36.82.5:4837 , piece_id=32VX7X2CPAQKJGKQYNDUF2U6GPAWZKEWYALRTRSFC6TPIQJBBXCQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.828365735 (5h14m55.415421976s) [noise=true , address=45.91.116.8:4048 , piece_id=XZNUB5SDPWSYVGHGMFFQZ4BZMBP2GMKF76GXWQ2MXAGT42I6I4FQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.828913136 (5h14m55.415969378s) [noise=true , address=104.36.82.2:4732 , piece_id=2HK2G5XCNE6UN3COUOG6V4IVCLTRVEMNNCQMV5SZLXRFTO2FJUYQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.934607129 (5h14m55.52166334s) [upload=5396]: Next returned nil segment
Aug 7 21:41:41.934619282 (5h14m55.521675503s) [upload=5396]: Waiting for error group managing segments...
Aug 7 21:41:41.945118551 (5h14m55.532174772s) [noise=true , address=45.91.116.4:4940 , piece_id=ETERKOUZIHEOKPCAJPSUBGXFMDLKEELCVMIW34LR7G66FBFMUNTA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.945901252 (5h14m55.532957473s) [noise=true , address=45.91.116.8:4048 , piece_id=XZNUB5SDPWSYVGHGMFFQZ4BZMBP2GMKF76GXWQ2MXAGT42I6I4FQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.946161258 (5h14m55.533217498s) [noise=true , address=45.91.116.5:4298 , piece_id=C3BQRSMSRSM4FJ7SWEBPHH7UKNUJWCDD5AEEBEAYN6OMCM2VRSWA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.946386648 (5h14m55.533442869s) [noise=true , address=77.90.31.12:4592 , piece_id=75OFHQZRJKZYL3QJ37T6QLDED663WXIEFAHTH2BQZLZ46PY5YPLQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.949024992 (5h14m55.536081243s) [noise=true , address=45.91.116.5:4299 , piece_id=XY3RW62XNQVLM6NTAZTBF26HWTY5KR3ZEJGVYTSTENY2B77YLBMA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.949218724 (5h14m55.536274945s) [noise=true , address=45.91.116.4:4937 , piece_id=BYNKX2DGOGITTOYV7IH73WDLAPXHXWG5V5WFIJDTM5RUJQYP6MLQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.949657033 (5h14m55.536713244s) [noise=true , address=77.90.31.13:4627 , piece_id=7MG24AD6AUVL6X66RZJ43OSAM7FLBB33KQY4ENE4Q3NR6PA63YQQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.949683371 (5h14m55.536739612s) [noise=true , address=104.36.82.2:4732 , piece_id=2HK2G5XCNE6UN3COUOG6V4IVCLTRVEMNNCQMV5SZLXRFTO2FJUYQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.950070354 (5h14m55.537126575s) [noise=true , address=104.36.82.11:4114 , piece_id=KB2SDFXXBJDEYUHUNIO3YSANNDXVREF46SGOSWQ3YBHRR42TFD4A, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.953623165 (5h14m55.540679407s) [noise=true , address=104.36.82.6:4875 , piece_id=B263E3OQZQDAAYHN3YIPJ4RBLTNOFNOXAZWYTVEGGVRM2YES3PBQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.957708261 (5h14m55.544764482s) [noise=true , address=104.36.82.5:4837 , piece_id=32VX7X2CPAQKJGKQYNDUF2U6GPAWZKEWYALRTRSFC6TPIQJBBXCQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.964243811 (5h14m55.551300021s) [noise=true , address=77.90.31.10:4519 , piece_id=OQZPQPV2NUVKLMSHONEMH2HUK52KXL2E6NXXSO2J6CP7IDTRVT7Q, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.964842018 (5h14m55.551898239s) [noise=true , address=77.90.31.14:4661 , piece_id=U3YYDMWVGG4NEV5OSK4ATJ2RNTEYCIXKH3KXY7UR3RGJXEUA25IA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.964860783 (5h14m55.551917004s) [seg_pos={0 0}, upload=5396]: Segment reached optimal threshold of 13 pieces.
Aug 7 21:41:41.964962292 (5h14m55.552018503s) [noise=true , address=77.90.31.17:4771 , piece_id=IYUYS3YHOD44ZF2OGKQX7JCFVW2GBU5S2TVC3FZ2M3JNF67TP4CQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2): protocol: expected piece hash; context canceled; EOF
Aug 7 21:41:41.965019739 (5h14m55.55207595s) [noise=true , address=104.36.82.10:4077 , piece_id=LZBNWOC4E35SX6FKBLATK2QFZDUWA7CBA5RY422YHVMMKO5XDSBQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF
Aug 7 21:41:41.965087696 (5h14m55.552143947s) [noise=true , address=104.36.82.7:4911 , piece_id=GLWOEWKACQVRHXQ6EY45IYR5N7VCP75FUZIYT5WRQG2VXULRUIUA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Aug 7 21:41:41.965118783 (5h14m55.552175005s) [seg_pos={0 0}, upload=5396]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug 7 21:41:41.965239138 (5h14m55.552295349s) [upload=5396]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 21:41:41.965243687 (5h14m55.552299898s) [upload=5396]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 21:41:46.509965896 (5h15m0.097022118s) [upload=5396]: Done uploading segments...
Aug 7 21:41:46.510002955 (5h15m0.097059167s) [upload=5396]: Upload finished. err: <nil>
Aug 7 21:42:01.196715658 (5h15m14.783771899s) [upload=5401]: Starting upload
Aug 7 21:42:01.196842946 (5h15m14.783899187s) [upload=5401]: Done starting upload
Aug 7 21:42:01.196915852 (5h15m14.783972103s) [upload=5401]: Uploading segments...
Aug 7 21:42:01.197283067 (5h15m14.784339309s) [upload=5401]: Got next segment. Inline: false
Aug 7 21:42:01.197355652 (5h15m14.784411984s) [upload=5401]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 21:42:01.197365230 (5h15m14.784421472s) [upload=5401]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 21:42:31.170606605 (5h15m44.757662826s) [upload=5401]: Next segment err: context deadline exceeded
Aug 7 21:42:31.170727651 (5h15m44.757783872s) [upload=5401]: Done uploading segments...
Aug 7 21:42:31.170749551 (5h15m44.757805773s) [upload=5401]: Upload finished. err: context deadline exceeded
Duration: 539.483434ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
38 out of 60 is failed (threshold=3) [................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX...X...] duration:
248.97117ms
FAIL (2025-08-07 21:46:52 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 248.99296ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
31 out of 60 is failed (threshold=3) [.......................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX......] duration:
1.719781802s
FAIL (2025-08-07 21:46:51 UTC)
operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 1.719805587s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
41 out of 60 is failed (threshold=3) [.............XX..XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.X...] duration:
196.205236ms
FAIL (2025-08-07 21:46:43 UTC)
operation: Commit uplink: metaclient: context deadline exceeded
Duration: 196.231836ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
19 out of 60 is failed (threshold=3) [..................................XXXXXXXXXXXXXXXXX.XX......] duration:
1.024758379s
FAIL (2025-08-07 21:46:32 UTC)
operation: sync2.Copy
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
address=104.36.82.12:4172 , piece_id=2SN23SJESN46DLA25WJULJLVGE7QWLQW2QJFAUA3WUVICJ5CKLUA, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.023027314 (5h13m59.610083535s) [noise=true , address=104.36.82.54:4183 , piece_id=ZOCQQFJKFATMPRR2PKHLTSWN2D3QXAMZ74K2A5KTKYQAHEGA2BUA, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.023255801 (5h13m59.610312012s) [noise=true , address=104.36.82.37:4663 , piece_id=XOIJUGNOKJJVWQ4226IL67H73DVYH7VBSIKI4BQSMOIGYNY7MO7A, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.023462957 (5h13m59.610519169s) [noise=true , address=104.36.82.60:4367 , piece_id=IRTAFXB5WIGLKZE4HQE7UW7J5OSZSIQK7TGY447RFZD7FCIAYQVQ, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.023666096 (5h13m59.610722308s) [noise=true , address=64.49.13.140:4511 , piece_id=A7AQ3VPKYONSOWW2YUPGWAXTMA4JPGBG4CQVYCK6PFFIFFUGPMHA, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.023880075 (5h13m59.610936287s) [noise=true , address=104.36.82.23:4474 , piece_id=TDLXCBP5IPHILGHJYQD4DXYRMLL2VS2ER3ECEBAXOBTUAMR67BBA, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.024106408 (5h13m59.611162629s) [noise=true , address=104.36.82.58:4269 , piece_id=4I2ROAYRNHMC53OKVWWXCS4FULL2XZ6CG5WZUPOLQ4UNELQDHHOA, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.024332290 (5h13m59.611388511s) [noise=true , address=104.36.82.16:4305 , piece_id=K5YI7X35EAPFSOANSPQERKCHUOO6GDZZWKAOFNYGM6R3PA6K2LWA, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.024539145 (5h13m59.611595357s) [noise=true , address=104.36.82.36:4623 , piece_id=ONIDD2KMXGVLKCD5YFBVUMMF2ORGVLFDV4LG3TRKRSINURIDAAFA, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.024749439 (5h13m59.61180566s) [noise=true , address=104.36.82.43:4850 , piece_id=XWPXP7HKO2ZH22MMIODDLHM3LPIIPQP3Y3FLZ54XMMWOIN7JIADA, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.024973778 (5h13m59.612029999s) [noise=true , address=45.91.116.9:4266 , piece_id=VOPNPD4GIHS2VOYBWCCTR7LX3YKL4BCZLW4XMROMAWU4WYUJ52WA, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.025220337 (5h13m59.612276558s) [noise=true , address=104.36.82.15:4275 , piece_id=HCH5IC5PTQ7NCSWPJJC5OOEPEIMA34ZL6E5QPQPCDB2P2FEO6JYA, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.105422677 (5h13m59.692478898s) [upload=5382]: Next returned nil segment
Aug 7 21:40:46.105438417 (5h13m59.692494638s) [upload=5382]: Waiting for error group managing segments...
Aug 7 21:40:46.115255601 (5h13m59.702311812s) [noise=true , address=45.91.116.9:4266 , piece_id=VOPNPD4GIHS2VOYBWCCTR7LX3YKL4BCZLW4XMROMAWU4WYUJ52WA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.123052245 (5h13m59.710108455s) [noise=true , address=104.36.82.16:4305 , piece_id=K5YI7X35EAPFSOANSPQERKCHUOO6GDZZWKAOFNYGM6R3PA6K2LWA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.123065018 (5h13m59.710121239s) [noise=true , address=104.36.82.37:4663 , piece_id=XOIJUGNOKJJVWQ4226IL67H73DVYH7VBSIKI4BQSMOIGYNY7MO7A, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.135955971 (5h13m59.723012192s) [noise=true , address=104.36.82.58:4269 , piece_id=4I2ROAYRNHMC53OKVWWXCS4FULL2XZ6CG5WZUPOLQ4UNELQDHHOA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.139757077 (5h13m59.726813288s) [noise=true , address=104.36.82.44:4891 , piece_id=D33W4EHVQ26LIOJ2KG5RKUHRZSGXAIGS2PQSIURYKGMP63RBTBGA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.148928486 (5h13m59.735984697s) [noise=true , address=104.36.82.15:4275 , piece_id=HCH5IC5PTQ7NCSWPJJC5OOEPEIMA34ZL6E5QPQPCDB2P2FEO6JYA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.149227595 (5h13m59.736283816s) [noise=true , address=104.36.82.36:4623 , piece_id=ONIDD2KMXGVLKCD5YFBVUMMF2ORGVLFDV4LG3TRKRSINURIDAAFA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.157435446 (5h13m59.744491657s) [noise=true , address=104.36.82.54:4183 , piece_id=ZOCQQFJKFATMPRR2PKHLTSWN2D3QXAMZ74K2A5KTKYQAHEGA2BUA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.193659694 (5h13m59.780715905s) [noise=true , address=104.36.82.60:4367 , piece_id=IRTAFXB5WIGLKZE4HQE7UW7J5OSZSIQK7TGY447RFZD7FCIAYQVQ, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.198544171 (5h13m59.785600382s) [noise=true , address=104.36.82.12:4172 , piece_id=2SN23SJESN46DLA25WJULJLVGE7QWLQW2QJFAUA3WUVICJ5CKLUA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.200016058 (5h13m59.787072279s) [noise=true , address=104.36.82.14:4228 , piece_id=USWUBYJMTZKFFN3DZIKQQD7PW6QAKBRUHJZRCBO4DXTHR2PQDHRQ, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.224817695 (5h13m59.811873916s) [noise=true , address=104.36.82.43:4850 , piece_id=XWPXP7HKO2ZH22MMIODDLHM3LPIIPQP3Y3FLZ54XMMWOIN7JIADA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.225279788 (5h13m59.812336009s) [noise=true , address=104.36.82.61:4383 , piece_id=ELAHQPPPJCCLCQYXDEOS62V6TOMV5NOCMUU5XZFCQ23Y6SQUWG6Q, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.305784060 (5h13m59.892840282s) [noise=true , address=104.36.82.43:4863 , piece_id=PWAZUY75NQILRAVGRSMJSFKPOPLR3WQ5O3Q47GZ5U37KXPXJ3ORQ, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.305806102 (5h13m59.892862323s) [seg_pos={0 0}, upload=5382]: Segment reached optimal threshold of 14 pieces.
Aug 7 21:40:46.305952956 (5h13m59.893009177s) [noise=true , address=104.36.82.56:4261 , piece_id=Z27LNZSXSYSUMQXEW2DI3C54ZJK26ALV653EINMYNU6COTMAMPBA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YNKaVEsXzHe6XGQuv6wR1qqbv6dbzg1xT5Aqkew2ZV3z3tMMf): protocol: expected piece hash; context canceled; EOF
Aug 7 21:40:46.306110209 (5h13m59.89316642s) [noise=true , address=64.49.13.139:4471 , piece_id=2OSYONIOJUEZXMYFSTL7NRN7HG6KXJOHFUL7TIDW73C4VKYF3W3A, seg_pos={0 0}, upload=5382]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:26750->64.49.13.139:4471: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 21:40:46.306163639 (5h13m59.89321985s) [noise=true , address=104.36.82.23:4474 , piece_id=TDLXCBP5IPHILGHJYQD4DXYRMLL2VS2ER3ECEBAXOBTUAMR67BBA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: write tcp 5.161.89.252:22402->104.36.82.23:4474: use of closed network connection; write tcp 5.161.89.252:22402->104.36.82.23:4474: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:22402->104.36.82.23:4474: use of closed network connection
Aug 7 21:40:46.306206098 (5h13m59.893262319s) [noise=true , address=64.49.13.140:4511 , piece_id=A7AQ3VPKYONSOWW2YUPGWAXTMA4JPGBG4CQVYCK6PFFIFFUGPMHA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: read tcp 5.161.89.252:31920->64.49.13.140:4511: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 21:40:46.306226506 (5h13m59.893282717s) [seg_pos={0 0}, upload=5382]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 21:40:46.306282762 (5h13m59.893338983s) [upload=5382]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 21:40:46.306286799 (5h13m59.89334301s) [upload=5382]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 21:40:57.774588980 (5h14m11.361645201s) [upload=5382]: Done uploading segments...
Aug 7 21:40:57.774603057 (5h14m11.361659278s) [upload=5382]: Upload finished. err: <nil>
Aug 7 21:41:10.210507562 (5h14m23.797563803s) [upload=5386]: Starting upload
Aug 7 21:41:10.210589415 (5h14m23.797645655s) [upload=5386]: Done starting upload
Aug 7 21:41:10.210669645 (5h14m23.797725856s) [upload=5386]: Uploading segments...
Aug 7 21:41:10.210963293 (5h14m23.798019534s) [upload=5386]: Got next segment. Inline: false
Aug 7 21:41:10.211025149 (5h14m23.79808139s) [upload=5386]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 21:41:10.211035066 (5h14m23.798091308s) [upload=5386]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 21:42:10.197934627 (5h15m23.784990848s) [upload=5386]: Next segment err: context deadline exceeded
Aug 7 21:42:10.198070280 (5h15m23.785126501s) [upload=5386]: Done uploading segments...
Aug 7 21:42:10.198139409 (5h15m23.78519562s) [upload=5386]: Upload finished. err: context deadline exceeded
Aug 7 21:42:14.127516635 (5h15m27.714572846s) [upload=5403]: Starting upload
Aug 7 21:42:14.127582357 (5h15m27.714638569s) [upload=5403]: Done starting upload
Aug 7 21:42:14.127692983 (5h15m27.714749204s) [upload=5403]: Uploading segments...
Aug 7 21:42:14.127793461 (5h15m27.714849672s) [upload=5403]: Got next segment. Inline: false
Aug 7 21:42:14.127840750 (5h15m27.714896961s) [upload=5403]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 21:42:14.127846281 (5h15m27.714902491s) [upload=5403]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 21:43:14.115648400 (5h16m27.702704611s) [upload=5403]: Next segment err: context deadline exceeded
Aug 7 21:43:14.115816064 (5h16m27.702872275s) [upload=5403]: Done uploading segments...
Aug 7 21:43:14.115831182 (5h16m27.702887403s) [upload=5403]: Upload finished. err: context deadline exceeded
Duration: 1.024782895s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
43 out of 60 is failed (threshold=3) [................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXXX] duration:
30.001560537s
FAIL (2025-08-07 21:46:28 UTC)
operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== hed. err: metaclient: context deadline exceeded Aug 7 21:37:56.437147115 (5h11m10.024203357s) [upload=5336]: Starting upload Aug 7 21:37:56.437251630 (5h11m10.024307872s) [upload=5336]: Done starting upload Aug 7 21:37:56.437342400 (5h11m10.024398641s) [upload=5336]: Uploading segments... Aug 7 21:37:56.437415256 (5h11m10.024471508s) [upload=5336]: Got next segment. Inline: true Aug 7 21:37:56.437425486 (5h11m10.024481767s) [upload=5336]: Waiting for error group managing segments... Aug 7 21:37:56.437531414 (5h11m10.024587665s) [upload=5336]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:37:56.437544558 (5h11m10.02460085s) [upload=5336]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:37:56.437551260 (5h11m10.024607511s) [upload=5336]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:38:26.422314839 (5h11m40.009371081s) [upload=5336]: Done uploading segments... Aug 7 21:38:26.422335869 (5h11m40.00939211s) [upload=5336]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:38:26.513648977 (5h11m40.100705218s) [upload=5344]: Starting upload Aug 7 21:38:26.513731310 (5h11m40.100787552s) [upload=5344]: Done starting upload Aug 7 21:38:26.513792245 (5h11m40.100848496s) [upload=5344]: Uploading segments... Aug 7 21:38:26.513834112 (5h11m40.100890354s) [upload=5344]: Got next segment. Inline: true Aug 7 21:38:26.513839653 (5h11m40.100895904s) [upload=5344]: Waiting for error group managing segments... Aug 7 21:38:26.513884006 (5h11m40.100940247s) [upload=5344]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:38:26.513889947 (5h11m40.100946188s) [upload=5344]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:38:26.513893434 (5h11m40.100949675s) [upload=5344]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:38:56.502052245 (5h12m10.089108537s) [upload=5344]: Done uploading segments... Aug 7 21:38:56.502102730 (5h12m10.089158972s) [upload=5344]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:39:24.008006172 (5h12m37.595062394s) [upload=5359]: Starting upload Aug 7 21:39:24.008059211 (5h12m37.595115422s) [upload=5359]: Done starting upload Aug 7 21:39:24.008103604 (5h12m37.595159835s) [upload=5359]: Uploading segments... Aug 7 21:39:24.008156191 (5h12m37.595212413s) [upload=5359]: Got next segment. Inline: true Aug 7 21:39:24.008162193 (5h12m37.595218414s) [upload=5359]: Waiting for error group managing segments... Aug 7 21:39:24.008207327 (5h12m37.595263548s) [upload=5359]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:39:24.008212668 (5h12m37.595268878s) [upload=5359]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:39:24.008216064 (5h12m37.595272285s) [upload=5359]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:39:53.997226503 (5h13m7.584282744s) [upload=5359]: Done uploading segments... Aug 7 21:39:53.997270334 (5h13m7.584326586s) [upload=5359]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:40:36.779619947 (5h13m50.366676188s) [upload=5383]: Starting upload Aug 7 21:40:36.779696139 (5h13m50.36675238s) [upload=5383]: Done starting upload Aug 7 21:40:36.779752775 (5h13m50.366809016s) [upload=5383]: Uploading segments... Aug 7 21:40:36.779788803 (5h13m50.366845044s) [upload=5383]: Got next segment. Inline: true Aug 7 21:40:36.779794423 (5h13m50.366850655s) [upload=5383]: Waiting for error group managing segments... Aug 7 21:40:36.779835950 (5h13m50.366892191s) [upload=5383]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:40:36.779841010 (5h13m50.366897241s) [upload=5383]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:40:36.779844195 (5h13m50.366900437s) [upload=5383]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:41:06.765292852 (5h14m20.352349064s) [upload=5383]: Done uploading segments... Aug 7 21:41:06.765314052 (5h14m20.352370273s) [upload=5383]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:41:47.961322510 (5h15m1.548378802s) [upload=5399]: Starting upload Aug 7 21:41:47.961442915 (5h15m1.548499166s) [upload=5399]: Done starting upload Aug 7 21:41:47.961510201 (5h15m1.548566443s) [upload=5399]: Uploading segments... Aug 7 21:41:47.961591062 (5h15m1.548647313s) [upload=5399]: Got next segment. Inline: true Aug 7 21:41:47.961599218 (5h15m1.548655458s) [upload=5399]: Waiting for error group managing segments... Aug 7 21:41:47.961647759 (5h15m1.548703999s) [upload=5399]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:41:47.961653760 (5h15m1.548710001s) [upload=5399]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:41:47.961657546 (5h15m1.548713787s) [upload=5399]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:42:17.948677724 (5h15m31.535733945s) [upload=5399]: Done uploading segments... Aug 7 21:42:17.948691099 (5h15m31.53574731s) [upload=5399]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:42:18.081006705 (5h15m31.668062915s) [upload=5405]: Starting upload Aug 7 21:42:18.081065655 (5h15m31.668121866s) [upload=5405]: Done starting upload Aug 7 21:42:18.081113425 (5h15m31.668169635s) [upload=5405]: Uploading segments... Aug 7 21:42:18.081164870 (5h15m31.668221091s) [upload=5405]: Got next segment. Inline: true Aug 7 21:42:18.081169459 (5h15m31.66822568s) [upload=5405]: Waiting for error group managing segments... Aug 7 21:42:18.081201809 (5h15m31.66825803s) [upload=5405]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:42:18.081205546 (5h15m31.668261757s) [upload=5405]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:42:18.081208271 (5h15m31.668264483s) [upload=5405]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:42:18.161269758 (5h15m31.748325999s) [upload=5405]: Done uploading segments... Aug 7 21:42:18.161287411 (5h15m31.748343652s) [upload=5405]: Upload finished. err: <nil> Aug 7 21:43:12.878567983 (5h16m26.465624204s) [upload=5420]: Starting upload Aug 7 21:43:12.878678820 (5h16m26.465735041s) [upload=5420]: Done starting upload Aug 7 21:43:12.878731839 (5h16m26.46578806s) [upload=5420]: Uploading segments... Aug 7 21:43:12.878762908 (5h16m26.465819129s) [upload=5420]: Got next segment. Inline: true Aug 7 21:43:12.878766635 (5h16m26.465822856s) [upload=5420]: Waiting for error group managing segments... Aug 7 21:43:12.878799204 (5h16m26.465855425s) [upload=5420]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:43:12.878803332 (5h16m26.465859543s) [upload=5420]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:43:12.878805566 (5h16m26.465861787s) [upload=5420]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:43:42.863779226 (5h16m56.450835478s) [upload=5420]: Done uploading segments... Aug 7 21:43:42.863802450 (5h16m56.450858691s) [upload=5420]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:43:51.464096058 (5h17m5.051152299s) [upload=5431]: Starting upload Aug 7 21:43:51.464210432 (5h17m5.051266673s) [upload=5431]: Done starting upload Aug 7 21:43:51.464274041 (5h17m5.051330282s) [upload=5431]: Uploading segments... Aug 7 21:43:51.464330065 (5h17m5.051386366s) [upload=5431]: Got next segment. Inline: true Aug 7 21:43:51.464343630 (5h17m5.051399912s) [upload=5431]: Waiting for error group managing segments... Aug 7 21:43:51.464415315 (5h17m5.051471556s) [upload=5431]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:43:51.464424673 (5h17m5.051480923s) [upload=5431]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:43:51.464431204 (5h17m5.051487455s) [upload=5431]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:44:21.448488824 (5h17m35.035545036s) [upload=5431]: Done uploading segments... Aug 7 21:44:21.448528209 (5h17m35.03558443s) [upload=5431]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:44:50.396194570 (5h18m3.983250782s) [upload=5444]: Starting upload Aug 7 21:44:50.396243653 (5h18m3.983299864s) [upload=5444]: Done starting upload Aug 7 21:44:50.396286463 (5h18m3.983342684s) [upload=5444]: Uploading segments... Aug 7 21:44:50.396309054 (5h18m3.983365266s) [upload=5444]: Got next segment. Inline: true Aug 7 21:44:50.396312381 (5h18m3.983368592s) [upload=5444]: Waiting for error group managing segments... Aug 7 21:44:50.396342687 (5h18m3.983398908s) [upload=5444]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:44:50.396346635 (5h18m3.983402856s) [upload=5444]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:44:50.396348889 (5h18m3.98340511s) [upload=5444]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:45:20.384461417 (5h18m33.971517668s) [upload=5444]: Done uploading segments... Aug 7 21:45:20.384482547 (5h18m33.971538788s) [upload=5444]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:45:58.414522311 (5h19m12.001578522s) [upload=5465]: Starting upload Aug 7 21:45:58.414582292 (5h19m12.001638504s) [upload=5465]: Done starting upload Aug 7 21:45:58.414634661 (5h19m12.001690882s) [upload=5465]: Uploading segments... Aug 7 21:45:58.414662251 (5h19m12.001718462s) [upload=5465]: Got next segment. Inline: true Aug 7 21:45:58.414665918 (5h19m12.00172213s) [upload=5465]: Waiting for error group managing segments... Aug 7 21:45:58.414697247 (5h19m12.001753468s) [upload=5465]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:45:58.414700753 (5h19m12.001756975s) [upload=5465]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:45:58.414703007 (5h19m12.001759229s) [upload=5465]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:46:28.397843251 (5h19m41.984899492s) [upload=5465]: Done uploading segments... Aug 7 21:46:28.397885870 (5h19m41.984942112s) [upload=5465]: Upload finished. err: metaclient: context deadline exceeded
Duration: 30.001578529s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
4 out of 60 is failed (threshold=3) [..........................X........XX...X...................] duration:
30.606482ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-07 21:46:19 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 30.630585ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
3 out of 60 is failed (threshold=3) [.........................................X...X...X..........] duration:
117.671821ms remote:
"tcp:136.0.77.2:443" target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
FAIL (2025-08-07 21:46:16 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": context deadline exceeded
Duration: 117.695203ms
edge
gateway
vhost
bgp
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
37 out of 60 is failed (threshold=3) [................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XX......] duration:
444.630486ms
FAIL (2025-08-07 21:46:07 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 444.646847ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
19 out of 60 is failed (threshold=3) [...................................XXXXXXXXXXXXXXXXX.XX.....] duration:
991.080693ms
FAIL (2025-08-07 21:46:02 UTC)
operation: sync2.Copy
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
address=104.36.82.12:4172 , piece_id=2SN23SJESN46DLA25WJULJLVGE7QWLQW2QJFAUA3WUVICJ5CKLUA, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.023027314 (5h13m59.610083535s) [noise=true , address=104.36.82.54:4183 , piece_id=ZOCQQFJKFATMPRR2PKHLTSWN2D3QXAMZ74K2A5KTKYQAHEGA2BUA, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.023255801 (5h13m59.610312012s) [noise=true , address=104.36.82.37:4663 , piece_id=XOIJUGNOKJJVWQ4226IL67H73DVYH7VBSIKI4BQSMOIGYNY7MO7A, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.023462957 (5h13m59.610519169s) [noise=true , address=104.36.82.60:4367 , piece_id=IRTAFXB5WIGLKZE4HQE7UW7J5OSZSIQK7TGY447RFZD7FCIAYQVQ, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.023666096 (5h13m59.610722308s) [noise=true , address=64.49.13.140:4511 , piece_id=A7AQ3VPKYONSOWW2YUPGWAXTMA4JPGBG4CQVYCK6PFFIFFUGPMHA, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.023880075 (5h13m59.610936287s) [noise=true , address=104.36.82.23:4474 , piece_id=TDLXCBP5IPHILGHJYQD4DXYRMLL2VS2ER3ECEBAXOBTUAMR67BBA, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.024106408 (5h13m59.611162629s) [noise=true , address=104.36.82.58:4269 , piece_id=4I2ROAYRNHMC53OKVWWXCS4FULL2XZ6CG5WZUPOLQ4UNELQDHHOA, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.024332290 (5h13m59.611388511s) [noise=true , address=104.36.82.16:4305 , piece_id=K5YI7X35EAPFSOANSPQERKCHUOO6GDZZWKAOFNYGM6R3PA6K2LWA, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.024539145 (5h13m59.611595357s) [noise=true , address=104.36.82.36:4623 , piece_id=ONIDD2KMXGVLKCD5YFBVUMMF2ORGVLFDV4LG3TRKRSINURIDAAFA, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.024749439 (5h13m59.61180566s) [noise=true , address=104.36.82.43:4850 , piece_id=XWPXP7HKO2ZH22MMIODDLHM3LPIIPQP3Y3FLZ54XMMWOIN7JIADA, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.024973778 (5h13m59.612029999s) [noise=true , address=45.91.116.9:4266 , piece_id=VOPNPD4GIHS2VOYBWCCTR7LX3YKL4BCZLW4XMROMAWU4WYUJ52WA, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.025220337 (5h13m59.612276558s) [noise=true , address=104.36.82.15:4275 , piece_id=HCH5IC5PTQ7NCSWPJJC5OOEPEIMA34ZL6E5QPQPCDB2P2FEO6JYA, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.105422677 (5h13m59.692478898s) [upload=5382]: Next returned nil segment
Aug 7 21:40:46.105438417 (5h13m59.692494638s) [upload=5382]: Waiting for error group managing segments...
Aug 7 21:40:46.115255601 (5h13m59.702311812s) [noise=true , address=45.91.116.9:4266 , piece_id=VOPNPD4GIHS2VOYBWCCTR7LX3YKL4BCZLW4XMROMAWU4WYUJ52WA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.123052245 (5h13m59.710108455s) [noise=true , address=104.36.82.16:4305 , piece_id=K5YI7X35EAPFSOANSPQERKCHUOO6GDZZWKAOFNYGM6R3PA6K2LWA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.123065018 (5h13m59.710121239s) [noise=true , address=104.36.82.37:4663 , piece_id=XOIJUGNOKJJVWQ4226IL67H73DVYH7VBSIKI4BQSMOIGYNY7MO7A, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.135955971 (5h13m59.723012192s) [noise=true , address=104.36.82.58:4269 , piece_id=4I2ROAYRNHMC53OKVWWXCS4FULL2XZ6CG5WZUPOLQ4UNELQDHHOA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.139757077 (5h13m59.726813288s) [noise=true , address=104.36.82.44:4891 , piece_id=D33W4EHVQ26LIOJ2KG5RKUHRZSGXAIGS2PQSIURYKGMP63RBTBGA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.148928486 (5h13m59.735984697s) [noise=true , address=104.36.82.15:4275 , piece_id=HCH5IC5PTQ7NCSWPJJC5OOEPEIMA34ZL6E5QPQPCDB2P2FEO6JYA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.149227595 (5h13m59.736283816s) [noise=true , address=104.36.82.36:4623 , piece_id=ONIDD2KMXGVLKCD5YFBVUMMF2ORGVLFDV4LG3TRKRSINURIDAAFA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.157435446 (5h13m59.744491657s) [noise=true , address=104.36.82.54:4183 , piece_id=ZOCQQFJKFATMPRR2PKHLTSWN2D3QXAMZ74K2A5KTKYQAHEGA2BUA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.193659694 (5h13m59.780715905s) [noise=true , address=104.36.82.60:4367 , piece_id=IRTAFXB5WIGLKZE4HQE7UW7J5OSZSIQK7TGY447RFZD7FCIAYQVQ, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.198544171 (5h13m59.785600382s) [noise=true , address=104.36.82.12:4172 , piece_id=2SN23SJESN46DLA25WJULJLVGE7QWLQW2QJFAUA3WUVICJ5CKLUA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.200016058 (5h13m59.787072279s) [noise=true , address=104.36.82.14:4228 , piece_id=USWUBYJMTZKFFN3DZIKQQD7PW6QAKBRUHJZRCBO4DXTHR2PQDHRQ, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.224817695 (5h13m59.811873916s) [noise=true , address=104.36.82.43:4850 , piece_id=XWPXP7HKO2ZH22MMIODDLHM3LPIIPQP3Y3FLZ54XMMWOIN7JIADA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.225279788 (5h13m59.812336009s) [noise=true , address=104.36.82.61:4383 , piece_id=ELAHQPPPJCCLCQYXDEOS62V6TOMV5NOCMUU5XZFCQ23Y6SQUWG6Q, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.305784060 (5h13m59.892840282s) [noise=true , address=104.36.82.43:4863 , piece_id=PWAZUY75NQILRAVGRSMJSFKPOPLR3WQ5O3Q47GZ5U37KXPXJ3ORQ, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.305806102 (5h13m59.892862323s) [seg_pos={0 0}, upload=5382]: Segment reached optimal threshold of 14 pieces.
Aug 7 21:40:46.305952956 (5h13m59.893009177s) [noise=true , address=104.36.82.56:4261 , piece_id=Z27LNZSXSYSUMQXEW2DI3C54ZJK26ALV653EINMYNU6COTMAMPBA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YNKaVEsXzHe6XGQuv6wR1qqbv6dbzg1xT5Aqkew2ZV3z3tMMf): protocol: expected piece hash; context canceled; EOF
Aug 7 21:40:46.306110209 (5h13m59.89316642s) [noise=true , address=64.49.13.139:4471 , piece_id=2OSYONIOJUEZXMYFSTL7NRN7HG6KXJOHFUL7TIDW73C4VKYF3W3A, seg_pos={0 0}, upload=5382]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:26750->64.49.13.139:4471: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 21:40:46.306163639 (5h13m59.89321985s) [noise=true , address=104.36.82.23:4474 , piece_id=TDLXCBP5IPHILGHJYQD4DXYRMLL2VS2ER3ECEBAXOBTUAMR67BBA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: write tcp 5.161.89.252:22402->104.36.82.23:4474: use of closed network connection; write tcp 5.161.89.252:22402->104.36.82.23:4474: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:22402->104.36.82.23:4474: use of closed network connection
Aug 7 21:40:46.306206098 (5h13m59.893262319s) [noise=true , address=64.49.13.140:4511 , piece_id=A7AQ3VPKYONSOWW2YUPGWAXTMA4JPGBG4CQVYCK6PFFIFFUGPMHA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: read tcp 5.161.89.252:31920->64.49.13.140:4511: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 21:40:46.306226506 (5h13m59.893282717s) [seg_pos={0 0}, upload=5382]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 21:40:46.306282762 (5h13m59.893338983s) [upload=5382]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 21:40:46.306286799 (5h13m59.89334301s) [upload=5382]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 21:40:57.774588980 (5h14m11.361645201s) [upload=5382]: Done uploading segments...
Aug 7 21:40:57.774603057 (5h14m11.361659278s) [upload=5382]: Upload finished. err: <nil>
Aug 7 21:41:10.210507562 (5h14m23.797563803s) [upload=5386]: Starting upload
Aug 7 21:41:10.210589415 (5h14m23.797645655s) [upload=5386]: Done starting upload
Aug 7 21:41:10.210669645 (5h14m23.797725856s) [upload=5386]: Uploading segments...
Aug 7 21:41:10.210963293 (5h14m23.798019534s) [upload=5386]: Got next segment. Inline: false
Aug 7 21:41:10.211025149 (5h14m23.79808139s) [upload=5386]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 21:41:10.211035066 (5h14m23.798091308s) [upload=5386]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 21:42:10.197934627 (5h15m23.784990848s) [upload=5386]: Next segment err: context deadline exceeded
Aug 7 21:42:10.198070280 (5h15m23.785126501s) [upload=5386]: Done uploading segments...
Aug 7 21:42:10.198139409 (5h15m23.78519562s) [upload=5386]: Upload finished. err: context deadline exceeded
Aug 7 21:42:14.127516635 (5h15m27.714572846s) [upload=5403]: Starting upload
Aug 7 21:42:14.127582357 (5h15m27.714638569s) [upload=5403]: Done starting upload
Aug 7 21:42:14.127692983 (5h15m27.714749204s) [upload=5403]: Uploading segments...
Aug 7 21:42:14.127793461 (5h15m27.714849672s) [upload=5403]: Got next segment. Inline: false
Aug 7 21:42:14.127840750 (5h15m27.714896961s) [upload=5403]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 21:42:14.127846281 (5h15m27.714902491s) [upload=5403]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 21:43:14.115648400 (5h16m27.702704611s) [upload=5403]: Next segment err: context deadline exceeded
Aug 7 21:43:14.115816064 (5h16m27.702872275s) [upload=5403]: Done uploading segments...
Aug 7 21:43:14.115831182 (5h16m27.702887403s) [upload=5403]: Upload finished. err: context deadline exceeded
Duration: 991.10585ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
31 out of 60 is failed (threshold=3) [........................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.....] duration:
1.888591729s
FAIL (2025-08-07 21:45:58 UTC)
operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 1.888610383s
core
uplink
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
38 out of 60 is failed (threshold=3) [.................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX...X..] duration:
179.783552ms
FAIL (2025-08-07 21:45:57 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 179.796927ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
35 out of 60 is failed (threshold=3) [...................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX..X....] duration:
477.202718ms
FAIL (2025-08-07 21:45:56 UTC)
operation: sync2.Copy
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
7 (5h14m28.062269058s) [upload=5388]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 21:41:25.266685321 (5h14m38.853741562s) [upload=5388]: Done uploading segments...
Aug 7 21:41:25.266706391 (5h14m38.853762631s) [upload=5388]: Upload finished. err: <nil>
Aug 7 21:41:41.070176076 (5h14m54.657232316s) [upload=5396]: Starting upload
Aug 7 21:41:41.070246557 (5h14m54.657302798s) [upload=5396]: Done starting upload
Aug 7 21:41:41.070459143 (5h14m54.657515385s) [upload=5396]: Uploading segments...
Aug 7 21:41:41.070697238 (5h14m54.657753479s) [upload=5396]: Got next segment. Inline: false
Aug 7 21:41:41.070732264 (5h14m54.657788505s) [upload=5396]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 21:41:41.070737293 (5h14m54.657793524s) [upload=5396]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 21:41:41.825834701 (5h14m55.412890922s) [seg_pos={0 0}, upload=5396]: Begin upload segment...
Aug 7 21:41:41.825865027 (5h14m55.412921237s) [seg_pos={0 0}, upload=5396]: Done begin upload segment.
Aug 7 21:41:41.825886015 (5h14m55.412942237s) [noise=true , address=77.90.31.12:4592 , piece_id=75OFHQZRJKZYL3QJ37T6QLDED663WXIEFAHTH2BQZLZ46PY5YPLQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.825988818 (5h14m55.413045068s) [noise=true , address=45.91.116.5:4298 , piece_id=C3BQRSMSRSM4FJ7SWEBPHH7UKNUJWCDD5AEEBEAYN6OMCM2VRSWA, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.826203979 (5h14m55.413260201s) [noise=true , address=45.91.116.4:4937 , piece_id=BYNKX2DGOGITTOYV7IH73WDLAPXHXWG5V5WFIJDTM5RUJQYP6MLQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.826435742 (5h14m55.413491953s) [noise=true , address=77.90.31.13:4627 , piece_id=7MG24AD6AUVL6X66RZJ43OSAM7FLBB33KQY4ENE4Q3NR6PA63YQQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.826541530 (5h14m55.41359777s) [noise=true , address=45.91.116.5:4299 , piece_id=XY3RW62XNQVLM6NTAZTBF26HWTY5KR3ZEJGVYTSTENY2B77YLBMA, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.826653037 (5h14m55.413709248s) [noise=true , address=77.90.31.14:4661 , piece_id=U3YYDMWVGG4NEV5OSK4ATJ2RNTEYCIXKH3KXY7UR3RGJXEUA25IA, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.826875332 (5h14m55.413931543s) [noise=true , address=77.90.31.10:4519 , piece_id=OQZPQPV2NUVKLMSHONEMH2HUK52KXL2E6NXXSO2J6CP7IDTRVT7Q, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.826921499 (5h14m55.41397774s) [noise=true , address=104.36.82.11:4114 , piece_id=KB2SDFXXBJDEYUHUNIO3YSANNDXVREF46SGOSWQ3YBHRR42TFD4A, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.827091606 (5h14m55.414147827s) [noise=true , address=45.91.116.4:4940 , piece_id=ETERKOUZIHEOKPCAJPSUBGXFMDLKEELCVMIW34LR7G66FBFMUNTA, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.827323819 (5h14m55.41438003s) [noise=true , address=77.90.31.17:4771 , piece_id=IYUYS3YHOD44ZF2OGKQX7JCFVW2GBU5S2TVC3FZ2M3JNF67TP4CQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.827393500 (5h14m55.414449742s) [noise=true , address=104.36.82.6:4875 , piece_id=B263E3OQZQDAAYHN3YIPJ4RBLTNOFNOXAZWYTVEGGVRM2YES3PBQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.827542938 (5h14m55.414599159s) [noise=true , address=104.36.82.7:4911 , piece_id=GLWOEWKACQVRHXQ6EY45IYR5N7VCP75FUZIYT5WRQG2VXULRUIUA, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.827778078 (5h14m55.414834318s) [noise=true , address=104.36.82.10:4077 , piece_id=LZBNWOC4E35SX6FKBLATK2QFZDUWA7CBA5RY422YHVMMKO5XDSBQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.827801491 (5h14m55.414857712s) [noise=true , address=104.36.82.5:4837 , piece_id=32VX7X2CPAQKJGKQYNDUF2U6GPAWZKEWYALRTRSFC6TPIQJBBXCQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.828365735 (5h14m55.415421976s) [noise=true , address=45.91.116.8:4048 , piece_id=XZNUB5SDPWSYVGHGMFFQZ4BZMBP2GMKF76GXWQ2MXAGT42I6I4FQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.828913136 (5h14m55.415969378s) [noise=true , address=104.36.82.2:4732 , piece_id=2HK2G5XCNE6UN3COUOG6V4IVCLTRVEMNNCQMV5SZLXRFTO2FJUYQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.934607129 (5h14m55.52166334s) [upload=5396]: Next returned nil segment
Aug 7 21:41:41.934619282 (5h14m55.521675503s) [upload=5396]: Waiting for error group managing segments...
Aug 7 21:41:41.945118551 (5h14m55.532174772s) [noise=true , address=45.91.116.4:4940 , piece_id=ETERKOUZIHEOKPCAJPSUBGXFMDLKEELCVMIW34LR7G66FBFMUNTA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.945901252 (5h14m55.532957473s) [noise=true , address=45.91.116.8:4048 , piece_id=XZNUB5SDPWSYVGHGMFFQZ4BZMBP2GMKF76GXWQ2MXAGT42I6I4FQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.946161258 (5h14m55.533217498s) [noise=true , address=45.91.116.5:4298 , piece_id=C3BQRSMSRSM4FJ7SWEBPHH7UKNUJWCDD5AEEBEAYN6OMCM2VRSWA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.946386648 (5h14m55.533442869s) [noise=true , address=77.90.31.12:4592 , piece_id=75OFHQZRJKZYL3QJ37T6QLDED663WXIEFAHTH2BQZLZ46PY5YPLQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.949024992 (5h14m55.536081243s) [noise=true , address=45.91.116.5:4299 , piece_id=XY3RW62XNQVLM6NTAZTBF26HWTY5KR3ZEJGVYTSTENY2B77YLBMA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.949218724 (5h14m55.536274945s) [noise=true , address=45.91.116.4:4937 , piece_id=BYNKX2DGOGITTOYV7IH73WDLAPXHXWG5V5WFIJDTM5RUJQYP6MLQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.949657033 (5h14m55.536713244s) [noise=true , address=77.90.31.13:4627 , piece_id=7MG24AD6AUVL6X66RZJ43OSAM7FLBB33KQY4ENE4Q3NR6PA63YQQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.949683371 (5h14m55.536739612s) [noise=true , address=104.36.82.2:4732 , piece_id=2HK2G5XCNE6UN3COUOG6V4IVCLTRVEMNNCQMV5SZLXRFTO2FJUYQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.950070354 (5h14m55.537126575s) [noise=true , address=104.36.82.11:4114 , piece_id=KB2SDFXXBJDEYUHUNIO3YSANNDXVREF46SGOSWQ3YBHRR42TFD4A, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.953623165 (5h14m55.540679407s) [noise=true , address=104.36.82.6:4875 , piece_id=B263E3OQZQDAAYHN3YIPJ4RBLTNOFNOXAZWYTVEGGVRM2YES3PBQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.957708261 (5h14m55.544764482s) [noise=true , address=104.36.82.5:4837 , piece_id=32VX7X2CPAQKJGKQYNDUF2U6GPAWZKEWYALRTRSFC6TPIQJBBXCQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.964243811 (5h14m55.551300021s) [noise=true , address=77.90.31.10:4519 , piece_id=OQZPQPV2NUVKLMSHONEMH2HUK52KXL2E6NXXSO2J6CP7IDTRVT7Q, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.964842018 (5h14m55.551898239s) [noise=true , address=77.90.31.14:4661 , piece_id=U3YYDMWVGG4NEV5OSK4ATJ2RNTEYCIXKH3KXY7UR3RGJXEUA25IA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.964860783 (5h14m55.551917004s) [seg_pos={0 0}, upload=5396]: Segment reached optimal threshold of 13 pieces.
Aug 7 21:41:41.964962292 (5h14m55.552018503s) [noise=true , address=77.90.31.17:4771 , piece_id=IYUYS3YHOD44ZF2OGKQX7JCFVW2GBU5S2TVC3FZ2M3JNF67TP4CQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2): protocol: expected piece hash; context canceled; EOF
Aug 7 21:41:41.965019739 (5h14m55.55207595s) [noise=true , address=104.36.82.10:4077 , piece_id=LZBNWOC4E35SX6FKBLATK2QFZDUWA7CBA5RY422YHVMMKO5XDSBQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF
Aug 7 21:41:41.965087696 (5h14m55.552143947s) [noise=true , address=104.36.82.7:4911 , piece_id=GLWOEWKACQVRHXQ6EY45IYR5N7VCP75FUZIYT5WRQG2VXULRUIUA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Aug 7 21:41:41.965118783 (5h14m55.552175005s) [seg_pos={0 0}, upload=5396]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug 7 21:41:41.965239138 (5h14m55.552295349s) [upload=5396]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 21:41:41.965243687 (5h14m55.552299898s) [upload=5396]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 21:41:46.509965896 (5h15m0.097022118s) [upload=5396]: Done uploading segments...
Aug 7 21:41:46.510002955 (5h15m0.097059167s) [upload=5396]: Upload finished. err: <nil>
Aug 7 21:42:01.196715658 (5h15m14.783771899s) [upload=5401]: Starting upload
Aug 7 21:42:01.196842946 (5h15m14.783899187s) [upload=5401]: Done starting upload
Aug 7 21:42:01.196915852 (5h15m14.783972103s) [upload=5401]: Uploading segments...
Aug 7 21:42:01.197283067 (5h15m14.784339309s) [upload=5401]: Got next segment. Inline: false
Aug 7 21:42:01.197355652 (5h15m14.784411984s) [upload=5401]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 21:42:01.197365230 (5h15m14.784421472s) [upload=5401]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 21:42:31.170606605 (5h15m44.757662826s) [upload=5401]: Next segment err: context deadline exceeded
Aug 7 21:42:31.170727651 (5h15m44.757783872s) [upload=5401]: Done uploading segments...
Aug 7 21:42:31.170749551 (5h15m44.757805773s) [upload=5401]: Upload finished. err: context deadline exceeded
Duration: 477.226443ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
28 out of 60 is failed (threshold=3) [.........................XX.XXXXXXXXXXXXXXXXXXXXXXXXXX......] duration:
1.748003511s
FAIL (2025-08-07 21:45:53 UTC)
operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.748027297s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
4 out of 60 is failed (threshold=3) [...........................X........XX...X..................] duration:
22.08336ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-07 21:45:50 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 22.10479ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
41 out of 60 is failed (threshold=3) [..............XX..XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.X..] duration:
221.164565ms
FAIL (2025-08-07 21:45:42 UTC)
operation: Commit uplink: metaclient: context deadline exceeded
Duration: 221.189572ms
core
uplink
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
4 out of 60 is failed (threshold=3) [............................X........XX...X.................] duration:
25.509459ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-07 21:45:33 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 25.532893ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
28 out of 60 is failed (threshold=3) [..........................XX.XXXXXXXXXXXXXXXXXXXXXXXXXX.....] duration:
1.94804689s
FAIL (2025-08-07 21:45:31 UTC)
operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.948109717s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
31 out of 60 is failed (threshold=3) [.........................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX....] duration:
1.852886409s
FAIL (2025-08-07 21:45:30 UTC)
operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 1.852916105s
core
uplink
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
3 out of 60 is failed (threshold=3) [..........................................X...X...X.........] duration:
128.951034ms remote:
"tcp:136.0.77.2:443" target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
FAIL (2025-08-07 21:45:23 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": context deadline exceeded
Duration: 129.007721ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
35 out of 60 is failed (threshold=3) [....................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX..X...] duration:
566.735976ms
FAIL (2025-08-07 21:45:20 UTC)
operation: sync2.Copy
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
7 (5h14m28.062269058s) [upload=5388]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 21:41:25.266685321 (5h14m38.853741562s) [upload=5388]: Done uploading segments...
Aug 7 21:41:25.266706391 (5h14m38.853762631s) [upload=5388]: Upload finished. err: <nil>
Aug 7 21:41:41.070176076 (5h14m54.657232316s) [upload=5396]: Starting upload
Aug 7 21:41:41.070246557 (5h14m54.657302798s) [upload=5396]: Done starting upload
Aug 7 21:41:41.070459143 (5h14m54.657515385s) [upload=5396]: Uploading segments...
Aug 7 21:41:41.070697238 (5h14m54.657753479s) [upload=5396]: Got next segment. Inline: false
Aug 7 21:41:41.070732264 (5h14m54.657788505s) [upload=5396]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 21:41:41.070737293 (5h14m54.657793524s) [upload=5396]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 21:41:41.825834701 (5h14m55.412890922s) [seg_pos={0 0}, upload=5396]: Begin upload segment...
Aug 7 21:41:41.825865027 (5h14m55.412921237s) [seg_pos={0 0}, upload=5396]: Done begin upload segment.
Aug 7 21:41:41.825886015 (5h14m55.412942237s) [noise=true , address=77.90.31.12:4592 , piece_id=75OFHQZRJKZYL3QJ37T6QLDED663WXIEFAHTH2BQZLZ46PY5YPLQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.825988818 (5h14m55.413045068s) [noise=true , address=45.91.116.5:4298 , piece_id=C3BQRSMSRSM4FJ7SWEBPHH7UKNUJWCDD5AEEBEAYN6OMCM2VRSWA, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.826203979 (5h14m55.413260201s) [noise=true , address=45.91.116.4:4937 , piece_id=BYNKX2DGOGITTOYV7IH73WDLAPXHXWG5V5WFIJDTM5RUJQYP6MLQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.826435742 (5h14m55.413491953s) [noise=true , address=77.90.31.13:4627 , piece_id=7MG24AD6AUVL6X66RZJ43OSAM7FLBB33KQY4ENE4Q3NR6PA63YQQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.826541530 (5h14m55.41359777s) [noise=true , address=45.91.116.5:4299 , piece_id=XY3RW62XNQVLM6NTAZTBF26HWTY5KR3ZEJGVYTSTENY2B77YLBMA, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.826653037 (5h14m55.413709248s) [noise=true , address=77.90.31.14:4661 , piece_id=U3YYDMWVGG4NEV5OSK4ATJ2RNTEYCIXKH3KXY7UR3RGJXEUA25IA, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.826875332 (5h14m55.413931543s) [noise=true , address=77.90.31.10:4519 , piece_id=OQZPQPV2NUVKLMSHONEMH2HUK52KXL2E6NXXSO2J6CP7IDTRVT7Q, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.826921499 (5h14m55.41397774s) [noise=true , address=104.36.82.11:4114 , piece_id=KB2SDFXXBJDEYUHUNIO3YSANNDXVREF46SGOSWQ3YBHRR42TFD4A, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.827091606 (5h14m55.414147827s) [noise=true , address=45.91.116.4:4940 , piece_id=ETERKOUZIHEOKPCAJPSUBGXFMDLKEELCVMIW34LR7G66FBFMUNTA, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.827323819 (5h14m55.41438003s) [noise=true , address=77.90.31.17:4771 , piece_id=IYUYS3YHOD44ZF2OGKQX7JCFVW2GBU5S2TVC3FZ2M3JNF67TP4CQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.827393500 (5h14m55.414449742s) [noise=true , address=104.36.82.6:4875 , piece_id=B263E3OQZQDAAYHN3YIPJ4RBLTNOFNOXAZWYTVEGGVRM2YES3PBQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.827542938 (5h14m55.414599159s) [noise=true , address=104.36.82.7:4911 , piece_id=GLWOEWKACQVRHXQ6EY45IYR5N7VCP75FUZIYT5WRQG2VXULRUIUA, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.827778078 (5h14m55.414834318s) [noise=true , address=104.36.82.10:4077 , piece_id=LZBNWOC4E35SX6FKBLATK2QFZDUWA7CBA5RY422YHVMMKO5XDSBQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.827801491 (5h14m55.414857712s) [noise=true , address=104.36.82.5:4837 , piece_id=32VX7X2CPAQKJGKQYNDUF2U6GPAWZKEWYALRTRSFC6TPIQJBBXCQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.828365735 (5h14m55.415421976s) [noise=true , address=45.91.116.8:4048 , piece_id=XZNUB5SDPWSYVGHGMFFQZ4BZMBP2GMKF76GXWQ2MXAGT42I6I4FQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.828913136 (5h14m55.415969378s) [noise=true , address=104.36.82.2:4732 , piece_id=2HK2G5XCNE6UN3COUOG6V4IVCLTRVEMNNCQMV5SZLXRFTO2FJUYQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.934607129 (5h14m55.52166334s) [upload=5396]: Next returned nil segment
Aug 7 21:41:41.934619282 (5h14m55.521675503s) [upload=5396]: Waiting for error group managing segments...
Aug 7 21:41:41.945118551 (5h14m55.532174772s) [noise=true , address=45.91.116.4:4940 , piece_id=ETERKOUZIHEOKPCAJPSUBGXFMDLKEELCVMIW34LR7G66FBFMUNTA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.945901252 (5h14m55.532957473s) [noise=true , address=45.91.116.8:4048 , piece_id=XZNUB5SDPWSYVGHGMFFQZ4BZMBP2GMKF76GXWQ2MXAGT42I6I4FQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.946161258 (5h14m55.533217498s) [noise=true , address=45.91.116.5:4298 , piece_id=C3BQRSMSRSM4FJ7SWEBPHH7UKNUJWCDD5AEEBEAYN6OMCM2VRSWA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.946386648 (5h14m55.533442869s) [noise=true , address=77.90.31.12:4592 , piece_id=75OFHQZRJKZYL3QJ37T6QLDED663WXIEFAHTH2BQZLZ46PY5YPLQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.949024992 (5h14m55.536081243s) [noise=true , address=45.91.116.5:4299 , piece_id=XY3RW62XNQVLM6NTAZTBF26HWTY5KR3ZEJGVYTSTENY2B77YLBMA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.949218724 (5h14m55.536274945s) [noise=true , address=45.91.116.4:4937 , piece_id=BYNKX2DGOGITTOYV7IH73WDLAPXHXWG5V5WFIJDTM5RUJQYP6MLQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.949657033 (5h14m55.536713244s) [noise=true , address=77.90.31.13:4627 , piece_id=7MG24AD6AUVL6X66RZJ43OSAM7FLBB33KQY4ENE4Q3NR6PA63YQQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.949683371 (5h14m55.536739612s) [noise=true , address=104.36.82.2:4732 , piece_id=2HK2G5XCNE6UN3COUOG6V4IVCLTRVEMNNCQMV5SZLXRFTO2FJUYQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.950070354 (5h14m55.537126575s) [noise=true , address=104.36.82.11:4114 , piece_id=KB2SDFXXBJDEYUHUNIO3YSANNDXVREF46SGOSWQ3YBHRR42TFD4A, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.953623165 (5h14m55.540679407s) [noise=true , address=104.36.82.6:4875 , piece_id=B263E3OQZQDAAYHN3YIPJ4RBLTNOFNOXAZWYTVEGGVRM2YES3PBQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.957708261 (5h14m55.544764482s) [noise=true , address=104.36.82.5:4837 , piece_id=32VX7X2CPAQKJGKQYNDUF2U6GPAWZKEWYALRTRSFC6TPIQJBBXCQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.964243811 (5h14m55.551300021s) [noise=true , address=77.90.31.10:4519 , piece_id=OQZPQPV2NUVKLMSHONEMH2HUK52KXL2E6NXXSO2J6CP7IDTRVT7Q, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.964842018 (5h14m55.551898239s) [noise=true , address=77.90.31.14:4661 , piece_id=U3YYDMWVGG4NEV5OSK4ATJ2RNTEYCIXKH3KXY7UR3RGJXEUA25IA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.964860783 (5h14m55.551917004s) [seg_pos={0 0}, upload=5396]: Segment reached optimal threshold of 13 pieces.
Aug 7 21:41:41.964962292 (5h14m55.552018503s) [noise=true , address=77.90.31.17:4771 , piece_id=IYUYS3YHOD44ZF2OGKQX7JCFVW2GBU5S2TVC3FZ2M3JNF67TP4CQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2): protocol: expected piece hash; context canceled; EOF
Aug 7 21:41:41.965019739 (5h14m55.55207595s) [noise=true , address=104.36.82.10:4077 , piece_id=LZBNWOC4E35SX6FKBLATK2QFZDUWA7CBA5RY422YHVMMKO5XDSBQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF
Aug 7 21:41:41.965087696 (5h14m55.552143947s) [noise=true , address=104.36.82.7:4911 , piece_id=GLWOEWKACQVRHXQ6EY45IYR5N7VCP75FUZIYT5WRQG2VXULRUIUA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Aug 7 21:41:41.965118783 (5h14m55.552175005s) [seg_pos={0 0}, upload=5396]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug 7 21:41:41.965239138 (5h14m55.552295349s) [upload=5396]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 21:41:41.965243687 (5h14m55.552299898s) [upload=5396]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 21:41:46.509965896 (5h15m0.097022118s) [upload=5396]: Done uploading segments...
Aug 7 21:41:46.510002955 (5h15m0.097059167s) [upload=5396]: Upload finished. err: <nil>
Aug 7 21:42:01.196715658 (5h15m14.783771899s) [upload=5401]: Starting upload
Aug 7 21:42:01.196842946 (5h15m14.783899187s) [upload=5401]: Done starting upload
Aug 7 21:42:01.196915852 (5h15m14.783972103s) [upload=5401]: Uploading segments...
Aug 7 21:42:01.197283067 (5h15m14.784339309s) [upload=5401]: Got next segment. Inline: false
Aug 7 21:42:01.197355652 (5h15m14.784411984s) [upload=5401]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 21:42:01.197365230 (5h15m14.784421472s) [upload=5401]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 21:42:31.170606605 (5h15m44.757662826s) [upload=5401]: Next segment err: context deadline exceeded
Aug 7 21:42:31.170727651 (5h15m44.757783872s) [upload=5401]: Done uploading segments...
Aug 7 21:42:31.170749551 (5h15m44.757805773s) [upload=5401]: Upload finished. err: context deadline exceeded
Duration: 566.757385ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
42 out of 60 is failed (threshold=3) [.................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXX] duration:
30.001642925s
FAIL (2025-08-07 21:45:20 UTC)
operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== shed. err: metaclient: context deadline exceeded Aug 7 21:37:24.787968674 (5h10m38.375024885s) [upload=5327]: Starting upload Aug 7 21:37:24.788026372 (5h10m38.375082583s) [upload=5327]: Done starting upload Aug 7 21:37:24.788072297 (5h10m38.375128518s) [upload=5327]: Uploading segments... Aug 7 21:37:24.788129475 (5h10m38.375185696s) [upload=5327]: Got next segment. Inline: true Aug 7 21:37:24.788133472 (5h10m38.375189694s) [upload=5327]: Waiting for error group managing segments... Aug 7 21:37:24.788169800 (5h10m38.375226021s) [upload=5327]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:37:24.788173967 (5h10m38.375230188s) [upload=5327]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:37:24.788176171 (5h10m38.375232382s) [upload=5327]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:37:54.773685524 (5h11m8.360741775s) [upload=5327]: Done uploading segments... Aug 7 21:37:54.773706774 (5h11m8.360763025s) [upload=5327]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:37:56.437147115 (5h11m10.024203357s) [upload=5336]: Starting upload Aug 7 21:37:56.437251630 (5h11m10.024307872s) [upload=5336]: Done starting upload Aug 7 21:37:56.437342400 (5h11m10.024398641s) [upload=5336]: Uploading segments... Aug 7 21:37:56.437415256 (5h11m10.024471508s) [upload=5336]: Got next segment. Inline: true Aug 7 21:37:56.437425486 (5h11m10.024481767s) [upload=5336]: Waiting for error group managing segments... Aug 7 21:37:56.437531414 (5h11m10.024587665s) [upload=5336]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:37:56.437544558 (5h11m10.02460085s) [upload=5336]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:37:56.437551260 (5h11m10.024607511s) [upload=5336]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:38:26.422314839 (5h11m40.009371081s) [upload=5336]: Done uploading segments... Aug 7 21:38:26.422335869 (5h11m40.00939211s) [upload=5336]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:38:26.513648977 (5h11m40.100705218s) [upload=5344]: Starting upload Aug 7 21:38:26.513731310 (5h11m40.100787552s) [upload=5344]: Done starting upload Aug 7 21:38:26.513792245 (5h11m40.100848496s) [upload=5344]: Uploading segments... Aug 7 21:38:26.513834112 (5h11m40.100890354s) [upload=5344]: Got next segment. Inline: true Aug 7 21:38:26.513839653 (5h11m40.100895904s) [upload=5344]: Waiting for error group managing segments... Aug 7 21:38:26.513884006 (5h11m40.100940247s) [upload=5344]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:38:26.513889947 (5h11m40.100946188s) [upload=5344]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:38:26.513893434 (5h11m40.100949675s) [upload=5344]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:38:56.502052245 (5h12m10.089108537s) [upload=5344]: Done uploading segments... Aug 7 21:38:56.502102730 (5h12m10.089158972s) [upload=5344]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:39:24.008006172 (5h12m37.595062394s) [upload=5359]: Starting upload Aug 7 21:39:24.008059211 (5h12m37.595115422s) [upload=5359]: Done starting upload Aug 7 21:39:24.008103604 (5h12m37.595159835s) [upload=5359]: Uploading segments... Aug 7 21:39:24.008156191 (5h12m37.595212413s) [upload=5359]: Got next segment. Inline: true Aug 7 21:39:24.008162193 (5h12m37.595218414s) [upload=5359]: Waiting for error group managing segments... Aug 7 21:39:24.008207327 (5h12m37.595263548s) [upload=5359]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:39:24.008212668 (5h12m37.595268878s) [upload=5359]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:39:24.008216064 (5h12m37.595272285s) [upload=5359]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:39:53.997226503 (5h13m7.584282744s) [upload=5359]: Done uploading segments... Aug 7 21:39:53.997270334 (5h13m7.584326586s) [upload=5359]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:40:36.779619947 (5h13m50.366676188s) [upload=5383]: Starting upload Aug 7 21:40:36.779696139 (5h13m50.36675238s) [upload=5383]: Done starting upload Aug 7 21:40:36.779752775 (5h13m50.366809016s) [upload=5383]: Uploading segments... Aug 7 21:40:36.779788803 (5h13m50.366845044s) [upload=5383]: Got next segment. Inline: true Aug 7 21:40:36.779794423 (5h13m50.366850655s) [upload=5383]: Waiting for error group managing segments... Aug 7 21:40:36.779835950 (5h13m50.366892191s) [upload=5383]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:40:36.779841010 (5h13m50.366897241s) [upload=5383]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:40:36.779844195 (5h13m50.366900437s) [upload=5383]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:41:06.765292852 (5h14m20.352349064s) [upload=5383]: Done uploading segments... Aug 7 21:41:06.765314052 (5h14m20.352370273s) [upload=5383]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:41:47.961322510 (5h15m1.548378802s) [upload=5399]: Starting upload Aug 7 21:41:47.961442915 (5h15m1.548499166s) [upload=5399]: Done starting upload Aug 7 21:41:47.961510201 (5h15m1.548566443s) [upload=5399]: Uploading segments... Aug 7 21:41:47.961591062 (5h15m1.548647313s) [upload=5399]: Got next segment. Inline: true Aug 7 21:41:47.961599218 (5h15m1.548655458s) [upload=5399]: Waiting for error group managing segments... Aug 7 21:41:47.961647759 (5h15m1.548703999s) [upload=5399]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:41:47.961653760 (5h15m1.548710001s) [upload=5399]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:41:47.961657546 (5h15m1.548713787s) [upload=5399]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:42:17.948677724 (5h15m31.535733945s) [upload=5399]: Done uploading segments... Aug 7 21:42:17.948691099 (5h15m31.53574731s) [upload=5399]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:42:18.081006705 (5h15m31.668062915s) [upload=5405]: Starting upload Aug 7 21:42:18.081065655 (5h15m31.668121866s) [upload=5405]: Done starting upload Aug 7 21:42:18.081113425 (5h15m31.668169635s) [upload=5405]: Uploading segments... Aug 7 21:42:18.081164870 (5h15m31.668221091s) [upload=5405]: Got next segment. Inline: true Aug 7 21:42:18.081169459 (5h15m31.66822568s) [upload=5405]: Waiting for error group managing segments... Aug 7 21:42:18.081201809 (5h15m31.66825803s) [upload=5405]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:42:18.081205546 (5h15m31.668261757s) [upload=5405]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:42:18.081208271 (5h15m31.668264483s) [upload=5405]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:42:18.161269758 (5h15m31.748325999s) [upload=5405]: Done uploading segments... Aug 7 21:42:18.161287411 (5h15m31.748343652s) [upload=5405]: Upload finished. err: <nil> Aug 7 21:43:12.878567983 (5h16m26.465624204s) [upload=5420]: Starting upload Aug 7 21:43:12.878678820 (5h16m26.465735041s) [upload=5420]: Done starting upload Aug 7 21:43:12.878731839 (5h16m26.46578806s) [upload=5420]: Uploading segments... Aug 7 21:43:12.878762908 (5h16m26.465819129s) [upload=5420]: Got next segment. Inline: true Aug 7 21:43:12.878766635 (5h16m26.465822856s) [upload=5420]: Waiting for error group managing segments... Aug 7 21:43:12.878799204 (5h16m26.465855425s) [upload=5420]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:43:12.878803332 (5h16m26.465859543s) [upload=5420]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:43:12.878805566 (5h16m26.465861787s) [upload=5420]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:43:42.863779226 (5h16m56.450835478s) [upload=5420]: Done uploading segments... Aug 7 21:43:42.863802450 (5h16m56.450858691s) [upload=5420]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:43:51.464096058 (5h17m5.051152299s) [upload=5431]: Starting upload Aug 7 21:43:51.464210432 (5h17m5.051266673s) [upload=5431]: Done starting upload Aug 7 21:43:51.464274041 (5h17m5.051330282s) [upload=5431]: Uploading segments... Aug 7 21:43:51.464330065 (5h17m5.051386366s) [upload=5431]: Got next segment. Inline: true Aug 7 21:43:51.464343630 (5h17m5.051399912s) [upload=5431]: Waiting for error group managing segments... Aug 7 21:43:51.464415315 (5h17m5.051471556s) [upload=5431]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:43:51.464424673 (5h17m5.051480923s) [upload=5431]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:43:51.464431204 (5h17m5.051487455s) [upload=5431]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:44:21.448488824 (5h17m35.035545036s) [upload=5431]: Done uploading segments... Aug 7 21:44:21.448528209 (5h17m35.03558443s) [upload=5431]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:44:50.396194570 (5h18m3.983250782s) [upload=5444]: Starting upload Aug 7 21:44:50.396243653 (5h18m3.983299864s) [upload=5444]: Done starting upload Aug 7 21:44:50.396286463 (5h18m3.983342684s) [upload=5444]: Uploading segments... Aug 7 21:44:50.396309054 (5h18m3.983365266s) [upload=5444]: Got next segment. Inline: true Aug 7 21:44:50.396312381 (5h18m3.983368592s) [upload=5444]: Waiting for error group managing segments... Aug 7 21:44:50.396342687 (5h18m3.983398908s) [upload=5444]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:44:50.396346635 (5h18m3.983402856s) [upload=5444]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:44:50.396348889 (5h18m3.98340511s) [upload=5444]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:45:20.384461417 (5h18m33.971517668s) [upload=5444]: Done uploading segments... Aug 7 21:45:20.384482547 (5h18m33.971538788s) [upload=5444]: Upload finished. err: metaclient: context deadline exceeded
Duration: 30.001687658s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
37 out of 60 is failed (threshold=3) [.................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XX.....] duration:
608.292255ms
FAIL (2025-08-07 21:45:19 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 608.306432ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
38 out of 60 is failed (threshold=3) [..................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX...X.] duration:
357.436567ms
FAIL (2025-08-07 21:45:18 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 357.451986ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
19 out of 60 is failed (threshold=3) [....................................XXXXXXXXXXXXXXXXX.XX....] duration:
1.105832403s
FAIL (2025-08-07 21:45:17 UTC)
operation: sync2.Copy
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
address=104.36.82.12:4172 , piece_id=2SN23SJESN46DLA25WJULJLVGE7QWLQW2QJFAUA3WUVICJ5CKLUA, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.023027314 (5h13m59.610083535s) [noise=true , address=104.36.82.54:4183 , piece_id=ZOCQQFJKFATMPRR2PKHLTSWN2D3QXAMZ74K2A5KTKYQAHEGA2BUA, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.023255801 (5h13m59.610312012s) [noise=true , address=104.36.82.37:4663 , piece_id=XOIJUGNOKJJVWQ4226IL67H73DVYH7VBSIKI4BQSMOIGYNY7MO7A, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.023462957 (5h13m59.610519169s) [noise=true , address=104.36.82.60:4367 , piece_id=IRTAFXB5WIGLKZE4HQE7UW7J5OSZSIQK7TGY447RFZD7FCIAYQVQ, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.023666096 (5h13m59.610722308s) [noise=true , address=64.49.13.140:4511 , piece_id=A7AQ3VPKYONSOWW2YUPGWAXTMA4JPGBG4CQVYCK6PFFIFFUGPMHA, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.023880075 (5h13m59.610936287s) [noise=true , address=104.36.82.23:4474 , piece_id=TDLXCBP5IPHILGHJYQD4DXYRMLL2VS2ER3ECEBAXOBTUAMR67BBA, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.024106408 (5h13m59.611162629s) [noise=true , address=104.36.82.58:4269 , piece_id=4I2ROAYRNHMC53OKVWWXCS4FULL2XZ6CG5WZUPOLQ4UNELQDHHOA, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.024332290 (5h13m59.611388511s) [noise=true , address=104.36.82.16:4305 , piece_id=K5YI7X35EAPFSOANSPQERKCHUOO6GDZZWKAOFNYGM6R3PA6K2LWA, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.024539145 (5h13m59.611595357s) [noise=true , address=104.36.82.36:4623 , piece_id=ONIDD2KMXGVLKCD5YFBVUMMF2ORGVLFDV4LG3TRKRSINURIDAAFA, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.024749439 (5h13m59.61180566s) [noise=true , address=104.36.82.43:4850 , piece_id=XWPXP7HKO2ZH22MMIODDLHM3LPIIPQP3Y3FLZ54XMMWOIN7JIADA, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.024973778 (5h13m59.612029999s) [noise=true , address=45.91.116.9:4266 , piece_id=VOPNPD4GIHS2VOYBWCCTR7LX3YKL4BCZLW4XMROMAWU4WYUJ52WA, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.025220337 (5h13m59.612276558s) [noise=true , address=104.36.82.15:4275 , piece_id=HCH5IC5PTQ7NCSWPJJC5OOEPEIMA34ZL6E5QPQPCDB2P2FEO6JYA, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.105422677 (5h13m59.692478898s) [upload=5382]: Next returned nil segment
Aug 7 21:40:46.105438417 (5h13m59.692494638s) [upload=5382]: Waiting for error group managing segments...
Aug 7 21:40:46.115255601 (5h13m59.702311812s) [noise=true , address=45.91.116.9:4266 , piece_id=VOPNPD4GIHS2VOYBWCCTR7LX3YKL4BCZLW4XMROMAWU4WYUJ52WA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.123052245 (5h13m59.710108455s) [noise=true , address=104.36.82.16:4305 , piece_id=K5YI7X35EAPFSOANSPQERKCHUOO6GDZZWKAOFNYGM6R3PA6K2LWA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.123065018 (5h13m59.710121239s) [noise=true , address=104.36.82.37:4663 , piece_id=XOIJUGNOKJJVWQ4226IL67H73DVYH7VBSIKI4BQSMOIGYNY7MO7A, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.135955971 (5h13m59.723012192s) [noise=true , address=104.36.82.58:4269 , piece_id=4I2ROAYRNHMC53OKVWWXCS4FULL2XZ6CG5WZUPOLQ4UNELQDHHOA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.139757077 (5h13m59.726813288s) [noise=true , address=104.36.82.44:4891 , piece_id=D33W4EHVQ26LIOJ2KG5RKUHRZSGXAIGS2PQSIURYKGMP63RBTBGA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.148928486 (5h13m59.735984697s) [noise=true , address=104.36.82.15:4275 , piece_id=HCH5IC5PTQ7NCSWPJJC5OOEPEIMA34ZL6E5QPQPCDB2P2FEO6JYA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.149227595 (5h13m59.736283816s) [noise=true , address=104.36.82.36:4623 , piece_id=ONIDD2KMXGVLKCD5YFBVUMMF2ORGVLFDV4LG3TRKRSINURIDAAFA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.157435446 (5h13m59.744491657s) [noise=true , address=104.36.82.54:4183 , piece_id=ZOCQQFJKFATMPRR2PKHLTSWN2D3QXAMZ74K2A5KTKYQAHEGA2BUA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.193659694 (5h13m59.780715905s) [noise=true , address=104.36.82.60:4367 , piece_id=IRTAFXB5WIGLKZE4HQE7UW7J5OSZSIQK7TGY447RFZD7FCIAYQVQ, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.198544171 (5h13m59.785600382s) [noise=true , address=104.36.82.12:4172 , piece_id=2SN23SJESN46DLA25WJULJLVGE7QWLQW2QJFAUA3WUVICJ5CKLUA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.200016058 (5h13m59.787072279s) [noise=true , address=104.36.82.14:4228 , piece_id=USWUBYJMTZKFFN3DZIKQQD7PW6QAKBRUHJZRCBO4DXTHR2PQDHRQ, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.224817695 (5h13m59.811873916s) [noise=true , address=104.36.82.43:4850 , piece_id=XWPXP7HKO2ZH22MMIODDLHM3LPIIPQP3Y3FLZ54XMMWOIN7JIADA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.225279788 (5h13m59.812336009s) [noise=true , address=104.36.82.61:4383 , piece_id=ELAHQPPPJCCLCQYXDEOS62V6TOMV5NOCMUU5XZFCQ23Y6SQUWG6Q, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.305784060 (5h13m59.892840282s) [noise=true , address=104.36.82.43:4863 , piece_id=PWAZUY75NQILRAVGRSMJSFKPOPLR3WQ5O3Q47GZ5U37KXPXJ3ORQ, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.305806102 (5h13m59.892862323s) [seg_pos={0 0}, upload=5382]: Segment reached optimal threshold of 14 pieces.
Aug 7 21:40:46.305952956 (5h13m59.893009177s) [noise=true , address=104.36.82.56:4261 , piece_id=Z27LNZSXSYSUMQXEW2DI3C54ZJK26ALV653EINMYNU6COTMAMPBA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YNKaVEsXzHe6XGQuv6wR1qqbv6dbzg1xT5Aqkew2ZV3z3tMMf): protocol: expected piece hash; context canceled; EOF
Aug 7 21:40:46.306110209 (5h13m59.89316642s) [noise=true , address=64.49.13.139:4471 , piece_id=2OSYONIOJUEZXMYFSTL7NRN7HG6KXJOHFUL7TIDW73C4VKYF3W3A, seg_pos={0 0}, upload=5382]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:26750->64.49.13.139:4471: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 21:40:46.306163639 (5h13m59.89321985s) [noise=true , address=104.36.82.23:4474 , piece_id=TDLXCBP5IPHILGHJYQD4DXYRMLL2VS2ER3ECEBAXOBTUAMR67BBA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: write tcp 5.161.89.252:22402->104.36.82.23:4474: use of closed network connection; write tcp 5.161.89.252:22402->104.36.82.23:4474: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:22402->104.36.82.23:4474: use of closed network connection
Aug 7 21:40:46.306206098 (5h13m59.893262319s) [noise=true , address=64.49.13.140:4511 , piece_id=A7AQ3VPKYONSOWW2YUPGWAXTMA4JPGBG4CQVYCK6PFFIFFUGPMHA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: read tcp 5.161.89.252:31920->64.49.13.140:4511: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 21:40:46.306226506 (5h13m59.893282717s) [seg_pos={0 0}, upload=5382]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 21:40:46.306282762 (5h13m59.893338983s) [upload=5382]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 21:40:46.306286799 (5h13m59.89334301s) [upload=5382]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 21:40:57.774588980 (5h14m11.361645201s) [upload=5382]: Done uploading segments...
Aug 7 21:40:57.774603057 (5h14m11.361659278s) [upload=5382]: Upload finished. err: <nil>
Aug 7 21:41:10.210507562 (5h14m23.797563803s) [upload=5386]: Starting upload
Aug 7 21:41:10.210589415 (5h14m23.797645655s) [upload=5386]: Done starting upload
Aug 7 21:41:10.210669645 (5h14m23.797725856s) [upload=5386]: Uploading segments...
Aug 7 21:41:10.210963293 (5h14m23.798019534s) [upload=5386]: Got next segment. Inline: false
Aug 7 21:41:10.211025149 (5h14m23.79808139s) [upload=5386]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 21:41:10.211035066 (5h14m23.798091308s) [upload=5386]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 21:42:10.197934627 (5h15m23.784990848s) [upload=5386]: Next segment err: context deadline exceeded
Aug 7 21:42:10.198070280 (5h15m23.785126501s) [upload=5386]: Done uploading segments...
Aug 7 21:42:10.198139409 (5h15m23.78519562s) [upload=5386]: Upload finished. err: context deadline exceeded
Aug 7 21:42:14.127516635 (5h15m27.714572846s) [upload=5403]: Starting upload
Aug 7 21:42:14.127582357 (5h15m27.714638569s) [upload=5403]: Done starting upload
Aug 7 21:42:14.127692983 (5h15m27.714749204s) [upload=5403]: Uploading segments...
Aug 7 21:42:14.127793461 (5h15m27.714849672s) [upload=5403]: Got next segment. Inline: false
Aug 7 21:42:14.127840750 (5h15m27.714896961s) [upload=5403]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 21:42:14.127846281 (5h15m27.714902491s) [upload=5403]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 21:43:14.115648400 (5h16m27.702704611s) [upload=5403]: Next segment err: context deadline exceeded
Aug 7 21:43:14.115816064 (5h16m27.702872275s) [upload=5403]: Done uploading segments...
Aug 7 21:43:14.115831182 (5h16m27.702887403s) [upload=5403]: Upload finished. err: context deadline exceeded
Duration: 1.105853113s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
29 out of 60 is failed (threshold=3) [.............................XXXXXXXXXXXXXXXXXXXXXXXXXXXX.X.] duration:
237.037794ms
FAIL (2025-08-07 21:45:13 UTC)
operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== oad=5272]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:35:15.032246862 (5h8m28.619303102s) [upload=5292]: Starting upload Aug 7 21:35:15.032327261 (5h8m28.619383502s) [upload=5292]: Done starting upload Aug 7 21:35:15.032391071 (5h8m28.619447312s) [upload=5292]: Uploading segments... Aug 7 21:35:15.032434000 (5h8m28.619490242s) [upload=5292]: Got next segment. Inline: true Aug 7 21:35:15.032439461 (5h8m28.619495711s) [upload=5292]: Waiting for error group managing segments... Aug 7 21:35:15.032484926 (5h8m28.619541167s) [upload=5292]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:35:15.032491267 (5h8m28.619547509s) [upload=5292]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:35:15.032494834 (5h8m28.619551085s) [upload=5292]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:36:15.017690007 (5h9m28.604746248s) [upload=5292]: Done uploading segments... Aug 7 21:36:15.017709373 (5h9m28.604765615s) [upload=5292]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:36:15.108542356 (5h9m28.695598567s) [upload=5309]: Starting upload Aug 7 21:36:15.108597850 (5h9m28.695654061s) [upload=5309]: Done starting upload Aug 7 21:36:15.108645098 (5h9m28.695701319s) [upload=5309]: Uploading segments... Aug 7 21:36:15.108673942 (5h9m28.695730153s) [upload=5309]: Got next segment. Inline: true Aug 7 21:36:15.108677278 (5h9m28.695733499s) [upload=5309]: Waiting for error group managing segments... Aug 7 21:36:15.108708507 (5h9m28.695764728s) [upload=5309]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:36:15.108712334 (5h9m28.695768555s) [upload=5309]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:36:15.108714538 (5h9m28.695770759s) [upload=5309]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:37:15.091220957 (5h10m28.678277188s) [upload=5309]: Done uploading segments... Aug 7 21:37:15.091240674 (5h10m28.678296905s) [upload=5309]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:37:15.177436931 (5h10m28.764493172s) [upload=5324]: Starting upload Aug 7 21:37:15.177533852 (5h10m28.764590103s) [upload=5324]: Done starting upload Aug 7 21:37:15.177602810 (5h10m28.764659061s) [upload=5324]: Uploading segments... Aug 7 21:37:15.177645340 (5h10m28.764701581s) [upload=5324]: Got next segment. Inline: true Aug 7 21:37:15.177650961 (5h10m28.764707202s) [upload=5324]: Waiting for error group managing segments... Aug 7 21:37:15.177698649 (5h10m28.76475489s) [upload=5324]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:37:15.177704300 (5h10m28.764760541s) [upload=5324]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:37:15.177708177 (5h10m28.764764428s) [upload=5324]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:37:40.730185715 (5h10m54.317241957s) [upload=5324]: Done uploading segments... Aug 7 21:37:40.730203639 (5h10m54.31725988s) [upload=5324]: Upload finished. err: <nil> Aug 7 21:38:15.287715124 (5h11m28.874771365s) [upload=5341]: Starting upload Aug 7 21:38:15.287780276 (5h11m28.874836516s) [upload=5341]: Done starting upload Aug 7 21:38:15.287844856 (5h11m28.874901107s) [upload=5341]: Uploading segments... Aug 7 21:38:15.287889961 (5h11m28.874946201s) [upload=5341]: Got next segment. Inline: true Aug 7 21:38:15.287895600 (5h11m28.874951842s) [upload=5341]: Waiting for error group managing segments... Aug 7 21:38:15.287984066 (5h11m28.875040317s) [upload=5341]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:38:15.287990077 (5h11m28.875046318s) [upload=5341]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:38:15.287993564 (5h11m28.875049804s) [upload=5341]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:39:15.275679218 (5h12m28.862735459s) [upload=5341]: Done uploading segments... Aug 7 21:39:15.275708622 (5h12m28.862764883s) [upload=5341]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:39:15.358605080 (5h12m28.945661322s) [upload=5358]: Starting upload Aug 7 21:39:15.358690641 (5h12m28.945746882s) [upload=5358]: Done starting upload Aug 7 21:39:15.358748869 (5h12m28.945805111s) [upload=5358]: Uploading segments... Aug 7 21:39:15.358790938 (5h12m28.94584718s) [upload=5358]: Got next segment. Inline: true Aug 7 21:39:15.358796779 (5h12m28.94585302s) [upload=5358]: Waiting for error group managing segments... Aug 7 21:39:15.358840480 (5h12m28.945896721s) [upload=5358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:39:15.358846441 (5h12m28.945902683s) [upload=5358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:39:15.358849918 (5h12m28.945906159s) [upload=5358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:40:15.344303433 (5h13m28.931359654s) [upload=5358]: Done uploading segments... Aug 7 21:40:15.344323120 (5h13m28.931379331s) [upload=5358]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:40:15.438334176 (5h13m29.025390397s) [upload=5373]: Starting upload Aug 7 21:40:15.438379379 (5h13m29.025435601s) [upload=5373]: Done starting upload Aug 7 21:40:15.438418503 (5h13m29.025474714s) [upload=5373]: Uploading segments... Aug 7 21:40:15.438447206 (5h13m29.025503427s) [upload=5373]: Got next segment. Inline: true Aug 7 21:40:15.438450683 (5h13m29.025506894s) [upload=5373]: Waiting for error group managing segments... Aug 7 21:40:15.438481920 (5h13m29.025538141s) [upload=5373]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:40:15.438487511 (5h13m29.025543722s) [upload=5373]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:40:15.438489826 (5h13m29.025546047s) [upload=5373]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:41:15.423387101 (5h14m29.010443342s) [upload=5373]: Done uploading segments... Aug 7 21:41:15.423408011 (5h14m29.010464251s) [upload=5373]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:41:15.514709386 (5h14m29.101765628s) [upload=5390]: Starting upload Aug 7 21:41:15.514790870 (5h14m29.10184711s) [upload=5390]: Done starting upload Aug 7 21:41:15.514852845 (5h14m29.101909086s) [upload=5390]: Uploading segments... Aug 7 21:41:15.514892409 (5h14m29.10194865s) [upload=5390]: Got next segment. Inline: true Aug 7 21:41:15.514898240 (5h14m29.101954481s) [upload=5390]: Waiting for error group managing segments... Aug 7 21:41:15.514941951 (5h14m29.101998192s) [upload=5390]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:41:15.514947551 (5h14m29.102003793s) [upload=5390]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:41:15.514951138 (5h14m29.102007389s) [upload=5390]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:42:15.497042181 (5h15m29.084098402s) [upload=5390]: Done uploading segments... Aug 7 21:42:15.497058301 (5h15m29.084114512s) [upload=5390]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:42:15.596278951 (5h15m29.183335172s) [upload=5404]: Starting upload Aug 7 21:42:15.596337329 (5h15m29.183393541s) [upload=5404]: Done starting upload Aug 7 21:42:15.596382114 (5h15m29.183438324s) [upload=5404]: Uploading segments... Aug 7 21:42:15.596411919 (5h15m29.18346814s) [upload=5404]: Got next segment. Inline: true Aug 7 21:42:15.596415937 (5h15m29.183472158s) [upload=5404]: Waiting for error group managing segments... Aug 7 21:42:15.596447405 (5h15m29.183503626s) [upload=5404]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:42:15.596451042 (5h15m29.183507263s) [upload=5404]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:42:15.596453266 (5h15m29.183509487s) [upload=5404]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:43:15.584735444 (5h16m29.171791655s) [upload=5404]: Done uploading segments... Aug 7 21:43:15.584747787 (5h16m29.171804008s) [upload=5404]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:43:22.691047415 (5h16m36.278103646s) [upload=5423]: Starting upload Aug 7 21:43:22.691110724 (5h16m36.278166955s) [upload=5423]: Done starting upload Aug 7 21:43:22.691177108 (5h16m36.278233338s) [upload=5423]: Uploading segments... Aug 7 21:43:22.691210019 (5h16m36.27826625s) [upload=5423]: Got next segment. Inline: true Aug 7 21:43:22.691214187 (5h16m36.278270418s) [upload=5423]: Waiting for error group managing segments... Aug 7 21:43:22.691250704 (5h16m36.278306925s) [upload=5423]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:43:22.691255263 (5h16m36.278311494s) [upload=5423]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:43:22.691258188 (5h16m36.278314419s) [upload=5423]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:43:22.751511620 (5h16m36.338567872s) [upload=5423]: Done uploading segments... Aug 7 21:43:22.751530204 (5h16m36.338586455s) [upload=5423]: Upload finished. err: <nil> Aug 7 21:44:13.185700222 (5h17m26.772756433s) [upload=5437]: Starting upload Aug 7 21:44:13.185766515 (5h17m26.772822736s) [upload=5437]: Done starting upload Aug 7 21:44:13.185811771 (5h17m26.772867981s) [upload=5437]: Uploading segments... Aug 7 21:44:13.185877192 (5h17m26.772933443s) [upload=5437]: Got next segment. Inline: true Aug 7 21:44:13.185884005 (5h17m26.772940226s) [upload=5437]: Waiting for error group managing segments... Aug 7 21:44:13.185926104 (5h17m26.772982314s) [upload=5437]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:44:13.185931043 (5h17m26.772987254s) [upload=5437]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:44:13.185934560 (5h17m26.77299077s) [upload=5437]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:45:13.172887995 (5h18m26.759944236s) [upload=5437]: Done uploading segments... Aug 7 21:45:13.172908133 (5h18m26.759964374s) [upload=5437]: Upload finished. err: metaclient: context deadline exceeded
Duration: 237.054836ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
31 out of 60 is failed (threshold=3) [..........................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX...] duration:
1.925653959s
FAIL (2025-08-07 21:45:05 UTC)
operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 1.92568168s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
41 out of 60 is failed (threshold=3) [...............XX..XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.X.] duration:
446.491911ms
FAIL (2025-08-07 21:44:59 UTC)
operation: Commit uplink: metaclient: context deadline exceeded
Duration: 446.542605ms
core
uplink
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
37 out of 60 is failed (threshold=3) [..................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XX....] duration:
453.909588ms
FAIL (2025-08-07 21:44:35 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 453.925758ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
38 out of 60 is failed (threshold=3) [...................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX...X] duration:
30.000814136s
FAIL (2025-08-07 21:44:35 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.000901239s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
35 out of 60 is failed (threshold=3) [.....................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX..X..] duration:
15.245716888s
FAIL (2025-08-07 21:44:28 UTC)
operation: sync2.Copy
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
7 (5h14m28.062269058s) [upload=5388]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 21:41:25.266685321 (5h14m38.853741562s) [upload=5388]: Done uploading segments...
Aug 7 21:41:25.266706391 (5h14m38.853762631s) [upload=5388]: Upload finished. err: <nil>
Aug 7 21:41:41.070176076 (5h14m54.657232316s) [upload=5396]: Starting upload
Aug 7 21:41:41.070246557 (5h14m54.657302798s) [upload=5396]: Done starting upload
Aug 7 21:41:41.070459143 (5h14m54.657515385s) [upload=5396]: Uploading segments...
Aug 7 21:41:41.070697238 (5h14m54.657753479s) [upload=5396]: Got next segment. Inline: false
Aug 7 21:41:41.070732264 (5h14m54.657788505s) [upload=5396]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 21:41:41.070737293 (5h14m54.657793524s) [upload=5396]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 21:41:41.825834701 (5h14m55.412890922s) [seg_pos={0 0}, upload=5396]: Begin upload segment...
Aug 7 21:41:41.825865027 (5h14m55.412921237s) [seg_pos={0 0}, upload=5396]: Done begin upload segment.
Aug 7 21:41:41.825886015 (5h14m55.412942237s) [noise=true , address=77.90.31.12:4592 , piece_id=75OFHQZRJKZYL3QJ37T6QLDED663WXIEFAHTH2BQZLZ46PY5YPLQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.825988818 (5h14m55.413045068s) [noise=true , address=45.91.116.5:4298 , piece_id=C3BQRSMSRSM4FJ7SWEBPHH7UKNUJWCDD5AEEBEAYN6OMCM2VRSWA, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.826203979 (5h14m55.413260201s) [noise=true , address=45.91.116.4:4937 , piece_id=BYNKX2DGOGITTOYV7IH73WDLAPXHXWG5V5WFIJDTM5RUJQYP6MLQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.826435742 (5h14m55.413491953s) [noise=true , address=77.90.31.13:4627 , piece_id=7MG24AD6AUVL6X66RZJ43OSAM7FLBB33KQY4ENE4Q3NR6PA63YQQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.826541530 (5h14m55.41359777s) [noise=true , address=45.91.116.5:4299 , piece_id=XY3RW62XNQVLM6NTAZTBF26HWTY5KR3ZEJGVYTSTENY2B77YLBMA, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.826653037 (5h14m55.413709248s) [noise=true , address=77.90.31.14:4661 , piece_id=U3YYDMWVGG4NEV5OSK4ATJ2RNTEYCIXKH3KXY7UR3RGJXEUA25IA, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.826875332 (5h14m55.413931543s) [noise=true , address=77.90.31.10:4519 , piece_id=OQZPQPV2NUVKLMSHONEMH2HUK52KXL2E6NXXSO2J6CP7IDTRVT7Q, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.826921499 (5h14m55.41397774s) [noise=true , address=104.36.82.11:4114 , piece_id=KB2SDFXXBJDEYUHUNIO3YSANNDXVREF46SGOSWQ3YBHRR42TFD4A, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.827091606 (5h14m55.414147827s) [noise=true , address=45.91.116.4:4940 , piece_id=ETERKOUZIHEOKPCAJPSUBGXFMDLKEELCVMIW34LR7G66FBFMUNTA, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.827323819 (5h14m55.41438003s) [noise=true , address=77.90.31.17:4771 , piece_id=IYUYS3YHOD44ZF2OGKQX7JCFVW2GBU5S2TVC3FZ2M3JNF67TP4CQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.827393500 (5h14m55.414449742s) [noise=true , address=104.36.82.6:4875 , piece_id=B263E3OQZQDAAYHN3YIPJ4RBLTNOFNOXAZWYTVEGGVRM2YES3PBQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.827542938 (5h14m55.414599159s) [noise=true , address=104.36.82.7:4911 , piece_id=GLWOEWKACQVRHXQ6EY45IYR5N7VCP75FUZIYT5WRQG2VXULRUIUA, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.827778078 (5h14m55.414834318s) [noise=true , address=104.36.82.10:4077 , piece_id=LZBNWOC4E35SX6FKBLATK2QFZDUWA7CBA5RY422YHVMMKO5XDSBQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.827801491 (5h14m55.414857712s) [noise=true , address=104.36.82.5:4837 , piece_id=32VX7X2CPAQKJGKQYNDUF2U6GPAWZKEWYALRTRSFC6TPIQJBBXCQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.828365735 (5h14m55.415421976s) [noise=true , address=45.91.116.8:4048 , piece_id=XZNUB5SDPWSYVGHGMFFQZ4BZMBP2GMKF76GXWQ2MXAGT42I6I4FQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.828913136 (5h14m55.415969378s) [noise=true , address=104.36.82.2:4732 , piece_id=2HK2G5XCNE6UN3COUOG6V4IVCLTRVEMNNCQMV5SZLXRFTO2FJUYQ, seg_pos={0 0}, upload=5396]: Uploading piece...
Aug 7 21:41:41.934607129 (5h14m55.52166334s) [upload=5396]: Next returned nil segment
Aug 7 21:41:41.934619282 (5h14m55.521675503s) [upload=5396]: Waiting for error group managing segments...
Aug 7 21:41:41.945118551 (5h14m55.532174772s) [noise=true , address=45.91.116.4:4940 , piece_id=ETERKOUZIHEOKPCAJPSUBGXFMDLKEELCVMIW34LR7G66FBFMUNTA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.945901252 (5h14m55.532957473s) [noise=true , address=45.91.116.8:4048 , piece_id=XZNUB5SDPWSYVGHGMFFQZ4BZMBP2GMKF76GXWQ2MXAGT42I6I4FQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.946161258 (5h14m55.533217498s) [noise=true , address=45.91.116.5:4298 , piece_id=C3BQRSMSRSM4FJ7SWEBPHH7UKNUJWCDD5AEEBEAYN6OMCM2VRSWA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.946386648 (5h14m55.533442869s) [noise=true , address=77.90.31.12:4592 , piece_id=75OFHQZRJKZYL3QJ37T6QLDED663WXIEFAHTH2BQZLZ46PY5YPLQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.949024992 (5h14m55.536081243s) [noise=true , address=45.91.116.5:4299 , piece_id=XY3RW62XNQVLM6NTAZTBF26HWTY5KR3ZEJGVYTSTENY2B77YLBMA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.949218724 (5h14m55.536274945s) [noise=true , address=45.91.116.4:4937 , piece_id=BYNKX2DGOGITTOYV7IH73WDLAPXHXWG5V5WFIJDTM5RUJQYP6MLQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.949657033 (5h14m55.536713244s) [noise=true , address=77.90.31.13:4627 , piece_id=7MG24AD6AUVL6X66RZJ43OSAM7FLBB33KQY4ENE4Q3NR6PA63YQQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.949683371 (5h14m55.536739612s) [noise=true , address=104.36.82.2:4732 , piece_id=2HK2G5XCNE6UN3COUOG6V4IVCLTRVEMNNCQMV5SZLXRFTO2FJUYQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.950070354 (5h14m55.537126575s) [noise=true , address=104.36.82.11:4114 , piece_id=KB2SDFXXBJDEYUHUNIO3YSANNDXVREF46SGOSWQ3YBHRR42TFD4A, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.953623165 (5h14m55.540679407s) [noise=true , address=104.36.82.6:4875 , piece_id=B263E3OQZQDAAYHN3YIPJ4RBLTNOFNOXAZWYTVEGGVRM2YES3PBQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.957708261 (5h14m55.544764482s) [noise=true , address=104.36.82.5:4837 , piece_id=32VX7X2CPAQKJGKQYNDUF2U6GPAWZKEWYALRTRSFC6TPIQJBBXCQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.964243811 (5h14m55.551300021s) [noise=true , address=77.90.31.10:4519 , piece_id=OQZPQPV2NUVKLMSHONEMH2HUK52KXL2E6NXXSO2J6CP7IDTRVT7Q, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.964842018 (5h14m55.551898239s) [noise=true , address=77.90.31.14:4661 , piece_id=U3YYDMWVGG4NEV5OSK4ATJ2RNTEYCIXKH3KXY7UR3RGJXEUA25IA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil>
Aug 7 21:41:41.964860783 (5h14m55.551917004s) [seg_pos={0 0}, upload=5396]: Segment reached optimal threshold of 13 pieces.
Aug 7 21:41:41.964962292 (5h14m55.552018503s) [noise=true , address=77.90.31.17:4771 , piece_id=IYUYS3YHOD44ZF2OGKQX7JCFVW2GBU5S2TVC3FZ2M3JNF67TP4CQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2): protocol: expected piece hash; context canceled; EOF
Aug 7 21:41:41.965019739 (5h14m55.55207595s) [noise=true , address=104.36.82.10:4077 , piece_id=LZBNWOC4E35SX6FKBLATK2QFZDUWA7CBA5RY422YHVMMKO5XDSBQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF
Aug 7 21:41:41.965087696 (5h14m55.552143947s) [noise=true , address=104.36.82.7:4911 , piece_id=GLWOEWKACQVRHXQ6EY45IYR5N7VCP75FUZIYT5WRQG2VXULRUIUA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF
Aug 7 21:41:41.965118783 (5h14m55.552175005s) [seg_pos={0 0}, upload=5396]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug 7 21:41:41.965239138 (5h14m55.552295349s) [upload=5396]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 21:41:41.965243687 (5h14m55.552299898s) [upload=5396]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 21:41:46.509965896 (5h15m0.097022118s) [upload=5396]: Done uploading segments...
Aug 7 21:41:46.510002955 (5h15m0.097059167s) [upload=5396]: Upload finished. err: <nil>
Aug 7 21:42:01.196715658 (5h15m14.783771899s) [upload=5401]: Starting upload
Aug 7 21:42:01.196842946 (5h15m14.783899187s) [upload=5401]: Done starting upload
Aug 7 21:42:01.196915852 (5h15m14.783972103s) [upload=5401]: Uploading segments...
Aug 7 21:42:01.197283067 (5h15m14.784339309s) [upload=5401]: Got next segment. Inline: false
Aug 7 21:42:01.197355652 (5h15m14.784411984s) [upload=5401]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 21:42:01.197365230 (5h15m14.784421472s) [upload=5401]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 21:42:31.170606605 (5h15m44.757662826s) [upload=5401]: Next segment err: context deadline exceeded
Aug 7 21:42:31.170727651 (5h15m44.757783872s) [upload=5401]: Done uploading segments...
Aug 7 21:42:31.170749551 (5h15m44.757805773s) [upload=5401]: Upload finished. err: context deadline exceeded
Duration: 15.245754869s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
28 out of 60 is failed (threshold=3) [...........................XX.XXXXXXXXXXXXXXXXXXXXXXXXXX....] duration:
1.554087329s
FAIL (2025-08-07 21:44:28 UTC)
operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.554100483s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
41 out of 60 is failed (threshold=3) [................XX..XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.X] duration:
30.000500506s
FAIL (2025-08-07 21:44:26 UTC)
operation: Commit uplink: metaclient: context deadline exceeded
Duration: 30.000518049s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
19 out of 60 is failed (threshold=3) [.....................................XXXXXXXXXXXXXXXXX.XX...] duration:
1.27832706s
FAIL (2025-08-07 21:44:25 UTC)
operation: sync2.Copy
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
address=104.36.82.12:4172 , piece_id=2SN23SJESN46DLA25WJULJLVGE7QWLQW2QJFAUA3WUVICJ5CKLUA, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.023027314 (5h13m59.610083535s) [noise=true , address=104.36.82.54:4183 , piece_id=ZOCQQFJKFATMPRR2PKHLTSWN2D3QXAMZ74K2A5KTKYQAHEGA2BUA, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.023255801 (5h13m59.610312012s) [noise=true , address=104.36.82.37:4663 , piece_id=XOIJUGNOKJJVWQ4226IL67H73DVYH7VBSIKI4BQSMOIGYNY7MO7A, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.023462957 (5h13m59.610519169s) [noise=true , address=104.36.82.60:4367 , piece_id=IRTAFXB5WIGLKZE4HQE7UW7J5OSZSIQK7TGY447RFZD7FCIAYQVQ, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.023666096 (5h13m59.610722308s) [noise=true , address=64.49.13.140:4511 , piece_id=A7AQ3VPKYONSOWW2YUPGWAXTMA4JPGBG4CQVYCK6PFFIFFUGPMHA, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.023880075 (5h13m59.610936287s) [noise=true , address=104.36.82.23:4474 , piece_id=TDLXCBP5IPHILGHJYQD4DXYRMLL2VS2ER3ECEBAXOBTUAMR67BBA, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.024106408 (5h13m59.611162629s) [noise=true , address=104.36.82.58:4269 , piece_id=4I2ROAYRNHMC53OKVWWXCS4FULL2XZ6CG5WZUPOLQ4UNELQDHHOA, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.024332290 (5h13m59.611388511s) [noise=true , address=104.36.82.16:4305 , piece_id=K5YI7X35EAPFSOANSPQERKCHUOO6GDZZWKAOFNYGM6R3PA6K2LWA, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.024539145 (5h13m59.611595357s) [noise=true , address=104.36.82.36:4623 , piece_id=ONIDD2KMXGVLKCD5YFBVUMMF2ORGVLFDV4LG3TRKRSINURIDAAFA, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.024749439 (5h13m59.61180566s) [noise=true , address=104.36.82.43:4850 , piece_id=XWPXP7HKO2ZH22MMIODDLHM3LPIIPQP3Y3FLZ54XMMWOIN7JIADA, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.024973778 (5h13m59.612029999s) [noise=true , address=45.91.116.9:4266 , piece_id=VOPNPD4GIHS2VOYBWCCTR7LX3YKL4BCZLW4XMROMAWU4WYUJ52WA, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.025220337 (5h13m59.612276558s) [noise=true , address=104.36.82.15:4275 , piece_id=HCH5IC5PTQ7NCSWPJJC5OOEPEIMA34ZL6E5QPQPCDB2P2FEO6JYA, seg_pos={0 0}, upload=5382]: Uploading piece...
Aug 7 21:40:46.105422677 (5h13m59.692478898s) [upload=5382]: Next returned nil segment
Aug 7 21:40:46.105438417 (5h13m59.692494638s) [upload=5382]: Waiting for error group managing segments...
Aug 7 21:40:46.115255601 (5h13m59.702311812s) [noise=true , address=45.91.116.9:4266 , piece_id=VOPNPD4GIHS2VOYBWCCTR7LX3YKL4BCZLW4XMROMAWU4WYUJ52WA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.123052245 (5h13m59.710108455s) [noise=true , address=104.36.82.16:4305 , piece_id=K5YI7X35EAPFSOANSPQERKCHUOO6GDZZWKAOFNYGM6R3PA6K2LWA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.123065018 (5h13m59.710121239s) [noise=true , address=104.36.82.37:4663 , piece_id=XOIJUGNOKJJVWQ4226IL67H73DVYH7VBSIKI4BQSMOIGYNY7MO7A, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.135955971 (5h13m59.723012192s) [noise=true , address=104.36.82.58:4269 , piece_id=4I2ROAYRNHMC53OKVWWXCS4FULL2XZ6CG5WZUPOLQ4UNELQDHHOA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.139757077 (5h13m59.726813288s) [noise=true , address=104.36.82.44:4891 , piece_id=D33W4EHVQ26LIOJ2KG5RKUHRZSGXAIGS2PQSIURYKGMP63RBTBGA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.148928486 (5h13m59.735984697s) [noise=true , address=104.36.82.15:4275 , piece_id=HCH5IC5PTQ7NCSWPJJC5OOEPEIMA34ZL6E5QPQPCDB2P2FEO6JYA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.149227595 (5h13m59.736283816s) [noise=true , address=104.36.82.36:4623 , piece_id=ONIDD2KMXGVLKCD5YFBVUMMF2ORGVLFDV4LG3TRKRSINURIDAAFA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.157435446 (5h13m59.744491657s) [noise=true , address=104.36.82.54:4183 , piece_id=ZOCQQFJKFATMPRR2PKHLTSWN2D3QXAMZ74K2A5KTKYQAHEGA2BUA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.193659694 (5h13m59.780715905s) [noise=true , address=104.36.82.60:4367 , piece_id=IRTAFXB5WIGLKZE4HQE7UW7J5OSZSIQK7TGY447RFZD7FCIAYQVQ, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.198544171 (5h13m59.785600382s) [noise=true , address=104.36.82.12:4172 , piece_id=2SN23SJESN46DLA25WJULJLVGE7QWLQW2QJFAUA3WUVICJ5CKLUA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.200016058 (5h13m59.787072279s) [noise=true , address=104.36.82.14:4228 , piece_id=USWUBYJMTZKFFN3DZIKQQD7PW6QAKBRUHJZRCBO4DXTHR2PQDHRQ, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.224817695 (5h13m59.811873916s) [noise=true , address=104.36.82.43:4850 , piece_id=XWPXP7HKO2ZH22MMIODDLHM3LPIIPQP3Y3FLZ54XMMWOIN7JIADA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.225279788 (5h13m59.812336009s) [noise=true , address=104.36.82.61:4383 , piece_id=ELAHQPPPJCCLCQYXDEOS62V6TOMV5NOCMUU5XZFCQ23Y6SQUWG6Q, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.305784060 (5h13m59.892840282s) [noise=true , address=104.36.82.43:4863 , piece_id=PWAZUY75NQILRAVGRSMJSFKPOPLR3WQ5O3Q47GZ5U37KXPXJ3ORQ, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil>
Aug 7 21:40:46.305806102 (5h13m59.892862323s) [seg_pos={0 0}, upload=5382]: Segment reached optimal threshold of 14 pieces.
Aug 7 21:40:46.305952956 (5h13m59.893009177s) [noise=true , address=104.36.82.56:4261 , piece_id=Z27LNZSXSYSUMQXEW2DI3C54ZJK26ALV653EINMYNU6COTMAMPBA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YNKaVEsXzHe6XGQuv6wR1qqbv6dbzg1xT5Aqkew2ZV3z3tMMf): protocol: expected piece hash; context canceled; EOF
Aug 7 21:40:46.306110209 (5h13m59.89316642s) [noise=true , address=64.49.13.139:4471 , piece_id=2OSYONIOJUEZXMYFSTL7NRN7HG6KXJOHFUL7TIDW73C4VKYF3W3A, seg_pos={0 0}, upload=5382]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:26750->64.49.13.139:4471: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 21:40:46.306163639 (5h13m59.89321985s) [noise=true , address=104.36.82.23:4474 , piece_id=TDLXCBP5IPHILGHJYQD4DXYRMLL2VS2ER3ECEBAXOBTUAMR67BBA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: write tcp 5.161.89.252:22402->104.36.82.23:4474: use of closed network connection; write tcp 5.161.89.252:22402->104.36.82.23:4474: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:22402->104.36.82.23:4474: use of closed network connection
Aug 7 21:40:46.306206098 (5h13m59.893262319s) [noise=true , address=64.49.13.140:4511 , piece_id=A7AQ3VPKYONSOWW2YUPGWAXTMA4JPGBG4CQVYCK6PFFIFFUGPMHA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: read tcp 5.161.89.252:31920->64.49.13.140:4511: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 21:40:46.306226506 (5h13m59.893282717s) [seg_pos={0 0}, upload=5382]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 21:40:46.306282762 (5h13m59.893338983s) [upload=5382]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 21:40:46.306286799 (5h13m59.89334301s) [upload=5382]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 21:40:57.774588980 (5h14m11.361645201s) [upload=5382]: Done uploading segments...
Aug 7 21:40:57.774603057 (5h14m11.361659278s) [upload=5382]: Upload finished. err: <nil>
Aug 7 21:41:10.210507562 (5h14m23.797563803s) [upload=5386]: Starting upload
Aug 7 21:41:10.210589415 (5h14m23.797645655s) [upload=5386]: Done starting upload
Aug 7 21:41:10.210669645 (5h14m23.797725856s) [upload=5386]: Uploading segments...
Aug 7 21:41:10.210963293 (5h14m23.798019534s) [upload=5386]: Got next segment. Inline: false
Aug 7 21:41:10.211025149 (5h14m23.79808139s) [upload=5386]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 21:41:10.211035066 (5h14m23.798091308s) [upload=5386]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 21:42:10.197934627 (5h15m23.784990848s) [upload=5386]: Next segment err: context deadline exceeded
Aug 7 21:42:10.198070280 (5h15m23.785126501s) [upload=5386]: Done uploading segments...
Aug 7 21:42:10.198139409 (5h15m23.78519562s) [upload=5386]: Upload finished. err: context deadline exceeded
Aug 7 21:42:14.127516635 (5h15m27.714572846s) [upload=5403]: Starting upload
Aug 7 21:42:14.127582357 (5h15m27.714638569s) [upload=5403]: Done starting upload
Aug 7 21:42:14.127692983 (5h15m27.714749204s) [upload=5403]: Uploading segments...
Aug 7 21:42:14.127793461 (5h15m27.714849672s) [upload=5403]: Got next segment. Inline: false
Aug 7 21:42:14.127840750 (5h15m27.714896961s) [upload=5403]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 21:42:14.127846281 (5h15m27.714902491s) [upload=5403]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 21:43:14.115648400 (5h16m27.702704611s) [upload=5403]: Next segment err: context deadline exceeded
Aug 7 21:43:14.115816064 (5h16m27.702872275s) [upload=5403]: Done uploading segments...
Aug 7 21:43:14.115831182 (5h16m27.702887403s) [upload=5403]: Upload finished. err: context deadline exceeded
Duration: 1.278352498s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
41 out of 60 is failed (threshold=3) [..................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XX] duration:
30.000930546s
FAIL (2025-08-07 21:44:21 UTC)
operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== nished. err: metaclient: context deadline exceeded Aug 7 21:36:52.348809979 (5h10m5.9358662s) [upload=5319]: Starting upload Aug 7 21:36:52.348858119 (5h10m5.93591434s) [upload=5319]: Done starting upload Aug 7 21:36:52.348898024 (5h10m5.935954245s) [upload=5319]: Uploading segments... Aug 7 21:36:52.348925776 (5h10m5.935981997s) [upload=5319]: Got next segment. Inline: true Aug 7 21:36:52.348929652 (5h10m5.935985864s) [upload=5319]: Waiting for error group managing segments... Aug 7 21:36:52.348958357 (5h10m5.936014567s) [upload=5319]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:36:52.348963487 (5h10m5.936019697s) [upload=5319]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:36:52.348965901 (5h10m5.936022122s) [upload=5319]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:37:22.335555108 (5h10m35.922611329s) [upload=5319]: Done uploading segments... Aug 7 21:37:22.335570486 (5h10m35.922626707s) [upload=5319]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:37:24.787968674 (5h10m38.375024885s) [upload=5327]: Starting upload Aug 7 21:37:24.788026372 (5h10m38.375082583s) [upload=5327]: Done starting upload Aug 7 21:37:24.788072297 (5h10m38.375128518s) [upload=5327]: Uploading segments... Aug 7 21:37:24.788129475 (5h10m38.375185696s) [upload=5327]: Got next segment. Inline: true Aug 7 21:37:24.788133472 (5h10m38.375189694s) [upload=5327]: Waiting for error group managing segments... Aug 7 21:37:24.788169800 (5h10m38.375226021s) [upload=5327]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:37:24.788173967 (5h10m38.375230188s) [upload=5327]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:37:24.788176171 (5h10m38.375232382s) [upload=5327]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:37:54.773685524 (5h11m8.360741775s) [upload=5327]: Done uploading segments... Aug 7 21:37:54.773706774 (5h11m8.360763025s) [upload=5327]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:37:56.437147115 (5h11m10.024203357s) [upload=5336]: Starting upload Aug 7 21:37:56.437251630 (5h11m10.024307872s) [upload=5336]: Done starting upload Aug 7 21:37:56.437342400 (5h11m10.024398641s) [upload=5336]: Uploading segments... Aug 7 21:37:56.437415256 (5h11m10.024471508s) [upload=5336]: Got next segment. Inline: true Aug 7 21:37:56.437425486 (5h11m10.024481767s) [upload=5336]: Waiting for error group managing segments... Aug 7 21:37:56.437531414 (5h11m10.024587665s) [upload=5336]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:37:56.437544558 (5h11m10.02460085s) [upload=5336]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:37:56.437551260 (5h11m10.024607511s) [upload=5336]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:38:26.422314839 (5h11m40.009371081s) [upload=5336]: Done uploading segments... Aug 7 21:38:26.422335869 (5h11m40.00939211s) [upload=5336]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:38:26.513648977 (5h11m40.100705218s) [upload=5344]: Starting upload Aug 7 21:38:26.513731310 (5h11m40.100787552s) [upload=5344]: Done starting upload Aug 7 21:38:26.513792245 (5h11m40.100848496s) [upload=5344]: Uploading segments... Aug 7 21:38:26.513834112 (5h11m40.100890354s) [upload=5344]: Got next segment. Inline: true Aug 7 21:38:26.513839653 (5h11m40.100895904s) [upload=5344]: Waiting for error group managing segments... Aug 7 21:38:26.513884006 (5h11m40.100940247s) [upload=5344]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:38:26.513889947 (5h11m40.100946188s) [upload=5344]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:38:26.513893434 (5h11m40.100949675s) [upload=5344]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:38:56.502052245 (5h12m10.089108537s) [upload=5344]: Done uploading segments... Aug 7 21:38:56.502102730 (5h12m10.089158972s) [upload=5344]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:39:24.008006172 (5h12m37.595062394s) [upload=5359]: Starting upload Aug 7 21:39:24.008059211 (5h12m37.595115422s) [upload=5359]: Done starting upload Aug 7 21:39:24.008103604 (5h12m37.595159835s) [upload=5359]: Uploading segments... Aug 7 21:39:24.008156191 (5h12m37.595212413s) [upload=5359]: Got next segment. Inline: true Aug 7 21:39:24.008162193 (5h12m37.595218414s) [upload=5359]: Waiting for error group managing segments... Aug 7 21:39:24.008207327 (5h12m37.595263548s) [upload=5359]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:39:24.008212668 (5h12m37.595268878s) [upload=5359]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:39:24.008216064 (5h12m37.595272285s) [upload=5359]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:39:53.997226503 (5h13m7.584282744s) [upload=5359]: Done uploading segments... Aug 7 21:39:53.997270334 (5h13m7.584326586s) [upload=5359]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:40:36.779619947 (5h13m50.366676188s) [upload=5383]: Starting upload Aug 7 21:40:36.779696139 (5h13m50.36675238s) [upload=5383]: Done starting upload Aug 7 21:40:36.779752775 (5h13m50.366809016s) [upload=5383]: Uploading segments... Aug 7 21:40:36.779788803 (5h13m50.366845044s) [upload=5383]: Got next segment. Inline: true Aug 7 21:40:36.779794423 (5h13m50.366850655s) [upload=5383]: Waiting for error group managing segments... Aug 7 21:40:36.779835950 (5h13m50.366892191s) [upload=5383]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:40:36.779841010 (5h13m50.366897241s) [upload=5383]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:40:36.779844195 (5h13m50.366900437s) [upload=5383]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:41:06.765292852 (5h14m20.352349064s) [upload=5383]: Done uploading segments... Aug 7 21:41:06.765314052 (5h14m20.352370273s) [upload=5383]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:41:47.961322510 (5h15m1.548378802s) [upload=5399]: Starting upload Aug 7 21:41:47.961442915 (5h15m1.548499166s) [upload=5399]: Done starting upload Aug 7 21:41:47.961510201 (5h15m1.548566443s) [upload=5399]: Uploading segments... Aug 7 21:41:47.961591062 (5h15m1.548647313s) [upload=5399]: Got next segment. Inline: true Aug 7 21:41:47.961599218 (5h15m1.548655458s) [upload=5399]: Waiting for error group managing segments... Aug 7 21:41:47.961647759 (5h15m1.548703999s) [upload=5399]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:41:47.961653760 (5h15m1.548710001s) [upload=5399]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:41:47.961657546 (5h15m1.548713787s) [upload=5399]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:42:17.948677724 (5h15m31.535733945s) [upload=5399]: Done uploading segments... Aug 7 21:42:17.948691099 (5h15m31.53574731s) [upload=5399]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:42:18.081006705 (5h15m31.668062915s) [upload=5405]: Starting upload Aug 7 21:42:18.081065655 (5h15m31.668121866s) [upload=5405]: Done starting upload Aug 7 21:42:18.081113425 (5h15m31.668169635s) [upload=5405]: Uploading segments... Aug 7 21:42:18.081164870 (5h15m31.668221091s) [upload=5405]: Got next segment. Inline: true Aug 7 21:42:18.081169459 (5h15m31.66822568s) [upload=5405]: Waiting for error group managing segments... Aug 7 21:42:18.081201809 (5h15m31.66825803s) [upload=5405]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:42:18.081205546 (5h15m31.668261757s) [upload=5405]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:42:18.081208271 (5h15m31.668264483s) [upload=5405]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:42:18.161269758 (5h15m31.748325999s) [upload=5405]: Done uploading segments... Aug 7 21:42:18.161287411 (5h15m31.748343652s) [upload=5405]: Upload finished. err: <nil> Aug 7 21:43:12.878567983 (5h16m26.465624204s) [upload=5420]: Starting upload Aug 7 21:43:12.878678820 (5h16m26.465735041s) [upload=5420]: Done starting upload Aug 7 21:43:12.878731839 (5h16m26.46578806s) [upload=5420]: Uploading segments... Aug 7 21:43:12.878762908 (5h16m26.465819129s) [upload=5420]: Got next segment. Inline: true Aug 7 21:43:12.878766635 (5h16m26.465822856s) [upload=5420]: Waiting for error group managing segments... Aug 7 21:43:12.878799204 (5h16m26.465855425s) [upload=5420]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:43:12.878803332 (5h16m26.465859543s) [upload=5420]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:43:12.878805566 (5h16m26.465861787s) [upload=5420]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:43:42.863779226 (5h16m56.450835478s) [upload=5420]: Done uploading segments... Aug 7 21:43:42.863802450 (5h16m56.450858691s) [upload=5420]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:43:51.464096058 (5h17m5.051152299s) [upload=5431]: Starting upload Aug 7 21:43:51.464210432 (5h17m5.051266673s) [upload=5431]: Done starting upload Aug 7 21:43:51.464274041 (5h17m5.051330282s) [upload=5431]: Uploading segments... Aug 7 21:43:51.464330065 (5h17m5.051386366s) [upload=5431]: Got next segment. Inline: true Aug 7 21:43:51.464343630 (5h17m5.051399912s) [upload=5431]: Waiting for error group managing segments... Aug 7 21:43:51.464415315 (5h17m5.051471556s) [upload=5431]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 21:43:51.464424673 (5h17m5.051480923s) [upload=5431]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 21:43:51.464431204 (5h17m5.051487455s) [upload=5431]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 21:44:21.448488824 (5h17m35.035545036s) [upload=5431]: Done uploading segments... Aug 7 21:44:21.448528209 (5h17m35.03558443s) [upload=5431]: Upload finished. err: metaclient: context deadline exceeded
Duration: 30.000950231s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
4 out of 60 is failed (threshold=3) [.............................X........XX...X................] duration:
29.280456ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-07 21:44:21 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 29.313537ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
3 out of 60 is failed (threshold=3) [...........................................X...X...X........] duration:
116.452396ms remote:
"tcp:136.0.77.2:443" target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
FAIL (2025-08-07 21:44:17 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": context deadline exceeded
Duration: 116.497481ms
edge
gateway
vhost
bgp
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
28 out of 60 is failed (threshold=3) [............................XX.XXXXXXXXXXXXXXXXXXXXXXXXXX...] duration:
1.756295229s
FAIL (2025-08-07 21:44:03 UTC)
operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.756604948s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
31 out of 60 is failed (threshold=3) [...........................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX..] duration:
1.771268158s
FAIL (2025-08-07 21:43:57 UTC)
operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 1.771290449s
core
uplink
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
37 out of 60 is failed (threshold=3) [...................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XX...] duration:
3.120324273s
FAIL (2025-08-07 21:43:49 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.120348208s
edge
gateway
us-select-1
|