Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....X........................................X..............] duration:
134.941756ms
FAIL (2025-08-28 09:14:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:02:18.699494201 (15h23m41.928979558s) [upload=15948]: Starting upload Aug 28 09:02:18.699566588 (15h23m41.929051945s) [upload=15948]: Done starting upload Aug 28 09:02:18.699621431 (15h23m41.929106788s) [upload=15948]: Uploading segments... Aug 28 09:02:18.699661696 (15h23m41.929147053s) [upload=15948]: Got next segment. Inline: true Aug 28 09:02:18.699667407 (15h23m41.929152814s) [upload=15948]: Waiting for error group managing segments... Aug 28 09:02:18.699730346 (15h23m41.929215693s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:02:18.699738331 (15h23m41.929223678s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:02:18.699742468 (15h23m41.929227826s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:02:18.702348129 (15h23m41.931833486s) [upload=15948]: Done uploading segments... Aug 28 09:02:18.702355443 (15h23m41.931840801s) [upload=15948]: Upload finished. err: metaclient: Too Many Requests
Duration: 134.964349ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
320.890178ms
FAIL (2025-08-28 09:14:22 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 28 08:38:37.128306418 (15h0m0.357791765s) [upload=15529]: Starting upload
Aug 28 08:38:37.128360960 (15h0m0.357846337s) [upload=15529]: Done starting upload
Aug 28 08:38:37.128467872 (15h0m0.357953229s) [upload=15529]: Uploading segments...
Aug 28 08:38:37.128594138 (15h0m0.358079495s) [upload=15529]: Got next segment. Inline: false
Aug 28 08:38:37.128626190 (15h0m0.358111547s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 08:38:37.128629987 (15h0m0.358115344s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 08:38:37.159496629 (15h0m0.388981986s) [seg_pos={0 0}, upload=15529]: Begin upload segment...
Aug 28 08:38:37.159526065 (15h0m0.389011422s) [seg_pos={0 0}, upload=15529]: Done begin upload segment.
Aug 28 08:38:37.159544059 (15h0m0.389029405s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159555029 (15h0m0.389040386s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159875983 (15h0m0.38936136s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159904587 (15h0m0.389389934s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160272919 (15h0m0.389758276s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160280884 (15h0m0.389766242s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160535985 (15h0m0.390021342s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160629981 (15h0m0.390115338s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160761228 (15h0m0.390246585s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160977334 (15h0m0.390462691s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161002733 (15h0m0.39048808s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161239779 (15h0m0.390725136s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161300903 (15h0m0.39078625s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161464060 (15h0m0.390949417s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161574097 (15h0m0.391059455s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161686059 (15h0m0.391171406s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161857702 (15h0m0.391343049s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161951357 (15h0m0.391436705s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.244154623 (15h0m0.47363998s) [upload=15529]: Next returned nil segment
Aug 28 08:38:37.244168008 (15h0m0.473653365s) [upload=15529]: Waiting for error group managing segments...
Aug 28 08:38:37.251633303 (15h0m0.481118651s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.252355692 (15h0m0.48184104s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253551001 (15h0m0.483036348s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253716342 (15h0m0.483201699s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253854362 (15h0m0.483339699s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254242262 (15h0m0.483727619s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254362789 (15h0m0.483848136s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254648477 (15h0m0.484133824s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.255754988 (15h0m0.485240345s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.260723024 (15h0m0.490208372s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.263272761 (15h0m0.492758118s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272821166 (15h0m0.502306513s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272952033 (15h0m0.5024374s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.273973004 (15h0m0.503458361s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.274003461 (15h0m0.503488818s) [seg_pos={0 0}, upload=15529]: Segment reached optimal threshold of 14 pieces.
Aug 28 08:38:37.274302303 (15h0m0.50378765s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1diUU2skKzXPjYy3Mu3iDDjnG5W8Z2cxCRMxDCH9cQGg2TdEiR): protocol: read tcp 5.161.89.252:10072->64.49.13.140:4508: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274341226 (15h0m0.503826583s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J4nbkWW5oM17EbRwB53vgPzEiK8dEXM2tR2TWGhJFqEja9RHi): protocol: read tcp 5.161.89.252:15990->64.49.13.154:4936: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274374699 (15h0m0.503860056s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: read tcp 5.161.89.252:15186->79.127.201.215:4348: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274501718 (15h0m0.503987085s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cYp95Dbq7byUc8cN7dF73sUBJEDnyJLDAVozb5jdz3wACLUXQ): protocol: read tcp 5.161.89.252:12078->79.127.205.245:4252: use of closed network connection; context canceled
Aug 28 08:38:37.274529791 (15h0m0.504015168s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 08:38:37.274605384 (15h0m0.504090751s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 08:38:37.274610052 (15h0m0.50409542s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 08:38:37.327657525 (15h0m0.557142902s) [upload=15529]: Done uploading segments...
Aug 28 08:38:37.327676731 (15h0m0.557162108s) [upload=15529]: Upload finished. err: <nil>
Duration: 320.911048ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....X........................................X.............] duration:
117.796492ms
FAIL (2025-08-28 09:13:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:02:18.699494201 (15h23m41.928979558s) [upload=15948]: Starting upload Aug 28 09:02:18.699566588 (15h23m41.929051945s) [upload=15948]: Done starting upload Aug 28 09:02:18.699621431 (15h23m41.929106788s) [upload=15948]: Uploading segments... Aug 28 09:02:18.699661696 (15h23m41.929147053s) [upload=15948]: Got next segment. Inline: true Aug 28 09:02:18.699667407 (15h23m41.929152814s) [upload=15948]: Waiting for error group managing segments... Aug 28 09:02:18.699730346 (15h23m41.929215693s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:02:18.699738331 (15h23m41.929223678s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:02:18.699742468 (15h23m41.929227826s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:02:18.702348129 (15h23m41.931833486s) [upload=15948]: Done uploading segments... Aug 28 09:02:18.702355443 (15h23m41.931840801s) [upload=15948]: Upload finished. err: metaclient: Too Many Requests
Duration: 117.822099ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
546.80054ms
FAIL (2025-08-28 09:13:25 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 28 08:38:37.128306418 (15h0m0.357791765s) [upload=15529]: Starting upload
Aug 28 08:38:37.128360960 (15h0m0.357846337s) [upload=15529]: Done starting upload
Aug 28 08:38:37.128467872 (15h0m0.357953229s) [upload=15529]: Uploading segments...
Aug 28 08:38:37.128594138 (15h0m0.358079495s) [upload=15529]: Got next segment. Inline: false
Aug 28 08:38:37.128626190 (15h0m0.358111547s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 08:38:37.128629987 (15h0m0.358115344s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 08:38:37.159496629 (15h0m0.388981986s) [seg_pos={0 0}, upload=15529]: Begin upload segment...
Aug 28 08:38:37.159526065 (15h0m0.389011422s) [seg_pos={0 0}, upload=15529]: Done begin upload segment.
Aug 28 08:38:37.159544059 (15h0m0.389029405s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159555029 (15h0m0.389040386s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159875983 (15h0m0.38936136s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159904587 (15h0m0.389389934s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160272919 (15h0m0.389758276s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160280884 (15h0m0.389766242s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160535985 (15h0m0.390021342s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160629981 (15h0m0.390115338s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160761228 (15h0m0.390246585s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160977334 (15h0m0.390462691s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161002733 (15h0m0.39048808s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161239779 (15h0m0.390725136s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161300903 (15h0m0.39078625s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161464060 (15h0m0.390949417s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161574097 (15h0m0.391059455s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161686059 (15h0m0.391171406s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161857702 (15h0m0.391343049s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161951357 (15h0m0.391436705s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.244154623 (15h0m0.47363998s) [upload=15529]: Next returned nil segment
Aug 28 08:38:37.244168008 (15h0m0.473653365s) [upload=15529]: Waiting for error group managing segments...
Aug 28 08:38:37.251633303 (15h0m0.481118651s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.252355692 (15h0m0.48184104s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253551001 (15h0m0.483036348s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253716342 (15h0m0.483201699s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253854362 (15h0m0.483339699s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254242262 (15h0m0.483727619s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254362789 (15h0m0.483848136s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254648477 (15h0m0.484133824s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.255754988 (15h0m0.485240345s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.260723024 (15h0m0.490208372s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.263272761 (15h0m0.492758118s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272821166 (15h0m0.502306513s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272952033 (15h0m0.5024374s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.273973004 (15h0m0.503458361s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.274003461 (15h0m0.503488818s) [seg_pos={0 0}, upload=15529]: Segment reached optimal threshold of 14 pieces.
Aug 28 08:38:37.274302303 (15h0m0.50378765s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1diUU2skKzXPjYy3Mu3iDDjnG5W8Z2cxCRMxDCH9cQGg2TdEiR): protocol: read tcp 5.161.89.252:10072->64.49.13.140:4508: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274341226 (15h0m0.503826583s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J4nbkWW5oM17EbRwB53vgPzEiK8dEXM2tR2TWGhJFqEja9RHi): protocol: read tcp 5.161.89.252:15990->64.49.13.154:4936: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274374699 (15h0m0.503860056s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: read tcp 5.161.89.252:15186->79.127.201.215:4348: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274501718 (15h0m0.503987085s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cYp95Dbq7byUc8cN7dF73sUBJEDnyJLDAVozb5jdz3wACLUXQ): protocol: read tcp 5.161.89.252:12078->79.127.205.245:4252: use of closed network connection; context canceled
Aug 28 08:38:37.274529791 (15h0m0.504015168s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 08:38:37.274605384 (15h0m0.504090751s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 08:38:37.274610052 (15h0m0.50409542s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 08:38:37.327657525 (15h0m0.557142902s) [upload=15529]: Done uploading segments...
Aug 28 08:38:37.327676731 (15h0m0.557162108s) [upload=15529]: Upload finished. err: <nil>
Duration: 546.90607ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......X........................................X............] duration:
437.369185ms
FAIL (2025-08-28 09:13:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:02:18.699494201 (15h23m41.928979558s) [upload=15948]: Starting upload Aug 28 09:02:18.699566588 (15h23m41.929051945s) [upload=15948]: Done starting upload Aug 28 09:02:18.699621431 (15h23m41.929106788s) [upload=15948]: Uploading segments... Aug 28 09:02:18.699661696 (15h23m41.929147053s) [upload=15948]: Got next segment. Inline: true Aug 28 09:02:18.699667407 (15h23m41.929152814s) [upload=15948]: Waiting for error group managing segments... Aug 28 09:02:18.699730346 (15h23m41.929215693s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:02:18.699738331 (15h23m41.929223678s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:02:18.699742468 (15h23m41.929227826s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:02:18.702348129 (15h23m41.931833486s) [upload=15948]: Done uploading segments... Aug 28 09:02:18.702355443 (15h23m41.931840801s) [upload=15948]: Upload finished. err: metaclient: Too Many Requests
Duration: 437.38801ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......X........................................X...........] duration:
461.019492ms
FAIL (2025-08-28 09:12:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:02:18.699494201 (15h23m41.928979558s) [upload=15948]: Starting upload Aug 28 09:02:18.699566588 (15h23m41.929051945s) [upload=15948]: Done starting upload Aug 28 09:02:18.699621431 (15h23m41.929106788s) [upload=15948]: Uploading segments... Aug 28 09:02:18.699661696 (15h23m41.929147053s) [upload=15948]: Got next segment. Inline: true Aug 28 09:02:18.699667407 (15h23m41.929152814s) [upload=15948]: Waiting for error group managing segments... Aug 28 09:02:18.699730346 (15h23m41.929215693s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:02:18.699738331 (15h23m41.929223678s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:02:18.699742468 (15h23m41.929227826s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:02:18.702348129 (15h23m41.931833486s) [upload=15948]: Done uploading segments... Aug 28 09:02:18.702355443 (15h23m41.931840801s) [upload=15948]: Upload finished. err: metaclient: Too Many Requests
Duration: 461.047234ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
625.339039ms
FAIL (2025-08-28 09:12:29 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 28 08:38:37.128306418 (15h0m0.357791765s) [upload=15529]: Starting upload
Aug 28 08:38:37.128360960 (15h0m0.357846337s) [upload=15529]: Done starting upload
Aug 28 08:38:37.128467872 (15h0m0.357953229s) [upload=15529]: Uploading segments...
Aug 28 08:38:37.128594138 (15h0m0.358079495s) [upload=15529]: Got next segment. Inline: false
Aug 28 08:38:37.128626190 (15h0m0.358111547s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 08:38:37.128629987 (15h0m0.358115344s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 08:38:37.159496629 (15h0m0.388981986s) [seg_pos={0 0}, upload=15529]: Begin upload segment...
Aug 28 08:38:37.159526065 (15h0m0.389011422s) [seg_pos={0 0}, upload=15529]: Done begin upload segment.
Aug 28 08:38:37.159544059 (15h0m0.389029405s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159555029 (15h0m0.389040386s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159875983 (15h0m0.38936136s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159904587 (15h0m0.389389934s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160272919 (15h0m0.389758276s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160280884 (15h0m0.389766242s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160535985 (15h0m0.390021342s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160629981 (15h0m0.390115338s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160761228 (15h0m0.390246585s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160977334 (15h0m0.390462691s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161002733 (15h0m0.39048808s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161239779 (15h0m0.390725136s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161300903 (15h0m0.39078625s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161464060 (15h0m0.390949417s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161574097 (15h0m0.391059455s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161686059 (15h0m0.391171406s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161857702 (15h0m0.391343049s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161951357 (15h0m0.391436705s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.244154623 (15h0m0.47363998s) [upload=15529]: Next returned nil segment
Aug 28 08:38:37.244168008 (15h0m0.473653365s) [upload=15529]: Waiting for error group managing segments...
Aug 28 08:38:37.251633303 (15h0m0.481118651s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.252355692 (15h0m0.48184104s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253551001 (15h0m0.483036348s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253716342 (15h0m0.483201699s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253854362 (15h0m0.483339699s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254242262 (15h0m0.483727619s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254362789 (15h0m0.483848136s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254648477 (15h0m0.484133824s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.255754988 (15h0m0.485240345s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.260723024 (15h0m0.490208372s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.263272761 (15h0m0.492758118s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272821166 (15h0m0.502306513s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272952033 (15h0m0.5024374s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.273973004 (15h0m0.503458361s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.274003461 (15h0m0.503488818s) [seg_pos={0 0}, upload=15529]: Segment reached optimal threshold of 14 pieces.
Aug 28 08:38:37.274302303 (15h0m0.50378765s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1diUU2skKzXPjYy3Mu3iDDjnG5W8Z2cxCRMxDCH9cQGg2TdEiR): protocol: read tcp 5.161.89.252:10072->64.49.13.140:4508: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274341226 (15h0m0.503826583s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J4nbkWW5oM17EbRwB53vgPzEiK8dEXM2tR2TWGhJFqEja9RHi): protocol: read tcp 5.161.89.252:15990->64.49.13.154:4936: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274374699 (15h0m0.503860056s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: read tcp 5.161.89.252:15186->79.127.201.215:4348: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274501718 (15h0m0.503987085s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cYp95Dbq7byUc8cN7dF73sUBJEDnyJLDAVozb5jdz3wACLUXQ): protocol: read tcp 5.161.89.252:12078->79.127.205.245:4252: use of closed network connection; context canceled
Aug 28 08:38:37.274529791 (15h0m0.504015168s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 08:38:37.274605384 (15h0m0.504090751s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 08:38:37.274610052 (15h0m0.50409542s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 08:38:37.327657525 (15h0m0.557142902s) [upload=15529]: Done uploading segments...
Aug 28 08:38:37.327676731 (15h0m0.557162108s) [upload=15529]: Upload finished. err: <nil>
Duration: 625.361722ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........X........................................X..........] duration:
126.445747ms
FAIL (2025-08-28 09:11:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:02:18.699494201 (15h23m41.928979558s) [upload=15948]: Starting upload Aug 28 09:02:18.699566588 (15h23m41.929051945s) [upload=15948]: Done starting upload Aug 28 09:02:18.699621431 (15h23m41.929106788s) [upload=15948]: Uploading segments... Aug 28 09:02:18.699661696 (15h23m41.929147053s) [upload=15948]: Got next segment. Inline: true Aug 28 09:02:18.699667407 (15h23m41.929152814s) [upload=15948]: Waiting for error group managing segments... Aug 28 09:02:18.699730346 (15h23m41.929215693s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:02:18.699738331 (15h23m41.929223678s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:02:18.699742468 (15h23m41.929227826s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:02:18.702348129 (15h23m41.931833486s) [upload=15948]: Done uploading segments... Aug 28 09:02:18.702355443 (15h23m41.931840801s) [upload=15948]: Upload finished. err: metaclient: Too Many Requests
Duration: 126.473119ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [X..............X............................................] duration:
393.770379ms
FAIL (2025-08-28 09:11:42 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 28 08:38:37.128306418 (15h0m0.357791765s) [upload=15529]: Starting upload
Aug 28 08:38:37.128360960 (15h0m0.357846337s) [upload=15529]: Done starting upload
Aug 28 08:38:37.128467872 (15h0m0.357953229s) [upload=15529]: Uploading segments...
Aug 28 08:38:37.128594138 (15h0m0.358079495s) [upload=15529]: Got next segment. Inline: false
Aug 28 08:38:37.128626190 (15h0m0.358111547s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 08:38:37.128629987 (15h0m0.358115344s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 08:38:37.159496629 (15h0m0.388981986s) [seg_pos={0 0}, upload=15529]: Begin upload segment...
Aug 28 08:38:37.159526065 (15h0m0.389011422s) [seg_pos={0 0}, upload=15529]: Done begin upload segment.
Aug 28 08:38:37.159544059 (15h0m0.389029405s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159555029 (15h0m0.389040386s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159875983 (15h0m0.38936136s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159904587 (15h0m0.389389934s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160272919 (15h0m0.389758276s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160280884 (15h0m0.389766242s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160535985 (15h0m0.390021342s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160629981 (15h0m0.390115338s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160761228 (15h0m0.390246585s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160977334 (15h0m0.390462691s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161002733 (15h0m0.39048808s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161239779 (15h0m0.390725136s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161300903 (15h0m0.39078625s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161464060 (15h0m0.390949417s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161574097 (15h0m0.391059455s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161686059 (15h0m0.391171406s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161857702 (15h0m0.391343049s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161951357 (15h0m0.391436705s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.244154623 (15h0m0.47363998s) [upload=15529]: Next returned nil segment
Aug 28 08:38:37.244168008 (15h0m0.473653365s) [upload=15529]: Waiting for error group managing segments...
Aug 28 08:38:37.251633303 (15h0m0.481118651s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.252355692 (15h0m0.48184104s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253551001 (15h0m0.483036348s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253716342 (15h0m0.483201699s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253854362 (15h0m0.483339699s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254242262 (15h0m0.483727619s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254362789 (15h0m0.483848136s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254648477 (15h0m0.484133824s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.255754988 (15h0m0.485240345s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.260723024 (15h0m0.490208372s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.263272761 (15h0m0.492758118s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272821166 (15h0m0.502306513s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272952033 (15h0m0.5024374s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.273973004 (15h0m0.503458361s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.274003461 (15h0m0.503488818s) [seg_pos={0 0}, upload=15529]: Segment reached optimal threshold of 14 pieces.
Aug 28 08:38:37.274302303 (15h0m0.50378765s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1diUU2skKzXPjYy3Mu3iDDjnG5W8Z2cxCRMxDCH9cQGg2TdEiR): protocol: read tcp 5.161.89.252:10072->64.49.13.140:4508: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274341226 (15h0m0.503826583s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J4nbkWW5oM17EbRwB53vgPzEiK8dEXM2tR2TWGhJFqEja9RHi): protocol: read tcp 5.161.89.252:15990->64.49.13.154:4936: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274374699 (15h0m0.503860056s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: read tcp 5.161.89.252:15186->79.127.201.215:4348: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274501718 (15h0m0.503987085s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cYp95Dbq7byUc8cN7dF73sUBJEDnyJLDAVozb5jdz3wACLUXQ): protocol: read tcp 5.161.89.252:12078->79.127.205.245:4252: use of closed network connection; context canceled
Aug 28 08:38:37.274529791 (15h0m0.504015168s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 08:38:37.274605384 (15h0m0.504090751s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 08:38:37.274610052 (15h0m0.50409542s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 08:38:37.327657525 (15h0m0.557142902s) [upload=15529]: Done uploading segments...
Aug 28 08:38:37.327676731 (15h0m0.557162108s) [upload=15529]: Upload finished. err: <nil>
Duration: 393.796076ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........X........................................X.........] duration:
226.566564ms
FAIL (2025-08-28 09:10:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:02:18.699494201 (15h23m41.928979558s) [upload=15948]: Starting upload Aug 28 09:02:18.699566588 (15h23m41.929051945s) [upload=15948]: Done starting upload Aug 28 09:02:18.699621431 (15h23m41.929106788s) [upload=15948]: Uploading segments... Aug 28 09:02:18.699661696 (15h23m41.929147053s) [upload=15948]: Got next segment. Inline: true Aug 28 09:02:18.699667407 (15h23m41.929152814s) [upload=15948]: Waiting for error group managing segments... Aug 28 09:02:18.699730346 (15h23m41.929215693s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:02:18.699738331 (15h23m41.929223678s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:02:18.699742468 (15h23m41.929227826s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:02:18.702348129 (15h23m41.931833486s) [upload=15948]: Done uploading segments... Aug 28 09:02:18.702355443 (15h23m41.931840801s) [upload=15948]: Upload finished. err: metaclient: Too Many Requests
Duration: 226.592292ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X..............X...........................................] duration:
307.39539ms
FAIL (2025-08-28 09:10:39 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 28 08:38:37.128306418 (15h0m0.357791765s) [upload=15529]: Starting upload
Aug 28 08:38:37.128360960 (15h0m0.357846337s) [upload=15529]: Done starting upload
Aug 28 08:38:37.128467872 (15h0m0.357953229s) [upload=15529]: Uploading segments...
Aug 28 08:38:37.128594138 (15h0m0.358079495s) [upload=15529]: Got next segment. Inline: false
Aug 28 08:38:37.128626190 (15h0m0.358111547s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 08:38:37.128629987 (15h0m0.358115344s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 08:38:37.159496629 (15h0m0.388981986s) [seg_pos={0 0}, upload=15529]: Begin upload segment...
Aug 28 08:38:37.159526065 (15h0m0.389011422s) [seg_pos={0 0}, upload=15529]: Done begin upload segment.
Aug 28 08:38:37.159544059 (15h0m0.389029405s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159555029 (15h0m0.389040386s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159875983 (15h0m0.38936136s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159904587 (15h0m0.389389934s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160272919 (15h0m0.389758276s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160280884 (15h0m0.389766242s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160535985 (15h0m0.390021342s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160629981 (15h0m0.390115338s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160761228 (15h0m0.390246585s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160977334 (15h0m0.390462691s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161002733 (15h0m0.39048808s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161239779 (15h0m0.390725136s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161300903 (15h0m0.39078625s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161464060 (15h0m0.390949417s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161574097 (15h0m0.391059455s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161686059 (15h0m0.391171406s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161857702 (15h0m0.391343049s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161951357 (15h0m0.391436705s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.244154623 (15h0m0.47363998s) [upload=15529]: Next returned nil segment
Aug 28 08:38:37.244168008 (15h0m0.473653365s) [upload=15529]: Waiting for error group managing segments...
Aug 28 08:38:37.251633303 (15h0m0.481118651s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.252355692 (15h0m0.48184104s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253551001 (15h0m0.483036348s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253716342 (15h0m0.483201699s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253854362 (15h0m0.483339699s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254242262 (15h0m0.483727619s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254362789 (15h0m0.483848136s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254648477 (15h0m0.484133824s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.255754988 (15h0m0.485240345s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.260723024 (15h0m0.490208372s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.263272761 (15h0m0.492758118s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272821166 (15h0m0.502306513s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272952033 (15h0m0.5024374s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.273973004 (15h0m0.503458361s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.274003461 (15h0m0.503488818s) [seg_pos={0 0}, upload=15529]: Segment reached optimal threshold of 14 pieces.
Aug 28 08:38:37.274302303 (15h0m0.50378765s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1diUU2skKzXPjYy3Mu3iDDjnG5W8Z2cxCRMxDCH9cQGg2TdEiR): protocol: read tcp 5.161.89.252:10072->64.49.13.140:4508: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274341226 (15h0m0.503826583s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J4nbkWW5oM17EbRwB53vgPzEiK8dEXM2tR2TWGhJFqEja9RHi): protocol: read tcp 5.161.89.252:15990->64.49.13.154:4936: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274374699 (15h0m0.503860056s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: read tcp 5.161.89.252:15186->79.127.201.215:4348: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274501718 (15h0m0.503987085s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cYp95Dbq7byUc8cN7dF73sUBJEDnyJLDAVozb5jdz3wACLUXQ): protocol: read tcp 5.161.89.252:12078->79.127.205.245:4252: use of closed network connection; context canceled
Aug 28 08:38:37.274529791 (15h0m0.504015168s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 08:38:37.274605384 (15h0m0.504090751s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 08:38:37.274610052 (15h0m0.50409542s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 08:38:37.327657525 (15h0m0.557142902s) [upload=15529]: Done uploading segments...
Aug 28 08:38:37.327676731 (15h0m0.557162108s) [upload=15529]: Upload finished. err: <nil>
Duration: 307.415267ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........X........................................X........] duration:
117.27968ms
FAIL (2025-08-28 09:10:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:02:18.699494201 (15h23m41.928979558s) [upload=15948]: Starting upload Aug 28 09:02:18.699566588 (15h23m41.929051945s) [upload=15948]: Done starting upload Aug 28 09:02:18.699621431 (15h23m41.929106788s) [upload=15948]: Uploading segments... Aug 28 09:02:18.699661696 (15h23m41.929147053s) [upload=15948]: Got next segment. Inline: true Aug 28 09:02:18.699667407 (15h23m41.929152814s) [upload=15948]: Waiting for error group managing segments... Aug 28 09:02:18.699730346 (15h23m41.929215693s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:02:18.699738331 (15h23m41.929223678s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:02:18.699742468 (15h23m41.929227826s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:02:18.702348129 (15h23m41.931833486s) [upload=15948]: Done uploading segments... Aug 28 09:02:18.702355443 (15h23m41.931840801s) [upload=15948]: Upload finished. err: metaclient: Too Many Requests
Duration: 117.302463ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X..............X..........................................] duration:
302.133955ms
FAIL (2025-08-28 09:10:03 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 28 08:38:37.128306418 (15h0m0.357791765s) [upload=15529]: Starting upload
Aug 28 08:38:37.128360960 (15h0m0.357846337s) [upload=15529]: Done starting upload
Aug 28 08:38:37.128467872 (15h0m0.357953229s) [upload=15529]: Uploading segments...
Aug 28 08:38:37.128594138 (15h0m0.358079495s) [upload=15529]: Got next segment. Inline: false
Aug 28 08:38:37.128626190 (15h0m0.358111547s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 08:38:37.128629987 (15h0m0.358115344s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 08:38:37.159496629 (15h0m0.388981986s) [seg_pos={0 0}, upload=15529]: Begin upload segment...
Aug 28 08:38:37.159526065 (15h0m0.389011422s) [seg_pos={0 0}, upload=15529]: Done begin upload segment.
Aug 28 08:38:37.159544059 (15h0m0.389029405s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159555029 (15h0m0.389040386s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159875983 (15h0m0.38936136s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159904587 (15h0m0.389389934s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160272919 (15h0m0.389758276s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160280884 (15h0m0.389766242s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160535985 (15h0m0.390021342s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160629981 (15h0m0.390115338s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160761228 (15h0m0.390246585s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160977334 (15h0m0.390462691s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161002733 (15h0m0.39048808s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161239779 (15h0m0.390725136s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161300903 (15h0m0.39078625s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161464060 (15h0m0.390949417s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161574097 (15h0m0.391059455s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161686059 (15h0m0.391171406s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161857702 (15h0m0.391343049s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161951357 (15h0m0.391436705s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.244154623 (15h0m0.47363998s) [upload=15529]: Next returned nil segment
Aug 28 08:38:37.244168008 (15h0m0.473653365s) [upload=15529]: Waiting for error group managing segments...
Aug 28 08:38:37.251633303 (15h0m0.481118651s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.252355692 (15h0m0.48184104s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253551001 (15h0m0.483036348s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253716342 (15h0m0.483201699s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253854362 (15h0m0.483339699s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254242262 (15h0m0.483727619s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254362789 (15h0m0.483848136s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254648477 (15h0m0.484133824s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.255754988 (15h0m0.485240345s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.260723024 (15h0m0.490208372s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.263272761 (15h0m0.492758118s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272821166 (15h0m0.502306513s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272952033 (15h0m0.5024374s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.273973004 (15h0m0.503458361s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.274003461 (15h0m0.503488818s) [seg_pos={0 0}, upload=15529]: Segment reached optimal threshold of 14 pieces.
Aug 28 08:38:37.274302303 (15h0m0.50378765s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1diUU2skKzXPjYy3Mu3iDDjnG5W8Z2cxCRMxDCH9cQGg2TdEiR): protocol: read tcp 5.161.89.252:10072->64.49.13.140:4508: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274341226 (15h0m0.503826583s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J4nbkWW5oM17EbRwB53vgPzEiK8dEXM2tR2TWGhJFqEja9RHi): protocol: read tcp 5.161.89.252:15990->64.49.13.154:4936: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274374699 (15h0m0.503860056s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: read tcp 5.161.89.252:15186->79.127.201.215:4348: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274501718 (15h0m0.503987085s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cYp95Dbq7byUc8cN7dF73sUBJEDnyJLDAVozb5jdz3wACLUXQ): protocol: read tcp 5.161.89.252:12078->79.127.205.245:4252: use of closed network connection; context canceled
Aug 28 08:38:37.274529791 (15h0m0.504015168s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 08:38:37.274605384 (15h0m0.504090751s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 08:38:37.274610052 (15h0m0.50409542s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 08:38:37.327657525 (15h0m0.557142902s) [upload=15529]: Done uploading segments...
Aug 28 08:38:37.327676731 (15h0m0.557162108s) [upload=15529]: Upload finished. err: <nil>
Duration: 302.158552ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X..............X.........................................] duration:
763.449695ms
FAIL (2025-08-28 09:09:46 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 28 08:38:37.128306418 (15h0m0.357791765s) [upload=15529]: Starting upload
Aug 28 08:38:37.128360960 (15h0m0.357846337s) [upload=15529]: Done starting upload
Aug 28 08:38:37.128467872 (15h0m0.357953229s) [upload=15529]: Uploading segments...
Aug 28 08:38:37.128594138 (15h0m0.358079495s) [upload=15529]: Got next segment. Inline: false
Aug 28 08:38:37.128626190 (15h0m0.358111547s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 08:38:37.128629987 (15h0m0.358115344s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 08:38:37.159496629 (15h0m0.388981986s) [seg_pos={0 0}, upload=15529]: Begin upload segment...
Aug 28 08:38:37.159526065 (15h0m0.389011422s) [seg_pos={0 0}, upload=15529]: Done begin upload segment.
Aug 28 08:38:37.159544059 (15h0m0.389029405s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159555029 (15h0m0.389040386s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159875983 (15h0m0.38936136s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159904587 (15h0m0.389389934s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160272919 (15h0m0.389758276s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160280884 (15h0m0.389766242s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160535985 (15h0m0.390021342s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160629981 (15h0m0.390115338s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160761228 (15h0m0.390246585s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160977334 (15h0m0.390462691s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161002733 (15h0m0.39048808s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161239779 (15h0m0.390725136s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161300903 (15h0m0.39078625s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161464060 (15h0m0.390949417s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161574097 (15h0m0.391059455s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161686059 (15h0m0.391171406s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161857702 (15h0m0.391343049s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161951357 (15h0m0.391436705s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.244154623 (15h0m0.47363998s) [upload=15529]: Next returned nil segment
Aug 28 08:38:37.244168008 (15h0m0.473653365s) [upload=15529]: Waiting for error group managing segments...
Aug 28 08:38:37.251633303 (15h0m0.481118651s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.252355692 (15h0m0.48184104s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253551001 (15h0m0.483036348s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253716342 (15h0m0.483201699s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253854362 (15h0m0.483339699s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254242262 (15h0m0.483727619s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254362789 (15h0m0.483848136s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254648477 (15h0m0.484133824s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.255754988 (15h0m0.485240345s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.260723024 (15h0m0.490208372s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.263272761 (15h0m0.492758118s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272821166 (15h0m0.502306513s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272952033 (15h0m0.5024374s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.273973004 (15h0m0.503458361s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.274003461 (15h0m0.503488818s) [seg_pos={0 0}, upload=15529]: Segment reached optimal threshold of 14 pieces.
Aug 28 08:38:37.274302303 (15h0m0.50378765s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1diUU2skKzXPjYy3Mu3iDDjnG5W8Z2cxCRMxDCH9cQGg2TdEiR): protocol: read tcp 5.161.89.252:10072->64.49.13.140:4508: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274341226 (15h0m0.503826583s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J4nbkWW5oM17EbRwB53vgPzEiK8dEXM2tR2TWGhJFqEja9RHi): protocol: read tcp 5.161.89.252:15990->64.49.13.154:4936: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274374699 (15h0m0.503860056s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: read tcp 5.161.89.252:15186->79.127.201.215:4348: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274501718 (15h0m0.503987085s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cYp95Dbq7byUc8cN7dF73sUBJEDnyJLDAVozb5jdz3wACLUXQ): protocol: read tcp 5.161.89.252:12078->79.127.205.245:4252: use of closed network connection; context canceled
Aug 28 08:38:37.274529791 (15h0m0.504015168s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 08:38:37.274605384 (15h0m0.504090751s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 08:38:37.274610052 (15h0m0.50409542s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 08:38:37.327657525 (15h0m0.557142902s) [upload=15529]: Done uploading segments...
Aug 28 08:38:37.327676731 (15h0m0.557162108s) [upload=15529]: Upload finished. err: <nil>
Duration: 763.472787ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X..............X........................................] duration:
300.836064ms
FAIL (2025-08-28 09:09:18 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 28 08:38:37.128306418 (15h0m0.357791765s) [upload=15529]: Starting upload
Aug 28 08:38:37.128360960 (15h0m0.357846337s) [upload=15529]: Done starting upload
Aug 28 08:38:37.128467872 (15h0m0.357953229s) [upload=15529]: Uploading segments...
Aug 28 08:38:37.128594138 (15h0m0.358079495s) [upload=15529]: Got next segment. Inline: false
Aug 28 08:38:37.128626190 (15h0m0.358111547s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 08:38:37.128629987 (15h0m0.358115344s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 08:38:37.159496629 (15h0m0.388981986s) [seg_pos={0 0}, upload=15529]: Begin upload segment...
Aug 28 08:38:37.159526065 (15h0m0.389011422s) [seg_pos={0 0}, upload=15529]: Done begin upload segment.
Aug 28 08:38:37.159544059 (15h0m0.389029405s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159555029 (15h0m0.389040386s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159875983 (15h0m0.38936136s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159904587 (15h0m0.389389934s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160272919 (15h0m0.389758276s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160280884 (15h0m0.389766242s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160535985 (15h0m0.390021342s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160629981 (15h0m0.390115338s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160761228 (15h0m0.390246585s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160977334 (15h0m0.390462691s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161002733 (15h0m0.39048808s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161239779 (15h0m0.390725136s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161300903 (15h0m0.39078625s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161464060 (15h0m0.390949417s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161574097 (15h0m0.391059455s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161686059 (15h0m0.391171406s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161857702 (15h0m0.391343049s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161951357 (15h0m0.391436705s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.244154623 (15h0m0.47363998s) [upload=15529]: Next returned nil segment
Aug 28 08:38:37.244168008 (15h0m0.473653365s) [upload=15529]: Waiting for error group managing segments...
Aug 28 08:38:37.251633303 (15h0m0.481118651s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.252355692 (15h0m0.48184104s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253551001 (15h0m0.483036348s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253716342 (15h0m0.483201699s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253854362 (15h0m0.483339699s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254242262 (15h0m0.483727619s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254362789 (15h0m0.483848136s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254648477 (15h0m0.484133824s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.255754988 (15h0m0.485240345s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.260723024 (15h0m0.490208372s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.263272761 (15h0m0.492758118s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272821166 (15h0m0.502306513s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272952033 (15h0m0.5024374s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.273973004 (15h0m0.503458361s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.274003461 (15h0m0.503488818s) [seg_pos={0 0}, upload=15529]: Segment reached optimal threshold of 14 pieces.
Aug 28 08:38:37.274302303 (15h0m0.50378765s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1diUU2skKzXPjYy3Mu3iDDjnG5W8Z2cxCRMxDCH9cQGg2TdEiR): protocol: read tcp 5.161.89.252:10072->64.49.13.140:4508: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274341226 (15h0m0.503826583s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J4nbkWW5oM17EbRwB53vgPzEiK8dEXM2tR2TWGhJFqEja9RHi): protocol: read tcp 5.161.89.252:15990->64.49.13.154:4936: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274374699 (15h0m0.503860056s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: read tcp 5.161.89.252:15186->79.127.201.215:4348: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274501718 (15h0m0.503987085s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cYp95Dbq7byUc8cN7dF73sUBJEDnyJLDAVozb5jdz3wACLUXQ): protocol: read tcp 5.161.89.252:12078->79.127.205.245:4252: use of closed network connection; context canceled
Aug 28 08:38:37.274529791 (15h0m0.504015168s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 08:38:37.274605384 (15h0m0.504090751s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 08:38:37.274610052 (15h0m0.50409542s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 08:38:37.327657525 (15h0m0.557142902s) [upload=15529]: Done uploading segments...
Aug 28 08:38:37.327676731 (15h0m0.557162108s) [upload=15529]: Upload finished. err: <nil>
Duration: 300.855501ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........X........................................X.......] duration:
526.397838ms
FAIL (2025-08-28 09:09:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:02:18.699494201 (15h23m41.928979558s) [upload=15948]: Starting upload Aug 28 09:02:18.699566588 (15h23m41.929051945s) [upload=15948]: Done starting upload Aug 28 09:02:18.699621431 (15h23m41.929106788s) [upload=15948]: Uploading segments... Aug 28 09:02:18.699661696 (15h23m41.929147053s) [upload=15948]: Got next segment. Inline: true Aug 28 09:02:18.699667407 (15h23m41.929152814s) [upload=15948]: Waiting for error group managing segments... Aug 28 09:02:18.699730346 (15h23m41.929215693s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:02:18.699738331 (15h23m41.929223678s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:02:18.699742468 (15h23m41.929227826s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:02:18.702348129 (15h23m41.931833486s) [upload=15948]: Done uploading segments... Aug 28 09:02:18.702355443 (15h23m41.931840801s) [upload=15948]: Upload finished. err: metaclient: Too Many Requests
Duration: 526.421964ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X..............X.......................................] duration:
755.002879ms
FAIL (2025-08-28 09:08:25 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 28 08:38:37.128306418 (15h0m0.357791765s) [upload=15529]: Starting upload
Aug 28 08:38:37.128360960 (15h0m0.357846337s) [upload=15529]: Done starting upload
Aug 28 08:38:37.128467872 (15h0m0.357953229s) [upload=15529]: Uploading segments...
Aug 28 08:38:37.128594138 (15h0m0.358079495s) [upload=15529]: Got next segment. Inline: false
Aug 28 08:38:37.128626190 (15h0m0.358111547s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 08:38:37.128629987 (15h0m0.358115344s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 08:38:37.159496629 (15h0m0.388981986s) [seg_pos={0 0}, upload=15529]: Begin upload segment...
Aug 28 08:38:37.159526065 (15h0m0.389011422s) [seg_pos={0 0}, upload=15529]: Done begin upload segment.
Aug 28 08:38:37.159544059 (15h0m0.389029405s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159555029 (15h0m0.389040386s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159875983 (15h0m0.38936136s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159904587 (15h0m0.389389934s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160272919 (15h0m0.389758276s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160280884 (15h0m0.389766242s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160535985 (15h0m0.390021342s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160629981 (15h0m0.390115338s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160761228 (15h0m0.390246585s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160977334 (15h0m0.390462691s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161002733 (15h0m0.39048808s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161239779 (15h0m0.390725136s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161300903 (15h0m0.39078625s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161464060 (15h0m0.390949417s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161574097 (15h0m0.391059455s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161686059 (15h0m0.391171406s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161857702 (15h0m0.391343049s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161951357 (15h0m0.391436705s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.244154623 (15h0m0.47363998s) [upload=15529]: Next returned nil segment
Aug 28 08:38:37.244168008 (15h0m0.473653365s) [upload=15529]: Waiting for error group managing segments...
Aug 28 08:38:37.251633303 (15h0m0.481118651s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.252355692 (15h0m0.48184104s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253551001 (15h0m0.483036348s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253716342 (15h0m0.483201699s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253854362 (15h0m0.483339699s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254242262 (15h0m0.483727619s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254362789 (15h0m0.483848136s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254648477 (15h0m0.484133824s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.255754988 (15h0m0.485240345s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.260723024 (15h0m0.490208372s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.263272761 (15h0m0.492758118s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272821166 (15h0m0.502306513s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272952033 (15h0m0.5024374s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.273973004 (15h0m0.503458361s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.274003461 (15h0m0.503488818s) [seg_pos={0 0}, upload=15529]: Segment reached optimal threshold of 14 pieces.
Aug 28 08:38:37.274302303 (15h0m0.50378765s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1diUU2skKzXPjYy3Mu3iDDjnG5W8Z2cxCRMxDCH9cQGg2TdEiR): protocol: read tcp 5.161.89.252:10072->64.49.13.140:4508: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274341226 (15h0m0.503826583s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J4nbkWW5oM17EbRwB53vgPzEiK8dEXM2tR2TWGhJFqEja9RHi): protocol: read tcp 5.161.89.252:15990->64.49.13.154:4936: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274374699 (15h0m0.503860056s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: read tcp 5.161.89.252:15186->79.127.201.215:4348: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274501718 (15h0m0.503987085s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cYp95Dbq7byUc8cN7dF73sUBJEDnyJLDAVozb5jdz3wACLUXQ): protocol: read tcp 5.161.89.252:12078->79.127.205.245:4252: use of closed network connection; context canceled
Aug 28 08:38:37.274529791 (15h0m0.504015168s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 08:38:37.274605384 (15h0m0.504090751s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 08:38:37.274610052 (15h0m0.50409542s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 08:38:37.327657525 (15h0m0.557142902s) [upload=15529]: Done uploading segments...
Aug 28 08:38:37.327676731 (15h0m0.557162108s) [upload=15529]: Upload finished. err: <nil>
Duration: 755.025502ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............X........................................X......] duration:
126.79711ms
FAIL (2025-08-28 09:08:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:02:18.699494201 (15h23m41.928979558s) [upload=15948]: Starting upload Aug 28 09:02:18.699566588 (15h23m41.929051945s) [upload=15948]: Done starting upload Aug 28 09:02:18.699621431 (15h23m41.929106788s) [upload=15948]: Uploading segments... Aug 28 09:02:18.699661696 (15h23m41.929147053s) [upload=15948]: Got next segment. Inline: true Aug 28 09:02:18.699667407 (15h23m41.929152814s) [upload=15948]: Waiting for error group managing segments... Aug 28 09:02:18.699730346 (15h23m41.929215693s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:02:18.699738331 (15h23m41.929223678s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:02:18.699742468 (15h23m41.929227826s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:02:18.702348129 (15h23m41.931833486s) [upload=15948]: Done uploading segments... Aug 28 09:02:18.702355443 (15h23m41.931840801s) [upload=15948]: Upload finished. err: metaclient: Too Many Requests
Duration: 126.817008ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X..............X......................................] duration:
423.413007ms
FAIL (2025-08-28 09:07:11 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 28 08:38:37.128306418 (15h0m0.357791765s) [upload=15529]: Starting upload
Aug 28 08:38:37.128360960 (15h0m0.357846337s) [upload=15529]: Done starting upload
Aug 28 08:38:37.128467872 (15h0m0.357953229s) [upload=15529]: Uploading segments...
Aug 28 08:38:37.128594138 (15h0m0.358079495s) [upload=15529]: Got next segment. Inline: false
Aug 28 08:38:37.128626190 (15h0m0.358111547s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 08:38:37.128629987 (15h0m0.358115344s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 08:38:37.159496629 (15h0m0.388981986s) [seg_pos={0 0}, upload=15529]: Begin upload segment...
Aug 28 08:38:37.159526065 (15h0m0.389011422s) [seg_pos={0 0}, upload=15529]: Done begin upload segment.
Aug 28 08:38:37.159544059 (15h0m0.389029405s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159555029 (15h0m0.389040386s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159875983 (15h0m0.38936136s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159904587 (15h0m0.389389934s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160272919 (15h0m0.389758276s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160280884 (15h0m0.389766242s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160535985 (15h0m0.390021342s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160629981 (15h0m0.390115338s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160761228 (15h0m0.390246585s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160977334 (15h0m0.390462691s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161002733 (15h0m0.39048808s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161239779 (15h0m0.390725136s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161300903 (15h0m0.39078625s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161464060 (15h0m0.390949417s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161574097 (15h0m0.391059455s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161686059 (15h0m0.391171406s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161857702 (15h0m0.391343049s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161951357 (15h0m0.391436705s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.244154623 (15h0m0.47363998s) [upload=15529]: Next returned nil segment
Aug 28 08:38:37.244168008 (15h0m0.473653365s) [upload=15529]: Waiting for error group managing segments...
Aug 28 08:38:37.251633303 (15h0m0.481118651s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.252355692 (15h0m0.48184104s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253551001 (15h0m0.483036348s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253716342 (15h0m0.483201699s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253854362 (15h0m0.483339699s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254242262 (15h0m0.483727619s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254362789 (15h0m0.483848136s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254648477 (15h0m0.484133824s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.255754988 (15h0m0.485240345s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.260723024 (15h0m0.490208372s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.263272761 (15h0m0.492758118s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272821166 (15h0m0.502306513s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272952033 (15h0m0.5024374s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.273973004 (15h0m0.503458361s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.274003461 (15h0m0.503488818s) [seg_pos={0 0}, upload=15529]: Segment reached optimal threshold of 14 pieces.
Aug 28 08:38:37.274302303 (15h0m0.50378765s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1diUU2skKzXPjYy3Mu3iDDjnG5W8Z2cxCRMxDCH9cQGg2TdEiR): protocol: read tcp 5.161.89.252:10072->64.49.13.140:4508: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274341226 (15h0m0.503826583s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J4nbkWW5oM17EbRwB53vgPzEiK8dEXM2tR2TWGhJFqEja9RHi): protocol: read tcp 5.161.89.252:15990->64.49.13.154:4936: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274374699 (15h0m0.503860056s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: read tcp 5.161.89.252:15186->79.127.201.215:4348: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274501718 (15h0m0.503987085s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cYp95Dbq7byUc8cN7dF73sUBJEDnyJLDAVozb5jdz3wACLUXQ): protocol: read tcp 5.161.89.252:12078->79.127.205.245:4252: use of closed network connection; context canceled
Aug 28 08:38:37.274529791 (15h0m0.504015168s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 08:38:37.274605384 (15h0m0.504090751s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 08:38:37.274610052 (15h0m0.50409542s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 08:38:37.327657525 (15h0m0.557142902s) [upload=15529]: Done uploading segments...
Aug 28 08:38:37.327676731 (15h0m0.557162108s) [upload=15529]: Upload finished. err: <nil>
Duration: 423.435719ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............X........................................X.....] duration:
164.047315ms
FAIL (2025-08-28 09:07:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:02:18.699494201 (15h23m41.928979558s) [upload=15948]: Starting upload Aug 28 09:02:18.699566588 (15h23m41.929051945s) [upload=15948]: Done starting upload Aug 28 09:02:18.699621431 (15h23m41.929106788s) [upload=15948]: Uploading segments... Aug 28 09:02:18.699661696 (15h23m41.929147053s) [upload=15948]: Got next segment. Inline: true Aug 28 09:02:18.699667407 (15h23m41.929152814s) [upload=15948]: Waiting for error group managing segments... Aug 28 09:02:18.699730346 (15h23m41.929215693s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:02:18.699738331 (15h23m41.929223678s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:02:18.699742468 (15h23m41.929227826s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:02:18.702348129 (15h23m41.931833486s) [upload=15948]: Done uploading segments... Aug 28 09:02:18.702355443 (15h23m41.931840801s) [upload=15948]: Upload finished. err: metaclient: Too Many Requests
Duration: 164.078554ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X..............X.....................................] duration:
420.199405ms
FAIL (2025-08-28 09:06:28 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 28 08:38:37.128306418 (15h0m0.357791765s) [upload=15529]: Starting upload
Aug 28 08:38:37.128360960 (15h0m0.357846337s) [upload=15529]: Done starting upload
Aug 28 08:38:37.128467872 (15h0m0.357953229s) [upload=15529]: Uploading segments...
Aug 28 08:38:37.128594138 (15h0m0.358079495s) [upload=15529]: Got next segment. Inline: false
Aug 28 08:38:37.128626190 (15h0m0.358111547s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 08:38:37.128629987 (15h0m0.358115344s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 08:38:37.159496629 (15h0m0.388981986s) [seg_pos={0 0}, upload=15529]: Begin upload segment...
Aug 28 08:38:37.159526065 (15h0m0.389011422s) [seg_pos={0 0}, upload=15529]: Done begin upload segment.
Aug 28 08:38:37.159544059 (15h0m0.389029405s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159555029 (15h0m0.389040386s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159875983 (15h0m0.38936136s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159904587 (15h0m0.389389934s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160272919 (15h0m0.389758276s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160280884 (15h0m0.389766242s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160535985 (15h0m0.390021342s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160629981 (15h0m0.390115338s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160761228 (15h0m0.390246585s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160977334 (15h0m0.390462691s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161002733 (15h0m0.39048808s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161239779 (15h0m0.390725136s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161300903 (15h0m0.39078625s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161464060 (15h0m0.390949417s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161574097 (15h0m0.391059455s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161686059 (15h0m0.391171406s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161857702 (15h0m0.391343049s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161951357 (15h0m0.391436705s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.244154623 (15h0m0.47363998s) [upload=15529]: Next returned nil segment
Aug 28 08:38:37.244168008 (15h0m0.473653365s) [upload=15529]: Waiting for error group managing segments...
Aug 28 08:38:37.251633303 (15h0m0.481118651s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.252355692 (15h0m0.48184104s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253551001 (15h0m0.483036348s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253716342 (15h0m0.483201699s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253854362 (15h0m0.483339699s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254242262 (15h0m0.483727619s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254362789 (15h0m0.483848136s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254648477 (15h0m0.484133824s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.255754988 (15h0m0.485240345s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.260723024 (15h0m0.490208372s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.263272761 (15h0m0.492758118s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272821166 (15h0m0.502306513s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272952033 (15h0m0.5024374s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.273973004 (15h0m0.503458361s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.274003461 (15h0m0.503488818s) [seg_pos={0 0}, upload=15529]: Segment reached optimal threshold of 14 pieces.
Aug 28 08:38:37.274302303 (15h0m0.50378765s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1diUU2skKzXPjYy3Mu3iDDjnG5W8Z2cxCRMxDCH9cQGg2TdEiR): protocol: read tcp 5.161.89.252:10072->64.49.13.140:4508: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274341226 (15h0m0.503826583s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J4nbkWW5oM17EbRwB53vgPzEiK8dEXM2tR2TWGhJFqEja9RHi): protocol: read tcp 5.161.89.252:15990->64.49.13.154:4936: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274374699 (15h0m0.503860056s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: read tcp 5.161.89.252:15186->79.127.201.215:4348: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274501718 (15h0m0.503987085s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cYp95Dbq7byUc8cN7dF73sUBJEDnyJLDAVozb5jdz3wACLUXQ): protocol: read tcp 5.161.89.252:12078->79.127.205.245:4252: use of closed network connection; context canceled
Aug 28 08:38:37.274529791 (15h0m0.504015168s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 08:38:37.274605384 (15h0m0.504090751s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 08:38:37.274610052 (15h0m0.50409542s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 08:38:37.327657525 (15h0m0.557142902s) [upload=15529]: Done uploading segments...
Aug 28 08:38:37.327676731 (15h0m0.557162108s) [upload=15529]: Upload finished. err: <nil>
Duration: 420.220746ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............X........................................X....] duration:
150.580358ms
FAIL (2025-08-28 09:06:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:02:18.699494201 (15h23m41.928979558s) [upload=15948]: Starting upload Aug 28 09:02:18.699566588 (15h23m41.929051945s) [upload=15948]: Done starting upload Aug 28 09:02:18.699621431 (15h23m41.929106788s) [upload=15948]: Uploading segments... Aug 28 09:02:18.699661696 (15h23m41.929147053s) [upload=15948]: Got next segment. Inline: true Aug 28 09:02:18.699667407 (15h23m41.929152814s) [upload=15948]: Waiting for error group managing segments... Aug 28 09:02:18.699730346 (15h23m41.929215693s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:02:18.699738331 (15h23m41.929223678s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:02:18.699742468 (15h23m41.929227826s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:02:18.702348129 (15h23m41.931833486s) [upload=15948]: Done uploading segments... Aug 28 09:02:18.702355443 (15h23m41.931840801s) [upload=15948]: Upload finished. err: metaclient: Too Many Requests
Duration: 150.59715ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X..............X....................................] duration:
1.135791166s
FAIL (2025-08-28 09:05:59 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 28 08:38:37.128306418 (15h0m0.357791765s) [upload=15529]: Starting upload
Aug 28 08:38:37.128360960 (15h0m0.357846337s) [upload=15529]: Done starting upload
Aug 28 08:38:37.128467872 (15h0m0.357953229s) [upload=15529]: Uploading segments...
Aug 28 08:38:37.128594138 (15h0m0.358079495s) [upload=15529]: Got next segment. Inline: false
Aug 28 08:38:37.128626190 (15h0m0.358111547s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 08:38:37.128629987 (15h0m0.358115344s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 08:38:37.159496629 (15h0m0.388981986s) [seg_pos={0 0}, upload=15529]: Begin upload segment...
Aug 28 08:38:37.159526065 (15h0m0.389011422s) [seg_pos={0 0}, upload=15529]: Done begin upload segment.
Aug 28 08:38:37.159544059 (15h0m0.389029405s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159555029 (15h0m0.389040386s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159875983 (15h0m0.38936136s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159904587 (15h0m0.389389934s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160272919 (15h0m0.389758276s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160280884 (15h0m0.389766242s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160535985 (15h0m0.390021342s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160629981 (15h0m0.390115338s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160761228 (15h0m0.390246585s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160977334 (15h0m0.390462691s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161002733 (15h0m0.39048808s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161239779 (15h0m0.390725136s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161300903 (15h0m0.39078625s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161464060 (15h0m0.390949417s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161574097 (15h0m0.391059455s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161686059 (15h0m0.391171406s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161857702 (15h0m0.391343049s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161951357 (15h0m0.391436705s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.244154623 (15h0m0.47363998s) [upload=15529]: Next returned nil segment
Aug 28 08:38:37.244168008 (15h0m0.473653365s) [upload=15529]: Waiting for error group managing segments...
Aug 28 08:38:37.251633303 (15h0m0.481118651s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.252355692 (15h0m0.48184104s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253551001 (15h0m0.483036348s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253716342 (15h0m0.483201699s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253854362 (15h0m0.483339699s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254242262 (15h0m0.483727619s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254362789 (15h0m0.483848136s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254648477 (15h0m0.484133824s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.255754988 (15h0m0.485240345s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.260723024 (15h0m0.490208372s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.263272761 (15h0m0.492758118s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272821166 (15h0m0.502306513s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272952033 (15h0m0.5024374s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.273973004 (15h0m0.503458361s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.274003461 (15h0m0.503488818s) [seg_pos={0 0}, upload=15529]: Segment reached optimal threshold of 14 pieces.
Aug 28 08:38:37.274302303 (15h0m0.50378765s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1diUU2skKzXPjYy3Mu3iDDjnG5W8Z2cxCRMxDCH9cQGg2TdEiR): protocol: read tcp 5.161.89.252:10072->64.49.13.140:4508: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274341226 (15h0m0.503826583s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J4nbkWW5oM17EbRwB53vgPzEiK8dEXM2tR2TWGhJFqEja9RHi): protocol: read tcp 5.161.89.252:15990->64.49.13.154:4936: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274374699 (15h0m0.503860056s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: read tcp 5.161.89.252:15186->79.127.201.215:4348: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274501718 (15h0m0.503987085s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cYp95Dbq7byUc8cN7dF73sUBJEDnyJLDAVozb5jdz3wACLUXQ): protocol: read tcp 5.161.89.252:12078->79.127.205.245:4252: use of closed network connection; context canceled
Aug 28 08:38:37.274529791 (15h0m0.504015168s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 08:38:37.274605384 (15h0m0.504090751s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 08:38:37.274610052 (15h0m0.50409542s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 08:38:37.327657525 (15h0m0.557142902s) [upload=15529]: Done uploading segments...
Aug 28 08:38:37.327676731 (15h0m0.557162108s) [upload=15529]: Upload finished. err: <nil>
Duration: 1.135825221s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............X........................................X...] duration:
838.271167ms
FAIL (2025-08-28 09:05:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:02:18.699494201 (15h23m41.928979558s) [upload=15948]: Starting upload Aug 28 09:02:18.699566588 (15h23m41.929051945s) [upload=15948]: Done starting upload Aug 28 09:02:18.699621431 (15h23m41.929106788s) [upload=15948]: Uploading segments... Aug 28 09:02:18.699661696 (15h23m41.929147053s) [upload=15948]: Got next segment. Inline: true Aug 28 09:02:18.699667407 (15h23m41.929152814s) [upload=15948]: Waiting for error group managing segments... Aug 28 09:02:18.699730346 (15h23m41.929215693s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:02:18.699738331 (15h23m41.929223678s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:02:18.699742468 (15h23m41.929227826s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:02:18.702348129 (15h23m41.931833486s) [upload=15948]: Done uploading segments... Aug 28 09:02:18.702355443 (15h23m41.931840801s) [upload=15948]: Upload finished. err: metaclient: Too Many Requests
Duration: 838.290564ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........X..............X...................................] duration:
419.865375ms
FAIL (2025-08-28 09:05:10 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 28 08:38:37.128306418 (15h0m0.357791765s) [upload=15529]: Starting upload
Aug 28 08:38:37.128360960 (15h0m0.357846337s) [upload=15529]: Done starting upload
Aug 28 08:38:37.128467872 (15h0m0.357953229s) [upload=15529]: Uploading segments...
Aug 28 08:38:37.128594138 (15h0m0.358079495s) [upload=15529]: Got next segment. Inline: false
Aug 28 08:38:37.128626190 (15h0m0.358111547s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 08:38:37.128629987 (15h0m0.358115344s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 08:38:37.159496629 (15h0m0.388981986s) [seg_pos={0 0}, upload=15529]: Begin upload segment...
Aug 28 08:38:37.159526065 (15h0m0.389011422s) [seg_pos={0 0}, upload=15529]: Done begin upload segment.
Aug 28 08:38:37.159544059 (15h0m0.389029405s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159555029 (15h0m0.389040386s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159875983 (15h0m0.38936136s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159904587 (15h0m0.389389934s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160272919 (15h0m0.389758276s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160280884 (15h0m0.389766242s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160535985 (15h0m0.390021342s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160629981 (15h0m0.390115338s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160761228 (15h0m0.390246585s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160977334 (15h0m0.390462691s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161002733 (15h0m0.39048808s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161239779 (15h0m0.390725136s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161300903 (15h0m0.39078625s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161464060 (15h0m0.390949417s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161574097 (15h0m0.391059455s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161686059 (15h0m0.391171406s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161857702 (15h0m0.391343049s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161951357 (15h0m0.391436705s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.244154623 (15h0m0.47363998s) [upload=15529]: Next returned nil segment
Aug 28 08:38:37.244168008 (15h0m0.473653365s) [upload=15529]: Waiting for error group managing segments...
Aug 28 08:38:37.251633303 (15h0m0.481118651s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.252355692 (15h0m0.48184104s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253551001 (15h0m0.483036348s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253716342 (15h0m0.483201699s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253854362 (15h0m0.483339699s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254242262 (15h0m0.483727619s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254362789 (15h0m0.483848136s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254648477 (15h0m0.484133824s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.255754988 (15h0m0.485240345s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.260723024 (15h0m0.490208372s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.263272761 (15h0m0.492758118s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272821166 (15h0m0.502306513s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272952033 (15h0m0.5024374s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.273973004 (15h0m0.503458361s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.274003461 (15h0m0.503488818s) [seg_pos={0 0}, upload=15529]: Segment reached optimal threshold of 14 pieces.
Aug 28 08:38:37.274302303 (15h0m0.50378765s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1diUU2skKzXPjYy3Mu3iDDjnG5W8Z2cxCRMxDCH9cQGg2TdEiR): protocol: read tcp 5.161.89.252:10072->64.49.13.140:4508: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274341226 (15h0m0.503826583s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J4nbkWW5oM17EbRwB53vgPzEiK8dEXM2tR2TWGhJFqEja9RHi): protocol: read tcp 5.161.89.252:15990->64.49.13.154:4936: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274374699 (15h0m0.503860056s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: read tcp 5.161.89.252:15186->79.127.201.215:4348: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274501718 (15h0m0.503987085s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cYp95Dbq7byUc8cN7dF73sUBJEDnyJLDAVozb5jdz3wACLUXQ): protocol: read tcp 5.161.89.252:12078->79.127.205.245:4252: use of closed network connection; context canceled
Aug 28 08:38:37.274529791 (15h0m0.504015168s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 08:38:37.274605384 (15h0m0.504090751s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 08:38:37.274610052 (15h0m0.50409542s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 08:38:37.327657525 (15h0m0.557142902s) [upload=15529]: Done uploading segments...
Aug 28 08:38:37.327676731 (15h0m0.557162108s) [upload=15529]: Upload finished. err: <nil>
Duration: 419.895743ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........X..............X..................................] duration:
323.794479ms
FAIL (2025-08-28 09:04:28 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 28 08:38:37.128306418 (15h0m0.357791765s) [upload=15529]: Starting upload
Aug 28 08:38:37.128360960 (15h0m0.357846337s) [upload=15529]: Done starting upload
Aug 28 08:38:37.128467872 (15h0m0.357953229s) [upload=15529]: Uploading segments...
Aug 28 08:38:37.128594138 (15h0m0.358079495s) [upload=15529]: Got next segment. Inline: false
Aug 28 08:38:37.128626190 (15h0m0.358111547s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 08:38:37.128629987 (15h0m0.358115344s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 08:38:37.159496629 (15h0m0.388981986s) [seg_pos={0 0}, upload=15529]: Begin upload segment...
Aug 28 08:38:37.159526065 (15h0m0.389011422s) [seg_pos={0 0}, upload=15529]: Done begin upload segment.
Aug 28 08:38:37.159544059 (15h0m0.389029405s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159555029 (15h0m0.389040386s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159875983 (15h0m0.38936136s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159904587 (15h0m0.389389934s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160272919 (15h0m0.389758276s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160280884 (15h0m0.389766242s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160535985 (15h0m0.390021342s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160629981 (15h0m0.390115338s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160761228 (15h0m0.390246585s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160977334 (15h0m0.390462691s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161002733 (15h0m0.39048808s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161239779 (15h0m0.390725136s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161300903 (15h0m0.39078625s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161464060 (15h0m0.390949417s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161574097 (15h0m0.391059455s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161686059 (15h0m0.391171406s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161857702 (15h0m0.391343049s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161951357 (15h0m0.391436705s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.244154623 (15h0m0.47363998s) [upload=15529]: Next returned nil segment
Aug 28 08:38:37.244168008 (15h0m0.473653365s) [upload=15529]: Waiting for error group managing segments...
Aug 28 08:38:37.251633303 (15h0m0.481118651s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.252355692 (15h0m0.48184104s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253551001 (15h0m0.483036348s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253716342 (15h0m0.483201699s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253854362 (15h0m0.483339699s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254242262 (15h0m0.483727619s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254362789 (15h0m0.483848136s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254648477 (15h0m0.484133824s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.255754988 (15h0m0.485240345s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.260723024 (15h0m0.490208372s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.263272761 (15h0m0.492758118s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272821166 (15h0m0.502306513s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272952033 (15h0m0.5024374s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.273973004 (15h0m0.503458361s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.274003461 (15h0m0.503488818s) [seg_pos={0 0}, upload=15529]: Segment reached optimal threshold of 14 pieces.
Aug 28 08:38:37.274302303 (15h0m0.50378765s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1diUU2skKzXPjYy3Mu3iDDjnG5W8Z2cxCRMxDCH9cQGg2TdEiR): protocol: read tcp 5.161.89.252:10072->64.49.13.140:4508: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274341226 (15h0m0.503826583s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J4nbkWW5oM17EbRwB53vgPzEiK8dEXM2tR2TWGhJFqEja9RHi): protocol: read tcp 5.161.89.252:15990->64.49.13.154:4936: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274374699 (15h0m0.503860056s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: read tcp 5.161.89.252:15186->79.127.201.215:4348: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274501718 (15h0m0.503987085s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cYp95Dbq7byUc8cN7dF73sUBJEDnyJLDAVozb5jdz3wACLUXQ): protocol: read tcp 5.161.89.252:12078->79.127.205.245:4252: use of closed network connection; context canceled
Aug 28 08:38:37.274529791 (15h0m0.504015168s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 08:38:37.274605384 (15h0m0.504090751s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 08:38:37.274610052 (15h0m0.50409542s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 08:38:37.327657525 (15h0m0.557142902s) [upload=15529]: Done uploading segments...
Aug 28 08:38:37.327676731 (15h0m0.557162108s) [upload=15529]: Upload finished. err: <nil>
Duration: 323.813574ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................X........................................X..] duration:
116.466371ms
FAIL (2025-08-28 09:04:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:02:18.699494201 (15h23m41.928979558s) [upload=15948]: Starting upload Aug 28 09:02:18.699566588 (15h23m41.929051945s) [upload=15948]: Done starting upload Aug 28 09:02:18.699621431 (15h23m41.929106788s) [upload=15948]: Uploading segments... Aug 28 09:02:18.699661696 (15h23m41.929147053s) [upload=15948]: Got next segment. Inline: true Aug 28 09:02:18.699667407 (15h23m41.929152814s) [upload=15948]: Waiting for error group managing segments... Aug 28 09:02:18.699730346 (15h23m41.929215693s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:02:18.699738331 (15h23m41.929223678s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:02:18.699742468 (15h23m41.929227826s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:02:18.702348129 (15h23m41.931833486s) [upload=15948]: Done uploading segments... Aug 28 09:02:18.702355443 (15h23m41.931840801s) [upload=15948]: Upload finished. err: metaclient: Too Many Requests
Duration: 116.490596ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................X........................................X.] duration:
121.60151ms
FAIL (2025-08-28 09:03:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:02:18.699494201 (15h23m41.928979558s) [upload=15948]: Starting upload Aug 28 09:02:18.699566588 (15h23m41.929051945s) [upload=15948]: Done starting upload Aug 28 09:02:18.699621431 (15h23m41.929106788s) [upload=15948]: Uploading segments... Aug 28 09:02:18.699661696 (15h23m41.929147053s) [upload=15948]: Got next segment. Inline: true Aug 28 09:02:18.699667407 (15h23m41.929152814s) [upload=15948]: Waiting for error group managing segments... Aug 28 09:02:18.699730346 (15h23m41.929215693s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:02:18.699738331 (15h23m41.929223678s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:02:18.699742468 (15h23m41.929227826s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:02:18.702348129 (15h23m41.931833486s) [upload=15948]: Done uploading segments... Aug 28 09:02:18.702355443 (15h23m41.931840801s) [upload=15948]: Upload finished. err: metaclient: Too Many Requests
Duration: 121.645143ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........X..............X.................................] duration:
503.046498ms
FAIL (2025-08-28 09:03:20 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 28 08:38:37.128306418 (15h0m0.357791765s) [upload=15529]: Starting upload
Aug 28 08:38:37.128360960 (15h0m0.357846337s) [upload=15529]: Done starting upload
Aug 28 08:38:37.128467872 (15h0m0.357953229s) [upload=15529]: Uploading segments...
Aug 28 08:38:37.128594138 (15h0m0.358079495s) [upload=15529]: Got next segment. Inline: false
Aug 28 08:38:37.128626190 (15h0m0.358111547s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 08:38:37.128629987 (15h0m0.358115344s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 08:38:37.159496629 (15h0m0.388981986s) [seg_pos={0 0}, upload=15529]: Begin upload segment...
Aug 28 08:38:37.159526065 (15h0m0.389011422s) [seg_pos={0 0}, upload=15529]: Done begin upload segment.
Aug 28 08:38:37.159544059 (15h0m0.389029405s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159555029 (15h0m0.389040386s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159875983 (15h0m0.38936136s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159904587 (15h0m0.389389934s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160272919 (15h0m0.389758276s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160280884 (15h0m0.389766242s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160535985 (15h0m0.390021342s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160629981 (15h0m0.390115338s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160761228 (15h0m0.390246585s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160977334 (15h0m0.390462691s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161002733 (15h0m0.39048808s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161239779 (15h0m0.390725136s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161300903 (15h0m0.39078625s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161464060 (15h0m0.390949417s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161574097 (15h0m0.391059455s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161686059 (15h0m0.391171406s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161857702 (15h0m0.391343049s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161951357 (15h0m0.391436705s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.244154623 (15h0m0.47363998s) [upload=15529]: Next returned nil segment
Aug 28 08:38:37.244168008 (15h0m0.473653365s) [upload=15529]: Waiting for error group managing segments...
Aug 28 08:38:37.251633303 (15h0m0.481118651s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.252355692 (15h0m0.48184104s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253551001 (15h0m0.483036348s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253716342 (15h0m0.483201699s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253854362 (15h0m0.483339699s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254242262 (15h0m0.483727619s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254362789 (15h0m0.483848136s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254648477 (15h0m0.484133824s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.255754988 (15h0m0.485240345s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.260723024 (15h0m0.490208372s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.263272761 (15h0m0.492758118s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272821166 (15h0m0.502306513s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272952033 (15h0m0.5024374s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.273973004 (15h0m0.503458361s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.274003461 (15h0m0.503488818s) [seg_pos={0 0}, upload=15529]: Segment reached optimal threshold of 14 pieces.
Aug 28 08:38:37.274302303 (15h0m0.50378765s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1diUU2skKzXPjYy3Mu3iDDjnG5W8Z2cxCRMxDCH9cQGg2TdEiR): protocol: read tcp 5.161.89.252:10072->64.49.13.140:4508: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274341226 (15h0m0.503826583s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J4nbkWW5oM17EbRwB53vgPzEiK8dEXM2tR2TWGhJFqEja9RHi): protocol: read tcp 5.161.89.252:15990->64.49.13.154:4936: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274374699 (15h0m0.503860056s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: read tcp 5.161.89.252:15186->79.127.201.215:4348: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274501718 (15h0m0.503987085s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cYp95Dbq7byUc8cN7dF73sUBJEDnyJLDAVozb5jdz3wACLUXQ): protocol: read tcp 5.161.89.252:12078->79.127.205.245:4252: use of closed network connection; context canceled
Aug 28 08:38:37.274529791 (15h0m0.504015168s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 08:38:37.274605384 (15h0m0.504090751s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 08:38:37.274610052 (15h0m0.50409542s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 08:38:37.327657525 (15h0m0.557142902s) [upload=15529]: Done uploading segments...
Aug 28 08:38:37.327676731 (15h0m0.557162108s) [upload=15529]: Upload finished. err: <nil>
Duration: 503.076825ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............X..............X................................] duration:
358.725823ms
FAIL (2025-08-28 09:03:01 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 28 08:38:37.128306418 (15h0m0.357791765s) [upload=15529]: Starting upload
Aug 28 08:38:37.128360960 (15h0m0.357846337s) [upload=15529]: Done starting upload
Aug 28 08:38:37.128467872 (15h0m0.357953229s) [upload=15529]: Uploading segments...
Aug 28 08:38:37.128594138 (15h0m0.358079495s) [upload=15529]: Got next segment. Inline: false
Aug 28 08:38:37.128626190 (15h0m0.358111547s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 08:38:37.128629987 (15h0m0.358115344s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 08:38:37.159496629 (15h0m0.388981986s) [seg_pos={0 0}, upload=15529]: Begin upload segment...
Aug 28 08:38:37.159526065 (15h0m0.389011422s) [seg_pos={0 0}, upload=15529]: Done begin upload segment.
Aug 28 08:38:37.159544059 (15h0m0.389029405s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159555029 (15h0m0.389040386s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159875983 (15h0m0.38936136s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159904587 (15h0m0.389389934s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160272919 (15h0m0.389758276s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160280884 (15h0m0.389766242s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160535985 (15h0m0.390021342s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160629981 (15h0m0.390115338s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160761228 (15h0m0.390246585s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160977334 (15h0m0.390462691s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161002733 (15h0m0.39048808s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161239779 (15h0m0.390725136s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161300903 (15h0m0.39078625s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161464060 (15h0m0.390949417s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161574097 (15h0m0.391059455s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161686059 (15h0m0.391171406s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161857702 (15h0m0.391343049s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161951357 (15h0m0.391436705s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.244154623 (15h0m0.47363998s) [upload=15529]: Next returned nil segment
Aug 28 08:38:37.244168008 (15h0m0.473653365s) [upload=15529]: Waiting for error group managing segments...
Aug 28 08:38:37.251633303 (15h0m0.481118651s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.252355692 (15h0m0.48184104s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253551001 (15h0m0.483036348s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253716342 (15h0m0.483201699s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253854362 (15h0m0.483339699s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254242262 (15h0m0.483727619s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254362789 (15h0m0.483848136s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254648477 (15h0m0.484133824s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.255754988 (15h0m0.485240345s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.260723024 (15h0m0.490208372s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.263272761 (15h0m0.492758118s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272821166 (15h0m0.502306513s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272952033 (15h0m0.5024374s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.273973004 (15h0m0.503458361s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.274003461 (15h0m0.503488818s) [seg_pos={0 0}, upload=15529]: Segment reached optimal threshold of 14 pieces.
Aug 28 08:38:37.274302303 (15h0m0.50378765s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1diUU2skKzXPjYy3Mu3iDDjnG5W8Z2cxCRMxDCH9cQGg2TdEiR): protocol: read tcp 5.161.89.252:10072->64.49.13.140:4508: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274341226 (15h0m0.503826583s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J4nbkWW5oM17EbRwB53vgPzEiK8dEXM2tR2TWGhJFqEja9RHi): protocol: read tcp 5.161.89.252:15990->64.49.13.154:4936: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274374699 (15h0m0.503860056s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: read tcp 5.161.89.252:15186->79.127.201.215:4348: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274501718 (15h0m0.503987085s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cYp95Dbq7byUc8cN7dF73sUBJEDnyJLDAVozb5jdz3wACLUXQ): protocol: read tcp 5.161.89.252:12078->79.127.205.245:4252: use of closed network connection; context canceled
Aug 28 08:38:37.274529791 (15h0m0.504015168s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 08:38:37.274605384 (15h0m0.504090751s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 08:38:37.274610052 (15h0m0.50409542s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 08:38:37.327657525 (15h0m0.557142902s) [upload=15529]: Done uploading segments...
Aug 28 08:38:37.327676731 (15h0m0.557162108s) [upload=15529]: Upload finished. err: <nil>
Duration: 358.766019ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............X..............X...............................] duration:
830.199113ms
FAIL (2025-08-28 09:02:31 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 28 08:38:37.128306418 (15h0m0.357791765s) [upload=15529]: Starting upload
Aug 28 08:38:37.128360960 (15h0m0.357846337s) [upload=15529]: Done starting upload
Aug 28 08:38:37.128467872 (15h0m0.357953229s) [upload=15529]: Uploading segments...
Aug 28 08:38:37.128594138 (15h0m0.358079495s) [upload=15529]: Got next segment. Inline: false
Aug 28 08:38:37.128626190 (15h0m0.358111547s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 08:38:37.128629987 (15h0m0.358115344s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 08:38:37.159496629 (15h0m0.388981986s) [seg_pos={0 0}, upload=15529]: Begin upload segment...
Aug 28 08:38:37.159526065 (15h0m0.389011422s) [seg_pos={0 0}, upload=15529]: Done begin upload segment.
Aug 28 08:38:37.159544059 (15h0m0.389029405s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159555029 (15h0m0.389040386s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159875983 (15h0m0.38936136s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159904587 (15h0m0.389389934s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160272919 (15h0m0.389758276s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160280884 (15h0m0.389766242s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160535985 (15h0m0.390021342s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160629981 (15h0m0.390115338s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160761228 (15h0m0.390246585s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160977334 (15h0m0.390462691s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161002733 (15h0m0.39048808s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161239779 (15h0m0.390725136s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161300903 (15h0m0.39078625s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161464060 (15h0m0.390949417s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161574097 (15h0m0.391059455s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161686059 (15h0m0.391171406s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161857702 (15h0m0.391343049s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161951357 (15h0m0.391436705s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.244154623 (15h0m0.47363998s) [upload=15529]: Next returned nil segment
Aug 28 08:38:37.244168008 (15h0m0.473653365s) [upload=15529]: Waiting for error group managing segments...
Aug 28 08:38:37.251633303 (15h0m0.481118651s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.252355692 (15h0m0.48184104s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253551001 (15h0m0.483036348s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253716342 (15h0m0.483201699s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253854362 (15h0m0.483339699s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254242262 (15h0m0.483727619s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254362789 (15h0m0.483848136s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254648477 (15h0m0.484133824s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.255754988 (15h0m0.485240345s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.260723024 (15h0m0.490208372s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.263272761 (15h0m0.492758118s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272821166 (15h0m0.502306513s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272952033 (15h0m0.5024374s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.273973004 (15h0m0.503458361s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.274003461 (15h0m0.503488818s) [seg_pos={0 0}, upload=15529]: Segment reached optimal threshold of 14 pieces.
Aug 28 08:38:37.274302303 (15h0m0.50378765s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1diUU2skKzXPjYy3Mu3iDDjnG5W8Z2cxCRMxDCH9cQGg2TdEiR): protocol: read tcp 5.161.89.252:10072->64.49.13.140:4508: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274341226 (15h0m0.503826583s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J4nbkWW5oM17EbRwB53vgPzEiK8dEXM2tR2TWGhJFqEja9RHi): protocol: read tcp 5.161.89.252:15990->64.49.13.154:4936: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274374699 (15h0m0.503860056s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: read tcp 5.161.89.252:15186->79.127.201.215:4348: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274501718 (15h0m0.503987085s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cYp95Dbq7byUc8cN7dF73sUBJEDnyJLDAVozb5jdz3wACLUXQ): protocol: read tcp 5.161.89.252:12078->79.127.205.245:4252: use of closed network connection; context canceled
Aug 28 08:38:37.274529791 (15h0m0.504015168s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 08:38:37.274605384 (15h0m0.504090751s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 08:38:37.274610052 (15h0m0.50409542s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 08:38:37.327657525 (15h0m0.557142902s) [upload=15529]: Done uploading segments...
Aug 28 08:38:37.327676731 (15h0m0.557162108s) [upload=15529]: Upload finished. err: <nil>
Duration: 830.224621ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................X........................................X] duration:
15.982373ms
FAIL (2025-08-28 09:02:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:02:18.699494201 (15h23m41.928979558s) [upload=15948]: Starting upload Aug 28 09:02:18.699566588 (15h23m41.929051945s) [upload=15948]: Done starting upload Aug 28 09:02:18.699621431 (15h23m41.929106788s) [upload=15948]: Uploading segments... Aug 28 09:02:18.699661696 (15h23m41.929147053s) [upload=15948]: Got next segment. Inline: true Aug 28 09:02:18.699667407 (15h23m41.929152814s) [upload=15948]: Waiting for error group managing segments... Aug 28 09:02:18.699730346 (15h23m41.929215693s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:02:18.699738331 (15h23m41.929223678s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:02:18.699742468 (15h23m41.929227826s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:02:18.702348129 (15h23m41.931833486s) [upload=15948]: Done uploading segments... Aug 28 09:02:18.702355443 (15h23m41.931840801s) [upload=15948]: Upload finished. err: metaclient: Too Many Requests
Duration: 16.002751ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
128.857106ms
FAIL (2025-08-28 09:01:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 08:34:49.327034091 (14h56m12.556519468s) [upload=15466]: Starting upload Aug 28 08:34:49.327164217 (14h56m12.556649593s) [upload=15466]: Done starting upload Aug 28 08:34:49.327228587 (14h56m12.556713944s) [upload=15466]: Uploading segments... Aug 28 08:34:49.327297758 (14h56m12.556783105s) [upload=15466]: Got next segment. Inline: true Aug 28 08:34:49.327304130 (14h56m12.556789487s) [upload=15466]: Waiting for error group managing segments... Aug 28 08:34:49.327343594 (14h56m12.556828951s) [upload=15466]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 08:34:49.327347441 (14h56m12.556832798s) [upload=15466]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 08:34:49.327349995 (14h56m12.556835352s) [upload=15466]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 08:34:49.376506477 (14h56m12.605991855s) [upload=15466]: Done uploading segments... Aug 28 08:34:49.376524523 (14h56m12.606009899s) [upload=15466]: Upload finished. err: metaclient: Too Many Requests
Duration: 128.882043ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............X..............X..............................] duration:
327.818108ms
FAIL (2025-08-28 09:01:27 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 28 08:38:37.128306418 (15h0m0.357791765s) [upload=15529]: Starting upload
Aug 28 08:38:37.128360960 (15h0m0.357846337s) [upload=15529]: Done starting upload
Aug 28 08:38:37.128467872 (15h0m0.357953229s) [upload=15529]: Uploading segments...
Aug 28 08:38:37.128594138 (15h0m0.358079495s) [upload=15529]: Got next segment. Inline: false
Aug 28 08:38:37.128626190 (15h0m0.358111547s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 08:38:37.128629987 (15h0m0.358115344s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 08:38:37.159496629 (15h0m0.388981986s) [seg_pos={0 0}, upload=15529]: Begin upload segment...
Aug 28 08:38:37.159526065 (15h0m0.389011422s) [seg_pos={0 0}, upload=15529]: Done begin upload segment.
Aug 28 08:38:37.159544059 (15h0m0.389029405s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159555029 (15h0m0.389040386s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159875983 (15h0m0.38936136s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159904587 (15h0m0.389389934s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160272919 (15h0m0.389758276s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160280884 (15h0m0.389766242s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160535985 (15h0m0.390021342s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160629981 (15h0m0.390115338s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160761228 (15h0m0.390246585s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160977334 (15h0m0.390462691s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161002733 (15h0m0.39048808s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161239779 (15h0m0.390725136s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161300903 (15h0m0.39078625s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161464060 (15h0m0.390949417s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161574097 (15h0m0.391059455s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161686059 (15h0m0.391171406s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161857702 (15h0m0.391343049s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161951357 (15h0m0.391436705s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.244154623 (15h0m0.47363998s) [upload=15529]: Next returned nil segment
Aug 28 08:38:37.244168008 (15h0m0.473653365s) [upload=15529]: Waiting for error group managing segments...
Aug 28 08:38:37.251633303 (15h0m0.481118651s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.252355692 (15h0m0.48184104s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253551001 (15h0m0.483036348s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253716342 (15h0m0.483201699s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253854362 (15h0m0.483339699s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254242262 (15h0m0.483727619s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254362789 (15h0m0.483848136s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254648477 (15h0m0.484133824s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.255754988 (15h0m0.485240345s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.260723024 (15h0m0.490208372s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.263272761 (15h0m0.492758118s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272821166 (15h0m0.502306513s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272952033 (15h0m0.5024374s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.273973004 (15h0m0.503458361s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.274003461 (15h0m0.503488818s) [seg_pos={0 0}, upload=15529]: Segment reached optimal threshold of 14 pieces.
Aug 28 08:38:37.274302303 (15h0m0.50378765s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1diUU2skKzXPjYy3Mu3iDDjnG5W8Z2cxCRMxDCH9cQGg2TdEiR): protocol: read tcp 5.161.89.252:10072->64.49.13.140:4508: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274341226 (15h0m0.503826583s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J4nbkWW5oM17EbRwB53vgPzEiK8dEXM2tR2TWGhJFqEja9RHi): protocol: read tcp 5.161.89.252:15990->64.49.13.154:4936: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274374699 (15h0m0.503860056s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: read tcp 5.161.89.252:15186->79.127.201.215:4348: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274501718 (15h0m0.503987085s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cYp95Dbq7byUc8cN7dF73sUBJEDnyJLDAVozb5jdz3wACLUXQ): protocol: read tcp 5.161.89.252:12078->79.127.205.245:4252: use of closed network connection; context canceled
Aug 28 08:38:37.274529791 (15h0m0.504015168s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 08:38:37.274605384 (15h0m0.504090751s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 08:38:37.274610052 (15h0m0.50409542s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 08:38:37.327657525 (15h0m0.557142902s) [upload=15529]: Done uploading segments...
Aug 28 08:38:37.327676731 (15h0m0.557162108s) [upload=15529]: Upload finished. err: <nil>
Duration: 327.841241ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
130.495949ms
FAIL (2025-08-28 09:00:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 08:34:49.327034091 (14h56m12.556519468s) [upload=15466]: Starting upload Aug 28 08:34:49.327164217 (14h56m12.556649593s) [upload=15466]: Done starting upload Aug 28 08:34:49.327228587 (14h56m12.556713944s) [upload=15466]: Uploading segments... Aug 28 08:34:49.327297758 (14h56m12.556783105s) [upload=15466]: Got next segment. Inline: true Aug 28 08:34:49.327304130 (14h56m12.556789487s) [upload=15466]: Waiting for error group managing segments... Aug 28 08:34:49.327343594 (14h56m12.556828951s) [upload=15466]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 08:34:49.327347441 (14h56m12.556832798s) [upload=15466]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 08:34:49.327349995 (14h56m12.556835352s) [upload=15466]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 08:34:49.376506477 (14h56m12.605991855s) [upload=15466]: Done uploading segments... Aug 28 08:34:49.376524523 (14h56m12.606009899s) [upload=15466]: Upload finished. err: metaclient: Too Many Requests
Duration: 130.521086ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............X..............X.............................] duration:
403.429533ms
FAIL (2025-08-28 09:00:36 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 28 08:38:37.128306418 (15h0m0.357791765s) [upload=15529]: Starting upload
Aug 28 08:38:37.128360960 (15h0m0.357846337s) [upload=15529]: Done starting upload
Aug 28 08:38:37.128467872 (15h0m0.357953229s) [upload=15529]: Uploading segments...
Aug 28 08:38:37.128594138 (15h0m0.358079495s) [upload=15529]: Got next segment. Inline: false
Aug 28 08:38:37.128626190 (15h0m0.358111547s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 08:38:37.128629987 (15h0m0.358115344s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 08:38:37.159496629 (15h0m0.388981986s) [seg_pos={0 0}, upload=15529]: Begin upload segment...
Aug 28 08:38:37.159526065 (15h0m0.389011422s) [seg_pos={0 0}, upload=15529]: Done begin upload segment.
Aug 28 08:38:37.159544059 (15h0m0.389029405s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159555029 (15h0m0.389040386s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159875983 (15h0m0.38936136s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159904587 (15h0m0.389389934s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160272919 (15h0m0.389758276s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160280884 (15h0m0.389766242s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160535985 (15h0m0.390021342s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160629981 (15h0m0.390115338s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160761228 (15h0m0.390246585s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160977334 (15h0m0.390462691s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161002733 (15h0m0.39048808s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161239779 (15h0m0.390725136s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161300903 (15h0m0.39078625s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161464060 (15h0m0.390949417s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161574097 (15h0m0.391059455s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161686059 (15h0m0.391171406s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161857702 (15h0m0.391343049s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161951357 (15h0m0.391436705s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.244154623 (15h0m0.47363998s) [upload=15529]: Next returned nil segment
Aug 28 08:38:37.244168008 (15h0m0.473653365s) [upload=15529]: Waiting for error group managing segments...
Aug 28 08:38:37.251633303 (15h0m0.481118651s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.252355692 (15h0m0.48184104s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253551001 (15h0m0.483036348s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253716342 (15h0m0.483201699s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253854362 (15h0m0.483339699s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254242262 (15h0m0.483727619s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254362789 (15h0m0.483848136s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254648477 (15h0m0.484133824s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.255754988 (15h0m0.485240345s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.260723024 (15h0m0.490208372s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.263272761 (15h0m0.492758118s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272821166 (15h0m0.502306513s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272952033 (15h0m0.5024374s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.273973004 (15h0m0.503458361s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.274003461 (15h0m0.503488818s) [seg_pos={0 0}, upload=15529]: Segment reached optimal threshold of 14 pieces.
Aug 28 08:38:37.274302303 (15h0m0.50378765s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1diUU2skKzXPjYy3Mu3iDDjnG5W8Z2cxCRMxDCH9cQGg2TdEiR): protocol: read tcp 5.161.89.252:10072->64.49.13.140:4508: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274341226 (15h0m0.503826583s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J4nbkWW5oM17EbRwB53vgPzEiK8dEXM2tR2TWGhJFqEja9RHi): protocol: read tcp 5.161.89.252:15990->64.49.13.154:4936: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274374699 (15h0m0.503860056s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: read tcp 5.161.89.252:15186->79.127.201.215:4348: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274501718 (15h0m0.503987085s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cYp95Dbq7byUc8cN7dF73sUBJEDnyJLDAVozb5jdz3wACLUXQ): protocol: read tcp 5.161.89.252:12078->79.127.205.245:4252: use of closed network connection; context canceled
Aug 28 08:38:37.274529791 (15h0m0.504015168s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 08:38:37.274605384 (15h0m0.504090751s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 08:38:37.274610052 (15h0m0.50409542s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 08:38:37.327657525 (15h0m0.557142902s) [upload=15529]: Done uploading segments...
Aug 28 08:38:37.327676731 (15h0m0.557162108s) [upload=15529]: Upload finished. err: <nil>
Duration: 403.451996ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
307.774437ms
FAIL (2025-08-28 09:00:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 08:34:49.327034091 (14h56m12.556519468s) [upload=15466]: Starting upload Aug 28 08:34:49.327164217 (14h56m12.556649593s) [upload=15466]: Done starting upload Aug 28 08:34:49.327228587 (14h56m12.556713944s) [upload=15466]: Uploading segments... Aug 28 08:34:49.327297758 (14h56m12.556783105s) [upload=15466]: Got next segment. Inline: true Aug 28 08:34:49.327304130 (14h56m12.556789487s) [upload=15466]: Waiting for error group managing segments... Aug 28 08:34:49.327343594 (14h56m12.556828951s) [upload=15466]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 08:34:49.327347441 (14h56m12.556832798s) [upload=15466]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 08:34:49.327349995 (14h56m12.556835352s) [upload=15466]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 08:34:49.376506477 (14h56m12.605991855s) [upload=15466]: Done uploading segments... Aug 28 08:34:49.376524523 (14h56m12.606009899s) [upload=15466]: Upload finished. err: metaclient: Too Many Requests
Duration: 307.794825ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
435.162749ms
FAIL (2025-08-28 09:00:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 08:34:49.327034091 (14h56m12.556519468s) [upload=15466]: Starting upload Aug 28 08:34:49.327164217 (14h56m12.556649593s) [upload=15466]: Done starting upload Aug 28 08:34:49.327228587 (14h56m12.556713944s) [upload=15466]: Uploading segments... Aug 28 08:34:49.327297758 (14h56m12.556783105s) [upload=15466]: Got next segment. Inline: true Aug 28 08:34:49.327304130 (14h56m12.556789487s) [upload=15466]: Waiting for error group managing segments... Aug 28 08:34:49.327343594 (14h56m12.556828951s) [upload=15466]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 08:34:49.327347441 (14h56m12.556832798s) [upload=15466]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 08:34:49.327349995 (14h56m12.556835352s) [upload=15466]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 08:34:49.376506477 (14h56m12.605991855s) [upload=15466]: Done uploading segments... Aug 28 08:34:49.376524523 (14h56m12.606009899s) [upload=15466]: Upload finished. err: metaclient: Too Many Requests
Duration: 435.18466ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
155.556818ms
FAIL (2025-08-28 08:59:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 08:34:49.327034091 (14h56m12.556519468s) [upload=15466]: Starting upload Aug 28 08:34:49.327164217 (14h56m12.556649593s) [upload=15466]: Done starting upload Aug 28 08:34:49.327228587 (14h56m12.556713944s) [upload=15466]: Uploading segments... Aug 28 08:34:49.327297758 (14h56m12.556783105s) [upload=15466]: Got next segment. Inline: true Aug 28 08:34:49.327304130 (14h56m12.556789487s) [upload=15466]: Waiting for error group managing segments... Aug 28 08:34:49.327343594 (14h56m12.556828951s) [upload=15466]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 08:34:49.327347441 (14h56m12.556832798s) [upload=15466]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 08:34:49.327349995 (14h56m12.556835352s) [upload=15466]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 08:34:49.376506477 (14h56m12.605991855s) [upload=15466]: Done uploading segments... Aug 28 08:34:49.376524523 (14h56m12.606009899s) [upload=15466]: Upload finished. err: metaclient: Too Many Requests
Duration: 155.57875ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................X..............X............................] duration:
373.913431ms
FAIL (2025-08-28 08:59:31 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 28 08:38:37.128306418 (15h0m0.357791765s) [upload=15529]: Starting upload
Aug 28 08:38:37.128360960 (15h0m0.357846337s) [upload=15529]: Done starting upload
Aug 28 08:38:37.128467872 (15h0m0.357953229s) [upload=15529]: Uploading segments...
Aug 28 08:38:37.128594138 (15h0m0.358079495s) [upload=15529]: Got next segment. Inline: false
Aug 28 08:38:37.128626190 (15h0m0.358111547s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 08:38:37.128629987 (15h0m0.358115344s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 08:38:37.159496629 (15h0m0.388981986s) [seg_pos={0 0}, upload=15529]: Begin upload segment...
Aug 28 08:38:37.159526065 (15h0m0.389011422s) [seg_pos={0 0}, upload=15529]: Done begin upload segment.
Aug 28 08:38:37.159544059 (15h0m0.389029405s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159555029 (15h0m0.389040386s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159875983 (15h0m0.38936136s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159904587 (15h0m0.389389934s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160272919 (15h0m0.389758276s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160280884 (15h0m0.389766242s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160535985 (15h0m0.390021342s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160629981 (15h0m0.390115338s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160761228 (15h0m0.390246585s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160977334 (15h0m0.390462691s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161002733 (15h0m0.39048808s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161239779 (15h0m0.390725136s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161300903 (15h0m0.39078625s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161464060 (15h0m0.390949417s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161574097 (15h0m0.391059455s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161686059 (15h0m0.391171406s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161857702 (15h0m0.391343049s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161951357 (15h0m0.391436705s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.244154623 (15h0m0.47363998s) [upload=15529]: Next returned nil segment
Aug 28 08:38:37.244168008 (15h0m0.473653365s) [upload=15529]: Waiting for error group managing segments...
Aug 28 08:38:37.251633303 (15h0m0.481118651s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.252355692 (15h0m0.48184104s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253551001 (15h0m0.483036348s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253716342 (15h0m0.483201699s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253854362 (15h0m0.483339699s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254242262 (15h0m0.483727619s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254362789 (15h0m0.483848136s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254648477 (15h0m0.484133824s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.255754988 (15h0m0.485240345s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.260723024 (15h0m0.490208372s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.263272761 (15h0m0.492758118s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272821166 (15h0m0.502306513s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272952033 (15h0m0.5024374s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.273973004 (15h0m0.503458361s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.274003461 (15h0m0.503488818s) [seg_pos={0 0}, upload=15529]: Segment reached optimal threshold of 14 pieces.
Aug 28 08:38:37.274302303 (15h0m0.50378765s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1diUU2skKzXPjYy3Mu3iDDjnG5W8Z2cxCRMxDCH9cQGg2TdEiR): protocol: read tcp 5.161.89.252:10072->64.49.13.140:4508: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274341226 (15h0m0.503826583s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J4nbkWW5oM17EbRwB53vgPzEiK8dEXM2tR2TWGhJFqEja9RHi): protocol: read tcp 5.161.89.252:15990->64.49.13.154:4936: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274374699 (15h0m0.503860056s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: read tcp 5.161.89.252:15186->79.127.201.215:4348: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274501718 (15h0m0.503987085s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cYp95Dbq7byUc8cN7dF73sUBJEDnyJLDAVozb5jdz3wACLUXQ): protocol: read tcp 5.161.89.252:12078->79.127.205.245:4252: use of closed network connection; context canceled
Aug 28 08:38:37.274529791 (15h0m0.504015168s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 08:38:37.274605384 (15h0m0.504090751s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 08:38:37.274610052 (15h0m0.50409542s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 08:38:37.327657525 (15h0m0.557142902s) [upload=15529]: Done uploading segments...
Aug 28 08:38:37.327676731 (15h0m0.557162108s) [upload=15529]: Upload finished. err: <nil>
Duration: 373.93946ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................X..............X...........................] duration:
644.907782ms
FAIL (2025-08-28 08:59:04 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 28 08:38:37.128306418 (15h0m0.357791765s) [upload=15529]: Starting upload
Aug 28 08:38:37.128360960 (15h0m0.357846337s) [upload=15529]: Done starting upload
Aug 28 08:38:37.128467872 (15h0m0.357953229s) [upload=15529]: Uploading segments...
Aug 28 08:38:37.128594138 (15h0m0.358079495s) [upload=15529]: Got next segment. Inline: false
Aug 28 08:38:37.128626190 (15h0m0.358111547s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 08:38:37.128629987 (15h0m0.358115344s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 08:38:37.159496629 (15h0m0.388981986s) [seg_pos={0 0}, upload=15529]: Begin upload segment...
Aug 28 08:38:37.159526065 (15h0m0.389011422s) [seg_pos={0 0}, upload=15529]: Done begin upload segment.
Aug 28 08:38:37.159544059 (15h0m0.389029405s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159555029 (15h0m0.389040386s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159875983 (15h0m0.38936136s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159904587 (15h0m0.389389934s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160272919 (15h0m0.389758276s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160280884 (15h0m0.389766242s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160535985 (15h0m0.390021342s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160629981 (15h0m0.390115338s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160761228 (15h0m0.390246585s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160977334 (15h0m0.390462691s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161002733 (15h0m0.39048808s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161239779 (15h0m0.390725136s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161300903 (15h0m0.39078625s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161464060 (15h0m0.390949417s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161574097 (15h0m0.391059455s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161686059 (15h0m0.391171406s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161857702 (15h0m0.391343049s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161951357 (15h0m0.391436705s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.244154623 (15h0m0.47363998s) [upload=15529]: Next returned nil segment
Aug 28 08:38:37.244168008 (15h0m0.473653365s) [upload=15529]: Waiting for error group managing segments...
Aug 28 08:38:37.251633303 (15h0m0.481118651s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.252355692 (15h0m0.48184104s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253551001 (15h0m0.483036348s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253716342 (15h0m0.483201699s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253854362 (15h0m0.483339699s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254242262 (15h0m0.483727619s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254362789 (15h0m0.483848136s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254648477 (15h0m0.484133824s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.255754988 (15h0m0.485240345s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.260723024 (15h0m0.490208372s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.263272761 (15h0m0.492758118s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272821166 (15h0m0.502306513s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272952033 (15h0m0.5024374s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.273973004 (15h0m0.503458361s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.274003461 (15h0m0.503488818s) [seg_pos={0 0}, upload=15529]: Segment reached optimal threshold of 14 pieces.
Aug 28 08:38:37.274302303 (15h0m0.50378765s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1diUU2skKzXPjYy3Mu3iDDjnG5W8Z2cxCRMxDCH9cQGg2TdEiR): protocol: read tcp 5.161.89.252:10072->64.49.13.140:4508: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274341226 (15h0m0.503826583s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J4nbkWW5oM17EbRwB53vgPzEiK8dEXM2tR2TWGhJFqEja9RHi): protocol: read tcp 5.161.89.252:15990->64.49.13.154:4936: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274374699 (15h0m0.503860056s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: read tcp 5.161.89.252:15186->79.127.201.215:4348: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274501718 (15h0m0.503987085s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cYp95Dbq7byUc8cN7dF73sUBJEDnyJLDAVozb5jdz3wACLUXQ): protocol: read tcp 5.161.89.252:12078->79.127.205.245:4252: use of closed network connection; context canceled
Aug 28 08:38:37.274529791 (15h0m0.504015168s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 08:38:37.274605384 (15h0m0.504090751s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 08:38:37.274610052 (15h0m0.50409542s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 08:38:37.327657525 (15h0m0.557142902s) [upload=15529]: Done uploading segments...
Aug 28 08:38:37.327676731 (15h0m0.557162108s) [upload=15529]: Upload finished. err: <nil>
Duration: 644.940183ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
327.77099ms
FAIL (2025-08-28 08:59:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 08:34:49.327034091 (14h56m12.556519468s) [upload=15466]: Starting upload Aug 28 08:34:49.327164217 (14h56m12.556649593s) [upload=15466]: Done starting upload Aug 28 08:34:49.327228587 (14h56m12.556713944s) [upload=15466]: Uploading segments... Aug 28 08:34:49.327297758 (14h56m12.556783105s) [upload=15466]: Got next segment. Inline: true Aug 28 08:34:49.327304130 (14h56m12.556789487s) [upload=15466]: Waiting for error group managing segments... Aug 28 08:34:49.327343594 (14h56m12.556828951s) [upload=15466]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 08:34:49.327347441 (14h56m12.556832798s) [upload=15466]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 08:34:49.327349995 (14h56m12.556835352s) [upload=15466]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 08:34:49.376506477 (14h56m12.605991855s) [upload=15466]: Done uploading segments... Aug 28 08:34:49.376524523 (14h56m12.606009899s) [upload=15466]: Upload finished. err: metaclient: Too Many Requests
Duration: 327.794735ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................X..............X..........................] duration:
669.99377ms
FAIL (2025-08-28 08:58:29 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 28 08:38:37.128306418 (15h0m0.357791765s) [upload=15529]: Starting upload
Aug 28 08:38:37.128360960 (15h0m0.357846337s) [upload=15529]: Done starting upload
Aug 28 08:38:37.128467872 (15h0m0.357953229s) [upload=15529]: Uploading segments...
Aug 28 08:38:37.128594138 (15h0m0.358079495s) [upload=15529]: Got next segment. Inline: false
Aug 28 08:38:37.128626190 (15h0m0.358111547s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 08:38:37.128629987 (15h0m0.358115344s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 08:38:37.159496629 (15h0m0.388981986s) [seg_pos={0 0}, upload=15529]: Begin upload segment...
Aug 28 08:38:37.159526065 (15h0m0.389011422s) [seg_pos={0 0}, upload=15529]: Done begin upload segment.
Aug 28 08:38:37.159544059 (15h0m0.389029405s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159555029 (15h0m0.389040386s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159875983 (15h0m0.38936136s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159904587 (15h0m0.389389934s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160272919 (15h0m0.389758276s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160280884 (15h0m0.389766242s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160535985 (15h0m0.390021342s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160629981 (15h0m0.390115338s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160761228 (15h0m0.390246585s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160977334 (15h0m0.390462691s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161002733 (15h0m0.39048808s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161239779 (15h0m0.390725136s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161300903 (15h0m0.39078625s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161464060 (15h0m0.390949417s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161574097 (15h0m0.391059455s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161686059 (15h0m0.391171406s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161857702 (15h0m0.391343049s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161951357 (15h0m0.391436705s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.244154623 (15h0m0.47363998s) [upload=15529]: Next returned nil segment
Aug 28 08:38:37.244168008 (15h0m0.473653365s) [upload=15529]: Waiting for error group managing segments...
Aug 28 08:38:37.251633303 (15h0m0.481118651s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.252355692 (15h0m0.48184104s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253551001 (15h0m0.483036348s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253716342 (15h0m0.483201699s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253854362 (15h0m0.483339699s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254242262 (15h0m0.483727619s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254362789 (15h0m0.483848136s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254648477 (15h0m0.484133824s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.255754988 (15h0m0.485240345s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.260723024 (15h0m0.490208372s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.263272761 (15h0m0.492758118s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272821166 (15h0m0.502306513s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272952033 (15h0m0.5024374s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.273973004 (15h0m0.503458361s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.274003461 (15h0m0.503488818s) [seg_pos={0 0}, upload=15529]: Segment reached optimal threshold of 14 pieces.
Aug 28 08:38:37.274302303 (15h0m0.50378765s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1diUU2skKzXPjYy3Mu3iDDjnG5W8Z2cxCRMxDCH9cQGg2TdEiR): protocol: read tcp 5.161.89.252:10072->64.49.13.140:4508: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274341226 (15h0m0.503826583s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J4nbkWW5oM17EbRwB53vgPzEiK8dEXM2tR2TWGhJFqEja9RHi): protocol: read tcp 5.161.89.252:15990->64.49.13.154:4936: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274374699 (15h0m0.503860056s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: read tcp 5.161.89.252:15186->79.127.201.215:4348: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274501718 (15h0m0.503987085s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cYp95Dbq7byUc8cN7dF73sUBJEDnyJLDAVozb5jdz3wACLUXQ): protocol: read tcp 5.161.89.252:12078->79.127.205.245:4252: use of closed network connection; context canceled
Aug 28 08:38:37.274529791 (15h0m0.504015168s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 08:38:37.274605384 (15h0m0.504090751s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 08:38:37.274610052 (15h0m0.50409542s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 08:38:37.327657525 (15h0m0.557142902s) [upload=15529]: Done uploading segments...
Aug 28 08:38:37.327676731 (15h0m0.557162108s) [upload=15529]: Upload finished. err: <nil>
Duration: 670.019038ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
145.70516ms
FAIL (2025-08-28 08:57:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 08:34:49.327034091 (14h56m12.556519468s) [upload=15466]: Starting upload Aug 28 08:34:49.327164217 (14h56m12.556649593s) [upload=15466]: Done starting upload Aug 28 08:34:49.327228587 (14h56m12.556713944s) [upload=15466]: Uploading segments... Aug 28 08:34:49.327297758 (14h56m12.556783105s) [upload=15466]: Got next segment. Inline: true Aug 28 08:34:49.327304130 (14h56m12.556789487s) [upload=15466]: Waiting for error group managing segments... Aug 28 08:34:49.327343594 (14h56m12.556828951s) [upload=15466]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 08:34:49.327347441 (14h56m12.556832798s) [upload=15466]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 08:34:49.327349995 (14h56m12.556835352s) [upload=15466]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 08:34:49.376506477 (14h56m12.605991855s) [upload=15466]: Done uploading segments... Aug 28 08:34:49.376524523 (14h56m12.606009899s) [upload=15466]: Upload finished. err: metaclient: Too Many Requests
Duration: 145.729716ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
126.965838ms
FAIL (2025-08-28 08:57:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 08:34:49.327034091 (14h56m12.556519468s) [upload=15466]: Starting upload Aug 28 08:34:49.327164217 (14h56m12.556649593s) [upload=15466]: Done starting upload Aug 28 08:34:49.327228587 (14h56m12.556713944s) [upload=15466]: Uploading segments... Aug 28 08:34:49.327297758 (14h56m12.556783105s) [upload=15466]: Got next segment. Inline: true Aug 28 08:34:49.327304130 (14h56m12.556789487s) [upload=15466]: Waiting for error group managing segments... Aug 28 08:34:49.327343594 (14h56m12.556828951s) [upload=15466]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 08:34:49.327347441 (14h56m12.556832798s) [upload=15466]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 08:34:49.327349995 (14h56m12.556835352s) [upload=15466]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 08:34:49.376506477 (14h56m12.605991855s) [upload=15466]: Done uploading segments... Aug 28 08:34:49.376524523 (14h56m12.606009899s) [upload=15466]: Upload finished. err: metaclient: Too Many Requests
Duration: 126.989263ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................X..............X.........................] duration:
474.186961ms
FAIL (2025-08-28 08:57:22 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 28 08:38:37.128306418 (15h0m0.357791765s) [upload=15529]: Starting upload
Aug 28 08:38:37.128360960 (15h0m0.357846337s) [upload=15529]: Done starting upload
Aug 28 08:38:37.128467872 (15h0m0.357953229s) [upload=15529]: Uploading segments...
Aug 28 08:38:37.128594138 (15h0m0.358079495s) [upload=15529]: Got next segment. Inline: false
Aug 28 08:38:37.128626190 (15h0m0.358111547s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 08:38:37.128629987 (15h0m0.358115344s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 08:38:37.159496629 (15h0m0.388981986s) [seg_pos={0 0}, upload=15529]: Begin upload segment...
Aug 28 08:38:37.159526065 (15h0m0.389011422s) [seg_pos={0 0}, upload=15529]: Done begin upload segment.
Aug 28 08:38:37.159544059 (15h0m0.389029405s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159555029 (15h0m0.389040386s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159875983 (15h0m0.38936136s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159904587 (15h0m0.389389934s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160272919 (15h0m0.389758276s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160280884 (15h0m0.389766242s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160535985 (15h0m0.390021342s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160629981 (15h0m0.390115338s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160761228 (15h0m0.390246585s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160977334 (15h0m0.390462691s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161002733 (15h0m0.39048808s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161239779 (15h0m0.390725136s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161300903 (15h0m0.39078625s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161464060 (15h0m0.390949417s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161574097 (15h0m0.391059455s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161686059 (15h0m0.391171406s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161857702 (15h0m0.391343049s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161951357 (15h0m0.391436705s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.244154623 (15h0m0.47363998s) [upload=15529]: Next returned nil segment
Aug 28 08:38:37.244168008 (15h0m0.473653365s) [upload=15529]: Waiting for error group managing segments...
Aug 28 08:38:37.251633303 (15h0m0.481118651s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.252355692 (15h0m0.48184104s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253551001 (15h0m0.483036348s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253716342 (15h0m0.483201699s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253854362 (15h0m0.483339699s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254242262 (15h0m0.483727619s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254362789 (15h0m0.483848136s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254648477 (15h0m0.484133824s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.255754988 (15h0m0.485240345s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.260723024 (15h0m0.490208372s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.263272761 (15h0m0.492758118s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272821166 (15h0m0.502306513s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272952033 (15h0m0.5024374s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.273973004 (15h0m0.503458361s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.274003461 (15h0m0.503488818s) [seg_pos={0 0}, upload=15529]: Segment reached optimal threshold of 14 pieces.
Aug 28 08:38:37.274302303 (15h0m0.50378765s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1diUU2skKzXPjYy3Mu3iDDjnG5W8Z2cxCRMxDCH9cQGg2TdEiR): protocol: read tcp 5.161.89.252:10072->64.49.13.140:4508: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274341226 (15h0m0.503826583s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J4nbkWW5oM17EbRwB53vgPzEiK8dEXM2tR2TWGhJFqEja9RHi): protocol: read tcp 5.161.89.252:15990->64.49.13.154:4936: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274374699 (15h0m0.503860056s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: read tcp 5.161.89.252:15186->79.127.201.215:4348: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274501718 (15h0m0.503987085s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cYp95Dbq7byUc8cN7dF73sUBJEDnyJLDAVozb5jdz3wACLUXQ): protocol: read tcp 5.161.89.252:12078->79.127.205.245:4252: use of closed network connection; context canceled
Aug 28 08:38:37.274529791 (15h0m0.504015168s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 08:38:37.274605384 (15h0m0.504090751s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 08:38:37.274610052 (15h0m0.50409542s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 08:38:37.327657525 (15h0m0.557142902s) [upload=15529]: Done uploading segments...
Aug 28 08:38:37.327676731 (15h0m0.557162108s) [upload=15529]: Upload finished. err: <nil>
Duration: 474.211759ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
497.965431ms
FAIL (2025-08-28 08:56:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 08:34:49.327034091 (14h56m12.556519468s) [upload=15466]: Starting upload Aug 28 08:34:49.327164217 (14h56m12.556649593s) [upload=15466]: Done starting upload Aug 28 08:34:49.327228587 (14h56m12.556713944s) [upload=15466]: Uploading segments... Aug 28 08:34:49.327297758 (14h56m12.556783105s) [upload=15466]: Got next segment. Inline: true Aug 28 08:34:49.327304130 (14h56m12.556789487s) [upload=15466]: Waiting for error group managing segments... Aug 28 08:34:49.327343594 (14h56m12.556828951s) [upload=15466]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 08:34:49.327347441 (14h56m12.556832798s) [upload=15466]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 08:34:49.327349995 (14h56m12.556835352s) [upload=15466]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 08:34:49.376506477 (14h56m12.605991855s) [upload=15466]: Done uploading segments... Aug 28 08:34:49.376524523 (14h56m12.606009899s) [upload=15466]: Upload finished. err: metaclient: Too Many Requests
Duration: 498.019994ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................X..............X........................] duration:
502.831561ms
FAIL (2025-08-28 08:56:20 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 28 08:38:37.128306418 (15h0m0.357791765s) [upload=15529]: Starting upload
Aug 28 08:38:37.128360960 (15h0m0.357846337s) [upload=15529]: Done starting upload
Aug 28 08:38:37.128467872 (15h0m0.357953229s) [upload=15529]: Uploading segments...
Aug 28 08:38:37.128594138 (15h0m0.358079495s) [upload=15529]: Got next segment. Inline: false
Aug 28 08:38:37.128626190 (15h0m0.358111547s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 08:38:37.128629987 (15h0m0.358115344s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 08:38:37.159496629 (15h0m0.388981986s) [seg_pos={0 0}, upload=15529]: Begin upload segment...
Aug 28 08:38:37.159526065 (15h0m0.389011422s) [seg_pos={0 0}, upload=15529]: Done begin upload segment.
Aug 28 08:38:37.159544059 (15h0m0.389029405s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159555029 (15h0m0.389040386s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159875983 (15h0m0.38936136s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159904587 (15h0m0.389389934s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160272919 (15h0m0.389758276s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160280884 (15h0m0.389766242s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160535985 (15h0m0.390021342s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160629981 (15h0m0.390115338s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160761228 (15h0m0.390246585s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160977334 (15h0m0.390462691s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161002733 (15h0m0.39048808s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161239779 (15h0m0.390725136s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161300903 (15h0m0.39078625s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161464060 (15h0m0.390949417s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161574097 (15h0m0.391059455s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161686059 (15h0m0.391171406s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161857702 (15h0m0.391343049s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161951357 (15h0m0.391436705s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.244154623 (15h0m0.47363998s) [upload=15529]: Next returned nil segment
Aug 28 08:38:37.244168008 (15h0m0.473653365s) [upload=15529]: Waiting for error group managing segments...
Aug 28 08:38:37.251633303 (15h0m0.481118651s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.252355692 (15h0m0.48184104s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253551001 (15h0m0.483036348s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253716342 (15h0m0.483201699s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253854362 (15h0m0.483339699s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254242262 (15h0m0.483727619s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254362789 (15h0m0.483848136s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254648477 (15h0m0.484133824s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.255754988 (15h0m0.485240345s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.260723024 (15h0m0.490208372s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.263272761 (15h0m0.492758118s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272821166 (15h0m0.502306513s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272952033 (15h0m0.5024374s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.273973004 (15h0m0.503458361s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.274003461 (15h0m0.503488818s) [seg_pos={0 0}, upload=15529]: Segment reached optimal threshold of 14 pieces.
Aug 28 08:38:37.274302303 (15h0m0.50378765s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1diUU2skKzXPjYy3Mu3iDDjnG5W8Z2cxCRMxDCH9cQGg2TdEiR): protocol: read tcp 5.161.89.252:10072->64.49.13.140:4508: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274341226 (15h0m0.503826583s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J4nbkWW5oM17EbRwB53vgPzEiK8dEXM2tR2TWGhJFqEja9RHi): protocol: read tcp 5.161.89.252:15990->64.49.13.154:4936: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274374699 (15h0m0.503860056s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: read tcp 5.161.89.252:15186->79.127.201.215:4348: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274501718 (15h0m0.503987085s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cYp95Dbq7byUc8cN7dF73sUBJEDnyJLDAVozb5jdz3wACLUXQ): protocol: read tcp 5.161.89.252:12078->79.127.205.245:4252: use of closed network connection; context canceled
Aug 28 08:38:37.274529791 (15h0m0.504015168s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 08:38:37.274605384 (15h0m0.504090751s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 08:38:37.274610052 (15h0m0.50409542s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 08:38:37.327657525 (15h0m0.557142902s) [upload=15529]: Done uploading segments...
Aug 28 08:38:37.327676731 (15h0m0.557162108s) [upload=15529]: Upload finished. err: <nil>
Duration: 502.852502ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
141.322146ms
FAIL (2025-08-28 08:55:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 08:34:49.327034091 (14h56m12.556519468s) [upload=15466]: Starting upload Aug 28 08:34:49.327164217 (14h56m12.556649593s) [upload=15466]: Done starting upload Aug 28 08:34:49.327228587 (14h56m12.556713944s) [upload=15466]: Uploading segments... Aug 28 08:34:49.327297758 (14h56m12.556783105s) [upload=15466]: Got next segment. Inline: true Aug 28 08:34:49.327304130 (14h56m12.556789487s) [upload=15466]: Waiting for error group managing segments... Aug 28 08:34:49.327343594 (14h56m12.556828951s) [upload=15466]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 08:34:49.327347441 (14h56m12.556832798s) [upload=15466]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 08:34:49.327349995 (14h56m12.556835352s) [upload=15466]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 08:34:49.376506477 (14h56m12.605991855s) [upload=15466]: Done uploading segments... Aug 28 08:34:49.376524523 (14h56m12.606009899s) [upload=15466]: Upload finished. err: metaclient: Too Many Requests
Duration: 141.345642ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................X..............X.......................] duration:
284.220368ms
FAIL (2025-08-28 08:55:38 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 28 08:38:37.128306418 (15h0m0.357791765s) [upload=15529]: Starting upload
Aug 28 08:38:37.128360960 (15h0m0.357846337s) [upload=15529]: Done starting upload
Aug 28 08:38:37.128467872 (15h0m0.357953229s) [upload=15529]: Uploading segments...
Aug 28 08:38:37.128594138 (15h0m0.358079495s) [upload=15529]: Got next segment. Inline: false
Aug 28 08:38:37.128626190 (15h0m0.358111547s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 08:38:37.128629987 (15h0m0.358115344s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 08:38:37.159496629 (15h0m0.388981986s) [seg_pos={0 0}, upload=15529]: Begin upload segment...
Aug 28 08:38:37.159526065 (15h0m0.389011422s) [seg_pos={0 0}, upload=15529]: Done begin upload segment.
Aug 28 08:38:37.159544059 (15h0m0.389029405s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159555029 (15h0m0.389040386s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159875983 (15h0m0.38936136s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159904587 (15h0m0.389389934s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160272919 (15h0m0.389758276s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160280884 (15h0m0.389766242s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160535985 (15h0m0.390021342s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160629981 (15h0m0.390115338s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160761228 (15h0m0.390246585s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160977334 (15h0m0.390462691s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161002733 (15h0m0.39048808s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161239779 (15h0m0.390725136s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161300903 (15h0m0.39078625s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161464060 (15h0m0.390949417s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161574097 (15h0m0.391059455s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161686059 (15h0m0.391171406s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161857702 (15h0m0.391343049s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161951357 (15h0m0.391436705s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.244154623 (15h0m0.47363998s) [upload=15529]: Next returned nil segment
Aug 28 08:38:37.244168008 (15h0m0.473653365s) [upload=15529]: Waiting for error group managing segments...
Aug 28 08:38:37.251633303 (15h0m0.481118651s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.252355692 (15h0m0.48184104s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253551001 (15h0m0.483036348s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253716342 (15h0m0.483201699s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253854362 (15h0m0.483339699s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254242262 (15h0m0.483727619s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254362789 (15h0m0.483848136s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254648477 (15h0m0.484133824s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.255754988 (15h0m0.485240345s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.260723024 (15h0m0.490208372s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.263272761 (15h0m0.492758118s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272821166 (15h0m0.502306513s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272952033 (15h0m0.5024374s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.273973004 (15h0m0.503458361s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.274003461 (15h0m0.503488818s) [seg_pos={0 0}, upload=15529]: Segment reached optimal threshold of 14 pieces.
Aug 28 08:38:37.274302303 (15h0m0.50378765s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1diUU2skKzXPjYy3Mu3iDDjnG5W8Z2cxCRMxDCH9cQGg2TdEiR): protocol: read tcp 5.161.89.252:10072->64.49.13.140:4508: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274341226 (15h0m0.503826583s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J4nbkWW5oM17EbRwB53vgPzEiK8dEXM2tR2TWGhJFqEja9RHi): protocol: read tcp 5.161.89.252:15990->64.49.13.154:4936: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274374699 (15h0m0.503860056s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: read tcp 5.161.89.252:15186->79.127.201.215:4348: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274501718 (15h0m0.503987085s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cYp95Dbq7byUc8cN7dF73sUBJEDnyJLDAVozb5jdz3wACLUXQ): protocol: read tcp 5.161.89.252:12078->79.127.205.245:4252: use of closed network connection; context canceled
Aug 28 08:38:37.274529791 (15h0m0.504015168s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 08:38:37.274605384 (15h0m0.504090751s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 08:38:37.274610052 (15h0m0.50409542s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 08:38:37.327657525 (15h0m0.557142902s) [upload=15529]: Done uploading segments...
Aug 28 08:38:37.327676731 (15h0m0.557162108s) [upload=15529]: Upload finished. err: <nil>
Duration: 284.242999ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|