Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................................X...................X] duration:
19.425069ms
FAIL (2025-08-23 04:53:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 04:53:20.160926199 (347h27m0.89219385s) [upload=361193]: Starting upload Aug 23 04:53:20.160991212 (347h27m0.892258862s) [upload=361193]: Done starting upload Aug 23 04:53:20.161145784 (347h27m0.892413433s) [upload=361193]: Uploading segments... Aug 23 04:53:20.161497567 (347h27m0.892765226s) [upload=361193]: Got next segment. Inline: false Aug 23 04:53:20.161542200 (347h27m0.89280985s) [upload=361193]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 04:53:20.161548041 (347h27m0.892815691s) [upload=361193]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 23 04:53:20.164187854 (347h27m0.895455504s) [upload=361193]: Next segment err: metaclient: Too Many Requests Aug 23 04:53:20.164204294 (347h27m0.895471955s) [upload=361193]: Done uploading segments... Aug 23 04:53:20.164217049 (347h27m0.895484699s) [upload=361193]: Upload finished. err: metaclient: Too Many Requests
Duration: 19.44659ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.X......................................................X...] duration:
462.901315ms
FAIL (2025-08-23 04:53:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 04:51:00.681506193 (347h24m41.412773813s) [upload=361150]: Starting upload Aug 23 04:51:00.681567178 (347h24m41.412834799s) [upload=361150]: Done starting upload Aug 23 04:51:00.681615028 (347h24m41.412882658s) [upload=361150]: Uploading segments... Aug 23 04:51:00.681649983 (347h24m41.412917604s) [upload=361150]: Got next segment. Inline: true Aug 23 04:51:00.681653800 (347h24m41.412921421s) [upload=361150]: Waiting for error group managing segments... Aug 23 04:51:00.681686994 (347h24m41.412954624s) [upload=361150]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 04:51:00.681690590 (347h24m41.41295822s) [upload=361150]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 04:51:00.681692775 (347h24m41.412960405s) [upload=361150]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 04:51:00.970638896 (347h24m41.701906556s) [upload=361150]: Done uploading segments... Aug 23 04:51:00.970655938 (347h24m41.701923568s) [upload=361150]: Upload finished. err: metaclient: Too Many Requests
Duration: 462.936681ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
475.843052ms
FAIL (2025-08-23 04:52:31 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 04:37:38.488494511 (347h11m19.219762161s) [upload=360921]: Starting upload
Aug 23 04:37:38.488593888 (347h11m19.219861549s) [upload=360921]: Done starting upload
Aug 23 04:37:38.488781211 (347h11m19.220048862s) [upload=360921]: Uploading segments...
Aug 23 04:37:38.489141779 (347h11m19.22040943s) [upload=360921]: Got next segment. Inline: false
Aug 23 04:37:38.489201743 (347h11m19.220469403s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 04:37:38.489211832 (347h11m19.220479482s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 04:37:38.519696232 (347h11m19.250963883s) [seg_pos={0 0}, upload=360921]: Begin upload segment...
Aug 23 04:37:38.519736558 (347h11m19.251004218s) [seg_pos={0 0}, upload=360921]: Done begin upload segment.
Aug 23 04:37:38.519765723 (347h11m19.251033374s) [noise=true , address=104.36.82.5:4866 , piece_id=N6SDBVXGJLMVWPNU62YG4TXIN7EVHK6PKO7E4JSTG567BH7KI74A, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.519779019 (347h11m19.251046669s) [noise=true , address=45.91.116.8:4070 , piece_id=7QQ26B76A2JKDIWD2Q7CBSDZVCHG7FYN36QBEQDQIANRKAED4YDA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520409926 (347h11m19.251677586s) [noise=true , address=77.90.31.11:4564 , piece_id=EGUX4XHAG5AYXT4AD3ABWH6L4GXR5IWL3XISPMMRA2CSS6I3GOBA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520443089 (347h11m19.251710789s) [noise=true , address=104.36.82.14:4244 , piece_id=BYA6E5F5D4W3NC25K4USWG73NFJBVTFV4BBU4PZGROHWJSIEUYVA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520813707 (347h11m19.252081356s) [noise=true , address=79.127.219.47:4065 , piece_id=SMKPN2ZBEP42KYT4KL3NMXE4TQZNROI5PIJUEOVJB7I4XSGTTO2Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520948851 (347h11m19.252216511s) [noise=true , address=104.36.82.40:4970 , piece_id=ABJKM5LHC6VMWOCEH2XBG2762H4IAONTFC6TYHDNLU6JMIKYAGSA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521225030 (347h11m19.252492691s) [noise=true , address=104.36.82.12:4166 , piece_id=TZ3OQHREJWS5Y2KC6AJOW5IT4N4FIOKNPWDBAM4VRGFUBEACKN5Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521323817 (347h11m19.252591467s) [noise=true , address=77.90.31.17:4780 , piece_id=2GMG3LOLE7YBXRH3FAZBOVOUH6H7JO244KXVXH57HY3P6X2IT5UQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521653298 (347h11m19.252920948s) [noise=true , address=45.91.116.5:4301 , piece_id=RZF2GJSTSYN2M4CRCUHFXUEP57WXGQMRMO26BOCIKCWDVPKPRD7Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521765469 (347h11m19.253033119s) [noise=true , address=77.90.31.12:4623 , piece_id=4LTRZJRPVXHYXK5V5O2SFXKBPTOZ2VUR7LZVP7MTWNE4FDQIXYAQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522079320 (347h11m19.25334697s) [noise=true , address=77.90.31.18:4812 , piece_id=5FMHBP74RE4YSIZYW5JAWNGGZHKQO4KV5SLL7CI5DNJYRXNVBSNA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522229032 (347h11m19.253496682s) [noise=true , address=104.36.82.23:4470 , piece_id=XSFLIIAPLDGS4WLNQ2HUJKT5QCG3QICN3QQRHAJIJLFZEG3JRELQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522574643 (347h11m19.253842293s) [noise=true , address=104.36.82.60:4372 , piece_id=QEOD5XLAU7SL7MBAMSIF56LUUL3AEEOM62OX7NQAXBGCQT5OWTQA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522671325 (347h11m19.253938974s) [noise=true , address=45.91.116.12:4230 , piece_id=ZOVILXHAVGUBEXQQQ623QVS3C2ERUW7ODZEB4FRFNFIPP4D7DP2A, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523062421 (347h11m19.254330071s) [noise=true , address=104.36.82.52:4107 , piece_id=F6KXTJFDEVFQ2M3JBFGWW6UKOFV5AQ76T2F63ILGHLBFCQBZR2SA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523466331 (347h11m19.254733981s) [noise=true , address=104.36.82.7:4923 , piece_id=47FFRXO767QLWZYBTKDZ2JTXFIN5YSEXFU3VKACTN562UPMZA3FQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523839645 (347h11m19.255107294s) [noise=true , address=79.127.201.214:4289 , piece_id=EI3IX442PPIS3RLP6BF7KXOYF5PUUFUPZY34MBMFPPL5FOAKI2TQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.526244593 (347h11m19.257512243s) [noise=true , address=77.90.31.19:4860 , piece_id=2AQJC67RND7ACK4MUKJSFNLMULJAZFPFYA2MLLPUI2OYDU5D5N6Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.653911453 (347h11m19.385179102s) [upload=360921]: Next returned nil segment
Aug 23 04:37:38.653927533 (347h11m19.385195183s) [upload=360921]: Waiting for error group managing segments...
Aug 23 04:37:38.662559206 (347h11m19.393826855s) [noise=true , address=79.127.219.47:4065 , piece_id=SMKPN2ZBEP42KYT4KL3NMXE4TQZNROI5PIJUEOVJB7I4XSGTTO2Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664028522 (347h11m19.395296182s) [noise=true , address=77.90.31.17:4780 , piece_id=2GMG3LOLE7YBXRH3FAZBOVOUH6H7JO244KXVXH57HY3P6X2IT5UQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664120556 (347h11m19.395388206s) [noise=true , address=45.91.116.5:4301 , piece_id=RZF2GJSTSYN2M4CRCUHFXUEP57WXGQMRMO26BOCIKCWDVPKPRD7Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664556126 (347h11m19.395823776s) [noise=true , address=45.91.116.12:4230 , piece_id=ZOVILXHAVGUBEXQQQ623QVS3C2ERUW7ODZEB4FRFNFIPP4D7DP2A, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.665523117 (347h11m19.396790767s) [noise=true , address=45.91.116.8:4070 , piece_id=7QQ26B76A2JKDIWD2Q7CBSDZVCHG7FYN36QBEQDQIANRKAED4YDA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.666922281 (347h11m19.398189932s) [noise=true , address=77.90.31.19:4860 , piece_id=2AQJC67RND7ACK4MUKJSFNLMULJAZFPFYA2MLLPUI2OYDU5D5N6Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.667251642 (347h11m19.398519292s) [noise=true , address=104.36.82.5:4866 , piece_id=N6SDBVXGJLMVWPNU62YG4TXIN7EVHK6PKO7E4JSTG567BH7KI74A, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668043622 (347h11m19.399311272s) [noise=true , address=104.36.82.12:4166 , piece_id=TZ3OQHREJWS5Y2KC6AJOW5IT4N4FIOKNPWDBAM4VRGFUBEACKN5Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668293092 (347h11m19.399560782s) [noise=true , address=104.36.82.52:4107 , piece_id=F6KXTJFDEVFQ2M3JBFGWW6UKOFV5AQ76T2F63ILGHLBFCQBZR2SA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668766424 (347h11m19.400034074s) [noise=true , address=104.36.82.60:4372 , piece_id=QEOD5XLAU7SL7MBAMSIF56LUUL3AEEOM62OX7NQAXBGCQT5OWTQA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.669011345 (347h11m19.400278996s) [noise=true , address=104.36.82.40:4970 , piece_id=ABJKM5LHC6VMWOCEH2XBG2762H4IAONTFC6TYHDNLU6JMIKYAGSA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.669766005 (347h11m19.401033656s) [noise=true , address=104.36.82.14:4244 , piece_id=BYA6E5F5D4W3NC25K4USWG73NFJBVTFV4BBU4PZGROHWJSIEUYVA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.671541008 (347h11m19.402808658s) [noise=true , address=104.36.82.7:4923 , piece_id=47FFRXO767QLWZYBTKDZ2JTXFIN5YSEXFU3VKACTN562UPMZA3FQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.686950824 (347h11m19.418218474s) [noise=true , address=104.36.82.23:4470 , piece_id=XSFLIIAPLDGS4WLNQ2HUJKT5QCG3QICN3QQRHAJIJLFZEG3JRELQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.686979798 (347h11m19.418247448s) [seg_pos={0 0}, upload=360921]: Segment reached optimal threshold of 14 pieces.
Aug 23 04:37:38.687145141 (347h11m19.41841279s) [noise=true , address=77.90.31.12:4623 , piece_id=4LTRZJRPVXHYXK5V5O2SFXKBPTOZ2VUR7LZVP7MTWNE4FDQIXYAQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ANjFmZrb9SDcqEHW8CBzeMtwvmceoLH9MtPabAjBw8wXjBuaM): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687251049 (347h11m19.418518699s) [noise=true , address=77.90.31.18:4812 , piece_id=5FMHBP74RE4YSIZYW5JAWNGGZHKQO4KV5SLL7CI5DNJYRXNVBSNA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687310421 (347h11m19.418578082s) [noise=true , address=77.90.31.11:4564 , piece_id=EGUX4XHAG5AYXT4AD3ABWH6L4GXR5IWL3XISPMMRA2CSS6I3GOBA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687479038 (347h11m19.418746689s) [noise=true , address=79.127.201.214:4289 , piece_id=EI3IX442PPIS3RLP6BF7KXOYF5PUUFUPZY34MBMFPPL5FOAKI2TQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YfeEiw7zKAYgUcMqMLgEiS2t1gMqdwrpuAdTb2dZouuXRBSM4): protocol: write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection; write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection
Aug 23 04:37:38.687511159 (347h11m19.418778808s) [seg_pos={0 0}, upload=360921]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 04:37:38.687579117 (347h11m19.418846777s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 04:37:38.687584127 (347h11m19.418851786s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 04:37:38.758982305 (347h11m19.490249956s) [upload=360921]: Done uploading segments...
Aug 23 04:37:38.759012683 (347h11m19.490280344s) [upload=360921]: Upload finished. err: <nil>
Duration: 475.859292ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..X......................................................X..] duration:
115.405106ms
FAIL (2025-08-23 04:52:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 04:51:00.681506193 (347h24m41.412773813s) [upload=361150]: Starting upload Aug 23 04:51:00.681567178 (347h24m41.412834799s) [upload=361150]: Done starting upload Aug 23 04:51:00.681615028 (347h24m41.412882658s) [upload=361150]: Uploading segments... Aug 23 04:51:00.681649983 (347h24m41.412917604s) [upload=361150]: Got next segment. Inline: true Aug 23 04:51:00.681653800 (347h24m41.412921421s) [upload=361150]: Waiting for error group managing segments... Aug 23 04:51:00.681686994 (347h24m41.412954624s) [upload=361150]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 04:51:00.681690590 (347h24m41.41295822s) [upload=361150]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 04:51:00.681692775 (347h24m41.412960405s) [upload=361150]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 04:51:00.970638896 (347h24m41.701906556s) [upload=361150]: Done uploading segments... Aug 23 04:51:00.970655938 (347h24m41.701923568s) [upload=361150]: Upload finished. err: metaclient: Too Many Requests
Duration: 115.709239ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...X......................................................X.] duration:
224.930234ms
FAIL (2025-08-23 04:51:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 04:51:00.681506193 (347h24m41.412773813s) [upload=361150]: Starting upload Aug 23 04:51:00.681567178 (347h24m41.412834799s) [upload=361150]: Done starting upload Aug 23 04:51:00.681615028 (347h24m41.412882658s) [upload=361150]: Uploading segments... Aug 23 04:51:00.681649983 (347h24m41.412917604s) [upload=361150]: Got next segment. Inline: true Aug 23 04:51:00.681653800 (347h24m41.412921421s) [upload=361150]: Waiting for error group managing segments... Aug 23 04:51:00.681686994 (347h24m41.412954624s) [upload=361150]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 04:51:00.681690590 (347h24m41.41295822s) [upload=361150]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 04:51:00.681692775 (347h24m41.412960405s) [upload=361150]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 04:51:00.970638896 (347h24m41.701906556s) [upload=361150]: Done uploading segments... Aug 23 04:51:00.970655938 (347h24m41.701923568s) [upload=361150]: Upload finished. err: metaclient: Too Many Requests
Duration: 224.948509ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
1.686778314s
FAIL (2025-08-23 04:51:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 04:37:38.488494511 (347h11m19.219762161s) [upload=360921]: Starting upload
Aug 23 04:37:38.488593888 (347h11m19.219861549s) [upload=360921]: Done starting upload
Aug 23 04:37:38.488781211 (347h11m19.220048862s) [upload=360921]: Uploading segments...
Aug 23 04:37:38.489141779 (347h11m19.22040943s) [upload=360921]: Got next segment. Inline: false
Aug 23 04:37:38.489201743 (347h11m19.220469403s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 04:37:38.489211832 (347h11m19.220479482s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 04:37:38.519696232 (347h11m19.250963883s) [seg_pos={0 0}, upload=360921]: Begin upload segment...
Aug 23 04:37:38.519736558 (347h11m19.251004218s) [seg_pos={0 0}, upload=360921]: Done begin upload segment.
Aug 23 04:37:38.519765723 (347h11m19.251033374s) [noise=true , address=104.36.82.5:4866 , piece_id=N6SDBVXGJLMVWPNU62YG4TXIN7EVHK6PKO7E4JSTG567BH7KI74A, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.519779019 (347h11m19.251046669s) [noise=true , address=45.91.116.8:4070 , piece_id=7QQ26B76A2JKDIWD2Q7CBSDZVCHG7FYN36QBEQDQIANRKAED4YDA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520409926 (347h11m19.251677586s) [noise=true , address=77.90.31.11:4564 , piece_id=EGUX4XHAG5AYXT4AD3ABWH6L4GXR5IWL3XISPMMRA2CSS6I3GOBA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520443089 (347h11m19.251710789s) [noise=true , address=104.36.82.14:4244 , piece_id=BYA6E5F5D4W3NC25K4USWG73NFJBVTFV4BBU4PZGROHWJSIEUYVA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520813707 (347h11m19.252081356s) [noise=true , address=79.127.219.47:4065 , piece_id=SMKPN2ZBEP42KYT4KL3NMXE4TQZNROI5PIJUEOVJB7I4XSGTTO2Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520948851 (347h11m19.252216511s) [noise=true , address=104.36.82.40:4970 , piece_id=ABJKM5LHC6VMWOCEH2XBG2762H4IAONTFC6TYHDNLU6JMIKYAGSA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521225030 (347h11m19.252492691s) [noise=true , address=104.36.82.12:4166 , piece_id=TZ3OQHREJWS5Y2KC6AJOW5IT4N4FIOKNPWDBAM4VRGFUBEACKN5Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521323817 (347h11m19.252591467s) [noise=true , address=77.90.31.17:4780 , piece_id=2GMG3LOLE7YBXRH3FAZBOVOUH6H7JO244KXVXH57HY3P6X2IT5UQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521653298 (347h11m19.252920948s) [noise=true , address=45.91.116.5:4301 , piece_id=RZF2GJSTSYN2M4CRCUHFXUEP57WXGQMRMO26BOCIKCWDVPKPRD7Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521765469 (347h11m19.253033119s) [noise=true , address=77.90.31.12:4623 , piece_id=4LTRZJRPVXHYXK5V5O2SFXKBPTOZ2VUR7LZVP7MTWNE4FDQIXYAQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522079320 (347h11m19.25334697s) [noise=true , address=77.90.31.18:4812 , piece_id=5FMHBP74RE4YSIZYW5JAWNGGZHKQO4KV5SLL7CI5DNJYRXNVBSNA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522229032 (347h11m19.253496682s) [noise=true , address=104.36.82.23:4470 , piece_id=XSFLIIAPLDGS4WLNQ2HUJKT5QCG3QICN3QQRHAJIJLFZEG3JRELQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522574643 (347h11m19.253842293s) [noise=true , address=104.36.82.60:4372 , piece_id=QEOD5XLAU7SL7MBAMSIF56LUUL3AEEOM62OX7NQAXBGCQT5OWTQA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522671325 (347h11m19.253938974s) [noise=true , address=45.91.116.12:4230 , piece_id=ZOVILXHAVGUBEXQQQ623QVS3C2ERUW7ODZEB4FRFNFIPP4D7DP2A, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523062421 (347h11m19.254330071s) [noise=true , address=104.36.82.52:4107 , piece_id=F6KXTJFDEVFQ2M3JBFGWW6UKOFV5AQ76T2F63ILGHLBFCQBZR2SA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523466331 (347h11m19.254733981s) [noise=true , address=104.36.82.7:4923 , piece_id=47FFRXO767QLWZYBTKDZ2JTXFIN5YSEXFU3VKACTN562UPMZA3FQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523839645 (347h11m19.255107294s) [noise=true , address=79.127.201.214:4289 , piece_id=EI3IX442PPIS3RLP6BF7KXOYF5PUUFUPZY34MBMFPPL5FOAKI2TQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.526244593 (347h11m19.257512243s) [noise=true , address=77.90.31.19:4860 , piece_id=2AQJC67RND7ACK4MUKJSFNLMULJAZFPFYA2MLLPUI2OYDU5D5N6Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.653911453 (347h11m19.385179102s) [upload=360921]: Next returned nil segment
Aug 23 04:37:38.653927533 (347h11m19.385195183s) [upload=360921]: Waiting for error group managing segments...
Aug 23 04:37:38.662559206 (347h11m19.393826855s) [noise=true , address=79.127.219.47:4065 , piece_id=SMKPN2ZBEP42KYT4KL3NMXE4TQZNROI5PIJUEOVJB7I4XSGTTO2Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664028522 (347h11m19.395296182s) [noise=true , address=77.90.31.17:4780 , piece_id=2GMG3LOLE7YBXRH3FAZBOVOUH6H7JO244KXVXH57HY3P6X2IT5UQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664120556 (347h11m19.395388206s) [noise=true , address=45.91.116.5:4301 , piece_id=RZF2GJSTSYN2M4CRCUHFXUEP57WXGQMRMO26BOCIKCWDVPKPRD7Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664556126 (347h11m19.395823776s) [noise=true , address=45.91.116.12:4230 , piece_id=ZOVILXHAVGUBEXQQQ623QVS3C2ERUW7ODZEB4FRFNFIPP4D7DP2A, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.665523117 (347h11m19.396790767s) [noise=true , address=45.91.116.8:4070 , piece_id=7QQ26B76A2JKDIWD2Q7CBSDZVCHG7FYN36QBEQDQIANRKAED4YDA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.666922281 (347h11m19.398189932s) [noise=true , address=77.90.31.19:4860 , piece_id=2AQJC67RND7ACK4MUKJSFNLMULJAZFPFYA2MLLPUI2OYDU5D5N6Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.667251642 (347h11m19.398519292s) [noise=true , address=104.36.82.5:4866 , piece_id=N6SDBVXGJLMVWPNU62YG4TXIN7EVHK6PKO7E4JSTG567BH7KI74A, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668043622 (347h11m19.399311272s) [noise=true , address=104.36.82.12:4166 , piece_id=TZ3OQHREJWS5Y2KC6AJOW5IT4N4FIOKNPWDBAM4VRGFUBEACKN5Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668293092 (347h11m19.399560782s) [noise=true , address=104.36.82.52:4107 , piece_id=F6KXTJFDEVFQ2M3JBFGWW6UKOFV5AQ76T2F63ILGHLBFCQBZR2SA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668766424 (347h11m19.400034074s) [noise=true , address=104.36.82.60:4372 , piece_id=QEOD5XLAU7SL7MBAMSIF56LUUL3AEEOM62OX7NQAXBGCQT5OWTQA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.669011345 (347h11m19.400278996s) [noise=true , address=104.36.82.40:4970 , piece_id=ABJKM5LHC6VMWOCEH2XBG2762H4IAONTFC6TYHDNLU6JMIKYAGSA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.669766005 (347h11m19.401033656s) [noise=true , address=104.36.82.14:4244 , piece_id=BYA6E5F5D4W3NC25K4USWG73NFJBVTFV4BBU4PZGROHWJSIEUYVA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.671541008 (347h11m19.402808658s) [noise=true , address=104.36.82.7:4923 , piece_id=47FFRXO767QLWZYBTKDZ2JTXFIN5YSEXFU3VKACTN562UPMZA3FQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.686950824 (347h11m19.418218474s) [noise=true , address=104.36.82.23:4470 , piece_id=XSFLIIAPLDGS4WLNQ2HUJKT5QCG3QICN3QQRHAJIJLFZEG3JRELQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.686979798 (347h11m19.418247448s) [seg_pos={0 0}, upload=360921]: Segment reached optimal threshold of 14 pieces.
Aug 23 04:37:38.687145141 (347h11m19.41841279s) [noise=true , address=77.90.31.12:4623 , piece_id=4LTRZJRPVXHYXK5V5O2SFXKBPTOZ2VUR7LZVP7MTWNE4FDQIXYAQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ANjFmZrb9SDcqEHW8CBzeMtwvmceoLH9MtPabAjBw8wXjBuaM): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687251049 (347h11m19.418518699s) [noise=true , address=77.90.31.18:4812 , piece_id=5FMHBP74RE4YSIZYW5JAWNGGZHKQO4KV5SLL7CI5DNJYRXNVBSNA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687310421 (347h11m19.418578082s) [noise=true , address=77.90.31.11:4564 , piece_id=EGUX4XHAG5AYXT4AD3ABWH6L4GXR5IWL3XISPMMRA2CSS6I3GOBA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687479038 (347h11m19.418746689s) [noise=true , address=79.127.201.214:4289 , piece_id=EI3IX442PPIS3RLP6BF7KXOYF5PUUFUPZY34MBMFPPL5FOAKI2TQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YfeEiw7zKAYgUcMqMLgEiS2t1gMqdwrpuAdTb2dZouuXRBSM4): protocol: write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection; write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection
Aug 23 04:37:38.687511159 (347h11m19.418778808s) [seg_pos={0 0}, upload=360921]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 04:37:38.687579117 (347h11m19.418846777s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 04:37:38.687584127 (347h11m19.418851786s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 04:37:38.758982305 (347h11m19.490249956s) [upload=360921]: Done uploading segments...
Aug 23 04:37:38.759012683 (347h11m19.490280344s) [upload=360921]: Upload finished. err: <nil>
Duration: 1.686806225s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....X......................................................X] duration:
302.576536ms
FAIL (2025-08-23 04:51:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 04:51:00.681506193 (347h24m41.412773813s) [upload=361150]: Starting upload Aug 23 04:51:00.681567178 (347h24m41.412834799s) [upload=361150]: Done starting upload Aug 23 04:51:00.681615028 (347h24m41.412882658s) [upload=361150]: Uploading segments... Aug 23 04:51:00.681649983 (347h24m41.412917604s) [upload=361150]: Got next segment. Inline: true Aug 23 04:51:00.681653800 (347h24m41.412921421s) [upload=361150]: Waiting for error group managing segments... Aug 23 04:51:00.681686994 (347h24m41.412954624s) [upload=361150]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 04:51:00.681690590 (347h24m41.41295822s) [upload=361150]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 04:51:00.681692775 (347h24m41.412960405s) [upload=361150]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 04:51:00.970638896 (347h24m41.701906556s) [upload=361150]: Done uploading segments... Aug 23 04:51:00.970655938 (347h24m41.701923568s) [upload=361150]: Upload finished. err: metaclient: Too Many Requests
Duration: 302.594541ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
1.816098063s
FAIL (2025-08-23 04:50:33 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 04:37:38.488494511 (347h11m19.219762161s) [upload=360921]: Starting upload
Aug 23 04:37:38.488593888 (347h11m19.219861549s) [upload=360921]: Done starting upload
Aug 23 04:37:38.488781211 (347h11m19.220048862s) [upload=360921]: Uploading segments...
Aug 23 04:37:38.489141779 (347h11m19.22040943s) [upload=360921]: Got next segment. Inline: false
Aug 23 04:37:38.489201743 (347h11m19.220469403s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 04:37:38.489211832 (347h11m19.220479482s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 04:37:38.519696232 (347h11m19.250963883s) [seg_pos={0 0}, upload=360921]: Begin upload segment...
Aug 23 04:37:38.519736558 (347h11m19.251004218s) [seg_pos={0 0}, upload=360921]: Done begin upload segment.
Aug 23 04:37:38.519765723 (347h11m19.251033374s) [noise=true , address=104.36.82.5:4866 , piece_id=N6SDBVXGJLMVWPNU62YG4TXIN7EVHK6PKO7E4JSTG567BH7KI74A, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.519779019 (347h11m19.251046669s) [noise=true , address=45.91.116.8:4070 , piece_id=7QQ26B76A2JKDIWD2Q7CBSDZVCHG7FYN36QBEQDQIANRKAED4YDA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520409926 (347h11m19.251677586s) [noise=true , address=77.90.31.11:4564 , piece_id=EGUX4XHAG5AYXT4AD3ABWH6L4GXR5IWL3XISPMMRA2CSS6I3GOBA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520443089 (347h11m19.251710789s) [noise=true , address=104.36.82.14:4244 , piece_id=BYA6E5F5D4W3NC25K4USWG73NFJBVTFV4BBU4PZGROHWJSIEUYVA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520813707 (347h11m19.252081356s) [noise=true , address=79.127.219.47:4065 , piece_id=SMKPN2ZBEP42KYT4KL3NMXE4TQZNROI5PIJUEOVJB7I4XSGTTO2Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520948851 (347h11m19.252216511s) [noise=true , address=104.36.82.40:4970 , piece_id=ABJKM5LHC6VMWOCEH2XBG2762H4IAONTFC6TYHDNLU6JMIKYAGSA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521225030 (347h11m19.252492691s) [noise=true , address=104.36.82.12:4166 , piece_id=TZ3OQHREJWS5Y2KC6AJOW5IT4N4FIOKNPWDBAM4VRGFUBEACKN5Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521323817 (347h11m19.252591467s) [noise=true , address=77.90.31.17:4780 , piece_id=2GMG3LOLE7YBXRH3FAZBOVOUH6H7JO244KXVXH57HY3P6X2IT5UQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521653298 (347h11m19.252920948s) [noise=true , address=45.91.116.5:4301 , piece_id=RZF2GJSTSYN2M4CRCUHFXUEP57WXGQMRMO26BOCIKCWDVPKPRD7Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521765469 (347h11m19.253033119s) [noise=true , address=77.90.31.12:4623 , piece_id=4LTRZJRPVXHYXK5V5O2SFXKBPTOZ2VUR7LZVP7MTWNE4FDQIXYAQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522079320 (347h11m19.25334697s) [noise=true , address=77.90.31.18:4812 , piece_id=5FMHBP74RE4YSIZYW5JAWNGGZHKQO4KV5SLL7CI5DNJYRXNVBSNA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522229032 (347h11m19.253496682s) [noise=true , address=104.36.82.23:4470 , piece_id=XSFLIIAPLDGS4WLNQ2HUJKT5QCG3QICN3QQRHAJIJLFZEG3JRELQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522574643 (347h11m19.253842293s) [noise=true , address=104.36.82.60:4372 , piece_id=QEOD5XLAU7SL7MBAMSIF56LUUL3AEEOM62OX7NQAXBGCQT5OWTQA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522671325 (347h11m19.253938974s) [noise=true , address=45.91.116.12:4230 , piece_id=ZOVILXHAVGUBEXQQQ623QVS3C2ERUW7ODZEB4FRFNFIPP4D7DP2A, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523062421 (347h11m19.254330071s) [noise=true , address=104.36.82.52:4107 , piece_id=F6KXTJFDEVFQ2M3JBFGWW6UKOFV5AQ76T2F63ILGHLBFCQBZR2SA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523466331 (347h11m19.254733981s) [noise=true , address=104.36.82.7:4923 , piece_id=47FFRXO767QLWZYBTKDZ2JTXFIN5YSEXFU3VKACTN562UPMZA3FQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523839645 (347h11m19.255107294s) [noise=true , address=79.127.201.214:4289 , piece_id=EI3IX442PPIS3RLP6BF7KXOYF5PUUFUPZY34MBMFPPL5FOAKI2TQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.526244593 (347h11m19.257512243s) [noise=true , address=77.90.31.19:4860 , piece_id=2AQJC67RND7ACK4MUKJSFNLMULJAZFPFYA2MLLPUI2OYDU5D5N6Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.653911453 (347h11m19.385179102s) [upload=360921]: Next returned nil segment
Aug 23 04:37:38.653927533 (347h11m19.385195183s) [upload=360921]: Waiting for error group managing segments...
Aug 23 04:37:38.662559206 (347h11m19.393826855s) [noise=true , address=79.127.219.47:4065 , piece_id=SMKPN2ZBEP42KYT4KL3NMXE4TQZNROI5PIJUEOVJB7I4XSGTTO2Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664028522 (347h11m19.395296182s) [noise=true , address=77.90.31.17:4780 , piece_id=2GMG3LOLE7YBXRH3FAZBOVOUH6H7JO244KXVXH57HY3P6X2IT5UQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664120556 (347h11m19.395388206s) [noise=true , address=45.91.116.5:4301 , piece_id=RZF2GJSTSYN2M4CRCUHFXUEP57WXGQMRMO26BOCIKCWDVPKPRD7Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664556126 (347h11m19.395823776s) [noise=true , address=45.91.116.12:4230 , piece_id=ZOVILXHAVGUBEXQQQ623QVS3C2ERUW7ODZEB4FRFNFIPP4D7DP2A, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.665523117 (347h11m19.396790767s) [noise=true , address=45.91.116.8:4070 , piece_id=7QQ26B76A2JKDIWD2Q7CBSDZVCHG7FYN36QBEQDQIANRKAED4YDA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.666922281 (347h11m19.398189932s) [noise=true , address=77.90.31.19:4860 , piece_id=2AQJC67RND7ACK4MUKJSFNLMULJAZFPFYA2MLLPUI2OYDU5D5N6Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.667251642 (347h11m19.398519292s) [noise=true , address=104.36.82.5:4866 , piece_id=N6SDBVXGJLMVWPNU62YG4TXIN7EVHK6PKO7E4JSTG567BH7KI74A, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668043622 (347h11m19.399311272s) [noise=true , address=104.36.82.12:4166 , piece_id=TZ3OQHREJWS5Y2KC6AJOW5IT4N4FIOKNPWDBAM4VRGFUBEACKN5Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668293092 (347h11m19.399560782s) [noise=true , address=104.36.82.52:4107 , piece_id=F6KXTJFDEVFQ2M3JBFGWW6UKOFV5AQ76T2F63ILGHLBFCQBZR2SA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668766424 (347h11m19.400034074s) [noise=true , address=104.36.82.60:4372 , piece_id=QEOD5XLAU7SL7MBAMSIF56LUUL3AEEOM62OX7NQAXBGCQT5OWTQA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.669011345 (347h11m19.400278996s) [noise=true , address=104.36.82.40:4970 , piece_id=ABJKM5LHC6VMWOCEH2XBG2762H4IAONTFC6TYHDNLU6JMIKYAGSA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.669766005 (347h11m19.401033656s) [noise=true , address=104.36.82.14:4244 , piece_id=BYA6E5F5D4W3NC25K4USWG73NFJBVTFV4BBU4PZGROHWJSIEUYVA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.671541008 (347h11m19.402808658s) [noise=true , address=104.36.82.7:4923 , piece_id=47FFRXO767QLWZYBTKDZ2JTXFIN5YSEXFU3VKACTN562UPMZA3FQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.686950824 (347h11m19.418218474s) [noise=true , address=104.36.82.23:4470 , piece_id=XSFLIIAPLDGS4WLNQ2HUJKT5QCG3QICN3QQRHAJIJLFZEG3JRELQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.686979798 (347h11m19.418247448s) [seg_pos={0 0}, upload=360921]: Segment reached optimal threshold of 14 pieces.
Aug 23 04:37:38.687145141 (347h11m19.41841279s) [noise=true , address=77.90.31.12:4623 , piece_id=4LTRZJRPVXHYXK5V5O2SFXKBPTOZ2VUR7LZVP7MTWNE4FDQIXYAQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ANjFmZrb9SDcqEHW8CBzeMtwvmceoLH9MtPabAjBw8wXjBuaM): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687251049 (347h11m19.418518699s) [noise=true , address=77.90.31.18:4812 , piece_id=5FMHBP74RE4YSIZYW5JAWNGGZHKQO4KV5SLL7CI5DNJYRXNVBSNA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687310421 (347h11m19.418578082s) [noise=true , address=77.90.31.11:4564 , piece_id=EGUX4XHAG5AYXT4AD3ABWH6L4GXR5IWL3XISPMMRA2CSS6I3GOBA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687479038 (347h11m19.418746689s) [noise=true , address=79.127.201.214:4289 , piece_id=EI3IX442PPIS3RLP6BF7KXOYF5PUUFUPZY34MBMFPPL5FOAKI2TQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YfeEiw7zKAYgUcMqMLgEiS2t1gMqdwrpuAdTb2dZouuXRBSM4): protocol: write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection; write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection
Aug 23 04:37:38.687511159 (347h11m19.418778808s) [seg_pos={0 0}, upload=360921]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 04:37:38.687579117 (347h11m19.418846777s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 04:37:38.687584127 (347h11m19.418851786s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 04:37:38.758982305 (347h11m19.490249956s) [upload=360921]: Done uploading segments...
Aug 23 04:37:38.759012683 (347h11m19.490280344s) [upload=360921]: Upload finished. err: <nil>
Duration: 1.816118743s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
242.809273ms
FAIL (2025-08-23 04:50:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 04:11:59.227473138 (346h45m39.958740788s) [upload=360474]: Starting upload Aug 23 04:11:59.227536837 (346h45m39.958804498s) [upload=360474]: Done starting upload Aug 23 04:11:59.227614664 (346h45m39.958882314s) [upload=360474]: Uploading segments... Aug 23 04:11:59.227651072 (346h45m39.958918733s) [upload=360474]: Got next segment. Inline: true Aug 23 04:11:59.227656383 (346h45m39.958924043s) [upload=360474]: Waiting for error group managing segments... Aug 23 04:11:59.227707940 (346h45m39.9589756s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 04:11:59.227716657 (346h45m39.958984317s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 04:11:59.227724952 (346h45m39.958992613s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 04:11:59.230727896 (346h45m39.961995547s) [upload=360474]: Done uploading segments... Aug 23 04:11:59.230740019 (346h45m39.962007669s) [upload=360474]: Upload finished. err: metaclient: Too Many Requests
Duration: 242.825382ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
1.02143098s
FAIL (2025-08-23 04:49:49 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 04:37:38.488494511 (347h11m19.219762161s) [upload=360921]: Starting upload
Aug 23 04:37:38.488593888 (347h11m19.219861549s) [upload=360921]: Done starting upload
Aug 23 04:37:38.488781211 (347h11m19.220048862s) [upload=360921]: Uploading segments...
Aug 23 04:37:38.489141779 (347h11m19.22040943s) [upload=360921]: Got next segment. Inline: false
Aug 23 04:37:38.489201743 (347h11m19.220469403s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 04:37:38.489211832 (347h11m19.220479482s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 04:37:38.519696232 (347h11m19.250963883s) [seg_pos={0 0}, upload=360921]: Begin upload segment...
Aug 23 04:37:38.519736558 (347h11m19.251004218s) [seg_pos={0 0}, upload=360921]: Done begin upload segment.
Aug 23 04:37:38.519765723 (347h11m19.251033374s) [noise=true , address=104.36.82.5:4866 , piece_id=N6SDBVXGJLMVWPNU62YG4TXIN7EVHK6PKO7E4JSTG567BH7KI74A, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.519779019 (347h11m19.251046669s) [noise=true , address=45.91.116.8:4070 , piece_id=7QQ26B76A2JKDIWD2Q7CBSDZVCHG7FYN36QBEQDQIANRKAED4YDA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520409926 (347h11m19.251677586s) [noise=true , address=77.90.31.11:4564 , piece_id=EGUX4XHAG5AYXT4AD3ABWH6L4GXR5IWL3XISPMMRA2CSS6I3GOBA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520443089 (347h11m19.251710789s) [noise=true , address=104.36.82.14:4244 , piece_id=BYA6E5F5D4W3NC25K4USWG73NFJBVTFV4BBU4PZGROHWJSIEUYVA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520813707 (347h11m19.252081356s) [noise=true , address=79.127.219.47:4065 , piece_id=SMKPN2ZBEP42KYT4KL3NMXE4TQZNROI5PIJUEOVJB7I4XSGTTO2Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520948851 (347h11m19.252216511s) [noise=true , address=104.36.82.40:4970 , piece_id=ABJKM5LHC6VMWOCEH2XBG2762H4IAONTFC6TYHDNLU6JMIKYAGSA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521225030 (347h11m19.252492691s) [noise=true , address=104.36.82.12:4166 , piece_id=TZ3OQHREJWS5Y2KC6AJOW5IT4N4FIOKNPWDBAM4VRGFUBEACKN5Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521323817 (347h11m19.252591467s) [noise=true , address=77.90.31.17:4780 , piece_id=2GMG3LOLE7YBXRH3FAZBOVOUH6H7JO244KXVXH57HY3P6X2IT5UQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521653298 (347h11m19.252920948s) [noise=true , address=45.91.116.5:4301 , piece_id=RZF2GJSTSYN2M4CRCUHFXUEP57WXGQMRMO26BOCIKCWDVPKPRD7Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521765469 (347h11m19.253033119s) [noise=true , address=77.90.31.12:4623 , piece_id=4LTRZJRPVXHYXK5V5O2SFXKBPTOZ2VUR7LZVP7MTWNE4FDQIXYAQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522079320 (347h11m19.25334697s) [noise=true , address=77.90.31.18:4812 , piece_id=5FMHBP74RE4YSIZYW5JAWNGGZHKQO4KV5SLL7CI5DNJYRXNVBSNA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522229032 (347h11m19.253496682s) [noise=true , address=104.36.82.23:4470 , piece_id=XSFLIIAPLDGS4WLNQ2HUJKT5QCG3QICN3QQRHAJIJLFZEG3JRELQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522574643 (347h11m19.253842293s) [noise=true , address=104.36.82.60:4372 , piece_id=QEOD5XLAU7SL7MBAMSIF56LUUL3AEEOM62OX7NQAXBGCQT5OWTQA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522671325 (347h11m19.253938974s) [noise=true , address=45.91.116.12:4230 , piece_id=ZOVILXHAVGUBEXQQQ623QVS3C2ERUW7ODZEB4FRFNFIPP4D7DP2A, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523062421 (347h11m19.254330071s) [noise=true , address=104.36.82.52:4107 , piece_id=F6KXTJFDEVFQ2M3JBFGWW6UKOFV5AQ76T2F63ILGHLBFCQBZR2SA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523466331 (347h11m19.254733981s) [noise=true , address=104.36.82.7:4923 , piece_id=47FFRXO767QLWZYBTKDZ2JTXFIN5YSEXFU3VKACTN562UPMZA3FQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523839645 (347h11m19.255107294s) [noise=true , address=79.127.201.214:4289 , piece_id=EI3IX442PPIS3RLP6BF7KXOYF5PUUFUPZY34MBMFPPL5FOAKI2TQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.526244593 (347h11m19.257512243s) [noise=true , address=77.90.31.19:4860 , piece_id=2AQJC67RND7ACK4MUKJSFNLMULJAZFPFYA2MLLPUI2OYDU5D5N6Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.653911453 (347h11m19.385179102s) [upload=360921]: Next returned nil segment
Aug 23 04:37:38.653927533 (347h11m19.385195183s) [upload=360921]: Waiting for error group managing segments...
Aug 23 04:37:38.662559206 (347h11m19.393826855s) [noise=true , address=79.127.219.47:4065 , piece_id=SMKPN2ZBEP42KYT4KL3NMXE4TQZNROI5PIJUEOVJB7I4XSGTTO2Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664028522 (347h11m19.395296182s) [noise=true , address=77.90.31.17:4780 , piece_id=2GMG3LOLE7YBXRH3FAZBOVOUH6H7JO244KXVXH57HY3P6X2IT5UQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664120556 (347h11m19.395388206s) [noise=true , address=45.91.116.5:4301 , piece_id=RZF2GJSTSYN2M4CRCUHFXUEP57WXGQMRMO26BOCIKCWDVPKPRD7Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664556126 (347h11m19.395823776s) [noise=true , address=45.91.116.12:4230 , piece_id=ZOVILXHAVGUBEXQQQ623QVS3C2ERUW7ODZEB4FRFNFIPP4D7DP2A, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.665523117 (347h11m19.396790767s) [noise=true , address=45.91.116.8:4070 , piece_id=7QQ26B76A2JKDIWD2Q7CBSDZVCHG7FYN36QBEQDQIANRKAED4YDA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.666922281 (347h11m19.398189932s) [noise=true , address=77.90.31.19:4860 , piece_id=2AQJC67RND7ACK4MUKJSFNLMULJAZFPFYA2MLLPUI2OYDU5D5N6Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.667251642 (347h11m19.398519292s) [noise=true , address=104.36.82.5:4866 , piece_id=N6SDBVXGJLMVWPNU62YG4TXIN7EVHK6PKO7E4JSTG567BH7KI74A, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668043622 (347h11m19.399311272s) [noise=true , address=104.36.82.12:4166 , piece_id=TZ3OQHREJWS5Y2KC6AJOW5IT4N4FIOKNPWDBAM4VRGFUBEACKN5Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668293092 (347h11m19.399560782s) [noise=true , address=104.36.82.52:4107 , piece_id=F6KXTJFDEVFQ2M3JBFGWW6UKOFV5AQ76T2F63ILGHLBFCQBZR2SA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668766424 (347h11m19.400034074s) [noise=true , address=104.36.82.60:4372 , piece_id=QEOD5XLAU7SL7MBAMSIF56LUUL3AEEOM62OX7NQAXBGCQT5OWTQA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.669011345 (347h11m19.400278996s) [noise=true , address=104.36.82.40:4970 , piece_id=ABJKM5LHC6VMWOCEH2XBG2762H4IAONTFC6TYHDNLU6JMIKYAGSA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.669766005 (347h11m19.401033656s) [noise=true , address=104.36.82.14:4244 , piece_id=BYA6E5F5D4W3NC25K4USWG73NFJBVTFV4BBU4PZGROHWJSIEUYVA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.671541008 (347h11m19.402808658s) [noise=true , address=104.36.82.7:4923 , piece_id=47FFRXO767QLWZYBTKDZ2JTXFIN5YSEXFU3VKACTN562UPMZA3FQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.686950824 (347h11m19.418218474s) [noise=true , address=104.36.82.23:4470 , piece_id=XSFLIIAPLDGS4WLNQ2HUJKT5QCG3QICN3QQRHAJIJLFZEG3JRELQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.686979798 (347h11m19.418247448s) [seg_pos={0 0}, upload=360921]: Segment reached optimal threshold of 14 pieces.
Aug 23 04:37:38.687145141 (347h11m19.41841279s) [noise=true , address=77.90.31.12:4623 , piece_id=4LTRZJRPVXHYXK5V5O2SFXKBPTOZ2VUR7LZVP7MTWNE4FDQIXYAQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ANjFmZrb9SDcqEHW8CBzeMtwvmceoLH9MtPabAjBw8wXjBuaM): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687251049 (347h11m19.418518699s) [noise=true , address=77.90.31.18:4812 , piece_id=5FMHBP74RE4YSIZYW5JAWNGGZHKQO4KV5SLL7CI5DNJYRXNVBSNA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687310421 (347h11m19.418578082s) [noise=true , address=77.90.31.11:4564 , piece_id=EGUX4XHAG5AYXT4AD3ABWH6L4GXR5IWL3XISPMMRA2CSS6I3GOBA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687479038 (347h11m19.418746689s) [noise=true , address=79.127.201.214:4289 , piece_id=EI3IX442PPIS3RLP6BF7KXOYF5PUUFUPZY34MBMFPPL5FOAKI2TQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YfeEiw7zKAYgUcMqMLgEiS2t1gMqdwrpuAdTb2dZouuXRBSM4): protocol: write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection; write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection
Aug 23 04:37:38.687511159 (347h11m19.418778808s) [seg_pos={0 0}, upload=360921]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 04:37:38.687579117 (347h11m19.418846777s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 04:37:38.687584127 (347h11m19.418851786s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 04:37:38.758982305 (347h11m19.490249956s) [upload=360921]: Done uploading segments...
Aug 23 04:37:38.759012683 (347h11m19.490280344s) [upload=360921]: Upload finished. err: <nil>
Duration: 1.021450316s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
1.420446465s
FAIL (2025-08-23 04:49:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 04:11:59.227473138 (346h45m39.958740788s) [upload=360474]: Starting upload Aug 23 04:11:59.227536837 (346h45m39.958804498s) [upload=360474]: Done starting upload Aug 23 04:11:59.227614664 (346h45m39.958882314s) [upload=360474]: Uploading segments... Aug 23 04:11:59.227651072 (346h45m39.958918733s) [upload=360474]: Got next segment. Inline: true Aug 23 04:11:59.227656383 (346h45m39.958924043s) [upload=360474]: Waiting for error group managing segments... Aug 23 04:11:59.227707940 (346h45m39.9589756s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 04:11:59.227716657 (346h45m39.958984317s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 04:11:59.227724952 (346h45m39.958992613s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 04:11:59.230727896 (346h45m39.961995547s) [upload=360474]: Done uploading segments... Aug 23 04:11:59.230740019 (346h45m39.962007669s) [upload=360474]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.420467775s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
358.834007ms
FAIL (2025-08-23 04:48:48 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 04:37:38.488494511 (347h11m19.219762161s) [upload=360921]: Starting upload
Aug 23 04:37:38.488593888 (347h11m19.219861549s) [upload=360921]: Done starting upload
Aug 23 04:37:38.488781211 (347h11m19.220048862s) [upload=360921]: Uploading segments...
Aug 23 04:37:38.489141779 (347h11m19.22040943s) [upload=360921]: Got next segment. Inline: false
Aug 23 04:37:38.489201743 (347h11m19.220469403s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 04:37:38.489211832 (347h11m19.220479482s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 04:37:38.519696232 (347h11m19.250963883s) [seg_pos={0 0}, upload=360921]: Begin upload segment...
Aug 23 04:37:38.519736558 (347h11m19.251004218s) [seg_pos={0 0}, upload=360921]: Done begin upload segment.
Aug 23 04:37:38.519765723 (347h11m19.251033374s) [noise=true , address=104.36.82.5:4866 , piece_id=N6SDBVXGJLMVWPNU62YG4TXIN7EVHK6PKO7E4JSTG567BH7KI74A, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.519779019 (347h11m19.251046669s) [noise=true , address=45.91.116.8:4070 , piece_id=7QQ26B76A2JKDIWD2Q7CBSDZVCHG7FYN36QBEQDQIANRKAED4YDA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520409926 (347h11m19.251677586s) [noise=true , address=77.90.31.11:4564 , piece_id=EGUX4XHAG5AYXT4AD3ABWH6L4GXR5IWL3XISPMMRA2CSS6I3GOBA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520443089 (347h11m19.251710789s) [noise=true , address=104.36.82.14:4244 , piece_id=BYA6E5F5D4W3NC25K4USWG73NFJBVTFV4BBU4PZGROHWJSIEUYVA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520813707 (347h11m19.252081356s) [noise=true , address=79.127.219.47:4065 , piece_id=SMKPN2ZBEP42KYT4KL3NMXE4TQZNROI5PIJUEOVJB7I4XSGTTO2Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520948851 (347h11m19.252216511s) [noise=true , address=104.36.82.40:4970 , piece_id=ABJKM5LHC6VMWOCEH2XBG2762H4IAONTFC6TYHDNLU6JMIKYAGSA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521225030 (347h11m19.252492691s) [noise=true , address=104.36.82.12:4166 , piece_id=TZ3OQHREJWS5Y2KC6AJOW5IT4N4FIOKNPWDBAM4VRGFUBEACKN5Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521323817 (347h11m19.252591467s) [noise=true , address=77.90.31.17:4780 , piece_id=2GMG3LOLE7YBXRH3FAZBOVOUH6H7JO244KXVXH57HY3P6X2IT5UQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521653298 (347h11m19.252920948s) [noise=true , address=45.91.116.5:4301 , piece_id=RZF2GJSTSYN2M4CRCUHFXUEP57WXGQMRMO26BOCIKCWDVPKPRD7Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521765469 (347h11m19.253033119s) [noise=true , address=77.90.31.12:4623 , piece_id=4LTRZJRPVXHYXK5V5O2SFXKBPTOZ2VUR7LZVP7MTWNE4FDQIXYAQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522079320 (347h11m19.25334697s) [noise=true , address=77.90.31.18:4812 , piece_id=5FMHBP74RE4YSIZYW5JAWNGGZHKQO4KV5SLL7CI5DNJYRXNVBSNA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522229032 (347h11m19.253496682s) [noise=true , address=104.36.82.23:4470 , piece_id=XSFLIIAPLDGS4WLNQ2HUJKT5QCG3QICN3QQRHAJIJLFZEG3JRELQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522574643 (347h11m19.253842293s) [noise=true , address=104.36.82.60:4372 , piece_id=QEOD5XLAU7SL7MBAMSIF56LUUL3AEEOM62OX7NQAXBGCQT5OWTQA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522671325 (347h11m19.253938974s) [noise=true , address=45.91.116.12:4230 , piece_id=ZOVILXHAVGUBEXQQQ623QVS3C2ERUW7ODZEB4FRFNFIPP4D7DP2A, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523062421 (347h11m19.254330071s) [noise=true , address=104.36.82.52:4107 , piece_id=F6KXTJFDEVFQ2M3JBFGWW6UKOFV5AQ76T2F63ILGHLBFCQBZR2SA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523466331 (347h11m19.254733981s) [noise=true , address=104.36.82.7:4923 , piece_id=47FFRXO767QLWZYBTKDZ2JTXFIN5YSEXFU3VKACTN562UPMZA3FQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523839645 (347h11m19.255107294s) [noise=true , address=79.127.201.214:4289 , piece_id=EI3IX442PPIS3RLP6BF7KXOYF5PUUFUPZY34MBMFPPL5FOAKI2TQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.526244593 (347h11m19.257512243s) [noise=true , address=77.90.31.19:4860 , piece_id=2AQJC67RND7ACK4MUKJSFNLMULJAZFPFYA2MLLPUI2OYDU5D5N6Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.653911453 (347h11m19.385179102s) [upload=360921]: Next returned nil segment
Aug 23 04:37:38.653927533 (347h11m19.385195183s) [upload=360921]: Waiting for error group managing segments...
Aug 23 04:37:38.662559206 (347h11m19.393826855s) [noise=true , address=79.127.219.47:4065 , piece_id=SMKPN2ZBEP42KYT4KL3NMXE4TQZNROI5PIJUEOVJB7I4XSGTTO2Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664028522 (347h11m19.395296182s) [noise=true , address=77.90.31.17:4780 , piece_id=2GMG3LOLE7YBXRH3FAZBOVOUH6H7JO244KXVXH57HY3P6X2IT5UQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664120556 (347h11m19.395388206s) [noise=true , address=45.91.116.5:4301 , piece_id=RZF2GJSTSYN2M4CRCUHFXUEP57WXGQMRMO26BOCIKCWDVPKPRD7Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664556126 (347h11m19.395823776s) [noise=true , address=45.91.116.12:4230 , piece_id=ZOVILXHAVGUBEXQQQ623QVS3C2ERUW7ODZEB4FRFNFIPP4D7DP2A, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.665523117 (347h11m19.396790767s) [noise=true , address=45.91.116.8:4070 , piece_id=7QQ26B76A2JKDIWD2Q7CBSDZVCHG7FYN36QBEQDQIANRKAED4YDA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.666922281 (347h11m19.398189932s) [noise=true , address=77.90.31.19:4860 , piece_id=2AQJC67RND7ACK4MUKJSFNLMULJAZFPFYA2MLLPUI2OYDU5D5N6Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.667251642 (347h11m19.398519292s) [noise=true , address=104.36.82.5:4866 , piece_id=N6SDBVXGJLMVWPNU62YG4TXIN7EVHK6PKO7E4JSTG567BH7KI74A, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668043622 (347h11m19.399311272s) [noise=true , address=104.36.82.12:4166 , piece_id=TZ3OQHREJWS5Y2KC6AJOW5IT4N4FIOKNPWDBAM4VRGFUBEACKN5Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668293092 (347h11m19.399560782s) [noise=true , address=104.36.82.52:4107 , piece_id=F6KXTJFDEVFQ2M3JBFGWW6UKOFV5AQ76T2F63ILGHLBFCQBZR2SA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668766424 (347h11m19.400034074s) [noise=true , address=104.36.82.60:4372 , piece_id=QEOD5XLAU7SL7MBAMSIF56LUUL3AEEOM62OX7NQAXBGCQT5OWTQA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.669011345 (347h11m19.400278996s) [noise=true , address=104.36.82.40:4970 , piece_id=ABJKM5LHC6VMWOCEH2XBG2762H4IAONTFC6TYHDNLU6JMIKYAGSA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.669766005 (347h11m19.401033656s) [noise=true , address=104.36.82.14:4244 , piece_id=BYA6E5F5D4W3NC25K4USWG73NFJBVTFV4BBU4PZGROHWJSIEUYVA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.671541008 (347h11m19.402808658s) [noise=true , address=104.36.82.7:4923 , piece_id=47FFRXO767QLWZYBTKDZ2JTXFIN5YSEXFU3VKACTN562UPMZA3FQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.686950824 (347h11m19.418218474s) [noise=true , address=104.36.82.23:4470 , piece_id=XSFLIIAPLDGS4WLNQ2HUJKT5QCG3QICN3QQRHAJIJLFZEG3JRELQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.686979798 (347h11m19.418247448s) [seg_pos={0 0}, upload=360921]: Segment reached optimal threshold of 14 pieces.
Aug 23 04:37:38.687145141 (347h11m19.41841279s) [noise=true , address=77.90.31.12:4623 , piece_id=4LTRZJRPVXHYXK5V5O2SFXKBPTOZ2VUR7LZVP7MTWNE4FDQIXYAQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ANjFmZrb9SDcqEHW8CBzeMtwvmceoLH9MtPabAjBw8wXjBuaM): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687251049 (347h11m19.418518699s) [noise=true , address=77.90.31.18:4812 , piece_id=5FMHBP74RE4YSIZYW5JAWNGGZHKQO4KV5SLL7CI5DNJYRXNVBSNA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687310421 (347h11m19.418578082s) [noise=true , address=77.90.31.11:4564 , piece_id=EGUX4XHAG5AYXT4AD3ABWH6L4GXR5IWL3XISPMMRA2CSS6I3GOBA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687479038 (347h11m19.418746689s) [noise=true , address=79.127.201.214:4289 , piece_id=EI3IX442PPIS3RLP6BF7KXOYF5PUUFUPZY34MBMFPPL5FOAKI2TQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YfeEiw7zKAYgUcMqMLgEiS2t1gMqdwrpuAdTb2dZouuXRBSM4): protocol: write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection; write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection
Aug 23 04:37:38.687511159 (347h11m19.418778808s) [seg_pos={0 0}, upload=360921]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 04:37:38.687579117 (347h11m19.418846777s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 04:37:38.687584127 (347h11m19.418851786s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 04:37:38.758982305 (347h11m19.490249956s) [upload=360921]: Done uploading segments...
Aug 23 04:37:38.759012683 (347h11m19.490280344s) [upload=360921]: Upload finished. err: <nil>
Duration: 358.852412ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
236.393639ms
FAIL (2025-08-23 04:48:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 04:11:59.227473138 (346h45m39.958740788s) [upload=360474]: Starting upload Aug 23 04:11:59.227536837 (346h45m39.958804498s) [upload=360474]: Done starting upload Aug 23 04:11:59.227614664 (346h45m39.958882314s) [upload=360474]: Uploading segments... Aug 23 04:11:59.227651072 (346h45m39.958918733s) [upload=360474]: Got next segment. Inline: true Aug 23 04:11:59.227656383 (346h45m39.958924043s) [upload=360474]: Waiting for error group managing segments... Aug 23 04:11:59.227707940 (346h45m39.9589756s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 04:11:59.227716657 (346h45m39.958984317s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 04:11:59.227724952 (346h45m39.958992613s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 04:11:59.230727896 (346h45m39.961995547s) [upload=360474]: Done uploading segments... Aug 23 04:11:59.230740019 (346h45m39.962007669s) [upload=360474]: Upload finished. err: metaclient: Too Many Requests
Duration: 236.415871ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
155.507975ms
FAIL (2025-08-23 04:48:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 04:11:59.227473138 (346h45m39.958740788s) [upload=360474]: Starting upload Aug 23 04:11:59.227536837 (346h45m39.958804498s) [upload=360474]: Done starting upload Aug 23 04:11:59.227614664 (346h45m39.958882314s) [upload=360474]: Uploading segments... Aug 23 04:11:59.227651072 (346h45m39.958918733s) [upload=360474]: Got next segment. Inline: true Aug 23 04:11:59.227656383 (346h45m39.958924043s) [upload=360474]: Waiting for error group managing segments... Aug 23 04:11:59.227707940 (346h45m39.9589756s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 04:11:59.227716657 (346h45m39.958984317s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 04:11:59.227724952 (346h45m39.958992613s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 04:11:59.230727896 (346h45m39.961995547s) [upload=360474]: Done uploading segments... Aug 23 04:11:59.230740019 (346h45m39.962007669s) [upload=360474]: Upload finished. err: metaclient: Too Many Requests
Duration: 155.527032ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
1.74820824s
FAIL (2025-08-23 04:47:54 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 04:37:38.488494511 (347h11m19.219762161s) [upload=360921]: Starting upload
Aug 23 04:37:38.488593888 (347h11m19.219861549s) [upload=360921]: Done starting upload
Aug 23 04:37:38.488781211 (347h11m19.220048862s) [upload=360921]: Uploading segments...
Aug 23 04:37:38.489141779 (347h11m19.22040943s) [upload=360921]: Got next segment. Inline: false
Aug 23 04:37:38.489201743 (347h11m19.220469403s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 04:37:38.489211832 (347h11m19.220479482s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 04:37:38.519696232 (347h11m19.250963883s) [seg_pos={0 0}, upload=360921]: Begin upload segment...
Aug 23 04:37:38.519736558 (347h11m19.251004218s) [seg_pos={0 0}, upload=360921]: Done begin upload segment.
Aug 23 04:37:38.519765723 (347h11m19.251033374s) [noise=true , address=104.36.82.5:4866 , piece_id=N6SDBVXGJLMVWPNU62YG4TXIN7EVHK6PKO7E4JSTG567BH7KI74A, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.519779019 (347h11m19.251046669s) [noise=true , address=45.91.116.8:4070 , piece_id=7QQ26B76A2JKDIWD2Q7CBSDZVCHG7FYN36QBEQDQIANRKAED4YDA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520409926 (347h11m19.251677586s) [noise=true , address=77.90.31.11:4564 , piece_id=EGUX4XHAG5AYXT4AD3ABWH6L4GXR5IWL3XISPMMRA2CSS6I3GOBA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520443089 (347h11m19.251710789s) [noise=true , address=104.36.82.14:4244 , piece_id=BYA6E5F5D4W3NC25K4USWG73NFJBVTFV4BBU4PZGROHWJSIEUYVA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520813707 (347h11m19.252081356s) [noise=true , address=79.127.219.47:4065 , piece_id=SMKPN2ZBEP42KYT4KL3NMXE4TQZNROI5PIJUEOVJB7I4XSGTTO2Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520948851 (347h11m19.252216511s) [noise=true , address=104.36.82.40:4970 , piece_id=ABJKM5LHC6VMWOCEH2XBG2762H4IAONTFC6TYHDNLU6JMIKYAGSA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521225030 (347h11m19.252492691s) [noise=true , address=104.36.82.12:4166 , piece_id=TZ3OQHREJWS5Y2KC6AJOW5IT4N4FIOKNPWDBAM4VRGFUBEACKN5Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521323817 (347h11m19.252591467s) [noise=true , address=77.90.31.17:4780 , piece_id=2GMG3LOLE7YBXRH3FAZBOVOUH6H7JO244KXVXH57HY3P6X2IT5UQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521653298 (347h11m19.252920948s) [noise=true , address=45.91.116.5:4301 , piece_id=RZF2GJSTSYN2M4CRCUHFXUEP57WXGQMRMO26BOCIKCWDVPKPRD7Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521765469 (347h11m19.253033119s) [noise=true , address=77.90.31.12:4623 , piece_id=4LTRZJRPVXHYXK5V5O2SFXKBPTOZ2VUR7LZVP7MTWNE4FDQIXYAQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522079320 (347h11m19.25334697s) [noise=true , address=77.90.31.18:4812 , piece_id=5FMHBP74RE4YSIZYW5JAWNGGZHKQO4KV5SLL7CI5DNJYRXNVBSNA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522229032 (347h11m19.253496682s) [noise=true , address=104.36.82.23:4470 , piece_id=XSFLIIAPLDGS4WLNQ2HUJKT5QCG3QICN3QQRHAJIJLFZEG3JRELQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522574643 (347h11m19.253842293s) [noise=true , address=104.36.82.60:4372 , piece_id=QEOD5XLAU7SL7MBAMSIF56LUUL3AEEOM62OX7NQAXBGCQT5OWTQA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522671325 (347h11m19.253938974s) [noise=true , address=45.91.116.12:4230 , piece_id=ZOVILXHAVGUBEXQQQ623QVS3C2ERUW7ODZEB4FRFNFIPP4D7DP2A, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523062421 (347h11m19.254330071s) [noise=true , address=104.36.82.52:4107 , piece_id=F6KXTJFDEVFQ2M3JBFGWW6UKOFV5AQ76T2F63ILGHLBFCQBZR2SA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523466331 (347h11m19.254733981s) [noise=true , address=104.36.82.7:4923 , piece_id=47FFRXO767QLWZYBTKDZ2JTXFIN5YSEXFU3VKACTN562UPMZA3FQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523839645 (347h11m19.255107294s) [noise=true , address=79.127.201.214:4289 , piece_id=EI3IX442PPIS3RLP6BF7KXOYF5PUUFUPZY34MBMFPPL5FOAKI2TQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.526244593 (347h11m19.257512243s) [noise=true , address=77.90.31.19:4860 , piece_id=2AQJC67RND7ACK4MUKJSFNLMULJAZFPFYA2MLLPUI2OYDU5D5N6Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.653911453 (347h11m19.385179102s) [upload=360921]: Next returned nil segment
Aug 23 04:37:38.653927533 (347h11m19.385195183s) [upload=360921]: Waiting for error group managing segments...
Aug 23 04:37:38.662559206 (347h11m19.393826855s) [noise=true , address=79.127.219.47:4065 , piece_id=SMKPN2ZBEP42KYT4KL3NMXE4TQZNROI5PIJUEOVJB7I4XSGTTO2Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664028522 (347h11m19.395296182s) [noise=true , address=77.90.31.17:4780 , piece_id=2GMG3LOLE7YBXRH3FAZBOVOUH6H7JO244KXVXH57HY3P6X2IT5UQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664120556 (347h11m19.395388206s) [noise=true , address=45.91.116.5:4301 , piece_id=RZF2GJSTSYN2M4CRCUHFXUEP57WXGQMRMO26BOCIKCWDVPKPRD7Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664556126 (347h11m19.395823776s) [noise=true , address=45.91.116.12:4230 , piece_id=ZOVILXHAVGUBEXQQQ623QVS3C2ERUW7ODZEB4FRFNFIPP4D7DP2A, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.665523117 (347h11m19.396790767s) [noise=true , address=45.91.116.8:4070 , piece_id=7QQ26B76A2JKDIWD2Q7CBSDZVCHG7FYN36QBEQDQIANRKAED4YDA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.666922281 (347h11m19.398189932s) [noise=true , address=77.90.31.19:4860 , piece_id=2AQJC67RND7ACK4MUKJSFNLMULJAZFPFYA2MLLPUI2OYDU5D5N6Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.667251642 (347h11m19.398519292s) [noise=true , address=104.36.82.5:4866 , piece_id=N6SDBVXGJLMVWPNU62YG4TXIN7EVHK6PKO7E4JSTG567BH7KI74A, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668043622 (347h11m19.399311272s) [noise=true , address=104.36.82.12:4166 , piece_id=TZ3OQHREJWS5Y2KC6AJOW5IT4N4FIOKNPWDBAM4VRGFUBEACKN5Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668293092 (347h11m19.399560782s) [noise=true , address=104.36.82.52:4107 , piece_id=F6KXTJFDEVFQ2M3JBFGWW6UKOFV5AQ76T2F63ILGHLBFCQBZR2SA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668766424 (347h11m19.400034074s) [noise=true , address=104.36.82.60:4372 , piece_id=QEOD5XLAU7SL7MBAMSIF56LUUL3AEEOM62OX7NQAXBGCQT5OWTQA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.669011345 (347h11m19.400278996s) [noise=true , address=104.36.82.40:4970 , piece_id=ABJKM5LHC6VMWOCEH2XBG2762H4IAONTFC6TYHDNLU6JMIKYAGSA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.669766005 (347h11m19.401033656s) [noise=true , address=104.36.82.14:4244 , piece_id=BYA6E5F5D4W3NC25K4USWG73NFJBVTFV4BBU4PZGROHWJSIEUYVA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.671541008 (347h11m19.402808658s) [noise=true , address=104.36.82.7:4923 , piece_id=47FFRXO767QLWZYBTKDZ2JTXFIN5YSEXFU3VKACTN562UPMZA3FQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.686950824 (347h11m19.418218474s) [noise=true , address=104.36.82.23:4470 , piece_id=XSFLIIAPLDGS4WLNQ2HUJKT5QCG3QICN3QQRHAJIJLFZEG3JRELQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.686979798 (347h11m19.418247448s) [seg_pos={0 0}, upload=360921]: Segment reached optimal threshold of 14 pieces.
Aug 23 04:37:38.687145141 (347h11m19.41841279s) [noise=true , address=77.90.31.12:4623 , piece_id=4LTRZJRPVXHYXK5V5O2SFXKBPTOZ2VUR7LZVP7MTWNE4FDQIXYAQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ANjFmZrb9SDcqEHW8CBzeMtwvmceoLH9MtPabAjBw8wXjBuaM): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687251049 (347h11m19.418518699s) [noise=true , address=77.90.31.18:4812 , piece_id=5FMHBP74RE4YSIZYW5JAWNGGZHKQO4KV5SLL7CI5DNJYRXNVBSNA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687310421 (347h11m19.418578082s) [noise=true , address=77.90.31.11:4564 , piece_id=EGUX4XHAG5AYXT4AD3ABWH6L4GXR5IWL3XISPMMRA2CSS6I3GOBA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687479038 (347h11m19.418746689s) [noise=true , address=79.127.201.214:4289 , piece_id=EI3IX442PPIS3RLP6BF7KXOYF5PUUFUPZY34MBMFPPL5FOAKI2TQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YfeEiw7zKAYgUcMqMLgEiS2t1gMqdwrpuAdTb2dZouuXRBSM4): protocol: write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection; write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection
Aug 23 04:37:38.687511159 (347h11m19.418778808s) [seg_pos={0 0}, upload=360921]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 04:37:38.687579117 (347h11m19.418846777s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 04:37:38.687584127 (347h11m19.418851786s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 04:37:38.758982305 (347h11m19.490249956s) [upload=360921]: Done uploading segments...
Aug 23 04:37:38.759012683 (347h11m19.490280344s) [upload=360921]: Upload finished. err: <nil>
Duration: 1.748228096s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
2.347371476s
FAIL (2025-08-23 04:47:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 04:37:38.488494511 (347h11m19.219762161s) [upload=360921]: Starting upload
Aug 23 04:37:38.488593888 (347h11m19.219861549s) [upload=360921]: Done starting upload
Aug 23 04:37:38.488781211 (347h11m19.220048862s) [upload=360921]: Uploading segments...
Aug 23 04:37:38.489141779 (347h11m19.22040943s) [upload=360921]: Got next segment. Inline: false
Aug 23 04:37:38.489201743 (347h11m19.220469403s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 04:37:38.489211832 (347h11m19.220479482s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 04:37:38.519696232 (347h11m19.250963883s) [seg_pos={0 0}, upload=360921]: Begin upload segment...
Aug 23 04:37:38.519736558 (347h11m19.251004218s) [seg_pos={0 0}, upload=360921]: Done begin upload segment.
Aug 23 04:37:38.519765723 (347h11m19.251033374s) [noise=true , address=104.36.82.5:4866 , piece_id=N6SDBVXGJLMVWPNU62YG4TXIN7EVHK6PKO7E4JSTG567BH7KI74A, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.519779019 (347h11m19.251046669s) [noise=true , address=45.91.116.8:4070 , piece_id=7QQ26B76A2JKDIWD2Q7CBSDZVCHG7FYN36QBEQDQIANRKAED4YDA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520409926 (347h11m19.251677586s) [noise=true , address=77.90.31.11:4564 , piece_id=EGUX4XHAG5AYXT4AD3ABWH6L4GXR5IWL3XISPMMRA2CSS6I3GOBA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520443089 (347h11m19.251710789s) [noise=true , address=104.36.82.14:4244 , piece_id=BYA6E5F5D4W3NC25K4USWG73NFJBVTFV4BBU4PZGROHWJSIEUYVA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520813707 (347h11m19.252081356s) [noise=true , address=79.127.219.47:4065 , piece_id=SMKPN2ZBEP42KYT4KL3NMXE4TQZNROI5PIJUEOVJB7I4XSGTTO2Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520948851 (347h11m19.252216511s) [noise=true , address=104.36.82.40:4970 , piece_id=ABJKM5LHC6VMWOCEH2XBG2762H4IAONTFC6TYHDNLU6JMIKYAGSA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521225030 (347h11m19.252492691s) [noise=true , address=104.36.82.12:4166 , piece_id=TZ3OQHREJWS5Y2KC6AJOW5IT4N4FIOKNPWDBAM4VRGFUBEACKN5Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521323817 (347h11m19.252591467s) [noise=true , address=77.90.31.17:4780 , piece_id=2GMG3LOLE7YBXRH3FAZBOVOUH6H7JO244KXVXH57HY3P6X2IT5UQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521653298 (347h11m19.252920948s) [noise=true , address=45.91.116.5:4301 , piece_id=RZF2GJSTSYN2M4CRCUHFXUEP57WXGQMRMO26BOCIKCWDVPKPRD7Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521765469 (347h11m19.253033119s) [noise=true , address=77.90.31.12:4623 , piece_id=4LTRZJRPVXHYXK5V5O2SFXKBPTOZ2VUR7LZVP7MTWNE4FDQIXYAQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522079320 (347h11m19.25334697s) [noise=true , address=77.90.31.18:4812 , piece_id=5FMHBP74RE4YSIZYW5JAWNGGZHKQO4KV5SLL7CI5DNJYRXNVBSNA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522229032 (347h11m19.253496682s) [noise=true , address=104.36.82.23:4470 , piece_id=XSFLIIAPLDGS4WLNQ2HUJKT5QCG3QICN3QQRHAJIJLFZEG3JRELQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522574643 (347h11m19.253842293s) [noise=true , address=104.36.82.60:4372 , piece_id=QEOD5XLAU7SL7MBAMSIF56LUUL3AEEOM62OX7NQAXBGCQT5OWTQA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522671325 (347h11m19.253938974s) [noise=true , address=45.91.116.12:4230 , piece_id=ZOVILXHAVGUBEXQQQ623QVS3C2ERUW7ODZEB4FRFNFIPP4D7DP2A, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523062421 (347h11m19.254330071s) [noise=true , address=104.36.82.52:4107 , piece_id=F6KXTJFDEVFQ2M3JBFGWW6UKOFV5AQ76T2F63ILGHLBFCQBZR2SA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523466331 (347h11m19.254733981s) [noise=true , address=104.36.82.7:4923 , piece_id=47FFRXO767QLWZYBTKDZ2JTXFIN5YSEXFU3VKACTN562UPMZA3FQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523839645 (347h11m19.255107294s) [noise=true , address=79.127.201.214:4289 , piece_id=EI3IX442PPIS3RLP6BF7KXOYF5PUUFUPZY34MBMFPPL5FOAKI2TQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.526244593 (347h11m19.257512243s) [noise=true , address=77.90.31.19:4860 , piece_id=2AQJC67RND7ACK4MUKJSFNLMULJAZFPFYA2MLLPUI2OYDU5D5N6Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.653911453 (347h11m19.385179102s) [upload=360921]: Next returned nil segment
Aug 23 04:37:38.653927533 (347h11m19.385195183s) [upload=360921]: Waiting for error group managing segments...
Aug 23 04:37:38.662559206 (347h11m19.393826855s) [noise=true , address=79.127.219.47:4065 , piece_id=SMKPN2ZBEP42KYT4KL3NMXE4TQZNROI5PIJUEOVJB7I4XSGTTO2Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664028522 (347h11m19.395296182s) [noise=true , address=77.90.31.17:4780 , piece_id=2GMG3LOLE7YBXRH3FAZBOVOUH6H7JO244KXVXH57HY3P6X2IT5UQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664120556 (347h11m19.395388206s) [noise=true , address=45.91.116.5:4301 , piece_id=RZF2GJSTSYN2M4CRCUHFXUEP57WXGQMRMO26BOCIKCWDVPKPRD7Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664556126 (347h11m19.395823776s) [noise=true , address=45.91.116.12:4230 , piece_id=ZOVILXHAVGUBEXQQQ623QVS3C2ERUW7ODZEB4FRFNFIPP4D7DP2A, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.665523117 (347h11m19.396790767s) [noise=true , address=45.91.116.8:4070 , piece_id=7QQ26B76A2JKDIWD2Q7CBSDZVCHG7FYN36QBEQDQIANRKAED4YDA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.666922281 (347h11m19.398189932s) [noise=true , address=77.90.31.19:4860 , piece_id=2AQJC67RND7ACK4MUKJSFNLMULJAZFPFYA2MLLPUI2OYDU5D5N6Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.667251642 (347h11m19.398519292s) [noise=true , address=104.36.82.5:4866 , piece_id=N6SDBVXGJLMVWPNU62YG4TXIN7EVHK6PKO7E4JSTG567BH7KI74A, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668043622 (347h11m19.399311272s) [noise=true , address=104.36.82.12:4166 , piece_id=TZ3OQHREJWS5Y2KC6AJOW5IT4N4FIOKNPWDBAM4VRGFUBEACKN5Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668293092 (347h11m19.399560782s) [noise=true , address=104.36.82.52:4107 , piece_id=F6KXTJFDEVFQ2M3JBFGWW6UKOFV5AQ76T2F63ILGHLBFCQBZR2SA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668766424 (347h11m19.400034074s) [noise=true , address=104.36.82.60:4372 , piece_id=QEOD5XLAU7SL7MBAMSIF56LUUL3AEEOM62OX7NQAXBGCQT5OWTQA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.669011345 (347h11m19.400278996s) [noise=true , address=104.36.82.40:4970 , piece_id=ABJKM5LHC6VMWOCEH2XBG2762H4IAONTFC6TYHDNLU6JMIKYAGSA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.669766005 (347h11m19.401033656s) [noise=true , address=104.36.82.14:4244 , piece_id=BYA6E5F5D4W3NC25K4USWG73NFJBVTFV4BBU4PZGROHWJSIEUYVA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.671541008 (347h11m19.402808658s) [noise=true , address=104.36.82.7:4923 , piece_id=47FFRXO767QLWZYBTKDZ2JTXFIN5YSEXFU3VKACTN562UPMZA3FQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.686950824 (347h11m19.418218474s) [noise=true , address=104.36.82.23:4470 , piece_id=XSFLIIAPLDGS4WLNQ2HUJKT5QCG3QICN3QQRHAJIJLFZEG3JRELQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.686979798 (347h11m19.418247448s) [seg_pos={0 0}, upload=360921]: Segment reached optimal threshold of 14 pieces.
Aug 23 04:37:38.687145141 (347h11m19.41841279s) [noise=true , address=77.90.31.12:4623 , piece_id=4LTRZJRPVXHYXK5V5O2SFXKBPTOZ2VUR7LZVP7MTWNE4FDQIXYAQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ANjFmZrb9SDcqEHW8CBzeMtwvmceoLH9MtPabAjBw8wXjBuaM): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687251049 (347h11m19.418518699s) [noise=true , address=77.90.31.18:4812 , piece_id=5FMHBP74RE4YSIZYW5JAWNGGZHKQO4KV5SLL7CI5DNJYRXNVBSNA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687310421 (347h11m19.418578082s) [noise=true , address=77.90.31.11:4564 , piece_id=EGUX4XHAG5AYXT4AD3ABWH6L4GXR5IWL3XISPMMRA2CSS6I3GOBA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687479038 (347h11m19.418746689s) [noise=true , address=79.127.201.214:4289 , piece_id=EI3IX442PPIS3RLP6BF7KXOYF5PUUFUPZY34MBMFPPL5FOAKI2TQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YfeEiw7zKAYgUcMqMLgEiS2t1gMqdwrpuAdTb2dZouuXRBSM4): protocol: write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection; write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection
Aug 23 04:37:38.687511159 (347h11m19.418778808s) [seg_pos={0 0}, upload=360921]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 04:37:38.687579117 (347h11m19.418846777s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 04:37:38.687584127 (347h11m19.418851786s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 04:37:38.758982305 (347h11m19.490249956s) [upload=360921]: Done uploading segments...
Aug 23 04:37:38.759012683 (347h11m19.490280344s) [upload=360921]: Upload finished. err: <nil>
Duration: 2.347402755s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
207.861312ms
FAIL (2025-08-23 04:47:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 04:11:59.227473138 (346h45m39.958740788s) [upload=360474]: Starting upload Aug 23 04:11:59.227536837 (346h45m39.958804498s) [upload=360474]: Done starting upload Aug 23 04:11:59.227614664 (346h45m39.958882314s) [upload=360474]: Uploading segments... Aug 23 04:11:59.227651072 (346h45m39.958918733s) [upload=360474]: Got next segment. Inline: true Aug 23 04:11:59.227656383 (346h45m39.958924043s) [upload=360474]: Waiting for error group managing segments... Aug 23 04:11:59.227707940 (346h45m39.9589756s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 04:11:59.227716657 (346h45m39.958984317s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 04:11:59.227724952 (346h45m39.958992613s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 04:11:59.230727896 (346h45m39.961995547s) [upload=360474]: Done uploading segments... Aug 23 04:11:59.230740019 (346h45m39.962007669s) [upload=360474]: Upload finished. err: metaclient: Too Many Requests
Duration: 207.880178ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
350.864916ms
FAIL (2025-08-23 04:46:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 04:11:59.227473138 (346h45m39.958740788s) [upload=360474]: Starting upload Aug 23 04:11:59.227536837 (346h45m39.958804498s) [upload=360474]: Done starting upload Aug 23 04:11:59.227614664 (346h45m39.958882314s) [upload=360474]: Uploading segments... Aug 23 04:11:59.227651072 (346h45m39.958918733s) [upload=360474]: Got next segment. Inline: true Aug 23 04:11:59.227656383 (346h45m39.958924043s) [upload=360474]: Waiting for error group managing segments... Aug 23 04:11:59.227707940 (346h45m39.9589756s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 04:11:59.227716657 (346h45m39.958984317s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 04:11:59.227724952 (346h45m39.958992613s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 04:11:59.230727896 (346h45m39.961995547s) [upload=360474]: Done uploading segments... Aug 23 04:11:59.230740019 (346h45m39.962007669s) [upload=360474]: Upload finished. err: metaclient: Too Many Requests
Duration: 350.959505ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
1.836374428s
FAIL (2025-08-23 04:46:34 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 04:37:38.488494511 (347h11m19.219762161s) [upload=360921]: Starting upload
Aug 23 04:37:38.488593888 (347h11m19.219861549s) [upload=360921]: Done starting upload
Aug 23 04:37:38.488781211 (347h11m19.220048862s) [upload=360921]: Uploading segments...
Aug 23 04:37:38.489141779 (347h11m19.22040943s) [upload=360921]: Got next segment. Inline: false
Aug 23 04:37:38.489201743 (347h11m19.220469403s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 04:37:38.489211832 (347h11m19.220479482s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 04:37:38.519696232 (347h11m19.250963883s) [seg_pos={0 0}, upload=360921]: Begin upload segment...
Aug 23 04:37:38.519736558 (347h11m19.251004218s) [seg_pos={0 0}, upload=360921]: Done begin upload segment.
Aug 23 04:37:38.519765723 (347h11m19.251033374s) [noise=true , address=104.36.82.5:4866 , piece_id=N6SDBVXGJLMVWPNU62YG4TXIN7EVHK6PKO7E4JSTG567BH7KI74A, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.519779019 (347h11m19.251046669s) [noise=true , address=45.91.116.8:4070 , piece_id=7QQ26B76A2JKDIWD2Q7CBSDZVCHG7FYN36QBEQDQIANRKAED4YDA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520409926 (347h11m19.251677586s) [noise=true , address=77.90.31.11:4564 , piece_id=EGUX4XHAG5AYXT4AD3ABWH6L4GXR5IWL3XISPMMRA2CSS6I3GOBA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520443089 (347h11m19.251710789s) [noise=true , address=104.36.82.14:4244 , piece_id=BYA6E5F5D4W3NC25K4USWG73NFJBVTFV4BBU4PZGROHWJSIEUYVA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520813707 (347h11m19.252081356s) [noise=true , address=79.127.219.47:4065 , piece_id=SMKPN2ZBEP42KYT4KL3NMXE4TQZNROI5PIJUEOVJB7I4XSGTTO2Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520948851 (347h11m19.252216511s) [noise=true , address=104.36.82.40:4970 , piece_id=ABJKM5LHC6VMWOCEH2XBG2762H4IAONTFC6TYHDNLU6JMIKYAGSA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521225030 (347h11m19.252492691s) [noise=true , address=104.36.82.12:4166 , piece_id=TZ3OQHREJWS5Y2KC6AJOW5IT4N4FIOKNPWDBAM4VRGFUBEACKN5Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521323817 (347h11m19.252591467s) [noise=true , address=77.90.31.17:4780 , piece_id=2GMG3LOLE7YBXRH3FAZBOVOUH6H7JO244KXVXH57HY3P6X2IT5UQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521653298 (347h11m19.252920948s) [noise=true , address=45.91.116.5:4301 , piece_id=RZF2GJSTSYN2M4CRCUHFXUEP57WXGQMRMO26BOCIKCWDVPKPRD7Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521765469 (347h11m19.253033119s) [noise=true , address=77.90.31.12:4623 , piece_id=4LTRZJRPVXHYXK5V5O2SFXKBPTOZ2VUR7LZVP7MTWNE4FDQIXYAQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522079320 (347h11m19.25334697s) [noise=true , address=77.90.31.18:4812 , piece_id=5FMHBP74RE4YSIZYW5JAWNGGZHKQO4KV5SLL7CI5DNJYRXNVBSNA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522229032 (347h11m19.253496682s) [noise=true , address=104.36.82.23:4470 , piece_id=XSFLIIAPLDGS4WLNQ2HUJKT5QCG3QICN3QQRHAJIJLFZEG3JRELQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522574643 (347h11m19.253842293s) [noise=true , address=104.36.82.60:4372 , piece_id=QEOD5XLAU7SL7MBAMSIF56LUUL3AEEOM62OX7NQAXBGCQT5OWTQA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522671325 (347h11m19.253938974s) [noise=true , address=45.91.116.12:4230 , piece_id=ZOVILXHAVGUBEXQQQ623QVS3C2ERUW7ODZEB4FRFNFIPP4D7DP2A, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523062421 (347h11m19.254330071s) [noise=true , address=104.36.82.52:4107 , piece_id=F6KXTJFDEVFQ2M3JBFGWW6UKOFV5AQ76T2F63ILGHLBFCQBZR2SA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523466331 (347h11m19.254733981s) [noise=true , address=104.36.82.7:4923 , piece_id=47FFRXO767QLWZYBTKDZ2JTXFIN5YSEXFU3VKACTN562UPMZA3FQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523839645 (347h11m19.255107294s) [noise=true , address=79.127.201.214:4289 , piece_id=EI3IX442PPIS3RLP6BF7KXOYF5PUUFUPZY34MBMFPPL5FOAKI2TQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.526244593 (347h11m19.257512243s) [noise=true , address=77.90.31.19:4860 , piece_id=2AQJC67RND7ACK4MUKJSFNLMULJAZFPFYA2MLLPUI2OYDU5D5N6Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.653911453 (347h11m19.385179102s) [upload=360921]: Next returned nil segment
Aug 23 04:37:38.653927533 (347h11m19.385195183s) [upload=360921]: Waiting for error group managing segments...
Aug 23 04:37:38.662559206 (347h11m19.393826855s) [noise=true , address=79.127.219.47:4065 , piece_id=SMKPN2ZBEP42KYT4KL3NMXE4TQZNROI5PIJUEOVJB7I4XSGTTO2Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664028522 (347h11m19.395296182s) [noise=true , address=77.90.31.17:4780 , piece_id=2GMG3LOLE7YBXRH3FAZBOVOUH6H7JO244KXVXH57HY3P6X2IT5UQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664120556 (347h11m19.395388206s) [noise=true , address=45.91.116.5:4301 , piece_id=RZF2GJSTSYN2M4CRCUHFXUEP57WXGQMRMO26BOCIKCWDVPKPRD7Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664556126 (347h11m19.395823776s) [noise=true , address=45.91.116.12:4230 , piece_id=ZOVILXHAVGUBEXQQQ623QVS3C2ERUW7ODZEB4FRFNFIPP4D7DP2A, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.665523117 (347h11m19.396790767s) [noise=true , address=45.91.116.8:4070 , piece_id=7QQ26B76A2JKDIWD2Q7CBSDZVCHG7FYN36QBEQDQIANRKAED4YDA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.666922281 (347h11m19.398189932s) [noise=true , address=77.90.31.19:4860 , piece_id=2AQJC67RND7ACK4MUKJSFNLMULJAZFPFYA2MLLPUI2OYDU5D5N6Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.667251642 (347h11m19.398519292s) [noise=true , address=104.36.82.5:4866 , piece_id=N6SDBVXGJLMVWPNU62YG4TXIN7EVHK6PKO7E4JSTG567BH7KI74A, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668043622 (347h11m19.399311272s) [noise=true , address=104.36.82.12:4166 , piece_id=TZ3OQHREJWS5Y2KC6AJOW5IT4N4FIOKNPWDBAM4VRGFUBEACKN5Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668293092 (347h11m19.399560782s) [noise=true , address=104.36.82.52:4107 , piece_id=F6KXTJFDEVFQ2M3JBFGWW6UKOFV5AQ76T2F63ILGHLBFCQBZR2SA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668766424 (347h11m19.400034074s) [noise=true , address=104.36.82.60:4372 , piece_id=QEOD5XLAU7SL7MBAMSIF56LUUL3AEEOM62OX7NQAXBGCQT5OWTQA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.669011345 (347h11m19.400278996s) [noise=true , address=104.36.82.40:4970 , piece_id=ABJKM5LHC6VMWOCEH2XBG2762H4IAONTFC6TYHDNLU6JMIKYAGSA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.669766005 (347h11m19.401033656s) [noise=true , address=104.36.82.14:4244 , piece_id=BYA6E5F5D4W3NC25K4USWG73NFJBVTFV4BBU4PZGROHWJSIEUYVA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.671541008 (347h11m19.402808658s) [noise=true , address=104.36.82.7:4923 , piece_id=47FFRXO767QLWZYBTKDZ2JTXFIN5YSEXFU3VKACTN562UPMZA3FQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.686950824 (347h11m19.418218474s) [noise=true , address=104.36.82.23:4470 , piece_id=XSFLIIAPLDGS4WLNQ2HUJKT5QCG3QICN3QQRHAJIJLFZEG3JRELQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.686979798 (347h11m19.418247448s) [seg_pos={0 0}, upload=360921]: Segment reached optimal threshold of 14 pieces.
Aug 23 04:37:38.687145141 (347h11m19.41841279s) [noise=true , address=77.90.31.12:4623 , piece_id=4LTRZJRPVXHYXK5V5O2SFXKBPTOZ2VUR7LZVP7MTWNE4FDQIXYAQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ANjFmZrb9SDcqEHW8CBzeMtwvmceoLH9MtPabAjBw8wXjBuaM): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687251049 (347h11m19.418518699s) [noise=true , address=77.90.31.18:4812 , piece_id=5FMHBP74RE4YSIZYW5JAWNGGZHKQO4KV5SLL7CI5DNJYRXNVBSNA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687310421 (347h11m19.418578082s) [noise=true , address=77.90.31.11:4564 , piece_id=EGUX4XHAG5AYXT4AD3ABWH6L4GXR5IWL3XISPMMRA2CSS6I3GOBA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687479038 (347h11m19.418746689s) [noise=true , address=79.127.201.214:4289 , piece_id=EI3IX442PPIS3RLP6BF7KXOYF5PUUFUPZY34MBMFPPL5FOAKI2TQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YfeEiw7zKAYgUcMqMLgEiS2t1gMqdwrpuAdTb2dZouuXRBSM4): protocol: write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection; write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection
Aug 23 04:37:38.687511159 (347h11m19.418778808s) [seg_pos={0 0}, upload=360921]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 04:37:38.687579117 (347h11m19.418846777s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 04:37:38.687584127 (347h11m19.418851786s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 04:37:38.758982305 (347h11m19.490249956s) [upload=360921]: Done uploading segments...
Aug 23 04:37:38.759012683 (347h11m19.490280344s) [upload=360921]: Upload finished. err: <nil>
Duration: 1.836400657s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
125.797539ms
FAIL (2025-08-23 04:45:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 04:11:59.227473138 (346h45m39.958740788s) [upload=360474]: Starting upload Aug 23 04:11:59.227536837 (346h45m39.958804498s) [upload=360474]: Done starting upload Aug 23 04:11:59.227614664 (346h45m39.958882314s) [upload=360474]: Uploading segments... Aug 23 04:11:59.227651072 (346h45m39.958918733s) [upload=360474]: Got next segment. Inline: true Aug 23 04:11:59.227656383 (346h45m39.958924043s) [upload=360474]: Waiting for error group managing segments... Aug 23 04:11:59.227707940 (346h45m39.9589756s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 04:11:59.227716657 (346h45m39.958984317s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 04:11:59.227724952 (346h45m39.958992613s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 04:11:59.230727896 (346h45m39.961995547s) [upload=360474]: Done uploading segments... Aug 23 04:11:59.230740019 (346h45m39.962007669s) [upload=360474]: Upload finished. err: metaclient: Too Many Requests
Duration: 125.818649ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
2.447557614s
FAIL (2025-08-23 04:45:31 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 04:37:38.488494511 (347h11m19.219762161s) [upload=360921]: Starting upload
Aug 23 04:37:38.488593888 (347h11m19.219861549s) [upload=360921]: Done starting upload
Aug 23 04:37:38.488781211 (347h11m19.220048862s) [upload=360921]: Uploading segments...
Aug 23 04:37:38.489141779 (347h11m19.22040943s) [upload=360921]: Got next segment. Inline: false
Aug 23 04:37:38.489201743 (347h11m19.220469403s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 04:37:38.489211832 (347h11m19.220479482s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 04:37:38.519696232 (347h11m19.250963883s) [seg_pos={0 0}, upload=360921]: Begin upload segment...
Aug 23 04:37:38.519736558 (347h11m19.251004218s) [seg_pos={0 0}, upload=360921]: Done begin upload segment.
Aug 23 04:37:38.519765723 (347h11m19.251033374s) [noise=true , address=104.36.82.5:4866 , piece_id=N6SDBVXGJLMVWPNU62YG4TXIN7EVHK6PKO7E4JSTG567BH7KI74A, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.519779019 (347h11m19.251046669s) [noise=true , address=45.91.116.8:4070 , piece_id=7QQ26B76A2JKDIWD2Q7CBSDZVCHG7FYN36QBEQDQIANRKAED4YDA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520409926 (347h11m19.251677586s) [noise=true , address=77.90.31.11:4564 , piece_id=EGUX4XHAG5AYXT4AD3ABWH6L4GXR5IWL3XISPMMRA2CSS6I3GOBA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520443089 (347h11m19.251710789s) [noise=true , address=104.36.82.14:4244 , piece_id=BYA6E5F5D4W3NC25K4USWG73NFJBVTFV4BBU4PZGROHWJSIEUYVA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520813707 (347h11m19.252081356s) [noise=true , address=79.127.219.47:4065 , piece_id=SMKPN2ZBEP42KYT4KL3NMXE4TQZNROI5PIJUEOVJB7I4XSGTTO2Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520948851 (347h11m19.252216511s) [noise=true , address=104.36.82.40:4970 , piece_id=ABJKM5LHC6VMWOCEH2XBG2762H4IAONTFC6TYHDNLU6JMIKYAGSA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521225030 (347h11m19.252492691s) [noise=true , address=104.36.82.12:4166 , piece_id=TZ3OQHREJWS5Y2KC6AJOW5IT4N4FIOKNPWDBAM4VRGFUBEACKN5Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521323817 (347h11m19.252591467s) [noise=true , address=77.90.31.17:4780 , piece_id=2GMG3LOLE7YBXRH3FAZBOVOUH6H7JO244KXVXH57HY3P6X2IT5UQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521653298 (347h11m19.252920948s) [noise=true , address=45.91.116.5:4301 , piece_id=RZF2GJSTSYN2M4CRCUHFXUEP57WXGQMRMO26BOCIKCWDVPKPRD7Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521765469 (347h11m19.253033119s) [noise=true , address=77.90.31.12:4623 , piece_id=4LTRZJRPVXHYXK5V5O2SFXKBPTOZ2VUR7LZVP7MTWNE4FDQIXYAQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522079320 (347h11m19.25334697s) [noise=true , address=77.90.31.18:4812 , piece_id=5FMHBP74RE4YSIZYW5JAWNGGZHKQO4KV5SLL7CI5DNJYRXNVBSNA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522229032 (347h11m19.253496682s) [noise=true , address=104.36.82.23:4470 , piece_id=XSFLIIAPLDGS4WLNQ2HUJKT5QCG3QICN3QQRHAJIJLFZEG3JRELQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522574643 (347h11m19.253842293s) [noise=true , address=104.36.82.60:4372 , piece_id=QEOD5XLAU7SL7MBAMSIF56LUUL3AEEOM62OX7NQAXBGCQT5OWTQA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522671325 (347h11m19.253938974s) [noise=true , address=45.91.116.12:4230 , piece_id=ZOVILXHAVGUBEXQQQ623QVS3C2ERUW7ODZEB4FRFNFIPP4D7DP2A, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523062421 (347h11m19.254330071s) [noise=true , address=104.36.82.52:4107 , piece_id=F6KXTJFDEVFQ2M3JBFGWW6UKOFV5AQ76T2F63ILGHLBFCQBZR2SA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523466331 (347h11m19.254733981s) [noise=true , address=104.36.82.7:4923 , piece_id=47FFRXO767QLWZYBTKDZ2JTXFIN5YSEXFU3VKACTN562UPMZA3FQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523839645 (347h11m19.255107294s) [noise=true , address=79.127.201.214:4289 , piece_id=EI3IX442PPIS3RLP6BF7KXOYF5PUUFUPZY34MBMFPPL5FOAKI2TQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.526244593 (347h11m19.257512243s) [noise=true , address=77.90.31.19:4860 , piece_id=2AQJC67RND7ACK4MUKJSFNLMULJAZFPFYA2MLLPUI2OYDU5D5N6Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.653911453 (347h11m19.385179102s) [upload=360921]: Next returned nil segment
Aug 23 04:37:38.653927533 (347h11m19.385195183s) [upload=360921]: Waiting for error group managing segments...
Aug 23 04:37:38.662559206 (347h11m19.393826855s) [noise=true , address=79.127.219.47:4065 , piece_id=SMKPN2ZBEP42KYT4KL3NMXE4TQZNROI5PIJUEOVJB7I4XSGTTO2Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664028522 (347h11m19.395296182s) [noise=true , address=77.90.31.17:4780 , piece_id=2GMG3LOLE7YBXRH3FAZBOVOUH6H7JO244KXVXH57HY3P6X2IT5UQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664120556 (347h11m19.395388206s) [noise=true , address=45.91.116.5:4301 , piece_id=RZF2GJSTSYN2M4CRCUHFXUEP57WXGQMRMO26BOCIKCWDVPKPRD7Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664556126 (347h11m19.395823776s) [noise=true , address=45.91.116.12:4230 , piece_id=ZOVILXHAVGUBEXQQQ623QVS3C2ERUW7ODZEB4FRFNFIPP4D7DP2A, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.665523117 (347h11m19.396790767s) [noise=true , address=45.91.116.8:4070 , piece_id=7QQ26B76A2JKDIWD2Q7CBSDZVCHG7FYN36QBEQDQIANRKAED4YDA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.666922281 (347h11m19.398189932s) [noise=true , address=77.90.31.19:4860 , piece_id=2AQJC67RND7ACK4MUKJSFNLMULJAZFPFYA2MLLPUI2OYDU5D5N6Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.667251642 (347h11m19.398519292s) [noise=true , address=104.36.82.5:4866 , piece_id=N6SDBVXGJLMVWPNU62YG4TXIN7EVHK6PKO7E4JSTG567BH7KI74A, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668043622 (347h11m19.399311272s) [noise=true , address=104.36.82.12:4166 , piece_id=TZ3OQHREJWS5Y2KC6AJOW5IT4N4FIOKNPWDBAM4VRGFUBEACKN5Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668293092 (347h11m19.399560782s) [noise=true , address=104.36.82.52:4107 , piece_id=F6KXTJFDEVFQ2M3JBFGWW6UKOFV5AQ76T2F63ILGHLBFCQBZR2SA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668766424 (347h11m19.400034074s) [noise=true , address=104.36.82.60:4372 , piece_id=QEOD5XLAU7SL7MBAMSIF56LUUL3AEEOM62OX7NQAXBGCQT5OWTQA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.669011345 (347h11m19.400278996s) [noise=true , address=104.36.82.40:4970 , piece_id=ABJKM5LHC6VMWOCEH2XBG2762H4IAONTFC6TYHDNLU6JMIKYAGSA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.669766005 (347h11m19.401033656s) [noise=true , address=104.36.82.14:4244 , piece_id=BYA6E5F5D4W3NC25K4USWG73NFJBVTFV4BBU4PZGROHWJSIEUYVA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.671541008 (347h11m19.402808658s) [noise=true , address=104.36.82.7:4923 , piece_id=47FFRXO767QLWZYBTKDZ2JTXFIN5YSEXFU3VKACTN562UPMZA3FQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.686950824 (347h11m19.418218474s) [noise=true , address=104.36.82.23:4470 , piece_id=XSFLIIAPLDGS4WLNQ2HUJKT5QCG3QICN3QQRHAJIJLFZEG3JRELQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.686979798 (347h11m19.418247448s) [seg_pos={0 0}, upload=360921]: Segment reached optimal threshold of 14 pieces.
Aug 23 04:37:38.687145141 (347h11m19.41841279s) [noise=true , address=77.90.31.12:4623 , piece_id=4LTRZJRPVXHYXK5V5O2SFXKBPTOZ2VUR7LZVP7MTWNE4FDQIXYAQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ANjFmZrb9SDcqEHW8CBzeMtwvmceoLH9MtPabAjBw8wXjBuaM): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687251049 (347h11m19.418518699s) [noise=true , address=77.90.31.18:4812 , piece_id=5FMHBP74RE4YSIZYW5JAWNGGZHKQO4KV5SLL7CI5DNJYRXNVBSNA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687310421 (347h11m19.418578082s) [noise=true , address=77.90.31.11:4564 , piece_id=EGUX4XHAG5AYXT4AD3ABWH6L4GXR5IWL3XISPMMRA2CSS6I3GOBA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687479038 (347h11m19.418746689s) [noise=true , address=79.127.201.214:4289 , piece_id=EI3IX442PPIS3RLP6BF7KXOYF5PUUFUPZY34MBMFPPL5FOAKI2TQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YfeEiw7zKAYgUcMqMLgEiS2t1gMqdwrpuAdTb2dZouuXRBSM4): protocol: write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection; write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection
Aug 23 04:37:38.687511159 (347h11m19.418778808s) [seg_pos={0 0}, upload=360921]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 04:37:38.687579117 (347h11m19.418846777s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 04:37:38.687584127 (347h11m19.418851786s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 04:37:38.758982305 (347h11m19.490249956s) [upload=360921]: Done uploading segments...
Aug 23 04:37:38.759012683 (347h11m19.490280344s) [upload=360921]: Upload finished. err: <nil>
Duration: 2.447581359s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
592.12621ms
FAIL (2025-08-23 04:45:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 04:11:59.227473138 (346h45m39.958740788s) [upload=360474]: Starting upload Aug 23 04:11:59.227536837 (346h45m39.958804498s) [upload=360474]: Done starting upload Aug 23 04:11:59.227614664 (346h45m39.958882314s) [upload=360474]: Uploading segments... Aug 23 04:11:59.227651072 (346h45m39.958918733s) [upload=360474]: Got next segment. Inline: true Aug 23 04:11:59.227656383 (346h45m39.958924043s) [upload=360474]: Waiting for error group managing segments... Aug 23 04:11:59.227707940 (346h45m39.9589756s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 04:11:59.227716657 (346h45m39.958984317s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 04:11:59.227724952 (346h45m39.958992613s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 04:11:59.230727896 (346h45m39.961995547s) [upload=360474]: Done uploading segments... Aug 23 04:11:59.230740019 (346h45m39.962007669s) [upload=360474]: Upload finished. err: metaclient: Too Many Requests
Duration: 592.147632ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
394.983051ms
FAIL (2025-08-23 04:44:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 04:11:59.227473138 (346h45m39.958740788s) [upload=360474]: Starting upload Aug 23 04:11:59.227536837 (346h45m39.958804498s) [upload=360474]: Done starting upload Aug 23 04:11:59.227614664 (346h45m39.958882314s) [upload=360474]: Uploading segments... Aug 23 04:11:59.227651072 (346h45m39.958918733s) [upload=360474]: Got next segment. Inline: true Aug 23 04:11:59.227656383 (346h45m39.958924043s) [upload=360474]: Waiting for error group managing segments... Aug 23 04:11:59.227707940 (346h45m39.9589756s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 04:11:59.227716657 (346h45m39.958984317s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 04:11:59.227724952 (346h45m39.958992613s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 04:11:59.230727896 (346h45m39.961995547s) [upload=360474]: Done uploading segments... Aug 23 04:11:59.230740019 (346h45m39.962007669s) [upload=360474]: Upload finished. err: metaclient: Too Many Requests
Duration: 395.012336ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
1.869166303s
FAIL (2025-08-23 04:44:26 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 04:37:38.488494511 (347h11m19.219762161s) [upload=360921]: Starting upload
Aug 23 04:37:38.488593888 (347h11m19.219861549s) [upload=360921]: Done starting upload
Aug 23 04:37:38.488781211 (347h11m19.220048862s) [upload=360921]: Uploading segments...
Aug 23 04:37:38.489141779 (347h11m19.22040943s) [upload=360921]: Got next segment. Inline: false
Aug 23 04:37:38.489201743 (347h11m19.220469403s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 04:37:38.489211832 (347h11m19.220479482s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 04:37:38.519696232 (347h11m19.250963883s) [seg_pos={0 0}, upload=360921]: Begin upload segment...
Aug 23 04:37:38.519736558 (347h11m19.251004218s) [seg_pos={0 0}, upload=360921]: Done begin upload segment.
Aug 23 04:37:38.519765723 (347h11m19.251033374s) [noise=true , address=104.36.82.5:4866 , piece_id=N6SDBVXGJLMVWPNU62YG4TXIN7EVHK6PKO7E4JSTG567BH7KI74A, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.519779019 (347h11m19.251046669s) [noise=true , address=45.91.116.8:4070 , piece_id=7QQ26B76A2JKDIWD2Q7CBSDZVCHG7FYN36QBEQDQIANRKAED4YDA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520409926 (347h11m19.251677586s) [noise=true , address=77.90.31.11:4564 , piece_id=EGUX4XHAG5AYXT4AD3ABWH6L4GXR5IWL3XISPMMRA2CSS6I3GOBA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520443089 (347h11m19.251710789s) [noise=true , address=104.36.82.14:4244 , piece_id=BYA6E5F5D4W3NC25K4USWG73NFJBVTFV4BBU4PZGROHWJSIEUYVA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520813707 (347h11m19.252081356s) [noise=true , address=79.127.219.47:4065 , piece_id=SMKPN2ZBEP42KYT4KL3NMXE4TQZNROI5PIJUEOVJB7I4XSGTTO2Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520948851 (347h11m19.252216511s) [noise=true , address=104.36.82.40:4970 , piece_id=ABJKM5LHC6VMWOCEH2XBG2762H4IAONTFC6TYHDNLU6JMIKYAGSA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521225030 (347h11m19.252492691s) [noise=true , address=104.36.82.12:4166 , piece_id=TZ3OQHREJWS5Y2KC6AJOW5IT4N4FIOKNPWDBAM4VRGFUBEACKN5Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521323817 (347h11m19.252591467s) [noise=true , address=77.90.31.17:4780 , piece_id=2GMG3LOLE7YBXRH3FAZBOVOUH6H7JO244KXVXH57HY3P6X2IT5UQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521653298 (347h11m19.252920948s) [noise=true , address=45.91.116.5:4301 , piece_id=RZF2GJSTSYN2M4CRCUHFXUEP57WXGQMRMO26BOCIKCWDVPKPRD7Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521765469 (347h11m19.253033119s) [noise=true , address=77.90.31.12:4623 , piece_id=4LTRZJRPVXHYXK5V5O2SFXKBPTOZ2VUR7LZVP7MTWNE4FDQIXYAQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522079320 (347h11m19.25334697s) [noise=true , address=77.90.31.18:4812 , piece_id=5FMHBP74RE4YSIZYW5JAWNGGZHKQO4KV5SLL7CI5DNJYRXNVBSNA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522229032 (347h11m19.253496682s) [noise=true , address=104.36.82.23:4470 , piece_id=XSFLIIAPLDGS4WLNQ2HUJKT5QCG3QICN3QQRHAJIJLFZEG3JRELQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522574643 (347h11m19.253842293s) [noise=true , address=104.36.82.60:4372 , piece_id=QEOD5XLAU7SL7MBAMSIF56LUUL3AEEOM62OX7NQAXBGCQT5OWTQA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522671325 (347h11m19.253938974s) [noise=true , address=45.91.116.12:4230 , piece_id=ZOVILXHAVGUBEXQQQ623QVS3C2ERUW7ODZEB4FRFNFIPP4D7DP2A, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523062421 (347h11m19.254330071s) [noise=true , address=104.36.82.52:4107 , piece_id=F6KXTJFDEVFQ2M3JBFGWW6UKOFV5AQ76T2F63ILGHLBFCQBZR2SA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523466331 (347h11m19.254733981s) [noise=true , address=104.36.82.7:4923 , piece_id=47FFRXO767QLWZYBTKDZ2JTXFIN5YSEXFU3VKACTN562UPMZA3FQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523839645 (347h11m19.255107294s) [noise=true , address=79.127.201.214:4289 , piece_id=EI3IX442PPIS3RLP6BF7KXOYF5PUUFUPZY34MBMFPPL5FOAKI2TQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.526244593 (347h11m19.257512243s) [noise=true , address=77.90.31.19:4860 , piece_id=2AQJC67RND7ACK4MUKJSFNLMULJAZFPFYA2MLLPUI2OYDU5D5N6Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.653911453 (347h11m19.385179102s) [upload=360921]: Next returned nil segment
Aug 23 04:37:38.653927533 (347h11m19.385195183s) [upload=360921]: Waiting for error group managing segments...
Aug 23 04:37:38.662559206 (347h11m19.393826855s) [noise=true , address=79.127.219.47:4065 , piece_id=SMKPN2ZBEP42KYT4KL3NMXE4TQZNROI5PIJUEOVJB7I4XSGTTO2Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664028522 (347h11m19.395296182s) [noise=true , address=77.90.31.17:4780 , piece_id=2GMG3LOLE7YBXRH3FAZBOVOUH6H7JO244KXVXH57HY3P6X2IT5UQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664120556 (347h11m19.395388206s) [noise=true , address=45.91.116.5:4301 , piece_id=RZF2GJSTSYN2M4CRCUHFXUEP57WXGQMRMO26BOCIKCWDVPKPRD7Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664556126 (347h11m19.395823776s) [noise=true , address=45.91.116.12:4230 , piece_id=ZOVILXHAVGUBEXQQQ623QVS3C2ERUW7ODZEB4FRFNFIPP4D7DP2A, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.665523117 (347h11m19.396790767s) [noise=true , address=45.91.116.8:4070 , piece_id=7QQ26B76A2JKDIWD2Q7CBSDZVCHG7FYN36QBEQDQIANRKAED4YDA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.666922281 (347h11m19.398189932s) [noise=true , address=77.90.31.19:4860 , piece_id=2AQJC67RND7ACK4MUKJSFNLMULJAZFPFYA2MLLPUI2OYDU5D5N6Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.667251642 (347h11m19.398519292s) [noise=true , address=104.36.82.5:4866 , piece_id=N6SDBVXGJLMVWPNU62YG4TXIN7EVHK6PKO7E4JSTG567BH7KI74A, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668043622 (347h11m19.399311272s) [noise=true , address=104.36.82.12:4166 , piece_id=TZ3OQHREJWS5Y2KC6AJOW5IT4N4FIOKNPWDBAM4VRGFUBEACKN5Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668293092 (347h11m19.399560782s) [noise=true , address=104.36.82.52:4107 , piece_id=F6KXTJFDEVFQ2M3JBFGWW6UKOFV5AQ76T2F63ILGHLBFCQBZR2SA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668766424 (347h11m19.400034074s) [noise=true , address=104.36.82.60:4372 , piece_id=QEOD5XLAU7SL7MBAMSIF56LUUL3AEEOM62OX7NQAXBGCQT5OWTQA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.669011345 (347h11m19.400278996s) [noise=true , address=104.36.82.40:4970 , piece_id=ABJKM5LHC6VMWOCEH2XBG2762H4IAONTFC6TYHDNLU6JMIKYAGSA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.669766005 (347h11m19.401033656s) [noise=true , address=104.36.82.14:4244 , piece_id=BYA6E5F5D4W3NC25K4USWG73NFJBVTFV4BBU4PZGROHWJSIEUYVA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.671541008 (347h11m19.402808658s) [noise=true , address=104.36.82.7:4923 , piece_id=47FFRXO767QLWZYBTKDZ2JTXFIN5YSEXFU3VKACTN562UPMZA3FQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.686950824 (347h11m19.418218474s) [noise=true , address=104.36.82.23:4470 , piece_id=XSFLIIAPLDGS4WLNQ2HUJKT5QCG3QICN3QQRHAJIJLFZEG3JRELQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.686979798 (347h11m19.418247448s) [seg_pos={0 0}, upload=360921]: Segment reached optimal threshold of 14 pieces.
Aug 23 04:37:38.687145141 (347h11m19.41841279s) [noise=true , address=77.90.31.12:4623 , piece_id=4LTRZJRPVXHYXK5V5O2SFXKBPTOZ2VUR7LZVP7MTWNE4FDQIXYAQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ANjFmZrb9SDcqEHW8CBzeMtwvmceoLH9MtPabAjBw8wXjBuaM): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687251049 (347h11m19.418518699s) [noise=true , address=77.90.31.18:4812 , piece_id=5FMHBP74RE4YSIZYW5JAWNGGZHKQO4KV5SLL7CI5DNJYRXNVBSNA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687310421 (347h11m19.418578082s) [noise=true , address=77.90.31.11:4564 , piece_id=EGUX4XHAG5AYXT4AD3ABWH6L4GXR5IWL3XISPMMRA2CSS6I3GOBA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687479038 (347h11m19.418746689s) [noise=true , address=79.127.201.214:4289 , piece_id=EI3IX442PPIS3RLP6BF7KXOYF5PUUFUPZY34MBMFPPL5FOAKI2TQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YfeEiw7zKAYgUcMqMLgEiS2t1gMqdwrpuAdTb2dZouuXRBSM4): protocol: write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection; write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection
Aug 23 04:37:38.687511159 (347h11m19.418778808s) [seg_pos={0 0}, upload=360921]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 04:37:38.687579117 (347h11m19.418846777s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 04:37:38.687584127 (347h11m19.418851786s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 04:37:38.758982305 (347h11m19.490249956s) [upload=360921]: Done uploading segments...
Aug 23 04:37:38.759012683 (347h11m19.490280344s) [upload=360921]: Upload finished. err: <nil>
Duration: 1.869185227s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
875.071086ms
FAIL (2025-08-23 04:43:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 04:11:59.227473138 (346h45m39.958740788s) [upload=360474]: Starting upload Aug 23 04:11:59.227536837 (346h45m39.958804498s) [upload=360474]: Done starting upload Aug 23 04:11:59.227614664 (346h45m39.958882314s) [upload=360474]: Uploading segments... Aug 23 04:11:59.227651072 (346h45m39.958918733s) [upload=360474]: Got next segment. Inline: true Aug 23 04:11:59.227656383 (346h45m39.958924043s) [upload=360474]: Waiting for error group managing segments... Aug 23 04:11:59.227707940 (346h45m39.9589756s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 04:11:59.227716657 (346h45m39.958984317s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 04:11:59.227724952 (346h45m39.958992613s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 04:11:59.230727896 (346h45m39.961995547s) [upload=360474]: Done uploading segments... Aug 23 04:11:59.230740019 (346h45m39.962007669s) [upload=360474]: Upload finished. err: metaclient: Too Many Requests
Duration: 875.095151ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
2.193407073s
FAIL (2025-08-23 04:43:20 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 04:37:38.488494511 (347h11m19.219762161s) [upload=360921]: Starting upload
Aug 23 04:37:38.488593888 (347h11m19.219861549s) [upload=360921]: Done starting upload
Aug 23 04:37:38.488781211 (347h11m19.220048862s) [upload=360921]: Uploading segments...
Aug 23 04:37:38.489141779 (347h11m19.22040943s) [upload=360921]: Got next segment. Inline: false
Aug 23 04:37:38.489201743 (347h11m19.220469403s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 04:37:38.489211832 (347h11m19.220479482s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 04:37:38.519696232 (347h11m19.250963883s) [seg_pos={0 0}, upload=360921]: Begin upload segment...
Aug 23 04:37:38.519736558 (347h11m19.251004218s) [seg_pos={0 0}, upload=360921]: Done begin upload segment.
Aug 23 04:37:38.519765723 (347h11m19.251033374s) [noise=true , address=104.36.82.5:4866 , piece_id=N6SDBVXGJLMVWPNU62YG4TXIN7EVHK6PKO7E4JSTG567BH7KI74A, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.519779019 (347h11m19.251046669s) [noise=true , address=45.91.116.8:4070 , piece_id=7QQ26B76A2JKDIWD2Q7CBSDZVCHG7FYN36QBEQDQIANRKAED4YDA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520409926 (347h11m19.251677586s) [noise=true , address=77.90.31.11:4564 , piece_id=EGUX4XHAG5AYXT4AD3ABWH6L4GXR5IWL3XISPMMRA2CSS6I3GOBA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520443089 (347h11m19.251710789s) [noise=true , address=104.36.82.14:4244 , piece_id=BYA6E5F5D4W3NC25K4USWG73NFJBVTFV4BBU4PZGROHWJSIEUYVA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520813707 (347h11m19.252081356s) [noise=true , address=79.127.219.47:4065 , piece_id=SMKPN2ZBEP42KYT4KL3NMXE4TQZNROI5PIJUEOVJB7I4XSGTTO2Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520948851 (347h11m19.252216511s) [noise=true , address=104.36.82.40:4970 , piece_id=ABJKM5LHC6VMWOCEH2XBG2762H4IAONTFC6TYHDNLU6JMIKYAGSA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521225030 (347h11m19.252492691s) [noise=true , address=104.36.82.12:4166 , piece_id=TZ3OQHREJWS5Y2KC6AJOW5IT4N4FIOKNPWDBAM4VRGFUBEACKN5Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521323817 (347h11m19.252591467s) [noise=true , address=77.90.31.17:4780 , piece_id=2GMG3LOLE7YBXRH3FAZBOVOUH6H7JO244KXVXH57HY3P6X2IT5UQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521653298 (347h11m19.252920948s) [noise=true , address=45.91.116.5:4301 , piece_id=RZF2GJSTSYN2M4CRCUHFXUEP57WXGQMRMO26BOCIKCWDVPKPRD7Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521765469 (347h11m19.253033119s) [noise=true , address=77.90.31.12:4623 , piece_id=4LTRZJRPVXHYXK5V5O2SFXKBPTOZ2VUR7LZVP7MTWNE4FDQIXYAQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522079320 (347h11m19.25334697s) [noise=true , address=77.90.31.18:4812 , piece_id=5FMHBP74RE4YSIZYW5JAWNGGZHKQO4KV5SLL7CI5DNJYRXNVBSNA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522229032 (347h11m19.253496682s) [noise=true , address=104.36.82.23:4470 , piece_id=XSFLIIAPLDGS4WLNQ2HUJKT5QCG3QICN3QQRHAJIJLFZEG3JRELQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522574643 (347h11m19.253842293s) [noise=true , address=104.36.82.60:4372 , piece_id=QEOD5XLAU7SL7MBAMSIF56LUUL3AEEOM62OX7NQAXBGCQT5OWTQA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522671325 (347h11m19.253938974s) [noise=true , address=45.91.116.12:4230 , piece_id=ZOVILXHAVGUBEXQQQ623QVS3C2ERUW7ODZEB4FRFNFIPP4D7DP2A, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523062421 (347h11m19.254330071s) [noise=true , address=104.36.82.52:4107 , piece_id=F6KXTJFDEVFQ2M3JBFGWW6UKOFV5AQ76T2F63ILGHLBFCQBZR2SA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523466331 (347h11m19.254733981s) [noise=true , address=104.36.82.7:4923 , piece_id=47FFRXO767QLWZYBTKDZ2JTXFIN5YSEXFU3VKACTN562UPMZA3FQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523839645 (347h11m19.255107294s) [noise=true , address=79.127.201.214:4289 , piece_id=EI3IX442PPIS3RLP6BF7KXOYF5PUUFUPZY34MBMFPPL5FOAKI2TQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.526244593 (347h11m19.257512243s) [noise=true , address=77.90.31.19:4860 , piece_id=2AQJC67RND7ACK4MUKJSFNLMULJAZFPFYA2MLLPUI2OYDU5D5N6Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.653911453 (347h11m19.385179102s) [upload=360921]: Next returned nil segment
Aug 23 04:37:38.653927533 (347h11m19.385195183s) [upload=360921]: Waiting for error group managing segments...
Aug 23 04:37:38.662559206 (347h11m19.393826855s) [noise=true , address=79.127.219.47:4065 , piece_id=SMKPN2ZBEP42KYT4KL3NMXE4TQZNROI5PIJUEOVJB7I4XSGTTO2Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664028522 (347h11m19.395296182s) [noise=true , address=77.90.31.17:4780 , piece_id=2GMG3LOLE7YBXRH3FAZBOVOUH6H7JO244KXVXH57HY3P6X2IT5UQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664120556 (347h11m19.395388206s) [noise=true , address=45.91.116.5:4301 , piece_id=RZF2GJSTSYN2M4CRCUHFXUEP57WXGQMRMO26BOCIKCWDVPKPRD7Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664556126 (347h11m19.395823776s) [noise=true , address=45.91.116.12:4230 , piece_id=ZOVILXHAVGUBEXQQQ623QVS3C2ERUW7ODZEB4FRFNFIPP4D7DP2A, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.665523117 (347h11m19.396790767s) [noise=true , address=45.91.116.8:4070 , piece_id=7QQ26B76A2JKDIWD2Q7CBSDZVCHG7FYN36QBEQDQIANRKAED4YDA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.666922281 (347h11m19.398189932s) [noise=true , address=77.90.31.19:4860 , piece_id=2AQJC67RND7ACK4MUKJSFNLMULJAZFPFYA2MLLPUI2OYDU5D5N6Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.667251642 (347h11m19.398519292s) [noise=true , address=104.36.82.5:4866 , piece_id=N6SDBVXGJLMVWPNU62YG4TXIN7EVHK6PKO7E4JSTG567BH7KI74A, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668043622 (347h11m19.399311272s) [noise=true , address=104.36.82.12:4166 , piece_id=TZ3OQHREJWS5Y2KC6AJOW5IT4N4FIOKNPWDBAM4VRGFUBEACKN5Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668293092 (347h11m19.399560782s) [noise=true , address=104.36.82.52:4107 , piece_id=F6KXTJFDEVFQ2M3JBFGWW6UKOFV5AQ76T2F63ILGHLBFCQBZR2SA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668766424 (347h11m19.400034074s) [noise=true , address=104.36.82.60:4372 , piece_id=QEOD5XLAU7SL7MBAMSIF56LUUL3AEEOM62OX7NQAXBGCQT5OWTQA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.669011345 (347h11m19.400278996s) [noise=true , address=104.36.82.40:4970 , piece_id=ABJKM5LHC6VMWOCEH2XBG2762H4IAONTFC6TYHDNLU6JMIKYAGSA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.669766005 (347h11m19.401033656s) [noise=true , address=104.36.82.14:4244 , piece_id=BYA6E5F5D4W3NC25K4USWG73NFJBVTFV4BBU4PZGROHWJSIEUYVA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.671541008 (347h11m19.402808658s) [noise=true , address=104.36.82.7:4923 , piece_id=47FFRXO767QLWZYBTKDZ2JTXFIN5YSEXFU3VKACTN562UPMZA3FQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.686950824 (347h11m19.418218474s) [noise=true , address=104.36.82.23:4470 , piece_id=XSFLIIAPLDGS4WLNQ2HUJKT5QCG3QICN3QQRHAJIJLFZEG3JRELQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.686979798 (347h11m19.418247448s) [seg_pos={0 0}, upload=360921]: Segment reached optimal threshold of 14 pieces.
Aug 23 04:37:38.687145141 (347h11m19.41841279s) [noise=true , address=77.90.31.12:4623 , piece_id=4LTRZJRPVXHYXK5V5O2SFXKBPTOZ2VUR7LZVP7MTWNE4FDQIXYAQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ANjFmZrb9SDcqEHW8CBzeMtwvmceoLH9MtPabAjBw8wXjBuaM): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687251049 (347h11m19.418518699s) [noise=true , address=77.90.31.18:4812 , piece_id=5FMHBP74RE4YSIZYW5JAWNGGZHKQO4KV5SLL7CI5DNJYRXNVBSNA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687310421 (347h11m19.418578082s) [noise=true , address=77.90.31.11:4564 , piece_id=EGUX4XHAG5AYXT4AD3ABWH6L4GXR5IWL3XISPMMRA2CSS6I3GOBA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687479038 (347h11m19.418746689s) [noise=true , address=79.127.201.214:4289 , piece_id=EI3IX442PPIS3RLP6BF7KXOYF5PUUFUPZY34MBMFPPL5FOAKI2TQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YfeEiw7zKAYgUcMqMLgEiS2t1gMqdwrpuAdTb2dZouuXRBSM4): protocol: write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection; write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection
Aug 23 04:37:38.687511159 (347h11m19.418778808s) [seg_pos={0 0}, upload=360921]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 04:37:38.687579117 (347h11m19.418846777s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 04:37:38.687584127 (347h11m19.418851786s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 04:37:38.758982305 (347h11m19.490249956s) [upload=360921]: Done uploading segments...
Aug 23 04:37:38.759012683 (347h11m19.490280344s) [upload=360921]: Upload finished. err: <nil>
Duration: 2.19343205s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
146.307912ms
FAIL (2025-08-23 04:42:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 04:11:59.227473138 (346h45m39.958740788s) [upload=360474]: Starting upload Aug 23 04:11:59.227536837 (346h45m39.958804498s) [upload=360474]: Done starting upload Aug 23 04:11:59.227614664 (346h45m39.958882314s) [upload=360474]: Uploading segments... Aug 23 04:11:59.227651072 (346h45m39.958918733s) [upload=360474]: Got next segment. Inline: true Aug 23 04:11:59.227656383 (346h45m39.958924043s) [upload=360474]: Waiting for error group managing segments... Aug 23 04:11:59.227707940 (346h45m39.9589756s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 04:11:59.227716657 (346h45m39.958984317s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 04:11:59.227724952 (346h45m39.958992613s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 04:11:59.230727896 (346h45m39.961995547s) [upload=360474]: Done uploading segments... Aug 23 04:11:59.230740019 (346h45m39.962007669s) [upload=360474]: Upload finished. err: metaclient: Too Many Requests
Duration: 146.337628ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
1.367699687s
FAIL (2025-08-23 04:42:11 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 04:37:38.488494511 (347h11m19.219762161s) [upload=360921]: Starting upload
Aug 23 04:37:38.488593888 (347h11m19.219861549s) [upload=360921]: Done starting upload
Aug 23 04:37:38.488781211 (347h11m19.220048862s) [upload=360921]: Uploading segments...
Aug 23 04:37:38.489141779 (347h11m19.22040943s) [upload=360921]: Got next segment. Inline: false
Aug 23 04:37:38.489201743 (347h11m19.220469403s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 04:37:38.489211832 (347h11m19.220479482s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 04:37:38.519696232 (347h11m19.250963883s) [seg_pos={0 0}, upload=360921]: Begin upload segment...
Aug 23 04:37:38.519736558 (347h11m19.251004218s) [seg_pos={0 0}, upload=360921]: Done begin upload segment.
Aug 23 04:37:38.519765723 (347h11m19.251033374s) [noise=true , address=104.36.82.5:4866 , piece_id=N6SDBVXGJLMVWPNU62YG4TXIN7EVHK6PKO7E4JSTG567BH7KI74A, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.519779019 (347h11m19.251046669s) [noise=true , address=45.91.116.8:4070 , piece_id=7QQ26B76A2JKDIWD2Q7CBSDZVCHG7FYN36QBEQDQIANRKAED4YDA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520409926 (347h11m19.251677586s) [noise=true , address=77.90.31.11:4564 , piece_id=EGUX4XHAG5AYXT4AD3ABWH6L4GXR5IWL3XISPMMRA2CSS6I3GOBA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520443089 (347h11m19.251710789s) [noise=true , address=104.36.82.14:4244 , piece_id=BYA6E5F5D4W3NC25K4USWG73NFJBVTFV4BBU4PZGROHWJSIEUYVA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520813707 (347h11m19.252081356s) [noise=true , address=79.127.219.47:4065 , piece_id=SMKPN2ZBEP42KYT4KL3NMXE4TQZNROI5PIJUEOVJB7I4XSGTTO2Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520948851 (347h11m19.252216511s) [noise=true , address=104.36.82.40:4970 , piece_id=ABJKM5LHC6VMWOCEH2XBG2762H4IAONTFC6TYHDNLU6JMIKYAGSA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521225030 (347h11m19.252492691s) [noise=true , address=104.36.82.12:4166 , piece_id=TZ3OQHREJWS5Y2KC6AJOW5IT4N4FIOKNPWDBAM4VRGFUBEACKN5Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521323817 (347h11m19.252591467s) [noise=true , address=77.90.31.17:4780 , piece_id=2GMG3LOLE7YBXRH3FAZBOVOUH6H7JO244KXVXH57HY3P6X2IT5UQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521653298 (347h11m19.252920948s) [noise=true , address=45.91.116.5:4301 , piece_id=RZF2GJSTSYN2M4CRCUHFXUEP57WXGQMRMO26BOCIKCWDVPKPRD7Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521765469 (347h11m19.253033119s) [noise=true , address=77.90.31.12:4623 , piece_id=4LTRZJRPVXHYXK5V5O2SFXKBPTOZ2VUR7LZVP7MTWNE4FDQIXYAQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522079320 (347h11m19.25334697s) [noise=true , address=77.90.31.18:4812 , piece_id=5FMHBP74RE4YSIZYW5JAWNGGZHKQO4KV5SLL7CI5DNJYRXNVBSNA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522229032 (347h11m19.253496682s) [noise=true , address=104.36.82.23:4470 , piece_id=XSFLIIAPLDGS4WLNQ2HUJKT5QCG3QICN3QQRHAJIJLFZEG3JRELQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522574643 (347h11m19.253842293s) [noise=true , address=104.36.82.60:4372 , piece_id=QEOD5XLAU7SL7MBAMSIF56LUUL3AEEOM62OX7NQAXBGCQT5OWTQA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522671325 (347h11m19.253938974s) [noise=true , address=45.91.116.12:4230 , piece_id=ZOVILXHAVGUBEXQQQ623QVS3C2ERUW7ODZEB4FRFNFIPP4D7DP2A, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523062421 (347h11m19.254330071s) [noise=true , address=104.36.82.52:4107 , piece_id=F6KXTJFDEVFQ2M3JBFGWW6UKOFV5AQ76T2F63ILGHLBFCQBZR2SA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523466331 (347h11m19.254733981s) [noise=true , address=104.36.82.7:4923 , piece_id=47FFRXO767QLWZYBTKDZ2JTXFIN5YSEXFU3VKACTN562UPMZA3FQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523839645 (347h11m19.255107294s) [noise=true , address=79.127.201.214:4289 , piece_id=EI3IX442PPIS3RLP6BF7KXOYF5PUUFUPZY34MBMFPPL5FOAKI2TQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.526244593 (347h11m19.257512243s) [noise=true , address=77.90.31.19:4860 , piece_id=2AQJC67RND7ACK4MUKJSFNLMULJAZFPFYA2MLLPUI2OYDU5D5N6Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.653911453 (347h11m19.385179102s) [upload=360921]: Next returned nil segment
Aug 23 04:37:38.653927533 (347h11m19.385195183s) [upload=360921]: Waiting for error group managing segments...
Aug 23 04:37:38.662559206 (347h11m19.393826855s) [noise=true , address=79.127.219.47:4065 , piece_id=SMKPN2ZBEP42KYT4KL3NMXE4TQZNROI5PIJUEOVJB7I4XSGTTO2Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664028522 (347h11m19.395296182s) [noise=true , address=77.90.31.17:4780 , piece_id=2GMG3LOLE7YBXRH3FAZBOVOUH6H7JO244KXVXH57HY3P6X2IT5UQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664120556 (347h11m19.395388206s) [noise=true , address=45.91.116.5:4301 , piece_id=RZF2GJSTSYN2M4CRCUHFXUEP57WXGQMRMO26BOCIKCWDVPKPRD7Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664556126 (347h11m19.395823776s) [noise=true , address=45.91.116.12:4230 , piece_id=ZOVILXHAVGUBEXQQQ623QVS3C2ERUW7ODZEB4FRFNFIPP4D7DP2A, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.665523117 (347h11m19.396790767s) [noise=true , address=45.91.116.8:4070 , piece_id=7QQ26B76A2JKDIWD2Q7CBSDZVCHG7FYN36QBEQDQIANRKAED4YDA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.666922281 (347h11m19.398189932s) [noise=true , address=77.90.31.19:4860 , piece_id=2AQJC67RND7ACK4MUKJSFNLMULJAZFPFYA2MLLPUI2OYDU5D5N6Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.667251642 (347h11m19.398519292s) [noise=true , address=104.36.82.5:4866 , piece_id=N6SDBVXGJLMVWPNU62YG4TXIN7EVHK6PKO7E4JSTG567BH7KI74A, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668043622 (347h11m19.399311272s) [noise=true , address=104.36.82.12:4166 , piece_id=TZ3OQHREJWS5Y2KC6AJOW5IT4N4FIOKNPWDBAM4VRGFUBEACKN5Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668293092 (347h11m19.399560782s) [noise=true , address=104.36.82.52:4107 , piece_id=F6KXTJFDEVFQ2M3JBFGWW6UKOFV5AQ76T2F63ILGHLBFCQBZR2SA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668766424 (347h11m19.400034074s) [noise=true , address=104.36.82.60:4372 , piece_id=QEOD5XLAU7SL7MBAMSIF56LUUL3AEEOM62OX7NQAXBGCQT5OWTQA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.669011345 (347h11m19.400278996s) [noise=true , address=104.36.82.40:4970 , piece_id=ABJKM5LHC6VMWOCEH2XBG2762H4IAONTFC6TYHDNLU6JMIKYAGSA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.669766005 (347h11m19.401033656s) [noise=true , address=104.36.82.14:4244 , piece_id=BYA6E5F5D4W3NC25K4USWG73NFJBVTFV4BBU4PZGROHWJSIEUYVA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.671541008 (347h11m19.402808658s) [noise=true , address=104.36.82.7:4923 , piece_id=47FFRXO767QLWZYBTKDZ2JTXFIN5YSEXFU3VKACTN562UPMZA3FQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.686950824 (347h11m19.418218474s) [noise=true , address=104.36.82.23:4470 , piece_id=XSFLIIAPLDGS4WLNQ2HUJKT5QCG3QICN3QQRHAJIJLFZEG3JRELQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.686979798 (347h11m19.418247448s) [seg_pos={0 0}, upload=360921]: Segment reached optimal threshold of 14 pieces.
Aug 23 04:37:38.687145141 (347h11m19.41841279s) [noise=true , address=77.90.31.12:4623 , piece_id=4LTRZJRPVXHYXK5V5O2SFXKBPTOZ2VUR7LZVP7MTWNE4FDQIXYAQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ANjFmZrb9SDcqEHW8CBzeMtwvmceoLH9MtPabAjBw8wXjBuaM): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687251049 (347h11m19.418518699s) [noise=true , address=77.90.31.18:4812 , piece_id=5FMHBP74RE4YSIZYW5JAWNGGZHKQO4KV5SLL7CI5DNJYRXNVBSNA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687310421 (347h11m19.418578082s) [noise=true , address=77.90.31.11:4564 , piece_id=EGUX4XHAG5AYXT4AD3ABWH6L4GXR5IWL3XISPMMRA2CSS6I3GOBA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687479038 (347h11m19.418746689s) [noise=true , address=79.127.201.214:4289 , piece_id=EI3IX442PPIS3RLP6BF7KXOYF5PUUFUPZY34MBMFPPL5FOAKI2TQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YfeEiw7zKAYgUcMqMLgEiS2t1gMqdwrpuAdTb2dZouuXRBSM4): protocol: write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection; write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection
Aug 23 04:37:38.687511159 (347h11m19.418778808s) [seg_pos={0 0}, upload=360921]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 04:37:38.687579117 (347h11m19.418846777s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 04:37:38.687584127 (347h11m19.418851786s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 04:37:38.758982305 (347h11m19.490249956s) [upload=360921]: Done uploading segments...
Aug 23 04:37:38.759012683 (347h11m19.490280344s) [upload=360921]: Upload finished. err: <nil>
Duration: 1.367725244s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
136.850252ms
FAIL (2025-08-23 04:41:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 04:11:59.227473138 (346h45m39.958740788s) [upload=360474]: Starting upload Aug 23 04:11:59.227536837 (346h45m39.958804498s) [upload=360474]: Done starting upload Aug 23 04:11:59.227614664 (346h45m39.958882314s) [upload=360474]: Uploading segments... Aug 23 04:11:59.227651072 (346h45m39.958918733s) [upload=360474]: Got next segment. Inline: true Aug 23 04:11:59.227656383 (346h45m39.958924043s) [upload=360474]: Waiting for error group managing segments... Aug 23 04:11:59.227707940 (346h45m39.9589756s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 04:11:59.227716657 (346h45m39.958984317s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 04:11:59.227724952 (346h45m39.958992613s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 04:11:59.230727896 (346h45m39.961995547s) [upload=360474]: Done uploading segments... Aug 23 04:11:59.230740019 (346h45m39.962007669s) [upload=360474]: Upload finished. err: metaclient: Too Many Requests
Duration: 136.877533ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
463.102326ms
FAIL (2025-08-23 04:41:40 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 04:37:38.488494511 (347h11m19.219762161s) [upload=360921]: Starting upload
Aug 23 04:37:38.488593888 (347h11m19.219861549s) [upload=360921]: Done starting upload
Aug 23 04:37:38.488781211 (347h11m19.220048862s) [upload=360921]: Uploading segments...
Aug 23 04:37:38.489141779 (347h11m19.22040943s) [upload=360921]: Got next segment. Inline: false
Aug 23 04:37:38.489201743 (347h11m19.220469403s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 04:37:38.489211832 (347h11m19.220479482s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 04:37:38.519696232 (347h11m19.250963883s) [seg_pos={0 0}, upload=360921]: Begin upload segment...
Aug 23 04:37:38.519736558 (347h11m19.251004218s) [seg_pos={0 0}, upload=360921]: Done begin upload segment.
Aug 23 04:37:38.519765723 (347h11m19.251033374s) [noise=true , address=104.36.82.5:4866 , piece_id=N6SDBVXGJLMVWPNU62YG4TXIN7EVHK6PKO7E4JSTG567BH7KI74A, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.519779019 (347h11m19.251046669s) [noise=true , address=45.91.116.8:4070 , piece_id=7QQ26B76A2JKDIWD2Q7CBSDZVCHG7FYN36QBEQDQIANRKAED4YDA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520409926 (347h11m19.251677586s) [noise=true , address=77.90.31.11:4564 , piece_id=EGUX4XHAG5AYXT4AD3ABWH6L4GXR5IWL3XISPMMRA2CSS6I3GOBA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520443089 (347h11m19.251710789s) [noise=true , address=104.36.82.14:4244 , piece_id=BYA6E5F5D4W3NC25K4USWG73NFJBVTFV4BBU4PZGROHWJSIEUYVA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520813707 (347h11m19.252081356s) [noise=true , address=79.127.219.47:4065 , piece_id=SMKPN2ZBEP42KYT4KL3NMXE4TQZNROI5PIJUEOVJB7I4XSGTTO2Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520948851 (347h11m19.252216511s) [noise=true , address=104.36.82.40:4970 , piece_id=ABJKM5LHC6VMWOCEH2XBG2762H4IAONTFC6TYHDNLU6JMIKYAGSA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521225030 (347h11m19.252492691s) [noise=true , address=104.36.82.12:4166 , piece_id=TZ3OQHREJWS5Y2KC6AJOW5IT4N4FIOKNPWDBAM4VRGFUBEACKN5Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521323817 (347h11m19.252591467s) [noise=true , address=77.90.31.17:4780 , piece_id=2GMG3LOLE7YBXRH3FAZBOVOUH6H7JO244KXVXH57HY3P6X2IT5UQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521653298 (347h11m19.252920948s) [noise=true , address=45.91.116.5:4301 , piece_id=RZF2GJSTSYN2M4CRCUHFXUEP57WXGQMRMO26BOCIKCWDVPKPRD7Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521765469 (347h11m19.253033119s) [noise=true , address=77.90.31.12:4623 , piece_id=4LTRZJRPVXHYXK5V5O2SFXKBPTOZ2VUR7LZVP7MTWNE4FDQIXYAQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522079320 (347h11m19.25334697s) [noise=true , address=77.90.31.18:4812 , piece_id=5FMHBP74RE4YSIZYW5JAWNGGZHKQO4KV5SLL7CI5DNJYRXNVBSNA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522229032 (347h11m19.253496682s) [noise=true , address=104.36.82.23:4470 , piece_id=XSFLIIAPLDGS4WLNQ2HUJKT5QCG3QICN3QQRHAJIJLFZEG3JRELQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522574643 (347h11m19.253842293s) [noise=true , address=104.36.82.60:4372 , piece_id=QEOD5XLAU7SL7MBAMSIF56LUUL3AEEOM62OX7NQAXBGCQT5OWTQA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522671325 (347h11m19.253938974s) [noise=true , address=45.91.116.12:4230 , piece_id=ZOVILXHAVGUBEXQQQ623QVS3C2ERUW7ODZEB4FRFNFIPP4D7DP2A, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523062421 (347h11m19.254330071s) [noise=true , address=104.36.82.52:4107 , piece_id=F6KXTJFDEVFQ2M3JBFGWW6UKOFV5AQ76T2F63ILGHLBFCQBZR2SA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523466331 (347h11m19.254733981s) [noise=true , address=104.36.82.7:4923 , piece_id=47FFRXO767QLWZYBTKDZ2JTXFIN5YSEXFU3VKACTN562UPMZA3FQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523839645 (347h11m19.255107294s) [noise=true , address=79.127.201.214:4289 , piece_id=EI3IX442PPIS3RLP6BF7KXOYF5PUUFUPZY34MBMFPPL5FOAKI2TQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.526244593 (347h11m19.257512243s) [noise=true , address=77.90.31.19:4860 , piece_id=2AQJC67RND7ACK4MUKJSFNLMULJAZFPFYA2MLLPUI2OYDU5D5N6Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.653911453 (347h11m19.385179102s) [upload=360921]: Next returned nil segment
Aug 23 04:37:38.653927533 (347h11m19.385195183s) [upload=360921]: Waiting for error group managing segments...
Aug 23 04:37:38.662559206 (347h11m19.393826855s) [noise=true , address=79.127.219.47:4065 , piece_id=SMKPN2ZBEP42KYT4KL3NMXE4TQZNROI5PIJUEOVJB7I4XSGTTO2Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664028522 (347h11m19.395296182s) [noise=true , address=77.90.31.17:4780 , piece_id=2GMG3LOLE7YBXRH3FAZBOVOUH6H7JO244KXVXH57HY3P6X2IT5UQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664120556 (347h11m19.395388206s) [noise=true , address=45.91.116.5:4301 , piece_id=RZF2GJSTSYN2M4CRCUHFXUEP57WXGQMRMO26BOCIKCWDVPKPRD7Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664556126 (347h11m19.395823776s) [noise=true , address=45.91.116.12:4230 , piece_id=ZOVILXHAVGUBEXQQQ623QVS3C2ERUW7ODZEB4FRFNFIPP4D7DP2A, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.665523117 (347h11m19.396790767s) [noise=true , address=45.91.116.8:4070 , piece_id=7QQ26B76A2JKDIWD2Q7CBSDZVCHG7FYN36QBEQDQIANRKAED4YDA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.666922281 (347h11m19.398189932s) [noise=true , address=77.90.31.19:4860 , piece_id=2AQJC67RND7ACK4MUKJSFNLMULJAZFPFYA2MLLPUI2OYDU5D5N6Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.667251642 (347h11m19.398519292s) [noise=true , address=104.36.82.5:4866 , piece_id=N6SDBVXGJLMVWPNU62YG4TXIN7EVHK6PKO7E4JSTG567BH7KI74A, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668043622 (347h11m19.399311272s) [noise=true , address=104.36.82.12:4166 , piece_id=TZ3OQHREJWS5Y2KC6AJOW5IT4N4FIOKNPWDBAM4VRGFUBEACKN5Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668293092 (347h11m19.399560782s) [noise=true , address=104.36.82.52:4107 , piece_id=F6KXTJFDEVFQ2M3JBFGWW6UKOFV5AQ76T2F63ILGHLBFCQBZR2SA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668766424 (347h11m19.400034074s) [noise=true , address=104.36.82.60:4372 , piece_id=QEOD5XLAU7SL7MBAMSIF56LUUL3AEEOM62OX7NQAXBGCQT5OWTQA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.669011345 (347h11m19.400278996s) [noise=true , address=104.36.82.40:4970 , piece_id=ABJKM5LHC6VMWOCEH2XBG2762H4IAONTFC6TYHDNLU6JMIKYAGSA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.669766005 (347h11m19.401033656s) [noise=true , address=104.36.82.14:4244 , piece_id=BYA6E5F5D4W3NC25K4USWG73NFJBVTFV4BBU4PZGROHWJSIEUYVA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.671541008 (347h11m19.402808658s) [noise=true , address=104.36.82.7:4923 , piece_id=47FFRXO767QLWZYBTKDZ2JTXFIN5YSEXFU3VKACTN562UPMZA3FQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.686950824 (347h11m19.418218474s) [noise=true , address=104.36.82.23:4470 , piece_id=XSFLIIAPLDGS4WLNQ2HUJKT5QCG3QICN3QQRHAJIJLFZEG3JRELQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.686979798 (347h11m19.418247448s) [seg_pos={0 0}, upload=360921]: Segment reached optimal threshold of 14 pieces.
Aug 23 04:37:38.687145141 (347h11m19.41841279s) [noise=true , address=77.90.31.12:4623 , piece_id=4LTRZJRPVXHYXK5V5O2SFXKBPTOZ2VUR7LZVP7MTWNE4FDQIXYAQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ANjFmZrb9SDcqEHW8CBzeMtwvmceoLH9MtPabAjBw8wXjBuaM): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687251049 (347h11m19.418518699s) [noise=true , address=77.90.31.18:4812 , piece_id=5FMHBP74RE4YSIZYW5JAWNGGZHKQO4KV5SLL7CI5DNJYRXNVBSNA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687310421 (347h11m19.418578082s) [noise=true , address=77.90.31.11:4564 , piece_id=EGUX4XHAG5AYXT4AD3ABWH6L4GXR5IWL3XISPMMRA2CSS6I3GOBA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687479038 (347h11m19.418746689s) [noise=true , address=79.127.201.214:4289 , piece_id=EI3IX442PPIS3RLP6BF7KXOYF5PUUFUPZY34MBMFPPL5FOAKI2TQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YfeEiw7zKAYgUcMqMLgEiS2t1gMqdwrpuAdTb2dZouuXRBSM4): protocol: write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection; write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection
Aug 23 04:37:38.687511159 (347h11m19.418778808s) [seg_pos={0 0}, upload=360921]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 04:37:38.687579117 (347h11m19.418846777s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 04:37:38.687584127 (347h11m19.418851786s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 04:37:38.758982305 (347h11m19.490249956s) [upload=360921]: Done uploading segments...
Aug 23 04:37:38.759012683 (347h11m19.490280344s) [upload=360921]: Upload finished. err: <nil>
Duration: 463.127193ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
122.611471ms
FAIL (2025-08-23 04:41:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 04:11:59.227473138 (346h45m39.958740788s) [upload=360474]: Starting upload Aug 23 04:11:59.227536837 (346h45m39.958804498s) [upload=360474]: Done starting upload Aug 23 04:11:59.227614664 (346h45m39.958882314s) [upload=360474]: Uploading segments... Aug 23 04:11:59.227651072 (346h45m39.958918733s) [upload=360474]: Got next segment. Inline: true Aug 23 04:11:59.227656383 (346h45m39.958924043s) [upload=360474]: Waiting for error group managing segments... Aug 23 04:11:59.227707940 (346h45m39.9589756s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 04:11:59.227716657 (346h45m39.958984317s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 04:11:59.227724952 (346h45m39.958992613s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 04:11:59.230727896 (346h45m39.961995547s) [upload=360474]: Done uploading segments... Aug 23 04:11:59.230740019 (346h45m39.962007669s) [upload=360474]: Upload finished. err: metaclient: Too Many Requests
Duration: 122.668849ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
1.448766809s
FAIL (2025-08-23 04:41:14 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 04:37:38.488494511 (347h11m19.219762161s) [upload=360921]: Starting upload
Aug 23 04:37:38.488593888 (347h11m19.219861549s) [upload=360921]: Done starting upload
Aug 23 04:37:38.488781211 (347h11m19.220048862s) [upload=360921]: Uploading segments...
Aug 23 04:37:38.489141779 (347h11m19.22040943s) [upload=360921]: Got next segment. Inline: false
Aug 23 04:37:38.489201743 (347h11m19.220469403s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 04:37:38.489211832 (347h11m19.220479482s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 04:37:38.519696232 (347h11m19.250963883s) [seg_pos={0 0}, upload=360921]: Begin upload segment...
Aug 23 04:37:38.519736558 (347h11m19.251004218s) [seg_pos={0 0}, upload=360921]: Done begin upload segment.
Aug 23 04:37:38.519765723 (347h11m19.251033374s) [noise=true , address=104.36.82.5:4866 , piece_id=N6SDBVXGJLMVWPNU62YG4TXIN7EVHK6PKO7E4JSTG567BH7KI74A, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.519779019 (347h11m19.251046669s) [noise=true , address=45.91.116.8:4070 , piece_id=7QQ26B76A2JKDIWD2Q7CBSDZVCHG7FYN36QBEQDQIANRKAED4YDA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520409926 (347h11m19.251677586s) [noise=true , address=77.90.31.11:4564 , piece_id=EGUX4XHAG5AYXT4AD3ABWH6L4GXR5IWL3XISPMMRA2CSS6I3GOBA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520443089 (347h11m19.251710789s) [noise=true , address=104.36.82.14:4244 , piece_id=BYA6E5F5D4W3NC25K4USWG73NFJBVTFV4BBU4PZGROHWJSIEUYVA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520813707 (347h11m19.252081356s) [noise=true , address=79.127.219.47:4065 , piece_id=SMKPN2ZBEP42KYT4KL3NMXE4TQZNROI5PIJUEOVJB7I4XSGTTO2Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520948851 (347h11m19.252216511s) [noise=true , address=104.36.82.40:4970 , piece_id=ABJKM5LHC6VMWOCEH2XBG2762H4IAONTFC6TYHDNLU6JMIKYAGSA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521225030 (347h11m19.252492691s) [noise=true , address=104.36.82.12:4166 , piece_id=TZ3OQHREJWS5Y2KC6AJOW5IT4N4FIOKNPWDBAM4VRGFUBEACKN5Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521323817 (347h11m19.252591467s) [noise=true , address=77.90.31.17:4780 , piece_id=2GMG3LOLE7YBXRH3FAZBOVOUH6H7JO244KXVXH57HY3P6X2IT5UQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521653298 (347h11m19.252920948s) [noise=true , address=45.91.116.5:4301 , piece_id=RZF2GJSTSYN2M4CRCUHFXUEP57WXGQMRMO26BOCIKCWDVPKPRD7Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521765469 (347h11m19.253033119s) [noise=true , address=77.90.31.12:4623 , piece_id=4LTRZJRPVXHYXK5V5O2SFXKBPTOZ2VUR7LZVP7MTWNE4FDQIXYAQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522079320 (347h11m19.25334697s) [noise=true , address=77.90.31.18:4812 , piece_id=5FMHBP74RE4YSIZYW5JAWNGGZHKQO4KV5SLL7CI5DNJYRXNVBSNA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522229032 (347h11m19.253496682s) [noise=true , address=104.36.82.23:4470 , piece_id=XSFLIIAPLDGS4WLNQ2HUJKT5QCG3QICN3QQRHAJIJLFZEG3JRELQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522574643 (347h11m19.253842293s) [noise=true , address=104.36.82.60:4372 , piece_id=QEOD5XLAU7SL7MBAMSIF56LUUL3AEEOM62OX7NQAXBGCQT5OWTQA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522671325 (347h11m19.253938974s) [noise=true , address=45.91.116.12:4230 , piece_id=ZOVILXHAVGUBEXQQQ623QVS3C2ERUW7ODZEB4FRFNFIPP4D7DP2A, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523062421 (347h11m19.254330071s) [noise=true , address=104.36.82.52:4107 , piece_id=F6KXTJFDEVFQ2M3JBFGWW6UKOFV5AQ76T2F63ILGHLBFCQBZR2SA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523466331 (347h11m19.254733981s) [noise=true , address=104.36.82.7:4923 , piece_id=47FFRXO767QLWZYBTKDZ2JTXFIN5YSEXFU3VKACTN562UPMZA3FQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523839645 (347h11m19.255107294s) [noise=true , address=79.127.201.214:4289 , piece_id=EI3IX442PPIS3RLP6BF7KXOYF5PUUFUPZY34MBMFPPL5FOAKI2TQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.526244593 (347h11m19.257512243s) [noise=true , address=77.90.31.19:4860 , piece_id=2AQJC67RND7ACK4MUKJSFNLMULJAZFPFYA2MLLPUI2OYDU5D5N6Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.653911453 (347h11m19.385179102s) [upload=360921]: Next returned nil segment
Aug 23 04:37:38.653927533 (347h11m19.385195183s) [upload=360921]: Waiting for error group managing segments...
Aug 23 04:37:38.662559206 (347h11m19.393826855s) [noise=true , address=79.127.219.47:4065 , piece_id=SMKPN2ZBEP42KYT4KL3NMXE4TQZNROI5PIJUEOVJB7I4XSGTTO2Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664028522 (347h11m19.395296182s) [noise=true , address=77.90.31.17:4780 , piece_id=2GMG3LOLE7YBXRH3FAZBOVOUH6H7JO244KXVXH57HY3P6X2IT5UQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664120556 (347h11m19.395388206s) [noise=true , address=45.91.116.5:4301 , piece_id=RZF2GJSTSYN2M4CRCUHFXUEP57WXGQMRMO26BOCIKCWDVPKPRD7Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664556126 (347h11m19.395823776s) [noise=true , address=45.91.116.12:4230 , piece_id=ZOVILXHAVGUBEXQQQ623QVS3C2ERUW7ODZEB4FRFNFIPP4D7DP2A, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.665523117 (347h11m19.396790767s) [noise=true , address=45.91.116.8:4070 , piece_id=7QQ26B76A2JKDIWD2Q7CBSDZVCHG7FYN36QBEQDQIANRKAED4YDA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.666922281 (347h11m19.398189932s) [noise=true , address=77.90.31.19:4860 , piece_id=2AQJC67RND7ACK4MUKJSFNLMULJAZFPFYA2MLLPUI2OYDU5D5N6Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.667251642 (347h11m19.398519292s) [noise=true , address=104.36.82.5:4866 , piece_id=N6SDBVXGJLMVWPNU62YG4TXIN7EVHK6PKO7E4JSTG567BH7KI74A, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668043622 (347h11m19.399311272s) [noise=true , address=104.36.82.12:4166 , piece_id=TZ3OQHREJWS5Y2KC6AJOW5IT4N4FIOKNPWDBAM4VRGFUBEACKN5Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668293092 (347h11m19.399560782s) [noise=true , address=104.36.82.52:4107 , piece_id=F6KXTJFDEVFQ2M3JBFGWW6UKOFV5AQ76T2F63ILGHLBFCQBZR2SA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668766424 (347h11m19.400034074s) [noise=true , address=104.36.82.60:4372 , piece_id=QEOD5XLAU7SL7MBAMSIF56LUUL3AEEOM62OX7NQAXBGCQT5OWTQA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.669011345 (347h11m19.400278996s) [noise=true , address=104.36.82.40:4970 , piece_id=ABJKM5LHC6VMWOCEH2XBG2762H4IAONTFC6TYHDNLU6JMIKYAGSA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.669766005 (347h11m19.401033656s) [noise=true , address=104.36.82.14:4244 , piece_id=BYA6E5F5D4W3NC25K4USWG73NFJBVTFV4BBU4PZGROHWJSIEUYVA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.671541008 (347h11m19.402808658s) [noise=true , address=104.36.82.7:4923 , piece_id=47FFRXO767QLWZYBTKDZ2JTXFIN5YSEXFU3VKACTN562UPMZA3FQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.686950824 (347h11m19.418218474s) [noise=true , address=104.36.82.23:4470 , piece_id=XSFLIIAPLDGS4WLNQ2HUJKT5QCG3QICN3QQRHAJIJLFZEG3JRELQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.686979798 (347h11m19.418247448s) [seg_pos={0 0}, upload=360921]: Segment reached optimal threshold of 14 pieces.
Aug 23 04:37:38.687145141 (347h11m19.41841279s) [noise=true , address=77.90.31.12:4623 , piece_id=4LTRZJRPVXHYXK5V5O2SFXKBPTOZ2VUR7LZVP7MTWNE4FDQIXYAQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ANjFmZrb9SDcqEHW8CBzeMtwvmceoLH9MtPabAjBw8wXjBuaM): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687251049 (347h11m19.418518699s) [noise=true , address=77.90.31.18:4812 , piece_id=5FMHBP74RE4YSIZYW5JAWNGGZHKQO4KV5SLL7CI5DNJYRXNVBSNA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687310421 (347h11m19.418578082s) [noise=true , address=77.90.31.11:4564 , piece_id=EGUX4XHAG5AYXT4AD3ABWH6L4GXR5IWL3XISPMMRA2CSS6I3GOBA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687479038 (347h11m19.418746689s) [noise=true , address=79.127.201.214:4289 , piece_id=EI3IX442PPIS3RLP6BF7KXOYF5PUUFUPZY34MBMFPPL5FOAKI2TQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YfeEiw7zKAYgUcMqMLgEiS2t1gMqdwrpuAdTb2dZouuXRBSM4): protocol: write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection; write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection
Aug 23 04:37:38.687511159 (347h11m19.418778808s) [seg_pos={0 0}, upload=360921]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 04:37:38.687579117 (347h11m19.418846777s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 04:37:38.687584127 (347h11m19.418851786s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 04:37:38.758982305 (347h11m19.490249956s) [upload=360921]: Done uploading segments...
Aug 23 04:37:38.759012683 (347h11m19.490280344s) [upload=360921]: Upload finished. err: <nil>
Duration: 1.448793692s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
326.080314ms
FAIL (2025-08-23 04:40:34 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 04:37:38.488494511 (347h11m19.219762161s) [upload=360921]: Starting upload
Aug 23 04:37:38.488593888 (347h11m19.219861549s) [upload=360921]: Done starting upload
Aug 23 04:37:38.488781211 (347h11m19.220048862s) [upload=360921]: Uploading segments...
Aug 23 04:37:38.489141779 (347h11m19.22040943s) [upload=360921]: Got next segment. Inline: false
Aug 23 04:37:38.489201743 (347h11m19.220469403s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 04:37:38.489211832 (347h11m19.220479482s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 04:37:38.519696232 (347h11m19.250963883s) [seg_pos={0 0}, upload=360921]: Begin upload segment...
Aug 23 04:37:38.519736558 (347h11m19.251004218s) [seg_pos={0 0}, upload=360921]: Done begin upload segment.
Aug 23 04:37:38.519765723 (347h11m19.251033374s) [noise=true , address=104.36.82.5:4866 , piece_id=N6SDBVXGJLMVWPNU62YG4TXIN7EVHK6PKO7E4JSTG567BH7KI74A, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.519779019 (347h11m19.251046669s) [noise=true , address=45.91.116.8:4070 , piece_id=7QQ26B76A2JKDIWD2Q7CBSDZVCHG7FYN36QBEQDQIANRKAED4YDA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520409926 (347h11m19.251677586s) [noise=true , address=77.90.31.11:4564 , piece_id=EGUX4XHAG5AYXT4AD3ABWH6L4GXR5IWL3XISPMMRA2CSS6I3GOBA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520443089 (347h11m19.251710789s) [noise=true , address=104.36.82.14:4244 , piece_id=BYA6E5F5D4W3NC25K4USWG73NFJBVTFV4BBU4PZGROHWJSIEUYVA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520813707 (347h11m19.252081356s) [noise=true , address=79.127.219.47:4065 , piece_id=SMKPN2ZBEP42KYT4KL3NMXE4TQZNROI5PIJUEOVJB7I4XSGTTO2Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520948851 (347h11m19.252216511s) [noise=true , address=104.36.82.40:4970 , piece_id=ABJKM5LHC6VMWOCEH2XBG2762H4IAONTFC6TYHDNLU6JMIKYAGSA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521225030 (347h11m19.252492691s) [noise=true , address=104.36.82.12:4166 , piece_id=TZ3OQHREJWS5Y2KC6AJOW5IT4N4FIOKNPWDBAM4VRGFUBEACKN5Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521323817 (347h11m19.252591467s) [noise=true , address=77.90.31.17:4780 , piece_id=2GMG3LOLE7YBXRH3FAZBOVOUH6H7JO244KXVXH57HY3P6X2IT5UQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521653298 (347h11m19.252920948s) [noise=true , address=45.91.116.5:4301 , piece_id=RZF2GJSTSYN2M4CRCUHFXUEP57WXGQMRMO26BOCIKCWDVPKPRD7Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521765469 (347h11m19.253033119s) [noise=true , address=77.90.31.12:4623 , piece_id=4LTRZJRPVXHYXK5V5O2SFXKBPTOZ2VUR7LZVP7MTWNE4FDQIXYAQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522079320 (347h11m19.25334697s) [noise=true , address=77.90.31.18:4812 , piece_id=5FMHBP74RE4YSIZYW5JAWNGGZHKQO4KV5SLL7CI5DNJYRXNVBSNA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522229032 (347h11m19.253496682s) [noise=true , address=104.36.82.23:4470 , piece_id=XSFLIIAPLDGS4WLNQ2HUJKT5QCG3QICN3QQRHAJIJLFZEG3JRELQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522574643 (347h11m19.253842293s) [noise=true , address=104.36.82.60:4372 , piece_id=QEOD5XLAU7SL7MBAMSIF56LUUL3AEEOM62OX7NQAXBGCQT5OWTQA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522671325 (347h11m19.253938974s) [noise=true , address=45.91.116.12:4230 , piece_id=ZOVILXHAVGUBEXQQQ623QVS3C2ERUW7ODZEB4FRFNFIPP4D7DP2A, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523062421 (347h11m19.254330071s) [noise=true , address=104.36.82.52:4107 , piece_id=F6KXTJFDEVFQ2M3JBFGWW6UKOFV5AQ76T2F63ILGHLBFCQBZR2SA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523466331 (347h11m19.254733981s) [noise=true , address=104.36.82.7:4923 , piece_id=47FFRXO767QLWZYBTKDZ2JTXFIN5YSEXFU3VKACTN562UPMZA3FQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523839645 (347h11m19.255107294s) [noise=true , address=79.127.201.214:4289 , piece_id=EI3IX442PPIS3RLP6BF7KXOYF5PUUFUPZY34MBMFPPL5FOAKI2TQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.526244593 (347h11m19.257512243s) [noise=true , address=77.90.31.19:4860 , piece_id=2AQJC67RND7ACK4MUKJSFNLMULJAZFPFYA2MLLPUI2OYDU5D5N6Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.653911453 (347h11m19.385179102s) [upload=360921]: Next returned nil segment
Aug 23 04:37:38.653927533 (347h11m19.385195183s) [upload=360921]: Waiting for error group managing segments...
Aug 23 04:37:38.662559206 (347h11m19.393826855s) [noise=true , address=79.127.219.47:4065 , piece_id=SMKPN2ZBEP42KYT4KL3NMXE4TQZNROI5PIJUEOVJB7I4XSGTTO2Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664028522 (347h11m19.395296182s) [noise=true , address=77.90.31.17:4780 , piece_id=2GMG3LOLE7YBXRH3FAZBOVOUH6H7JO244KXVXH57HY3P6X2IT5UQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664120556 (347h11m19.395388206s) [noise=true , address=45.91.116.5:4301 , piece_id=RZF2GJSTSYN2M4CRCUHFXUEP57WXGQMRMO26BOCIKCWDVPKPRD7Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664556126 (347h11m19.395823776s) [noise=true , address=45.91.116.12:4230 , piece_id=ZOVILXHAVGUBEXQQQ623QVS3C2ERUW7ODZEB4FRFNFIPP4D7DP2A, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.665523117 (347h11m19.396790767s) [noise=true , address=45.91.116.8:4070 , piece_id=7QQ26B76A2JKDIWD2Q7CBSDZVCHG7FYN36QBEQDQIANRKAED4YDA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.666922281 (347h11m19.398189932s) [noise=true , address=77.90.31.19:4860 , piece_id=2AQJC67RND7ACK4MUKJSFNLMULJAZFPFYA2MLLPUI2OYDU5D5N6Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.667251642 (347h11m19.398519292s) [noise=true , address=104.36.82.5:4866 , piece_id=N6SDBVXGJLMVWPNU62YG4TXIN7EVHK6PKO7E4JSTG567BH7KI74A, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668043622 (347h11m19.399311272s) [noise=true , address=104.36.82.12:4166 , piece_id=TZ3OQHREJWS5Y2KC6AJOW5IT4N4FIOKNPWDBAM4VRGFUBEACKN5Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668293092 (347h11m19.399560782s) [noise=true , address=104.36.82.52:4107 , piece_id=F6KXTJFDEVFQ2M3JBFGWW6UKOFV5AQ76T2F63ILGHLBFCQBZR2SA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668766424 (347h11m19.400034074s) [noise=true , address=104.36.82.60:4372 , piece_id=QEOD5XLAU7SL7MBAMSIF56LUUL3AEEOM62OX7NQAXBGCQT5OWTQA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.669011345 (347h11m19.400278996s) [noise=true , address=104.36.82.40:4970 , piece_id=ABJKM5LHC6VMWOCEH2XBG2762H4IAONTFC6TYHDNLU6JMIKYAGSA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.669766005 (347h11m19.401033656s) [noise=true , address=104.36.82.14:4244 , piece_id=BYA6E5F5D4W3NC25K4USWG73NFJBVTFV4BBU4PZGROHWJSIEUYVA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.671541008 (347h11m19.402808658s) [noise=true , address=104.36.82.7:4923 , piece_id=47FFRXO767QLWZYBTKDZ2JTXFIN5YSEXFU3VKACTN562UPMZA3FQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.686950824 (347h11m19.418218474s) [noise=true , address=104.36.82.23:4470 , piece_id=XSFLIIAPLDGS4WLNQ2HUJKT5QCG3QICN3QQRHAJIJLFZEG3JRELQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.686979798 (347h11m19.418247448s) [seg_pos={0 0}, upload=360921]: Segment reached optimal threshold of 14 pieces.
Aug 23 04:37:38.687145141 (347h11m19.41841279s) [noise=true , address=77.90.31.12:4623 , piece_id=4LTRZJRPVXHYXK5V5O2SFXKBPTOZ2VUR7LZVP7MTWNE4FDQIXYAQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ANjFmZrb9SDcqEHW8CBzeMtwvmceoLH9MtPabAjBw8wXjBuaM): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687251049 (347h11m19.418518699s) [noise=true , address=77.90.31.18:4812 , piece_id=5FMHBP74RE4YSIZYW5JAWNGGZHKQO4KV5SLL7CI5DNJYRXNVBSNA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687310421 (347h11m19.418578082s) [noise=true , address=77.90.31.11:4564 , piece_id=EGUX4XHAG5AYXT4AD3ABWH6L4GXR5IWL3XISPMMRA2CSS6I3GOBA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687479038 (347h11m19.418746689s) [noise=true , address=79.127.201.214:4289 , piece_id=EI3IX442PPIS3RLP6BF7KXOYF5PUUFUPZY34MBMFPPL5FOAKI2TQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YfeEiw7zKAYgUcMqMLgEiS2t1gMqdwrpuAdTb2dZouuXRBSM4): protocol: write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection; write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection
Aug 23 04:37:38.687511159 (347h11m19.418778808s) [seg_pos={0 0}, upload=360921]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 04:37:38.687579117 (347h11m19.418846777s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 04:37:38.687584127 (347h11m19.418851786s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 04:37:38.758982305 (347h11m19.490249956s) [upload=360921]: Done uploading segments...
Aug 23 04:37:38.759012683 (347h11m19.490280344s) [upload=360921]: Upload finished. err: <nil>
Duration: 326.101875ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
1.008883896s
FAIL (2025-08-23 04:40:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 04:11:59.227473138 (346h45m39.958740788s) [upload=360474]: Starting upload Aug 23 04:11:59.227536837 (346h45m39.958804498s) [upload=360474]: Done starting upload Aug 23 04:11:59.227614664 (346h45m39.958882314s) [upload=360474]: Uploading segments... Aug 23 04:11:59.227651072 (346h45m39.958918733s) [upload=360474]: Got next segment. Inline: true Aug 23 04:11:59.227656383 (346h45m39.958924043s) [upload=360474]: Waiting for error group managing segments... Aug 23 04:11:59.227707940 (346h45m39.9589756s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 04:11:59.227716657 (346h45m39.958984317s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 04:11:59.227724952 (346h45m39.958992613s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 04:11:59.230727896 (346h45m39.961995547s) [upload=360474]: Done uploading segments... Aug 23 04:11:59.230740019 (346h45m39.962007669s) [upload=360474]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.00892405s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
1.580290813s
FAIL (2025-08-23 04:40:15 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 04:37:38.488494511 (347h11m19.219762161s) [upload=360921]: Starting upload
Aug 23 04:37:38.488593888 (347h11m19.219861549s) [upload=360921]: Done starting upload
Aug 23 04:37:38.488781211 (347h11m19.220048862s) [upload=360921]: Uploading segments...
Aug 23 04:37:38.489141779 (347h11m19.22040943s) [upload=360921]: Got next segment. Inline: false
Aug 23 04:37:38.489201743 (347h11m19.220469403s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 04:37:38.489211832 (347h11m19.220479482s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 04:37:38.519696232 (347h11m19.250963883s) [seg_pos={0 0}, upload=360921]: Begin upload segment...
Aug 23 04:37:38.519736558 (347h11m19.251004218s) [seg_pos={0 0}, upload=360921]: Done begin upload segment.
Aug 23 04:37:38.519765723 (347h11m19.251033374s) [noise=true , address=104.36.82.5:4866 , piece_id=N6SDBVXGJLMVWPNU62YG4TXIN7EVHK6PKO7E4JSTG567BH7KI74A, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.519779019 (347h11m19.251046669s) [noise=true , address=45.91.116.8:4070 , piece_id=7QQ26B76A2JKDIWD2Q7CBSDZVCHG7FYN36QBEQDQIANRKAED4YDA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520409926 (347h11m19.251677586s) [noise=true , address=77.90.31.11:4564 , piece_id=EGUX4XHAG5AYXT4AD3ABWH6L4GXR5IWL3XISPMMRA2CSS6I3GOBA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520443089 (347h11m19.251710789s) [noise=true , address=104.36.82.14:4244 , piece_id=BYA6E5F5D4W3NC25K4USWG73NFJBVTFV4BBU4PZGROHWJSIEUYVA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520813707 (347h11m19.252081356s) [noise=true , address=79.127.219.47:4065 , piece_id=SMKPN2ZBEP42KYT4KL3NMXE4TQZNROI5PIJUEOVJB7I4XSGTTO2Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520948851 (347h11m19.252216511s) [noise=true , address=104.36.82.40:4970 , piece_id=ABJKM5LHC6VMWOCEH2XBG2762H4IAONTFC6TYHDNLU6JMIKYAGSA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521225030 (347h11m19.252492691s) [noise=true , address=104.36.82.12:4166 , piece_id=TZ3OQHREJWS5Y2KC6AJOW5IT4N4FIOKNPWDBAM4VRGFUBEACKN5Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521323817 (347h11m19.252591467s) [noise=true , address=77.90.31.17:4780 , piece_id=2GMG3LOLE7YBXRH3FAZBOVOUH6H7JO244KXVXH57HY3P6X2IT5UQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521653298 (347h11m19.252920948s) [noise=true , address=45.91.116.5:4301 , piece_id=RZF2GJSTSYN2M4CRCUHFXUEP57WXGQMRMO26BOCIKCWDVPKPRD7Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521765469 (347h11m19.253033119s) [noise=true , address=77.90.31.12:4623 , piece_id=4LTRZJRPVXHYXK5V5O2SFXKBPTOZ2VUR7LZVP7MTWNE4FDQIXYAQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522079320 (347h11m19.25334697s) [noise=true , address=77.90.31.18:4812 , piece_id=5FMHBP74RE4YSIZYW5JAWNGGZHKQO4KV5SLL7CI5DNJYRXNVBSNA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522229032 (347h11m19.253496682s) [noise=true , address=104.36.82.23:4470 , piece_id=XSFLIIAPLDGS4WLNQ2HUJKT5QCG3QICN3QQRHAJIJLFZEG3JRELQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522574643 (347h11m19.253842293s) [noise=true , address=104.36.82.60:4372 , piece_id=QEOD5XLAU7SL7MBAMSIF56LUUL3AEEOM62OX7NQAXBGCQT5OWTQA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522671325 (347h11m19.253938974s) [noise=true , address=45.91.116.12:4230 , piece_id=ZOVILXHAVGUBEXQQQ623QVS3C2ERUW7ODZEB4FRFNFIPP4D7DP2A, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523062421 (347h11m19.254330071s) [noise=true , address=104.36.82.52:4107 , piece_id=F6KXTJFDEVFQ2M3JBFGWW6UKOFV5AQ76T2F63ILGHLBFCQBZR2SA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523466331 (347h11m19.254733981s) [noise=true , address=104.36.82.7:4923 , piece_id=47FFRXO767QLWZYBTKDZ2JTXFIN5YSEXFU3VKACTN562UPMZA3FQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523839645 (347h11m19.255107294s) [noise=true , address=79.127.201.214:4289 , piece_id=EI3IX442PPIS3RLP6BF7KXOYF5PUUFUPZY34MBMFPPL5FOAKI2TQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.526244593 (347h11m19.257512243s) [noise=true , address=77.90.31.19:4860 , piece_id=2AQJC67RND7ACK4MUKJSFNLMULJAZFPFYA2MLLPUI2OYDU5D5N6Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.653911453 (347h11m19.385179102s) [upload=360921]: Next returned nil segment
Aug 23 04:37:38.653927533 (347h11m19.385195183s) [upload=360921]: Waiting for error group managing segments...
Aug 23 04:37:38.662559206 (347h11m19.393826855s) [noise=true , address=79.127.219.47:4065 , piece_id=SMKPN2ZBEP42KYT4KL3NMXE4TQZNROI5PIJUEOVJB7I4XSGTTO2Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664028522 (347h11m19.395296182s) [noise=true , address=77.90.31.17:4780 , piece_id=2GMG3LOLE7YBXRH3FAZBOVOUH6H7JO244KXVXH57HY3P6X2IT5UQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664120556 (347h11m19.395388206s) [noise=true , address=45.91.116.5:4301 , piece_id=RZF2GJSTSYN2M4CRCUHFXUEP57WXGQMRMO26BOCIKCWDVPKPRD7Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664556126 (347h11m19.395823776s) [noise=true , address=45.91.116.12:4230 , piece_id=ZOVILXHAVGUBEXQQQ623QVS3C2ERUW7ODZEB4FRFNFIPP4D7DP2A, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.665523117 (347h11m19.396790767s) [noise=true , address=45.91.116.8:4070 , piece_id=7QQ26B76A2JKDIWD2Q7CBSDZVCHG7FYN36QBEQDQIANRKAED4YDA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.666922281 (347h11m19.398189932s) [noise=true , address=77.90.31.19:4860 , piece_id=2AQJC67RND7ACK4MUKJSFNLMULJAZFPFYA2MLLPUI2OYDU5D5N6Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.667251642 (347h11m19.398519292s) [noise=true , address=104.36.82.5:4866 , piece_id=N6SDBVXGJLMVWPNU62YG4TXIN7EVHK6PKO7E4JSTG567BH7KI74A, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668043622 (347h11m19.399311272s) [noise=true , address=104.36.82.12:4166 , piece_id=TZ3OQHREJWS5Y2KC6AJOW5IT4N4FIOKNPWDBAM4VRGFUBEACKN5Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668293092 (347h11m19.399560782s) [noise=true , address=104.36.82.52:4107 , piece_id=F6KXTJFDEVFQ2M3JBFGWW6UKOFV5AQ76T2F63ILGHLBFCQBZR2SA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668766424 (347h11m19.400034074s) [noise=true , address=104.36.82.60:4372 , piece_id=QEOD5XLAU7SL7MBAMSIF56LUUL3AEEOM62OX7NQAXBGCQT5OWTQA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.669011345 (347h11m19.400278996s) [noise=true , address=104.36.82.40:4970 , piece_id=ABJKM5LHC6VMWOCEH2XBG2762H4IAONTFC6TYHDNLU6JMIKYAGSA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.669766005 (347h11m19.401033656s) [noise=true , address=104.36.82.14:4244 , piece_id=BYA6E5F5D4W3NC25K4USWG73NFJBVTFV4BBU4PZGROHWJSIEUYVA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.671541008 (347h11m19.402808658s) [noise=true , address=104.36.82.7:4923 , piece_id=47FFRXO767QLWZYBTKDZ2JTXFIN5YSEXFU3VKACTN562UPMZA3FQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.686950824 (347h11m19.418218474s) [noise=true , address=104.36.82.23:4470 , piece_id=XSFLIIAPLDGS4WLNQ2HUJKT5QCG3QICN3QQRHAJIJLFZEG3JRELQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.686979798 (347h11m19.418247448s) [seg_pos={0 0}, upload=360921]: Segment reached optimal threshold of 14 pieces.
Aug 23 04:37:38.687145141 (347h11m19.41841279s) [noise=true , address=77.90.31.12:4623 , piece_id=4LTRZJRPVXHYXK5V5O2SFXKBPTOZ2VUR7LZVP7MTWNE4FDQIXYAQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ANjFmZrb9SDcqEHW8CBzeMtwvmceoLH9MtPabAjBw8wXjBuaM): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687251049 (347h11m19.418518699s) [noise=true , address=77.90.31.18:4812 , piece_id=5FMHBP74RE4YSIZYW5JAWNGGZHKQO4KV5SLL7CI5DNJYRXNVBSNA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687310421 (347h11m19.418578082s) [noise=true , address=77.90.31.11:4564 , piece_id=EGUX4XHAG5AYXT4AD3ABWH6L4GXR5IWL3XISPMMRA2CSS6I3GOBA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687479038 (347h11m19.418746689s) [noise=true , address=79.127.201.214:4289 , piece_id=EI3IX442PPIS3RLP6BF7KXOYF5PUUFUPZY34MBMFPPL5FOAKI2TQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YfeEiw7zKAYgUcMqMLgEiS2t1gMqdwrpuAdTb2dZouuXRBSM4): protocol: write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection; write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection
Aug 23 04:37:38.687511159 (347h11m19.418778808s) [seg_pos={0 0}, upload=360921]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 04:37:38.687579117 (347h11m19.418846777s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 04:37:38.687584127 (347h11m19.418851786s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 04:37:38.758982305 (347h11m19.490249956s) [upload=360921]: Done uploading segments...
Aug 23 04:37:38.759012683 (347h11m19.490280344s) [upload=360921]: Upload finished. err: <nil>
Duration: 1.580314668s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
1.268796707s
FAIL (2025-08-23 04:39:43 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 04:37:38.488494511 (347h11m19.219762161s) [upload=360921]: Starting upload
Aug 23 04:37:38.488593888 (347h11m19.219861549s) [upload=360921]: Done starting upload
Aug 23 04:37:38.488781211 (347h11m19.220048862s) [upload=360921]: Uploading segments...
Aug 23 04:37:38.489141779 (347h11m19.22040943s) [upload=360921]: Got next segment. Inline: false
Aug 23 04:37:38.489201743 (347h11m19.220469403s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 04:37:38.489211832 (347h11m19.220479482s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 04:37:38.519696232 (347h11m19.250963883s) [seg_pos={0 0}, upload=360921]: Begin upload segment...
Aug 23 04:37:38.519736558 (347h11m19.251004218s) [seg_pos={0 0}, upload=360921]: Done begin upload segment.
Aug 23 04:37:38.519765723 (347h11m19.251033374s) [noise=true , address=104.36.82.5:4866 , piece_id=N6SDBVXGJLMVWPNU62YG4TXIN7EVHK6PKO7E4JSTG567BH7KI74A, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.519779019 (347h11m19.251046669s) [noise=true , address=45.91.116.8:4070 , piece_id=7QQ26B76A2JKDIWD2Q7CBSDZVCHG7FYN36QBEQDQIANRKAED4YDA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520409926 (347h11m19.251677586s) [noise=true , address=77.90.31.11:4564 , piece_id=EGUX4XHAG5AYXT4AD3ABWH6L4GXR5IWL3XISPMMRA2CSS6I3GOBA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520443089 (347h11m19.251710789s) [noise=true , address=104.36.82.14:4244 , piece_id=BYA6E5F5D4W3NC25K4USWG73NFJBVTFV4BBU4PZGROHWJSIEUYVA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520813707 (347h11m19.252081356s) [noise=true , address=79.127.219.47:4065 , piece_id=SMKPN2ZBEP42KYT4KL3NMXE4TQZNROI5PIJUEOVJB7I4XSGTTO2Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520948851 (347h11m19.252216511s) [noise=true , address=104.36.82.40:4970 , piece_id=ABJKM5LHC6VMWOCEH2XBG2762H4IAONTFC6TYHDNLU6JMIKYAGSA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521225030 (347h11m19.252492691s) [noise=true , address=104.36.82.12:4166 , piece_id=TZ3OQHREJWS5Y2KC6AJOW5IT4N4FIOKNPWDBAM4VRGFUBEACKN5Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521323817 (347h11m19.252591467s) [noise=true , address=77.90.31.17:4780 , piece_id=2GMG3LOLE7YBXRH3FAZBOVOUH6H7JO244KXVXH57HY3P6X2IT5UQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521653298 (347h11m19.252920948s) [noise=true , address=45.91.116.5:4301 , piece_id=RZF2GJSTSYN2M4CRCUHFXUEP57WXGQMRMO26BOCIKCWDVPKPRD7Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521765469 (347h11m19.253033119s) [noise=true , address=77.90.31.12:4623 , piece_id=4LTRZJRPVXHYXK5V5O2SFXKBPTOZ2VUR7LZVP7MTWNE4FDQIXYAQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522079320 (347h11m19.25334697s) [noise=true , address=77.90.31.18:4812 , piece_id=5FMHBP74RE4YSIZYW5JAWNGGZHKQO4KV5SLL7CI5DNJYRXNVBSNA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522229032 (347h11m19.253496682s) [noise=true , address=104.36.82.23:4470 , piece_id=XSFLIIAPLDGS4WLNQ2HUJKT5QCG3QICN3QQRHAJIJLFZEG3JRELQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522574643 (347h11m19.253842293s) [noise=true , address=104.36.82.60:4372 , piece_id=QEOD5XLAU7SL7MBAMSIF56LUUL3AEEOM62OX7NQAXBGCQT5OWTQA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522671325 (347h11m19.253938974s) [noise=true , address=45.91.116.12:4230 , piece_id=ZOVILXHAVGUBEXQQQ623QVS3C2ERUW7ODZEB4FRFNFIPP4D7DP2A, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523062421 (347h11m19.254330071s) [noise=true , address=104.36.82.52:4107 , piece_id=F6KXTJFDEVFQ2M3JBFGWW6UKOFV5AQ76T2F63ILGHLBFCQBZR2SA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523466331 (347h11m19.254733981s) [noise=true , address=104.36.82.7:4923 , piece_id=47FFRXO767QLWZYBTKDZ2JTXFIN5YSEXFU3VKACTN562UPMZA3FQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523839645 (347h11m19.255107294s) [noise=true , address=79.127.201.214:4289 , piece_id=EI3IX442PPIS3RLP6BF7KXOYF5PUUFUPZY34MBMFPPL5FOAKI2TQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.526244593 (347h11m19.257512243s) [noise=true , address=77.90.31.19:4860 , piece_id=2AQJC67RND7ACK4MUKJSFNLMULJAZFPFYA2MLLPUI2OYDU5D5N6Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.653911453 (347h11m19.385179102s) [upload=360921]: Next returned nil segment
Aug 23 04:37:38.653927533 (347h11m19.385195183s) [upload=360921]: Waiting for error group managing segments...
Aug 23 04:37:38.662559206 (347h11m19.393826855s) [noise=true , address=79.127.219.47:4065 , piece_id=SMKPN2ZBEP42KYT4KL3NMXE4TQZNROI5PIJUEOVJB7I4XSGTTO2Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664028522 (347h11m19.395296182s) [noise=true , address=77.90.31.17:4780 , piece_id=2GMG3LOLE7YBXRH3FAZBOVOUH6H7JO244KXVXH57HY3P6X2IT5UQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664120556 (347h11m19.395388206s) [noise=true , address=45.91.116.5:4301 , piece_id=RZF2GJSTSYN2M4CRCUHFXUEP57WXGQMRMO26BOCIKCWDVPKPRD7Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664556126 (347h11m19.395823776s) [noise=true , address=45.91.116.12:4230 , piece_id=ZOVILXHAVGUBEXQQQ623QVS3C2ERUW7ODZEB4FRFNFIPP4D7DP2A, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.665523117 (347h11m19.396790767s) [noise=true , address=45.91.116.8:4070 , piece_id=7QQ26B76A2JKDIWD2Q7CBSDZVCHG7FYN36QBEQDQIANRKAED4YDA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.666922281 (347h11m19.398189932s) [noise=true , address=77.90.31.19:4860 , piece_id=2AQJC67RND7ACK4MUKJSFNLMULJAZFPFYA2MLLPUI2OYDU5D5N6Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.667251642 (347h11m19.398519292s) [noise=true , address=104.36.82.5:4866 , piece_id=N6SDBVXGJLMVWPNU62YG4TXIN7EVHK6PKO7E4JSTG567BH7KI74A, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668043622 (347h11m19.399311272s) [noise=true , address=104.36.82.12:4166 , piece_id=TZ3OQHREJWS5Y2KC6AJOW5IT4N4FIOKNPWDBAM4VRGFUBEACKN5Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668293092 (347h11m19.399560782s) [noise=true , address=104.36.82.52:4107 , piece_id=F6KXTJFDEVFQ2M3JBFGWW6UKOFV5AQ76T2F63ILGHLBFCQBZR2SA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668766424 (347h11m19.400034074s) [noise=true , address=104.36.82.60:4372 , piece_id=QEOD5XLAU7SL7MBAMSIF56LUUL3AEEOM62OX7NQAXBGCQT5OWTQA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.669011345 (347h11m19.400278996s) [noise=true , address=104.36.82.40:4970 , piece_id=ABJKM5LHC6VMWOCEH2XBG2762H4IAONTFC6TYHDNLU6JMIKYAGSA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.669766005 (347h11m19.401033656s) [noise=true , address=104.36.82.14:4244 , piece_id=BYA6E5F5D4W3NC25K4USWG73NFJBVTFV4BBU4PZGROHWJSIEUYVA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.671541008 (347h11m19.402808658s) [noise=true , address=104.36.82.7:4923 , piece_id=47FFRXO767QLWZYBTKDZ2JTXFIN5YSEXFU3VKACTN562UPMZA3FQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.686950824 (347h11m19.418218474s) [noise=true , address=104.36.82.23:4470 , piece_id=XSFLIIAPLDGS4WLNQ2HUJKT5QCG3QICN3QQRHAJIJLFZEG3JRELQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.686979798 (347h11m19.418247448s) [seg_pos={0 0}, upload=360921]: Segment reached optimal threshold of 14 pieces.
Aug 23 04:37:38.687145141 (347h11m19.41841279s) [noise=true , address=77.90.31.12:4623 , piece_id=4LTRZJRPVXHYXK5V5O2SFXKBPTOZ2VUR7LZVP7MTWNE4FDQIXYAQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ANjFmZrb9SDcqEHW8CBzeMtwvmceoLH9MtPabAjBw8wXjBuaM): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687251049 (347h11m19.418518699s) [noise=true , address=77.90.31.18:4812 , piece_id=5FMHBP74RE4YSIZYW5JAWNGGZHKQO4KV5SLL7CI5DNJYRXNVBSNA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687310421 (347h11m19.418578082s) [noise=true , address=77.90.31.11:4564 , piece_id=EGUX4XHAG5AYXT4AD3ABWH6L4GXR5IWL3XISPMMRA2CSS6I3GOBA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687479038 (347h11m19.418746689s) [noise=true , address=79.127.201.214:4289 , piece_id=EI3IX442PPIS3RLP6BF7KXOYF5PUUFUPZY34MBMFPPL5FOAKI2TQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YfeEiw7zKAYgUcMqMLgEiS2t1gMqdwrpuAdTb2dZouuXRBSM4): protocol: write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection; write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection
Aug 23 04:37:38.687511159 (347h11m19.418778808s) [seg_pos={0 0}, upload=360921]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 04:37:38.687579117 (347h11m19.418846777s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 04:37:38.687584127 (347h11m19.418851786s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 04:37:38.758982305 (347h11m19.490249956s) [upload=360921]: Done uploading segments...
Aug 23 04:37:38.759012683 (347h11m19.490280344s) [upload=360921]: Upload finished. err: <nil>
Duration: 1.268819621s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
172.152693ms
FAIL (2025-08-23 04:39:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 04:11:59.227473138 (346h45m39.958740788s) [upload=360474]: Starting upload Aug 23 04:11:59.227536837 (346h45m39.958804498s) [upload=360474]: Done starting upload Aug 23 04:11:59.227614664 (346h45m39.958882314s) [upload=360474]: Uploading segments... Aug 23 04:11:59.227651072 (346h45m39.958918733s) [upload=360474]: Got next segment. Inline: true Aug 23 04:11:59.227656383 (346h45m39.958924043s) [upload=360474]: Waiting for error group managing segments... Aug 23 04:11:59.227707940 (346h45m39.9589756s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 04:11:59.227716657 (346h45m39.958984317s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 04:11:59.227724952 (346h45m39.958992613s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 04:11:59.230727896 (346h45m39.961995547s) [upload=360474]: Done uploading segments... Aug 23 04:11:59.230740019 (346h45m39.962007669s) [upload=360474]: Upload finished. err: metaclient: Too Many Requests
Duration: 172.186108ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
430.794913ms
FAIL (2025-08-23 04:39:21 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 04:37:38.488494511 (347h11m19.219762161s) [upload=360921]: Starting upload
Aug 23 04:37:38.488593888 (347h11m19.219861549s) [upload=360921]: Done starting upload
Aug 23 04:37:38.488781211 (347h11m19.220048862s) [upload=360921]: Uploading segments...
Aug 23 04:37:38.489141779 (347h11m19.22040943s) [upload=360921]: Got next segment. Inline: false
Aug 23 04:37:38.489201743 (347h11m19.220469403s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 04:37:38.489211832 (347h11m19.220479482s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 04:37:38.519696232 (347h11m19.250963883s) [seg_pos={0 0}, upload=360921]: Begin upload segment...
Aug 23 04:37:38.519736558 (347h11m19.251004218s) [seg_pos={0 0}, upload=360921]: Done begin upload segment.
Aug 23 04:37:38.519765723 (347h11m19.251033374s) [noise=true , address=104.36.82.5:4866 , piece_id=N6SDBVXGJLMVWPNU62YG4TXIN7EVHK6PKO7E4JSTG567BH7KI74A, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.519779019 (347h11m19.251046669s) [noise=true , address=45.91.116.8:4070 , piece_id=7QQ26B76A2JKDIWD2Q7CBSDZVCHG7FYN36QBEQDQIANRKAED4YDA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520409926 (347h11m19.251677586s) [noise=true , address=77.90.31.11:4564 , piece_id=EGUX4XHAG5AYXT4AD3ABWH6L4GXR5IWL3XISPMMRA2CSS6I3GOBA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520443089 (347h11m19.251710789s) [noise=true , address=104.36.82.14:4244 , piece_id=BYA6E5F5D4W3NC25K4USWG73NFJBVTFV4BBU4PZGROHWJSIEUYVA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520813707 (347h11m19.252081356s) [noise=true , address=79.127.219.47:4065 , piece_id=SMKPN2ZBEP42KYT4KL3NMXE4TQZNROI5PIJUEOVJB7I4XSGTTO2Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520948851 (347h11m19.252216511s) [noise=true , address=104.36.82.40:4970 , piece_id=ABJKM5LHC6VMWOCEH2XBG2762H4IAONTFC6TYHDNLU6JMIKYAGSA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521225030 (347h11m19.252492691s) [noise=true , address=104.36.82.12:4166 , piece_id=TZ3OQHREJWS5Y2KC6AJOW5IT4N4FIOKNPWDBAM4VRGFUBEACKN5Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521323817 (347h11m19.252591467s) [noise=true , address=77.90.31.17:4780 , piece_id=2GMG3LOLE7YBXRH3FAZBOVOUH6H7JO244KXVXH57HY3P6X2IT5UQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521653298 (347h11m19.252920948s) [noise=true , address=45.91.116.5:4301 , piece_id=RZF2GJSTSYN2M4CRCUHFXUEP57WXGQMRMO26BOCIKCWDVPKPRD7Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521765469 (347h11m19.253033119s) [noise=true , address=77.90.31.12:4623 , piece_id=4LTRZJRPVXHYXK5V5O2SFXKBPTOZ2VUR7LZVP7MTWNE4FDQIXYAQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522079320 (347h11m19.25334697s) [noise=true , address=77.90.31.18:4812 , piece_id=5FMHBP74RE4YSIZYW5JAWNGGZHKQO4KV5SLL7CI5DNJYRXNVBSNA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522229032 (347h11m19.253496682s) [noise=true , address=104.36.82.23:4470 , piece_id=XSFLIIAPLDGS4WLNQ2HUJKT5QCG3QICN3QQRHAJIJLFZEG3JRELQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522574643 (347h11m19.253842293s) [noise=true , address=104.36.82.60:4372 , piece_id=QEOD5XLAU7SL7MBAMSIF56LUUL3AEEOM62OX7NQAXBGCQT5OWTQA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522671325 (347h11m19.253938974s) [noise=true , address=45.91.116.12:4230 , piece_id=ZOVILXHAVGUBEXQQQ623QVS3C2ERUW7ODZEB4FRFNFIPP4D7DP2A, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523062421 (347h11m19.254330071s) [noise=true , address=104.36.82.52:4107 , piece_id=F6KXTJFDEVFQ2M3JBFGWW6UKOFV5AQ76T2F63ILGHLBFCQBZR2SA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523466331 (347h11m19.254733981s) [noise=true , address=104.36.82.7:4923 , piece_id=47FFRXO767QLWZYBTKDZ2JTXFIN5YSEXFU3VKACTN562UPMZA3FQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523839645 (347h11m19.255107294s) [noise=true , address=79.127.201.214:4289 , piece_id=EI3IX442PPIS3RLP6BF7KXOYF5PUUFUPZY34MBMFPPL5FOAKI2TQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.526244593 (347h11m19.257512243s) [noise=true , address=77.90.31.19:4860 , piece_id=2AQJC67RND7ACK4MUKJSFNLMULJAZFPFYA2MLLPUI2OYDU5D5N6Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.653911453 (347h11m19.385179102s) [upload=360921]: Next returned nil segment
Aug 23 04:37:38.653927533 (347h11m19.385195183s) [upload=360921]: Waiting for error group managing segments...
Aug 23 04:37:38.662559206 (347h11m19.393826855s) [noise=true , address=79.127.219.47:4065 , piece_id=SMKPN2ZBEP42KYT4KL3NMXE4TQZNROI5PIJUEOVJB7I4XSGTTO2Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664028522 (347h11m19.395296182s) [noise=true , address=77.90.31.17:4780 , piece_id=2GMG3LOLE7YBXRH3FAZBOVOUH6H7JO244KXVXH57HY3P6X2IT5UQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664120556 (347h11m19.395388206s) [noise=true , address=45.91.116.5:4301 , piece_id=RZF2GJSTSYN2M4CRCUHFXUEP57WXGQMRMO26BOCIKCWDVPKPRD7Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664556126 (347h11m19.395823776s) [noise=true , address=45.91.116.12:4230 , piece_id=ZOVILXHAVGUBEXQQQ623QVS3C2ERUW7ODZEB4FRFNFIPP4D7DP2A, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.665523117 (347h11m19.396790767s) [noise=true , address=45.91.116.8:4070 , piece_id=7QQ26B76A2JKDIWD2Q7CBSDZVCHG7FYN36QBEQDQIANRKAED4YDA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.666922281 (347h11m19.398189932s) [noise=true , address=77.90.31.19:4860 , piece_id=2AQJC67RND7ACK4MUKJSFNLMULJAZFPFYA2MLLPUI2OYDU5D5N6Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.667251642 (347h11m19.398519292s) [noise=true , address=104.36.82.5:4866 , piece_id=N6SDBVXGJLMVWPNU62YG4TXIN7EVHK6PKO7E4JSTG567BH7KI74A, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668043622 (347h11m19.399311272s) [noise=true , address=104.36.82.12:4166 , piece_id=TZ3OQHREJWS5Y2KC6AJOW5IT4N4FIOKNPWDBAM4VRGFUBEACKN5Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668293092 (347h11m19.399560782s) [noise=true , address=104.36.82.52:4107 , piece_id=F6KXTJFDEVFQ2M3JBFGWW6UKOFV5AQ76T2F63ILGHLBFCQBZR2SA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668766424 (347h11m19.400034074s) [noise=true , address=104.36.82.60:4372 , piece_id=QEOD5XLAU7SL7MBAMSIF56LUUL3AEEOM62OX7NQAXBGCQT5OWTQA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.669011345 (347h11m19.400278996s) [noise=true , address=104.36.82.40:4970 , piece_id=ABJKM5LHC6VMWOCEH2XBG2762H4IAONTFC6TYHDNLU6JMIKYAGSA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.669766005 (347h11m19.401033656s) [noise=true , address=104.36.82.14:4244 , piece_id=BYA6E5F5D4W3NC25K4USWG73NFJBVTFV4BBU4PZGROHWJSIEUYVA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.671541008 (347h11m19.402808658s) [noise=true , address=104.36.82.7:4923 , piece_id=47FFRXO767QLWZYBTKDZ2JTXFIN5YSEXFU3VKACTN562UPMZA3FQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.686950824 (347h11m19.418218474s) [noise=true , address=104.36.82.23:4470 , piece_id=XSFLIIAPLDGS4WLNQ2HUJKT5QCG3QICN3QQRHAJIJLFZEG3JRELQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.686979798 (347h11m19.418247448s) [seg_pos={0 0}, upload=360921]: Segment reached optimal threshold of 14 pieces.
Aug 23 04:37:38.687145141 (347h11m19.41841279s) [noise=true , address=77.90.31.12:4623 , piece_id=4LTRZJRPVXHYXK5V5O2SFXKBPTOZ2VUR7LZVP7MTWNE4FDQIXYAQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ANjFmZrb9SDcqEHW8CBzeMtwvmceoLH9MtPabAjBw8wXjBuaM): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687251049 (347h11m19.418518699s) [noise=true , address=77.90.31.18:4812 , piece_id=5FMHBP74RE4YSIZYW5JAWNGGZHKQO4KV5SLL7CI5DNJYRXNVBSNA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687310421 (347h11m19.418578082s) [noise=true , address=77.90.31.11:4564 , piece_id=EGUX4XHAG5AYXT4AD3ABWH6L4GXR5IWL3XISPMMRA2CSS6I3GOBA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687479038 (347h11m19.418746689s) [noise=true , address=79.127.201.214:4289 , piece_id=EI3IX442PPIS3RLP6BF7KXOYF5PUUFUPZY34MBMFPPL5FOAKI2TQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YfeEiw7zKAYgUcMqMLgEiS2t1gMqdwrpuAdTb2dZouuXRBSM4): protocol: write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection; write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection
Aug 23 04:37:38.687511159 (347h11m19.418778808s) [seg_pos={0 0}, upload=360921]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 04:37:38.687579117 (347h11m19.418846777s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 04:37:38.687584127 (347h11m19.418851786s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 04:37:38.758982305 (347h11m19.490249956s) [upload=360921]: Done uploading segments...
Aug 23 04:37:38.759012683 (347h11m19.490280344s) [upload=360921]: Upload finished. err: <nil>
Duration: 430.820652ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
1.377587016s
FAIL (2025-08-23 04:38:51 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 04:37:38.488494511 (347h11m19.219762161s) [upload=360921]: Starting upload
Aug 23 04:37:38.488593888 (347h11m19.219861549s) [upload=360921]: Done starting upload
Aug 23 04:37:38.488781211 (347h11m19.220048862s) [upload=360921]: Uploading segments...
Aug 23 04:37:38.489141779 (347h11m19.22040943s) [upload=360921]: Got next segment. Inline: false
Aug 23 04:37:38.489201743 (347h11m19.220469403s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 04:37:38.489211832 (347h11m19.220479482s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 04:37:38.519696232 (347h11m19.250963883s) [seg_pos={0 0}, upload=360921]: Begin upload segment...
Aug 23 04:37:38.519736558 (347h11m19.251004218s) [seg_pos={0 0}, upload=360921]: Done begin upload segment.
Aug 23 04:37:38.519765723 (347h11m19.251033374s) [noise=true , address=104.36.82.5:4866 , piece_id=N6SDBVXGJLMVWPNU62YG4TXIN7EVHK6PKO7E4JSTG567BH7KI74A, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.519779019 (347h11m19.251046669s) [noise=true , address=45.91.116.8:4070 , piece_id=7QQ26B76A2JKDIWD2Q7CBSDZVCHG7FYN36QBEQDQIANRKAED4YDA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520409926 (347h11m19.251677586s) [noise=true , address=77.90.31.11:4564 , piece_id=EGUX4XHAG5AYXT4AD3ABWH6L4GXR5IWL3XISPMMRA2CSS6I3GOBA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520443089 (347h11m19.251710789s) [noise=true , address=104.36.82.14:4244 , piece_id=BYA6E5F5D4W3NC25K4USWG73NFJBVTFV4BBU4PZGROHWJSIEUYVA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520813707 (347h11m19.252081356s) [noise=true , address=79.127.219.47:4065 , piece_id=SMKPN2ZBEP42KYT4KL3NMXE4TQZNROI5PIJUEOVJB7I4XSGTTO2Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520948851 (347h11m19.252216511s) [noise=true , address=104.36.82.40:4970 , piece_id=ABJKM5LHC6VMWOCEH2XBG2762H4IAONTFC6TYHDNLU6JMIKYAGSA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521225030 (347h11m19.252492691s) [noise=true , address=104.36.82.12:4166 , piece_id=TZ3OQHREJWS5Y2KC6AJOW5IT4N4FIOKNPWDBAM4VRGFUBEACKN5Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521323817 (347h11m19.252591467s) [noise=true , address=77.90.31.17:4780 , piece_id=2GMG3LOLE7YBXRH3FAZBOVOUH6H7JO244KXVXH57HY3P6X2IT5UQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521653298 (347h11m19.252920948s) [noise=true , address=45.91.116.5:4301 , piece_id=RZF2GJSTSYN2M4CRCUHFXUEP57WXGQMRMO26BOCIKCWDVPKPRD7Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521765469 (347h11m19.253033119s) [noise=true , address=77.90.31.12:4623 , piece_id=4LTRZJRPVXHYXK5V5O2SFXKBPTOZ2VUR7LZVP7MTWNE4FDQIXYAQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522079320 (347h11m19.25334697s) [noise=true , address=77.90.31.18:4812 , piece_id=5FMHBP74RE4YSIZYW5JAWNGGZHKQO4KV5SLL7CI5DNJYRXNVBSNA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522229032 (347h11m19.253496682s) [noise=true , address=104.36.82.23:4470 , piece_id=XSFLIIAPLDGS4WLNQ2HUJKT5QCG3QICN3QQRHAJIJLFZEG3JRELQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522574643 (347h11m19.253842293s) [noise=true , address=104.36.82.60:4372 , piece_id=QEOD5XLAU7SL7MBAMSIF56LUUL3AEEOM62OX7NQAXBGCQT5OWTQA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522671325 (347h11m19.253938974s) [noise=true , address=45.91.116.12:4230 , piece_id=ZOVILXHAVGUBEXQQQ623QVS3C2ERUW7ODZEB4FRFNFIPP4D7DP2A, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523062421 (347h11m19.254330071s) [noise=true , address=104.36.82.52:4107 , piece_id=F6KXTJFDEVFQ2M3JBFGWW6UKOFV5AQ76T2F63ILGHLBFCQBZR2SA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523466331 (347h11m19.254733981s) [noise=true , address=104.36.82.7:4923 , piece_id=47FFRXO767QLWZYBTKDZ2JTXFIN5YSEXFU3VKACTN562UPMZA3FQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523839645 (347h11m19.255107294s) [noise=true , address=79.127.201.214:4289 , piece_id=EI3IX442PPIS3RLP6BF7KXOYF5PUUFUPZY34MBMFPPL5FOAKI2TQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.526244593 (347h11m19.257512243s) [noise=true , address=77.90.31.19:4860 , piece_id=2AQJC67RND7ACK4MUKJSFNLMULJAZFPFYA2MLLPUI2OYDU5D5N6Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.653911453 (347h11m19.385179102s) [upload=360921]: Next returned nil segment
Aug 23 04:37:38.653927533 (347h11m19.385195183s) [upload=360921]: Waiting for error group managing segments...
Aug 23 04:37:38.662559206 (347h11m19.393826855s) [noise=true , address=79.127.219.47:4065 , piece_id=SMKPN2ZBEP42KYT4KL3NMXE4TQZNROI5PIJUEOVJB7I4XSGTTO2Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664028522 (347h11m19.395296182s) [noise=true , address=77.90.31.17:4780 , piece_id=2GMG3LOLE7YBXRH3FAZBOVOUH6H7JO244KXVXH57HY3P6X2IT5UQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664120556 (347h11m19.395388206s) [noise=true , address=45.91.116.5:4301 , piece_id=RZF2GJSTSYN2M4CRCUHFXUEP57WXGQMRMO26BOCIKCWDVPKPRD7Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664556126 (347h11m19.395823776s) [noise=true , address=45.91.116.12:4230 , piece_id=ZOVILXHAVGUBEXQQQ623QVS3C2ERUW7ODZEB4FRFNFIPP4D7DP2A, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.665523117 (347h11m19.396790767s) [noise=true , address=45.91.116.8:4070 , piece_id=7QQ26B76A2JKDIWD2Q7CBSDZVCHG7FYN36QBEQDQIANRKAED4YDA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.666922281 (347h11m19.398189932s) [noise=true , address=77.90.31.19:4860 , piece_id=2AQJC67RND7ACK4MUKJSFNLMULJAZFPFYA2MLLPUI2OYDU5D5N6Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.667251642 (347h11m19.398519292s) [noise=true , address=104.36.82.5:4866 , piece_id=N6SDBVXGJLMVWPNU62YG4TXIN7EVHK6PKO7E4JSTG567BH7KI74A, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668043622 (347h11m19.399311272s) [noise=true , address=104.36.82.12:4166 , piece_id=TZ3OQHREJWS5Y2KC6AJOW5IT4N4FIOKNPWDBAM4VRGFUBEACKN5Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668293092 (347h11m19.399560782s) [noise=true , address=104.36.82.52:4107 , piece_id=F6KXTJFDEVFQ2M3JBFGWW6UKOFV5AQ76T2F63ILGHLBFCQBZR2SA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668766424 (347h11m19.400034074s) [noise=true , address=104.36.82.60:4372 , piece_id=QEOD5XLAU7SL7MBAMSIF56LUUL3AEEOM62OX7NQAXBGCQT5OWTQA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.669011345 (347h11m19.400278996s) [noise=true , address=104.36.82.40:4970 , piece_id=ABJKM5LHC6VMWOCEH2XBG2762H4IAONTFC6TYHDNLU6JMIKYAGSA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.669766005 (347h11m19.401033656s) [noise=true , address=104.36.82.14:4244 , piece_id=BYA6E5F5D4W3NC25K4USWG73NFJBVTFV4BBU4PZGROHWJSIEUYVA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.671541008 (347h11m19.402808658s) [noise=true , address=104.36.82.7:4923 , piece_id=47FFRXO767QLWZYBTKDZ2JTXFIN5YSEXFU3VKACTN562UPMZA3FQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.686950824 (347h11m19.418218474s) [noise=true , address=104.36.82.23:4470 , piece_id=XSFLIIAPLDGS4WLNQ2HUJKT5QCG3QICN3QQRHAJIJLFZEG3JRELQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.686979798 (347h11m19.418247448s) [seg_pos={0 0}, upload=360921]: Segment reached optimal threshold of 14 pieces.
Aug 23 04:37:38.687145141 (347h11m19.41841279s) [noise=true , address=77.90.31.12:4623 , piece_id=4LTRZJRPVXHYXK5V5O2SFXKBPTOZ2VUR7LZVP7MTWNE4FDQIXYAQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ANjFmZrb9SDcqEHW8CBzeMtwvmceoLH9MtPabAjBw8wXjBuaM): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687251049 (347h11m19.418518699s) [noise=true , address=77.90.31.18:4812 , piece_id=5FMHBP74RE4YSIZYW5JAWNGGZHKQO4KV5SLL7CI5DNJYRXNVBSNA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687310421 (347h11m19.418578082s) [noise=true , address=77.90.31.11:4564 , piece_id=EGUX4XHAG5AYXT4AD3ABWH6L4GXR5IWL3XISPMMRA2CSS6I3GOBA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687479038 (347h11m19.418746689s) [noise=true , address=79.127.201.214:4289 , piece_id=EI3IX442PPIS3RLP6BF7KXOYF5PUUFUPZY34MBMFPPL5FOAKI2TQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YfeEiw7zKAYgUcMqMLgEiS2t1gMqdwrpuAdTb2dZouuXRBSM4): protocol: write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection; write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection
Aug 23 04:37:38.687511159 (347h11m19.418778808s) [seg_pos={0 0}, upload=360921]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 04:37:38.687579117 (347h11m19.418846777s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 04:37:38.687584127 (347h11m19.418851786s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 04:37:38.758982305 (347h11m19.490249956s) [upload=360921]: Done uploading segments...
Aug 23 04:37:38.759012683 (347h11m19.490280344s) [upload=360921]: Upload finished. err: <nil>
Duration: 1.377614368s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
129.717742ms
FAIL (2025-08-23 04:38:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 04:11:59.227473138 (346h45m39.958740788s) [upload=360474]: Starting upload Aug 23 04:11:59.227536837 (346h45m39.958804498s) [upload=360474]: Done starting upload Aug 23 04:11:59.227614664 (346h45m39.958882314s) [upload=360474]: Uploading segments... Aug 23 04:11:59.227651072 (346h45m39.958918733s) [upload=360474]: Got next segment. Inline: true Aug 23 04:11:59.227656383 (346h45m39.958924043s) [upload=360474]: Waiting for error group managing segments... Aug 23 04:11:59.227707940 (346h45m39.9589756s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 04:11:59.227716657 (346h45m39.958984317s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 04:11:59.227724952 (346h45m39.958992613s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 04:11:59.230727896 (346h45m39.961995547s) [upload=360474]: Done uploading segments... Aug 23 04:11:59.230740019 (346h45m39.962007669s) [upload=360474]: Upload finished. err: metaclient: Too Many Requests
Duration: 129.803613ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
197.886794ms
FAIL (2025-08-23 04:38:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 04:11:59.227473138 (346h45m39.958740788s) [upload=360474]: Starting upload Aug 23 04:11:59.227536837 (346h45m39.958804498s) [upload=360474]: Done starting upload Aug 23 04:11:59.227614664 (346h45m39.958882314s) [upload=360474]: Uploading segments... Aug 23 04:11:59.227651072 (346h45m39.958918733s) [upload=360474]: Got next segment. Inline: true Aug 23 04:11:59.227656383 (346h45m39.958924043s) [upload=360474]: Waiting for error group managing segments... Aug 23 04:11:59.227707940 (346h45m39.9589756s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 04:11:59.227716657 (346h45m39.958984317s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 04:11:59.227724952 (346h45m39.958992613s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 04:11:59.230727896 (346h45m39.961995547s) [upload=360474]: Done uploading segments... Aug 23 04:11:59.230740019 (346h45m39.962007669s) [upload=360474]: Upload finished. err: metaclient: Too Many Requests
Duration: 197.904928ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
348.616146ms
FAIL (2025-08-23 04:37:38 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 04:37:38.488494511 (347h11m19.219762161s) [upload=360921]: Starting upload
Aug 23 04:37:38.488593888 (347h11m19.219861549s) [upload=360921]: Done starting upload
Aug 23 04:37:38.488781211 (347h11m19.220048862s) [upload=360921]: Uploading segments...
Aug 23 04:37:38.489141779 (347h11m19.22040943s) [upload=360921]: Got next segment. Inline: false
Aug 23 04:37:38.489201743 (347h11m19.220469403s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 04:37:38.489211832 (347h11m19.220479482s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 04:37:38.519696232 (347h11m19.250963883s) [seg_pos={0 0}, upload=360921]: Begin upload segment...
Aug 23 04:37:38.519736558 (347h11m19.251004218s) [seg_pos={0 0}, upload=360921]: Done begin upload segment.
Aug 23 04:37:38.519765723 (347h11m19.251033374s) [noise=true , address=104.36.82.5:4866 , piece_id=N6SDBVXGJLMVWPNU62YG4TXIN7EVHK6PKO7E4JSTG567BH7KI74A, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.519779019 (347h11m19.251046669s) [noise=true , address=45.91.116.8:4070 , piece_id=7QQ26B76A2JKDIWD2Q7CBSDZVCHG7FYN36QBEQDQIANRKAED4YDA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520409926 (347h11m19.251677586s) [noise=true , address=77.90.31.11:4564 , piece_id=EGUX4XHAG5AYXT4AD3ABWH6L4GXR5IWL3XISPMMRA2CSS6I3GOBA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520443089 (347h11m19.251710789s) [noise=true , address=104.36.82.14:4244 , piece_id=BYA6E5F5D4W3NC25K4USWG73NFJBVTFV4BBU4PZGROHWJSIEUYVA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520813707 (347h11m19.252081356s) [noise=true , address=79.127.219.47:4065 , piece_id=SMKPN2ZBEP42KYT4KL3NMXE4TQZNROI5PIJUEOVJB7I4XSGTTO2Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.520948851 (347h11m19.252216511s) [noise=true , address=104.36.82.40:4970 , piece_id=ABJKM5LHC6VMWOCEH2XBG2762H4IAONTFC6TYHDNLU6JMIKYAGSA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521225030 (347h11m19.252492691s) [noise=true , address=104.36.82.12:4166 , piece_id=TZ3OQHREJWS5Y2KC6AJOW5IT4N4FIOKNPWDBAM4VRGFUBEACKN5Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521323817 (347h11m19.252591467s) [noise=true , address=77.90.31.17:4780 , piece_id=2GMG3LOLE7YBXRH3FAZBOVOUH6H7JO244KXVXH57HY3P6X2IT5UQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521653298 (347h11m19.252920948s) [noise=true , address=45.91.116.5:4301 , piece_id=RZF2GJSTSYN2M4CRCUHFXUEP57WXGQMRMO26BOCIKCWDVPKPRD7Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.521765469 (347h11m19.253033119s) [noise=true , address=77.90.31.12:4623 , piece_id=4LTRZJRPVXHYXK5V5O2SFXKBPTOZ2VUR7LZVP7MTWNE4FDQIXYAQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522079320 (347h11m19.25334697s) [noise=true , address=77.90.31.18:4812 , piece_id=5FMHBP74RE4YSIZYW5JAWNGGZHKQO4KV5SLL7CI5DNJYRXNVBSNA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522229032 (347h11m19.253496682s) [noise=true , address=104.36.82.23:4470 , piece_id=XSFLIIAPLDGS4WLNQ2HUJKT5QCG3QICN3QQRHAJIJLFZEG3JRELQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522574643 (347h11m19.253842293s) [noise=true , address=104.36.82.60:4372 , piece_id=QEOD5XLAU7SL7MBAMSIF56LUUL3AEEOM62OX7NQAXBGCQT5OWTQA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.522671325 (347h11m19.253938974s) [noise=true , address=45.91.116.12:4230 , piece_id=ZOVILXHAVGUBEXQQQ623QVS3C2ERUW7ODZEB4FRFNFIPP4D7DP2A, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523062421 (347h11m19.254330071s) [noise=true , address=104.36.82.52:4107 , piece_id=F6KXTJFDEVFQ2M3JBFGWW6UKOFV5AQ76T2F63ILGHLBFCQBZR2SA, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523466331 (347h11m19.254733981s) [noise=true , address=104.36.82.7:4923 , piece_id=47FFRXO767QLWZYBTKDZ2JTXFIN5YSEXFU3VKACTN562UPMZA3FQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.523839645 (347h11m19.255107294s) [noise=true , address=79.127.201.214:4289 , piece_id=EI3IX442PPIS3RLP6BF7KXOYF5PUUFUPZY34MBMFPPL5FOAKI2TQ, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.526244593 (347h11m19.257512243s) [noise=true , address=77.90.31.19:4860 , piece_id=2AQJC67RND7ACK4MUKJSFNLMULJAZFPFYA2MLLPUI2OYDU5D5N6Q, seg_pos={0 0}, upload=360921]: Uploading piece...
Aug 23 04:37:38.653911453 (347h11m19.385179102s) [upload=360921]: Next returned nil segment
Aug 23 04:37:38.653927533 (347h11m19.385195183s) [upload=360921]: Waiting for error group managing segments...
Aug 23 04:37:38.662559206 (347h11m19.393826855s) [noise=true , address=79.127.219.47:4065 , piece_id=SMKPN2ZBEP42KYT4KL3NMXE4TQZNROI5PIJUEOVJB7I4XSGTTO2Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664028522 (347h11m19.395296182s) [noise=true , address=77.90.31.17:4780 , piece_id=2GMG3LOLE7YBXRH3FAZBOVOUH6H7JO244KXVXH57HY3P6X2IT5UQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664120556 (347h11m19.395388206s) [noise=true , address=45.91.116.5:4301 , piece_id=RZF2GJSTSYN2M4CRCUHFXUEP57WXGQMRMO26BOCIKCWDVPKPRD7Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.664556126 (347h11m19.395823776s) [noise=true , address=45.91.116.12:4230 , piece_id=ZOVILXHAVGUBEXQQQ623QVS3C2ERUW7ODZEB4FRFNFIPP4D7DP2A, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.665523117 (347h11m19.396790767s) [noise=true , address=45.91.116.8:4070 , piece_id=7QQ26B76A2JKDIWD2Q7CBSDZVCHG7FYN36QBEQDQIANRKAED4YDA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.666922281 (347h11m19.398189932s) [noise=true , address=77.90.31.19:4860 , piece_id=2AQJC67RND7ACK4MUKJSFNLMULJAZFPFYA2MLLPUI2OYDU5D5N6Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.667251642 (347h11m19.398519292s) [noise=true , address=104.36.82.5:4866 , piece_id=N6SDBVXGJLMVWPNU62YG4TXIN7EVHK6PKO7E4JSTG567BH7KI74A, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668043622 (347h11m19.399311272s) [noise=true , address=104.36.82.12:4166 , piece_id=TZ3OQHREJWS5Y2KC6AJOW5IT4N4FIOKNPWDBAM4VRGFUBEACKN5Q, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668293092 (347h11m19.399560782s) [noise=true , address=104.36.82.52:4107 , piece_id=F6KXTJFDEVFQ2M3JBFGWW6UKOFV5AQ76T2F63ILGHLBFCQBZR2SA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.668766424 (347h11m19.400034074s) [noise=true , address=104.36.82.60:4372 , piece_id=QEOD5XLAU7SL7MBAMSIF56LUUL3AEEOM62OX7NQAXBGCQT5OWTQA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.669011345 (347h11m19.400278996s) [noise=true , address=104.36.82.40:4970 , piece_id=ABJKM5LHC6VMWOCEH2XBG2762H4IAONTFC6TYHDNLU6JMIKYAGSA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.669766005 (347h11m19.401033656s) [noise=true , address=104.36.82.14:4244 , piece_id=BYA6E5F5D4W3NC25K4USWG73NFJBVTFV4BBU4PZGROHWJSIEUYVA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.671541008 (347h11m19.402808658s) [noise=true , address=104.36.82.7:4923 , piece_id=47FFRXO767QLWZYBTKDZ2JTXFIN5YSEXFU3VKACTN562UPMZA3FQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.686950824 (347h11m19.418218474s) [noise=true , address=104.36.82.23:4470 , piece_id=XSFLIIAPLDGS4WLNQ2HUJKT5QCG3QICN3QQRHAJIJLFZEG3JRELQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: <nil>
Aug 23 04:37:38.686979798 (347h11m19.418247448s) [seg_pos={0 0}, upload=360921]: Segment reached optimal threshold of 14 pieces.
Aug 23 04:37:38.687145141 (347h11m19.41841279s) [noise=true , address=77.90.31.12:4623 , piece_id=4LTRZJRPVXHYXK5V5O2SFXKBPTOZ2VUR7LZVP7MTWNE4FDQIXYAQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ANjFmZrb9SDcqEHW8CBzeMtwvmceoLH9MtPabAjBw8wXjBuaM): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687251049 (347h11m19.418518699s) [noise=true , address=77.90.31.18:4812 , piece_id=5FMHBP74RE4YSIZYW5JAWNGGZHKQO4KV5SLL7CI5DNJYRXNVBSNA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687310421 (347h11m19.418578082s) [noise=true , address=77.90.31.11:4564 , piece_id=EGUX4XHAG5AYXT4AD3ABWH6L4GXR5IWL3XISPMMRA2CSS6I3GOBA, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pKhKeEpeFSQDeKBUkSwGp58G9nAcdQZ19zuuuae522vMv7AP9): protocol: expected piece hash; context canceled; EOF
Aug 23 04:37:38.687479038 (347h11m19.418746689s) [noise=true , address=79.127.201.214:4289 , piece_id=EI3IX442PPIS3RLP6BF7KXOYF5PUUFUPZY34MBMFPPL5FOAKI2TQ, seg_pos={0 0}, upload=360921]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YfeEiw7zKAYgUcMqMLgEiS2t1gMqdwrpuAdTb2dZouuXRBSM4): protocol: write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection; write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:41772->79.127.201.214:4289: use of closed network connection
Aug 23 04:37:38.687511159 (347h11m19.418778808s) [seg_pos={0 0}, upload=360921]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 04:37:38.687579117 (347h11m19.418846777s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 04:37:38.687584127 (347h11m19.418851786s) [upload=360921]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 04:37:38.758982305 (347h11m19.490249956s) [upload=360921]: Done uploading segments...
Aug 23 04:37:38.759012683 (347h11m19.490280344s) [upload=360921]: Upload finished. err: <nil>
Duration: 348.639481ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
345.281819ms
FAIL (2025-08-23 04:37:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 04:11:59.227473138 (346h45m39.958740788s) [upload=360474]: Starting upload Aug 23 04:11:59.227536837 (346h45m39.958804498s) [upload=360474]: Done starting upload Aug 23 04:11:59.227614664 (346h45m39.958882314s) [upload=360474]: Uploading segments... Aug 23 04:11:59.227651072 (346h45m39.958918733s) [upload=360474]: Got next segment. Inline: true Aug 23 04:11:59.227656383 (346h45m39.958924043s) [upload=360474]: Waiting for error group managing segments... Aug 23 04:11:59.227707940 (346h45m39.9589756s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 04:11:59.227716657 (346h45m39.958984317s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 04:11:59.227724952 (346h45m39.958992613s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 04:11:59.230727896 (346h45m39.961995547s) [upload=360474]: Done uploading segments... Aug 23 04:11:59.230740019 (346h45m39.962007669s) [upload=360474]: Upload finished. err: metaclient: Too Many Requests
Duration: 345.302968ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
172.997235ms
FAIL (2025-08-23 04:36:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 04:11:59.227473138 (346h45m39.958740788s) [upload=360474]: Starting upload Aug 23 04:11:59.227536837 (346h45m39.958804498s) [upload=360474]: Done starting upload Aug 23 04:11:59.227614664 (346h45m39.958882314s) [upload=360474]: Uploading segments... Aug 23 04:11:59.227651072 (346h45m39.958918733s) [upload=360474]: Got next segment. Inline: true Aug 23 04:11:59.227656383 (346h45m39.958924043s) [upload=360474]: Waiting for error group managing segments... Aug 23 04:11:59.227707940 (346h45m39.9589756s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 04:11:59.227716657 (346h45m39.958984317s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 04:11:59.227724952 (346h45m39.958992613s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 04:11:59.230727896 (346h45m39.961995547s) [upload=360474]: Done uploading segments... Aug 23 04:11:59.230740019 (346h45m39.962007669s) [upload=360474]: Upload finished. err: metaclient: Too Many Requests
Duration: 173.028463ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
479.526834ms
FAIL (2025-08-23 04:35:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 04:11:59.227473138 (346h45m39.958740788s) [upload=360474]: Starting upload Aug 23 04:11:59.227536837 (346h45m39.958804498s) [upload=360474]: Done starting upload Aug 23 04:11:59.227614664 (346h45m39.958882314s) [upload=360474]: Uploading segments... Aug 23 04:11:59.227651072 (346h45m39.958918733s) [upload=360474]: Got next segment. Inline: true Aug 23 04:11:59.227656383 (346h45m39.958924043s) [upload=360474]: Waiting for error group managing segments... Aug 23 04:11:59.227707940 (346h45m39.9589756s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 04:11:59.227716657 (346h45m39.958984317s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 04:11:59.227724952 (346h45m39.958992613s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 04:11:59.230727896 (346h45m39.961995547s) [upload=360474]: Done uploading segments... Aug 23 04:11:59.230740019 (346h45m39.962007669s) [upload=360474]: Upload finished. err: metaclient: Too Many Requests
Duration: 479.54603ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
166.137859ms
FAIL (2025-08-23 04:35:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 04:11:59.227473138 (346h45m39.958740788s) [upload=360474]: Starting upload Aug 23 04:11:59.227536837 (346h45m39.958804498s) [upload=360474]: Done starting upload Aug 23 04:11:59.227614664 (346h45m39.958882314s) [upload=360474]: Uploading segments... Aug 23 04:11:59.227651072 (346h45m39.958918733s) [upload=360474]: Got next segment. Inline: true Aug 23 04:11:59.227656383 (346h45m39.958924043s) [upload=360474]: Waiting for error group managing segments... Aug 23 04:11:59.227707940 (346h45m39.9589756s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 04:11:59.227716657 (346h45m39.958984317s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 04:11:59.227724952 (346h45m39.958992613s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 04:11:59.230727896 (346h45m39.961995547s) [upload=360474]: Done uploading segments... Aug 23 04:11:59.230740019 (346h45m39.962007669s) [upload=360474]: Upload finished. err: metaclient: Too Many Requests
Duration: 166.158829ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
139.346352ms
FAIL (2025-08-23 04:34:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 04:11:59.227473138 (346h45m39.958740788s) [upload=360474]: Starting upload Aug 23 04:11:59.227536837 (346h45m39.958804498s) [upload=360474]: Done starting upload Aug 23 04:11:59.227614664 (346h45m39.958882314s) [upload=360474]: Uploading segments... Aug 23 04:11:59.227651072 (346h45m39.958918733s) [upload=360474]: Got next segment. Inline: true Aug 23 04:11:59.227656383 (346h45m39.958924043s) [upload=360474]: Waiting for error group managing segments... Aug 23 04:11:59.227707940 (346h45m39.9589756s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 04:11:59.227716657 (346h45m39.958984317s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 04:11:59.227724952 (346h45m39.958992613s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 04:11:59.230727896 (346h45m39.961995547s) [upload=360474]: Done uploading segments... Aug 23 04:11:59.230740019 (346h45m39.962007669s) [upload=360474]: Upload finished. err: metaclient: Too Many Requests
Duration: 139.404973ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
217.673269ms
FAIL (2025-08-23 04:33:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 04:11:59.227473138 (346h45m39.958740788s) [upload=360474]: Starting upload Aug 23 04:11:59.227536837 (346h45m39.958804498s) [upload=360474]: Done starting upload Aug 23 04:11:59.227614664 (346h45m39.958882314s) [upload=360474]: Uploading segments... Aug 23 04:11:59.227651072 (346h45m39.958918733s) [upload=360474]: Got next segment. Inline: true Aug 23 04:11:59.227656383 (346h45m39.958924043s) [upload=360474]: Waiting for error group managing segments... Aug 23 04:11:59.227707940 (346h45m39.9589756s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 04:11:59.227716657 (346h45m39.958984317s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 04:11:59.227724952 (346h45m39.958992613s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 04:11:59.230727896 (346h45m39.961995547s) [upload=360474]: Done uploading segments... Aug 23 04:11:59.230740019 (346h45m39.962007669s) [upload=360474]: Upload finished. err: metaclient: Too Many Requests
Duration: 217.70037ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
125.547199ms
FAIL (2025-08-23 04:32:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 04:11:59.227473138 (346h45m39.958740788s) [upload=360474]: Starting upload Aug 23 04:11:59.227536837 (346h45m39.958804498s) [upload=360474]: Done starting upload Aug 23 04:11:59.227614664 (346h45m39.958882314s) [upload=360474]: Uploading segments... Aug 23 04:11:59.227651072 (346h45m39.958918733s) [upload=360474]: Got next segment. Inline: true Aug 23 04:11:59.227656383 (346h45m39.958924043s) [upload=360474]: Waiting for error group managing segments... Aug 23 04:11:59.227707940 (346h45m39.9589756s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 04:11:59.227716657 (346h45m39.958984317s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 04:11:59.227724952 (346h45m39.958992613s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 04:11:59.230727896 (346h45m39.961995547s) [upload=360474]: Done uploading segments... Aug 23 04:11:59.230740019 (346h45m39.962007669s) [upload=360474]: Upload finished. err: metaclient: Too Many Requests
Duration: 125.569221ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
303.443047ms
FAIL (2025-08-23 04:31:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 23 04:11:59.227473138 (346h45m39.958740788s) [upload=360474]: Starting upload Aug 23 04:11:59.227536837 (346h45m39.958804498s) [upload=360474]: Done starting upload Aug 23 04:11:59.227614664 (346h45m39.958882314s) [upload=360474]: Uploading segments... Aug 23 04:11:59.227651072 (346h45m39.958918733s) [upload=360474]: Got next segment. Inline: true Aug 23 04:11:59.227656383 (346h45m39.958924043s) [upload=360474]: Waiting for error group managing segments... Aug 23 04:11:59.227707940 (346h45m39.9589756s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 04:11:59.227716657 (346h45m39.958984317s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 04:11:59.227724952 (346h45m39.958992613s) [upload=360474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 04:11:59.230727896 (346h45m39.961995547s) [upload=360474]: Done uploading segments... Aug 23 04:11:59.230740019 (346h45m39.962007669s) [upload=360474]: Upload finished. err: metaclient: Too Many Requests
Duration: 303.47097ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|