Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [........X.............X.....................X........X......] duration:
279.344499ms
FAIL (2025-08-14 13:29:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 13:24:24.391040260 (139h58m5.122307901s) [upload=145718]: Starting upload Aug 14 13:24:24.391096446 (139h58m5.122364096s) [upload=145718]: Done starting upload Aug 14 13:24:24.391156418 (139h58m5.122424067s) [upload=145718]: Uploading segments... Aug 14 13:24:24.391194669 (139h58m5.12246231s) [upload=145718]: Got next segment. Inline: true Aug 14 13:24:24.391200170 (139h58m5.12246782s) [upload=145718]: Waiting for error group managing segments... Aug 14 13:24:24.391267154 (139h58m5.122534805s) [upload=145718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 13:24:24.391273045 (139h58m5.122540696s) [upload=145718]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 13:24:24.391276822 (139h58m5.122544473s) [upload=145718]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 13:24:24.393899743 (139h58m5.125167393s) [upload=145718]: Done uploading segments... Aug 14 13:24:24.393911154 (139h58m5.125178804s) [upload=145718]: Upload finished. err: metaclient: Too Many Requests
Duration: 279.36621ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
396.976342ms
FAIL (2025-08-14 13:28:56 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 14 12:53:30.811893619 (139h27m11.54316128s) [upload=145185]: Starting upload
Aug 14 12:53:30.812060782 (139h27m11.543328433s) [upload=145185]: Done starting upload
Aug 14 12:53:30.812332184 (139h27m11.543599834s) [upload=145185]: Uploading segments...
Aug 14 12:53:30.812805844 (139h27m11.544073505s) [upload=145185]: Got next segment. Inline: false
Aug 14 12:53:30.812855368 (139h27m11.544123018s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 12:53:30.812863023 (139h27m11.544130672s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 12:53:30.840662084 (139h27m11.571929735s) [seg_pos={0 0}, upload=145185]: Begin upload segment...
Aug 14 12:53:30.840845550 (139h27m11.57211324s) [seg_pos={0 0}, upload=145185]: Done begin upload segment.
Aug 14 12:53:30.840887478 (139h27m11.572155128s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.840896425 (139h27m11.572164065s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841038943 (139h27m11.572306593s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841803511 (139h27m11.573071162s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841849618 (139h27m11.573117278s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842568741 (139h27m11.57383639s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842967270 (139h27m11.57423494s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843307149 (139h27m11.574574819s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843863526 (139h27m11.575131176s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844059354 (139h27m11.575327005s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844997248 (139h27m11.576264898s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845093238 (139h27m11.576360898s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845923159 (139h27m11.577190809s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845943016 (139h27m11.577210666s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846549868 (139h27m11.577817529s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846669723 (139h27m11.577937373s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847123256 (139h27m11.578390915s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847438158 (139h27m11.578705818s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.881759808 (139h27m11.613027429s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: ecclient: upload failed (node:1EiYA6gHiLyHsMfPevj2gLqmqttu1knLw3AM8SbWWtgKEf7Csu, address:104.36.82.5:4859): protocol: write tcp 5.161.89.252:28650->104.36.82.5:4859: write: connection refused; conn closed: op; piecestore: piecestore close: manager closed: conn closed: op
Aug 14 12:53:30.932703619 (139h27m11.663971239s) [upload=145185]: Next returned nil segment
Aug 14 12:53:30.932711613 (139h27m11.663979224s) [upload=145185]: Waiting for error group managing segments...
Aug 14 12:53:30.940609227 (139h27m11.671876847s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.940887300 (139h27m11.67215492s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.947132756 (139h27m11.678400377s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.952794213 (139h27m11.684061834s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.953517694 (139h27m11.684785314s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.955080694 (139h27m11.686348304s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.960298438 (139h27m11.691566058s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.970922197 (139h27m11.702189817s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.975258844 (139h27m11.706526464s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.976947489 (139h27m11.708215099s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.978861599 (139h27m11.710129229s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.986380830 (139h27m11.71764845s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.085651371 (139h27m11.816919021s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446180656 (139h27m12.177448286s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446211113 (139h27m12.177478743s) [seg_pos={0 0}, upload=145185]: Segment reached optimal threshold of 14 pieces.
Aug 14 12:53:31.446327853 (139h27m12.177595483s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446432539 (139h27m12.177700169s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446511999 (139h27m12.17777965s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446568505 (139h27m12.177836165s) [seg_pos={0 0}, upload=145185]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 12:53:31.446682359 (139h27m12.177950019s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 12:53:31.446690074 (139h27m12.177957723s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 12:53:31.495940821 (139h27m12.227208451s) [upload=145185]: Done uploading segments...
Aug 14 12:53:31.495953846 (139h27m12.227221465s) [upload=145185]: Upload finished. err: <nil>
Duration: 397.002871ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.........X.............X.....................X........X.....] duration:
236.158732ms
FAIL (2025-08-14 13:28:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 13:24:24.391040260 (139h58m5.122307901s) [upload=145718]: Starting upload Aug 14 13:24:24.391096446 (139h58m5.122364096s) [upload=145718]: Done starting upload Aug 14 13:24:24.391156418 (139h58m5.122424067s) [upload=145718]: Uploading segments... Aug 14 13:24:24.391194669 (139h58m5.12246231s) [upload=145718]: Got next segment. Inline: true Aug 14 13:24:24.391200170 (139h58m5.12246782s) [upload=145718]: Waiting for error group managing segments... Aug 14 13:24:24.391267154 (139h58m5.122534805s) [upload=145718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 13:24:24.391273045 (139h58m5.122540696s) [upload=145718]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 13:24:24.391276822 (139h58m5.122544473s) [upload=145718]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 13:24:24.393899743 (139h58m5.125167393s) [upload=145718]: Done uploading segments... Aug 14 13:24:24.393911154 (139h58m5.125178804s) [upload=145718]: Upload finished. err: metaclient: Too Many Requests
Duration: 236.176054ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
433.542966ms
FAIL (2025-08-14 13:28:29 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 14 12:53:30.811893619 (139h27m11.54316128s) [upload=145185]: Starting upload
Aug 14 12:53:30.812060782 (139h27m11.543328433s) [upload=145185]: Done starting upload
Aug 14 12:53:30.812332184 (139h27m11.543599834s) [upload=145185]: Uploading segments...
Aug 14 12:53:30.812805844 (139h27m11.544073505s) [upload=145185]: Got next segment. Inline: false
Aug 14 12:53:30.812855368 (139h27m11.544123018s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 12:53:30.812863023 (139h27m11.544130672s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 12:53:30.840662084 (139h27m11.571929735s) [seg_pos={0 0}, upload=145185]: Begin upload segment...
Aug 14 12:53:30.840845550 (139h27m11.57211324s) [seg_pos={0 0}, upload=145185]: Done begin upload segment.
Aug 14 12:53:30.840887478 (139h27m11.572155128s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.840896425 (139h27m11.572164065s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841038943 (139h27m11.572306593s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841803511 (139h27m11.573071162s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841849618 (139h27m11.573117278s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842568741 (139h27m11.57383639s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842967270 (139h27m11.57423494s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843307149 (139h27m11.574574819s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843863526 (139h27m11.575131176s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844059354 (139h27m11.575327005s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844997248 (139h27m11.576264898s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845093238 (139h27m11.576360898s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845923159 (139h27m11.577190809s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845943016 (139h27m11.577210666s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846549868 (139h27m11.577817529s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846669723 (139h27m11.577937373s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847123256 (139h27m11.578390915s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847438158 (139h27m11.578705818s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.881759808 (139h27m11.613027429s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: ecclient: upload failed (node:1EiYA6gHiLyHsMfPevj2gLqmqttu1knLw3AM8SbWWtgKEf7Csu, address:104.36.82.5:4859): protocol: write tcp 5.161.89.252:28650->104.36.82.5:4859: write: connection refused; conn closed: op; piecestore: piecestore close: manager closed: conn closed: op
Aug 14 12:53:30.932703619 (139h27m11.663971239s) [upload=145185]: Next returned nil segment
Aug 14 12:53:30.932711613 (139h27m11.663979224s) [upload=145185]: Waiting for error group managing segments...
Aug 14 12:53:30.940609227 (139h27m11.671876847s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.940887300 (139h27m11.67215492s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.947132756 (139h27m11.678400377s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.952794213 (139h27m11.684061834s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.953517694 (139h27m11.684785314s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.955080694 (139h27m11.686348304s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.960298438 (139h27m11.691566058s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.970922197 (139h27m11.702189817s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.975258844 (139h27m11.706526464s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.976947489 (139h27m11.708215099s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.978861599 (139h27m11.710129229s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.986380830 (139h27m11.71764845s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.085651371 (139h27m11.816919021s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446180656 (139h27m12.177448286s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446211113 (139h27m12.177478743s) [seg_pos={0 0}, upload=145185]: Segment reached optimal threshold of 14 pieces.
Aug 14 12:53:31.446327853 (139h27m12.177595483s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446432539 (139h27m12.177700169s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446511999 (139h27m12.17777965s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446568505 (139h27m12.177836165s) [seg_pos={0 0}, upload=145185]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 12:53:31.446682359 (139h27m12.177950019s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 12:53:31.446690074 (139h27m12.177957723s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 12:53:31.495940821 (139h27m12.227208451s) [upload=145185]: Done uploading segments...
Aug 14 12:53:31.495953846 (139h27m12.227221465s) [upload=145185]: Upload finished. err: <nil>
Duration: 433.556321ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..........X.............X.....................X........X....] duration:
170.221491ms
FAIL (2025-08-14 13:28:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 13:24:24.391040260 (139h58m5.122307901s) [upload=145718]: Starting upload Aug 14 13:24:24.391096446 (139h58m5.122364096s) [upload=145718]: Done starting upload Aug 14 13:24:24.391156418 (139h58m5.122424067s) [upload=145718]: Uploading segments... Aug 14 13:24:24.391194669 (139h58m5.12246231s) [upload=145718]: Got next segment. Inline: true Aug 14 13:24:24.391200170 (139h58m5.12246782s) [upload=145718]: Waiting for error group managing segments... Aug 14 13:24:24.391267154 (139h58m5.122534805s) [upload=145718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 13:24:24.391273045 (139h58m5.122540696s) [upload=145718]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 13:24:24.391276822 (139h58m5.122544473s) [upload=145718]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 13:24:24.393899743 (139h58m5.125167393s) [upload=145718]: Done uploading segments... Aug 14 13:24:24.393911154 (139h58m5.125178804s) [upload=145718]: Upload finished. err: metaclient: Too Many Requests
Duration: 170.237791ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
582.382108ms
FAIL (2025-08-14 13:28:01 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 14 12:53:30.811893619 (139h27m11.54316128s) [upload=145185]: Starting upload
Aug 14 12:53:30.812060782 (139h27m11.543328433s) [upload=145185]: Done starting upload
Aug 14 12:53:30.812332184 (139h27m11.543599834s) [upload=145185]: Uploading segments...
Aug 14 12:53:30.812805844 (139h27m11.544073505s) [upload=145185]: Got next segment. Inline: false
Aug 14 12:53:30.812855368 (139h27m11.544123018s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 12:53:30.812863023 (139h27m11.544130672s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 12:53:30.840662084 (139h27m11.571929735s) [seg_pos={0 0}, upload=145185]: Begin upload segment...
Aug 14 12:53:30.840845550 (139h27m11.57211324s) [seg_pos={0 0}, upload=145185]: Done begin upload segment.
Aug 14 12:53:30.840887478 (139h27m11.572155128s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.840896425 (139h27m11.572164065s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841038943 (139h27m11.572306593s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841803511 (139h27m11.573071162s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841849618 (139h27m11.573117278s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842568741 (139h27m11.57383639s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842967270 (139h27m11.57423494s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843307149 (139h27m11.574574819s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843863526 (139h27m11.575131176s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844059354 (139h27m11.575327005s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844997248 (139h27m11.576264898s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845093238 (139h27m11.576360898s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845923159 (139h27m11.577190809s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845943016 (139h27m11.577210666s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846549868 (139h27m11.577817529s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846669723 (139h27m11.577937373s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847123256 (139h27m11.578390915s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847438158 (139h27m11.578705818s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.881759808 (139h27m11.613027429s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: ecclient: upload failed (node:1EiYA6gHiLyHsMfPevj2gLqmqttu1knLw3AM8SbWWtgKEf7Csu, address:104.36.82.5:4859): protocol: write tcp 5.161.89.252:28650->104.36.82.5:4859: write: connection refused; conn closed: op; piecestore: piecestore close: manager closed: conn closed: op
Aug 14 12:53:30.932703619 (139h27m11.663971239s) [upload=145185]: Next returned nil segment
Aug 14 12:53:30.932711613 (139h27m11.663979224s) [upload=145185]: Waiting for error group managing segments...
Aug 14 12:53:30.940609227 (139h27m11.671876847s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.940887300 (139h27m11.67215492s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.947132756 (139h27m11.678400377s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.952794213 (139h27m11.684061834s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.953517694 (139h27m11.684785314s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.955080694 (139h27m11.686348304s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.960298438 (139h27m11.691566058s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.970922197 (139h27m11.702189817s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.975258844 (139h27m11.706526464s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.976947489 (139h27m11.708215099s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.978861599 (139h27m11.710129229s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.986380830 (139h27m11.71764845s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.085651371 (139h27m11.816919021s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446180656 (139h27m12.177448286s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446211113 (139h27m12.177478743s) [seg_pos={0 0}, upload=145185]: Segment reached optimal threshold of 14 pieces.
Aug 14 12:53:31.446327853 (139h27m12.177595483s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446432539 (139h27m12.177700169s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446511999 (139h27m12.17777965s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446568505 (139h27m12.177836165s) [seg_pos={0 0}, upload=145185]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 12:53:31.446682359 (139h27m12.177950019s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 12:53:31.446690074 (139h27m12.177957723s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 12:53:31.495940821 (139h27m12.227208451s) [upload=145185]: Done uploading segments...
Aug 14 12:53:31.495953846 (139h27m12.227221465s) [upload=145185]: Upload finished. err: <nil>
Duration: 582.409981ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
758.415117ms
FAIL (2025-08-14 13:27:41 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 14 12:53:30.811893619 (139h27m11.54316128s) [upload=145185]: Starting upload
Aug 14 12:53:30.812060782 (139h27m11.543328433s) [upload=145185]: Done starting upload
Aug 14 12:53:30.812332184 (139h27m11.543599834s) [upload=145185]: Uploading segments...
Aug 14 12:53:30.812805844 (139h27m11.544073505s) [upload=145185]: Got next segment. Inline: false
Aug 14 12:53:30.812855368 (139h27m11.544123018s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 12:53:30.812863023 (139h27m11.544130672s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 12:53:30.840662084 (139h27m11.571929735s) [seg_pos={0 0}, upload=145185]: Begin upload segment...
Aug 14 12:53:30.840845550 (139h27m11.57211324s) [seg_pos={0 0}, upload=145185]: Done begin upload segment.
Aug 14 12:53:30.840887478 (139h27m11.572155128s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.840896425 (139h27m11.572164065s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841038943 (139h27m11.572306593s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841803511 (139h27m11.573071162s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841849618 (139h27m11.573117278s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842568741 (139h27m11.57383639s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842967270 (139h27m11.57423494s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843307149 (139h27m11.574574819s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843863526 (139h27m11.575131176s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844059354 (139h27m11.575327005s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844997248 (139h27m11.576264898s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845093238 (139h27m11.576360898s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845923159 (139h27m11.577190809s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845943016 (139h27m11.577210666s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846549868 (139h27m11.577817529s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846669723 (139h27m11.577937373s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847123256 (139h27m11.578390915s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847438158 (139h27m11.578705818s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.881759808 (139h27m11.613027429s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: ecclient: upload failed (node:1EiYA6gHiLyHsMfPevj2gLqmqttu1knLw3AM8SbWWtgKEf7Csu, address:104.36.82.5:4859): protocol: write tcp 5.161.89.252:28650->104.36.82.5:4859: write: connection refused; conn closed: op; piecestore: piecestore close: manager closed: conn closed: op
Aug 14 12:53:30.932703619 (139h27m11.663971239s) [upload=145185]: Next returned nil segment
Aug 14 12:53:30.932711613 (139h27m11.663979224s) [upload=145185]: Waiting for error group managing segments...
Aug 14 12:53:30.940609227 (139h27m11.671876847s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.940887300 (139h27m11.67215492s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.947132756 (139h27m11.678400377s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.952794213 (139h27m11.684061834s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.953517694 (139h27m11.684785314s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.955080694 (139h27m11.686348304s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.960298438 (139h27m11.691566058s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.970922197 (139h27m11.702189817s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.975258844 (139h27m11.706526464s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.976947489 (139h27m11.708215099s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.978861599 (139h27m11.710129229s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.986380830 (139h27m11.71764845s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.085651371 (139h27m11.816919021s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446180656 (139h27m12.177448286s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446211113 (139h27m12.177478743s) [seg_pos={0 0}, upload=145185]: Segment reached optimal threshold of 14 pieces.
Aug 14 12:53:31.446327853 (139h27m12.177595483s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446432539 (139h27m12.177700169s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446511999 (139h27m12.17777965s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446568505 (139h27m12.177836165s) [seg_pos={0 0}, upload=145185]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 12:53:31.446682359 (139h27m12.177950019s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 12:53:31.446690074 (139h27m12.177957723s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 12:53:31.495940821 (139h27m12.227208451s) [upload=145185]: Done uploading segments...
Aug 14 12:53:31.495953846 (139h27m12.227221465s) [upload=145185]: Upload finished. err: <nil>
Duration: 758.438831ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
693.780388ms
FAIL (2025-08-14 13:27:09 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 14 12:53:30.811893619 (139h27m11.54316128s) [upload=145185]: Starting upload
Aug 14 12:53:30.812060782 (139h27m11.543328433s) [upload=145185]: Done starting upload
Aug 14 12:53:30.812332184 (139h27m11.543599834s) [upload=145185]: Uploading segments...
Aug 14 12:53:30.812805844 (139h27m11.544073505s) [upload=145185]: Got next segment. Inline: false
Aug 14 12:53:30.812855368 (139h27m11.544123018s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 12:53:30.812863023 (139h27m11.544130672s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 12:53:30.840662084 (139h27m11.571929735s) [seg_pos={0 0}, upload=145185]: Begin upload segment...
Aug 14 12:53:30.840845550 (139h27m11.57211324s) [seg_pos={0 0}, upload=145185]: Done begin upload segment.
Aug 14 12:53:30.840887478 (139h27m11.572155128s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.840896425 (139h27m11.572164065s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841038943 (139h27m11.572306593s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841803511 (139h27m11.573071162s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841849618 (139h27m11.573117278s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842568741 (139h27m11.57383639s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842967270 (139h27m11.57423494s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843307149 (139h27m11.574574819s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843863526 (139h27m11.575131176s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844059354 (139h27m11.575327005s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844997248 (139h27m11.576264898s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845093238 (139h27m11.576360898s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845923159 (139h27m11.577190809s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845943016 (139h27m11.577210666s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846549868 (139h27m11.577817529s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846669723 (139h27m11.577937373s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847123256 (139h27m11.578390915s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847438158 (139h27m11.578705818s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.881759808 (139h27m11.613027429s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: ecclient: upload failed (node:1EiYA6gHiLyHsMfPevj2gLqmqttu1knLw3AM8SbWWtgKEf7Csu, address:104.36.82.5:4859): protocol: write tcp 5.161.89.252:28650->104.36.82.5:4859: write: connection refused; conn closed: op; piecestore: piecestore close: manager closed: conn closed: op
Aug 14 12:53:30.932703619 (139h27m11.663971239s) [upload=145185]: Next returned nil segment
Aug 14 12:53:30.932711613 (139h27m11.663979224s) [upload=145185]: Waiting for error group managing segments...
Aug 14 12:53:30.940609227 (139h27m11.671876847s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.940887300 (139h27m11.67215492s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.947132756 (139h27m11.678400377s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.952794213 (139h27m11.684061834s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.953517694 (139h27m11.684785314s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.955080694 (139h27m11.686348304s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.960298438 (139h27m11.691566058s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.970922197 (139h27m11.702189817s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.975258844 (139h27m11.706526464s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.976947489 (139h27m11.708215099s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.978861599 (139h27m11.710129229s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.986380830 (139h27m11.71764845s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.085651371 (139h27m11.816919021s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446180656 (139h27m12.177448286s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446211113 (139h27m12.177478743s) [seg_pos={0 0}, upload=145185]: Segment reached optimal threshold of 14 pieces.
Aug 14 12:53:31.446327853 (139h27m12.177595483s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446432539 (139h27m12.177700169s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446511999 (139h27m12.17777965s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446568505 (139h27m12.177836165s) [seg_pos={0 0}, upload=145185]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 12:53:31.446682359 (139h27m12.177950019s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 12:53:31.446690074 (139h27m12.177957723s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 12:53:31.495940821 (139h27m12.227208451s) [upload=145185]: Done uploading segments...
Aug 14 12:53:31.495953846 (139h27m12.227221465s) [upload=145185]: Upload finished. err: <nil>
Duration: 693.805916ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...........X.............X.....................X........X...] duration:
177.97769ms
FAIL (2025-08-14 13:27:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 13:24:24.391040260 (139h58m5.122307901s) [upload=145718]: Starting upload Aug 14 13:24:24.391096446 (139h58m5.122364096s) [upload=145718]: Done starting upload Aug 14 13:24:24.391156418 (139h58m5.122424067s) [upload=145718]: Uploading segments... Aug 14 13:24:24.391194669 (139h58m5.12246231s) [upload=145718]: Got next segment. Inline: true Aug 14 13:24:24.391200170 (139h58m5.12246782s) [upload=145718]: Waiting for error group managing segments... Aug 14 13:24:24.391267154 (139h58m5.122534805s) [upload=145718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 13:24:24.391273045 (139h58m5.122540696s) [upload=145718]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 13:24:24.391276822 (139h58m5.122544473s) [upload=145718]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 13:24:24.393899743 (139h58m5.125167393s) [upload=145718]: Done uploading segments... Aug 14 13:24:24.393911154 (139h58m5.125178804s) [upload=145718]: Upload finished. err: metaclient: Too Many Requests
Duration: 177.99905ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
415.796422ms
FAIL (2025-08-14 13:26:48 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 14 12:53:30.811893619 (139h27m11.54316128s) [upload=145185]: Starting upload
Aug 14 12:53:30.812060782 (139h27m11.543328433s) [upload=145185]: Done starting upload
Aug 14 12:53:30.812332184 (139h27m11.543599834s) [upload=145185]: Uploading segments...
Aug 14 12:53:30.812805844 (139h27m11.544073505s) [upload=145185]: Got next segment. Inline: false
Aug 14 12:53:30.812855368 (139h27m11.544123018s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 12:53:30.812863023 (139h27m11.544130672s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 12:53:30.840662084 (139h27m11.571929735s) [seg_pos={0 0}, upload=145185]: Begin upload segment...
Aug 14 12:53:30.840845550 (139h27m11.57211324s) [seg_pos={0 0}, upload=145185]: Done begin upload segment.
Aug 14 12:53:30.840887478 (139h27m11.572155128s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.840896425 (139h27m11.572164065s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841038943 (139h27m11.572306593s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841803511 (139h27m11.573071162s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841849618 (139h27m11.573117278s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842568741 (139h27m11.57383639s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842967270 (139h27m11.57423494s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843307149 (139h27m11.574574819s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843863526 (139h27m11.575131176s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844059354 (139h27m11.575327005s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844997248 (139h27m11.576264898s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845093238 (139h27m11.576360898s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845923159 (139h27m11.577190809s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845943016 (139h27m11.577210666s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846549868 (139h27m11.577817529s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846669723 (139h27m11.577937373s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847123256 (139h27m11.578390915s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847438158 (139h27m11.578705818s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.881759808 (139h27m11.613027429s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: ecclient: upload failed (node:1EiYA6gHiLyHsMfPevj2gLqmqttu1knLw3AM8SbWWtgKEf7Csu, address:104.36.82.5:4859): protocol: write tcp 5.161.89.252:28650->104.36.82.5:4859: write: connection refused; conn closed: op; piecestore: piecestore close: manager closed: conn closed: op
Aug 14 12:53:30.932703619 (139h27m11.663971239s) [upload=145185]: Next returned nil segment
Aug 14 12:53:30.932711613 (139h27m11.663979224s) [upload=145185]: Waiting for error group managing segments...
Aug 14 12:53:30.940609227 (139h27m11.671876847s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.940887300 (139h27m11.67215492s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.947132756 (139h27m11.678400377s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.952794213 (139h27m11.684061834s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.953517694 (139h27m11.684785314s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.955080694 (139h27m11.686348304s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.960298438 (139h27m11.691566058s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.970922197 (139h27m11.702189817s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.975258844 (139h27m11.706526464s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.976947489 (139h27m11.708215099s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.978861599 (139h27m11.710129229s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.986380830 (139h27m11.71764845s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.085651371 (139h27m11.816919021s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446180656 (139h27m12.177448286s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446211113 (139h27m12.177478743s) [seg_pos={0 0}, upload=145185]: Segment reached optimal threshold of 14 pieces.
Aug 14 12:53:31.446327853 (139h27m12.177595483s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446432539 (139h27m12.177700169s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446511999 (139h27m12.17777965s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446568505 (139h27m12.177836165s) [seg_pos={0 0}, upload=145185]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 12:53:31.446682359 (139h27m12.177950019s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 12:53:31.446690074 (139h27m12.177957723s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 12:53:31.495940821 (139h27m12.227208451s) [upload=145185]: Done uploading segments...
Aug 14 12:53:31.495953846 (139h27m12.227221465s) [upload=145185]: Upload finished. err: <nil>
Duration: 415.818524ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [............X.............X.....................X........X..] duration:
176.113556ms
FAIL (2025-08-14 13:25:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 13:24:24.391040260 (139h58m5.122307901s) [upload=145718]: Starting upload Aug 14 13:24:24.391096446 (139h58m5.122364096s) [upload=145718]: Done starting upload Aug 14 13:24:24.391156418 (139h58m5.122424067s) [upload=145718]: Uploading segments... Aug 14 13:24:24.391194669 (139h58m5.12246231s) [upload=145718]: Got next segment. Inline: true Aug 14 13:24:24.391200170 (139h58m5.12246782s) [upload=145718]: Waiting for error group managing segments... Aug 14 13:24:24.391267154 (139h58m5.122534805s) [upload=145718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 13:24:24.391273045 (139h58m5.122540696s) [upload=145718]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 13:24:24.391276822 (139h58m5.122544473s) [upload=145718]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 13:24:24.393899743 (139h58m5.125167393s) [upload=145718]: Done uploading segments... Aug 14 13:24:24.393911154 (139h58m5.125178804s) [upload=145718]: Upload finished. err: metaclient: Too Many Requests
Duration: 176.140626ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
566.505088ms
FAIL (2025-08-14 13:25:41 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 14 12:53:30.811893619 (139h27m11.54316128s) [upload=145185]: Starting upload
Aug 14 12:53:30.812060782 (139h27m11.543328433s) [upload=145185]: Done starting upload
Aug 14 12:53:30.812332184 (139h27m11.543599834s) [upload=145185]: Uploading segments...
Aug 14 12:53:30.812805844 (139h27m11.544073505s) [upload=145185]: Got next segment. Inline: false
Aug 14 12:53:30.812855368 (139h27m11.544123018s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 12:53:30.812863023 (139h27m11.544130672s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 12:53:30.840662084 (139h27m11.571929735s) [seg_pos={0 0}, upload=145185]: Begin upload segment...
Aug 14 12:53:30.840845550 (139h27m11.57211324s) [seg_pos={0 0}, upload=145185]: Done begin upload segment.
Aug 14 12:53:30.840887478 (139h27m11.572155128s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.840896425 (139h27m11.572164065s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841038943 (139h27m11.572306593s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841803511 (139h27m11.573071162s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841849618 (139h27m11.573117278s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842568741 (139h27m11.57383639s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842967270 (139h27m11.57423494s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843307149 (139h27m11.574574819s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843863526 (139h27m11.575131176s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844059354 (139h27m11.575327005s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844997248 (139h27m11.576264898s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845093238 (139h27m11.576360898s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845923159 (139h27m11.577190809s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845943016 (139h27m11.577210666s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846549868 (139h27m11.577817529s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846669723 (139h27m11.577937373s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847123256 (139h27m11.578390915s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847438158 (139h27m11.578705818s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.881759808 (139h27m11.613027429s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: ecclient: upload failed (node:1EiYA6gHiLyHsMfPevj2gLqmqttu1knLw3AM8SbWWtgKEf7Csu, address:104.36.82.5:4859): protocol: write tcp 5.161.89.252:28650->104.36.82.5:4859: write: connection refused; conn closed: op; piecestore: piecestore close: manager closed: conn closed: op
Aug 14 12:53:30.932703619 (139h27m11.663971239s) [upload=145185]: Next returned nil segment
Aug 14 12:53:30.932711613 (139h27m11.663979224s) [upload=145185]: Waiting for error group managing segments...
Aug 14 12:53:30.940609227 (139h27m11.671876847s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.940887300 (139h27m11.67215492s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.947132756 (139h27m11.678400377s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.952794213 (139h27m11.684061834s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.953517694 (139h27m11.684785314s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.955080694 (139h27m11.686348304s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.960298438 (139h27m11.691566058s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.970922197 (139h27m11.702189817s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.975258844 (139h27m11.706526464s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.976947489 (139h27m11.708215099s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.978861599 (139h27m11.710129229s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.986380830 (139h27m11.71764845s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.085651371 (139h27m11.816919021s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446180656 (139h27m12.177448286s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446211113 (139h27m12.177478743s) [seg_pos={0 0}, upload=145185]: Segment reached optimal threshold of 14 pieces.
Aug 14 12:53:31.446327853 (139h27m12.177595483s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446432539 (139h27m12.177700169s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446511999 (139h27m12.17777965s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446568505 (139h27m12.177836165s) [seg_pos={0 0}, upload=145185]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 12:53:31.446682359 (139h27m12.177950019s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 12:53:31.446690074 (139h27m12.177957723s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 12:53:31.495940821 (139h27m12.227208451s) [upload=145185]: Done uploading segments...
Aug 14 12:53:31.495953846 (139h27m12.227221465s) [upload=145185]: Upload finished. err: <nil>
Duration: 566.528994ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
391.36542ms
FAIL (2025-08-14 13:25:19 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 14 12:53:30.811893619 (139h27m11.54316128s) [upload=145185]: Starting upload
Aug 14 12:53:30.812060782 (139h27m11.543328433s) [upload=145185]: Done starting upload
Aug 14 12:53:30.812332184 (139h27m11.543599834s) [upload=145185]: Uploading segments...
Aug 14 12:53:30.812805844 (139h27m11.544073505s) [upload=145185]: Got next segment. Inline: false
Aug 14 12:53:30.812855368 (139h27m11.544123018s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 12:53:30.812863023 (139h27m11.544130672s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 12:53:30.840662084 (139h27m11.571929735s) [seg_pos={0 0}, upload=145185]: Begin upload segment...
Aug 14 12:53:30.840845550 (139h27m11.57211324s) [seg_pos={0 0}, upload=145185]: Done begin upload segment.
Aug 14 12:53:30.840887478 (139h27m11.572155128s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.840896425 (139h27m11.572164065s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841038943 (139h27m11.572306593s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841803511 (139h27m11.573071162s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841849618 (139h27m11.573117278s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842568741 (139h27m11.57383639s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842967270 (139h27m11.57423494s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843307149 (139h27m11.574574819s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843863526 (139h27m11.575131176s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844059354 (139h27m11.575327005s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844997248 (139h27m11.576264898s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845093238 (139h27m11.576360898s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845923159 (139h27m11.577190809s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845943016 (139h27m11.577210666s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846549868 (139h27m11.577817529s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846669723 (139h27m11.577937373s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847123256 (139h27m11.578390915s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847438158 (139h27m11.578705818s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.881759808 (139h27m11.613027429s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: ecclient: upload failed (node:1EiYA6gHiLyHsMfPevj2gLqmqttu1knLw3AM8SbWWtgKEf7Csu, address:104.36.82.5:4859): protocol: write tcp 5.161.89.252:28650->104.36.82.5:4859: write: connection refused; conn closed: op; piecestore: piecestore close: manager closed: conn closed: op
Aug 14 12:53:30.932703619 (139h27m11.663971239s) [upload=145185]: Next returned nil segment
Aug 14 12:53:30.932711613 (139h27m11.663979224s) [upload=145185]: Waiting for error group managing segments...
Aug 14 12:53:30.940609227 (139h27m11.671876847s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.940887300 (139h27m11.67215492s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.947132756 (139h27m11.678400377s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.952794213 (139h27m11.684061834s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.953517694 (139h27m11.684785314s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.955080694 (139h27m11.686348304s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.960298438 (139h27m11.691566058s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.970922197 (139h27m11.702189817s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.975258844 (139h27m11.706526464s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.976947489 (139h27m11.708215099s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.978861599 (139h27m11.710129229s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.986380830 (139h27m11.71764845s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.085651371 (139h27m11.816919021s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446180656 (139h27m12.177448286s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446211113 (139h27m12.177478743s) [seg_pos={0 0}, upload=145185]: Segment reached optimal threshold of 14 pieces.
Aug 14 12:53:31.446327853 (139h27m12.177595483s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446432539 (139h27m12.177700169s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446511999 (139h27m12.17777965s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446568505 (139h27m12.177836165s) [seg_pos={0 0}, upload=145185]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 12:53:31.446682359 (139h27m12.177950019s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 12:53:31.446690074 (139h27m12.177957723s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 12:53:31.495940821 (139h27m12.227208451s) [upload=145185]: Done uploading segments...
Aug 14 12:53:31.495953846 (139h27m12.227221465s) [upload=145185]: Upload finished. err: <nil>
Duration: 391.386279ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.............X.............X.....................X........X.] duration:
162.12371ms
FAIL (2025-08-14 13:24:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 13:24:24.391040260 (139h58m5.122307901s) [upload=145718]: Starting upload Aug 14 13:24:24.391096446 (139h58m5.122364096s) [upload=145718]: Done starting upload Aug 14 13:24:24.391156418 (139h58m5.122424067s) [upload=145718]: Uploading segments... Aug 14 13:24:24.391194669 (139h58m5.12246231s) [upload=145718]: Got next segment. Inline: true Aug 14 13:24:24.391200170 (139h58m5.12246782s) [upload=145718]: Waiting for error group managing segments... Aug 14 13:24:24.391267154 (139h58m5.122534805s) [upload=145718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 13:24:24.391273045 (139h58m5.122540696s) [upload=145718]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 13:24:24.391276822 (139h58m5.122544473s) [upload=145718]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 13:24:24.393899743 (139h58m5.125167393s) [upload=145718]: Done uploading segments... Aug 14 13:24:24.393911154 (139h58m5.125178804s) [upload=145718]: Upload finished. err: metaclient: Too Many Requests
Duration: 162.15046ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
466.01175ms
FAIL (2025-08-14 13:24:31 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 14 12:53:30.811893619 (139h27m11.54316128s) [upload=145185]: Starting upload
Aug 14 12:53:30.812060782 (139h27m11.543328433s) [upload=145185]: Done starting upload
Aug 14 12:53:30.812332184 (139h27m11.543599834s) [upload=145185]: Uploading segments...
Aug 14 12:53:30.812805844 (139h27m11.544073505s) [upload=145185]: Got next segment. Inline: false
Aug 14 12:53:30.812855368 (139h27m11.544123018s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 12:53:30.812863023 (139h27m11.544130672s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 12:53:30.840662084 (139h27m11.571929735s) [seg_pos={0 0}, upload=145185]: Begin upload segment...
Aug 14 12:53:30.840845550 (139h27m11.57211324s) [seg_pos={0 0}, upload=145185]: Done begin upload segment.
Aug 14 12:53:30.840887478 (139h27m11.572155128s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.840896425 (139h27m11.572164065s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841038943 (139h27m11.572306593s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841803511 (139h27m11.573071162s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841849618 (139h27m11.573117278s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842568741 (139h27m11.57383639s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842967270 (139h27m11.57423494s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843307149 (139h27m11.574574819s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843863526 (139h27m11.575131176s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844059354 (139h27m11.575327005s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844997248 (139h27m11.576264898s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845093238 (139h27m11.576360898s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845923159 (139h27m11.577190809s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845943016 (139h27m11.577210666s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846549868 (139h27m11.577817529s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846669723 (139h27m11.577937373s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847123256 (139h27m11.578390915s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847438158 (139h27m11.578705818s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.881759808 (139h27m11.613027429s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: ecclient: upload failed (node:1EiYA6gHiLyHsMfPevj2gLqmqttu1knLw3AM8SbWWtgKEf7Csu, address:104.36.82.5:4859): protocol: write tcp 5.161.89.252:28650->104.36.82.5:4859: write: connection refused; conn closed: op; piecestore: piecestore close: manager closed: conn closed: op
Aug 14 12:53:30.932703619 (139h27m11.663971239s) [upload=145185]: Next returned nil segment
Aug 14 12:53:30.932711613 (139h27m11.663979224s) [upload=145185]: Waiting for error group managing segments...
Aug 14 12:53:30.940609227 (139h27m11.671876847s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.940887300 (139h27m11.67215492s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.947132756 (139h27m11.678400377s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.952794213 (139h27m11.684061834s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.953517694 (139h27m11.684785314s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.955080694 (139h27m11.686348304s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.960298438 (139h27m11.691566058s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.970922197 (139h27m11.702189817s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.975258844 (139h27m11.706526464s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.976947489 (139h27m11.708215099s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.978861599 (139h27m11.710129229s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.986380830 (139h27m11.71764845s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.085651371 (139h27m11.816919021s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446180656 (139h27m12.177448286s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446211113 (139h27m12.177478743s) [seg_pos={0 0}, upload=145185]: Segment reached optimal threshold of 14 pieces.
Aug 14 12:53:31.446327853 (139h27m12.177595483s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446432539 (139h27m12.177700169s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446511999 (139h27m12.17777965s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446568505 (139h27m12.177836165s) [seg_pos={0 0}, upload=145185]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 12:53:31.446682359 (139h27m12.177950019s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 12:53:31.446690074 (139h27m12.177957723s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 12:53:31.495940821 (139h27m12.227208451s) [upload=145185]: Done uploading segments...
Aug 14 12:53:31.495953846 (139h27m12.227221465s) [upload=145185]: Upload finished. err: <nil>
Duration: 466.03338ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..............X.............X.....................X........X] duration:
16.346367ms
FAIL (2025-08-14 13:24:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 13:24:24.391040260 (139h58m5.122307901s) [upload=145718]: Starting upload Aug 14 13:24:24.391096446 (139h58m5.122364096s) [upload=145718]: Done starting upload Aug 14 13:24:24.391156418 (139h58m5.122424067s) [upload=145718]: Uploading segments... Aug 14 13:24:24.391194669 (139h58m5.12246231s) [upload=145718]: Got next segment. Inline: true Aug 14 13:24:24.391200170 (139h58m5.12246782s) [upload=145718]: Waiting for error group managing segments... Aug 14 13:24:24.391267154 (139h58m5.122534805s) [upload=145718]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 13:24:24.391273045 (139h58m5.122540696s) [upload=145718]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 13:24:24.391276822 (139h58m5.122544473s) [upload=145718]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 13:24:24.393899743 (139h58m5.125167393s) [upload=145718]: Done uploading segments... Aug 14 13:24:24.393911154 (139h58m5.125178804s) [upload=145718]: Upload finished. err: metaclient: Too Many Requests
Duration: 16.367096ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
429.389176ms
FAIL (2025-08-14 13:23:39 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 14 12:53:30.811893619 (139h27m11.54316128s) [upload=145185]: Starting upload
Aug 14 12:53:30.812060782 (139h27m11.543328433s) [upload=145185]: Done starting upload
Aug 14 12:53:30.812332184 (139h27m11.543599834s) [upload=145185]: Uploading segments...
Aug 14 12:53:30.812805844 (139h27m11.544073505s) [upload=145185]: Got next segment. Inline: false
Aug 14 12:53:30.812855368 (139h27m11.544123018s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 12:53:30.812863023 (139h27m11.544130672s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 12:53:30.840662084 (139h27m11.571929735s) [seg_pos={0 0}, upload=145185]: Begin upload segment...
Aug 14 12:53:30.840845550 (139h27m11.57211324s) [seg_pos={0 0}, upload=145185]: Done begin upload segment.
Aug 14 12:53:30.840887478 (139h27m11.572155128s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.840896425 (139h27m11.572164065s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841038943 (139h27m11.572306593s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841803511 (139h27m11.573071162s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841849618 (139h27m11.573117278s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842568741 (139h27m11.57383639s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842967270 (139h27m11.57423494s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843307149 (139h27m11.574574819s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843863526 (139h27m11.575131176s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844059354 (139h27m11.575327005s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844997248 (139h27m11.576264898s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845093238 (139h27m11.576360898s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845923159 (139h27m11.577190809s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845943016 (139h27m11.577210666s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846549868 (139h27m11.577817529s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846669723 (139h27m11.577937373s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847123256 (139h27m11.578390915s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847438158 (139h27m11.578705818s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.881759808 (139h27m11.613027429s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: ecclient: upload failed (node:1EiYA6gHiLyHsMfPevj2gLqmqttu1knLw3AM8SbWWtgKEf7Csu, address:104.36.82.5:4859): protocol: write tcp 5.161.89.252:28650->104.36.82.5:4859: write: connection refused; conn closed: op; piecestore: piecestore close: manager closed: conn closed: op
Aug 14 12:53:30.932703619 (139h27m11.663971239s) [upload=145185]: Next returned nil segment
Aug 14 12:53:30.932711613 (139h27m11.663979224s) [upload=145185]: Waiting for error group managing segments...
Aug 14 12:53:30.940609227 (139h27m11.671876847s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.940887300 (139h27m11.67215492s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.947132756 (139h27m11.678400377s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.952794213 (139h27m11.684061834s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.953517694 (139h27m11.684785314s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.955080694 (139h27m11.686348304s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.960298438 (139h27m11.691566058s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.970922197 (139h27m11.702189817s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.975258844 (139h27m11.706526464s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.976947489 (139h27m11.708215099s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.978861599 (139h27m11.710129229s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.986380830 (139h27m11.71764845s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.085651371 (139h27m11.816919021s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446180656 (139h27m12.177448286s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446211113 (139h27m12.177478743s) [seg_pos={0 0}, upload=145185]: Segment reached optimal threshold of 14 pieces.
Aug 14 12:53:31.446327853 (139h27m12.177595483s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446432539 (139h27m12.177700169s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446511999 (139h27m12.17777965s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446568505 (139h27m12.177836165s) [seg_pos={0 0}, upload=145185]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 12:53:31.446682359 (139h27m12.177950019s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 12:53:31.446690074 (139h27m12.177957723s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 12:53:31.495940821 (139h27m12.227208451s) [upload=145185]: Done uploading segments...
Aug 14 12:53:31.495953846 (139h27m12.227221465s) [upload=145185]: Upload finished. err: <nil>
Duration: 429.400917ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............X.............X.....................X........] duration:
171.181523ms
FAIL (2025-08-14 13:23:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 13:17:00.178020483 (139h50m40.909288104s) [upload=145588]: Starting upload Aug 14 13:17:00.178063935 (139h50m40.909331565s) [upload=145588]: Done starting upload Aug 14 13:17:00.178107788 (139h50m40.909375408s) [upload=145588]: Uploading segments... Aug 14 13:17:00.178146912 (139h50m40.909414542s) [upload=145588]: Got next segment. Inline: true Aug 14 13:17:00.178150288 (139h50m40.909417908s) [upload=145588]: Waiting for error group managing segments... Aug 14 13:17:00.178181667 (139h50m40.909449297s) [upload=145588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 13:17:00.178186145 (139h50m40.909453775s) [upload=145588]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 13:17:00.178188700 (139h50m40.90945632s) [upload=145588]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 13:17:00.181109793 (139h50m40.912377423s) [upload=145588]: Done uploading segments... Aug 14 13:17:00.181118729 (139h50m40.91238636s) [upload=145588]: Upload finished. err: metaclient: Too Many Requests
Duration: 171.202072ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
516.468767ms
FAIL (2025-08-14 13:23:01 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 14 12:53:30.811893619 (139h27m11.54316128s) [upload=145185]: Starting upload
Aug 14 12:53:30.812060782 (139h27m11.543328433s) [upload=145185]: Done starting upload
Aug 14 12:53:30.812332184 (139h27m11.543599834s) [upload=145185]: Uploading segments...
Aug 14 12:53:30.812805844 (139h27m11.544073505s) [upload=145185]: Got next segment. Inline: false
Aug 14 12:53:30.812855368 (139h27m11.544123018s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 12:53:30.812863023 (139h27m11.544130672s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 12:53:30.840662084 (139h27m11.571929735s) [seg_pos={0 0}, upload=145185]: Begin upload segment...
Aug 14 12:53:30.840845550 (139h27m11.57211324s) [seg_pos={0 0}, upload=145185]: Done begin upload segment.
Aug 14 12:53:30.840887478 (139h27m11.572155128s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.840896425 (139h27m11.572164065s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841038943 (139h27m11.572306593s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841803511 (139h27m11.573071162s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841849618 (139h27m11.573117278s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842568741 (139h27m11.57383639s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842967270 (139h27m11.57423494s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843307149 (139h27m11.574574819s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843863526 (139h27m11.575131176s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844059354 (139h27m11.575327005s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844997248 (139h27m11.576264898s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845093238 (139h27m11.576360898s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845923159 (139h27m11.577190809s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845943016 (139h27m11.577210666s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846549868 (139h27m11.577817529s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846669723 (139h27m11.577937373s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847123256 (139h27m11.578390915s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847438158 (139h27m11.578705818s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.881759808 (139h27m11.613027429s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: ecclient: upload failed (node:1EiYA6gHiLyHsMfPevj2gLqmqttu1knLw3AM8SbWWtgKEf7Csu, address:104.36.82.5:4859): protocol: write tcp 5.161.89.252:28650->104.36.82.5:4859: write: connection refused; conn closed: op; piecestore: piecestore close: manager closed: conn closed: op
Aug 14 12:53:30.932703619 (139h27m11.663971239s) [upload=145185]: Next returned nil segment
Aug 14 12:53:30.932711613 (139h27m11.663979224s) [upload=145185]: Waiting for error group managing segments...
Aug 14 12:53:30.940609227 (139h27m11.671876847s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.940887300 (139h27m11.67215492s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.947132756 (139h27m11.678400377s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.952794213 (139h27m11.684061834s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.953517694 (139h27m11.684785314s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.955080694 (139h27m11.686348304s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.960298438 (139h27m11.691566058s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.970922197 (139h27m11.702189817s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.975258844 (139h27m11.706526464s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.976947489 (139h27m11.708215099s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.978861599 (139h27m11.710129229s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.986380830 (139h27m11.71764845s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.085651371 (139h27m11.816919021s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446180656 (139h27m12.177448286s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446211113 (139h27m12.177478743s) [seg_pos={0 0}, upload=145185]: Segment reached optimal threshold of 14 pieces.
Aug 14 12:53:31.446327853 (139h27m12.177595483s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446432539 (139h27m12.177700169s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446511999 (139h27m12.17777965s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446568505 (139h27m12.177836165s) [seg_pos={0 0}, upload=145185]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 12:53:31.446682359 (139h27m12.177950019s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 12:53:31.446690074 (139h27m12.177957723s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 12:53:31.495940821 (139h27m12.227208451s) [upload=145185]: Done uploading segments...
Aug 14 12:53:31.495953846 (139h27m12.227221465s) [upload=145185]: Upload finished. err: <nil>
Duration: 516.51829ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
577.013842ms
FAIL (2025-08-14 13:22:40 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 14 12:53:30.811893619 (139h27m11.54316128s) [upload=145185]: Starting upload
Aug 14 12:53:30.812060782 (139h27m11.543328433s) [upload=145185]: Done starting upload
Aug 14 12:53:30.812332184 (139h27m11.543599834s) [upload=145185]: Uploading segments...
Aug 14 12:53:30.812805844 (139h27m11.544073505s) [upload=145185]: Got next segment. Inline: false
Aug 14 12:53:30.812855368 (139h27m11.544123018s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 12:53:30.812863023 (139h27m11.544130672s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 12:53:30.840662084 (139h27m11.571929735s) [seg_pos={0 0}, upload=145185]: Begin upload segment...
Aug 14 12:53:30.840845550 (139h27m11.57211324s) [seg_pos={0 0}, upload=145185]: Done begin upload segment.
Aug 14 12:53:30.840887478 (139h27m11.572155128s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.840896425 (139h27m11.572164065s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841038943 (139h27m11.572306593s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841803511 (139h27m11.573071162s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841849618 (139h27m11.573117278s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842568741 (139h27m11.57383639s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842967270 (139h27m11.57423494s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843307149 (139h27m11.574574819s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843863526 (139h27m11.575131176s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844059354 (139h27m11.575327005s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844997248 (139h27m11.576264898s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845093238 (139h27m11.576360898s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845923159 (139h27m11.577190809s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845943016 (139h27m11.577210666s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846549868 (139h27m11.577817529s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846669723 (139h27m11.577937373s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847123256 (139h27m11.578390915s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847438158 (139h27m11.578705818s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.881759808 (139h27m11.613027429s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: ecclient: upload failed (node:1EiYA6gHiLyHsMfPevj2gLqmqttu1knLw3AM8SbWWtgKEf7Csu, address:104.36.82.5:4859): protocol: write tcp 5.161.89.252:28650->104.36.82.5:4859: write: connection refused; conn closed: op; piecestore: piecestore close: manager closed: conn closed: op
Aug 14 12:53:30.932703619 (139h27m11.663971239s) [upload=145185]: Next returned nil segment
Aug 14 12:53:30.932711613 (139h27m11.663979224s) [upload=145185]: Waiting for error group managing segments...
Aug 14 12:53:30.940609227 (139h27m11.671876847s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.940887300 (139h27m11.67215492s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.947132756 (139h27m11.678400377s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.952794213 (139h27m11.684061834s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.953517694 (139h27m11.684785314s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.955080694 (139h27m11.686348304s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.960298438 (139h27m11.691566058s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.970922197 (139h27m11.702189817s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.975258844 (139h27m11.706526464s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.976947489 (139h27m11.708215099s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.978861599 (139h27m11.710129229s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.986380830 (139h27m11.71764845s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.085651371 (139h27m11.816919021s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446180656 (139h27m12.177448286s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446211113 (139h27m12.177478743s) [seg_pos={0 0}, upload=145185]: Segment reached optimal threshold of 14 pieces.
Aug 14 12:53:31.446327853 (139h27m12.177595483s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446432539 (139h27m12.177700169s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446511999 (139h27m12.17777965s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446568505 (139h27m12.177836165s) [seg_pos={0 0}, upload=145185]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 12:53:31.446682359 (139h27m12.177950019s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 12:53:31.446690074 (139h27m12.177957723s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 12:53:31.495940821 (139h27m12.227208451s) [upload=145185]: Done uploading segments...
Aug 14 12:53:31.495953846 (139h27m12.227221465s) [upload=145185]: Upload finished. err: <nil>
Duration: 577.031505ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................X.............X.....................X.......] duration:
260.981791ms
FAIL (2025-08-14 13:22:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 13:17:00.178020483 (139h50m40.909288104s) [upload=145588]: Starting upload Aug 14 13:17:00.178063935 (139h50m40.909331565s) [upload=145588]: Done starting upload Aug 14 13:17:00.178107788 (139h50m40.909375408s) [upload=145588]: Uploading segments... Aug 14 13:17:00.178146912 (139h50m40.909414542s) [upload=145588]: Got next segment. Inline: true Aug 14 13:17:00.178150288 (139h50m40.909417908s) [upload=145588]: Waiting for error group managing segments... Aug 14 13:17:00.178181667 (139h50m40.909449297s) [upload=145588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 13:17:00.178186145 (139h50m40.909453775s) [upload=145588]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 13:17:00.178188700 (139h50m40.90945632s) [upload=145588]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 13:17:00.181109793 (139h50m40.912377423s) [upload=145588]: Done uploading segments... Aug 14 13:17:00.181118729 (139h50m40.91238636s) [upload=145588]: Upload finished. err: metaclient: Too Many Requests
Duration: 260.997671ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
394.472298ms
FAIL (2025-08-14 13:21:51 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 14 12:53:30.811893619 (139h27m11.54316128s) [upload=145185]: Starting upload
Aug 14 12:53:30.812060782 (139h27m11.543328433s) [upload=145185]: Done starting upload
Aug 14 12:53:30.812332184 (139h27m11.543599834s) [upload=145185]: Uploading segments...
Aug 14 12:53:30.812805844 (139h27m11.544073505s) [upload=145185]: Got next segment. Inline: false
Aug 14 12:53:30.812855368 (139h27m11.544123018s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 12:53:30.812863023 (139h27m11.544130672s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 12:53:30.840662084 (139h27m11.571929735s) [seg_pos={0 0}, upload=145185]: Begin upload segment...
Aug 14 12:53:30.840845550 (139h27m11.57211324s) [seg_pos={0 0}, upload=145185]: Done begin upload segment.
Aug 14 12:53:30.840887478 (139h27m11.572155128s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.840896425 (139h27m11.572164065s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841038943 (139h27m11.572306593s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841803511 (139h27m11.573071162s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841849618 (139h27m11.573117278s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842568741 (139h27m11.57383639s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842967270 (139h27m11.57423494s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843307149 (139h27m11.574574819s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843863526 (139h27m11.575131176s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844059354 (139h27m11.575327005s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844997248 (139h27m11.576264898s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845093238 (139h27m11.576360898s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845923159 (139h27m11.577190809s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845943016 (139h27m11.577210666s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846549868 (139h27m11.577817529s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846669723 (139h27m11.577937373s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847123256 (139h27m11.578390915s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847438158 (139h27m11.578705818s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.881759808 (139h27m11.613027429s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: ecclient: upload failed (node:1EiYA6gHiLyHsMfPevj2gLqmqttu1knLw3AM8SbWWtgKEf7Csu, address:104.36.82.5:4859): protocol: write tcp 5.161.89.252:28650->104.36.82.5:4859: write: connection refused; conn closed: op; piecestore: piecestore close: manager closed: conn closed: op
Aug 14 12:53:30.932703619 (139h27m11.663971239s) [upload=145185]: Next returned nil segment
Aug 14 12:53:30.932711613 (139h27m11.663979224s) [upload=145185]: Waiting for error group managing segments...
Aug 14 12:53:30.940609227 (139h27m11.671876847s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.940887300 (139h27m11.67215492s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.947132756 (139h27m11.678400377s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.952794213 (139h27m11.684061834s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.953517694 (139h27m11.684785314s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.955080694 (139h27m11.686348304s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.960298438 (139h27m11.691566058s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.970922197 (139h27m11.702189817s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.975258844 (139h27m11.706526464s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.976947489 (139h27m11.708215099s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.978861599 (139h27m11.710129229s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.986380830 (139h27m11.71764845s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.085651371 (139h27m11.816919021s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446180656 (139h27m12.177448286s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446211113 (139h27m12.177478743s) [seg_pos={0 0}, upload=145185]: Segment reached optimal threshold of 14 pieces.
Aug 14 12:53:31.446327853 (139h27m12.177595483s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446432539 (139h27m12.177700169s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446511999 (139h27m12.17777965s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446568505 (139h27m12.177836165s) [seg_pos={0 0}, upload=145185]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 12:53:31.446682359 (139h27m12.177950019s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 12:53:31.446690074 (139h27m12.177957723s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 12:53:31.495940821 (139h27m12.227208451s) [upload=145185]: Done uploading segments...
Aug 14 12:53:31.495953846 (139h27m12.227221465s) [upload=145185]: Upload finished. err: <nil>
Duration: 394.492527ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.................X.............X.....................X......] duration:
176.225116ms
FAIL (2025-08-14 13:21:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 13:17:00.178020483 (139h50m40.909288104s) [upload=145588]: Starting upload Aug 14 13:17:00.178063935 (139h50m40.909331565s) [upload=145588]: Done starting upload Aug 14 13:17:00.178107788 (139h50m40.909375408s) [upload=145588]: Uploading segments... Aug 14 13:17:00.178146912 (139h50m40.909414542s) [upload=145588]: Got next segment. Inline: true Aug 14 13:17:00.178150288 (139h50m40.909417908s) [upload=145588]: Waiting for error group managing segments... Aug 14 13:17:00.178181667 (139h50m40.909449297s) [upload=145588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 13:17:00.178186145 (139h50m40.909453775s) [upload=145588]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 13:17:00.178188700 (139h50m40.90945632s) [upload=145588]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 13:17:00.181109793 (139h50m40.912377423s) [upload=145588]: Done uploading segments... Aug 14 13:17:00.181118729 (139h50m40.91238636s) [upload=145588]: Upload finished. err: metaclient: Too Many Requests
Duration: 176.242629ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
592.985756ms
FAIL (2025-08-14 13:21:30 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 14 12:53:30.811893619 (139h27m11.54316128s) [upload=145185]: Starting upload
Aug 14 12:53:30.812060782 (139h27m11.543328433s) [upload=145185]: Done starting upload
Aug 14 12:53:30.812332184 (139h27m11.543599834s) [upload=145185]: Uploading segments...
Aug 14 12:53:30.812805844 (139h27m11.544073505s) [upload=145185]: Got next segment. Inline: false
Aug 14 12:53:30.812855368 (139h27m11.544123018s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 12:53:30.812863023 (139h27m11.544130672s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 12:53:30.840662084 (139h27m11.571929735s) [seg_pos={0 0}, upload=145185]: Begin upload segment...
Aug 14 12:53:30.840845550 (139h27m11.57211324s) [seg_pos={0 0}, upload=145185]: Done begin upload segment.
Aug 14 12:53:30.840887478 (139h27m11.572155128s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.840896425 (139h27m11.572164065s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841038943 (139h27m11.572306593s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841803511 (139h27m11.573071162s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841849618 (139h27m11.573117278s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842568741 (139h27m11.57383639s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842967270 (139h27m11.57423494s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843307149 (139h27m11.574574819s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843863526 (139h27m11.575131176s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844059354 (139h27m11.575327005s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844997248 (139h27m11.576264898s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845093238 (139h27m11.576360898s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845923159 (139h27m11.577190809s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845943016 (139h27m11.577210666s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846549868 (139h27m11.577817529s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846669723 (139h27m11.577937373s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847123256 (139h27m11.578390915s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847438158 (139h27m11.578705818s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.881759808 (139h27m11.613027429s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: ecclient: upload failed (node:1EiYA6gHiLyHsMfPevj2gLqmqttu1knLw3AM8SbWWtgKEf7Csu, address:104.36.82.5:4859): protocol: write tcp 5.161.89.252:28650->104.36.82.5:4859: write: connection refused; conn closed: op; piecestore: piecestore close: manager closed: conn closed: op
Aug 14 12:53:30.932703619 (139h27m11.663971239s) [upload=145185]: Next returned nil segment
Aug 14 12:53:30.932711613 (139h27m11.663979224s) [upload=145185]: Waiting for error group managing segments...
Aug 14 12:53:30.940609227 (139h27m11.671876847s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.940887300 (139h27m11.67215492s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.947132756 (139h27m11.678400377s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.952794213 (139h27m11.684061834s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.953517694 (139h27m11.684785314s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.955080694 (139h27m11.686348304s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.960298438 (139h27m11.691566058s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.970922197 (139h27m11.702189817s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.975258844 (139h27m11.706526464s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.976947489 (139h27m11.708215099s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.978861599 (139h27m11.710129229s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.986380830 (139h27m11.71764845s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.085651371 (139h27m11.816919021s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446180656 (139h27m12.177448286s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446211113 (139h27m12.177478743s) [seg_pos={0 0}, upload=145185]: Segment reached optimal threshold of 14 pieces.
Aug 14 12:53:31.446327853 (139h27m12.177595483s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446432539 (139h27m12.177700169s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446511999 (139h27m12.17777965s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446568505 (139h27m12.177836165s) [seg_pos={0 0}, upload=145185]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 12:53:31.446682359 (139h27m12.177950019s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 12:53:31.446690074 (139h27m12.177957723s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 12:53:31.495940821 (139h27m12.227208451s) [upload=145185]: Done uploading segments...
Aug 14 12:53:31.495953846 (139h27m12.227221465s) [upload=145185]: Upload finished. err: <nil>
Duration: 593.017976ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
465.624271ms
FAIL (2025-08-14 13:20:49 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 14 12:53:30.811893619 (139h27m11.54316128s) [upload=145185]: Starting upload
Aug 14 12:53:30.812060782 (139h27m11.543328433s) [upload=145185]: Done starting upload
Aug 14 12:53:30.812332184 (139h27m11.543599834s) [upload=145185]: Uploading segments...
Aug 14 12:53:30.812805844 (139h27m11.544073505s) [upload=145185]: Got next segment. Inline: false
Aug 14 12:53:30.812855368 (139h27m11.544123018s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 12:53:30.812863023 (139h27m11.544130672s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 12:53:30.840662084 (139h27m11.571929735s) [seg_pos={0 0}, upload=145185]: Begin upload segment...
Aug 14 12:53:30.840845550 (139h27m11.57211324s) [seg_pos={0 0}, upload=145185]: Done begin upload segment.
Aug 14 12:53:30.840887478 (139h27m11.572155128s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.840896425 (139h27m11.572164065s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841038943 (139h27m11.572306593s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841803511 (139h27m11.573071162s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841849618 (139h27m11.573117278s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842568741 (139h27m11.57383639s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842967270 (139h27m11.57423494s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843307149 (139h27m11.574574819s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843863526 (139h27m11.575131176s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844059354 (139h27m11.575327005s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844997248 (139h27m11.576264898s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845093238 (139h27m11.576360898s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845923159 (139h27m11.577190809s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845943016 (139h27m11.577210666s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846549868 (139h27m11.577817529s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846669723 (139h27m11.577937373s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847123256 (139h27m11.578390915s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847438158 (139h27m11.578705818s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.881759808 (139h27m11.613027429s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: ecclient: upload failed (node:1EiYA6gHiLyHsMfPevj2gLqmqttu1knLw3AM8SbWWtgKEf7Csu, address:104.36.82.5:4859): protocol: write tcp 5.161.89.252:28650->104.36.82.5:4859: write: connection refused; conn closed: op; piecestore: piecestore close: manager closed: conn closed: op
Aug 14 12:53:30.932703619 (139h27m11.663971239s) [upload=145185]: Next returned nil segment
Aug 14 12:53:30.932711613 (139h27m11.663979224s) [upload=145185]: Waiting for error group managing segments...
Aug 14 12:53:30.940609227 (139h27m11.671876847s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.940887300 (139h27m11.67215492s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.947132756 (139h27m11.678400377s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.952794213 (139h27m11.684061834s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.953517694 (139h27m11.684785314s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.955080694 (139h27m11.686348304s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.960298438 (139h27m11.691566058s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.970922197 (139h27m11.702189817s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.975258844 (139h27m11.706526464s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.976947489 (139h27m11.708215099s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.978861599 (139h27m11.710129229s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.986380830 (139h27m11.71764845s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.085651371 (139h27m11.816919021s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446180656 (139h27m12.177448286s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446211113 (139h27m12.177478743s) [seg_pos={0 0}, upload=145185]: Segment reached optimal threshold of 14 pieces.
Aug 14 12:53:31.446327853 (139h27m12.177595483s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446432539 (139h27m12.177700169s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446511999 (139h27m12.17777965s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446568505 (139h27m12.177836165s) [seg_pos={0 0}, upload=145185]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 12:53:31.446682359 (139h27m12.177950019s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 12:53:31.446690074 (139h27m12.177957723s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 12:53:31.495940821 (139h27m12.227208451s) [upload=145185]: Done uploading segments...
Aug 14 12:53:31.495953846 (139h27m12.227221465s) [upload=145185]: Upload finished. err: <nil>
Duration: 465.636333ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..................X.............X.....................X.....] duration:
141.989104ms
FAIL (2025-08-14 13:20:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 13:17:00.178020483 (139h50m40.909288104s) [upload=145588]: Starting upload Aug 14 13:17:00.178063935 (139h50m40.909331565s) [upload=145588]: Done starting upload Aug 14 13:17:00.178107788 (139h50m40.909375408s) [upload=145588]: Uploading segments... Aug 14 13:17:00.178146912 (139h50m40.909414542s) [upload=145588]: Got next segment. Inline: true Aug 14 13:17:00.178150288 (139h50m40.909417908s) [upload=145588]: Waiting for error group managing segments... Aug 14 13:17:00.178181667 (139h50m40.909449297s) [upload=145588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 13:17:00.178186145 (139h50m40.909453775s) [upload=145588]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 13:17:00.178188700 (139h50m40.90945632s) [upload=145588]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 13:17:00.181109793 (139h50m40.912377423s) [upload=145588]: Done uploading segments... Aug 14 13:17:00.181118729 (139h50m40.91238636s) [upload=145588]: Upload finished. err: metaclient: Too Many Requests
Duration: 142.012447ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
504.511612ms
FAIL (2025-08-14 13:19:39 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 14 12:53:30.811893619 (139h27m11.54316128s) [upload=145185]: Starting upload
Aug 14 12:53:30.812060782 (139h27m11.543328433s) [upload=145185]: Done starting upload
Aug 14 12:53:30.812332184 (139h27m11.543599834s) [upload=145185]: Uploading segments...
Aug 14 12:53:30.812805844 (139h27m11.544073505s) [upload=145185]: Got next segment. Inline: false
Aug 14 12:53:30.812855368 (139h27m11.544123018s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 12:53:30.812863023 (139h27m11.544130672s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 12:53:30.840662084 (139h27m11.571929735s) [seg_pos={0 0}, upload=145185]: Begin upload segment...
Aug 14 12:53:30.840845550 (139h27m11.57211324s) [seg_pos={0 0}, upload=145185]: Done begin upload segment.
Aug 14 12:53:30.840887478 (139h27m11.572155128s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.840896425 (139h27m11.572164065s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841038943 (139h27m11.572306593s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841803511 (139h27m11.573071162s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841849618 (139h27m11.573117278s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842568741 (139h27m11.57383639s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842967270 (139h27m11.57423494s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843307149 (139h27m11.574574819s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843863526 (139h27m11.575131176s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844059354 (139h27m11.575327005s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844997248 (139h27m11.576264898s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845093238 (139h27m11.576360898s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845923159 (139h27m11.577190809s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845943016 (139h27m11.577210666s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846549868 (139h27m11.577817529s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846669723 (139h27m11.577937373s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847123256 (139h27m11.578390915s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847438158 (139h27m11.578705818s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.881759808 (139h27m11.613027429s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: ecclient: upload failed (node:1EiYA6gHiLyHsMfPevj2gLqmqttu1knLw3AM8SbWWtgKEf7Csu, address:104.36.82.5:4859): protocol: write tcp 5.161.89.252:28650->104.36.82.5:4859: write: connection refused; conn closed: op; piecestore: piecestore close: manager closed: conn closed: op
Aug 14 12:53:30.932703619 (139h27m11.663971239s) [upload=145185]: Next returned nil segment
Aug 14 12:53:30.932711613 (139h27m11.663979224s) [upload=145185]: Waiting for error group managing segments...
Aug 14 12:53:30.940609227 (139h27m11.671876847s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.940887300 (139h27m11.67215492s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.947132756 (139h27m11.678400377s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.952794213 (139h27m11.684061834s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.953517694 (139h27m11.684785314s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.955080694 (139h27m11.686348304s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.960298438 (139h27m11.691566058s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.970922197 (139h27m11.702189817s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.975258844 (139h27m11.706526464s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.976947489 (139h27m11.708215099s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.978861599 (139h27m11.710129229s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.986380830 (139h27m11.71764845s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.085651371 (139h27m11.816919021s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446180656 (139h27m12.177448286s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446211113 (139h27m12.177478743s) [seg_pos={0 0}, upload=145185]: Segment reached optimal threshold of 14 pieces.
Aug 14 12:53:31.446327853 (139h27m12.177595483s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446432539 (139h27m12.177700169s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446511999 (139h27m12.17777965s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446568505 (139h27m12.177836165s) [seg_pos={0 0}, upload=145185]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 12:53:31.446682359 (139h27m12.177950019s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 12:53:31.446690074 (139h27m12.177957723s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 12:53:31.495940821 (139h27m12.227208451s) [upload=145185]: Done uploading segments...
Aug 14 12:53:31.495953846 (139h27m12.227221465s) [upload=145185]: Upload finished. err: <nil>
Duration: 504.530438ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...................X.............X.....................X....] duration:
177.041731ms
FAIL (2025-08-14 13:19:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 13:17:00.178020483 (139h50m40.909288104s) [upload=145588]: Starting upload Aug 14 13:17:00.178063935 (139h50m40.909331565s) [upload=145588]: Done starting upload Aug 14 13:17:00.178107788 (139h50m40.909375408s) [upload=145588]: Uploading segments... Aug 14 13:17:00.178146912 (139h50m40.909414542s) [upload=145588]: Got next segment. Inline: true Aug 14 13:17:00.178150288 (139h50m40.909417908s) [upload=145588]: Waiting for error group managing segments... Aug 14 13:17:00.178181667 (139h50m40.909449297s) [upload=145588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 13:17:00.178186145 (139h50m40.909453775s) [upload=145588]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 13:17:00.178188700 (139h50m40.90945632s) [upload=145588]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 13:17:00.181109793 (139h50m40.912377423s) [upload=145588]: Done uploading segments... Aug 14 13:17:00.181118729 (139h50m40.91238636s) [upload=145588]: Upload finished. err: metaclient: Too Many Requests
Duration: 177.069233ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
513.285943ms
FAIL (2025-08-14 13:19:06 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 14 12:53:30.811893619 (139h27m11.54316128s) [upload=145185]: Starting upload
Aug 14 12:53:30.812060782 (139h27m11.543328433s) [upload=145185]: Done starting upload
Aug 14 12:53:30.812332184 (139h27m11.543599834s) [upload=145185]: Uploading segments...
Aug 14 12:53:30.812805844 (139h27m11.544073505s) [upload=145185]: Got next segment. Inline: false
Aug 14 12:53:30.812855368 (139h27m11.544123018s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 12:53:30.812863023 (139h27m11.544130672s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 12:53:30.840662084 (139h27m11.571929735s) [seg_pos={0 0}, upload=145185]: Begin upload segment...
Aug 14 12:53:30.840845550 (139h27m11.57211324s) [seg_pos={0 0}, upload=145185]: Done begin upload segment.
Aug 14 12:53:30.840887478 (139h27m11.572155128s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.840896425 (139h27m11.572164065s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841038943 (139h27m11.572306593s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841803511 (139h27m11.573071162s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841849618 (139h27m11.573117278s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842568741 (139h27m11.57383639s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842967270 (139h27m11.57423494s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843307149 (139h27m11.574574819s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843863526 (139h27m11.575131176s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844059354 (139h27m11.575327005s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844997248 (139h27m11.576264898s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845093238 (139h27m11.576360898s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845923159 (139h27m11.577190809s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845943016 (139h27m11.577210666s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846549868 (139h27m11.577817529s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846669723 (139h27m11.577937373s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847123256 (139h27m11.578390915s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847438158 (139h27m11.578705818s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.881759808 (139h27m11.613027429s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: ecclient: upload failed (node:1EiYA6gHiLyHsMfPevj2gLqmqttu1knLw3AM8SbWWtgKEf7Csu, address:104.36.82.5:4859): protocol: write tcp 5.161.89.252:28650->104.36.82.5:4859: write: connection refused; conn closed: op; piecestore: piecestore close: manager closed: conn closed: op
Aug 14 12:53:30.932703619 (139h27m11.663971239s) [upload=145185]: Next returned nil segment
Aug 14 12:53:30.932711613 (139h27m11.663979224s) [upload=145185]: Waiting for error group managing segments...
Aug 14 12:53:30.940609227 (139h27m11.671876847s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.940887300 (139h27m11.67215492s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.947132756 (139h27m11.678400377s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.952794213 (139h27m11.684061834s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.953517694 (139h27m11.684785314s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.955080694 (139h27m11.686348304s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.960298438 (139h27m11.691566058s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.970922197 (139h27m11.702189817s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.975258844 (139h27m11.706526464s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.976947489 (139h27m11.708215099s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.978861599 (139h27m11.710129229s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.986380830 (139h27m11.71764845s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.085651371 (139h27m11.816919021s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446180656 (139h27m12.177448286s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446211113 (139h27m12.177478743s) [seg_pos={0 0}, upload=145185]: Segment reached optimal threshold of 14 pieces.
Aug 14 12:53:31.446327853 (139h27m12.177595483s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446432539 (139h27m12.177700169s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446511999 (139h27m12.17777965s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446568505 (139h27m12.177836165s) [seg_pos={0 0}, upload=145185]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 12:53:31.446682359 (139h27m12.177950019s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 12:53:31.446690074 (139h27m12.177957723s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 12:53:31.495940821 (139h27m12.227208451s) [upload=145185]: Done uploading segments...
Aug 14 12:53:31.495953846 (139h27m12.227221465s) [upload=145185]: Upload finished. err: <nil>
Duration: 513.307293ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....................X.............X.....................X...] duration:
185.88388ms
FAIL (2025-08-14 13:18:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 13:17:00.178020483 (139h50m40.909288104s) [upload=145588]: Starting upload Aug 14 13:17:00.178063935 (139h50m40.909331565s) [upload=145588]: Done starting upload Aug 14 13:17:00.178107788 (139h50m40.909375408s) [upload=145588]: Uploading segments... Aug 14 13:17:00.178146912 (139h50m40.909414542s) [upload=145588]: Got next segment. Inline: true Aug 14 13:17:00.178150288 (139h50m40.909417908s) [upload=145588]: Waiting for error group managing segments... Aug 14 13:17:00.178181667 (139h50m40.909449297s) [upload=145588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 13:17:00.178186145 (139h50m40.909453775s) [upload=145588]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 13:17:00.178188700 (139h50m40.90945632s) [upload=145588]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 13:17:00.181109793 (139h50m40.912377423s) [upload=145588]: Done uploading segments... Aug 14 13:17:00.181118729 (139h50m40.91238636s) [upload=145588]: Upload finished. err: metaclient: Too Many Requests
Duration: 185.907884ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....................X.............X.....................X..] duration:
198.943495ms
FAIL (2025-08-14 13:18:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 13:17:00.178020483 (139h50m40.909288104s) [upload=145588]: Starting upload Aug 14 13:17:00.178063935 (139h50m40.909331565s) [upload=145588]: Done starting upload Aug 14 13:17:00.178107788 (139h50m40.909375408s) [upload=145588]: Uploading segments... Aug 14 13:17:00.178146912 (139h50m40.909414542s) [upload=145588]: Got next segment. Inline: true Aug 14 13:17:00.178150288 (139h50m40.909417908s) [upload=145588]: Waiting for error group managing segments... Aug 14 13:17:00.178181667 (139h50m40.909449297s) [upload=145588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 13:17:00.178186145 (139h50m40.909453775s) [upload=145588]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 13:17:00.178188700 (139h50m40.90945632s) [upload=145588]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 13:17:00.181109793 (139h50m40.912377423s) [upload=145588]: Done uploading segments... Aug 14 13:17:00.181118729 (139h50m40.91238636s) [upload=145588]: Upload finished. err: metaclient: Too Many Requests
Duration: 198.961098ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
567.699276ms
FAIL (2025-08-14 13:18:22 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 14 12:53:30.811893619 (139h27m11.54316128s) [upload=145185]: Starting upload
Aug 14 12:53:30.812060782 (139h27m11.543328433s) [upload=145185]: Done starting upload
Aug 14 12:53:30.812332184 (139h27m11.543599834s) [upload=145185]: Uploading segments...
Aug 14 12:53:30.812805844 (139h27m11.544073505s) [upload=145185]: Got next segment. Inline: false
Aug 14 12:53:30.812855368 (139h27m11.544123018s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 12:53:30.812863023 (139h27m11.544130672s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 12:53:30.840662084 (139h27m11.571929735s) [seg_pos={0 0}, upload=145185]: Begin upload segment...
Aug 14 12:53:30.840845550 (139h27m11.57211324s) [seg_pos={0 0}, upload=145185]: Done begin upload segment.
Aug 14 12:53:30.840887478 (139h27m11.572155128s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.840896425 (139h27m11.572164065s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841038943 (139h27m11.572306593s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841803511 (139h27m11.573071162s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841849618 (139h27m11.573117278s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842568741 (139h27m11.57383639s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842967270 (139h27m11.57423494s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843307149 (139h27m11.574574819s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843863526 (139h27m11.575131176s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844059354 (139h27m11.575327005s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844997248 (139h27m11.576264898s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845093238 (139h27m11.576360898s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845923159 (139h27m11.577190809s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845943016 (139h27m11.577210666s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846549868 (139h27m11.577817529s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846669723 (139h27m11.577937373s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847123256 (139h27m11.578390915s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847438158 (139h27m11.578705818s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.881759808 (139h27m11.613027429s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: ecclient: upload failed (node:1EiYA6gHiLyHsMfPevj2gLqmqttu1knLw3AM8SbWWtgKEf7Csu, address:104.36.82.5:4859): protocol: write tcp 5.161.89.252:28650->104.36.82.5:4859: write: connection refused; conn closed: op; piecestore: piecestore close: manager closed: conn closed: op
Aug 14 12:53:30.932703619 (139h27m11.663971239s) [upload=145185]: Next returned nil segment
Aug 14 12:53:30.932711613 (139h27m11.663979224s) [upload=145185]: Waiting for error group managing segments...
Aug 14 12:53:30.940609227 (139h27m11.671876847s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.940887300 (139h27m11.67215492s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.947132756 (139h27m11.678400377s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.952794213 (139h27m11.684061834s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.953517694 (139h27m11.684785314s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.955080694 (139h27m11.686348304s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.960298438 (139h27m11.691566058s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.970922197 (139h27m11.702189817s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.975258844 (139h27m11.706526464s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.976947489 (139h27m11.708215099s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.978861599 (139h27m11.710129229s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.986380830 (139h27m11.71764845s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.085651371 (139h27m11.816919021s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446180656 (139h27m12.177448286s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446211113 (139h27m12.177478743s) [seg_pos={0 0}, upload=145185]: Segment reached optimal threshold of 14 pieces.
Aug 14 12:53:31.446327853 (139h27m12.177595483s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446432539 (139h27m12.177700169s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446511999 (139h27m12.17777965s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446568505 (139h27m12.177836165s) [seg_pos={0 0}, upload=145185]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 12:53:31.446682359 (139h27m12.177950019s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 12:53:31.446690074 (139h27m12.177957723s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 12:53:31.495940821 (139h27m12.227208451s) [upload=145185]: Done uploading segments...
Aug 14 12:53:31.495953846 (139h27m12.227221465s) [upload=145185]: Upload finished. err: <nil>
Duration: 567.724013ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
460.690294ms
FAIL (2025-08-14 13:18:05 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 14 12:53:30.811893619 (139h27m11.54316128s) [upload=145185]: Starting upload
Aug 14 12:53:30.812060782 (139h27m11.543328433s) [upload=145185]: Done starting upload
Aug 14 12:53:30.812332184 (139h27m11.543599834s) [upload=145185]: Uploading segments...
Aug 14 12:53:30.812805844 (139h27m11.544073505s) [upload=145185]: Got next segment. Inline: false
Aug 14 12:53:30.812855368 (139h27m11.544123018s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 12:53:30.812863023 (139h27m11.544130672s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 12:53:30.840662084 (139h27m11.571929735s) [seg_pos={0 0}, upload=145185]: Begin upload segment...
Aug 14 12:53:30.840845550 (139h27m11.57211324s) [seg_pos={0 0}, upload=145185]: Done begin upload segment.
Aug 14 12:53:30.840887478 (139h27m11.572155128s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.840896425 (139h27m11.572164065s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841038943 (139h27m11.572306593s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841803511 (139h27m11.573071162s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841849618 (139h27m11.573117278s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842568741 (139h27m11.57383639s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842967270 (139h27m11.57423494s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843307149 (139h27m11.574574819s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843863526 (139h27m11.575131176s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844059354 (139h27m11.575327005s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844997248 (139h27m11.576264898s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845093238 (139h27m11.576360898s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845923159 (139h27m11.577190809s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845943016 (139h27m11.577210666s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846549868 (139h27m11.577817529s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846669723 (139h27m11.577937373s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847123256 (139h27m11.578390915s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847438158 (139h27m11.578705818s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.881759808 (139h27m11.613027429s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: ecclient: upload failed (node:1EiYA6gHiLyHsMfPevj2gLqmqttu1knLw3AM8SbWWtgKEf7Csu, address:104.36.82.5:4859): protocol: write tcp 5.161.89.252:28650->104.36.82.5:4859: write: connection refused; conn closed: op; piecestore: piecestore close: manager closed: conn closed: op
Aug 14 12:53:30.932703619 (139h27m11.663971239s) [upload=145185]: Next returned nil segment
Aug 14 12:53:30.932711613 (139h27m11.663979224s) [upload=145185]: Waiting for error group managing segments...
Aug 14 12:53:30.940609227 (139h27m11.671876847s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.940887300 (139h27m11.67215492s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.947132756 (139h27m11.678400377s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.952794213 (139h27m11.684061834s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.953517694 (139h27m11.684785314s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.955080694 (139h27m11.686348304s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.960298438 (139h27m11.691566058s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.970922197 (139h27m11.702189817s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.975258844 (139h27m11.706526464s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.976947489 (139h27m11.708215099s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.978861599 (139h27m11.710129229s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.986380830 (139h27m11.71764845s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.085651371 (139h27m11.816919021s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446180656 (139h27m12.177448286s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446211113 (139h27m12.177478743s) [seg_pos={0 0}, upload=145185]: Segment reached optimal threshold of 14 pieces.
Aug 14 12:53:31.446327853 (139h27m12.177595483s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446432539 (139h27m12.177700169s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446511999 (139h27m12.17777965s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446568505 (139h27m12.177836165s) [seg_pos={0 0}, upload=145185]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 12:53:31.446682359 (139h27m12.177950019s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 12:53:31.446690074 (139h27m12.177957723s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 12:53:31.495940821 (139h27m12.227208451s) [upload=145185]: Done uploading segments...
Aug 14 12:53:31.495953846 (139h27m12.227221465s) [upload=145185]: Upload finished. err: <nil>
Duration: 460.711975ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......................X.............X.....................X.] duration:
453.775483ms
FAIL (2025-08-14 13:17:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 13:17:00.178020483 (139h50m40.909288104s) [upload=145588]: Starting upload Aug 14 13:17:00.178063935 (139h50m40.909331565s) [upload=145588]: Done starting upload Aug 14 13:17:00.178107788 (139h50m40.909375408s) [upload=145588]: Uploading segments... Aug 14 13:17:00.178146912 (139h50m40.909414542s) [upload=145588]: Got next segment. Inline: true Aug 14 13:17:00.178150288 (139h50m40.909417908s) [upload=145588]: Waiting for error group managing segments... Aug 14 13:17:00.178181667 (139h50m40.909449297s) [upload=145588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 13:17:00.178186145 (139h50m40.909453775s) [upload=145588]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 13:17:00.178188700 (139h50m40.90945632s) [upload=145588]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 13:17:00.181109793 (139h50m40.912377423s) [upload=145588]: Done uploading segments... Aug 14 13:17:00.181118729 (139h50m40.91238636s) [upload=145588]: Upload finished. err: metaclient: Too Many Requests
Duration: 453.80024ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......................X.............X.....................X] duration:
18.580228ms
FAIL (2025-08-14 13:17:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 14 13:17:00.178020483 (139h50m40.909288104s) [upload=145588]: Starting upload Aug 14 13:17:00.178063935 (139h50m40.909331565s) [upload=145588]: Done starting upload Aug 14 13:17:00.178107788 (139h50m40.909375408s) [upload=145588]: Uploading segments... Aug 14 13:17:00.178146912 (139h50m40.909414542s) [upload=145588]: Got next segment. Inline: true Aug 14 13:17:00.178150288 (139h50m40.909417908s) [upload=145588]: Waiting for error group managing segments... Aug 14 13:17:00.178181667 (139h50m40.909449297s) [upload=145588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 14 13:17:00.178186145 (139h50m40.909453775s) [upload=145588]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 14 13:17:00.178188700 (139h50m40.90945632s) [upload=145588]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 14 13:17:00.181109793 (139h50m40.912377423s) [upload=145588]: Done uploading segments... Aug 14 13:17:00.181118729 (139h50m40.91238636s) [upload=145588]: Upload finished. err: metaclient: Too Many Requests
Duration: 18.601027ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
398.286081ms
FAIL (2025-08-14 13:16:52 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 14 12:53:30.811893619 (139h27m11.54316128s) [upload=145185]: Starting upload
Aug 14 12:53:30.812060782 (139h27m11.543328433s) [upload=145185]: Done starting upload
Aug 14 12:53:30.812332184 (139h27m11.543599834s) [upload=145185]: Uploading segments...
Aug 14 12:53:30.812805844 (139h27m11.544073505s) [upload=145185]: Got next segment. Inline: false
Aug 14 12:53:30.812855368 (139h27m11.544123018s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 12:53:30.812863023 (139h27m11.544130672s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 12:53:30.840662084 (139h27m11.571929735s) [seg_pos={0 0}, upload=145185]: Begin upload segment...
Aug 14 12:53:30.840845550 (139h27m11.57211324s) [seg_pos={0 0}, upload=145185]: Done begin upload segment.
Aug 14 12:53:30.840887478 (139h27m11.572155128s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.840896425 (139h27m11.572164065s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841038943 (139h27m11.572306593s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841803511 (139h27m11.573071162s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841849618 (139h27m11.573117278s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842568741 (139h27m11.57383639s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842967270 (139h27m11.57423494s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843307149 (139h27m11.574574819s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843863526 (139h27m11.575131176s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844059354 (139h27m11.575327005s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844997248 (139h27m11.576264898s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845093238 (139h27m11.576360898s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845923159 (139h27m11.577190809s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845943016 (139h27m11.577210666s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846549868 (139h27m11.577817529s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846669723 (139h27m11.577937373s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847123256 (139h27m11.578390915s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847438158 (139h27m11.578705818s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.881759808 (139h27m11.613027429s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: ecclient: upload failed (node:1EiYA6gHiLyHsMfPevj2gLqmqttu1knLw3AM8SbWWtgKEf7Csu, address:104.36.82.5:4859): protocol: write tcp 5.161.89.252:28650->104.36.82.5:4859: write: connection refused; conn closed: op; piecestore: piecestore close: manager closed: conn closed: op
Aug 14 12:53:30.932703619 (139h27m11.663971239s) [upload=145185]: Next returned nil segment
Aug 14 12:53:30.932711613 (139h27m11.663979224s) [upload=145185]: Waiting for error group managing segments...
Aug 14 12:53:30.940609227 (139h27m11.671876847s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.940887300 (139h27m11.67215492s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.947132756 (139h27m11.678400377s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.952794213 (139h27m11.684061834s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.953517694 (139h27m11.684785314s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.955080694 (139h27m11.686348304s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.960298438 (139h27m11.691566058s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.970922197 (139h27m11.702189817s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.975258844 (139h27m11.706526464s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.976947489 (139h27m11.708215099s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.978861599 (139h27m11.710129229s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.986380830 (139h27m11.71764845s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.085651371 (139h27m11.816919021s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446180656 (139h27m12.177448286s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446211113 (139h27m12.177478743s) [seg_pos={0 0}, upload=145185]: Segment reached optimal threshold of 14 pieces.
Aug 14 12:53:31.446327853 (139h27m12.177595483s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446432539 (139h27m12.177700169s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446511999 (139h27m12.17777965s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446568505 (139h27m12.177836165s) [seg_pos={0 0}, upload=145185]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 12:53:31.446682359 (139h27m12.177950019s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 12:53:31.446690074 (139h27m12.177957723s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 12:53:31.495940821 (139h27m12.227208451s) [upload=145185]: Done uploading segments...
Aug 14 12:53:31.495953846 (139h27m12.227221465s) [upload=145185]: Upload finished. err: <nil>
Duration: 398.30186ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................X.............X.....................] duration:
157.61266ms
FAIL (2025-08-14 13:16:29 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 14 13:02:05.799391009 (139h35m46.530658659s) [upload=145334]: Starting upload
Aug 14 13:02:05.799499983 (139h35m46.530767663s) [upload=145334]: Done starting upload
Aug 14 13:02:05.799598559 (139h35m46.530866209s) [upload=145334]: Uploading segments...
Aug 14 13:02:05.799652370 (139h35m46.53092002s) [upload=145334]: Got next segment. Inline: true
Aug 14 13:02:05.799660655 (139h35m46.530928306s) [upload=145334]: Waiting for error group managing segments...
Aug 14 13:02:05.799723874 (139h35m46.530991524s) [upload=145334]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 13:02:05.799733502 (139h35m46.531001142s) [upload=145334]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 13:02:05.799739804 (139h35m46.531007454s) [upload=145334]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 13:02:05.934245793 (139h35m46.665513483s) [upload=145334]: Done uploading segments...
Aug 14 13:02:05.934265540 (139h35m46.66553319s) [upload=145334]: Upload finished. err: <nil>
Duration: 157.633599ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
399.509159ms
FAIL (2025-08-14 13:16:12 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 14 12:53:30.811893619 (139h27m11.54316128s) [upload=145185]: Starting upload
Aug 14 12:53:30.812060782 (139h27m11.543328433s) [upload=145185]: Done starting upload
Aug 14 12:53:30.812332184 (139h27m11.543599834s) [upload=145185]: Uploading segments...
Aug 14 12:53:30.812805844 (139h27m11.544073505s) [upload=145185]: Got next segment. Inline: false
Aug 14 12:53:30.812855368 (139h27m11.544123018s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 12:53:30.812863023 (139h27m11.544130672s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 12:53:30.840662084 (139h27m11.571929735s) [seg_pos={0 0}, upload=145185]: Begin upload segment...
Aug 14 12:53:30.840845550 (139h27m11.57211324s) [seg_pos={0 0}, upload=145185]: Done begin upload segment.
Aug 14 12:53:30.840887478 (139h27m11.572155128s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.840896425 (139h27m11.572164065s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841038943 (139h27m11.572306593s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841803511 (139h27m11.573071162s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841849618 (139h27m11.573117278s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842568741 (139h27m11.57383639s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842967270 (139h27m11.57423494s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843307149 (139h27m11.574574819s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843863526 (139h27m11.575131176s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844059354 (139h27m11.575327005s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844997248 (139h27m11.576264898s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845093238 (139h27m11.576360898s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845923159 (139h27m11.577190809s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845943016 (139h27m11.577210666s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846549868 (139h27m11.577817529s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846669723 (139h27m11.577937373s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847123256 (139h27m11.578390915s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847438158 (139h27m11.578705818s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.881759808 (139h27m11.613027429s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: ecclient: upload failed (node:1EiYA6gHiLyHsMfPevj2gLqmqttu1knLw3AM8SbWWtgKEf7Csu, address:104.36.82.5:4859): protocol: write tcp 5.161.89.252:28650->104.36.82.5:4859: write: connection refused; conn closed: op; piecestore: piecestore close: manager closed: conn closed: op
Aug 14 12:53:30.932703619 (139h27m11.663971239s) [upload=145185]: Next returned nil segment
Aug 14 12:53:30.932711613 (139h27m11.663979224s) [upload=145185]: Waiting for error group managing segments...
Aug 14 12:53:30.940609227 (139h27m11.671876847s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.940887300 (139h27m11.67215492s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.947132756 (139h27m11.678400377s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.952794213 (139h27m11.684061834s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.953517694 (139h27m11.684785314s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.955080694 (139h27m11.686348304s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.960298438 (139h27m11.691566058s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.970922197 (139h27m11.702189817s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.975258844 (139h27m11.706526464s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.976947489 (139h27m11.708215099s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.978861599 (139h27m11.710129229s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.986380830 (139h27m11.71764845s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.085651371 (139h27m11.816919021s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446180656 (139h27m12.177448286s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446211113 (139h27m12.177478743s) [seg_pos={0 0}, upload=145185]: Segment reached optimal threshold of 14 pieces.
Aug 14 12:53:31.446327853 (139h27m12.177595483s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446432539 (139h27m12.177700169s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446511999 (139h27m12.17777965s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446568505 (139h27m12.177836165s) [seg_pos={0 0}, upload=145185]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 12:53:31.446682359 (139h27m12.177950019s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 12:53:31.446690074 (139h27m12.177957723s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 12:53:31.495940821 (139h27m12.227208451s) [upload=145185]: Done uploading segments...
Aug 14 12:53:31.495953846 (139h27m12.227221465s) [upload=145185]: Upload finished. err: <nil>
Duration: 399.529026ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................X.............X....................] duration:
166.703994ms
FAIL (2025-08-14 13:15:32 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 14 13:02:05.799391009 (139h35m46.530658659s) [upload=145334]: Starting upload
Aug 14 13:02:05.799499983 (139h35m46.530767663s) [upload=145334]: Done starting upload
Aug 14 13:02:05.799598559 (139h35m46.530866209s) [upload=145334]: Uploading segments...
Aug 14 13:02:05.799652370 (139h35m46.53092002s) [upload=145334]: Got next segment. Inline: true
Aug 14 13:02:05.799660655 (139h35m46.530928306s) [upload=145334]: Waiting for error group managing segments...
Aug 14 13:02:05.799723874 (139h35m46.530991524s) [upload=145334]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 13:02:05.799733502 (139h35m46.531001142s) [upload=145334]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 13:02:05.799739804 (139h35m46.531007454s) [upload=145334]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 13:02:05.934245793 (139h35m46.665513483s) [upload=145334]: Done uploading segments...
Aug 14 13:02:05.934265540 (139h35m46.66553319s) [upload=145334]: Upload finished. err: <nil>
Duration: 166.731274ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
580.538461ms
FAIL (2025-08-14 13:15:00 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 14 12:53:30.811893619 (139h27m11.54316128s) [upload=145185]: Starting upload
Aug 14 12:53:30.812060782 (139h27m11.543328433s) [upload=145185]: Done starting upload
Aug 14 12:53:30.812332184 (139h27m11.543599834s) [upload=145185]: Uploading segments...
Aug 14 12:53:30.812805844 (139h27m11.544073505s) [upload=145185]: Got next segment. Inline: false
Aug 14 12:53:30.812855368 (139h27m11.544123018s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 12:53:30.812863023 (139h27m11.544130672s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 12:53:30.840662084 (139h27m11.571929735s) [seg_pos={0 0}, upload=145185]: Begin upload segment...
Aug 14 12:53:30.840845550 (139h27m11.57211324s) [seg_pos={0 0}, upload=145185]: Done begin upload segment.
Aug 14 12:53:30.840887478 (139h27m11.572155128s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.840896425 (139h27m11.572164065s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841038943 (139h27m11.572306593s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841803511 (139h27m11.573071162s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841849618 (139h27m11.573117278s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842568741 (139h27m11.57383639s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842967270 (139h27m11.57423494s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843307149 (139h27m11.574574819s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843863526 (139h27m11.575131176s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844059354 (139h27m11.575327005s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844997248 (139h27m11.576264898s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845093238 (139h27m11.576360898s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845923159 (139h27m11.577190809s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845943016 (139h27m11.577210666s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846549868 (139h27m11.577817529s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846669723 (139h27m11.577937373s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847123256 (139h27m11.578390915s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847438158 (139h27m11.578705818s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.881759808 (139h27m11.613027429s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: ecclient: upload failed (node:1EiYA6gHiLyHsMfPevj2gLqmqttu1knLw3AM8SbWWtgKEf7Csu, address:104.36.82.5:4859): protocol: write tcp 5.161.89.252:28650->104.36.82.5:4859: write: connection refused; conn closed: op; piecestore: piecestore close: manager closed: conn closed: op
Aug 14 12:53:30.932703619 (139h27m11.663971239s) [upload=145185]: Next returned nil segment
Aug 14 12:53:30.932711613 (139h27m11.663979224s) [upload=145185]: Waiting for error group managing segments...
Aug 14 12:53:30.940609227 (139h27m11.671876847s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.940887300 (139h27m11.67215492s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.947132756 (139h27m11.678400377s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.952794213 (139h27m11.684061834s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.953517694 (139h27m11.684785314s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.955080694 (139h27m11.686348304s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.960298438 (139h27m11.691566058s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.970922197 (139h27m11.702189817s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.975258844 (139h27m11.706526464s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.976947489 (139h27m11.708215099s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.978861599 (139h27m11.710129229s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.986380830 (139h27m11.71764845s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.085651371 (139h27m11.816919021s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446180656 (139h27m12.177448286s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446211113 (139h27m12.177478743s) [seg_pos={0 0}, upload=145185]: Segment reached optimal threshold of 14 pieces.
Aug 14 12:53:31.446327853 (139h27m12.177595483s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446432539 (139h27m12.177700169s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446511999 (139h27m12.17777965s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446568505 (139h27m12.177836165s) [seg_pos={0 0}, upload=145185]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 12:53:31.446682359 (139h27m12.177950019s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 12:53:31.446690074 (139h27m12.177957723s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 12:53:31.495940821 (139h27m12.227208451s) [upload=145185]: Done uploading segments...
Aug 14 12:53:31.495953846 (139h27m12.227221465s) [upload=145185]: Upload finished. err: <nil>
Duration: 580.561203ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................X.............X...................] duration:
160.148066ms
FAIL (2025-08-14 13:14:22 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 14 13:02:05.799391009 (139h35m46.530658659s) [upload=145334]: Starting upload
Aug 14 13:02:05.799499983 (139h35m46.530767663s) [upload=145334]: Done starting upload
Aug 14 13:02:05.799598559 (139h35m46.530866209s) [upload=145334]: Uploading segments...
Aug 14 13:02:05.799652370 (139h35m46.53092002s) [upload=145334]: Got next segment. Inline: true
Aug 14 13:02:05.799660655 (139h35m46.530928306s) [upload=145334]: Waiting for error group managing segments...
Aug 14 13:02:05.799723874 (139h35m46.530991524s) [upload=145334]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 13:02:05.799733502 (139h35m46.531001142s) [upload=145334]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 13:02:05.799739804 (139h35m46.531007454s) [upload=145334]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 13:02:05.934245793 (139h35m46.665513483s) [upload=145334]: Done uploading segments...
Aug 14 13:02:05.934265540 (139h35m46.66553319s) [upload=145334]: Upload finished. err: <nil>
Duration: 160.167643ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
370.524591ms
FAIL (2025-08-14 13:14:09 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 14 12:53:30.811893619 (139h27m11.54316128s) [upload=145185]: Starting upload
Aug 14 12:53:30.812060782 (139h27m11.543328433s) [upload=145185]: Done starting upload
Aug 14 12:53:30.812332184 (139h27m11.543599834s) [upload=145185]: Uploading segments...
Aug 14 12:53:30.812805844 (139h27m11.544073505s) [upload=145185]: Got next segment. Inline: false
Aug 14 12:53:30.812855368 (139h27m11.544123018s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 12:53:30.812863023 (139h27m11.544130672s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 12:53:30.840662084 (139h27m11.571929735s) [seg_pos={0 0}, upload=145185]: Begin upload segment...
Aug 14 12:53:30.840845550 (139h27m11.57211324s) [seg_pos={0 0}, upload=145185]: Done begin upload segment.
Aug 14 12:53:30.840887478 (139h27m11.572155128s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.840896425 (139h27m11.572164065s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841038943 (139h27m11.572306593s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841803511 (139h27m11.573071162s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841849618 (139h27m11.573117278s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842568741 (139h27m11.57383639s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842967270 (139h27m11.57423494s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843307149 (139h27m11.574574819s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843863526 (139h27m11.575131176s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844059354 (139h27m11.575327005s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844997248 (139h27m11.576264898s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845093238 (139h27m11.576360898s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845923159 (139h27m11.577190809s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845943016 (139h27m11.577210666s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846549868 (139h27m11.577817529s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846669723 (139h27m11.577937373s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847123256 (139h27m11.578390915s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847438158 (139h27m11.578705818s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.881759808 (139h27m11.613027429s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: ecclient: upload failed (node:1EiYA6gHiLyHsMfPevj2gLqmqttu1knLw3AM8SbWWtgKEf7Csu, address:104.36.82.5:4859): protocol: write tcp 5.161.89.252:28650->104.36.82.5:4859: write: connection refused; conn closed: op; piecestore: piecestore close: manager closed: conn closed: op
Aug 14 12:53:30.932703619 (139h27m11.663971239s) [upload=145185]: Next returned nil segment
Aug 14 12:53:30.932711613 (139h27m11.663979224s) [upload=145185]: Waiting for error group managing segments...
Aug 14 12:53:30.940609227 (139h27m11.671876847s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.940887300 (139h27m11.67215492s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.947132756 (139h27m11.678400377s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.952794213 (139h27m11.684061834s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.953517694 (139h27m11.684785314s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.955080694 (139h27m11.686348304s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.960298438 (139h27m11.691566058s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.970922197 (139h27m11.702189817s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.975258844 (139h27m11.706526464s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.976947489 (139h27m11.708215099s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.978861599 (139h27m11.710129229s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.986380830 (139h27m11.71764845s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.085651371 (139h27m11.816919021s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446180656 (139h27m12.177448286s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446211113 (139h27m12.177478743s) [seg_pos={0 0}, upload=145185]: Segment reached optimal threshold of 14 pieces.
Aug 14 12:53:31.446327853 (139h27m12.177595483s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446432539 (139h27m12.177700169s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446511999 (139h27m12.17777965s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446568505 (139h27m12.177836165s) [seg_pos={0 0}, upload=145185]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 12:53:31.446682359 (139h27m12.177950019s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 12:53:31.446690074 (139h27m12.177957723s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 12:53:31.495940821 (139h27m12.227208451s) [upload=145185]: Done uploading segments...
Aug 14 12:53:31.495953846 (139h27m12.227221465s) [upload=145185]: Upload finished. err: <nil>
Duration: 370.546563ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................X.............X..................] duration:
137.83575ms
FAIL (2025-08-14 13:14:04 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 14 13:02:05.799391009 (139h35m46.530658659s) [upload=145334]: Starting upload
Aug 14 13:02:05.799499983 (139h35m46.530767663s) [upload=145334]: Done starting upload
Aug 14 13:02:05.799598559 (139h35m46.530866209s) [upload=145334]: Uploading segments...
Aug 14 13:02:05.799652370 (139h35m46.53092002s) [upload=145334]: Got next segment. Inline: true
Aug 14 13:02:05.799660655 (139h35m46.530928306s) [upload=145334]: Waiting for error group managing segments...
Aug 14 13:02:05.799723874 (139h35m46.530991524s) [upload=145334]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 13:02:05.799733502 (139h35m46.531001142s) [upload=145334]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 13:02:05.799739804 (139h35m46.531007454s) [upload=145334]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 13:02:05.934245793 (139h35m46.665513483s) [upload=145334]: Done uploading segments...
Aug 14 13:02:05.934265540 (139h35m46.66553319s) [upload=145334]: Upload finished. err: <nil>
Duration: 137.859806ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................X.............X.................] duration:
156.904259ms
FAIL (2025-08-14 13:13:17 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 14 13:02:05.799391009 (139h35m46.530658659s) [upload=145334]: Starting upload
Aug 14 13:02:05.799499983 (139h35m46.530767663s) [upload=145334]: Done starting upload
Aug 14 13:02:05.799598559 (139h35m46.530866209s) [upload=145334]: Uploading segments...
Aug 14 13:02:05.799652370 (139h35m46.53092002s) [upload=145334]: Got next segment. Inline: true
Aug 14 13:02:05.799660655 (139h35m46.530928306s) [upload=145334]: Waiting for error group managing segments...
Aug 14 13:02:05.799723874 (139h35m46.530991524s) [upload=145334]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 13:02:05.799733502 (139h35m46.531001142s) [upload=145334]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 13:02:05.799739804 (139h35m46.531007454s) [upload=145334]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 13:02:05.934245793 (139h35m46.665513483s) [upload=145334]: Done uploading segments...
Aug 14 13:02:05.934265540 (139h35m46.66553319s) [upload=145334]: Upload finished. err: <nil>
Duration: 156.925859ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
352.261024ms
FAIL (2025-08-14 13:13:14 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 14 12:53:30.811893619 (139h27m11.54316128s) [upload=145185]: Starting upload
Aug 14 12:53:30.812060782 (139h27m11.543328433s) [upload=145185]: Done starting upload
Aug 14 12:53:30.812332184 (139h27m11.543599834s) [upload=145185]: Uploading segments...
Aug 14 12:53:30.812805844 (139h27m11.544073505s) [upload=145185]: Got next segment. Inline: false
Aug 14 12:53:30.812855368 (139h27m11.544123018s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 12:53:30.812863023 (139h27m11.544130672s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 12:53:30.840662084 (139h27m11.571929735s) [seg_pos={0 0}, upload=145185]: Begin upload segment...
Aug 14 12:53:30.840845550 (139h27m11.57211324s) [seg_pos={0 0}, upload=145185]: Done begin upload segment.
Aug 14 12:53:30.840887478 (139h27m11.572155128s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.840896425 (139h27m11.572164065s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841038943 (139h27m11.572306593s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841803511 (139h27m11.573071162s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841849618 (139h27m11.573117278s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842568741 (139h27m11.57383639s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842967270 (139h27m11.57423494s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843307149 (139h27m11.574574819s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843863526 (139h27m11.575131176s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844059354 (139h27m11.575327005s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844997248 (139h27m11.576264898s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845093238 (139h27m11.576360898s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845923159 (139h27m11.577190809s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845943016 (139h27m11.577210666s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846549868 (139h27m11.577817529s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846669723 (139h27m11.577937373s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847123256 (139h27m11.578390915s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847438158 (139h27m11.578705818s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.881759808 (139h27m11.613027429s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: ecclient: upload failed (node:1EiYA6gHiLyHsMfPevj2gLqmqttu1knLw3AM8SbWWtgKEf7Csu, address:104.36.82.5:4859): protocol: write tcp 5.161.89.252:28650->104.36.82.5:4859: write: connection refused; conn closed: op; piecestore: piecestore close: manager closed: conn closed: op
Aug 14 12:53:30.932703619 (139h27m11.663971239s) [upload=145185]: Next returned nil segment
Aug 14 12:53:30.932711613 (139h27m11.663979224s) [upload=145185]: Waiting for error group managing segments...
Aug 14 12:53:30.940609227 (139h27m11.671876847s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.940887300 (139h27m11.67215492s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.947132756 (139h27m11.678400377s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.952794213 (139h27m11.684061834s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.953517694 (139h27m11.684785314s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.955080694 (139h27m11.686348304s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.960298438 (139h27m11.691566058s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.970922197 (139h27m11.702189817s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.975258844 (139h27m11.706526464s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.976947489 (139h27m11.708215099s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.978861599 (139h27m11.710129229s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.986380830 (139h27m11.71764845s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.085651371 (139h27m11.816919021s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446180656 (139h27m12.177448286s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446211113 (139h27m12.177478743s) [seg_pos={0 0}, upload=145185]: Segment reached optimal threshold of 14 pieces.
Aug 14 12:53:31.446327853 (139h27m12.177595483s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446432539 (139h27m12.177700169s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446511999 (139h27m12.17777965s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446568505 (139h27m12.177836165s) [seg_pos={0 0}, upload=145185]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 12:53:31.446682359 (139h27m12.177950019s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 12:53:31.446690074 (139h27m12.177957723s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 12:53:31.495940821 (139h27m12.227208451s) [upload=145185]: Done uploading segments...
Aug 14 12:53:31.495953846 (139h27m12.227221465s) [upload=145185]: Upload finished. err: <nil>
Duration: 352.279961ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
409.620985ms
FAIL (2025-08-14 13:12:48 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 14 12:53:30.811893619 (139h27m11.54316128s) [upload=145185]: Starting upload
Aug 14 12:53:30.812060782 (139h27m11.543328433s) [upload=145185]: Done starting upload
Aug 14 12:53:30.812332184 (139h27m11.543599834s) [upload=145185]: Uploading segments...
Aug 14 12:53:30.812805844 (139h27m11.544073505s) [upload=145185]: Got next segment. Inline: false
Aug 14 12:53:30.812855368 (139h27m11.544123018s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 12:53:30.812863023 (139h27m11.544130672s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 12:53:30.840662084 (139h27m11.571929735s) [seg_pos={0 0}, upload=145185]: Begin upload segment...
Aug 14 12:53:30.840845550 (139h27m11.57211324s) [seg_pos={0 0}, upload=145185]: Done begin upload segment.
Aug 14 12:53:30.840887478 (139h27m11.572155128s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.840896425 (139h27m11.572164065s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841038943 (139h27m11.572306593s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841803511 (139h27m11.573071162s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841849618 (139h27m11.573117278s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842568741 (139h27m11.57383639s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842967270 (139h27m11.57423494s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843307149 (139h27m11.574574819s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843863526 (139h27m11.575131176s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844059354 (139h27m11.575327005s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844997248 (139h27m11.576264898s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845093238 (139h27m11.576360898s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845923159 (139h27m11.577190809s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845943016 (139h27m11.577210666s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846549868 (139h27m11.577817529s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846669723 (139h27m11.577937373s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847123256 (139h27m11.578390915s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847438158 (139h27m11.578705818s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.881759808 (139h27m11.613027429s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: ecclient: upload failed (node:1EiYA6gHiLyHsMfPevj2gLqmqttu1knLw3AM8SbWWtgKEf7Csu, address:104.36.82.5:4859): protocol: write tcp 5.161.89.252:28650->104.36.82.5:4859: write: connection refused; conn closed: op; piecestore: piecestore close: manager closed: conn closed: op
Aug 14 12:53:30.932703619 (139h27m11.663971239s) [upload=145185]: Next returned nil segment
Aug 14 12:53:30.932711613 (139h27m11.663979224s) [upload=145185]: Waiting for error group managing segments...
Aug 14 12:53:30.940609227 (139h27m11.671876847s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.940887300 (139h27m11.67215492s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.947132756 (139h27m11.678400377s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.952794213 (139h27m11.684061834s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.953517694 (139h27m11.684785314s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.955080694 (139h27m11.686348304s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.960298438 (139h27m11.691566058s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.970922197 (139h27m11.702189817s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.975258844 (139h27m11.706526464s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.976947489 (139h27m11.708215099s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.978861599 (139h27m11.710129229s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.986380830 (139h27m11.71764845s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.085651371 (139h27m11.816919021s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446180656 (139h27m12.177448286s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446211113 (139h27m12.177478743s) [seg_pos={0 0}, upload=145185]: Segment reached optimal threshold of 14 pieces.
Aug 14 12:53:31.446327853 (139h27m12.177595483s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446432539 (139h27m12.177700169s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446511999 (139h27m12.17777965s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446568505 (139h27m12.177836165s) [seg_pos={0 0}, upload=145185]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 12:53:31.446682359 (139h27m12.177950019s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 12:53:31.446690074 (139h27m12.177957723s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 12:53:31.495940821 (139h27m12.227208451s) [upload=145185]: Done uploading segments...
Aug 14 12:53:31.495953846 (139h27m12.227221465s) [upload=145185]: Upload finished. err: <nil>
Duration: 409.642345ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
435.888587ms
FAIL (2025-08-14 13:12:28 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 14 12:53:30.811893619 (139h27m11.54316128s) [upload=145185]: Starting upload
Aug 14 12:53:30.812060782 (139h27m11.543328433s) [upload=145185]: Done starting upload
Aug 14 12:53:30.812332184 (139h27m11.543599834s) [upload=145185]: Uploading segments...
Aug 14 12:53:30.812805844 (139h27m11.544073505s) [upload=145185]: Got next segment. Inline: false
Aug 14 12:53:30.812855368 (139h27m11.544123018s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 12:53:30.812863023 (139h27m11.544130672s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 12:53:30.840662084 (139h27m11.571929735s) [seg_pos={0 0}, upload=145185]: Begin upload segment...
Aug 14 12:53:30.840845550 (139h27m11.57211324s) [seg_pos={0 0}, upload=145185]: Done begin upload segment.
Aug 14 12:53:30.840887478 (139h27m11.572155128s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.840896425 (139h27m11.572164065s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841038943 (139h27m11.572306593s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841803511 (139h27m11.573071162s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841849618 (139h27m11.573117278s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842568741 (139h27m11.57383639s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842967270 (139h27m11.57423494s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843307149 (139h27m11.574574819s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843863526 (139h27m11.575131176s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844059354 (139h27m11.575327005s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844997248 (139h27m11.576264898s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845093238 (139h27m11.576360898s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845923159 (139h27m11.577190809s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845943016 (139h27m11.577210666s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846549868 (139h27m11.577817529s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846669723 (139h27m11.577937373s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847123256 (139h27m11.578390915s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847438158 (139h27m11.578705818s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.881759808 (139h27m11.613027429s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: ecclient: upload failed (node:1EiYA6gHiLyHsMfPevj2gLqmqttu1knLw3AM8SbWWtgKEf7Csu, address:104.36.82.5:4859): protocol: write tcp 5.161.89.252:28650->104.36.82.5:4859: write: connection refused; conn closed: op; piecestore: piecestore close: manager closed: conn closed: op
Aug 14 12:53:30.932703619 (139h27m11.663971239s) [upload=145185]: Next returned nil segment
Aug 14 12:53:30.932711613 (139h27m11.663979224s) [upload=145185]: Waiting for error group managing segments...
Aug 14 12:53:30.940609227 (139h27m11.671876847s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.940887300 (139h27m11.67215492s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.947132756 (139h27m11.678400377s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.952794213 (139h27m11.684061834s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.953517694 (139h27m11.684785314s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.955080694 (139h27m11.686348304s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.960298438 (139h27m11.691566058s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.970922197 (139h27m11.702189817s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.975258844 (139h27m11.706526464s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.976947489 (139h27m11.708215099s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.978861599 (139h27m11.710129229s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.986380830 (139h27m11.71764845s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.085651371 (139h27m11.816919021s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446180656 (139h27m12.177448286s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446211113 (139h27m12.177478743s) [seg_pos={0 0}, upload=145185]: Segment reached optimal threshold of 14 pieces.
Aug 14 12:53:31.446327853 (139h27m12.177595483s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446432539 (139h27m12.177700169s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446511999 (139h27m12.17777965s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446568505 (139h27m12.177836165s) [seg_pos={0 0}, upload=145185]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 12:53:31.446682359 (139h27m12.177950019s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 12:53:31.446690074 (139h27m12.177957723s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 12:53:31.495940821 (139h27m12.227208451s) [upload=145185]: Done uploading segments...
Aug 14 12:53:31.495953846 (139h27m12.227221465s) [upload=145185]: Upload finished. err: <nil>
Duration: 435.910759ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................X.............X................] duration:
161.615987ms
FAIL (2025-08-14 13:12:26 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 14 13:02:05.799391009 (139h35m46.530658659s) [upload=145334]: Starting upload
Aug 14 13:02:05.799499983 (139h35m46.530767663s) [upload=145334]: Done starting upload
Aug 14 13:02:05.799598559 (139h35m46.530866209s) [upload=145334]: Uploading segments...
Aug 14 13:02:05.799652370 (139h35m46.53092002s) [upload=145334]: Got next segment. Inline: true
Aug 14 13:02:05.799660655 (139h35m46.530928306s) [upload=145334]: Waiting for error group managing segments...
Aug 14 13:02:05.799723874 (139h35m46.530991524s) [upload=145334]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 13:02:05.799733502 (139h35m46.531001142s) [upload=145334]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 13:02:05.799739804 (139h35m46.531007454s) [upload=145334]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 13:02:05.934245793 (139h35m46.665513483s) [upload=145334]: Done uploading segments...
Aug 14 13:02:05.934265540 (139h35m46.66553319s) [upload=145334]: Upload finished. err: <nil>
Duration: 161.635494ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
387.664007ms
FAIL (2025-08-14 13:11:29 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 14 12:53:30.811893619 (139h27m11.54316128s) [upload=145185]: Starting upload
Aug 14 12:53:30.812060782 (139h27m11.543328433s) [upload=145185]: Done starting upload
Aug 14 12:53:30.812332184 (139h27m11.543599834s) [upload=145185]: Uploading segments...
Aug 14 12:53:30.812805844 (139h27m11.544073505s) [upload=145185]: Got next segment. Inline: false
Aug 14 12:53:30.812855368 (139h27m11.544123018s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 12:53:30.812863023 (139h27m11.544130672s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 12:53:30.840662084 (139h27m11.571929735s) [seg_pos={0 0}, upload=145185]: Begin upload segment...
Aug 14 12:53:30.840845550 (139h27m11.57211324s) [seg_pos={0 0}, upload=145185]: Done begin upload segment.
Aug 14 12:53:30.840887478 (139h27m11.572155128s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.840896425 (139h27m11.572164065s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841038943 (139h27m11.572306593s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841803511 (139h27m11.573071162s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.841849618 (139h27m11.573117278s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842568741 (139h27m11.57383639s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.842967270 (139h27m11.57423494s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843307149 (139h27m11.574574819s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.843863526 (139h27m11.575131176s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844059354 (139h27m11.575327005s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.844997248 (139h27m11.576264898s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845093238 (139h27m11.576360898s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845923159 (139h27m11.577190809s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.845943016 (139h27m11.577210666s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846549868 (139h27m11.577817529s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.846669723 (139h27m11.577937373s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847123256 (139h27m11.578390915s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.847438158 (139h27m11.578705818s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Uploading piece...
Aug 14 12:53:30.881759808 (139h27m11.613027429s) [noise=true , address=104.36.82.5:4859 , piece_id=DIQSGHD3TTX3XMQULKDNLUEM26KROMRL5MZKXSCRYKDSR5MQDRIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: ecclient: upload failed (node:1EiYA6gHiLyHsMfPevj2gLqmqttu1knLw3AM8SbWWtgKEf7Csu, address:104.36.82.5:4859): protocol: write tcp 5.161.89.252:28650->104.36.82.5:4859: write: connection refused; conn closed: op; piecestore: piecestore close: manager closed: conn closed: op
Aug 14 12:53:30.932703619 (139h27m11.663971239s) [upload=145185]: Next returned nil segment
Aug 14 12:53:30.932711613 (139h27m11.663979224s) [upload=145185]: Waiting for error group managing segments...
Aug 14 12:53:30.940609227 (139h27m11.671876847s) [noise=true , address=77.90.31.14:4666 , piece_id=PMHERNSRWBVXVTQVV3NEI4O4FWZIUPYEPOJQCXKBMV4X62XPFKNQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.940887300 (139h27m11.67215492s) [noise=true , address=77.90.31.11:4578 , piece_id=STWYUIZSM3FWU27MNXN4A32SKRFED2LDL6MZZIINLRIGTOZ5LCXQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.947132756 (139h27m11.678400377s) [noise=true , address=104.36.82.37:4681 , piece_id=WXMX36VPVYO5SUHLDKMBQUX7GLEAEPRV7XWRBP5HRSVQ5LEUBDBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.952794213 (139h27m11.684061834s) [noise=true , address=104.36.82.60:4362 , piece_id=PLF453VYS2KESBQU2IPFUPZMCRIDWQO7H7RAZ3KMAYFWD3ORKIKQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.953517694 (139h27m11.684785314s) [noise=true , address=77.90.31.21:4893 , piece_id=74MZ7QRWY2M44VASUEPALTO2BQDYYC6AF2WX5GOQ6WZRWQJ6LPIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.955080694 (139h27m11.686348304s) [noise=true , address=77.90.31.18:4808 , piece_id=QCIUHPWV4VG5UI5724GY2I6MJKXOXW634NHSHHWUNWR5GVV2AMBA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.960298438 (139h27m11.691566058s) [noise=true , address=104.36.82.44:4899 , piece_id=5P5ITKQ6OQHKUGXF6CQUJJZKQY3NSKYKFMC6QBQHYB5IOR7XJCWQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.970922197 (139h27m11.702189817s) [noise=true , address=104.36.82.35:4597 , piece_id=ODK4V62FGNH4GQJ73JZTOC4W3AU3IAQLINTBYLSDHUE3IW74KYCA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.975258844 (139h27m11.706526464s) [noise=true , address=104.36.82.34:4545 , piece_id=GIPOL3BQBTFHZK3P67UFRBBPGUG4YBF2OPL64F4WD6M6KV7ASWEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.976947489 (139h27m11.708215099s) [noise=true , address=104.36.82.23:4452 , piece_id=ZKYGDRQDGPTGB7ESRADM7RHG6TIMGXFRQIY4ZTWGV5GQLCSQVNLQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.978861599 (139h27m11.710129229s) [noise=true , address=77.90.31.19:4855 , piece_id=KOJ5LVTKIWTCLSOZU5NQWLFNXHUB6JQ5OOYY7UZRTUJHLZUEHFGQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:30.986380830 (139h27m11.71764845s) [noise=true , address=77.90.31.17:4776 , piece_id=L4A3CK2OWFE7O6CROCYSNEOZWT7HC6T5XVBSLXMOJUA7O5NEBSIQ, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.085651371 (139h27m11.816919021s) [noise=true , address=79.127.201.215:4350 , piece_id=VM266DN74UP5QEEEJPTKGR65TCSTSU4EFJFNZUFBSJTI7HKMJ3KA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446180656 (139h27m12.177448286s) [noise=true , address=64.49.13.169:4707 , piece_id=AU6II5VX6HBTRJBHMTJYF4QHIGGQRJHYNXZ5AQP5F2JPH2DCGA5A, seg_pos={0 0}, upload=145185]: Done uploading piece. err: <nil>
Aug 14 12:53:31.446211113 (139h27m12.177478743s) [seg_pos={0 0}, upload=145185]: Segment reached optimal threshold of 14 pieces.
Aug 14 12:53:31.446327853 (139h27m12.177595483s) [noise=true , address=64.49.13.169:4715 , piece_id=MUWK7HYQPQVKINTLT27Q4SEZ7DLEUUQCJPFZNYKYZ6MWULNL4PEA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446432539 (139h27m12.177700169s) [noise=true , address=104.36.82.59:4324 , piece_id=WJVGES3PY4YULG3LXTGZWO7UCBS45PKT7BCYWMBSCNEEURHMHGVA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12j5y2JKTy6UuY5iC2MLsNNXkSKzNhj8BQ4ZwDtV3Nz4wjfGzkH): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446511999 (139h27m12.17777965s) [noise=true , address=66.23.193.175:4562 , piece_id=HZOD55DZQ47NUIDZU7FKJSUHPAY4V7SZEIHM23JH4SXMBYLBYVNA, seg_pos={0 0}, upload=145185]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: expected piece hash; context canceled; EOF
Aug 14 12:53:31.446568505 (139h27m12.177836165s) [seg_pos={0 0}, upload=145185]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 12:53:31.446682359 (139h27m12.177950019s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 12:53:31.446690074 (139h27m12.177957723s) [upload=145185]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 12:53:31.495940821 (139h27m12.227208451s) [upload=145185]: Done uploading segments...
Aug 14 12:53:31.495953846 (139h27m12.227221465s) [upload=145185]: Upload finished. err: <nil>
Duration: 387.683895ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................X.............X...............] duration:
1.222487372s
FAIL (2025-08-14 13:11:13 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 14 13:02:05.799391009 (139h35m46.530658659s) [upload=145334]: Starting upload
Aug 14 13:02:05.799499983 (139h35m46.530767663s) [upload=145334]: Done starting upload
Aug 14 13:02:05.799598559 (139h35m46.530866209s) [upload=145334]: Uploading segments...
Aug 14 13:02:05.799652370 (139h35m46.53092002s) [upload=145334]: Got next segment. Inline: true
Aug 14 13:02:05.799660655 (139h35m46.530928306s) [upload=145334]: Waiting for error group managing segments...
Aug 14 13:02:05.799723874 (139h35m46.530991524s) [upload=145334]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 13:02:05.799733502 (139h35m46.531001142s) [upload=145334]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 13:02:05.799739804 (139h35m46.531007454s) [upload=145334]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 13:02:05.934245793 (139h35m46.665513483s) [upload=145334]: Done uploading segments...
Aug 14 13:02:05.934265540 (139h35m46.66553319s) [upload=145334]: Upload finished. err: <nil>
Duration: 1.222515656s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|