Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
539.412613ms
FAIL (2025-08-12 20:30:15 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 20:22:01.339537006 (98h55m42.070804636s) [upload=103006]: Starting upload
Aug 12 20:22:01.339603582 (98h55m42.070871202s) [upload=103006]: Done starting upload
Aug 12 20:22:01.339679935 (98h55m42.070947565s) [upload=103006]: Uploading segments...
Aug 12 20:22:01.339853221 (98h55m42.071120851s) [upload=103006]: Got next segment. Inline: false
Aug 12 20:22:01.339892445 (98h55m42.071160075s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 20:22:01.339896492 (98h55m42.071164122s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 20:22:01.379548451 (98h55m42.110816081s) [seg_pos={0 0}, upload=103006]: Begin upload segment...
Aug 12 20:22:01.379584901 (98h55m42.110852531s) [seg_pos={0 0}, upload=103006]: Done begin upload segment.
Aug 12 20:22:01.379611641 (98h55m42.110879271s) [noise=true , address=104.36.82.9:4035 , piece_id=JI3Y6MFMMFSBL7YDA45H7RBV2FUM7SLFP4LIZ6O2BBW3KB7QFQYA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.379628362 (98h55m42.110895992s) [noise=true , address=104.36.82.59:4306 , piece_id=7VZX2QOV3S5U3JTBTXGHENIXO3XJKM7CXHQEGECBQTUROERNA6CQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380012595 (98h55m42.111280215s) [noise=true , address=77.90.31.21:4899 , piece_id=XB3VNMD6V6LJJHATXLHW6MGXQX667NYKUTS6FJ7QRP5MVPCFKTDQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380023856 (98h55m42.111291476s) [noise=true , address=104.36.82.62:4436 , piece_id=WSYIG725WIYG6QJ6FO3UWSG6QP6KA2IBDNM6FI6IF2QEOA5WMU3Q, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380277303 (98h55m42.111544923s) [noise=true , address=104.36.82.8:4993 , piece_id=5JGUV4QMSBG5YAPTQTUOMPTGUCUGQXUKFZGFS32MPDPU3D3G7Y4Q, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380294425 (98h55m42.111562045s) [noise=true , address=104.36.82.40:4972 , piece_id=OJGZIQQ7FBYSKYJTAVGFIULWVZCBUF2HPJVC7TUMEI3HEQJTUNKQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380557831 (98h55m42.111825482s) [noise=true , address=64.49.13.169:4713 , piece_id=NPVCOAXQ3U2ZDNCXZMU2C356Q2WBI54L6LJHKEM7M276G34YXPIQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381005865 (98h55m42.112273495s) [noise=true , address=104.36.82.36:4618 , piece_id=3BXDRNPSA77ZCRWCFLYYRXAGJTL2O6HZ42GRZPQXM6RA26NJOF6A, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381223243 (98h55m42.112490873s) [noise=true , address=104.36.82.12:4168 , piece_id=4U4ZQQOMMF53XG7WW3CXN6A5YVN2Q4EQXUY6RKI2P45FBOOVSRSA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381495867 (98h55m42.112763487s) [noise=true , address=104.36.82.13:4210 , piece_id=DIQBERJ3UOM2H2FTNK6B7JA3ATUTYR4DZ3A26CMK6TVS5CIVIMXQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381860323 (98h55m42.113127953s) [noise=true , address=79.127.205.235:4658 , piece_id=LYEUZ4WBS32YU2L43D7JTSD3NPSZKGPOZMYWFVAWAUR4GYW2XVGA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382135862 (98h55m42.113403482s) [noise=true , address=104.36.82.14:4232 , piece_id=UO3P7FBYFJPBFWZFRKK6CWWMCDEB7YAPC5FPREKSQOEQ2JU6I37Q, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382450184 (98h55m42.113717804s) [noise=true , address=104.36.82.35:4582 , piece_id=DVWEOHMCH7ADDY2RXPKPOE55LOQAE636ZLJ2BRIUFTQX22BRNUKA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382711605 (98h55m42.113979225s) [noise=true , address=104.36.82.62:4420 , piece_id=JUYUQFID5GUDXGCIHMCZUWDDC3WIVR5E72XEGFZUAPFAKBEAJPSQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382963689 (98h55m42.11423131s) [noise=true , address=104.36.82.23:4445 , piece_id=VKVNYY73RMER75AMFM6DSEDLKCZAKEXJQSTMPQOOCKFAXN23OJQA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.383222817 (98h55m42.114490438s) [noise=true , address=104.36.82.61:4394 , piece_id=NZMAPLSHTI4TO3D36YMDSPUWNGSJ7GAK4AM5NXTZOMC4YU7P5RWQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.384120417 (98h55m42.115388047s) [noise=true , address=104.36.82.21:4506 , piece_id=EWJA4LY7K3QJWZXVITMXDYVGXTPJAIRC2CVLWPXIH46OYABIMONQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.384281039 (98h55m42.115548659s) [noise=true , address=104.36.82.39:4754 , piece_id=7ZBCC3Q72O4KIWFZVO2O4U6FS7UL5P67FU3EY2UMW7TFCDUYYE4A, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.503410855 (98h55m42.234678495s) [upload=103006]: Next returned nil segment
Aug 12 20:22:01.503425643 (98h55m42.234693273s) [upload=103006]: Waiting for error group managing segments...
Aug 12 20:22:01.518591716 (98h55m42.249859346s) [noise=true , address=104.36.82.39:4754 , piece_id=7ZBCC3Q72O4KIWFZVO2O4U6FS7UL5P67FU3EY2UMW7TFCDUYYE4A, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.522295799 (98h55m42.253563429s) [noise=true , address=104.36.82.14:4232 , piece_id=UO3P7FBYFJPBFWZFRKK6CWWMCDEB7YAPC5FPREKSQOEQ2JU6I37Q, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.524942810 (98h55m42.25621044s) [noise=true , address=104.36.82.8:4993 , piece_id=5JGUV4QMSBG5YAPTQTUOMPTGUCUGQXUKFZGFS32MPDPU3D3G7Y4Q, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.529281676 (98h55m42.260549297s) [noise=true , address=104.36.82.35:4582 , piece_id=DVWEOHMCH7ADDY2RXPKPOE55LOQAE636ZLJ2BRIUFTQX22BRNUKA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.529534613 (98h55m42.260802233s) [noise=true , address=104.36.82.40:4972 , piece_id=OJGZIQQ7FBYSKYJTAVGFIULWVZCBUF2HPJVC7TUMEI3HEQJTUNKQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.529663065 (98h55m42.260930685s) [noise=true , address=104.36.82.23:4445 , piece_id=VKVNYY73RMER75AMFM6DSEDLKCZAKEXJQSTMPQOOCKFAXN23OJQA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.532249323 (98h55m42.263516953s) [noise=true , address=104.36.82.62:4420 , piece_id=JUYUQFID5GUDXGCIHMCZUWDDC3WIVR5E72XEGFZUAPFAKBEAJPSQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.537316489 (98h55m42.268584109s) [noise=true , address=104.36.82.36:4618 , piece_id=3BXDRNPSA77ZCRWCFLYYRXAGJTL2O6HZ42GRZPQXM6RA26NJOF6A, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.540779567 (98h55m42.272047197s) [noise=true , address=104.36.82.13:4210 , piece_id=DIQBERJ3UOM2H2FTNK6B7JA3ATUTYR4DZ3A26CMK6TVS5CIVIMXQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.550597055 (98h55m42.281864685s) [noise=true , address=77.90.31.21:4899 , piece_id=XB3VNMD6V6LJJHATXLHW6MGXQX667NYKUTS6FJ7QRP5MVPCFKTDQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.552054648 (98h55m42.283322299s) [noise=true , address=104.36.82.12:4168 , piece_id=4U4ZQQOMMF53XG7WW3CXN6A5YVN2Q4EQXUY6RKI2P45FBOOVSRSA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.557838805 (98h55m42.289106454s) [noise=true , address=104.36.82.9:4035 , piece_id=JI3Y6MFMMFSBL7YDA45H7RBV2FUM7SLFP4LIZ6O2BBW3KB7QFQYA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.560393523 (98h55m42.291661173s) [noise=true , address=104.36.82.62:4436 , piece_id=WSYIG725WIYG6QJ6FO3UWSG6QP6KA2IBDNM6FI6IF2QEOA5WMU3Q, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.562560110 (98h55m42.29382776s) [noise=true , address=104.36.82.61:4394 , piece_id=NZMAPLSHTI4TO3D36YMDSPUWNGSJ7GAK4AM5NXTZOMC4YU7P5RWQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.562600397 (98h55m42.293868037s) [seg_pos={0 0}, upload=103006]: Segment reached optimal threshold of 14 pieces.
Aug 12 20:22:01.562929186 (98h55m42.294196835s) [noise=true , address=104.36.82.59:4306 , piece_id=7VZX2QOV3S5U3JTBTXGHENIXO3XJKM7CXHQEGECBQTUROERNA6CQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw): protocol: expected piece hash; context canceled; EOF
Aug 12 20:22:01.562988978 (98h55m42.294256627s) [noise=true , address=79.127.205.235:4658 , piece_id=LYEUZ4WBS32YU2L43D7JTSD3NPSZKGPOZMYWFVAWAUR4GYW2XVGA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HSvQVuCNaPdj84e4ybE8YWZ77ff2gbhnjd4z9HTf1abGxz2u7): protocol: read tcp 5.161.89.252:22078->79.127.205.235:4658: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 20:22:01.563045493 (98h55m42.294313144s) [noise=true , address=64.49.13.169:4713 , piece_id=NPVCOAXQ3U2ZDNCXZMU2C356Q2WBI54L6LJHKEM7M276G34YXPIQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: read tcp 5.161.89.252:35864->64.49.13.169:4713: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 20:22:01.563079208 (98h55m42.294346858s) [noise=true , address=104.36.82.21:4506 , piece_id=EWJA4LY7K3QJWZXVITMXDYVGXTPJAIRC2CVLWPXIH46OYABIMONQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YUTchJGJE2EGXqiGZEcLjQmFQCazjV8Ahi8ogJhuqTE4H6n7T): protocol: expected piece hash; context canceled; EOF
Aug 12 20:22:01.563135343 (98h55m42.294402994s) [seg_pos={0 0}, upload=103006]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 20:22:01.563200666 (98h55m42.294468316s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 20:22:01.563205484 (98h55m42.294473135s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 20:22:02.476106688 (98h55m43.207374368s) [upload=103006]: Done uploading segments...
Aug 12 20:22:02.476119001 (98h55m43.207386621s) [upload=103006]: Upload finished. err: <nil>
Duration: 539.430076ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
411.544991ms
FAIL (2025-08-12 20:29:54 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 20:22:01.339537006 (98h55m42.070804636s) [upload=103006]: Starting upload
Aug 12 20:22:01.339603582 (98h55m42.070871202s) [upload=103006]: Done starting upload
Aug 12 20:22:01.339679935 (98h55m42.070947565s) [upload=103006]: Uploading segments...
Aug 12 20:22:01.339853221 (98h55m42.071120851s) [upload=103006]: Got next segment. Inline: false
Aug 12 20:22:01.339892445 (98h55m42.071160075s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 20:22:01.339896492 (98h55m42.071164122s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 20:22:01.379548451 (98h55m42.110816081s) [seg_pos={0 0}, upload=103006]: Begin upload segment...
Aug 12 20:22:01.379584901 (98h55m42.110852531s) [seg_pos={0 0}, upload=103006]: Done begin upload segment.
Aug 12 20:22:01.379611641 (98h55m42.110879271s) [noise=true , address=104.36.82.9:4035 , piece_id=JI3Y6MFMMFSBL7YDA45H7RBV2FUM7SLFP4LIZ6O2BBW3KB7QFQYA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.379628362 (98h55m42.110895992s) [noise=true , address=104.36.82.59:4306 , piece_id=7VZX2QOV3S5U3JTBTXGHENIXO3XJKM7CXHQEGECBQTUROERNA6CQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380012595 (98h55m42.111280215s) [noise=true , address=77.90.31.21:4899 , piece_id=XB3VNMD6V6LJJHATXLHW6MGXQX667NYKUTS6FJ7QRP5MVPCFKTDQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380023856 (98h55m42.111291476s) [noise=true , address=104.36.82.62:4436 , piece_id=WSYIG725WIYG6QJ6FO3UWSG6QP6KA2IBDNM6FI6IF2QEOA5WMU3Q, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380277303 (98h55m42.111544923s) [noise=true , address=104.36.82.8:4993 , piece_id=5JGUV4QMSBG5YAPTQTUOMPTGUCUGQXUKFZGFS32MPDPU3D3G7Y4Q, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380294425 (98h55m42.111562045s) [noise=true , address=104.36.82.40:4972 , piece_id=OJGZIQQ7FBYSKYJTAVGFIULWVZCBUF2HPJVC7TUMEI3HEQJTUNKQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380557831 (98h55m42.111825482s) [noise=true , address=64.49.13.169:4713 , piece_id=NPVCOAXQ3U2ZDNCXZMU2C356Q2WBI54L6LJHKEM7M276G34YXPIQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381005865 (98h55m42.112273495s) [noise=true , address=104.36.82.36:4618 , piece_id=3BXDRNPSA77ZCRWCFLYYRXAGJTL2O6HZ42GRZPQXM6RA26NJOF6A, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381223243 (98h55m42.112490873s) [noise=true , address=104.36.82.12:4168 , piece_id=4U4ZQQOMMF53XG7WW3CXN6A5YVN2Q4EQXUY6RKI2P45FBOOVSRSA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381495867 (98h55m42.112763487s) [noise=true , address=104.36.82.13:4210 , piece_id=DIQBERJ3UOM2H2FTNK6B7JA3ATUTYR4DZ3A26CMK6TVS5CIVIMXQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381860323 (98h55m42.113127953s) [noise=true , address=79.127.205.235:4658 , piece_id=LYEUZ4WBS32YU2L43D7JTSD3NPSZKGPOZMYWFVAWAUR4GYW2XVGA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382135862 (98h55m42.113403482s) [noise=true , address=104.36.82.14:4232 , piece_id=UO3P7FBYFJPBFWZFRKK6CWWMCDEB7YAPC5FPREKSQOEQ2JU6I37Q, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382450184 (98h55m42.113717804s) [noise=true , address=104.36.82.35:4582 , piece_id=DVWEOHMCH7ADDY2RXPKPOE55LOQAE636ZLJ2BRIUFTQX22BRNUKA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382711605 (98h55m42.113979225s) [noise=true , address=104.36.82.62:4420 , piece_id=JUYUQFID5GUDXGCIHMCZUWDDC3WIVR5E72XEGFZUAPFAKBEAJPSQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382963689 (98h55m42.11423131s) [noise=true , address=104.36.82.23:4445 , piece_id=VKVNYY73RMER75AMFM6DSEDLKCZAKEXJQSTMPQOOCKFAXN23OJQA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.383222817 (98h55m42.114490438s) [noise=true , address=104.36.82.61:4394 , piece_id=NZMAPLSHTI4TO3D36YMDSPUWNGSJ7GAK4AM5NXTZOMC4YU7P5RWQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.384120417 (98h55m42.115388047s) [noise=true , address=104.36.82.21:4506 , piece_id=EWJA4LY7K3QJWZXVITMXDYVGXTPJAIRC2CVLWPXIH46OYABIMONQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.384281039 (98h55m42.115548659s) [noise=true , address=104.36.82.39:4754 , piece_id=7ZBCC3Q72O4KIWFZVO2O4U6FS7UL5P67FU3EY2UMW7TFCDUYYE4A, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.503410855 (98h55m42.234678495s) [upload=103006]: Next returned nil segment
Aug 12 20:22:01.503425643 (98h55m42.234693273s) [upload=103006]: Waiting for error group managing segments...
Aug 12 20:22:01.518591716 (98h55m42.249859346s) [noise=true , address=104.36.82.39:4754 , piece_id=7ZBCC3Q72O4KIWFZVO2O4U6FS7UL5P67FU3EY2UMW7TFCDUYYE4A, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.522295799 (98h55m42.253563429s) [noise=true , address=104.36.82.14:4232 , piece_id=UO3P7FBYFJPBFWZFRKK6CWWMCDEB7YAPC5FPREKSQOEQ2JU6I37Q, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.524942810 (98h55m42.25621044s) [noise=true , address=104.36.82.8:4993 , piece_id=5JGUV4QMSBG5YAPTQTUOMPTGUCUGQXUKFZGFS32MPDPU3D3G7Y4Q, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.529281676 (98h55m42.260549297s) [noise=true , address=104.36.82.35:4582 , piece_id=DVWEOHMCH7ADDY2RXPKPOE55LOQAE636ZLJ2BRIUFTQX22BRNUKA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.529534613 (98h55m42.260802233s) [noise=true , address=104.36.82.40:4972 , piece_id=OJGZIQQ7FBYSKYJTAVGFIULWVZCBUF2HPJVC7TUMEI3HEQJTUNKQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.529663065 (98h55m42.260930685s) [noise=true , address=104.36.82.23:4445 , piece_id=VKVNYY73RMER75AMFM6DSEDLKCZAKEXJQSTMPQOOCKFAXN23OJQA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.532249323 (98h55m42.263516953s) [noise=true , address=104.36.82.62:4420 , piece_id=JUYUQFID5GUDXGCIHMCZUWDDC3WIVR5E72XEGFZUAPFAKBEAJPSQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.537316489 (98h55m42.268584109s) [noise=true , address=104.36.82.36:4618 , piece_id=3BXDRNPSA77ZCRWCFLYYRXAGJTL2O6HZ42GRZPQXM6RA26NJOF6A, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.540779567 (98h55m42.272047197s) [noise=true , address=104.36.82.13:4210 , piece_id=DIQBERJ3UOM2H2FTNK6B7JA3ATUTYR4DZ3A26CMK6TVS5CIVIMXQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.550597055 (98h55m42.281864685s) [noise=true , address=77.90.31.21:4899 , piece_id=XB3VNMD6V6LJJHATXLHW6MGXQX667NYKUTS6FJ7QRP5MVPCFKTDQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.552054648 (98h55m42.283322299s) [noise=true , address=104.36.82.12:4168 , piece_id=4U4ZQQOMMF53XG7WW3CXN6A5YVN2Q4EQXUY6RKI2P45FBOOVSRSA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.557838805 (98h55m42.289106454s) [noise=true , address=104.36.82.9:4035 , piece_id=JI3Y6MFMMFSBL7YDA45H7RBV2FUM7SLFP4LIZ6O2BBW3KB7QFQYA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.560393523 (98h55m42.291661173s) [noise=true , address=104.36.82.62:4436 , piece_id=WSYIG725WIYG6QJ6FO3UWSG6QP6KA2IBDNM6FI6IF2QEOA5WMU3Q, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.562560110 (98h55m42.29382776s) [noise=true , address=104.36.82.61:4394 , piece_id=NZMAPLSHTI4TO3D36YMDSPUWNGSJ7GAK4AM5NXTZOMC4YU7P5RWQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.562600397 (98h55m42.293868037s) [seg_pos={0 0}, upload=103006]: Segment reached optimal threshold of 14 pieces.
Aug 12 20:22:01.562929186 (98h55m42.294196835s) [noise=true , address=104.36.82.59:4306 , piece_id=7VZX2QOV3S5U3JTBTXGHENIXO3XJKM7CXHQEGECBQTUROERNA6CQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw): protocol: expected piece hash; context canceled; EOF
Aug 12 20:22:01.562988978 (98h55m42.294256627s) [noise=true , address=79.127.205.235:4658 , piece_id=LYEUZ4WBS32YU2L43D7JTSD3NPSZKGPOZMYWFVAWAUR4GYW2XVGA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HSvQVuCNaPdj84e4ybE8YWZ77ff2gbhnjd4z9HTf1abGxz2u7): protocol: read tcp 5.161.89.252:22078->79.127.205.235:4658: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 20:22:01.563045493 (98h55m42.294313144s) [noise=true , address=64.49.13.169:4713 , piece_id=NPVCOAXQ3U2ZDNCXZMU2C356Q2WBI54L6LJHKEM7M276G34YXPIQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: read tcp 5.161.89.252:35864->64.49.13.169:4713: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 20:22:01.563079208 (98h55m42.294346858s) [noise=true , address=104.36.82.21:4506 , piece_id=EWJA4LY7K3QJWZXVITMXDYVGXTPJAIRC2CVLWPXIH46OYABIMONQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YUTchJGJE2EGXqiGZEcLjQmFQCazjV8Ahi8ogJhuqTE4H6n7T): protocol: expected piece hash; context canceled; EOF
Aug 12 20:22:01.563135343 (98h55m42.294402994s) [seg_pos={0 0}, upload=103006]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 20:22:01.563200666 (98h55m42.294468316s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 20:22:01.563205484 (98h55m42.294473135s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 20:22:02.476106688 (98h55m43.207374368s) [upload=103006]: Done uploading segments...
Aug 12 20:22:02.476119001 (98h55m43.207386621s) [upload=103006]: Upload finished. err: <nil>
Duration: 411.567024ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................X...................................X] duration:
24.278916ms
FAIL (2025-08-12 20:29:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 20:29:20.443735527 (99h3m1.175003147s) [upload=103132]: Starting upload Aug 12 20:29:20.443814516 (99h3m1.175082136s) [upload=103132]: Done starting upload Aug 12 20:29:20.443953527 (99h3m1.175221157s) [upload=103132]: Uploading segments... Aug 12 20:29:20.444007669 (99h3m1.175275309s) [upload=103132]: Got next segment. Inline: true Aug 12 20:29:20.444012588 (99h3m1.175280208s) [upload=103132]: Waiting for error group managing segments... Aug 12 20:29:20.444062733 (99h3m1.175330352s) [upload=103132]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 20:29:20.444067902 (99h3m1.175335522s) [upload=103132]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 20:29:20.444087398 (99h3m1.175355019s) [upload=103132]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 20:29:20.450757743 (99h3m1.182025363s) [upload=103132]: Done uploading segments... Aug 12 20:29:20.450767311 (99h3m1.182034941s) [upload=103132]: Upload finished. err: metaclient: Too Many Requests
Duration: 24.298723ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
784.522742ms
FAIL (2025-08-12 20:28:56 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 20:22:01.339537006 (98h55m42.070804636s) [upload=103006]: Starting upload
Aug 12 20:22:01.339603582 (98h55m42.070871202s) [upload=103006]: Done starting upload
Aug 12 20:22:01.339679935 (98h55m42.070947565s) [upload=103006]: Uploading segments...
Aug 12 20:22:01.339853221 (98h55m42.071120851s) [upload=103006]: Got next segment. Inline: false
Aug 12 20:22:01.339892445 (98h55m42.071160075s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 20:22:01.339896492 (98h55m42.071164122s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 20:22:01.379548451 (98h55m42.110816081s) [seg_pos={0 0}, upload=103006]: Begin upload segment...
Aug 12 20:22:01.379584901 (98h55m42.110852531s) [seg_pos={0 0}, upload=103006]: Done begin upload segment.
Aug 12 20:22:01.379611641 (98h55m42.110879271s) [noise=true , address=104.36.82.9:4035 , piece_id=JI3Y6MFMMFSBL7YDA45H7RBV2FUM7SLFP4LIZ6O2BBW3KB7QFQYA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.379628362 (98h55m42.110895992s) [noise=true , address=104.36.82.59:4306 , piece_id=7VZX2QOV3S5U3JTBTXGHENIXO3XJKM7CXHQEGECBQTUROERNA6CQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380012595 (98h55m42.111280215s) [noise=true , address=77.90.31.21:4899 , piece_id=XB3VNMD6V6LJJHATXLHW6MGXQX667NYKUTS6FJ7QRP5MVPCFKTDQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380023856 (98h55m42.111291476s) [noise=true , address=104.36.82.62:4436 , piece_id=WSYIG725WIYG6QJ6FO3UWSG6QP6KA2IBDNM6FI6IF2QEOA5WMU3Q, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380277303 (98h55m42.111544923s) [noise=true , address=104.36.82.8:4993 , piece_id=5JGUV4QMSBG5YAPTQTUOMPTGUCUGQXUKFZGFS32MPDPU3D3G7Y4Q, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380294425 (98h55m42.111562045s) [noise=true , address=104.36.82.40:4972 , piece_id=OJGZIQQ7FBYSKYJTAVGFIULWVZCBUF2HPJVC7TUMEI3HEQJTUNKQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380557831 (98h55m42.111825482s) [noise=true , address=64.49.13.169:4713 , piece_id=NPVCOAXQ3U2ZDNCXZMU2C356Q2WBI54L6LJHKEM7M276G34YXPIQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381005865 (98h55m42.112273495s) [noise=true , address=104.36.82.36:4618 , piece_id=3BXDRNPSA77ZCRWCFLYYRXAGJTL2O6HZ42GRZPQXM6RA26NJOF6A, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381223243 (98h55m42.112490873s) [noise=true , address=104.36.82.12:4168 , piece_id=4U4ZQQOMMF53XG7WW3CXN6A5YVN2Q4EQXUY6RKI2P45FBOOVSRSA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381495867 (98h55m42.112763487s) [noise=true , address=104.36.82.13:4210 , piece_id=DIQBERJ3UOM2H2FTNK6B7JA3ATUTYR4DZ3A26CMK6TVS5CIVIMXQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381860323 (98h55m42.113127953s) [noise=true , address=79.127.205.235:4658 , piece_id=LYEUZ4WBS32YU2L43D7JTSD3NPSZKGPOZMYWFVAWAUR4GYW2XVGA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382135862 (98h55m42.113403482s) [noise=true , address=104.36.82.14:4232 , piece_id=UO3P7FBYFJPBFWZFRKK6CWWMCDEB7YAPC5FPREKSQOEQ2JU6I37Q, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382450184 (98h55m42.113717804s) [noise=true , address=104.36.82.35:4582 , piece_id=DVWEOHMCH7ADDY2RXPKPOE55LOQAE636ZLJ2BRIUFTQX22BRNUKA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382711605 (98h55m42.113979225s) [noise=true , address=104.36.82.62:4420 , piece_id=JUYUQFID5GUDXGCIHMCZUWDDC3WIVR5E72XEGFZUAPFAKBEAJPSQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382963689 (98h55m42.11423131s) [noise=true , address=104.36.82.23:4445 , piece_id=VKVNYY73RMER75AMFM6DSEDLKCZAKEXJQSTMPQOOCKFAXN23OJQA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.383222817 (98h55m42.114490438s) [noise=true , address=104.36.82.61:4394 , piece_id=NZMAPLSHTI4TO3D36YMDSPUWNGSJ7GAK4AM5NXTZOMC4YU7P5RWQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.384120417 (98h55m42.115388047s) [noise=true , address=104.36.82.21:4506 , piece_id=EWJA4LY7K3QJWZXVITMXDYVGXTPJAIRC2CVLWPXIH46OYABIMONQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.384281039 (98h55m42.115548659s) [noise=true , address=104.36.82.39:4754 , piece_id=7ZBCC3Q72O4KIWFZVO2O4U6FS7UL5P67FU3EY2UMW7TFCDUYYE4A, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.503410855 (98h55m42.234678495s) [upload=103006]: Next returned nil segment
Aug 12 20:22:01.503425643 (98h55m42.234693273s) [upload=103006]: Waiting for error group managing segments...
Aug 12 20:22:01.518591716 (98h55m42.249859346s) [noise=true , address=104.36.82.39:4754 , piece_id=7ZBCC3Q72O4KIWFZVO2O4U6FS7UL5P67FU3EY2UMW7TFCDUYYE4A, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.522295799 (98h55m42.253563429s) [noise=true , address=104.36.82.14:4232 , piece_id=UO3P7FBYFJPBFWZFRKK6CWWMCDEB7YAPC5FPREKSQOEQ2JU6I37Q, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.524942810 (98h55m42.25621044s) [noise=true , address=104.36.82.8:4993 , piece_id=5JGUV4QMSBG5YAPTQTUOMPTGUCUGQXUKFZGFS32MPDPU3D3G7Y4Q, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.529281676 (98h55m42.260549297s) [noise=true , address=104.36.82.35:4582 , piece_id=DVWEOHMCH7ADDY2RXPKPOE55LOQAE636ZLJ2BRIUFTQX22BRNUKA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.529534613 (98h55m42.260802233s) [noise=true , address=104.36.82.40:4972 , piece_id=OJGZIQQ7FBYSKYJTAVGFIULWVZCBUF2HPJVC7TUMEI3HEQJTUNKQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.529663065 (98h55m42.260930685s) [noise=true , address=104.36.82.23:4445 , piece_id=VKVNYY73RMER75AMFM6DSEDLKCZAKEXJQSTMPQOOCKFAXN23OJQA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.532249323 (98h55m42.263516953s) [noise=true , address=104.36.82.62:4420 , piece_id=JUYUQFID5GUDXGCIHMCZUWDDC3WIVR5E72XEGFZUAPFAKBEAJPSQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.537316489 (98h55m42.268584109s) [noise=true , address=104.36.82.36:4618 , piece_id=3BXDRNPSA77ZCRWCFLYYRXAGJTL2O6HZ42GRZPQXM6RA26NJOF6A, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.540779567 (98h55m42.272047197s) [noise=true , address=104.36.82.13:4210 , piece_id=DIQBERJ3UOM2H2FTNK6B7JA3ATUTYR4DZ3A26CMK6TVS5CIVIMXQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.550597055 (98h55m42.281864685s) [noise=true , address=77.90.31.21:4899 , piece_id=XB3VNMD6V6LJJHATXLHW6MGXQX667NYKUTS6FJ7QRP5MVPCFKTDQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.552054648 (98h55m42.283322299s) [noise=true , address=104.36.82.12:4168 , piece_id=4U4ZQQOMMF53XG7WW3CXN6A5YVN2Q4EQXUY6RKI2P45FBOOVSRSA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.557838805 (98h55m42.289106454s) [noise=true , address=104.36.82.9:4035 , piece_id=JI3Y6MFMMFSBL7YDA45H7RBV2FUM7SLFP4LIZ6O2BBW3KB7QFQYA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.560393523 (98h55m42.291661173s) [noise=true , address=104.36.82.62:4436 , piece_id=WSYIG725WIYG6QJ6FO3UWSG6QP6KA2IBDNM6FI6IF2QEOA5WMU3Q, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.562560110 (98h55m42.29382776s) [noise=true , address=104.36.82.61:4394 , piece_id=NZMAPLSHTI4TO3D36YMDSPUWNGSJ7GAK4AM5NXTZOMC4YU7P5RWQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.562600397 (98h55m42.293868037s) [seg_pos={0 0}, upload=103006]: Segment reached optimal threshold of 14 pieces.
Aug 12 20:22:01.562929186 (98h55m42.294196835s) [noise=true , address=104.36.82.59:4306 , piece_id=7VZX2QOV3S5U3JTBTXGHENIXO3XJKM7CXHQEGECBQTUROERNA6CQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw): protocol: expected piece hash; context canceled; EOF
Aug 12 20:22:01.562988978 (98h55m42.294256627s) [noise=true , address=79.127.205.235:4658 , piece_id=LYEUZ4WBS32YU2L43D7JTSD3NPSZKGPOZMYWFVAWAUR4GYW2XVGA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HSvQVuCNaPdj84e4ybE8YWZ77ff2gbhnjd4z9HTf1abGxz2u7): protocol: read tcp 5.161.89.252:22078->79.127.205.235:4658: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 20:22:01.563045493 (98h55m42.294313144s) [noise=true , address=64.49.13.169:4713 , piece_id=NPVCOAXQ3U2ZDNCXZMU2C356Q2WBI54L6LJHKEM7M276G34YXPIQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: read tcp 5.161.89.252:35864->64.49.13.169:4713: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 20:22:01.563079208 (98h55m42.294346858s) [noise=true , address=104.36.82.21:4506 , piece_id=EWJA4LY7K3QJWZXVITMXDYVGXTPJAIRC2CVLWPXIH46OYABIMONQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YUTchJGJE2EGXqiGZEcLjQmFQCazjV8Ahi8ogJhuqTE4H6n7T): protocol: expected piece hash; context canceled; EOF
Aug 12 20:22:01.563135343 (98h55m42.294402994s) [seg_pos={0 0}, upload=103006]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 20:22:01.563200666 (98h55m42.294468316s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 20:22:01.563205484 (98h55m42.294473135s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 20:22:02.476106688 (98h55m43.207374368s) [upload=103006]: Done uploading segments...
Aug 12 20:22:02.476119001 (98h55m43.207386621s) [upload=103006]: Upload finished. err: <nil>
Duration: 784.540687ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
166.3236ms
FAIL (2025-08-12 20:28:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 20:00:51.560567573 (98h34m32.291835212s) [upload=102629]: Starting upload Aug 12 20:00:51.560633275 (98h34m32.291900916s) [upload=102629]: Done starting upload Aug 12 20:00:51.560728936 (98h34m32.291996556s) [upload=102629]: Uploading segments... Aug 12 20:00:51.560773409 (98h34m32.29204103s) [upload=102629]: Got next segment. Inline: true Aug 12 20:00:51.560778469 (98h34m32.292046089s) [upload=102629]: Waiting for error group managing segments... Aug 12 20:00:51.560828974 (98h34m32.292096593s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 20:00:51.560833722 (98h34m32.292101343s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 20:00:51.560836829 (98h34m32.292104448s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 20:00:51.563209974 (98h34m32.294477593s) [upload=102629]: Done uploading segments... Aug 12 20:00:51.563230521 (98h34m32.294498152s) [upload=102629]: Upload finished. err: metaclient: Too Many Requests
Duration: 166.342926ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
586.748188ms
FAIL (2025-08-12 20:28:32 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 20:22:01.339537006 (98h55m42.070804636s) [upload=103006]: Starting upload
Aug 12 20:22:01.339603582 (98h55m42.070871202s) [upload=103006]: Done starting upload
Aug 12 20:22:01.339679935 (98h55m42.070947565s) [upload=103006]: Uploading segments...
Aug 12 20:22:01.339853221 (98h55m42.071120851s) [upload=103006]: Got next segment. Inline: false
Aug 12 20:22:01.339892445 (98h55m42.071160075s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 20:22:01.339896492 (98h55m42.071164122s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 20:22:01.379548451 (98h55m42.110816081s) [seg_pos={0 0}, upload=103006]: Begin upload segment...
Aug 12 20:22:01.379584901 (98h55m42.110852531s) [seg_pos={0 0}, upload=103006]: Done begin upload segment.
Aug 12 20:22:01.379611641 (98h55m42.110879271s) [noise=true , address=104.36.82.9:4035 , piece_id=JI3Y6MFMMFSBL7YDA45H7RBV2FUM7SLFP4LIZ6O2BBW3KB7QFQYA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.379628362 (98h55m42.110895992s) [noise=true , address=104.36.82.59:4306 , piece_id=7VZX2QOV3S5U3JTBTXGHENIXO3XJKM7CXHQEGECBQTUROERNA6CQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380012595 (98h55m42.111280215s) [noise=true , address=77.90.31.21:4899 , piece_id=XB3VNMD6V6LJJHATXLHW6MGXQX667NYKUTS6FJ7QRP5MVPCFKTDQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380023856 (98h55m42.111291476s) [noise=true , address=104.36.82.62:4436 , piece_id=WSYIG725WIYG6QJ6FO3UWSG6QP6KA2IBDNM6FI6IF2QEOA5WMU3Q, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380277303 (98h55m42.111544923s) [noise=true , address=104.36.82.8:4993 , piece_id=5JGUV4QMSBG5YAPTQTUOMPTGUCUGQXUKFZGFS32MPDPU3D3G7Y4Q, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380294425 (98h55m42.111562045s) [noise=true , address=104.36.82.40:4972 , piece_id=OJGZIQQ7FBYSKYJTAVGFIULWVZCBUF2HPJVC7TUMEI3HEQJTUNKQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380557831 (98h55m42.111825482s) [noise=true , address=64.49.13.169:4713 , piece_id=NPVCOAXQ3U2ZDNCXZMU2C356Q2WBI54L6LJHKEM7M276G34YXPIQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381005865 (98h55m42.112273495s) [noise=true , address=104.36.82.36:4618 , piece_id=3BXDRNPSA77ZCRWCFLYYRXAGJTL2O6HZ42GRZPQXM6RA26NJOF6A, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381223243 (98h55m42.112490873s) [noise=true , address=104.36.82.12:4168 , piece_id=4U4ZQQOMMF53XG7WW3CXN6A5YVN2Q4EQXUY6RKI2P45FBOOVSRSA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381495867 (98h55m42.112763487s) [noise=true , address=104.36.82.13:4210 , piece_id=DIQBERJ3UOM2H2FTNK6B7JA3ATUTYR4DZ3A26CMK6TVS5CIVIMXQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381860323 (98h55m42.113127953s) [noise=true , address=79.127.205.235:4658 , piece_id=LYEUZ4WBS32YU2L43D7JTSD3NPSZKGPOZMYWFVAWAUR4GYW2XVGA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382135862 (98h55m42.113403482s) [noise=true , address=104.36.82.14:4232 , piece_id=UO3P7FBYFJPBFWZFRKK6CWWMCDEB7YAPC5FPREKSQOEQ2JU6I37Q, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382450184 (98h55m42.113717804s) [noise=true , address=104.36.82.35:4582 , piece_id=DVWEOHMCH7ADDY2RXPKPOE55LOQAE636ZLJ2BRIUFTQX22BRNUKA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382711605 (98h55m42.113979225s) [noise=true , address=104.36.82.62:4420 , piece_id=JUYUQFID5GUDXGCIHMCZUWDDC3WIVR5E72XEGFZUAPFAKBEAJPSQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382963689 (98h55m42.11423131s) [noise=true , address=104.36.82.23:4445 , piece_id=VKVNYY73RMER75AMFM6DSEDLKCZAKEXJQSTMPQOOCKFAXN23OJQA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.383222817 (98h55m42.114490438s) [noise=true , address=104.36.82.61:4394 , piece_id=NZMAPLSHTI4TO3D36YMDSPUWNGSJ7GAK4AM5NXTZOMC4YU7P5RWQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.384120417 (98h55m42.115388047s) [noise=true , address=104.36.82.21:4506 , piece_id=EWJA4LY7K3QJWZXVITMXDYVGXTPJAIRC2CVLWPXIH46OYABIMONQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.384281039 (98h55m42.115548659s) [noise=true , address=104.36.82.39:4754 , piece_id=7ZBCC3Q72O4KIWFZVO2O4U6FS7UL5P67FU3EY2UMW7TFCDUYYE4A, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.503410855 (98h55m42.234678495s) [upload=103006]: Next returned nil segment
Aug 12 20:22:01.503425643 (98h55m42.234693273s) [upload=103006]: Waiting for error group managing segments...
Aug 12 20:22:01.518591716 (98h55m42.249859346s) [noise=true , address=104.36.82.39:4754 , piece_id=7ZBCC3Q72O4KIWFZVO2O4U6FS7UL5P67FU3EY2UMW7TFCDUYYE4A, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.522295799 (98h55m42.253563429s) [noise=true , address=104.36.82.14:4232 , piece_id=UO3P7FBYFJPBFWZFRKK6CWWMCDEB7YAPC5FPREKSQOEQ2JU6I37Q, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.524942810 (98h55m42.25621044s) [noise=true , address=104.36.82.8:4993 , piece_id=5JGUV4QMSBG5YAPTQTUOMPTGUCUGQXUKFZGFS32MPDPU3D3G7Y4Q, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.529281676 (98h55m42.260549297s) [noise=true , address=104.36.82.35:4582 , piece_id=DVWEOHMCH7ADDY2RXPKPOE55LOQAE636ZLJ2BRIUFTQX22BRNUKA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.529534613 (98h55m42.260802233s) [noise=true , address=104.36.82.40:4972 , piece_id=OJGZIQQ7FBYSKYJTAVGFIULWVZCBUF2HPJVC7TUMEI3HEQJTUNKQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.529663065 (98h55m42.260930685s) [noise=true , address=104.36.82.23:4445 , piece_id=VKVNYY73RMER75AMFM6DSEDLKCZAKEXJQSTMPQOOCKFAXN23OJQA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.532249323 (98h55m42.263516953s) [noise=true , address=104.36.82.62:4420 , piece_id=JUYUQFID5GUDXGCIHMCZUWDDC3WIVR5E72XEGFZUAPFAKBEAJPSQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.537316489 (98h55m42.268584109s) [noise=true , address=104.36.82.36:4618 , piece_id=3BXDRNPSA77ZCRWCFLYYRXAGJTL2O6HZ42GRZPQXM6RA26NJOF6A, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.540779567 (98h55m42.272047197s) [noise=true , address=104.36.82.13:4210 , piece_id=DIQBERJ3UOM2H2FTNK6B7JA3ATUTYR4DZ3A26CMK6TVS5CIVIMXQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.550597055 (98h55m42.281864685s) [noise=true , address=77.90.31.21:4899 , piece_id=XB3VNMD6V6LJJHATXLHW6MGXQX667NYKUTS6FJ7QRP5MVPCFKTDQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.552054648 (98h55m42.283322299s) [noise=true , address=104.36.82.12:4168 , piece_id=4U4ZQQOMMF53XG7WW3CXN6A5YVN2Q4EQXUY6RKI2P45FBOOVSRSA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.557838805 (98h55m42.289106454s) [noise=true , address=104.36.82.9:4035 , piece_id=JI3Y6MFMMFSBL7YDA45H7RBV2FUM7SLFP4LIZ6O2BBW3KB7QFQYA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.560393523 (98h55m42.291661173s) [noise=true , address=104.36.82.62:4436 , piece_id=WSYIG725WIYG6QJ6FO3UWSG6QP6KA2IBDNM6FI6IF2QEOA5WMU3Q, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.562560110 (98h55m42.29382776s) [noise=true , address=104.36.82.61:4394 , piece_id=NZMAPLSHTI4TO3D36YMDSPUWNGSJ7GAK4AM5NXTZOMC4YU7P5RWQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.562600397 (98h55m42.293868037s) [seg_pos={0 0}, upload=103006]: Segment reached optimal threshold of 14 pieces.
Aug 12 20:22:01.562929186 (98h55m42.294196835s) [noise=true , address=104.36.82.59:4306 , piece_id=7VZX2QOV3S5U3JTBTXGHENIXO3XJKM7CXHQEGECBQTUROERNA6CQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw): protocol: expected piece hash; context canceled; EOF
Aug 12 20:22:01.562988978 (98h55m42.294256627s) [noise=true , address=79.127.205.235:4658 , piece_id=LYEUZ4WBS32YU2L43D7JTSD3NPSZKGPOZMYWFVAWAUR4GYW2XVGA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HSvQVuCNaPdj84e4ybE8YWZ77ff2gbhnjd4z9HTf1abGxz2u7): protocol: read tcp 5.161.89.252:22078->79.127.205.235:4658: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 20:22:01.563045493 (98h55m42.294313144s) [noise=true , address=64.49.13.169:4713 , piece_id=NPVCOAXQ3U2ZDNCXZMU2C356Q2WBI54L6LJHKEM7M276G34YXPIQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: read tcp 5.161.89.252:35864->64.49.13.169:4713: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 20:22:01.563079208 (98h55m42.294346858s) [noise=true , address=104.36.82.21:4506 , piece_id=EWJA4LY7K3QJWZXVITMXDYVGXTPJAIRC2CVLWPXIH46OYABIMONQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YUTchJGJE2EGXqiGZEcLjQmFQCazjV8Ahi8ogJhuqTE4H6n7T): protocol: expected piece hash; context canceled; EOF
Aug 12 20:22:01.563135343 (98h55m42.294402994s) [seg_pos={0 0}, upload=103006]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 20:22:01.563200666 (98h55m42.294468316s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 20:22:01.563205484 (98h55m42.294473135s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 20:22:02.476106688 (98h55m43.207374368s) [upload=103006]: Done uploading segments...
Aug 12 20:22:02.476119001 (98h55m43.207386621s) [upload=103006]: Upload finished. err: <nil>
Duration: 586.774186ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
1.025953763s
FAIL (2025-08-12 20:27:40 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 20:22:01.339537006 (98h55m42.070804636s) [upload=103006]: Starting upload
Aug 12 20:22:01.339603582 (98h55m42.070871202s) [upload=103006]: Done starting upload
Aug 12 20:22:01.339679935 (98h55m42.070947565s) [upload=103006]: Uploading segments...
Aug 12 20:22:01.339853221 (98h55m42.071120851s) [upload=103006]: Got next segment. Inline: false
Aug 12 20:22:01.339892445 (98h55m42.071160075s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 20:22:01.339896492 (98h55m42.071164122s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 20:22:01.379548451 (98h55m42.110816081s) [seg_pos={0 0}, upload=103006]: Begin upload segment...
Aug 12 20:22:01.379584901 (98h55m42.110852531s) [seg_pos={0 0}, upload=103006]: Done begin upload segment.
Aug 12 20:22:01.379611641 (98h55m42.110879271s) [noise=true , address=104.36.82.9:4035 , piece_id=JI3Y6MFMMFSBL7YDA45H7RBV2FUM7SLFP4LIZ6O2BBW3KB7QFQYA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.379628362 (98h55m42.110895992s) [noise=true , address=104.36.82.59:4306 , piece_id=7VZX2QOV3S5U3JTBTXGHENIXO3XJKM7CXHQEGECBQTUROERNA6CQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380012595 (98h55m42.111280215s) [noise=true , address=77.90.31.21:4899 , piece_id=XB3VNMD6V6LJJHATXLHW6MGXQX667NYKUTS6FJ7QRP5MVPCFKTDQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380023856 (98h55m42.111291476s) [noise=true , address=104.36.82.62:4436 , piece_id=WSYIG725WIYG6QJ6FO3UWSG6QP6KA2IBDNM6FI6IF2QEOA5WMU3Q, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380277303 (98h55m42.111544923s) [noise=true , address=104.36.82.8:4993 , piece_id=5JGUV4QMSBG5YAPTQTUOMPTGUCUGQXUKFZGFS32MPDPU3D3G7Y4Q, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380294425 (98h55m42.111562045s) [noise=true , address=104.36.82.40:4972 , piece_id=OJGZIQQ7FBYSKYJTAVGFIULWVZCBUF2HPJVC7TUMEI3HEQJTUNKQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380557831 (98h55m42.111825482s) [noise=true , address=64.49.13.169:4713 , piece_id=NPVCOAXQ3U2ZDNCXZMU2C356Q2WBI54L6LJHKEM7M276G34YXPIQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381005865 (98h55m42.112273495s) [noise=true , address=104.36.82.36:4618 , piece_id=3BXDRNPSA77ZCRWCFLYYRXAGJTL2O6HZ42GRZPQXM6RA26NJOF6A, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381223243 (98h55m42.112490873s) [noise=true , address=104.36.82.12:4168 , piece_id=4U4ZQQOMMF53XG7WW3CXN6A5YVN2Q4EQXUY6RKI2P45FBOOVSRSA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381495867 (98h55m42.112763487s) [noise=true , address=104.36.82.13:4210 , piece_id=DIQBERJ3UOM2H2FTNK6B7JA3ATUTYR4DZ3A26CMK6TVS5CIVIMXQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381860323 (98h55m42.113127953s) [noise=true , address=79.127.205.235:4658 , piece_id=LYEUZ4WBS32YU2L43D7JTSD3NPSZKGPOZMYWFVAWAUR4GYW2XVGA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382135862 (98h55m42.113403482s) [noise=true , address=104.36.82.14:4232 , piece_id=UO3P7FBYFJPBFWZFRKK6CWWMCDEB7YAPC5FPREKSQOEQ2JU6I37Q, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382450184 (98h55m42.113717804s) [noise=true , address=104.36.82.35:4582 , piece_id=DVWEOHMCH7ADDY2RXPKPOE55LOQAE636ZLJ2BRIUFTQX22BRNUKA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382711605 (98h55m42.113979225s) [noise=true , address=104.36.82.62:4420 , piece_id=JUYUQFID5GUDXGCIHMCZUWDDC3WIVR5E72XEGFZUAPFAKBEAJPSQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382963689 (98h55m42.11423131s) [noise=true , address=104.36.82.23:4445 , piece_id=VKVNYY73RMER75AMFM6DSEDLKCZAKEXJQSTMPQOOCKFAXN23OJQA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.383222817 (98h55m42.114490438s) [noise=true , address=104.36.82.61:4394 , piece_id=NZMAPLSHTI4TO3D36YMDSPUWNGSJ7GAK4AM5NXTZOMC4YU7P5RWQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.384120417 (98h55m42.115388047s) [noise=true , address=104.36.82.21:4506 , piece_id=EWJA4LY7K3QJWZXVITMXDYVGXTPJAIRC2CVLWPXIH46OYABIMONQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.384281039 (98h55m42.115548659s) [noise=true , address=104.36.82.39:4754 , piece_id=7ZBCC3Q72O4KIWFZVO2O4U6FS7UL5P67FU3EY2UMW7TFCDUYYE4A, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.503410855 (98h55m42.234678495s) [upload=103006]: Next returned nil segment
Aug 12 20:22:01.503425643 (98h55m42.234693273s) [upload=103006]: Waiting for error group managing segments...
Aug 12 20:22:01.518591716 (98h55m42.249859346s) [noise=true , address=104.36.82.39:4754 , piece_id=7ZBCC3Q72O4KIWFZVO2O4U6FS7UL5P67FU3EY2UMW7TFCDUYYE4A, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.522295799 (98h55m42.253563429s) [noise=true , address=104.36.82.14:4232 , piece_id=UO3P7FBYFJPBFWZFRKK6CWWMCDEB7YAPC5FPREKSQOEQ2JU6I37Q, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.524942810 (98h55m42.25621044s) [noise=true , address=104.36.82.8:4993 , piece_id=5JGUV4QMSBG5YAPTQTUOMPTGUCUGQXUKFZGFS32MPDPU3D3G7Y4Q, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.529281676 (98h55m42.260549297s) [noise=true , address=104.36.82.35:4582 , piece_id=DVWEOHMCH7ADDY2RXPKPOE55LOQAE636ZLJ2BRIUFTQX22BRNUKA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.529534613 (98h55m42.260802233s) [noise=true , address=104.36.82.40:4972 , piece_id=OJGZIQQ7FBYSKYJTAVGFIULWVZCBUF2HPJVC7TUMEI3HEQJTUNKQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.529663065 (98h55m42.260930685s) [noise=true , address=104.36.82.23:4445 , piece_id=VKVNYY73RMER75AMFM6DSEDLKCZAKEXJQSTMPQOOCKFAXN23OJQA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.532249323 (98h55m42.263516953s) [noise=true , address=104.36.82.62:4420 , piece_id=JUYUQFID5GUDXGCIHMCZUWDDC3WIVR5E72XEGFZUAPFAKBEAJPSQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.537316489 (98h55m42.268584109s) [noise=true , address=104.36.82.36:4618 , piece_id=3BXDRNPSA77ZCRWCFLYYRXAGJTL2O6HZ42GRZPQXM6RA26NJOF6A, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.540779567 (98h55m42.272047197s) [noise=true , address=104.36.82.13:4210 , piece_id=DIQBERJ3UOM2H2FTNK6B7JA3ATUTYR4DZ3A26CMK6TVS5CIVIMXQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.550597055 (98h55m42.281864685s) [noise=true , address=77.90.31.21:4899 , piece_id=XB3VNMD6V6LJJHATXLHW6MGXQX667NYKUTS6FJ7QRP5MVPCFKTDQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.552054648 (98h55m42.283322299s) [noise=true , address=104.36.82.12:4168 , piece_id=4U4ZQQOMMF53XG7WW3CXN6A5YVN2Q4EQXUY6RKI2P45FBOOVSRSA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.557838805 (98h55m42.289106454s) [noise=true , address=104.36.82.9:4035 , piece_id=JI3Y6MFMMFSBL7YDA45H7RBV2FUM7SLFP4LIZ6O2BBW3KB7QFQYA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.560393523 (98h55m42.291661173s) [noise=true , address=104.36.82.62:4436 , piece_id=WSYIG725WIYG6QJ6FO3UWSG6QP6KA2IBDNM6FI6IF2QEOA5WMU3Q, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.562560110 (98h55m42.29382776s) [noise=true , address=104.36.82.61:4394 , piece_id=NZMAPLSHTI4TO3D36YMDSPUWNGSJ7GAK4AM5NXTZOMC4YU7P5RWQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.562600397 (98h55m42.293868037s) [seg_pos={0 0}, upload=103006]: Segment reached optimal threshold of 14 pieces.
Aug 12 20:22:01.562929186 (98h55m42.294196835s) [noise=true , address=104.36.82.59:4306 , piece_id=7VZX2QOV3S5U3JTBTXGHENIXO3XJKM7CXHQEGECBQTUROERNA6CQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw): protocol: expected piece hash; context canceled; EOF
Aug 12 20:22:01.562988978 (98h55m42.294256627s) [noise=true , address=79.127.205.235:4658 , piece_id=LYEUZ4WBS32YU2L43D7JTSD3NPSZKGPOZMYWFVAWAUR4GYW2XVGA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HSvQVuCNaPdj84e4ybE8YWZ77ff2gbhnjd4z9HTf1abGxz2u7): protocol: read tcp 5.161.89.252:22078->79.127.205.235:4658: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 20:22:01.563045493 (98h55m42.294313144s) [noise=true , address=64.49.13.169:4713 , piece_id=NPVCOAXQ3U2ZDNCXZMU2C356Q2WBI54L6LJHKEM7M276G34YXPIQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: read tcp 5.161.89.252:35864->64.49.13.169:4713: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 20:22:01.563079208 (98h55m42.294346858s) [noise=true , address=104.36.82.21:4506 , piece_id=EWJA4LY7K3QJWZXVITMXDYVGXTPJAIRC2CVLWPXIH46OYABIMONQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YUTchJGJE2EGXqiGZEcLjQmFQCazjV8Ahi8ogJhuqTE4H6n7T): protocol: expected piece hash; context canceled; EOF
Aug 12 20:22:01.563135343 (98h55m42.294402994s) [seg_pos={0 0}, upload=103006]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 20:22:01.563200666 (98h55m42.294468316s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 20:22:01.563205484 (98h55m42.294473135s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 20:22:02.476106688 (98h55m43.207374368s) [upload=103006]: Done uploading segments...
Aug 12 20:22:02.476119001 (98h55m43.207386621s) [upload=103006]: Upload finished. err: <nil>
Duration: 1.02598426s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
499.05049ms
FAIL (2025-08-12 20:27:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 20:00:51.560567573 (98h34m32.291835212s) [upload=102629]: Starting upload Aug 12 20:00:51.560633275 (98h34m32.291900916s) [upload=102629]: Done starting upload Aug 12 20:00:51.560728936 (98h34m32.291996556s) [upload=102629]: Uploading segments... Aug 12 20:00:51.560773409 (98h34m32.29204103s) [upload=102629]: Got next segment. Inline: true Aug 12 20:00:51.560778469 (98h34m32.292046089s) [upload=102629]: Waiting for error group managing segments... Aug 12 20:00:51.560828974 (98h34m32.292096593s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 20:00:51.560833722 (98h34m32.292101343s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 20:00:51.560836829 (98h34m32.292104448s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 20:00:51.563209974 (98h34m32.294477593s) [upload=102629]: Done uploading segments... Aug 12 20:00:51.563230521 (98h34m32.294498152s) [upload=102629]: Upload finished. err: metaclient: Too Many Requests
Duration: 499.078924ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
417.456921ms
FAIL (2025-08-12 20:26:37 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 20:22:01.339537006 (98h55m42.070804636s) [upload=103006]: Starting upload
Aug 12 20:22:01.339603582 (98h55m42.070871202s) [upload=103006]: Done starting upload
Aug 12 20:22:01.339679935 (98h55m42.070947565s) [upload=103006]: Uploading segments...
Aug 12 20:22:01.339853221 (98h55m42.071120851s) [upload=103006]: Got next segment. Inline: false
Aug 12 20:22:01.339892445 (98h55m42.071160075s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 20:22:01.339896492 (98h55m42.071164122s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 20:22:01.379548451 (98h55m42.110816081s) [seg_pos={0 0}, upload=103006]: Begin upload segment...
Aug 12 20:22:01.379584901 (98h55m42.110852531s) [seg_pos={0 0}, upload=103006]: Done begin upload segment.
Aug 12 20:22:01.379611641 (98h55m42.110879271s) [noise=true , address=104.36.82.9:4035 , piece_id=JI3Y6MFMMFSBL7YDA45H7RBV2FUM7SLFP4LIZ6O2BBW3KB7QFQYA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.379628362 (98h55m42.110895992s) [noise=true , address=104.36.82.59:4306 , piece_id=7VZX2QOV3S5U3JTBTXGHENIXO3XJKM7CXHQEGECBQTUROERNA6CQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380012595 (98h55m42.111280215s) [noise=true , address=77.90.31.21:4899 , piece_id=XB3VNMD6V6LJJHATXLHW6MGXQX667NYKUTS6FJ7QRP5MVPCFKTDQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380023856 (98h55m42.111291476s) [noise=true , address=104.36.82.62:4436 , piece_id=WSYIG725WIYG6QJ6FO3UWSG6QP6KA2IBDNM6FI6IF2QEOA5WMU3Q, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380277303 (98h55m42.111544923s) [noise=true , address=104.36.82.8:4993 , piece_id=5JGUV4QMSBG5YAPTQTUOMPTGUCUGQXUKFZGFS32MPDPU3D3G7Y4Q, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380294425 (98h55m42.111562045s) [noise=true , address=104.36.82.40:4972 , piece_id=OJGZIQQ7FBYSKYJTAVGFIULWVZCBUF2HPJVC7TUMEI3HEQJTUNKQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380557831 (98h55m42.111825482s) [noise=true , address=64.49.13.169:4713 , piece_id=NPVCOAXQ3U2ZDNCXZMU2C356Q2WBI54L6LJHKEM7M276G34YXPIQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381005865 (98h55m42.112273495s) [noise=true , address=104.36.82.36:4618 , piece_id=3BXDRNPSA77ZCRWCFLYYRXAGJTL2O6HZ42GRZPQXM6RA26NJOF6A, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381223243 (98h55m42.112490873s) [noise=true , address=104.36.82.12:4168 , piece_id=4U4ZQQOMMF53XG7WW3CXN6A5YVN2Q4EQXUY6RKI2P45FBOOVSRSA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381495867 (98h55m42.112763487s) [noise=true , address=104.36.82.13:4210 , piece_id=DIQBERJ3UOM2H2FTNK6B7JA3ATUTYR4DZ3A26CMK6TVS5CIVIMXQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381860323 (98h55m42.113127953s) [noise=true , address=79.127.205.235:4658 , piece_id=LYEUZ4WBS32YU2L43D7JTSD3NPSZKGPOZMYWFVAWAUR4GYW2XVGA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382135862 (98h55m42.113403482s) [noise=true , address=104.36.82.14:4232 , piece_id=UO3P7FBYFJPBFWZFRKK6CWWMCDEB7YAPC5FPREKSQOEQ2JU6I37Q, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382450184 (98h55m42.113717804s) [noise=true , address=104.36.82.35:4582 , piece_id=DVWEOHMCH7ADDY2RXPKPOE55LOQAE636ZLJ2BRIUFTQX22BRNUKA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382711605 (98h55m42.113979225s) [noise=true , address=104.36.82.62:4420 , piece_id=JUYUQFID5GUDXGCIHMCZUWDDC3WIVR5E72XEGFZUAPFAKBEAJPSQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382963689 (98h55m42.11423131s) [noise=true , address=104.36.82.23:4445 , piece_id=VKVNYY73RMER75AMFM6DSEDLKCZAKEXJQSTMPQOOCKFAXN23OJQA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.383222817 (98h55m42.114490438s) [noise=true , address=104.36.82.61:4394 , piece_id=NZMAPLSHTI4TO3D36YMDSPUWNGSJ7GAK4AM5NXTZOMC4YU7P5RWQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.384120417 (98h55m42.115388047s) [noise=true , address=104.36.82.21:4506 , piece_id=EWJA4LY7K3QJWZXVITMXDYVGXTPJAIRC2CVLWPXIH46OYABIMONQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.384281039 (98h55m42.115548659s) [noise=true , address=104.36.82.39:4754 , piece_id=7ZBCC3Q72O4KIWFZVO2O4U6FS7UL5P67FU3EY2UMW7TFCDUYYE4A, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.503410855 (98h55m42.234678495s) [upload=103006]: Next returned nil segment
Aug 12 20:22:01.503425643 (98h55m42.234693273s) [upload=103006]: Waiting for error group managing segments...
Aug 12 20:22:01.518591716 (98h55m42.249859346s) [noise=true , address=104.36.82.39:4754 , piece_id=7ZBCC3Q72O4KIWFZVO2O4U6FS7UL5P67FU3EY2UMW7TFCDUYYE4A, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.522295799 (98h55m42.253563429s) [noise=true , address=104.36.82.14:4232 , piece_id=UO3P7FBYFJPBFWZFRKK6CWWMCDEB7YAPC5FPREKSQOEQ2JU6I37Q, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.524942810 (98h55m42.25621044s) [noise=true , address=104.36.82.8:4993 , piece_id=5JGUV4QMSBG5YAPTQTUOMPTGUCUGQXUKFZGFS32MPDPU3D3G7Y4Q, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.529281676 (98h55m42.260549297s) [noise=true , address=104.36.82.35:4582 , piece_id=DVWEOHMCH7ADDY2RXPKPOE55LOQAE636ZLJ2BRIUFTQX22BRNUKA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.529534613 (98h55m42.260802233s) [noise=true , address=104.36.82.40:4972 , piece_id=OJGZIQQ7FBYSKYJTAVGFIULWVZCBUF2HPJVC7TUMEI3HEQJTUNKQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.529663065 (98h55m42.260930685s) [noise=true , address=104.36.82.23:4445 , piece_id=VKVNYY73RMER75AMFM6DSEDLKCZAKEXJQSTMPQOOCKFAXN23OJQA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.532249323 (98h55m42.263516953s) [noise=true , address=104.36.82.62:4420 , piece_id=JUYUQFID5GUDXGCIHMCZUWDDC3WIVR5E72XEGFZUAPFAKBEAJPSQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.537316489 (98h55m42.268584109s) [noise=true , address=104.36.82.36:4618 , piece_id=3BXDRNPSA77ZCRWCFLYYRXAGJTL2O6HZ42GRZPQXM6RA26NJOF6A, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.540779567 (98h55m42.272047197s) [noise=true , address=104.36.82.13:4210 , piece_id=DIQBERJ3UOM2H2FTNK6B7JA3ATUTYR4DZ3A26CMK6TVS5CIVIMXQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.550597055 (98h55m42.281864685s) [noise=true , address=77.90.31.21:4899 , piece_id=XB3VNMD6V6LJJHATXLHW6MGXQX667NYKUTS6FJ7QRP5MVPCFKTDQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.552054648 (98h55m42.283322299s) [noise=true , address=104.36.82.12:4168 , piece_id=4U4ZQQOMMF53XG7WW3CXN6A5YVN2Q4EQXUY6RKI2P45FBOOVSRSA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.557838805 (98h55m42.289106454s) [noise=true , address=104.36.82.9:4035 , piece_id=JI3Y6MFMMFSBL7YDA45H7RBV2FUM7SLFP4LIZ6O2BBW3KB7QFQYA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.560393523 (98h55m42.291661173s) [noise=true , address=104.36.82.62:4436 , piece_id=WSYIG725WIYG6QJ6FO3UWSG6QP6KA2IBDNM6FI6IF2QEOA5WMU3Q, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.562560110 (98h55m42.29382776s) [noise=true , address=104.36.82.61:4394 , piece_id=NZMAPLSHTI4TO3D36YMDSPUWNGSJ7GAK4AM5NXTZOMC4YU7P5RWQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.562600397 (98h55m42.293868037s) [seg_pos={0 0}, upload=103006]: Segment reached optimal threshold of 14 pieces.
Aug 12 20:22:01.562929186 (98h55m42.294196835s) [noise=true , address=104.36.82.59:4306 , piece_id=7VZX2QOV3S5U3JTBTXGHENIXO3XJKM7CXHQEGECBQTUROERNA6CQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw): protocol: expected piece hash; context canceled; EOF
Aug 12 20:22:01.562988978 (98h55m42.294256627s) [noise=true , address=79.127.205.235:4658 , piece_id=LYEUZ4WBS32YU2L43D7JTSD3NPSZKGPOZMYWFVAWAUR4GYW2XVGA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HSvQVuCNaPdj84e4ybE8YWZ77ff2gbhnjd4z9HTf1abGxz2u7): protocol: read tcp 5.161.89.252:22078->79.127.205.235:4658: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 20:22:01.563045493 (98h55m42.294313144s) [noise=true , address=64.49.13.169:4713 , piece_id=NPVCOAXQ3U2ZDNCXZMU2C356Q2WBI54L6LJHKEM7M276G34YXPIQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: read tcp 5.161.89.252:35864->64.49.13.169:4713: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 20:22:01.563079208 (98h55m42.294346858s) [noise=true , address=104.36.82.21:4506 , piece_id=EWJA4LY7K3QJWZXVITMXDYVGXTPJAIRC2CVLWPXIH46OYABIMONQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YUTchJGJE2EGXqiGZEcLjQmFQCazjV8Ahi8ogJhuqTE4H6n7T): protocol: expected piece hash; context canceled; EOF
Aug 12 20:22:01.563135343 (98h55m42.294402994s) [seg_pos={0 0}, upload=103006]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 20:22:01.563200666 (98h55m42.294468316s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 20:22:01.563205484 (98h55m42.294473135s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 20:22:02.476106688 (98h55m43.207374368s) [upload=103006]: Done uploading segments...
Aug 12 20:22:02.476119001 (98h55m43.207386621s) [upload=103006]: Upload finished. err: <nil>
Duration: 417.479294ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
166.347313ms
FAIL (2025-08-12 20:26:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 20:00:51.560567573 (98h34m32.291835212s) [upload=102629]: Starting upload Aug 12 20:00:51.560633275 (98h34m32.291900916s) [upload=102629]: Done starting upload Aug 12 20:00:51.560728936 (98h34m32.291996556s) [upload=102629]: Uploading segments... Aug 12 20:00:51.560773409 (98h34m32.29204103s) [upload=102629]: Got next segment. Inline: true Aug 12 20:00:51.560778469 (98h34m32.292046089s) [upload=102629]: Waiting for error group managing segments... Aug 12 20:00:51.560828974 (98h34m32.292096593s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 20:00:51.560833722 (98h34m32.292101343s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 20:00:51.560836829 (98h34m32.292104448s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 20:00:51.563209974 (98h34m32.294477593s) [upload=102629]: Done uploading segments... Aug 12 20:00:51.563230521 (98h34m32.294498152s) [upload=102629]: Upload finished. err: metaclient: Too Many Requests
Duration: 166.36608ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
735.068531ms
FAIL (2025-08-12 20:25:51 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 20:22:01.339537006 (98h55m42.070804636s) [upload=103006]: Starting upload
Aug 12 20:22:01.339603582 (98h55m42.070871202s) [upload=103006]: Done starting upload
Aug 12 20:22:01.339679935 (98h55m42.070947565s) [upload=103006]: Uploading segments...
Aug 12 20:22:01.339853221 (98h55m42.071120851s) [upload=103006]: Got next segment. Inline: false
Aug 12 20:22:01.339892445 (98h55m42.071160075s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 20:22:01.339896492 (98h55m42.071164122s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 20:22:01.379548451 (98h55m42.110816081s) [seg_pos={0 0}, upload=103006]: Begin upload segment...
Aug 12 20:22:01.379584901 (98h55m42.110852531s) [seg_pos={0 0}, upload=103006]: Done begin upload segment.
Aug 12 20:22:01.379611641 (98h55m42.110879271s) [noise=true , address=104.36.82.9:4035 , piece_id=JI3Y6MFMMFSBL7YDA45H7RBV2FUM7SLFP4LIZ6O2BBW3KB7QFQYA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.379628362 (98h55m42.110895992s) [noise=true , address=104.36.82.59:4306 , piece_id=7VZX2QOV3S5U3JTBTXGHENIXO3XJKM7CXHQEGECBQTUROERNA6CQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380012595 (98h55m42.111280215s) [noise=true , address=77.90.31.21:4899 , piece_id=XB3VNMD6V6LJJHATXLHW6MGXQX667NYKUTS6FJ7QRP5MVPCFKTDQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380023856 (98h55m42.111291476s) [noise=true , address=104.36.82.62:4436 , piece_id=WSYIG725WIYG6QJ6FO3UWSG6QP6KA2IBDNM6FI6IF2QEOA5WMU3Q, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380277303 (98h55m42.111544923s) [noise=true , address=104.36.82.8:4993 , piece_id=5JGUV4QMSBG5YAPTQTUOMPTGUCUGQXUKFZGFS32MPDPU3D3G7Y4Q, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380294425 (98h55m42.111562045s) [noise=true , address=104.36.82.40:4972 , piece_id=OJGZIQQ7FBYSKYJTAVGFIULWVZCBUF2HPJVC7TUMEI3HEQJTUNKQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380557831 (98h55m42.111825482s) [noise=true , address=64.49.13.169:4713 , piece_id=NPVCOAXQ3U2ZDNCXZMU2C356Q2WBI54L6LJHKEM7M276G34YXPIQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381005865 (98h55m42.112273495s) [noise=true , address=104.36.82.36:4618 , piece_id=3BXDRNPSA77ZCRWCFLYYRXAGJTL2O6HZ42GRZPQXM6RA26NJOF6A, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381223243 (98h55m42.112490873s) [noise=true , address=104.36.82.12:4168 , piece_id=4U4ZQQOMMF53XG7WW3CXN6A5YVN2Q4EQXUY6RKI2P45FBOOVSRSA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381495867 (98h55m42.112763487s) [noise=true , address=104.36.82.13:4210 , piece_id=DIQBERJ3UOM2H2FTNK6B7JA3ATUTYR4DZ3A26CMK6TVS5CIVIMXQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381860323 (98h55m42.113127953s) [noise=true , address=79.127.205.235:4658 , piece_id=LYEUZ4WBS32YU2L43D7JTSD3NPSZKGPOZMYWFVAWAUR4GYW2XVGA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382135862 (98h55m42.113403482s) [noise=true , address=104.36.82.14:4232 , piece_id=UO3P7FBYFJPBFWZFRKK6CWWMCDEB7YAPC5FPREKSQOEQ2JU6I37Q, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382450184 (98h55m42.113717804s) [noise=true , address=104.36.82.35:4582 , piece_id=DVWEOHMCH7ADDY2RXPKPOE55LOQAE636ZLJ2BRIUFTQX22BRNUKA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382711605 (98h55m42.113979225s) [noise=true , address=104.36.82.62:4420 , piece_id=JUYUQFID5GUDXGCIHMCZUWDDC3WIVR5E72XEGFZUAPFAKBEAJPSQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382963689 (98h55m42.11423131s) [noise=true , address=104.36.82.23:4445 , piece_id=VKVNYY73RMER75AMFM6DSEDLKCZAKEXJQSTMPQOOCKFAXN23OJQA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.383222817 (98h55m42.114490438s) [noise=true , address=104.36.82.61:4394 , piece_id=NZMAPLSHTI4TO3D36YMDSPUWNGSJ7GAK4AM5NXTZOMC4YU7P5RWQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.384120417 (98h55m42.115388047s) [noise=true , address=104.36.82.21:4506 , piece_id=EWJA4LY7K3QJWZXVITMXDYVGXTPJAIRC2CVLWPXIH46OYABIMONQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.384281039 (98h55m42.115548659s) [noise=true , address=104.36.82.39:4754 , piece_id=7ZBCC3Q72O4KIWFZVO2O4U6FS7UL5P67FU3EY2UMW7TFCDUYYE4A, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.503410855 (98h55m42.234678495s) [upload=103006]: Next returned nil segment
Aug 12 20:22:01.503425643 (98h55m42.234693273s) [upload=103006]: Waiting for error group managing segments...
Aug 12 20:22:01.518591716 (98h55m42.249859346s) [noise=true , address=104.36.82.39:4754 , piece_id=7ZBCC3Q72O4KIWFZVO2O4U6FS7UL5P67FU3EY2UMW7TFCDUYYE4A, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.522295799 (98h55m42.253563429s) [noise=true , address=104.36.82.14:4232 , piece_id=UO3P7FBYFJPBFWZFRKK6CWWMCDEB7YAPC5FPREKSQOEQ2JU6I37Q, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.524942810 (98h55m42.25621044s) [noise=true , address=104.36.82.8:4993 , piece_id=5JGUV4QMSBG5YAPTQTUOMPTGUCUGQXUKFZGFS32MPDPU3D3G7Y4Q, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.529281676 (98h55m42.260549297s) [noise=true , address=104.36.82.35:4582 , piece_id=DVWEOHMCH7ADDY2RXPKPOE55LOQAE636ZLJ2BRIUFTQX22BRNUKA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.529534613 (98h55m42.260802233s) [noise=true , address=104.36.82.40:4972 , piece_id=OJGZIQQ7FBYSKYJTAVGFIULWVZCBUF2HPJVC7TUMEI3HEQJTUNKQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.529663065 (98h55m42.260930685s) [noise=true , address=104.36.82.23:4445 , piece_id=VKVNYY73RMER75AMFM6DSEDLKCZAKEXJQSTMPQOOCKFAXN23OJQA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.532249323 (98h55m42.263516953s) [noise=true , address=104.36.82.62:4420 , piece_id=JUYUQFID5GUDXGCIHMCZUWDDC3WIVR5E72XEGFZUAPFAKBEAJPSQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.537316489 (98h55m42.268584109s) [noise=true , address=104.36.82.36:4618 , piece_id=3BXDRNPSA77ZCRWCFLYYRXAGJTL2O6HZ42GRZPQXM6RA26NJOF6A, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.540779567 (98h55m42.272047197s) [noise=true , address=104.36.82.13:4210 , piece_id=DIQBERJ3UOM2H2FTNK6B7JA3ATUTYR4DZ3A26CMK6TVS5CIVIMXQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.550597055 (98h55m42.281864685s) [noise=true , address=77.90.31.21:4899 , piece_id=XB3VNMD6V6LJJHATXLHW6MGXQX667NYKUTS6FJ7QRP5MVPCFKTDQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.552054648 (98h55m42.283322299s) [noise=true , address=104.36.82.12:4168 , piece_id=4U4ZQQOMMF53XG7WW3CXN6A5YVN2Q4EQXUY6RKI2P45FBOOVSRSA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.557838805 (98h55m42.289106454s) [noise=true , address=104.36.82.9:4035 , piece_id=JI3Y6MFMMFSBL7YDA45H7RBV2FUM7SLFP4LIZ6O2BBW3KB7QFQYA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.560393523 (98h55m42.291661173s) [noise=true , address=104.36.82.62:4436 , piece_id=WSYIG725WIYG6QJ6FO3UWSG6QP6KA2IBDNM6FI6IF2QEOA5WMU3Q, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.562560110 (98h55m42.29382776s) [noise=true , address=104.36.82.61:4394 , piece_id=NZMAPLSHTI4TO3D36YMDSPUWNGSJ7GAK4AM5NXTZOMC4YU7P5RWQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.562600397 (98h55m42.293868037s) [seg_pos={0 0}, upload=103006]: Segment reached optimal threshold of 14 pieces.
Aug 12 20:22:01.562929186 (98h55m42.294196835s) [noise=true , address=104.36.82.59:4306 , piece_id=7VZX2QOV3S5U3JTBTXGHENIXO3XJKM7CXHQEGECBQTUROERNA6CQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw): protocol: expected piece hash; context canceled; EOF
Aug 12 20:22:01.562988978 (98h55m42.294256627s) [noise=true , address=79.127.205.235:4658 , piece_id=LYEUZ4WBS32YU2L43D7JTSD3NPSZKGPOZMYWFVAWAUR4GYW2XVGA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HSvQVuCNaPdj84e4ybE8YWZ77ff2gbhnjd4z9HTf1abGxz2u7): protocol: read tcp 5.161.89.252:22078->79.127.205.235:4658: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 20:22:01.563045493 (98h55m42.294313144s) [noise=true , address=64.49.13.169:4713 , piece_id=NPVCOAXQ3U2ZDNCXZMU2C356Q2WBI54L6LJHKEM7M276G34YXPIQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: read tcp 5.161.89.252:35864->64.49.13.169:4713: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 20:22:01.563079208 (98h55m42.294346858s) [noise=true , address=104.36.82.21:4506 , piece_id=EWJA4LY7K3QJWZXVITMXDYVGXTPJAIRC2CVLWPXIH46OYABIMONQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YUTchJGJE2EGXqiGZEcLjQmFQCazjV8Ahi8ogJhuqTE4H6n7T): protocol: expected piece hash; context canceled; EOF
Aug 12 20:22:01.563135343 (98h55m42.294402994s) [seg_pos={0 0}, upload=103006]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 20:22:01.563200666 (98h55m42.294468316s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 20:22:01.563205484 (98h55m42.294473135s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 20:22:02.476106688 (98h55m43.207374368s) [upload=103006]: Done uploading segments...
Aug 12 20:22:02.476119001 (98h55m43.207386621s) [upload=103006]: Upload finished. err: <nil>
Duration: 735.094549ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
485.511436ms
FAIL (2025-08-12 20:25:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 20:00:51.560567573 (98h34m32.291835212s) [upload=102629]: Starting upload Aug 12 20:00:51.560633275 (98h34m32.291900916s) [upload=102629]: Done starting upload Aug 12 20:00:51.560728936 (98h34m32.291996556s) [upload=102629]: Uploading segments... Aug 12 20:00:51.560773409 (98h34m32.29204103s) [upload=102629]: Got next segment. Inline: true Aug 12 20:00:51.560778469 (98h34m32.292046089s) [upload=102629]: Waiting for error group managing segments... Aug 12 20:00:51.560828974 (98h34m32.292096593s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 20:00:51.560833722 (98h34m32.292101343s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 20:00:51.560836829 (98h34m32.292104448s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 20:00:51.563209974 (98h34m32.294477593s) [upload=102629]: Done uploading segments... Aug 12 20:00:51.563230521 (98h34m32.294498152s) [upload=102629]: Upload finished. err: metaclient: Too Many Requests
Duration: 485.544177ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
666.873019ms
FAIL (2025-08-12 20:25:19 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 20:22:01.339537006 (98h55m42.070804636s) [upload=103006]: Starting upload
Aug 12 20:22:01.339603582 (98h55m42.070871202s) [upload=103006]: Done starting upload
Aug 12 20:22:01.339679935 (98h55m42.070947565s) [upload=103006]: Uploading segments...
Aug 12 20:22:01.339853221 (98h55m42.071120851s) [upload=103006]: Got next segment. Inline: false
Aug 12 20:22:01.339892445 (98h55m42.071160075s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 20:22:01.339896492 (98h55m42.071164122s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 20:22:01.379548451 (98h55m42.110816081s) [seg_pos={0 0}, upload=103006]: Begin upload segment...
Aug 12 20:22:01.379584901 (98h55m42.110852531s) [seg_pos={0 0}, upload=103006]: Done begin upload segment.
Aug 12 20:22:01.379611641 (98h55m42.110879271s) [noise=true , address=104.36.82.9:4035 , piece_id=JI3Y6MFMMFSBL7YDA45H7RBV2FUM7SLFP4LIZ6O2BBW3KB7QFQYA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.379628362 (98h55m42.110895992s) [noise=true , address=104.36.82.59:4306 , piece_id=7VZX2QOV3S5U3JTBTXGHENIXO3XJKM7CXHQEGECBQTUROERNA6CQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380012595 (98h55m42.111280215s) [noise=true , address=77.90.31.21:4899 , piece_id=XB3VNMD6V6LJJHATXLHW6MGXQX667NYKUTS6FJ7QRP5MVPCFKTDQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380023856 (98h55m42.111291476s) [noise=true , address=104.36.82.62:4436 , piece_id=WSYIG725WIYG6QJ6FO3UWSG6QP6KA2IBDNM6FI6IF2QEOA5WMU3Q, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380277303 (98h55m42.111544923s) [noise=true , address=104.36.82.8:4993 , piece_id=5JGUV4QMSBG5YAPTQTUOMPTGUCUGQXUKFZGFS32MPDPU3D3G7Y4Q, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380294425 (98h55m42.111562045s) [noise=true , address=104.36.82.40:4972 , piece_id=OJGZIQQ7FBYSKYJTAVGFIULWVZCBUF2HPJVC7TUMEI3HEQJTUNKQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380557831 (98h55m42.111825482s) [noise=true , address=64.49.13.169:4713 , piece_id=NPVCOAXQ3U2ZDNCXZMU2C356Q2WBI54L6LJHKEM7M276G34YXPIQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381005865 (98h55m42.112273495s) [noise=true , address=104.36.82.36:4618 , piece_id=3BXDRNPSA77ZCRWCFLYYRXAGJTL2O6HZ42GRZPQXM6RA26NJOF6A, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381223243 (98h55m42.112490873s) [noise=true , address=104.36.82.12:4168 , piece_id=4U4ZQQOMMF53XG7WW3CXN6A5YVN2Q4EQXUY6RKI2P45FBOOVSRSA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381495867 (98h55m42.112763487s) [noise=true , address=104.36.82.13:4210 , piece_id=DIQBERJ3UOM2H2FTNK6B7JA3ATUTYR4DZ3A26CMK6TVS5CIVIMXQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381860323 (98h55m42.113127953s) [noise=true , address=79.127.205.235:4658 , piece_id=LYEUZ4WBS32YU2L43D7JTSD3NPSZKGPOZMYWFVAWAUR4GYW2XVGA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382135862 (98h55m42.113403482s) [noise=true , address=104.36.82.14:4232 , piece_id=UO3P7FBYFJPBFWZFRKK6CWWMCDEB7YAPC5FPREKSQOEQ2JU6I37Q, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382450184 (98h55m42.113717804s) [noise=true , address=104.36.82.35:4582 , piece_id=DVWEOHMCH7ADDY2RXPKPOE55LOQAE636ZLJ2BRIUFTQX22BRNUKA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382711605 (98h55m42.113979225s) [noise=true , address=104.36.82.62:4420 , piece_id=JUYUQFID5GUDXGCIHMCZUWDDC3WIVR5E72XEGFZUAPFAKBEAJPSQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382963689 (98h55m42.11423131s) [noise=true , address=104.36.82.23:4445 , piece_id=VKVNYY73RMER75AMFM6DSEDLKCZAKEXJQSTMPQOOCKFAXN23OJQA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.383222817 (98h55m42.114490438s) [noise=true , address=104.36.82.61:4394 , piece_id=NZMAPLSHTI4TO3D36YMDSPUWNGSJ7GAK4AM5NXTZOMC4YU7P5RWQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.384120417 (98h55m42.115388047s) [noise=true , address=104.36.82.21:4506 , piece_id=EWJA4LY7K3QJWZXVITMXDYVGXTPJAIRC2CVLWPXIH46OYABIMONQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.384281039 (98h55m42.115548659s) [noise=true , address=104.36.82.39:4754 , piece_id=7ZBCC3Q72O4KIWFZVO2O4U6FS7UL5P67FU3EY2UMW7TFCDUYYE4A, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.503410855 (98h55m42.234678495s) [upload=103006]: Next returned nil segment
Aug 12 20:22:01.503425643 (98h55m42.234693273s) [upload=103006]: Waiting for error group managing segments...
Aug 12 20:22:01.518591716 (98h55m42.249859346s) [noise=true , address=104.36.82.39:4754 , piece_id=7ZBCC3Q72O4KIWFZVO2O4U6FS7UL5P67FU3EY2UMW7TFCDUYYE4A, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.522295799 (98h55m42.253563429s) [noise=true , address=104.36.82.14:4232 , piece_id=UO3P7FBYFJPBFWZFRKK6CWWMCDEB7YAPC5FPREKSQOEQ2JU6I37Q, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.524942810 (98h55m42.25621044s) [noise=true , address=104.36.82.8:4993 , piece_id=5JGUV4QMSBG5YAPTQTUOMPTGUCUGQXUKFZGFS32MPDPU3D3G7Y4Q, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.529281676 (98h55m42.260549297s) [noise=true , address=104.36.82.35:4582 , piece_id=DVWEOHMCH7ADDY2RXPKPOE55LOQAE636ZLJ2BRIUFTQX22BRNUKA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.529534613 (98h55m42.260802233s) [noise=true , address=104.36.82.40:4972 , piece_id=OJGZIQQ7FBYSKYJTAVGFIULWVZCBUF2HPJVC7TUMEI3HEQJTUNKQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.529663065 (98h55m42.260930685s) [noise=true , address=104.36.82.23:4445 , piece_id=VKVNYY73RMER75AMFM6DSEDLKCZAKEXJQSTMPQOOCKFAXN23OJQA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.532249323 (98h55m42.263516953s) [noise=true , address=104.36.82.62:4420 , piece_id=JUYUQFID5GUDXGCIHMCZUWDDC3WIVR5E72XEGFZUAPFAKBEAJPSQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.537316489 (98h55m42.268584109s) [noise=true , address=104.36.82.36:4618 , piece_id=3BXDRNPSA77ZCRWCFLYYRXAGJTL2O6HZ42GRZPQXM6RA26NJOF6A, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.540779567 (98h55m42.272047197s) [noise=true , address=104.36.82.13:4210 , piece_id=DIQBERJ3UOM2H2FTNK6B7JA3ATUTYR4DZ3A26CMK6TVS5CIVIMXQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.550597055 (98h55m42.281864685s) [noise=true , address=77.90.31.21:4899 , piece_id=XB3VNMD6V6LJJHATXLHW6MGXQX667NYKUTS6FJ7QRP5MVPCFKTDQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.552054648 (98h55m42.283322299s) [noise=true , address=104.36.82.12:4168 , piece_id=4U4ZQQOMMF53XG7WW3CXN6A5YVN2Q4EQXUY6RKI2P45FBOOVSRSA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.557838805 (98h55m42.289106454s) [noise=true , address=104.36.82.9:4035 , piece_id=JI3Y6MFMMFSBL7YDA45H7RBV2FUM7SLFP4LIZ6O2BBW3KB7QFQYA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.560393523 (98h55m42.291661173s) [noise=true , address=104.36.82.62:4436 , piece_id=WSYIG725WIYG6QJ6FO3UWSG6QP6KA2IBDNM6FI6IF2QEOA5WMU3Q, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.562560110 (98h55m42.29382776s) [noise=true , address=104.36.82.61:4394 , piece_id=NZMAPLSHTI4TO3D36YMDSPUWNGSJ7GAK4AM5NXTZOMC4YU7P5RWQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.562600397 (98h55m42.293868037s) [seg_pos={0 0}, upload=103006]: Segment reached optimal threshold of 14 pieces.
Aug 12 20:22:01.562929186 (98h55m42.294196835s) [noise=true , address=104.36.82.59:4306 , piece_id=7VZX2QOV3S5U3JTBTXGHENIXO3XJKM7CXHQEGECBQTUROERNA6CQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw): protocol: expected piece hash; context canceled; EOF
Aug 12 20:22:01.562988978 (98h55m42.294256627s) [noise=true , address=79.127.205.235:4658 , piece_id=LYEUZ4WBS32YU2L43D7JTSD3NPSZKGPOZMYWFVAWAUR4GYW2XVGA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HSvQVuCNaPdj84e4ybE8YWZ77ff2gbhnjd4z9HTf1abGxz2u7): protocol: read tcp 5.161.89.252:22078->79.127.205.235:4658: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 20:22:01.563045493 (98h55m42.294313144s) [noise=true , address=64.49.13.169:4713 , piece_id=NPVCOAXQ3U2ZDNCXZMU2C356Q2WBI54L6LJHKEM7M276G34YXPIQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: read tcp 5.161.89.252:35864->64.49.13.169:4713: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 20:22:01.563079208 (98h55m42.294346858s) [noise=true , address=104.36.82.21:4506 , piece_id=EWJA4LY7K3QJWZXVITMXDYVGXTPJAIRC2CVLWPXIH46OYABIMONQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YUTchJGJE2EGXqiGZEcLjQmFQCazjV8Ahi8ogJhuqTE4H6n7T): protocol: expected piece hash; context canceled; EOF
Aug 12 20:22:01.563135343 (98h55m42.294402994s) [seg_pos={0 0}, upload=103006]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 20:22:01.563200666 (98h55m42.294468316s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 20:22:01.563205484 (98h55m42.294473135s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 20:22:02.476106688 (98h55m43.207374368s) [upload=103006]: Done uploading segments...
Aug 12 20:22:02.476119001 (98h55m43.207386621s) [upload=103006]: Upload finished. err: <nil>
Duration: 666.891826ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
282.037356ms
FAIL (2025-08-12 20:25:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 20:00:51.560567573 (98h34m32.291835212s) [upload=102629]: Starting upload Aug 12 20:00:51.560633275 (98h34m32.291900916s) [upload=102629]: Done starting upload Aug 12 20:00:51.560728936 (98h34m32.291996556s) [upload=102629]: Uploading segments... Aug 12 20:00:51.560773409 (98h34m32.29204103s) [upload=102629]: Got next segment. Inline: true Aug 12 20:00:51.560778469 (98h34m32.292046089s) [upload=102629]: Waiting for error group managing segments... Aug 12 20:00:51.560828974 (98h34m32.292096593s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 20:00:51.560833722 (98h34m32.292101343s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 20:00:51.560836829 (98h34m32.292104448s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 20:00:51.563209974 (98h34m32.294477593s) [upload=102629]: Done uploading segments... Aug 12 20:00:51.563230521 (98h34m32.294498152s) [upload=102629]: Upload finished. err: metaclient: Too Many Requests
Duration: 282.063746ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
1.03136798s
FAIL (2025-08-12 20:25:01 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 20:22:01.339537006 (98h55m42.070804636s) [upload=103006]: Starting upload
Aug 12 20:22:01.339603582 (98h55m42.070871202s) [upload=103006]: Done starting upload
Aug 12 20:22:01.339679935 (98h55m42.070947565s) [upload=103006]: Uploading segments...
Aug 12 20:22:01.339853221 (98h55m42.071120851s) [upload=103006]: Got next segment. Inline: false
Aug 12 20:22:01.339892445 (98h55m42.071160075s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 20:22:01.339896492 (98h55m42.071164122s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 20:22:01.379548451 (98h55m42.110816081s) [seg_pos={0 0}, upload=103006]: Begin upload segment...
Aug 12 20:22:01.379584901 (98h55m42.110852531s) [seg_pos={0 0}, upload=103006]: Done begin upload segment.
Aug 12 20:22:01.379611641 (98h55m42.110879271s) [noise=true , address=104.36.82.9:4035 , piece_id=JI3Y6MFMMFSBL7YDA45H7RBV2FUM7SLFP4LIZ6O2BBW3KB7QFQYA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.379628362 (98h55m42.110895992s) [noise=true , address=104.36.82.59:4306 , piece_id=7VZX2QOV3S5U3JTBTXGHENIXO3XJKM7CXHQEGECBQTUROERNA6CQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380012595 (98h55m42.111280215s) [noise=true , address=77.90.31.21:4899 , piece_id=XB3VNMD6V6LJJHATXLHW6MGXQX667NYKUTS6FJ7QRP5MVPCFKTDQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380023856 (98h55m42.111291476s) [noise=true , address=104.36.82.62:4436 , piece_id=WSYIG725WIYG6QJ6FO3UWSG6QP6KA2IBDNM6FI6IF2QEOA5WMU3Q, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380277303 (98h55m42.111544923s) [noise=true , address=104.36.82.8:4993 , piece_id=5JGUV4QMSBG5YAPTQTUOMPTGUCUGQXUKFZGFS32MPDPU3D3G7Y4Q, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380294425 (98h55m42.111562045s) [noise=true , address=104.36.82.40:4972 , piece_id=OJGZIQQ7FBYSKYJTAVGFIULWVZCBUF2HPJVC7TUMEI3HEQJTUNKQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380557831 (98h55m42.111825482s) [noise=true , address=64.49.13.169:4713 , piece_id=NPVCOAXQ3U2ZDNCXZMU2C356Q2WBI54L6LJHKEM7M276G34YXPIQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381005865 (98h55m42.112273495s) [noise=true , address=104.36.82.36:4618 , piece_id=3BXDRNPSA77ZCRWCFLYYRXAGJTL2O6HZ42GRZPQXM6RA26NJOF6A, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381223243 (98h55m42.112490873s) [noise=true , address=104.36.82.12:4168 , piece_id=4U4ZQQOMMF53XG7WW3CXN6A5YVN2Q4EQXUY6RKI2P45FBOOVSRSA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381495867 (98h55m42.112763487s) [noise=true , address=104.36.82.13:4210 , piece_id=DIQBERJ3UOM2H2FTNK6B7JA3ATUTYR4DZ3A26CMK6TVS5CIVIMXQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381860323 (98h55m42.113127953s) [noise=true , address=79.127.205.235:4658 , piece_id=LYEUZ4WBS32YU2L43D7JTSD3NPSZKGPOZMYWFVAWAUR4GYW2XVGA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382135862 (98h55m42.113403482s) [noise=true , address=104.36.82.14:4232 , piece_id=UO3P7FBYFJPBFWZFRKK6CWWMCDEB7YAPC5FPREKSQOEQ2JU6I37Q, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382450184 (98h55m42.113717804s) [noise=true , address=104.36.82.35:4582 , piece_id=DVWEOHMCH7ADDY2RXPKPOE55LOQAE636ZLJ2BRIUFTQX22BRNUKA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382711605 (98h55m42.113979225s) [noise=true , address=104.36.82.62:4420 , piece_id=JUYUQFID5GUDXGCIHMCZUWDDC3WIVR5E72XEGFZUAPFAKBEAJPSQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382963689 (98h55m42.11423131s) [noise=true , address=104.36.82.23:4445 , piece_id=VKVNYY73RMER75AMFM6DSEDLKCZAKEXJQSTMPQOOCKFAXN23OJQA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.383222817 (98h55m42.114490438s) [noise=true , address=104.36.82.61:4394 , piece_id=NZMAPLSHTI4TO3D36YMDSPUWNGSJ7GAK4AM5NXTZOMC4YU7P5RWQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.384120417 (98h55m42.115388047s) [noise=true , address=104.36.82.21:4506 , piece_id=EWJA4LY7K3QJWZXVITMXDYVGXTPJAIRC2CVLWPXIH46OYABIMONQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.384281039 (98h55m42.115548659s) [noise=true , address=104.36.82.39:4754 , piece_id=7ZBCC3Q72O4KIWFZVO2O4U6FS7UL5P67FU3EY2UMW7TFCDUYYE4A, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.503410855 (98h55m42.234678495s) [upload=103006]: Next returned nil segment
Aug 12 20:22:01.503425643 (98h55m42.234693273s) [upload=103006]: Waiting for error group managing segments...
Aug 12 20:22:01.518591716 (98h55m42.249859346s) [noise=true , address=104.36.82.39:4754 , piece_id=7ZBCC3Q72O4KIWFZVO2O4U6FS7UL5P67FU3EY2UMW7TFCDUYYE4A, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.522295799 (98h55m42.253563429s) [noise=true , address=104.36.82.14:4232 , piece_id=UO3P7FBYFJPBFWZFRKK6CWWMCDEB7YAPC5FPREKSQOEQ2JU6I37Q, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.524942810 (98h55m42.25621044s) [noise=true , address=104.36.82.8:4993 , piece_id=5JGUV4QMSBG5YAPTQTUOMPTGUCUGQXUKFZGFS32MPDPU3D3G7Y4Q, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.529281676 (98h55m42.260549297s) [noise=true , address=104.36.82.35:4582 , piece_id=DVWEOHMCH7ADDY2RXPKPOE55LOQAE636ZLJ2BRIUFTQX22BRNUKA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.529534613 (98h55m42.260802233s) [noise=true , address=104.36.82.40:4972 , piece_id=OJGZIQQ7FBYSKYJTAVGFIULWVZCBUF2HPJVC7TUMEI3HEQJTUNKQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.529663065 (98h55m42.260930685s) [noise=true , address=104.36.82.23:4445 , piece_id=VKVNYY73RMER75AMFM6DSEDLKCZAKEXJQSTMPQOOCKFAXN23OJQA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.532249323 (98h55m42.263516953s) [noise=true , address=104.36.82.62:4420 , piece_id=JUYUQFID5GUDXGCIHMCZUWDDC3WIVR5E72XEGFZUAPFAKBEAJPSQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.537316489 (98h55m42.268584109s) [noise=true , address=104.36.82.36:4618 , piece_id=3BXDRNPSA77ZCRWCFLYYRXAGJTL2O6HZ42GRZPQXM6RA26NJOF6A, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.540779567 (98h55m42.272047197s) [noise=true , address=104.36.82.13:4210 , piece_id=DIQBERJ3UOM2H2FTNK6B7JA3ATUTYR4DZ3A26CMK6TVS5CIVIMXQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.550597055 (98h55m42.281864685s) [noise=true , address=77.90.31.21:4899 , piece_id=XB3VNMD6V6LJJHATXLHW6MGXQX667NYKUTS6FJ7QRP5MVPCFKTDQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.552054648 (98h55m42.283322299s) [noise=true , address=104.36.82.12:4168 , piece_id=4U4ZQQOMMF53XG7WW3CXN6A5YVN2Q4EQXUY6RKI2P45FBOOVSRSA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.557838805 (98h55m42.289106454s) [noise=true , address=104.36.82.9:4035 , piece_id=JI3Y6MFMMFSBL7YDA45H7RBV2FUM7SLFP4LIZ6O2BBW3KB7QFQYA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.560393523 (98h55m42.291661173s) [noise=true , address=104.36.82.62:4436 , piece_id=WSYIG725WIYG6QJ6FO3UWSG6QP6KA2IBDNM6FI6IF2QEOA5WMU3Q, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.562560110 (98h55m42.29382776s) [noise=true , address=104.36.82.61:4394 , piece_id=NZMAPLSHTI4TO3D36YMDSPUWNGSJ7GAK4AM5NXTZOMC4YU7P5RWQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.562600397 (98h55m42.293868037s) [seg_pos={0 0}, upload=103006]: Segment reached optimal threshold of 14 pieces.
Aug 12 20:22:01.562929186 (98h55m42.294196835s) [noise=true , address=104.36.82.59:4306 , piece_id=7VZX2QOV3S5U3JTBTXGHENIXO3XJKM7CXHQEGECBQTUROERNA6CQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw): protocol: expected piece hash; context canceled; EOF
Aug 12 20:22:01.562988978 (98h55m42.294256627s) [noise=true , address=79.127.205.235:4658 , piece_id=LYEUZ4WBS32YU2L43D7JTSD3NPSZKGPOZMYWFVAWAUR4GYW2XVGA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HSvQVuCNaPdj84e4ybE8YWZ77ff2gbhnjd4z9HTf1abGxz2u7): protocol: read tcp 5.161.89.252:22078->79.127.205.235:4658: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 20:22:01.563045493 (98h55m42.294313144s) [noise=true , address=64.49.13.169:4713 , piece_id=NPVCOAXQ3U2ZDNCXZMU2C356Q2WBI54L6LJHKEM7M276G34YXPIQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: read tcp 5.161.89.252:35864->64.49.13.169:4713: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 20:22:01.563079208 (98h55m42.294346858s) [noise=true , address=104.36.82.21:4506 , piece_id=EWJA4LY7K3QJWZXVITMXDYVGXTPJAIRC2CVLWPXIH46OYABIMONQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YUTchJGJE2EGXqiGZEcLjQmFQCazjV8Ahi8ogJhuqTE4H6n7T): protocol: expected piece hash; context canceled; EOF
Aug 12 20:22:01.563135343 (98h55m42.294402994s) [seg_pos={0 0}, upload=103006]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 20:22:01.563200666 (98h55m42.294468316s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 20:22:01.563205484 (98h55m42.294473135s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 20:22:02.476106688 (98h55m43.207374368s) [upload=103006]: Done uploading segments...
Aug 12 20:22:02.476119001 (98h55m43.207386621s) [upload=103006]: Upload finished. err: <nil>
Duration: 1.031393338s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
238.406988ms
FAIL (2025-08-12 20:24:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 20:00:51.560567573 (98h34m32.291835212s) [upload=102629]: Starting upload Aug 12 20:00:51.560633275 (98h34m32.291900916s) [upload=102629]: Done starting upload Aug 12 20:00:51.560728936 (98h34m32.291996556s) [upload=102629]: Uploading segments... Aug 12 20:00:51.560773409 (98h34m32.29204103s) [upload=102629]: Got next segment. Inline: true Aug 12 20:00:51.560778469 (98h34m32.292046089s) [upload=102629]: Waiting for error group managing segments... Aug 12 20:00:51.560828974 (98h34m32.292096593s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 20:00:51.560833722 (98h34m32.292101343s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 20:00:51.560836829 (98h34m32.292104448s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 20:00:51.563209974 (98h34m32.294477593s) [upload=102629]: Done uploading segments... Aug 12 20:00:51.563230521 (98h34m32.294498152s) [upload=102629]: Upload finished. err: metaclient: Too Many Requests
Duration: 238.427566ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
436.407817ms
FAIL (2025-08-12 20:23:55 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 20:22:01.339537006 (98h55m42.070804636s) [upload=103006]: Starting upload
Aug 12 20:22:01.339603582 (98h55m42.070871202s) [upload=103006]: Done starting upload
Aug 12 20:22:01.339679935 (98h55m42.070947565s) [upload=103006]: Uploading segments...
Aug 12 20:22:01.339853221 (98h55m42.071120851s) [upload=103006]: Got next segment. Inline: false
Aug 12 20:22:01.339892445 (98h55m42.071160075s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 20:22:01.339896492 (98h55m42.071164122s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 20:22:01.379548451 (98h55m42.110816081s) [seg_pos={0 0}, upload=103006]: Begin upload segment...
Aug 12 20:22:01.379584901 (98h55m42.110852531s) [seg_pos={0 0}, upload=103006]: Done begin upload segment.
Aug 12 20:22:01.379611641 (98h55m42.110879271s) [noise=true , address=104.36.82.9:4035 , piece_id=JI3Y6MFMMFSBL7YDA45H7RBV2FUM7SLFP4LIZ6O2BBW3KB7QFQYA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.379628362 (98h55m42.110895992s) [noise=true , address=104.36.82.59:4306 , piece_id=7VZX2QOV3S5U3JTBTXGHENIXO3XJKM7CXHQEGECBQTUROERNA6CQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380012595 (98h55m42.111280215s) [noise=true , address=77.90.31.21:4899 , piece_id=XB3VNMD6V6LJJHATXLHW6MGXQX667NYKUTS6FJ7QRP5MVPCFKTDQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380023856 (98h55m42.111291476s) [noise=true , address=104.36.82.62:4436 , piece_id=WSYIG725WIYG6QJ6FO3UWSG6QP6KA2IBDNM6FI6IF2QEOA5WMU3Q, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380277303 (98h55m42.111544923s) [noise=true , address=104.36.82.8:4993 , piece_id=5JGUV4QMSBG5YAPTQTUOMPTGUCUGQXUKFZGFS32MPDPU3D3G7Y4Q, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380294425 (98h55m42.111562045s) [noise=true , address=104.36.82.40:4972 , piece_id=OJGZIQQ7FBYSKYJTAVGFIULWVZCBUF2HPJVC7TUMEI3HEQJTUNKQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380557831 (98h55m42.111825482s) [noise=true , address=64.49.13.169:4713 , piece_id=NPVCOAXQ3U2ZDNCXZMU2C356Q2WBI54L6LJHKEM7M276G34YXPIQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381005865 (98h55m42.112273495s) [noise=true , address=104.36.82.36:4618 , piece_id=3BXDRNPSA77ZCRWCFLYYRXAGJTL2O6HZ42GRZPQXM6RA26NJOF6A, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381223243 (98h55m42.112490873s) [noise=true , address=104.36.82.12:4168 , piece_id=4U4ZQQOMMF53XG7WW3CXN6A5YVN2Q4EQXUY6RKI2P45FBOOVSRSA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381495867 (98h55m42.112763487s) [noise=true , address=104.36.82.13:4210 , piece_id=DIQBERJ3UOM2H2FTNK6B7JA3ATUTYR4DZ3A26CMK6TVS5CIVIMXQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381860323 (98h55m42.113127953s) [noise=true , address=79.127.205.235:4658 , piece_id=LYEUZ4WBS32YU2L43D7JTSD3NPSZKGPOZMYWFVAWAUR4GYW2XVGA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382135862 (98h55m42.113403482s) [noise=true , address=104.36.82.14:4232 , piece_id=UO3P7FBYFJPBFWZFRKK6CWWMCDEB7YAPC5FPREKSQOEQ2JU6I37Q, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382450184 (98h55m42.113717804s) [noise=true , address=104.36.82.35:4582 , piece_id=DVWEOHMCH7ADDY2RXPKPOE55LOQAE636ZLJ2BRIUFTQX22BRNUKA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382711605 (98h55m42.113979225s) [noise=true , address=104.36.82.62:4420 , piece_id=JUYUQFID5GUDXGCIHMCZUWDDC3WIVR5E72XEGFZUAPFAKBEAJPSQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382963689 (98h55m42.11423131s) [noise=true , address=104.36.82.23:4445 , piece_id=VKVNYY73RMER75AMFM6DSEDLKCZAKEXJQSTMPQOOCKFAXN23OJQA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.383222817 (98h55m42.114490438s) [noise=true , address=104.36.82.61:4394 , piece_id=NZMAPLSHTI4TO3D36YMDSPUWNGSJ7GAK4AM5NXTZOMC4YU7P5RWQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.384120417 (98h55m42.115388047s) [noise=true , address=104.36.82.21:4506 , piece_id=EWJA4LY7K3QJWZXVITMXDYVGXTPJAIRC2CVLWPXIH46OYABIMONQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.384281039 (98h55m42.115548659s) [noise=true , address=104.36.82.39:4754 , piece_id=7ZBCC3Q72O4KIWFZVO2O4U6FS7UL5P67FU3EY2UMW7TFCDUYYE4A, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.503410855 (98h55m42.234678495s) [upload=103006]: Next returned nil segment
Aug 12 20:22:01.503425643 (98h55m42.234693273s) [upload=103006]: Waiting for error group managing segments...
Aug 12 20:22:01.518591716 (98h55m42.249859346s) [noise=true , address=104.36.82.39:4754 , piece_id=7ZBCC3Q72O4KIWFZVO2O4U6FS7UL5P67FU3EY2UMW7TFCDUYYE4A, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.522295799 (98h55m42.253563429s) [noise=true , address=104.36.82.14:4232 , piece_id=UO3P7FBYFJPBFWZFRKK6CWWMCDEB7YAPC5FPREKSQOEQ2JU6I37Q, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.524942810 (98h55m42.25621044s) [noise=true , address=104.36.82.8:4993 , piece_id=5JGUV4QMSBG5YAPTQTUOMPTGUCUGQXUKFZGFS32MPDPU3D3G7Y4Q, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.529281676 (98h55m42.260549297s) [noise=true , address=104.36.82.35:4582 , piece_id=DVWEOHMCH7ADDY2RXPKPOE55LOQAE636ZLJ2BRIUFTQX22BRNUKA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.529534613 (98h55m42.260802233s) [noise=true , address=104.36.82.40:4972 , piece_id=OJGZIQQ7FBYSKYJTAVGFIULWVZCBUF2HPJVC7TUMEI3HEQJTUNKQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.529663065 (98h55m42.260930685s) [noise=true , address=104.36.82.23:4445 , piece_id=VKVNYY73RMER75AMFM6DSEDLKCZAKEXJQSTMPQOOCKFAXN23OJQA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.532249323 (98h55m42.263516953s) [noise=true , address=104.36.82.62:4420 , piece_id=JUYUQFID5GUDXGCIHMCZUWDDC3WIVR5E72XEGFZUAPFAKBEAJPSQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.537316489 (98h55m42.268584109s) [noise=true , address=104.36.82.36:4618 , piece_id=3BXDRNPSA77ZCRWCFLYYRXAGJTL2O6HZ42GRZPQXM6RA26NJOF6A, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.540779567 (98h55m42.272047197s) [noise=true , address=104.36.82.13:4210 , piece_id=DIQBERJ3UOM2H2FTNK6B7JA3ATUTYR4DZ3A26CMK6TVS5CIVIMXQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.550597055 (98h55m42.281864685s) [noise=true , address=77.90.31.21:4899 , piece_id=XB3VNMD6V6LJJHATXLHW6MGXQX667NYKUTS6FJ7QRP5MVPCFKTDQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.552054648 (98h55m42.283322299s) [noise=true , address=104.36.82.12:4168 , piece_id=4U4ZQQOMMF53XG7WW3CXN6A5YVN2Q4EQXUY6RKI2P45FBOOVSRSA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.557838805 (98h55m42.289106454s) [noise=true , address=104.36.82.9:4035 , piece_id=JI3Y6MFMMFSBL7YDA45H7RBV2FUM7SLFP4LIZ6O2BBW3KB7QFQYA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.560393523 (98h55m42.291661173s) [noise=true , address=104.36.82.62:4436 , piece_id=WSYIG725WIYG6QJ6FO3UWSG6QP6KA2IBDNM6FI6IF2QEOA5WMU3Q, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.562560110 (98h55m42.29382776s) [noise=true , address=104.36.82.61:4394 , piece_id=NZMAPLSHTI4TO3D36YMDSPUWNGSJ7GAK4AM5NXTZOMC4YU7P5RWQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.562600397 (98h55m42.293868037s) [seg_pos={0 0}, upload=103006]: Segment reached optimal threshold of 14 pieces.
Aug 12 20:22:01.562929186 (98h55m42.294196835s) [noise=true , address=104.36.82.59:4306 , piece_id=7VZX2QOV3S5U3JTBTXGHENIXO3XJKM7CXHQEGECBQTUROERNA6CQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw): protocol: expected piece hash; context canceled; EOF
Aug 12 20:22:01.562988978 (98h55m42.294256627s) [noise=true , address=79.127.205.235:4658 , piece_id=LYEUZ4WBS32YU2L43D7JTSD3NPSZKGPOZMYWFVAWAUR4GYW2XVGA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HSvQVuCNaPdj84e4ybE8YWZ77ff2gbhnjd4z9HTf1abGxz2u7): protocol: read tcp 5.161.89.252:22078->79.127.205.235:4658: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 20:22:01.563045493 (98h55m42.294313144s) [noise=true , address=64.49.13.169:4713 , piece_id=NPVCOAXQ3U2ZDNCXZMU2C356Q2WBI54L6LJHKEM7M276G34YXPIQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: read tcp 5.161.89.252:35864->64.49.13.169:4713: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 20:22:01.563079208 (98h55m42.294346858s) [noise=true , address=104.36.82.21:4506 , piece_id=EWJA4LY7K3QJWZXVITMXDYVGXTPJAIRC2CVLWPXIH46OYABIMONQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YUTchJGJE2EGXqiGZEcLjQmFQCazjV8Ahi8ogJhuqTE4H6n7T): protocol: expected piece hash; context canceled; EOF
Aug 12 20:22:01.563135343 (98h55m42.294402994s) [seg_pos={0 0}, upload=103006]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 20:22:01.563200666 (98h55m42.294468316s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 20:22:01.563205484 (98h55m42.294473135s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 20:22:02.476106688 (98h55m43.207374368s) [upload=103006]: Done uploading segments...
Aug 12 20:22:02.476119001 (98h55m43.207386621s) [upload=103006]: Upload finished. err: <nil>
Duration: 436.434047ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
353.182087ms
FAIL (2025-08-12 20:23:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 20:00:51.560567573 (98h34m32.291835212s) [upload=102629]: Starting upload Aug 12 20:00:51.560633275 (98h34m32.291900916s) [upload=102629]: Done starting upload Aug 12 20:00:51.560728936 (98h34m32.291996556s) [upload=102629]: Uploading segments... Aug 12 20:00:51.560773409 (98h34m32.29204103s) [upload=102629]: Got next segment. Inline: true Aug 12 20:00:51.560778469 (98h34m32.292046089s) [upload=102629]: Waiting for error group managing segments... Aug 12 20:00:51.560828974 (98h34m32.292096593s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 20:00:51.560833722 (98h34m32.292101343s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 20:00:51.560836829 (98h34m32.292104448s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 20:00:51.563209974 (98h34m32.294477593s) [upload=102629]: Done uploading segments... Aug 12 20:00:51.563230521 (98h34m32.294498152s) [upload=102629]: Upload finished. err: metaclient: Too Many Requests
Duration: 353.208898ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
394.421075ms
FAIL (2025-08-12 20:23:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 20:00:51.560567573 (98h34m32.291835212s) [upload=102629]: Starting upload Aug 12 20:00:51.560633275 (98h34m32.291900916s) [upload=102629]: Done starting upload Aug 12 20:00:51.560728936 (98h34m32.291996556s) [upload=102629]: Uploading segments... Aug 12 20:00:51.560773409 (98h34m32.29204103s) [upload=102629]: Got next segment. Inline: true Aug 12 20:00:51.560778469 (98h34m32.292046089s) [upload=102629]: Waiting for error group managing segments... Aug 12 20:00:51.560828974 (98h34m32.292096593s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 20:00:51.560833722 (98h34m32.292101343s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 20:00:51.560836829 (98h34m32.292104448s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 20:00:51.563209974 (98h34m32.294477593s) [upload=102629]: Done uploading segments... Aug 12 20:00:51.563230521 (98h34m32.294498152s) [upload=102629]: Upload finished. err: metaclient: Too Many Requests
Duration: 394.437215ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
393.212768ms
FAIL (2025-08-12 20:22:48 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 20:22:01.339537006 (98h55m42.070804636s) [upload=103006]: Starting upload
Aug 12 20:22:01.339603582 (98h55m42.070871202s) [upload=103006]: Done starting upload
Aug 12 20:22:01.339679935 (98h55m42.070947565s) [upload=103006]: Uploading segments...
Aug 12 20:22:01.339853221 (98h55m42.071120851s) [upload=103006]: Got next segment. Inline: false
Aug 12 20:22:01.339892445 (98h55m42.071160075s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 20:22:01.339896492 (98h55m42.071164122s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 20:22:01.379548451 (98h55m42.110816081s) [seg_pos={0 0}, upload=103006]: Begin upload segment...
Aug 12 20:22:01.379584901 (98h55m42.110852531s) [seg_pos={0 0}, upload=103006]: Done begin upload segment.
Aug 12 20:22:01.379611641 (98h55m42.110879271s) [noise=true , address=104.36.82.9:4035 , piece_id=JI3Y6MFMMFSBL7YDA45H7RBV2FUM7SLFP4LIZ6O2BBW3KB7QFQYA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.379628362 (98h55m42.110895992s) [noise=true , address=104.36.82.59:4306 , piece_id=7VZX2QOV3S5U3JTBTXGHENIXO3XJKM7CXHQEGECBQTUROERNA6CQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380012595 (98h55m42.111280215s) [noise=true , address=77.90.31.21:4899 , piece_id=XB3VNMD6V6LJJHATXLHW6MGXQX667NYKUTS6FJ7QRP5MVPCFKTDQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380023856 (98h55m42.111291476s) [noise=true , address=104.36.82.62:4436 , piece_id=WSYIG725WIYG6QJ6FO3UWSG6QP6KA2IBDNM6FI6IF2QEOA5WMU3Q, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380277303 (98h55m42.111544923s) [noise=true , address=104.36.82.8:4993 , piece_id=5JGUV4QMSBG5YAPTQTUOMPTGUCUGQXUKFZGFS32MPDPU3D3G7Y4Q, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380294425 (98h55m42.111562045s) [noise=true , address=104.36.82.40:4972 , piece_id=OJGZIQQ7FBYSKYJTAVGFIULWVZCBUF2HPJVC7TUMEI3HEQJTUNKQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380557831 (98h55m42.111825482s) [noise=true , address=64.49.13.169:4713 , piece_id=NPVCOAXQ3U2ZDNCXZMU2C356Q2WBI54L6LJHKEM7M276G34YXPIQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381005865 (98h55m42.112273495s) [noise=true , address=104.36.82.36:4618 , piece_id=3BXDRNPSA77ZCRWCFLYYRXAGJTL2O6HZ42GRZPQXM6RA26NJOF6A, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381223243 (98h55m42.112490873s) [noise=true , address=104.36.82.12:4168 , piece_id=4U4ZQQOMMF53XG7WW3CXN6A5YVN2Q4EQXUY6RKI2P45FBOOVSRSA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381495867 (98h55m42.112763487s) [noise=true , address=104.36.82.13:4210 , piece_id=DIQBERJ3UOM2H2FTNK6B7JA3ATUTYR4DZ3A26CMK6TVS5CIVIMXQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381860323 (98h55m42.113127953s) [noise=true , address=79.127.205.235:4658 , piece_id=LYEUZ4WBS32YU2L43D7JTSD3NPSZKGPOZMYWFVAWAUR4GYW2XVGA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382135862 (98h55m42.113403482s) [noise=true , address=104.36.82.14:4232 , piece_id=UO3P7FBYFJPBFWZFRKK6CWWMCDEB7YAPC5FPREKSQOEQ2JU6I37Q, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382450184 (98h55m42.113717804s) [noise=true , address=104.36.82.35:4582 , piece_id=DVWEOHMCH7ADDY2RXPKPOE55LOQAE636ZLJ2BRIUFTQX22BRNUKA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382711605 (98h55m42.113979225s) [noise=true , address=104.36.82.62:4420 , piece_id=JUYUQFID5GUDXGCIHMCZUWDDC3WIVR5E72XEGFZUAPFAKBEAJPSQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382963689 (98h55m42.11423131s) [noise=true , address=104.36.82.23:4445 , piece_id=VKVNYY73RMER75AMFM6DSEDLKCZAKEXJQSTMPQOOCKFAXN23OJQA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.383222817 (98h55m42.114490438s) [noise=true , address=104.36.82.61:4394 , piece_id=NZMAPLSHTI4TO3D36YMDSPUWNGSJ7GAK4AM5NXTZOMC4YU7P5RWQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.384120417 (98h55m42.115388047s) [noise=true , address=104.36.82.21:4506 , piece_id=EWJA4LY7K3QJWZXVITMXDYVGXTPJAIRC2CVLWPXIH46OYABIMONQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.384281039 (98h55m42.115548659s) [noise=true , address=104.36.82.39:4754 , piece_id=7ZBCC3Q72O4KIWFZVO2O4U6FS7UL5P67FU3EY2UMW7TFCDUYYE4A, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.503410855 (98h55m42.234678495s) [upload=103006]: Next returned nil segment
Aug 12 20:22:01.503425643 (98h55m42.234693273s) [upload=103006]: Waiting for error group managing segments...
Aug 12 20:22:01.518591716 (98h55m42.249859346s) [noise=true , address=104.36.82.39:4754 , piece_id=7ZBCC3Q72O4KIWFZVO2O4U6FS7UL5P67FU3EY2UMW7TFCDUYYE4A, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.522295799 (98h55m42.253563429s) [noise=true , address=104.36.82.14:4232 , piece_id=UO3P7FBYFJPBFWZFRKK6CWWMCDEB7YAPC5FPREKSQOEQ2JU6I37Q, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.524942810 (98h55m42.25621044s) [noise=true , address=104.36.82.8:4993 , piece_id=5JGUV4QMSBG5YAPTQTUOMPTGUCUGQXUKFZGFS32MPDPU3D3G7Y4Q, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.529281676 (98h55m42.260549297s) [noise=true , address=104.36.82.35:4582 , piece_id=DVWEOHMCH7ADDY2RXPKPOE55LOQAE636ZLJ2BRIUFTQX22BRNUKA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.529534613 (98h55m42.260802233s) [noise=true , address=104.36.82.40:4972 , piece_id=OJGZIQQ7FBYSKYJTAVGFIULWVZCBUF2HPJVC7TUMEI3HEQJTUNKQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.529663065 (98h55m42.260930685s) [noise=true , address=104.36.82.23:4445 , piece_id=VKVNYY73RMER75AMFM6DSEDLKCZAKEXJQSTMPQOOCKFAXN23OJQA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.532249323 (98h55m42.263516953s) [noise=true , address=104.36.82.62:4420 , piece_id=JUYUQFID5GUDXGCIHMCZUWDDC3WIVR5E72XEGFZUAPFAKBEAJPSQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.537316489 (98h55m42.268584109s) [noise=true , address=104.36.82.36:4618 , piece_id=3BXDRNPSA77ZCRWCFLYYRXAGJTL2O6HZ42GRZPQXM6RA26NJOF6A, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.540779567 (98h55m42.272047197s) [noise=true , address=104.36.82.13:4210 , piece_id=DIQBERJ3UOM2H2FTNK6B7JA3ATUTYR4DZ3A26CMK6TVS5CIVIMXQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.550597055 (98h55m42.281864685s) [noise=true , address=77.90.31.21:4899 , piece_id=XB3VNMD6V6LJJHATXLHW6MGXQX667NYKUTS6FJ7QRP5MVPCFKTDQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.552054648 (98h55m42.283322299s) [noise=true , address=104.36.82.12:4168 , piece_id=4U4ZQQOMMF53XG7WW3CXN6A5YVN2Q4EQXUY6RKI2P45FBOOVSRSA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.557838805 (98h55m42.289106454s) [noise=true , address=104.36.82.9:4035 , piece_id=JI3Y6MFMMFSBL7YDA45H7RBV2FUM7SLFP4LIZ6O2BBW3KB7QFQYA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.560393523 (98h55m42.291661173s) [noise=true , address=104.36.82.62:4436 , piece_id=WSYIG725WIYG6QJ6FO3UWSG6QP6KA2IBDNM6FI6IF2QEOA5WMU3Q, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.562560110 (98h55m42.29382776s) [noise=true , address=104.36.82.61:4394 , piece_id=NZMAPLSHTI4TO3D36YMDSPUWNGSJ7GAK4AM5NXTZOMC4YU7P5RWQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.562600397 (98h55m42.293868037s) [seg_pos={0 0}, upload=103006]: Segment reached optimal threshold of 14 pieces.
Aug 12 20:22:01.562929186 (98h55m42.294196835s) [noise=true , address=104.36.82.59:4306 , piece_id=7VZX2QOV3S5U3JTBTXGHENIXO3XJKM7CXHQEGECBQTUROERNA6CQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw): protocol: expected piece hash; context canceled; EOF
Aug 12 20:22:01.562988978 (98h55m42.294256627s) [noise=true , address=79.127.205.235:4658 , piece_id=LYEUZ4WBS32YU2L43D7JTSD3NPSZKGPOZMYWFVAWAUR4GYW2XVGA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HSvQVuCNaPdj84e4ybE8YWZ77ff2gbhnjd4z9HTf1abGxz2u7): protocol: read tcp 5.161.89.252:22078->79.127.205.235:4658: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 20:22:01.563045493 (98h55m42.294313144s) [noise=true , address=64.49.13.169:4713 , piece_id=NPVCOAXQ3U2ZDNCXZMU2C356Q2WBI54L6LJHKEM7M276G34YXPIQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: read tcp 5.161.89.252:35864->64.49.13.169:4713: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 20:22:01.563079208 (98h55m42.294346858s) [noise=true , address=104.36.82.21:4506 , piece_id=EWJA4LY7K3QJWZXVITMXDYVGXTPJAIRC2CVLWPXIH46OYABIMONQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YUTchJGJE2EGXqiGZEcLjQmFQCazjV8Ahi8ogJhuqTE4H6n7T): protocol: expected piece hash; context canceled; EOF
Aug 12 20:22:01.563135343 (98h55m42.294402994s) [seg_pos={0 0}, upload=103006]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 20:22:01.563200666 (98h55m42.294468316s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 20:22:01.563205484 (98h55m42.294473135s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 20:22:02.476106688 (98h55m43.207374368s) [upload=103006]: Done uploading segments...
Aug 12 20:22:02.476119001 (98h55m43.207386621s) [upload=103006]: Upload finished. err: <nil>
Duration: 393.239338ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
198.108361ms
FAIL (2025-08-12 20:22:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 20:00:51.560567573 (98h34m32.291835212s) [upload=102629]: Starting upload Aug 12 20:00:51.560633275 (98h34m32.291900916s) [upload=102629]: Done starting upload Aug 12 20:00:51.560728936 (98h34m32.291996556s) [upload=102629]: Uploading segments... Aug 12 20:00:51.560773409 (98h34m32.29204103s) [upload=102629]: Got next segment. Inline: true Aug 12 20:00:51.560778469 (98h34m32.292046089s) [upload=102629]: Waiting for error group managing segments... Aug 12 20:00:51.560828974 (98h34m32.292096593s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 20:00:51.560833722 (98h34m32.292101343s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 20:00:51.560836829 (98h34m32.292104448s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 20:00:51.563209974 (98h34m32.294477593s) [upload=102629]: Done uploading segments... Aug 12 20:00:51.563230521 (98h34m32.294498152s) [upload=102629]: Upload finished. err: metaclient: Too Many Requests
Duration: 198.152966ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1.196151831s
FAIL (2025-08-12 20:22:02 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 20:22:01.339537006 (98h55m42.070804636s) [upload=103006]: Starting upload
Aug 12 20:22:01.339603582 (98h55m42.070871202s) [upload=103006]: Done starting upload
Aug 12 20:22:01.339679935 (98h55m42.070947565s) [upload=103006]: Uploading segments...
Aug 12 20:22:01.339853221 (98h55m42.071120851s) [upload=103006]: Got next segment. Inline: false
Aug 12 20:22:01.339892445 (98h55m42.071160075s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 20:22:01.339896492 (98h55m42.071164122s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 20:22:01.379548451 (98h55m42.110816081s) [seg_pos={0 0}, upload=103006]: Begin upload segment...
Aug 12 20:22:01.379584901 (98h55m42.110852531s) [seg_pos={0 0}, upload=103006]: Done begin upload segment.
Aug 12 20:22:01.379611641 (98h55m42.110879271s) [noise=true , address=104.36.82.9:4035 , piece_id=JI3Y6MFMMFSBL7YDA45H7RBV2FUM7SLFP4LIZ6O2BBW3KB7QFQYA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.379628362 (98h55m42.110895992s) [noise=true , address=104.36.82.59:4306 , piece_id=7VZX2QOV3S5U3JTBTXGHENIXO3XJKM7CXHQEGECBQTUROERNA6CQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380012595 (98h55m42.111280215s) [noise=true , address=77.90.31.21:4899 , piece_id=XB3VNMD6V6LJJHATXLHW6MGXQX667NYKUTS6FJ7QRP5MVPCFKTDQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380023856 (98h55m42.111291476s) [noise=true , address=104.36.82.62:4436 , piece_id=WSYIG725WIYG6QJ6FO3UWSG6QP6KA2IBDNM6FI6IF2QEOA5WMU3Q, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380277303 (98h55m42.111544923s) [noise=true , address=104.36.82.8:4993 , piece_id=5JGUV4QMSBG5YAPTQTUOMPTGUCUGQXUKFZGFS32MPDPU3D3G7Y4Q, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380294425 (98h55m42.111562045s) [noise=true , address=104.36.82.40:4972 , piece_id=OJGZIQQ7FBYSKYJTAVGFIULWVZCBUF2HPJVC7TUMEI3HEQJTUNKQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.380557831 (98h55m42.111825482s) [noise=true , address=64.49.13.169:4713 , piece_id=NPVCOAXQ3U2ZDNCXZMU2C356Q2WBI54L6LJHKEM7M276G34YXPIQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381005865 (98h55m42.112273495s) [noise=true , address=104.36.82.36:4618 , piece_id=3BXDRNPSA77ZCRWCFLYYRXAGJTL2O6HZ42GRZPQXM6RA26NJOF6A, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381223243 (98h55m42.112490873s) [noise=true , address=104.36.82.12:4168 , piece_id=4U4ZQQOMMF53XG7WW3CXN6A5YVN2Q4EQXUY6RKI2P45FBOOVSRSA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381495867 (98h55m42.112763487s) [noise=true , address=104.36.82.13:4210 , piece_id=DIQBERJ3UOM2H2FTNK6B7JA3ATUTYR4DZ3A26CMK6TVS5CIVIMXQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.381860323 (98h55m42.113127953s) [noise=true , address=79.127.205.235:4658 , piece_id=LYEUZ4WBS32YU2L43D7JTSD3NPSZKGPOZMYWFVAWAUR4GYW2XVGA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382135862 (98h55m42.113403482s) [noise=true , address=104.36.82.14:4232 , piece_id=UO3P7FBYFJPBFWZFRKK6CWWMCDEB7YAPC5FPREKSQOEQ2JU6I37Q, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382450184 (98h55m42.113717804s) [noise=true , address=104.36.82.35:4582 , piece_id=DVWEOHMCH7ADDY2RXPKPOE55LOQAE636ZLJ2BRIUFTQX22BRNUKA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382711605 (98h55m42.113979225s) [noise=true , address=104.36.82.62:4420 , piece_id=JUYUQFID5GUDXGCIHMCZUWDDC3WIVR5E72XEGFZUAPFAKBEAJPSQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.382963689 (98h55m42.11423131s) [noise=true , address=104.36.82.23:4445 , piece_id=VKVNYY73RMER75AMFM6DSEDLKCZAKEXJQSTMPQOOCKFAXN23OJQA, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.383222817 (98h55m42.114490438s) [noise=true , address=104.36.82.61:4394 , piece_id=NZMAPLSHTI4TO3D36YMDSPUWNGSJ7GAK4AM5NXTZOMC4YU7P5RWQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.384120417 (98h55m42.115388047s) [noise=true , address=104.36.82.21:4506 , piece_id=EWJA4LY7K3QJWZXVITMXDYVGXTPJAIRC2CVLWPXIH46OYABIMONQ, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.384281039 (98h55m42.115548659s) [noise=true , address=104.36.82.39:4754 , piece_id=7ZBCC3Q72O4KIWFZVO2O4U6FS7UL5P67FU3EY2UMW7TFCDUYYE4A, seg_pos={0 0}, upload=103006]: Uploading piece...
Aug 12 20:22:01.503410855 (98h55m42.234678495s) [upload=103006]: Next returned nil segment
Aug 12 20:22:01.503425643 (98h55m42.234693273s) [upload=103006]: Waiting for error group managing segments...
Aug 12 20:22:01.518591716 (98h55m42.249859346s) [noise=true , address=104.36.82.39:4754 , piece_id=7ZBCC3Q72O4KIWFZVO2O4U6FS7UL5P67FU3EY2UMW7TFCDUYYE4A, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.522295799 (98h55m42.253563429s) [noise=true , address=104.36.82.14:4232 , piece_id=UO3P7FBYFJPBFWZFRKK6CWWMCDEB7YAPC5FPREKSQOEQ2JU6I37Q, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.524942810 (98h55m42.25621044s) [noise=true , address=104.36.82.8:4993 , piece_id=5JGUV4QMSBG5YAPTQTUOMPTGUCUGQXUKFZGFS32MPDPU3D3G7Y4Q, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.529281676 (98h55m42.260549297s) [noise=true , address=104.36.82.35:4582 , piece_id=DVWEOHMCH7ADDY2RXPKPOE55LOQAE636ZLJ2BRIUFTQX22BRNUKA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.529534613 (98h55m42.260802233s) [noise=true , address=104.36.82.40:4972 , piece_id=OJGZIQQ7FBYSKYJTAVGFIULWVZCBUF2HPJVC7TUMEI3HEQJTUNKQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.529663065 (98h55m42.260930685s) [noise=true , address=104.36.82.23:4445 , piece_id=VKVNYY73RMER75AMFM6DSEDLKCZAKEXJQSTMPQOOCKFAXN23OJQA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.532249323 (98h55m42.263516953s) [noise=true , address=104.36.82.62:4420 , piece_id=JUYUQFID5GUDXGCIHMCZUWDDC3WIVR5E72XEGFZUAPFAKBEAJPSQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.537316489 (98h55m42.268584109s) [noise=true , address=104.36.82.36:4618 , piece_id=3BXDRNPSA77ZCRWCFLYYRXAGJTL2O6HZ42GRZPQXM6RA26NJOF6A, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.540779567 (98h55m42.272047197s) [noise=true , address=104.36.82.13:4210 , piece_id=DIQBERJ3UOM2H2FTNK6B7JA3ATUTYR4DZ3A26CMK6TVS5CIVIMXQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.550597055 (98h55m42.281864685s) [noise=true , address=77.90.31.21:4899 , piece_id=XB3VNMD6V6LJJHATXLHW6MGXQX667NYKUTS6FJ7QRP5MVPCFKTDQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.552054648 (98h55m42.283322299s) [noise=true , address=104.36.82.12:4168 , piece_id=4U4ZQQOMMF53XG7WW3CXN6A5YVN2Q4EQXUY6RKI2P45FBOOVSRSA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.557838805 (98h55m42.289106454s) [noise=true , address=104.36.82.9:4035 , piece_id=JI3Y6MFMMFSBL7YDA45H7RBV2FUM7SLFP4LIZ6O2BBW3KB7QFQYA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.560393523 (98h55m42.291661173s) [noise=true , address=104.36.82.62:4436 , piece_id=WSYIG725WIYG6QJ6FO3UWSG6QP6KA2IBDNM6FI6IF2QEOA5WMU3Q, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.562560110 (98h55m42.29382776s) [noise=true , address=104.36.82.61:4394 , piece_id=NZMAPLSHTI4TO3D36YMDSPUWNGSJ7GAK4AM5NXTZOMC4YU7P5RWQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: <nil>
Aug 12 20:22:01.562600397 (98h55m42.293868037s) [seg_pos={0 0}, upload=103006]: Segment reached optimal threshold of 14 pieces.
Aug 12 20:22:01.562929186 (98h55m42.294196835s) [noise=true , address=104.36.82.59:4306 , piece_id=7VZX2QOV3S5U3JTBTXGHENIXO3XJKM7CXHQEGECBQTUROERNA6CQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw): protocol: expected piece hash; context canceled; EOF
Aug 12 20:22:01.562988978 (98h55m42.294256627s) [noise=true , address=79.127.205.235:4658 , piece_id=LYEUZ4WBS32YU2L43D7JTSD3NPSZKGPOZMYWFVAWAUR4GYW2XVGA, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HSvQVuCNaPdj84e4ybE8YWZ77ff2gbhnjd4z9HTf1abGxz2u7): protocol: read tcp 5.161.89.252:22078->79.127.205.235:4658: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 20:22:01.563045493 (98h55m42.294313144s) [noise=true , address=64.49.13.169:4713 , piece_id=NPVCOAXQ3U2ZDNCXZMU2C356Q2WBI54L6LJHKEM7M276G34YXPIQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: read tcp 5.161.89.252:35864->64.49.13.169:4713: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 12 20:22:01.563079208 (98h55m42.294346858s) [noise=true , address=104.36.82.21:4506 , piece_id=EWJA4LY7K3QJWZXVITMXDYVGXTPJAIRC2CVLWPXIH46OYABIMONQ, seg_pos={0 0}, upload=103006]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YUTchJGJE2EGXqiGZEcLjQmFQCazjV8Ahi8ogJhuqTE4H6n7T): protocol: expected piece hash; context canceled; EOF
Aug 12 20:22:01.563135343 (98h55m42.294402994s) [seg_pos={0 0}, upload=103006]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 20:22:01.563200666 (98h55m42.294468316s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 20:22:01.563205484 (98h55m42.294473135s) [upload=103006]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 20:22:02.476106688 (98h55m43.207374368s) [upload=103006]: Done uploading segments...
Aug 12 20:22:02.476119001 (98h55m43.207386621s) [upload=103006]: Upload finished. err: <nil>
Duration: 1.196173142s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
200.584622ms
FAIL (2025-08-12 20:21:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 20:00:51.560567573 (98h34m32.291835212s) [upload=102629]: Starting upload Aug 12 20:00:51.560633275 (98h34m32.291900916s) [upload=102629]: Done starting upload Aug 12 20:00:51.560728936 (98h34m32.291996556s) [upload=102629]: Uploading segments... Aug 12 20:00:51.560773409 (98h34m32.29204103s) [upload=102629]: Got next segment. Inline: true Aug 12 20:00:51.560778469 (98h34m32.292046089s) [upload=102629]: Waiting for error group managing segments... Aug 12 20:00:51.560828974 (98h34m32.292096593s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 20:00:51.560833722 (98h34m32.292101343s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 20:00:51.560836829 (98h34m32.292104448s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 20:00:51.563209974 (98h34m32.294477593s) [upload=102629]: Done uploading segments... Aug 12 20:00:51.563230521 (98h34m32.294498152s) [upload=102629]: Upload finished. err: metaclient: Too Many Requests
Duration: 200.605441ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
215.059878ms
FAIL (2025-08-12 20:21:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 20:00:51.560567573 (98h34m32.291835212s) [upload=102629]: Starting upload Aug 12 20:00:51.560633275 (98h34m32.291900916s) [upload=102629]: Done starting upload Aug 12 20:00:51.560728936 (98h34m32.291996556s) [upload=102629]: Uploading segments... Aug 12 20:00:51.560773409 (98h34m32.29204103s) [upload=102629]: Got next segment. Inline: true Aug 12 20:00:51.560778469 (98h34m32.292046089s) [upload=102629]: Waiting for error group managing segments... Aug 12 20:00:51.560828974 (98h34m32.292096593s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 20:00:51.560833722 (98h34m32.292101343s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 20:00:51.560836829 (98h34m32.292104448s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 20:00:51.563209974 (98h34m32.294477593s) [upload=102629]: Done uploading segments... Aug 12 20:00:51.563230521 (98h34m32.294498152s) [upload=102629]: Upload finished. err: metaclient: Too Many Requests
Duration: 215.077049ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [X..................................X........................] duration:
181.936645ms
FAIL (2025-08-12 20:20:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 20:00:51.560567573 (98h34m32.291835212s) [upload=102629]: Starting upload Aug 12 20:00:51.560633275 (98h34m32.291900916s) [upload=102629]: Done starting upload Aug 12 20:00:51.560728936 (98h34m32.291996556s) [upload=102629]: Uploading segments... Aug 12 20:00:51.560773409 (98h34m32.29204103s) [upload=102629]: Got next segment. Inline: true Aug 12 20:00:51.560778469 (98h34m32.292046089s) [upload=102629]: Waiting for error group managing segments... Aug 12 20:00:51.560828974 (98h34m32.292096593s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 20:00:51.560833722 (98h34m32.292101343s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 20:00:51.560836829 (98h34m32.292104448s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 20:00:51.563209974 (98h34m32.294477593s) [upload=102629]: Done uploading segments... Aug 12 20:00:51.563230521 (98h34m32.294498152s) [upload=102629]: Upload finished. err: metaclient: Too Many Requests
Duration: 181.976508ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.X..................................X.......................] duration:
164.372568ms
FAIL (2025-08-12 20:19:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 20:00:51.560567573 (98h34m32.291835212s) [upload=102629]: Starting upload Aug 12 20:00:51.560633275 (98h34m32.291900916s) [upload=102629]: Done starting upload Aug 12 20:00:51.560728936 (98h34m32.291996556s) [upload=102629]: Uploading segments... Aug 12 20:00:51.560773409 (98h34m32.29204103s) [upload=102629]: Got next segment. Inline: true Aug 12 20:00:51.560778469 (98h34m32.292046089s) [upload=102629]: Waiting for error group managing segments... Aug 12 20:00:51.560828974 (98h34m32.292096593s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 20:00:51.560833722 (98h34m32.292101343s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 20:00:51.560836829 (98h34m32.292104448s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 20:00:51.563209974 (98h34m32.294477593s) [upload=102629]: Done uploading segments... Aug 12 20:00:51.563230521 (98h34m32.294498152s) [upload=102629]: Upload finished. err: metaclient: Too Many Requests
Duration: 164.39553ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..X..................................X......................] duration:
438.313877ms
FAIL (2025-08-12 20:19:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 20:00:51.560567573 (98h34m32.291835212s) [upload=102629]: Starting upload Aug 12 20:00:51.560633275 (98h34m32.291900916s) [upload=102629]: Done starting upload Aug 12 20:00:51.560728936 (98h34m32.291996556s) [upload=102629]: Uploading segments... Aug 12 20:00:51.560773409 (98h34m32.29204103s) [upload=102629]: Got next segment. Inline: true Aug 12 20:00:51.560778469 (98h34m32.292046089s) [upload=102629]: Waiting for error group managing segments... Aug 12 20:00:51.560828974 (98h34m32.292096593s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 20:00:51.560833722 (98h34m32.292101343s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 20:00:51.560836829 (98h34m32.292104448s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 20:00:51.563209974 (98h34m32.294477593s) [upload=102629]: Done uploading segments... Aug 12 20:00:51.563230521 (98h34m32.294498152s) [upload=102629]: Upload finished. err: metaclient: Too Many Requests
Duration: 438.338464ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...X..................................X.....................] duration:
148.773989ms
FAIL (2025-08-12 20:18:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 20:00:51.560567573 (98h34m32.291835212s) [upload=102629]: Starting upload Aug 12 20:00:51.560633275 (98h34m32.291900916s) [upload=102629]: Done starting upload Aug 12 20:00:51.560728936 (98h34m32.291996556s) [upload=102629]: Uploading segments... Aug 12 20:00:51.560773409 (98h34m32.29204103s) [upload=102629]: Got next segment. Inline: true Aug 12 20:00:51.560778469 (98h34m32.292046089s) [upload=102629]: Waiting for error group managing segments... Aug 12 20:00:51.560828974 (98h34m32.292096593s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 20:00:51.560833722 (98h34m32.292101343s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 20:00:51.560836829 (98h34m32.292104448s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 20:00:51.563209974 (98h34m32.294477593s) [upload=102629]: Done uploading segments... Aug 12 20:00:51.563230521 (98h34m32.294498152s) [upload=102629]: Upload finished. err: metaclient: Too Many Requests
Duration: 148.793125ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....X..................................X....................] duration:
186.017696ms
FAIL (2025-08-12 20:17:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 20:00:51.560567573 (98h34m32.291835212s) [upload=102629]: Starting upload Aug 12 20:00:51.560633275 (98h34m32.291900916s) [upload=102629]: Done starting upload Aug 12 20:00:51.560728936 (98h34m32.291996556s) [upload=102629]: Uploading segments... Aug 12 20:00:51.560773409 (98h34m32.29204103s) [upload=102629]: Got next segment. Inline: true Aug 12 20:00:51.560778469 (98h34m32.292046089s) [upload=102629]: Waiting for error group managing segments... Aug 12 20:00:51.560828974 (98h34m32.292096593s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 20:00:51.560833722 (98h34m32.292101343s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 20:00:51.560836829 (98h34m32.292104448s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 20:00:51.563209974 (98h34m32.294477593s) [upload=102629]: Done uploading segments... Aug 12 20:00:51.563230521 (98h34m32.294498152s) [upload=102629]: Upload finished. err: metaclient: Too Many Requests
Duration: 186.038305ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....X..................................X...................] duration:
327.616867ms
FAIL (2025-08-12 20:16:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 20:00:51.560567573 (98h34m32.291835212s) [upload=102629]: Starting upload Aug 12 20:00:51.560633275 (98h34m32.291900916s) [upload=102629]: Done starting upload Aug 12 20:00:51.560728936 (98h34m32.291996556s) [upload=102629]: Uploading segments... Aug 12 20:00:51.560773409 (98h34m32.29204103s) [upload=102629]: Got next segment. Inline: true Aug 12 20:00:51.560778469 (98h34m32.292046089s) [upload=102629]: Waiting for error group managing segments... Aug 12 20:00:51.560828974 (98h34m32.292096593s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 20:00:51.560833722 (98h34m32.292101343s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 20:00:51.560836829 (98h34m32.292104448s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 20:00:51.563209974 (98h34m32.294477593s) [upload=102629]: Done uploading segments... Aug 12 20:00:51.563230521 (98h34m32.294498152s) [upload=102629]: Upload finished. err: metaclient: Too Many Requests
Duration: 327.63988ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......X..................................X..................] duration:
387.278271ms
FAIL (2025-08-12 20:15:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 20:00:51.560567573 (98h34m32.291835212s) [upload=102629]: Starting upload Aug 12 20:00:51.560633275 (98h34m32.291900916s) [upload=102629]: Done starting upload Aug 12 20:00:51.560728936 (98h34m32.291996556s) [upload=102629]: Uploading segments... Aug 12 20:00:51.560773409 (98h34m32.29204103s) [upload=102629]: Got next segment. Inline: true Aug 12 20:00:51.560778469 (98h34m32.292046089s) [upload=102629]: Waiting for error group managing segments... Aug 12 20:00:51.560828974 (98h34m32.292096593s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 20:00:51.560833722 (98h34m32.292101343s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 20:00:51.560836829 (98h34m32.292104448s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 20:00:51.563209974 (98h34m32.294477593s) [upload=102629]: Done uploading segments... Aug 12 20:00:51.563230521 (98h34m32.294498152s) [upload=102629]: Upload finished. err: metaclient: Too Many Requests
Duration: 387.306725ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......X..................................X.................] duration:
161.872645ms
FAIL (2025-08-12 20:14:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 20:00:51.560567573 (98h34m32.291835212s) [upload=102629]: Starting upload Aug 12 20:00:51.560633275 (98h34m32.291900916s) [upload=102629]: Done starting upload Aug 12 20:00:51.560728936 (98h34m32.291996556s) [upload=102629]: Uploading segments... Aug 12 20:00:51.560773409 (98h34m32.29204103s) [upload=102629]: Got next segment. Inline: true Aug 12 20:00:51.560778469 (98h34m32.292046089s) [upload=102629]: Waiting for error group managing segments... Aug 12 20:00:51.560828974 (98h34m32.292096593s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 20:00:51.560833722 (98h34m32.292101343s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 20:00:51.560836829 (98h34m32.292104448s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 20:00:51.563209974 (98h34m32.294477593s) [upload=102629]: Done uploading segments... Aug 12 20:00:51.563230521 (98h34m32.294498152s) [upload=102629]: Upload finished. err: metaclient: Too Many Requests
Duration: 161.894668ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........X..................................X................] duration:
174.275922ms
FAIL (2025-08-12 20:13:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 20:00:51.560567573 (98h34m32.291835212s) [upload=102629]: Starting upload Aug 12 20:00:51.560633275 (98h34m32.291900916s) [upload=102629]: Done starting upload Aug 12 20:00:51.560728936 (98h34m32.291996556s) [upload=102629]: Uploading segments... Aug 12 20:00:51.560773409 (98h34m32.29204103s) [upload=102629]: Got next segment. Inline: true Aug 12 20:00:51.560778469 (98h34m32.292046089s) [upload=102629]: Waiting for error group managing segments... Aug 12 20:00:51.560828974 (98h34m32.292096593s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 20:00:51.560833722 (98h34m32.292101343s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 20:00:51.560836829 (98h34m32.292104448s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 20:00:51.563209974 (98h34m32.294477593s) [upload=102629]: Done uploading segments... Aug 12 20:00:51.563230521 (98h34m32.294498152s) [upload=102629]: Upload finished. err: metaclient: Too Many Requests
Duration: 174.299185ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........X..................................X...............] duration:
161.340293ms
FAIL (2025-08-12 20:12:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 20:00:51.560567573 (98h34m32.291835212s) [upload=102629]: Starting upload Aug 12 20:00:51.560633275 (98h34m32.291900916s) [upload=102629]: Done starting upload Aug 12 20:00:51.560728936 (98h34m32.291996556s) [upload=102629]: Uploading segments... Aug 12 20:00:51.560773409 (98h34m32.29204103s) [upload=102629]: Got next segment. Inline: true Aug 12 20:00:51.560778469 (98h34m32.292046089s) [upload=102629]: Waiting for error group managing segments... Aug 12 20:00:51.560828974 (98h34m32.292096593s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 20:00:51.560833722 (98h34m32.292101343s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 20:00:51.560836829 (98h34m32.292104448s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 20:00:51.563209974 (98h34m32.294477593s) [upload=102629]: Done uploading segments... Aug 12 20:00:51.563230521 (98h34m32.294498152s) [upload=102629]: Upload finished. err: metaclient: Too Many Requests
Duration: 161.360502ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........X..................................X..............] duration:
466.405198ms
FAIL (2025-08-12 20:12:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 20:00:51.560567573 (98h34m32.291835212s) [upload=102629]: Starting upload Aug 12 20:00:51.560633275 (98h34m32.291900916s) [upload=102629]: Done starting upload Aug 12 20:00:51.560728936 (98h34m32.291996556s) [upload=102629]: Uploading segments... Aug 12 20:00:51.560773409 (98h34m32.29204103s) [upload=102629]: Got next segment. Inline: true Aug 12 20:00:51.560778469 (98h34m32.292046089s) [upload=102629]: Waiting for error group managing segments... Aug 12 20:00:51.560828974 (98h34m32.292096593s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 20:00:51.560833722 (98h34m32.292101343s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 20:00:51.560836829 (98h34m32.292104448s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 20:00:51.563209974 (98h34m32.294477593s) [upload=102629]: Done uploading segments... Aug 12 20:00:51.563230521 (98h34m32.294498152s) [upload=102629]: Upload finished. err: metaclient: Too Many Requests
Duration: 466.434243ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........X..................................X.............] duration:
235.641505ms
FAIL (2025-08-12 20:11:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 20:00:51.560567573 (98h34m32.291835212s) [upload=102629]: Starting upload Aug 12 20:00:51.560633275 (98h34m32.291900916s) [upload=102629]: Done starting upload Aug 12 20:00:51.560728936 (98h34m32.291996556s) [upload=102629]: Uploading segments... Aug 12 20:00:51.560773409 (98h34m32.29204103s) [upload=102629]: Got next segment. Inline: true Aug 12 20:00:51.560778469 (98h34m32.292046089s) [upload=102629]: Waiting for error group managing segments... Aug 12 20:00:51.560828974 (98h34m32.292096593s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 20:00:51.560833722 (98h34m32.292101343s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 20:00:51.560836829 (98h34m32.292104448s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 20:00:51.563209974 (98h34m32.294477593s) [upload=102629]: Done uploading segments... Aug 12 20:00:51.563230521 (98h34m32.294498152s) [upload=102629]: Upload finished. err: metaclient: Too Many Requests
Duration: 235.659257ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............X..................................X............] duration:
160.788458ms
FAIL (2025-08-12 20:10:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 20:00:51.560567573 (98h34m32.291835212s) [upload=102629]: Starting upload Aug 12 20:00:51.560633275 (98h34m32.291900916s) [upload=102629]: Done starting upload Aug 12 20:00:51.560728936 (98h34m32.291996556s) [upload=102629]: Uploading segments... Aug 12 20:00:51.560773409 (98h34m32.29204103s) [upload=102629]: Got next segment. Inline: true Aug 12 20:00:51.560778469 (98h34m32.292046089s) [upload=102629]: Waiting for error group managing segments... Aug 12 20:00:51.560828974 (98h34m32.292096593s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 20:00:51.560833722 (98h34m32.292101343s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 20:00:51.560836829 (98h34m32.292104448s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 20:00:51.563209974 (98h34m32.294477593s) [upload=102629]: Done uploading segments... Aug 12 20:00:51.563230521 (98h34m32.294498152s) [upload=102629]: Upload finished. err: metaclient: Too Many Requests
Duration: 160.839273ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............X..................................X...........] duration:
141.784892ms
FAIL (2025-08-12 20:09:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 20:00:51.560567573 (98h34m32.291835212s) [upload=102629]: Starting upload Aug 12 20:00:51.560633275 (98h34m32.291900916s) [upload=102629]: Done starting upload Aug 12 20:00:51.560728936 (98h34m32.291996556s) [upload=102629]: Uploading segments... Aug 12 20:00:51.560773409 (98h34m32.29204103s) [upload=102629]: Got next segment. Inline: true Aug 12 20:00:51.560778469 (98h34m32.292046089s) [upload=102629]: Waiting for error group managing segments... Aug 12 20:00:51.560828974 (98h34m32.292096593s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 20:00:51.560833722 (98h34m32.292101343s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 20:00:51.560836829 (98h34m32.292104448s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 20:00:51.563209974 (98h34m32.294477593s) [upload=102629]: Done uploading segments... Aug 12 20:00:51.563230521 (98h34m32.294498152s) [upload=102629]: Upload finished. err: metaclient: Too Many Requests
Duration: 141.814168ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............X..................................X..........] duration:
190.983134ms
FAIL (2025-08-12 20:08:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 20:00:51.560567573 (98h34m32.291835212s) [upload=102629]: Starting upload Aug 12 20:00:51.560633275 (98h34m32.291900916s) [upload=102629]: Done starting upload Aug 12 20:00:51.560728936 (98h34m32.291996556s) [upload=102629]: Uploading segments... Aug 12 20:00:51.560773409 (98h34m32.29204103s) [upload=102629]: Got next segment. Inline: true Aug 12 20:00:51.560778469 (98h34m32.292046089s) [upload=102629]: Waiting for error group managing segments... Aug 12 20:00:51.560828974 (98h34m32.292096593s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 20:00:51.560833722 (98h34m32.292101343s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 20:00:51.560836829 (98h34m32.292104448s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 20:00:51.563209974 (98h34m32.294477593s) [upload=102629]: Done uploading segments... Aug 12 20:00:51.563230521 (98h34m32.294498152s) [upload=102629]: Upload finished. err: metaclient: Too Many Requests
Duration: 191.006447ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............X..................................X.........] duration:
425.641068ms
FAIL (2025-08-12 20:07:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 20:00:51.560567573 (98h34m32.291835212s) [upload=102629]: Starting upload Aug 12 20:00:51.560633275 (98h34m32.291900916s) [upload=102629]: Done starting upload Aug 12 20:00:51.560728936 (98h34m32.291996556s) [upload=102629]: Uploading segments... Aug 12 20:00:51.560773409 (98h34m32.29204103s) [upload=102629]: Got next segment. Inline: true Aug 12 20:00:51.560778469 (98h34m32.292046089s) [upload=102629]: Waiting for error group managing segments... Aug 12 20:00:51.560828974 (98h34m32.292096593s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 20:00:51.560833722 (98h34m32.292101343s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 20:00:51.560836829 (98h34m32.292104448s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 20:00:51.563209974 (98h34m32.294477593s) [upload=102629]: Done uploading segments... Aug 12 20:00:51.563230521 (98h34m32.294498152s) [upload=102629]: Upload finished. err: metaclient: Too Many Requests
Duration: 425.669894ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................X..................................X........] duration:
163.426097ms
FAIL (2025-08-12 20:06:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 20:00:51.560567573 (98h34m32.291835212s) [upload=102629]: Starting upload Aug 12 20:00:51.560633275 (98h34m32.291900916s) [upload=102629]: Done starting upload Aug 12 20:00:51.560728936 (98h34m32.291996556s) [upload=102629]: Uploading segments... Aug 12 20:00:51.560773409 (98h34m32.29204103s) [upload=102629]: Got next segment. Inline: true Aug 12 20:00:51.560778469 (98h34m32.292046089s) [upload=102629]: Waiting for error group managing segments... Aug 12 20:00:51.560828974 (98h34m32.292096593s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 20:00:51.560833722 (98h34m32.292101343s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 20:00:51.560836829 (98h34m32.292104448s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 20:00:51.563209974 (98h34m32.294477593s) [upload=102629]: Done uploading segments... Aug 12 20:00:51.563230521 (98h34m32.294498152s) [upload=102629]: Upload finished. err: metaclient: Too Many Requests
Duration: 163.44923ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................X..................................X.......] duration:
209.074423ms
FAIL (2025-08-12 20:05:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 20:00:51.560567573 (98h34m32.291835212s) [upload=102629]: Starting upload Aug 12 20:00:51.560633275 (98h34m32.291900916s) [upload=102629]: Done starting upload Aug 12 20:00:51.560728936 (98h34m32.291996556s) [upload=102629]: Uploading segments... Aug 12 20:00:51.560773409 (98h34m32.29204103s) [upload=102629]: Got next segment. Inline: true Aug 12 20:00:51.560778469 (98h34m32.292046089s) [upload=102629]: Waiting for error group managing segments... Aug 12 20:00:51.560828974 (98h34m32.292096593s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 20:00:51.560833722 (98h34m32.292101343s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 20:00:51.560836829 (98h34m32.292104448s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 20:00:51.563209974 (98h34m32.294477593s) [upload=102629]: Done uploading segments... Aug 12 20:00:51.563230521 (98h34m32.294498152s) [upload=102629]: Upload finished. err: metaclient: Too Many Requests
Duration: 209.098398ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................X..................................X......] duration:
145.766986ms
FAIL (2025-08-12 20:04:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 20:00:51.560567573 (98h34m32.291835212s) [upload=102629]: Starting upload Aug 12 20:00:51.560633275 (98h34m32.291900916s) [upload=102629]: Done starting upload Aug 12 20:00:51.560728936 (98h34m32.291996556s) [upload=102629]: Uploading segments... Aug 12 20:00:51.560773409 (98h34m32.29204103s) [upload=102629]: Got next segment. Inline: true Aug 12 20:00:51.560778469 (98h34m32.292046089s) [upload=102629]: Waiting for error group managing segments... Aug 12 20:00:51.560828974 (98h34m32.292096593s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 20:00:51.560833722 (98h34m32.292101343s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 20:00:51.560836829 (98h34m32.292104448s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 20:00:51.563209974 (98h34m32.294477593s) [upload=102629]: Done uploading segments... Aug 12 20:00:51.563230521 (98h34m32.294498152s) [upload=102629]: Upload finished. err: metaclient: Too Many Requests
Duration: 145.789188ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................X..................................X.....] duration:
164.021217ms
FAIL (2025-08-12 20:03:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 20:00:51.560567573 (98h34m32.291835212s) [upload=102629]: Starting upload Aug 12 20:00:51.560633275 (98h34m32.291900916s) [upload=102629]: Done starting upload Aug 12 20:00:51.560728936 (98h34m32.291996556s) [upload=102629]: Uploading segments... Aug 12 20:00:51.560773409 (98h34m32.29204103s) [upload=102629]: Got next segment. Inline: true Aug 12 20:00:51.560778469 (98h34m32.292046089s) [upload=102629]: Waiting for error group managing segments... Aug 12 20:00:51.560828974 (98h34m32.292096593s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 20:00:51.560833722 (98h34m32.292101343s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 20:00:51.560836829 (98h34m32.292104448s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 20:00:51.563209974 (98h34m32.294477593s) [upload=102629]: Done uploading segments... Aug 12 20:00:51.563230521 (98h34m32.294498152s) [upload=102629]: Upload finished. err: metaclient: Too Many Requests
Duration: 164.040514ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................X..................................X....] duration:
180.572568ms
FAIL (2025-08-12 20:03:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 20:00:51.560567573 (98h34m32.291835212s) [upload=102629]: Starting upload Aug 12 20:00:51.560633275 (98h34m32.291900916s) [upload=102629]: Done starting upload Aug 12 20:00:51.560728936 (98h34m32.291996556s) [upload=102629]: Uploading segments... Aug 12 20:00:51.560773409 (98h34m32.29204103s) [upload=102629]: Got next segment. Inline: true Aug 12 20:00:51.560778469 (98h34m32.292046089s) [upload=102629]: Waiting for error group managing segments... Aug 12 20:00:51.560828974 (98h34m32.292096593s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 20:00:51.560833722 (98h34m32.292101343s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 20:00:51.560836829 (98h34m32.292104448s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 20:00:51.563209974 (98h34m32.294477593s) [upload=102629]: Done uploading segments... Aug 12 20:00:51.563230521 (98h34m32.294498152s) [upload=102629]: Upload finished. err: metaclient: Too Many Requests
Duration: 180.59494ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................X..................................X...] duration:
467.975854ms
FAIL (2025-08-12 20:03:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 20:00:51.560567573 (98h34m32.291835212s) [upload=102629]: Starting upload Aug 12 20:00:51.560633275 (98h34m32.291900916s) [upload=102629]: Done starting upload Aug 12 20:00:51.560728936 (98h34m32.291996556s) [upload=102629]: Uploading segments... Aug 12 20:00:51.560773409 (98h34m32.29204103s) [upload=102629]: Got next segment. Inline: true Aug 12 20:00:51.560778469 (98h34m32.292046089s) [upload=102629]: Waiting for error group managing segments... Aug 12 20:00:51.560828974 (98h34m32.292096593s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 20:00:51.560833722 (98h34m32.292101343s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 20:00:51.560836829 (98h34m32.292104448s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 20:00:51.563209974 (98h34m32.294477593s) [upload=102629]: Done uploading segments... Aug 12 20:00:51.563230521 (98h34m32.294498152s) [upload=102629]: Upload finished. err: metaclient: Too Many Requests
Duration: 467.998708ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................X..................................X..] duration:
272.882187ms
FAIL (2025-08-12 20:02:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 20:00:51.560567573 (98h34m32.291835212s) [upload=102629]: Starting upload Aug 12 20:00:51.560633275 (98h34m32.291900916s) [upload=102629]: Done starting upload Aug 12 20:00:51.560728936 (98h34m32.291996556s) [upload=102629]: Uploading segments... Aug 12 20:00:51.560773409 (98h34m32.29204103s) [upload=102629]: Got next segment. Inline: true Aug 12 20:00:51.560778469 (98h34m32.292046089s) [upload=102629]: Waiting for error group managing segments... Aug 12 20:00:51.560828974 (98h34m32.292096593s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 20:00:51.560833722 (98h34m32.292101343s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 20:00:51.560836829 (98h34m32.292104448s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 20:00:51.563209974 (98h34m32.294477593s) [upload=102629]: Done uploading segments... Aug 12 20:00:51.563230521 (98h34m32.294498152s) [upload=102629]: Upload finished. err: metaclient: Too Many Requests
Duration: 272.904139ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................X..................................X.] duration:
174.417517ms
FAIL (2025-08-12 20:01:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 20:00:51.560567573 (98h34m32.291835212s) [upload=102629]: Starting upload Aug 12 20:00:51.560633275 (98h34m32.291900916s) [upload=102629]: Done starting upload Aug 12 20:00:51.560728936 (98h34m32.291996556s) [upload=102629]: Uploading segments... Aug 12 20:00:51.560773409 (98h34m32.29204103s) [upload=102629]: Got next segment. Inline: true Aug 12 20:00:51.560778469 (98h34m32.292046089s) [upload=102629]: Waiting for error group managing segments... Aug 12 20:00:51.560828974 (98h34m32.292096593s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 20:00:51.560833722 (98h34m32.292101343s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 20:00:51.560836829 (98h34m32.292104448s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 20:00:51.563209974 (98h34m32.294477593s) [upload=102629]: Done uploading segments... Aug 12 20:00:51.563230521 (98h34m32.294498152s) [upload=102629]: Upload finished. err: metaclient: Too Many Requests
Duration: 174.439428ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................X..................................X] duration:
17.057431ms
FAIL (2025-08-12 20:00:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 20:00:51.560567573 (98h34m32.291835212s) [upload=102629]: Starting upload Aug 12 20:00:51.560633275 (98h34m32.291900916s) [upload=102629]: Done starting upload Aug 12 20:00:51.560728936 (98h34m32.291996556s) [upload=102629]: Uploading segments... Aug 12 20:00:51.560773409 (98h34m32.29204103s) [upload=102629]: Got next segment. Inline: true Aug 12 20:00:51.560778469 (98h34m32.292046089s) [upload=102629]: Waiting for error group managing segments... Aug 12 20:00:51.560828974 (98h34m32.292096593s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 20:00:51.560833722 (98h34m32.292101343s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 20:00:51.560836829 (98h34m32.292104448s) [upload=102629]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 20:00:51.563209974 (98h34m32.294477593s) [upload=102629]: Done uploading segments... Aug 12 20:00:51.563230521 (98h34m32.294498152s) [upload=102629]: Upload finished. err: metaclient: Too Many Requests
Duration: 17.071918ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
154.335359ms
FAIL (2025-08-12 19:59:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 19:38:55.912315552 (98h12m36.643583172s) [upload=102249]: Starting upload Aug 12 19:38:55.912341010 (98h12m36.643608629s) [upload=102249]: Done starting upload Aug 12 19:38:55.912419056 (98h12m36.643686676s) [upload=102249]: Uploading segments... Aug 12 19:38:55.912446207 (98h12m36.643713827s) [upload=102249]: Got next segment. Inline: true Aug 12 19:38:55.912449754 (98h12m36.643717365s) [upload=102249]: Waiting for error group managing segments... Aug 12 19:38:55.912527951 (98h12m36.643795571s) [upload=102249]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 19:38:55.912531788 (98h12m36.643799409s) [upload=102249]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 19:38:55.912534603 (98h12m36.643802224s) [upload=102249]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 19:38:55.914595261 (98h12m36.6458629s) [upload=102249]: Done uploading segments... Aug 12 19:38:55.914607794 (98h12m36.645875414s) [upload=102249]: Upload finished. err: metaclient: Too Many Requests
Duration: 154.356829ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|