Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
127.091942ms
FAIL (2025-08-16 21:14:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:46:30.777765332 (195h20m11.509032962s) [upload=203272]: Starting upload Aug 16 20:46:30.777826648 (195h20m11.509094278s) [upload=203272]: Done starting upload Aug 16 20:46:30.777873375 (195h20m11.509140996s) [upload=203272]: Uploading segments... Aug 16 20:46:30.777903231 (195h20m11.509170852s) [upload=203272]: Got next segment. Inline: true Aug 16 20:46:30.777906738 (195h20m11.509174368s) [upload=203272]: Waiting for error group managing segments... Aug 16 20:46:30.777935733 (195h20m11.509203363s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:46:30.777939391 (195h20m11.509207021s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:46:30.777942236 (195h20m11.509209856s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:46:30.780551737 (195h20m11.511819357s) [upload=203272]: Done uploading segments... Aug 16 20:46:30.780558780 (195h20m11.5118264s) [upload=203272]: Upload finished. err: metaclient: Too Many Requests
Duration: 127.12311ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
967.318881ms
FAIL (2025-08-16 21:14:22 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 967.341303ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
799.538463ms
FAIL (2025-08-16 21:13:49 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 799.5629ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
205.522608ms
FAIL (2025-08-16 21:13:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:46:30.777765332 (195h20m11.509032962s) [upload=203272]: Starting upload Aug 16 20:46:30.777826648 (195h20m11.509094278s) [upload=203272]: Done starting upload Aug 16 20:46:30.777873375 (195h20m11.509140996s) [upload=203272]: Uploading segments... Aug 16 20:46:30.777903231 (195h20m11.509170852s) [upload=203272]: Got next segment. Inline: true Aug 16 20:46:30.777906738 (195h20m11.509174368s) [upload=203272]: Waiting for error group managing segments... Aug 16 20:46:30.777935733 (195h20m11.509203363s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:46:30.777939391 (195h20m11.509207021s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:46:30.777942236 (195h20m11.509209856s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:46:30.780551737 (195h20m11.511819357s) [upload=203272]: Done uploading segments... Aug 16 20:46:30.780558780 (195h20m11.5118264s) [upload=203272]: Upload finished. err: metaclient: Too Many Requests
Duration: 205.544118ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
631.549044ms
FAIL (2025-08-16 21:13:22 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 631.576215ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
696.05186ms
FAIL (2025-08-16 21:13:05 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 696.069161ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
163.51849ms
FAIL (2025-08-16 21:12:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:46:30.777765332 (195h20m11.509032962s) [upload=203272]: Starting upload Aug 16 20:46:30.777826648 (195h20m11.509094278s) [upload=203272]: Done starting upload Aug 16 20:46:30.777873375 (195h20m11.509140996s) [upload=203272]: Uploading segments... Aug 16 20:46:30.777903231 (195h20m11.509170852s) [upload=203272]: Got next segment. Inline: true Aug 16 20:46:30.777906738 (195h20m11.509174368s) [upload=203272]: Waiting for error group managing segments... Aug 16 20:46:30.777935733 (195h20m11.509203363s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:46:30.777939391 (195h20m11.509207021s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:46:30.777942236 (195h20m11.509209856s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:46:30.780551737 (195h20m11.511819357s) [upload=203272]: Done uploading segments... Aug 16 20:46:30.780558780 (195h20m11.5118264s) [upload=203272]: Upload finished. err: metaclient: Too Many Requests
Duration: 163.53961ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
727.906056ms
FAIL (2025-08-16 21:12:10 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 727.925554ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
523.150188ms
FAIL (2025-08-16 21:11:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:46:30.777765332 (195h20m11.509032962s) [upload=203272]: Starting upload Aug 16 20:46:30.777826648 (195h20m11.509094278s) [upload=203272]: Done starting upload Aug 16 20:46:30.777873375 (195h20m11.509140996s) [upload=203272]: Uploading segments... Aug 16 20:46:30.777903231 (195h20m11.509170852s) [upload=203272]: Got next segment. Inline: true Aug 16 20:46:30.777906738 (195h20m11.509174368s) [upload=203272]: Waiting for error group managing segments... Aug 16 20:46:30.777935733 (195h20m11.509203363s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:46:30.777939391 (195h20m11.509207021s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:46:30.777942236 (195h20m11.509209856s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:46:30.780551737 (195h20m11.511819357s) [upload=203272]: Done uploading segments... Aug 16 20:46:30.780558780 (195h20m11.5118264s) [upload=203272]: Upload finished. err: metaclient: Too Many Requests
Duration: 523.174364ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [X....................X......................................] duration:
684.420675ms
FAIL (2025-08-16 21:11:04 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 684.461942ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
156.483765ms
FAIL (2025-08-16 21:10:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:46:30.777765332 (195h20m11.509032962s) [upload=203272]: Starting upload Aug 16 20:46:30.777826648 (195h20m11.509094278s) [upload=203272]: Done starting upload Aug 16 20:46:30.777873375 (195h20m11.509140996s) [upload=203272]: Uploading segments... Aug 16 20:46:30.777903231 (195h20m11.509170852s) [upload=203272]: Got next segment. Inline: true Aug 16 20:46:30.777906738 (195h20m11.509174368s) [upload=203272]: Waiting for error group managing segments... Aug 16 20:46:30.777935733 (195h20m11.509203363s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:46:30.777939391 (195h20m11.509207021s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:46:30.777942236 (195h20m11.509209856s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:46:30.780551737 (195h20m11.511819357s) [upload=203272]: Done uploading segments... Aug 16 20:46:30.780558780 (195h20m11.5118264s) [upload=203272]: Upload finished. err: metaclient: Too Many Requests
Duration: 156.508391ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X....................X.....................................] duration:
727.022411ms
FAIL (2025-08-16 21:10:15 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 727.045696ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
203.607176ms
FAIL (2025-08-16 21:09:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:46:30.777765332 (195h20m11.509032962s) [upload=203272]: Starting upload Aug 16 20:46:30.777826648 (195h20m11.509094278s) [upload=203272]: Done starting upload Aug 16 20:46:30.777873375 (195h20m11.509140996s) [upload=203272]: Uploading segments... Aug 16 20:46:30.777903231 (195h20m11.509170852s) [upload=203272]: Got next segment. Inline: true Aug 16 20:46:30.777906738 (195h20m11.509174368s) [upload=203272]: Waiting for error group managing segments... Aug 16 20:46:30.777935733 (195h20m11.509203363s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:46:30.777939391 (195h20m11.509207021s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:46:30.777942236 (195h20m11.509209856s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:46:30.780551737 (195h20m11.511819357s) [upload=203272]: Done uploading segments... Aug 16 20:46:30.780558780 (195h20m11.5118264s) [upload=203272]: Upload finished. err: metaclient: Too Many Requests
Duration: 203.633475ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X....................X....................................] duration:
504.338264ms
FAIL (2025-08-16 21:09:27 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 504.365445ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
281.626528ms
FAIL (2025-08-16 21:09:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:46:30.777765332 (195h20m11.509032962s) [upload=203272]: Starting upload Aug 16 20:46:30.777826648 (195h20m11.509094278s) [upload=203272]: Done starting upload Aug 16 20:46:30.777873375 (195h20m11.509140996s) [upload=203272]: Uploading segments... Aug 16 20:46:30.777903231 (195h20m11.509170852s) [upload=203272]: Got next segment. Inline: true Aug 16 20:46:30.777906738 (195h20m11.509174368s) [upload=203272]: Waiting for error group managing segments... Aug 16 20:46:30.777935733 (195h20m11.509203363s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:46:30.777939391 (195h20m11.509207021s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:46:30.777942236 (195h20m11.509209856s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:46:30.780551737 (195h20m11.511819357s) [upload=203272]: Done uploading segments... Aug 16 20:46:30.780558780 (195h20m11.5118264s) [upload=203272]: Upload finished. err: metaclient: Too Many Requests
Duration: 281.644242ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X....................X...................................] duration:
595.853399ms
FAIL (2025-08-16 21:08:51 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 595.87989ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
303.847619ms
FAIL (2025-08-16 21:08:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:46:30.777765332 (195h20m11.509032962s) [upload=203272]: Starting upload Aug 16 20:46:30.777826648 (195h20m11.509094278s) [upload=203272]: Done starting upload Aug 16 20:46:30.777873375 (195h20m11.509140996s) [upload=203272]: Uploading segments... Aug 16 20:46:30.777903231 (195h20m11.509170852s) [upload=203272]: Got next segment. Inline: true Aug 16 20:46:30.777906738 (195h20m11.509174368s) [upload=203272]: Waiting for error group managing segments... Aug 16 20:46:30.777935733 (195h20m11.509203363s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:46:30.777939391 (195h20m11.509207021s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:46:30.777942236 (195h20m11.509209856s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:46:30.780551737 (195h20m11.511819357s) [upload=203272]: Done uploading segments... Aug 16 20:46:30.780558780 (195h20m11.5118264s) [upload=203272]: Upload finished. err: metaclient: Too Many Requests
Duration: 303.866094ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
148.534819ms
FAIL (2025-08-16 21:08:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:46:30.777765332 (195h20m11.509032962s) [upload=203272]: Starting upload Aug 16 20:46:30.777826648 (195h20m11.509094278s) [upload=203272]: Done starting upload Aug 16 20:46:30.777873375 (195h20m11.509140996s) [upload=203272]: Uploading segments... Aug 16 20:46:30.777903231 (195h20m11.509170852s) [upload=203272]: Got next segment. Inline: true Aug 16 20:46:30.777906738 (195h20m11.509174368s) [upload=203272]: Waiting for error group managing segments... Aug 16 20:46:30.777935733 (195h20m11.509203363s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:46:30.777939391 (195h20m11.509207021s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:46:30.777942236 (195h20m11.509209856s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:46:30.780551737 (195h20m11.511819357s) [upload=203272]: Done uploading segments... Aug 16 20:46:30.780558780 (195h20m11.5118264s) [upload=203272]: Upload finished. err: metaclient: Too Many Requests
Duration: 148.554096ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X....................X..................................] duration:
722.908306ms
FAIL (2025-08-16 21:07:51 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 722.934355ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
218.646444ms
FAIL (2025-08-16 21:07:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:46:30.777765332 (195h20m11.509032962s) [upload=203272]: Starting upload Aug 16 20:46:30.777826648 (195h20m11.509094278s) [upload=203272]: Done starting upload Aug 16 20:46:30.777873375 (195h20m11.509140996s) [upload=203272]: Uploading segments... Aug 16 20:46:30.777903231 (195h20m11.509170852s) [upload=203272]: Got next segment. Inline: true Aug 16 20:46:30.777906738 (195h20m11.509174368s) [upload=203272]: Waiting for error group managing segments... Aug 16 20:46:30.777935733 (195h20m11.509203363s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:46:30.777939391 (195h20m11.509207021s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:46:30.777942236 (195h20m11.509209856s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:46:30.780551737 (195h20m11.511819357s) [upload=203272]: Done uploading segments... Aug 16 20:46:30.780558780 (195h20m11.5118264s) [upload=203272]: Upload finished. err: metaclient: Too Many Requests
Duration: 218.670608ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
399.839875ms
FAIL (2025-08-16 21:07:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:46:30.777765332 (195h20m11.509032962s) [upload=203272]: Starting upload Aug 16 20:46:30.777826648 (195h20m11.509094278s) [upload=203272]: Done starting upload Aug 16 20:46:30.777873375 (195h20m11.509140996s) [upload=203272]: Uploading segments... Aug 16 20:46:30.777903231 (195h20m11.509170852s) [upload=203272]: Got next segment. Inline: true Aug 16 20:46:30.777906738 (195h20m11.509174368s) [upload=203272]: Waiting for error group managing segments... Aug 16 20:46:30.777935733 (195h20m11.509203363s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:46:30.777939391 (195h20m11.509207021s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:46:30.777942236 (195h20m11.509209856s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:46:30.780551737 (195h20m11.511819357s) [upload=203272]: Done uploading segments... Aug 16 20:46:30.780558780 (195h20m11.5118264s) [upload=203272]: Upload finished. err: metaclient: Too Many Requests
Duration: 399.864642ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X....................X.................................] duration:
737.986395ms
FAIL (2025-08-16 21:07:12 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 738.007585ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X....................X................................] duration:
794.979199ms
FAIL (2025-08-16 21:06:50 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 795.005047ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
455.096339ms
FAIL (2025-08-16 21:06:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:46:30.777765332 (195h20m11.509032962s) [upload=203272]: Starting upload Aug 16 20:46:30.777826648 (195h20m11.509094278s) [upload=203272]: Done starting upload Aug 16 20:46:30.777873375 (195h20m11.509140996s) [upload=203272]: Uploading segments... Aug 16 20:46:30.777903231 (195h20m11.509170852s) [upload=203272]: Got next segment. Inline: true Aug 16 20:46:30.777906738 (195h20m11.509174368s) [upload=203272]: Waiting for error group managing segments... Aug 16 20:46:30.777935733 (195h20m11.509203363s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:46:30.777939391 (195h20m11.509207021s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:46:30.777942236 (195h20m11.509209856s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:46:30.780551737 (195h20m11.511819357s) [upload=203272]: Done uploading segments... Aug 16 20:46:30.780558780 (195h20m11.5118264s) [upload=203272]: Upload finished. err: metaclient: Too Many Requests
Duration: 455.108172ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X....................X...............................] duration:
718.50924ms
FAIL (2025-08-16 21:05:49 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 718.534027ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
301.846324ms
FAIL (2025-08-16 21:05:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:46:30.777765332 (195h20m11.509032962s) [upload=203272]: Starting upload Aug 16 20:46:30.777826648 (195h20m11.509094278s) [upload=203272]: Done starting upload Aug 16 20:46:30.777873375 (195h20m11.509140996s) [upload=203272]: Uploading segments... Aug 16 20:46:30.777903231 (195h20m11.509170852s) [upload=203272]: Got next segment. Inline: true Aug 16 20:46:30.777906738 (195h20m11.509174368s) [upload=203272]: Waiting for error group managing segments... Aug 16 20:46:30.777935733 (195h20m11.509203363s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:46:30.777939391 (195h20m11.509207021s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:46:30.777942236 (195h20m11.509209856s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:46:30.780551737 (195h20m11.511819357s) [upload=203272]: Done uploading segments... Aug 16 20:46:30.780558780 (195h20m11.5118264s) [upload=203272]: Upload finished. err: metaclient: Too Many Requests
Duration: 301.865489ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X....................X..............................] duration:
732.728536ms
FAIL (2025-08-16 21:05:24 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 732.749937ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
302.319992ms
FAIL (2025-08-16 21:05:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:46:30.777765332 (195h20m11.509032962s) [upload=203272]: Starting upload Aug 16 20:46:30.777826648 (195h20m11.509094278s) [upload=203272]: Done starting upload Aug 16 20:46:30.777873375 (195h20m11.509140996s) [upload=203272]: Uploading segments... Aug 16 20:46:30.777903231 (195h20m11.509170852s) [upload=203272]: Got next segment. Inline: true Aug 16 20:46:30.777906738 (195h20m11.509174368s) [upload=203272]: Waiting for error group managing segments... Aug 16 20:46:30.777935733 (195h20m11.509203363s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:46:30.777939391 (195h20m11.509207021s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:46:30.777942236 (195h20m11.509209856s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:46:30.780551737 (195h20m11.511819357s) [upload=203272]: Done uploading segments... Aug 16 20:46:30.780558780 (195h20m11.5118264s) [upload=203272]: Upload finished. err: metaclient: Too Many Requests
Duration: 302.346603ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........X....................X.............................] duration:
498.874729ms
FAIL (2025-08-16 21:04:47 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 498.898243ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
168.452301ms
FAIL (2025-08-16 21:04:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:46:30.777765332 (195h20m11.509032962s) [upload=203272]: Starting upload Aug 16 20:46:30.777826648 (195h20m11.509094278s) [upload=203272]: Done starting upload Aug 16 20:46:30.777873375 (195h20m11.509140996s) [upload=203272]: Uploading segments... Aug 16 20:46:30.777903231 (195h20m11.509170852s) [upload=203272]: Got next segment. Inline: true Aug 16 20:46:30.777906738 (195h20m11.509174368s) [upload=203272]: Waiting for error group managing segments... Aug 16 20:46:30.777935733 (195h20m11.509203363s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:46:30.777939391 (195h20m11.509207021s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:46:30.777942236 (195h20m11.509209856s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:46:30.780551737 (195h20m11.511819357s) [upload=203272]: Done uploading segments... Aug 16 20:46:30.780558780 (195h20m11.5118264s) [upload=203272]: Upload finished. err: metaclient: Too Many Requests
Duration: 168.480125ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
153.280543ms
FAIL (2025-08-16 21:04:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:46:30.777765332 (195h20m11.509032962s) [upload=203272]: Starting upload Aug 16 20:46:30.777826648 (195h20m11.509094278s) [upload=203272]: Done starting upload Aug 16 20:46:30.777873375 (195h20m11.509140996s) [upload=203272]: Uploading segments... Aug 16 20:46:30.777903231 (195h20m11.509170852s) [upload=203272]: Got next segment. Inline: true Aug 16 20:46:30.777906738 (195h20m11.509174368s) [upload=203272]: Waiting for error group managing segments... Aug 16 20:46:30.777935733 (195h20m11.509203363s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:46:30.777939391 (195h20m11.509207021s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:46:30.777942236 (195h20m11.509209856s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:46:30.780551737 (195h20m11.511819357s) [upload=203272]: Done uploading segments... Aug 16 20:46:30.780558780 (195h20m11.5118264s) [upload=203272]: Upload finished. err: metaclient: Too Many Requests
Duration: 153.306153ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
174.3207ms
FAIL (2025-08-16 21:03:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:46:30.777765332 (195h20m11.509032962s) [upload=203272]: Starting upload Aug 16 20:46:30.777826648 (195h20m11.509094278s) [upload=203272]: Done starting upload Aug 16 20:46:30.777873375 (195h20m11.509140996s) [upload=203272]: Uploading segments... Aug 16 20:46:30.777903231 (195h20m11.509170852s) [upload=203272]: Got next segment. Inline: true Aug 16 20:46:30.777906738 (195h20m11.509174368s) [upload=203272]: Waiting for error group managing segments... Aug 16 20:46:30.777935733 (195h20m11.509203363s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:46:30.777939391 (195h20m11.509207021s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:46:30.777942236 (195h20m11.509209856s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:46:30.780551737 (195h20m11.511819357s) [upload=203272]: Done uploading segments... Aug 16 20:46:30.780558780 (195h20m11.5118264s) [upload=203272]: Upload finished. err: metaclient: Too Many Requests
Duration: 174.347159ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........X....................X............................] duration:
674.851377ms
FAIL (2025-08-16 21:03:36 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 674.879099ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........X....................X...........................] duration:
1.032974283s
FAIL (2025-08-16 21:03:06 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 1.033000253s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
196.298503ms
FAIL (2025-08-16 21:02:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:46:30.777765332 (195h20m11.509032962s) [upload=203272]: Starting upload Aug 16 20:46:30.777826648 (195h20m11.509094278s) [upload=203272]: Done starting upload Aug 16 20:46:30.777873375 (195h20m11.509140996s) [upload=203272]: Uploading segments... Aug 16 20:46:30.777903231 (195h20m11.509170852s) [upload=203272]: Got next segment. Inline: true Aug 16 20:46:30.777906738 (195h20m11.509174368s) [upload=203272]: Waiting for error group managing segments... Aug 16 20:46:30.777935733 (195h20m11.509203363s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:46:30.777939391 (195h20m11.509207021s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:46:30.777942236 (195h20m11.509209856s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:46:30.780551737 (195h20m11.511819357s) [upload=203272]: Done uploading segments... Aug 16 20:46:30.780558780 (195h20m11.5118264s) [upload=203272]: Upload finished. err: metaclient: Too Many Requests
Duration: 196.321236ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............X....................X..........................] duration:
937.197182ms
FAIL (2025-08-16 21:02:35 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 937.221849ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............X....................X.........................] duration:
767.275915ms
FAIL (2025-08-16 21:02:13 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 767.293097ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [X.....................................X.....................] duration:
284.61642ms
FAIL (2025-08-16 21:01:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:46:30.777765332 (195h20m11.509032962s) [upload=203272]: Starting upload Aug 16 20:46:30.777826648 (195h20m11.509094278s) [upload=203272]: Done starting upload Aug 16 20:46:30.777873375 (195h20m11.509140996s) [upload=203272]: Uploading segments... Aug 16 20:46:30.777903231 (195h20m11.509170852s) [upload=203272]: Got next segment. Inline: true Aug 16 20:46:30.777906738 (195h20m11.509174368s) [upload=203272]: Waiting for error group managing segments... Aug 16 20:46:30.777935733 (195h20m11.509203363s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:46:30.777939391 (195h20m11.509207021s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:46:30.777942236 (195h20m11.509209856s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:46:30.780551737 (195h20m11.511819357s) [upload=203272]: Done uploading segments... Aug 16 20:46:30.780558780 (195h20m11.5118264s) [upload=203272]: Upload finished. err: metaclient: Too Many Requests
Duration: 284.639755ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............X....................X........................] duration:
1.20035618s
FAIL (2025-08-16 21:01:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 1.200384462s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............X....................X.......................] duration:
693.218892ms
FAIL (2025-08-16 21:01:12 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 693.238729ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.X.....................................X....................] duration:
162.868633ms
FAIL (2025-08-16 21:00:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:46:30.777765332 (195h20m11.509032962s) [upload=203272]: Starting upload Aug 16 20:46:30.777826648 (195h20m11.509094278s) [upload=203272]: Done starting upload Aug 16 20:46:30.777873375 (195h20m11.509140996s) [upload=203272]: Uploading segments... Aug 16 20:46:30.777903231 (195h20m11.509170852s) [upload=203272]: Got next segment. Inline: true Aug 16 20:46:30.777906738 (195h20m11.509174368s) [upload=203272]: Waiting for error group managing segments... Aug 16 20:46:30.777935733 (195h20m11.509203363s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:46:30.777939391 (195h20m11.509207021s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:46:30.777942236 (195h20m11.509209856s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:46:30.780551737 (195h20m11.511819357s) [upload=203272]: Done uploading segments... Aug 16 20:46:30.780558780 (195h20m11.5118264s) [upload=203272]: Upload finished. err: metaclient: Too Many Requests
Duration: 162.895414ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................X....................X......................] duration:
735.98755ms
FAIL (2025-08-16 21:00:30 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 736.009873ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..X.....................................X...................] duration:
318.212575ms
FAIL (2025-08-16 21:00:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:46:30.777765332 (195h20m11.509032962s) [upload=203272]: Starting upload Aug 16 20:46:30.777826648 (195h20m11.509094278s) [upload=203272]: Done starting upload Aug 16 20:46:30.777873375 (195h20m11.509140996s) [upload=203272]: Uploading segments... Aug 16 20:46:30.777903231 (195h20m11.509170852s) [upload=203272]: Got next segment. Inline: true Aug 16 20:46:30.777906738 (195h20m11.509174368s) [upload=203272]: Waiting for error group managing segments... Aug 16 20:46:30.777935733 (195h20m11.509203363s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:46:30.777939391 (195h20m11.509207021s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:46:30.777942236 (195h20m11.509209856s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:46:30.780551737 (195h20m11.511819357s) [upload=203272]: Done uploading segments... Aug 16 20:46:30.780558780 (195h20m11.5118264s) [upload=203272]: Upload finished. err: metaclient: Too Many Requests
Duration: 318.272627ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...X.....................................X..................] duration:
146.16895ms
FAIL (2025-08-16 21:00:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:46:30.777765332 (195h20m11.509032962s) [upload=203272]: Starting upload Aug 16 20:46:30.777826648 (195h20m11.509094278s) [upload=203272]: Done starting upload Aug 16 20:46:30.777873375 (195h20m11.509140996s) [upload=203272]: Uploading segments... Aug 16 20:46:30.777903231 (195h20m11.509170852s) [upload=203272]: Got next segment. Inline: true Aug 16 20:46:30.777906738 (195h20m11.509174368s) [upload=203272]: Waiting for error group managing segments... Aug 16 20:46:30.777935733 (195h20m11.509203363s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:46:30.777939391 (195h20m11.509207021s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:46:30.777942236 (195h20m11.509209856s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:46:30.780551737 (195h20m11.511819357s) [upload=203272]: Done uploading segments... Aug 16 20:46:30.780558780 (195h20m11.5118264s) [upload=203272]: Upload finished. err: metaclient: Too Many Requests
Duration: 146.189338ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....X.....................................X.................] duration:
140.275408ms
FAIL (2025-08-16 20:59:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:46:30.777765332 (195h20m11.509032962s) [upload=203272]: Starting upload Aug 16 20:46:30.777826648 (195h20m11.509094278s) [upload=203272]: Done starting upload Aug 16 20:46:30.777873375 (195h20m11.509140996s) [upload=203272]: Uploading segments... Aug 16 20:46:30.777903231 (195h20m11.509170852s) [upload=203272]: Got next segment. Inline: true Aug 16 20:46:30.777906738 (195h20m11.509174368s) [upload=203272]: Waiting for error group managing segments... Aug 16 20:46:30.777935733 (195h20m11.509203363s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:46:30.777939391 (195h20m11.509207021s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:46:30.777942236 (195h20m11.509209856s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:46:30.780551737 (195h20m11.511819357s) [upload=203272]: Done uploading segments... Aug 16 20:46:30.780558780 (195h20m11.5118264s) [upload=203272]: Upload finished. err: metaclient: Too Many Requests
Duration: 140.292641ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................X....................X.....................] duration:
790.7484ms
FAIL (2025-08-16 20:59:20 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 790.771795ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....X.....................................X................] duration:
209.004026ms
FAIL (2025-08-16 20:58:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:46:30.777765332 (195h20m11.509032962s) [upload=203272]: Starting upload Aug 16 20:46:30.777826648 (195h20m11.509094278s) [upload=203272]: Done starting upload Aug 16 20:46:30.777873375 (195h20m11.509140996s) [upload=203272]: Uploading segments... Aug 16 20:46:30.777903231 (195h20m11.509170852s) [upload=203272]: Got next segment. Inline: true Aug 16 20:46:30.777906738 (195h20m11.509174368s) [upload=203272]: Waiting for error group managing segments... Aug 16 20:46:30.777935733 (195h20m11.509203363s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:46:30.777939391 (195h20m11.509207021s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:46:30.777942236 (195h20m11.509209856s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:46:30.780551737 (195h20m11.511819357s) [upload=203272]: Done uploading segments... Aug 16 20:46:30.780558780 (195h20m11.5118264s) [upload=203272]: Upload finished. err: metaclient: Too Many Requests
Duration: 209.026958ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................X....................X....................] duration:
824.298353ms
FAIL (2025-08-16 20:58:31 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 824.325393ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X.....X.....................................X...............] duration:
297.932389ms
FAIL (2025-08-16 20:58:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:46:30.777765332 (195h20m11.509032962s) [upload=203272]: Starting upload Aug 16 20:46:30.777826648 (195h20m11.509094278s) [upload=203272]: Done starting upload Aug 16 20:46:30.777873375 (195h20m11.509140996s) [upload=203272]: Uploading segments... Aug 16 20:46:30.777903231 (195h20m11.509170852s) [upload=203272]: Got next segment. Inline: true Aug 16 20:46:30.777906738 (195h20m11.509174368s) [upload=203272]: Waiting for error group managing segments... Aug 16 20:46:30.777935733 (195h20m11.509203363s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:46:30.777939391 (195h20m11.509207021s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:46:30.777942236 (195h20m11.509209856s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:46:30.780551737 (195h20m11.511819357s) [upload=203272]: Done uploading segments... Aug 16 20:46:30.780558780 (195h20m11.5118264s) [upload=203272]: Upload finished. err: metaclient: Too Many Requests
Duration: 298.122156ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................X....................X...................] duration:
657.010706ms
FAIL (2025-08-16 20:57:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 657.05032ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|