Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X.....X.....................................X..............] duration:
155.364526ms
FAIL (2025-08-16 20:57:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:46:30.777765332 (195h20m11.509032962s) [upload=203272]: Starting upload Aug 16 20:46:30.777826648 (195h20m11.509094278s) [upload=203272]: Done starting upload Aug 16 20:46:30.777873375 (195h20m11.509140996s) [upload=203272]: Uploading segments... Aug 16 20:46:30.777903231 (195h20m11.509170852s) [upload=203272]: Got next segment. Inline: true Aug 16 20:46:30.777906738 (195h20m11.509174368s) [upload=203272]: Waiting for error group managing segments... Aug 16 20:46:30.777935733 (195h20m11.509203363s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:46:30.777939391 (195h20m11.509207021s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:46:30.777942236 (195h20m11.509209856s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:46:30.780551737 (195h20m11.511819357s) [upload=203272]: Done uploading segments... Aug 16 20:46:30.780558780 (195h20m11.5118264s) [upload=203272]: Upload finished. err: metaclient: Too Many Requests
Duration: 155.386597ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..X.....X.....................................X.............] duration:
187.660617ms
FAIL (2025-08-16 20:57:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:46:30.777765332 (195h20m11.509032962s) [upload=203272]: Starting upload Aug 16 20:46:30.777826648 (195h20m11.509094278s) [upload=203272]: Done starting upload Aug 16 20:46:30.777873375 (195h20m11.509140996s) [upload=203272]: Uploading segments... Aug 16 20:46:30.777903231 (195h20m11.509170852s) [upload=203272]: Got next segment. Inline: true Aug 16 20:46:30.777906738 (195h20m11.509174368s) [upload=203272]: Waiting for error group managing segments... Aug 16 20:46:30.777935733 (195h20m11.509203363s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:46:30.777939391 (195h20m11.509207021s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:46:30.777942236 (195h20m11.509209856s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:46:30.780551737 (195h20m11.511819357s) [upload=203272]: Done uploading segments... Aug 16 20:46:30.780558780 (195h20m11.5118264s) [upload=203272]: Upload finished. err: metaclient: Too Many Requests
Duration: 187.674703ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................X....................X..................] duration:
507.769111ms
FAIL (2025-08-16 20:57:00 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 507.799477ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................X....................X.................] duration:
456.546971ms
FAIL (2025-08-16 20:56:23 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 456.574604ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...X.....X.....................................X............] duration:
249.973139ms
FAIL (2025-08-16 20:56:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:46:30.777765332 (195h20m11.509032962s) [upload=203272]: Starting upload Aug 16 20:46:30.777826648 (195h20m11.509094278s) [upload=203272]: Done starting upload Aug 16 20:46:30.777873375 (195h20m11.509140996s) [upload=203272]: Uploading segments... Aug 16 20:46:30.777903231 (195h20m11.509170852s) [upload=203272]: Got next segment. Inline: true Aug 16 20:46:30.777906738 (195h20m11.509174368s) [upload=203272]: Waiting for error group managing segments... Aug 16 20:46:30.777935733 (195h20m11.509203363s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:46:30.777939391 (195h20m11.509207021s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:46:30.777942236 (195h20m11.509209856s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:46:30.780551737 (195h20m11.511819357s) [upload=203272]: Done uploading segments... Aug 16 20:46:30.780558780 (195h20m11.5118264s) [upload=203272]: Upload finished. err: metaclient: Too Many Requests
Duration: 249.993116ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................X....................X................] duration:
688.439264ms
FAIL (2025-08-16 20:55:28 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 688.454263ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....X.....X.....................................X...........] duration:
142.505004ms
FAIL (2025-08-16 20:55:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:46:30.777765332 (195h20m11.509032962s) [upload=203272]: Starting upload Aug 16 20:46:30.777826648 (195h20m11.509094278s) [upload=203272]: Done starting upload Aug 16 20:46:30.777873375 (195h20m11.509140996s) [upload=203272]: Uploading segments... Aug 16 20:46:30.777903231 (195h20m11.509170852s) [upload=203272]: Got next segment. Inline: true Aug 16 20:46:30.777906738 (195h20m11.509174368s) [upload=203272]: Waiting for error group managing segments... Aug 16 20:46:30.777935733 (195h20m11.509203363s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:46:30.777939391 (195h20m11.509207021s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:46:30.777942236 (195h20m11.509209856s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:46:30.780551737 (195h20m11.511819357s) [upload=203272]: Done uploading segments... Aug 16 20:46:30.780558780 (195h20m11.5118264s) [upload=203272]: Upload finished. err: metaclient: Too Many Requests
Duration: 142.563475ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................X....................X...............] duration:
622.166197ms
FAIL (2025-08-16 20:55:13 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 622.187227ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....X.....X.....................................X..........] duration:
309.949465ms
FAIL (2025-08-16 20:55:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:46:30.777765332 (195h20m11.509032962s) [upload=203272]: Starting upload Aug 16 20:46:30.777826648 (195h20m11.509094278s) [upload=203272]: Done starting upload Aug 16 20:46:30.777873375 (195h20m11.509140996s) [upload=203272]: Uploading segments... Aug 16 20:46:30.777903231 (195h20m11.509170852s) [upload=203272]: Got next segment. Inline: true Aug 16 20:46:30.777906738 (195h20m11.509174368s) [upload=203272]: Waiting for error group managing segments... Aug 16 20:46:30.777935733 (195h20m11.509203363s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:46:30.777939391 (195h20m11.509207021s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:46:30.777942236 (195h20m11.509209856s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:46:30.780551737 (195h20m11.511819357s) [upload=203272]: Done uploading segments... Aug 16 20:46:30.780558780 (195h20m11.5118264s) [upload=203272]: Upload finished. err: metaclient: Too Many Requests
Duration: 309.96827ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................X....................X..............] duration:
555.738913ms
FAIL (2025-08-16 20:54:22 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 555.798325ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......X.....X.....................................X.........] duration:
414.602662ms
FAIL (2025-08-16 20:54:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:46:30.777765332 (195h20m11.509032962s) [upload=203272]: Starting upload Aug 16 20:46:30.777826648 (195h20m11.509094278s) [upload=203272]: Done starting upload Aug 16 20:46:30.777873375 (195h20m11.509140996s) [upload=203272]: Uploading segments... Aug 16 20:46:30.777903231 (195h20m11.509170852s) [upload=203272]: Got next segment. Inline: true Aug 16 20:46:30.777906738 (195h20m11.509174368s) [upload=203272]: Waiting for error group managing segments... Aug 16 20:46:30.777935733 (195h20m11.509203363s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:46:30.777939391 (195h20m11.509207021s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:46:30.777942236 (195h20m11.509209856s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:46:30.780551737 (195h20m11.511819357s) [upload=203272]: Done uploading segments... Aug 16 20:46:30.780558780 (195h20m11.5118264s) [upload=203272]: Upload finished. err: metaclient: Too Many Requests
Duration: 414.630885ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................X....................X.............] duration:
749.892539ms
FAIL (2025-08-16 20:53:53 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 749.92984ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................X....................X............] duration:
802.557377ms
FAIL (2025-08-16 20:53:14 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 802.580029ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X.....X.....................................X........] duration:
198.053437ms
FAIL (2025-08-16 20:52:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:46:30.777765332 (195h20m11.509032962s) [upload=203272]: Starting upload Aug 16 20:46:30.777826648 (195h20m11.509094278s) [upload=203272]: Done starting upload Aug 16 20:46:30.777873375 (195h20m11.509140996s) [upload=203272]: Uploading segments... Aug 16 20:46:30.777903231 (195h20m11.509170852s) [upload=203272]: Got next segment. Inline: true Aug 16 20:46:30.777906738 (195h20m11.509174368s) [upload=203272]: Waiting for error group managing segments... Aug 16 20:46:30.777935733 (195h20m11.509203363s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:46:30.777939391 (195h20m11.509207021s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:46:30.777942236 (195h20m11.509209856s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:46:30.780551737 (195h20m11.511819357s) [upload=203272]: Done uploading segments... Aug 16 20:46:30.780558780 (195h20m11.5118264s) [upload=203272]: Upload finished. err: metaclient: Too Many Requests
Duration: 198.072804ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................X....................X...........] duration:
896.977963ms
FAIL (2025-08-16 20:52:03 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 897.047484ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X.....X.....................................X.......] duration:
171.433318ms
FAIL (2025-08-16 20:51:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:46:30.777765332 (195h20m11.509032962s) [upload=203272]: Starting upload Aug 16 20:46:30.777826648 (195h20m11.509094278s) [upload=203272]: Done starting upload Aug 16 20:46:30.777873375 (195h20m11.509140996s) [upload=203272]: Uploading segments... Aug 16 20:46:30.777903231 (195h20m11.509170852s) [upload=203272]: Got next segment. Inline: true Aug 16 20:46:30.777906738 (195h20m11.509174368s) [upload=203272]: Waiting for error group managing segments... Aug 16 20:46:30.777935733 (195h20m11.509203363s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:46:30.777939391 (195h20m11.509207021s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:46:30.777942236 (195h20m11.509209856s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:46:30.780551737 (195h20m11.511819357s) [upload=203272]: Done uploading segments... Aug 16 20:46:30.780558780 (195h20m11.5118264s) [upload=203272]: Upload finished. err: metaclient: Too Many Requests
Duration: 171.451252ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................X....................X..........] duration:
921.457073ms
FAIL (2025-08-16 20:51:23 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 921.483424ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X.....X.....................................X......] duration:
170.256346ms
FAIL (2025-08-16 20:50:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:46:30.777765332 (195h20m11.509032962s) [upload=203272]: Starting upload Aug 16 20:46:30.777826648 (195h20m11.509094278s) [upload=203272]: Done starting upload Aug 16 20:46:30.777873375 (195h20m11.509140996s) [upload=203272]: Uploading segments... Aug 16 20:46:30.777903231 (195h20m11.509170852s) [upload=203272]: Got next segment. Inline: true Aug 16 20:46:30.777906738 (195h20m11.509174368s) [upload=203272]: Waiting for error group managing segments... Aug 16 20:46:30.777935733 (195h20m11.509203363s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:46:30.777939391 (195h20m11.509207021s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:46:30.777942236 (195h20m11.509209856s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:46:30.780551737 (195h20m11.511819357s) [upload=203272]: Done uploading segments... Aug 16 20:46:30.780558780 (195h20m11.5118264s) [upload=203272]: Upload finished. err: metaclient: Too Many Requests
Duration: 170.284768ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................X....................X.........] duration:
557.883047ms
FAIL (2025-08-16 20:50:19 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 557.906663ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X.....X.....................................X.....] duration:
231.050639ms
FAIL (2025-08-16 20:50:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:46:30.777765332 (195h20m11.509032962s) [upload=203272]: Starting upload Aug 16 20:46:30.777826648 (195h20m11.509094278s) [upload=203272]: Done starting upload Aug 16 20:46:30.777873375 (195h20m11.509140996s) [upload=203272]: Uploading segments... Aug 16 20:46:30.777903231 (195h20m11.509170852s) [upload=203272]: Got next segment. Inline: true Aug 16 20:46:30.777906738 (195h20m11.509174368s) [upload=203272]: Waiting for error group managing segments... Aug 16 20:46:30.777935733 (195h20m11.509203363s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:46:30.777939391 (195h20m11.509207021s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:46:30.777942236 (195h20m11.509209856s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:46:30.780551737 (195h20m11.511819357s) [upload=203272]: Done uploading segments... Aug 16 20:46:30.780558780 (195h20m11.5118264s) [upload=203272]: Upload finished. err: metaclient: Too Many Requests
Duration: 231.070386ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........X.....X.....................................X....] duration:
383.848253ms
FAIL (2025-08-16 20:49:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:46:30.777765332 (195h20m11.509032962s) [upload=203272]: Starting upload Aug 16 20:46:30.777826648 (195h20m11.509094278s) [upload=203272]: Done starting upload Aug 16 20:46:30.777873375 (195h20m11.509140996s) [upload=203272]: Uploading segments... Aug 16 20:46:30.777903231 (195h20m11.509170852s) [upload=203272]: Got next segment. Inline: true Aug 16 20:46:30.777906738 (195h20m11.509174368s) [upload=203272]: Waiting for error group managing segments... Aug 16 20:46:30.777935733 (195h20m11.509203363s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:46:30.777939391 (195h20m11.509207021s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:46:30.777942236 (195h20m11.509209856s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:46:30.780551737 (195h20m11.511819357s) [upload=203272]: Done uploading segments... Aug 16 20:46:30.780558780 (195h20m11.5118264s) [upload=203272]: Upload finished. err: metaclient: Too Many Requests
Duration: 383.865524ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................X....................X........] duration:
846.612265ms
FAIL (2025-08-16 20:49:24 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 846.631011ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............X.....X.....................................X...] duration:
229.720314ms
FAIL (2025-08-16 20:49:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:46:30.777765332 (195h20m11.509032962s) [upload=203272]: Starting upload Aug 16 20:46:30.777826648 (195h20m11.509094278s) [upload=203272]: Done starting upload Aug 16 20:46:30.777873375 (195h20m11.509140996s) [upload=203272]: Uploading segments... Aug 16 20:46:30.777903231 (195h20m11.509170852s) [upload=203272]: Got next segment. Inline: true Aug 16 20:46:30.777906738 (195h20m11.509174368s) [upload=203272]: Waiting for error group managing segments... Aug 16 20:46:30.777935733 (195h20m11.509203363s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:46:30.777939391 (195h20m11.509207021s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:46:30.777942236 (195h20m11.509209856s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:46:30.780551737 (195h20m11.511819357s) [upload=203272]: Done uploading segments... Aug 16 20:46:30.780558780 (195h20m11.5118264s) [upload=203272]: Upload finished. err: metaclient: Too Many Requests
Duration: 229.76108ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................X....................X.......] duration:
734.907488ms
FAIL (2025-08-16 20:48:47 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 734.920302ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............X.....X.....................................X..] duration:
238.107939ms
FAIL (2025-08-16 20:48:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:46:30.777765332 (195h20m11.509032962s) [upload=203272]: Starting upload Aug 16 20:46:30.777826648 (195h20m11.509094278s) [upload=203272]: Done starting upload Aug 16 20:46:30.777873375 (195h20m11.509140996s) [upload=203272]: Uploading segments... Aug 16 20:46:30.777903231 (195h20m11.509170852s) [upload=203272]: Got next segment. Inline: true Aug 16 20:46:30.777906738 (195h20m11.509174368s) [upload=203272]: Waiting for error group managing segments... Aug 16 20:46:30.777935733 (195h20m11.509203363s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:46:30.777939391 (195h20m11.509207021s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:46:30.777942236 (195h20m11.509209856s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:46:30.780551737 (195h20m11.511819357s) [upload=203272]: Done uploading segments... Aug 16 20:46:30.780558780 (195h20m11.5118264s) [upload=203272]: Upload finished. err: metaclient: Too Many Requests
Duration: 238.133256ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................................X....................X......] duration:
646.644246ms
FAIL (2025-08-16 20:48:14 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 646.723115ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................................X....................X.....] duration:
958.373421ms
FAIL (2025-08-16 20:47:33 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 958.404208ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............X.....X.....................................X.] duration:
311.745604ms
FAIL (2025-08-16 20:47:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:46:30.777765332 (195h20m11.509032962s) [upload=203272]: Starting upload Aug 16 20:46:30.777826648 (195h20m11.509094278s) [upload=203272]: Done starting upload Aug 16 20:46:30.777873375 (195h20m11.509140996s) [upload=203272]: Uploading segments... Aug 16 20:46:30.777903231 (195h20m11.509170852s) [upload=203272]: Got next segment. Inline: true Aug 16 20:46:30.777906738 (195h20m11.509174368s) [upload=203272]: Waiting for error group managing segments... Aug 16 20:46:30.777935733 (195h20m11.509203363s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:46:30.777939391 (195h20m11.509207021s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:46:30.777942236 (195h20m11.509209856s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:46:30.780551737 (195h20m11.511819357s) [upload=203272]: Done uploading segments... Aug 16 20:46:30.780558780 (195h20m11.5118264s) [upload=203272]: Upload finished. err: metaclient: Too Many Requests
Duration: 311.764141ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............X.....X.....................................X] duration:
17.723697ms
FAIL (2025-08-16 20:46:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:46:30.777765332 (195h20m11.509032962s) [upload=203272]: Starting upload Aug 16 20:46:30.777826648 (195h20m11.509094278s) [upload=203272]: Done starting upload Aug 16 20:46:30.777873375 (195h20m11.509140996s) [upload=203272]: Uploading segments... Aug 16 20:46:30.777903231 (195h20m11.509170852s) [upload=203272]: Got next segment. Inline: true Aug 16 20:46:30.777906738 (195h20m11.509174368s) [upload=203272]: Waiting for error group managing segments... Aug 16 20:46:30.777935733 (195h20m11.509203363s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:46:30.777939391 (195h20m11.509207021s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:46:30.777942236 (195h20m11.509209856s) [upload=203272]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:46:30.780551737 (195h20m11.511819357s) [upload=203272]: Done uploading segments... Aug 16 20:46:30.780558780 (195h20m11.5118264s) [upload=203272]: Upload finished. err: metaclient: Too Many Requests
Duration: 17.738566ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................................X....................X....] duration:
797.313316ms
FAIL (2025-08-16 20:46:19 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 797.348161ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................................X....................X...] duration:
1.070642572s
FAIL (2025-08-16 20:45:55 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 1.070660987s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................X.....X.....................................] duration:
207.909999ms
FAIL (2025-08-16 20:45:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:18:32.403131077 (194h52m13.134398726s) [upload=202805]: Starting upload Aug 16 20:18:32.403291679 (194h52m13.134559329s) [upload=202805]: Done starting upload Aug 16 20:18:32.403375486 (194h52m13.134643137s) [upload=202805]: Uploading segments... Aug 16 20:18:32.403448534 (194h52m13.134716184s) [upload=202805]: Got next segment. Inline: true Aug 16 20:18:32.403458603 (194h52m13.134726264s) [upload=202805]: Waiting for error group managing segments... Aug 16 20:18:32.403514699 (194h52m13.134782349s) [upload=202805]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:18:32.403520500 (194h52m13.13478815s) [upload=202805]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:18:32.403524297 (194h52m13.134791947s) [upload=202805]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:18:32.406721335 (194h52m13.137988985s) [upload=202805]: Done uploading segments... Aug 16 20:18:32.406733629 (194h52m13.138001279s) [upload=202805]: Upload finished. err: metaclient: Too Many Requests
Duration: 207.935496ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................................X....................X..] duration:
799.202552ms
FAIL (2025-08-16 20:44:42 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 799.229093ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................X.....X....................................] duration:
264.079969ms
FAIL (2025-08-16 20:44:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:18:32.403131077 (194h52m13.134398726s) [upload=202805]: Starting upload Aug 16 20:18:32.403291679 (194h52m13.134559329s) [upload=202805]: Done starting upload Aug 16 20:18:32.403375486 (194h52m13.134643137s) [upload=202805]: Uploading segments... Aug 16 20:18:32.403448534 (194h52m13.134716184s) [upload=202805]: Got next segment. Inline: true Aug 16 20:18:32.403458603 (194h52m13.134726264s) [upload=202805]: Waiting for error group managing segments... Aug 16 20:18:32.403514699 (194h52m13.134782349s) [upload=202805]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:18:32.403520500 (194h52m13.13478815s) [upload=202805]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:18:32.403524297 (194h52m13.134791947s) [upload=202805]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:18:32.406721335 (194h52m13.137988985s) [upload=202805]: Done uploading segments... Aug 16 20:18:32.406733629 (194h52m13.138001279s) [upload=202805]: Upload finished. err: metaclient: Too Many Requests
Duration: 264.092862ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X....................X.] duration:
562.158111ms
FAIL (2025-08-16 20:43:44 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 562.184361ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................X.....X...................................] duration:
512.757263ms
FAIL (2025-08-16 20:43:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:18:32.403131077 (194h52m13.134398726s) [upload=202805]: Starting upload Aug 16 20:18:32.403291679 (194h52m13.134559329s) [upload=202805]: Done starting upload Aug 16 20:18:32.403375486 (194h52m13.134643137s) [upload=202805]: Uploading segments... Aug 16 20:18:32.403448534 (194h52m13.134716184s) [upload=202805]: Got next segment. Inline: true Aug 16 20:18:32.403458603 (194h52m13.134726264s) [upload=202805]: Waiting for error group managing segments... Aug 16 20:18:32.403514699 (194h52m13.134782349s) [upload=202805]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:18:32.403520500 (194h52m13.13478815s) [upload=202805]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:18:32.403524297 (194h52m13.134791947s) [upload=202805]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:18:32.406721335 (194h52m13.137988985s) [upload=202805]: Done uploading segments... Aug 16 20:18:32.406733629 (194h52m13.138001279s) [upload=202805]: Upload finished. err: metaclient: Too Many Requests
Duration: 512.791648ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................................X....................X] duration:
1.916829116s
FAIL (2025-08-16 20:42:37 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 20:42:36.075486014 (195h16m16.806753665s) [upload=203208]: Starting upload
Aug 16 20:42:36.075547300 (195h16m16.80681492s) [upload=203208]: Done starting upload
Aug 16 20:42:36.075701130 (195h16m16.80696876s) [upload=203208]: Uploading segments...
Aug 16 20:42:36.075843968 (195h16m16.807111598s) [upload=203208]: Got next segment. Inline: false
Aug 16 20:42:36.075872872 (195h16m16.807140502s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 20:42:36.075876890 (195h16m16.807144521s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 20:42:37.423719311 (195h16m18.154986941s) [seg_pos={0 0}, upload=203208]: Begin upload segment...
Aug 16 20:42:37.423752103 (195h16m18.155019723s) [seg_pos={0 0}, upload=203208]: Done begin upload segment.
Aug 16 20:42:37.423771880 (195h16m18.15503951s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.423787008 (195h16m18.155054628s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424099516 (195h16m18.155367146s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424110528 (195h16m18.155378148s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424335320 (195h16m18.155602951s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424341663 (195h16m18.155609293s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424584550 (195h16m18.15585218s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424588598 (195h16m18.155856228s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424809112 (195h16m18.156076733s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.424835643 (195h16m18.156103264s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425022305 (195h16m18.156289924s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425059254 (195h16m18.156326884s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425262607 (195h16m18.156530227s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425299196 (195h16m18.156566826s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425535540 (195h16m18.156803171s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425741869 (195h16m18.157009499s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.425955642 (195h16m18.157223272s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.426376242 (195h16m18.157643872s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Uploading piece...
Aug 16 20:42:37.507099019 (195h16m18.238366639s) [upload=203208]: Next returned nil segment
Aug 16 20:42:37.507155795 (195h16m18.238423425s) [upload=203208]: Waiting for error group managing segments...
Aug 16 20:42:37.517278172 (195h16m18.248545802s) [noise=true , address=104.36.82.39:4731 , piece_id=GFFXAHSPX7J65QOFJDPANLDWQQBS42KWBZALZ52DR372ESI2BJBQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.519536002 (195h16m18.250803623s) [noise=true , address=45.91.116.5:4320 , piece_id=CDOBGERXOXJ6QWTO7XZSPRRSTDCRRV5WBMHDPYURFOMABDFWXN5Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551570129 (195h16m18.282837759s) [noise=true , address=77.90.31.16:4756 , piece_id=UOLBWELFLRLXCSFCZJUNVQAQPO7QV5PLQHAVX3OW6LVW36LCGZNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.551934855 (195h16m18.283202475s) [noise=true , address=77.90.31.14:4692 , piece_id=J2HJNIWP6Q2CU267STGCJMCPEPSAIEQTC37NHK23PFEXA7F6UUKA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.563100555 (195h16m18.294368185s) [noise=true , address=104.36.82.8:4987 , piece_id=MRRQDX7PTUWXH42GR36CRF337DGSYORPNIFNIL24I5J3QXCGU2RQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.567813829 (195h16m18.299081459s) [noise=true , address=104.36.82.23:4473 , piece_id=FJYL7AR2EXSOHF74OFXWMUNRRNBFIZWTG2ZJIYCHRHZMFEDHBXLQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.577464587 (195h16m18.308732217s) [noise=true , address=77.90.31.21:4887 , piece_id=Q3BLYQHHZ7DLN5YAST6GPVX2INOYSDHYDYBOOQHS3G52CTK6YTNA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591068538 (195h16m18.322336187s) [noise=true , address=104.36.82.51:4081 , piece_id=HKZJLIYZRDYKCRBP2P2LS6VVQSB7T3WBRGQKLENQORCPFMZCRVZQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.591657526 (195h16m18.322925166s) [noise=true , address=104.36.82.11:4146 , piece_id=LOYC4X2XHL2CGUGBBECM54HRF3MFFOOJEMD3USUQFYCJQRNI4S7Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.597405748 (195h16m18.328673408s) [noise=true , address=104.36.82.3:4797 , piece_id=6U4OH5OM27KTOZZIA2K2XCISCYT6Y52G4S36JAPREEDMICC6EPHQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.661463591 (195h16m18.392731241s) [noise=true , address=104.36.82.13:4212 , piece_id=ZJA4YDMAZVA666JDMYZKAWDR3LYVIMTZ3NHLYXQ6M6CYX6E6CI3Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.753919325 (195h16m18.485186974s) [noise=true , address=104.36.82.58:4276 , piece_id=GJJBZM5ROSXPBQC6VF5F3VPF6LPP5BUTACOD7JVBHXSQLEWXDRUQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.760085093 (195h16m18.491352742s) [noise=true , address=104.36.82.38:4705 , piece_id=JT2QU7HZVPPZCRXN6SXOHNFC2CWUK333GJW5ZSQQMWW77HSQDOKQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852828327 (195h16m18.584095977s) [noise=true , address=77.90.31.19:4848 , piece_id=YOCBMEJXLLUHCR4UHZNQKBIZL4RD6TUDSN2F4DGSFSO35PEHT7HQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: <nil>
Aug 16 20:42:37.852863163 (195h16m18.584130814s) [seg_pos={0 0}, upload=203208]: Segment reached optimal threshold of 14 pieces.
Aug 16 20:42:37.853008276 (195h16m18.584275927s) [noise=true , address=104.36.82.60:4353 , piece_id=BS5IVCOK6YPAIDRV6M2Q5XRYKNGSDUQW7YDDSR3XCCCT2BU5SVDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853029627 (195h16m18.584297257s) [noise=true , address=104.36.82.36:4633 , piece_id=BOWL5TW5EYKIN7IFDWD25BUBXKC3LQVCUNMP4JSJRRPHU2HYIXDQ, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853062548 (195h16m18.584330189s) [noise=true , address=45.91.116.14:4210 , piece_id=KXLG7HYDRCWV5FGQG7D66MCNRMZFBHPCFAIC6GCC7MJDE2AUECTA, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Xz49MqUbhiKpnPKri94CdfaNZdvBjarfMFYbW9uL9YJXW3W6n): protocol: expected piece hash; context canceled; EOF
Aug 16 20:42:37.853130316 (195h16m18.584397946s) [noise=true , address=66.23.193.175:4561 , piece_id=LGVM7I5EWWLW4YLODK6ZIYYPXJNC6LULXB2F26J77DMXYONQBE4Q, seg_pos={0 0}, upload=203208]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bYAiLD5oLcD72fz1TE9nmNmmszSLXkzKMc2Wc56pDKc119cu3): protocol: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27504->66.23.193.175:4561: use of closed network connection
Aug 16 20:42:37.853141388 (195h16m18.584409018s) [seg_pos={0 0}, upload=203208]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 20:42:37.853199386 (195h16m18.584467006s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 20:42:37.853203584 (195h16m18.584471214s) [upload=203208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 20:42:37.933994518 (195h16m18.665262148s) [upload=203208]: Done uploading segments...
Aug 16 20:42:37.934009236 (195h16m18.665276866s) [upload=203208]: Upload finished. err: <nil>
Duration: 1.916876356s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................X.....X..................................] duration:
277.3179ms
FAIL (2025-08-16 20:42:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:18:32.403131077 (194h52m13.134398726s) [upload=202805]: Starting upload Aug 16 20:18:32.403291679 (194h52m13.134559329s) [upload=202805]: Done starting upload Aug 16 20:18:32.403375486 (194h52m13.134643137s) [upload=202805]: Uploading segments... Aug 16 20:18:32.403448534 (194h52m13.134716184s) [upload=202805]: Got next segment. Inline: true Aug 16 20:18:32.403458603 (194h52m13.134726264s) [upload=202805]: Waiting for error group managing segments... Aug 16 20:18:32.403514699 (194h52m13.134782349s) [upload=202805]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:18:32.403520500 (194h52m13.13478815s) [upload=202805]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:18:32.403524297 (194h52m13.134791947s) [upload=202805]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:18:32.406721335 (194h52m13.137988985s) [upload=202805]: Done uploading segments... Aug 16 20:18:32.406733629 (194h52m13.138001279s) [upload=202805]: Upload finished. err: metaclient: Too Many Requests
Duration: 277.338698ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................X.....X.................................] duration:
167.389952ms
FAIL (2025-08-16 20:41:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:18:32.403131077 (194h52m13.134398726s) [upload=202805]: Starting upload Aug 16 20:18:32.403291679 (194h52m13.134559329s) [upload=202805]: Done starting upload Aug 16 20:18:32.403375486 (194h52m13.134643137s) [upload=202805]: Uploading segments... Aug 16 20:18:32.403448534 (194h52m13.134716184s) [upload=202805]: Got next segment. Inline: true Aug 16 20:18:32.403458603 (194h52m13.134726264s) [upload=202805]: Waiting for error group managing segments... Aug 16 20:18:32.403514699 (194h52m13.134782349s) [upload=202805]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:18:32.403520500 (194h52m13.13478815s) [upload=202805]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:18:32.403524297 (194h52m13.134791947s) [upload=202805]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:18:32.406721335 (194h52m13.137988985s) [upload=202805]: Done uploading segments... Aug 16 20:18:32.406733629 (194h52m13.138001279s) [upload=202805]: Upload finished. err: metaclient: Too Many Requests
Duration: 167.410329ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
475.301566ms
FAIL (2025-08-16 20:41:54 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:27:30.166922980 (195h1m10.89819062s) [upload=202955]: Starting upload Aug 16 20:27:30.166964328 (195h1m10.898231968s) [upload=202955]: Done starting upload Aug 16 20:27:30.167377435 (195h1m10.898645065s) [upload=202955]: Uploading segments... Aug 16 20:27:30.167415057 (195h1m10.898682697s) [upload=202955]: Got next segment. Inline: false Aug 16 20:27:30.167439844 (195h1m10.898707484s) [upload=202955]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:27:30.167444021 (195h1m10.898711661s) [upload=202955]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 20:27:30.221614591 (195h1m10.952882251s) [upload=202955]: Next segment err: metaclient: Too Many Requests Aug 16 20:27:30.221655108 (195h1m10.952922768s) [upload=202955]: Done uploading segments... Aug 16 20:27:30.221673692 (195h1m10.952941343s) [upload=202955]: Upload finished. err: metaclient: Too Many Requests
Duration: 475.31952ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................X.....X................................] duration:
163.403598ms
FAIL (2025-08-16 20:41:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:18:32.403131077 (194h52m13.134398726s) [upload=202805]: Starting upload Aug 16 20:18:32.403291679 (194h52m13.134559329s) [upload=202805]: Done starting upload Aug 16 20:18:32.403375486 (194h52m13.134643137s) [upload=202805]: Uploading segments... Aug 16 20:18:32.403448534 (194h52m13.134716184s) [upload=202805]: Got next segment. Inline: true Aug 16 20:18:32.403458603 (194h52m13.134726264s) [upload=202805]: Waiting for error group managing segments... Aug 16 20:18:32.403514699 (194h52m13.134782349s) [upload=202805]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:18:32.403520500 (194h52m13.13478815s) [upload=202805]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:18:32.403524297 (194h52m13.134791947s) [upload=202805]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:18:32.406721335 (194h52m13.137988985s) [upload=202805]: Done uploading segments... Aug 16 20:18:32.406733629 (194h52m13.138001279s) [upload=202805]: Upload finished. err: metaclient: Too Many Requests
Duration: 163.432473ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................X.....X...............................] duration:
292.635767ms
FAIL (2025-08-16 20:40:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:18:32.403131077 (194h52m13.134398726s) [upload=202805]: Starting upload Aug 16 20:18:32.403291679 (194h52m13.134559329s) [upload=202805]: Done starting upload Aug 16 20:18:32.403375486 (194h52m13.134643137s) [upload=202805]: Uploading segments... Aug 16 20:18:32.403448534 (194h52m13.134716184s) [upload=202805]: Got next segment. Inline: true Aug 16 20:18:32.403458603 (194h52m13.134726264s) [upload=202805]: Waiting for error group managing segments... Aug 16 20:18:32.403514699 (194h52m13.134782349s) [upload=202805]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:18:32.403520500 (194h52m13.13478815s) [upload=202805]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:18:32.403524297 (194h52m13.134791947s) [upload=202805]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:18:32.406721335 (194h52m13.137988985s) [upload=202805]: Done uploading segments... Aug 16 20:18:32.406733629 (194h52m13.138001279s) [upload=202805]: Upload finished. err: metaclient: Too Many Requests
Duration: 292.654572ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
832.573472ms
FAIL (2025-08-16 20:40:48 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:27:30.166922980 (195h1m10.89819062s) [upload=202955]: Starting upload Aug 16 20:27:30.166964328 (195h1m10.898231968s) [upload=202955]: Done starting upload Aug 16 20:27:30.167377435 (195h1m10.898645065s) [upload=202955]: Uploading segments... Aug 16 20:27:30.167415057 (195h1m10.898682697s) [upload=202955]: Got next segment. Inline: false Aug 16 20:27:30.167439844 (195h1m10.898707484s) [upload=202955]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:27:30.167444021 (195h1m10.898711661s) [upload=202955]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 20:27:30.221614591 (195h1m10.952882251s) [upload=202955]: Next segment err: metaclient: Too Many Requests Aug 16 20:27:30.221655108 (195h1m10.952922768s) [upload=202955]: Done uploading segments... Aug 16 20:27:30.221673692 (195h1m10.952941343s) [upload=202955]: Upload finished. err: metaclient: Too Many Requests
Duration: 832.59884ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
681.281648ms
FAIL (2025-08-16 20:40:17 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:27:30.166922980 (195h1m10.89819062s) [upload=202955]: Starting upload Aug 16 20:27:30.166964328 (195h1m10.898231968s) [upload=202955]: Done starting upload Aug 16 20:27:30.167377435 (195h1m10.898645065s) [upload=202955]: Uploading segments... Aug 16 20:27:30.167415057 (195h1m10.898682697s) [upload=202955]: Got next segment. Inline: false Aug 16 20:27:30.167439844 (195h1m10.898707484s) [upload=202955]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:27:30.167444021 (195h1m10.898711661s) [upload=202955]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 20:27:30.221614591 (195h1m10.952882251s) [upload=202955]: Next segment err: metaclient: Too Many Requests Aug 16 20:27:30.221655108 (195h1m10.952922768s) [upload=202955]: Done uploading segments... Aug 16 20:27:30.221673692 (195h1m10.952941343s) [upload=202955]: Upload finished. err: metaclient: Too Many Requests
Duration: 681.306635ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................X.....X..............................] duration:
534.406023ms
FAIL (2025-08-16 20:40:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:18:32.403131077 (194h52m13.134398726s) [upload=202805]: Starting upload Aug 16 20:18:32.403291679 (194h52m13.134559329s) [upload=202805]: Done starting upload Aug 16 20:18:32.403375486 (194h52m13.134643137s) [upload=202805]: Uploading segments... Aug 16 20:18:32.403448534 (194h52m13.134716184s) [upload=202805]: Got next segment. Inline: true Aug 16 20:18:32.403458603 (194h52m13.134726264s) [upload=202805]: Waiting for error group managing segments... Aug 16 20:18:32.403514699 (194h52m13.134782349s) [upload=202805]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:18:32.403520500 (194h52m13.13478815s) [upload=202805]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:18:32.403524297 (194h52m13.134791947s) [upload=202805]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:18:32.406721335 (194h52m13.137988985s) [upload=202805]: Done uploading segments... Aug 16 20:18:32.406733629 (194h52m13.138001279s) [upload=202805]: Upload finished. err: metaclient: Too Many Requests
Duration: 534.423807ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................X.....X.............................] duration:
271.19829ms
FAIL (2025-08-16 20:39:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:18:32.403131077 (194h52m13.134398726s) [upload=202805]: Starting upload Aug 16 20:18:32.403291679 (194h52m13.134559329s) [upload=202805]: Done starting upload Aug 16 20:18:32.403375486 (194h52m13.134643137s) [upload=202805]: Uploading segments... Aug 16 20:18:32.403448534 (194h52m13.134716184s) [upload=202805]: Got next segment. Inline: true Aug 16 20:18:32.403458603 (194h52m13.134726264s) [upload=202805]: Waiting for error group managing segments... Aug 16 20:18:32.403514699 (194h52m13.134782349s) [upload=202805]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:18:32.403520500 (194h52m13.13478815s) [upload=202805]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:18:32.403524297 (194h52m13.134791947s) [upload=202805]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:18:32.406721335 (194h52m13.137988985s) [upload=202805]: Done uploading segments... Aug 16 20:18:32.406733629 (194h52m13.138001279s) [upload=202805]: Upload finished. err: metaclient: Too Many Requests
Duration: 271.216154ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
802.806185ms
FAIL (2025-08-16 20:39:45 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:27:30.166922980 (195h1m10.89819062s) [upload=202955]: Starting upload Aug 16 20:27:30.166964328 (195h1m10.898231968s) [upload=202955]: Done starting upload Aug 16 20:27:30.167377435 (195h1m10.898645065s) [upload=202955]: Uploading segments... Aug 16 20:27:30.167415057 (195h1m10.898682697s) [upload=202955]: Got next segment. Inline: false Aug 16 20:27:30.167439844 (195h1m10.898707484s) [upload=202955]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:27:30.167444021 (195h1m10.898711661s) [upload=202955]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 20:27:30.221614591 (195h1m10.952882251s) [upload=202955]: Next segment err: metaclient: Too Many Requests Aug 16 20:27:30.221655108 (195h1m10.952922768s) [upload=202955]: Done uploading segments... Aug 16 20:27:30.221673692 (195h1m10.952941343s) [upload=202955]: Upload finished. err: metaclient: Too Many Requests
Duration: 802.81926ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................X.....X............................] duration:
425.851163ms
FAIL (2025-08-16 20:39:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:18:32.403131077 (194h52m13.134398726s) [upload=202805]: Starting upload Aug 16 20:18:32.403291679 (194h52m13.134559329s) [upload=202805]: Done starting upload Aug 16 20:18:32.403375486 (194h52m13.134643137s) [upload=202805]: Uploading segments... Aug 16 20:18:32.403448534 (194h52m13.134716184s) [upload=202805]: Got next segment. Inline: true Aug 16 20:18:32.403458603 (194h52m13.134726264s) [upload=202805]: Waiting for error group managing segments... Aug 16 20:18:32.403514699 (194h52m13.134782349s) [upload=202805]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:18:32.403520500 (194h52m13.13478815s) [upload=202805]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 20:18:32.403524297 (194h52m13.134791947s) [upload=202805]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 20:18:32.406721335 (194h52m13.137988985s) [upload=202805]: Done uploading segments... Aug 16 20:18:32.406733629 (194h52m13.138001279s) [upload=202805]: Upload finished. err: metaclient: Too Many Requests
Duration: 425.873274ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
687.465389ms
FAIL (2025-08-16 20:39:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:27:30.166922980 (195h1m10.89819062s) [upload=202955]: Starting upload Aug 16 20:27:30.166964328 (195h1m10.898231968s) [upload=202955]: Done starting upload Aug 16 20:27:30.167377435 (195h1m10.898645065s) [upload=202955]: Uploading segments... Aug 16 20:27:30.167415057 (195h1m10.898682697s) [upload=202955]: Got next segment. Inline: false Aug 16 20:27:30.167439844 (195h1m10.898707484s) [upload=202955]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:27:30.167444021 (195h1m10.898711661s) [upload=202955]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 20:27:30.221614591 (195h1m10.952882251s) [upload=202955]: Next segment err: metaclient: Too Many Requests Aug 16 20:27:30.221655108 (195h1m10.952922768s) [upload=202955]: Done uploading segments... Aug 16 20:27:30.221673692 (195h1m10.952941343s) [upload=202955]: Upload finished. err: metaclient: Too Many Requests
Duration: 687.488813ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
640.773611ms
FAIL (2025-08-16 20:38:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 20:27:30.166922980 (195h1m10.89819062s) [upload=202955]: Starting upload Aug 16 20:27:30.166964328 (195h1m10.898231968s) [upload=202955]: Done starting upload Aug 16 20:27:30.167377435 (195h1m10.898645065s) [upload=202955]: Uploading segments... Aug 16 20:27:30.167415057 (195h1m10.898682697s) [upload=202955]: Got next segment. Inline: false Aug 16 20:27:30.167439844 (195h1m10.898707484s) [upload=202955]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 20:27:30.167444021 (195h1m10.898711661s) [upload=202955]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 20:27:30.221614591 (195h1m10.952882251s) [upload=202955]: Next segment err: metaclient: Too Many Requests Aug 16 20:27:30.221655108 (195h1m10.952922768s) [upload=202955]: Done uploading segments... Aug 16 20:27:30.221673692 (195h1m10.952941343s) [upload=202955]: Upload finished. err: metaclient: Too Many Requests
Duration: 640.804259ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|