Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 334.726387ms trace: https://jaeger.dev.storj.io/trace/3bb5e6bb5aa7ad6b FAIL (2026-01-26 19:06:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 26 18:43:22.244729209 (266h47m0.42717419s) [upload=234289]: Starting upload Jan 26 18:43:22.244783651 (266h47m0.427228631s) [upload=234289]: Done starting upload Jan 26 18:43:22.244862287 (266h47m0.427307267s) [upload=234289]: Uploading segments... Jan 26 18:43:22.245010364 (266h47m0.427455334s) [upload=234289]: Got next segment. Inline: false Jan 26 18:43:22.245044468 (266h47m0.427489448s) [upload=234289]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 26 18:43:22.245048175 (266h47m0.427493155s) [upload=234289]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 26 18:43:22.266231092 (266h47m0.448676072s) [seg_pos={0 0}, upload=234289]: Begin upload segment... Jan 26 18:43:22.266262791 (266h47m0.448707761s) [seg_pos={0 0}, upload=234289]: Done begin upload segment. Jan 26 18:43:22.266285364 (266h47m0.448730334s) [noise=true , address=45.91.116.12:4225 , piece_id=M7NFP2QJD5JTMJXROZSXKW6LAJ45WTJJ4XOJLBD4UQEDJJSEY4RA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.266372465 (266h47m0.448817446s) [noise=true , address=145.79.227.47:4265 , piece_id=RQLMIDMVU45GIR2VOBZQRVLZEEKI4TEU4EJVTLLNLKDHAS3GSGTQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.266739602 (266h47m0.449184583s) [noise=true , address=45.91.116.7:4010 , piece_id=3RADWMUAMQOTQQF3YLXSJJOWSQRZEWVZJQXPHMADDWYQIKJX6UCA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267056043 (266h47m0.449501013s) [noise=true , address=145.79.227.13:4803 , piece_id=TVP3SVAKCCCFAOOVG3DAPLEAAL3IFP76TCQ4LN43I2TQNDZT7DGA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267372755 (266h47m0.449817725s) [noise=true , address=45.91.116.9:4261 , piece_id=BWWCW3CPBTPWOF4K2NUOXEZRMHZGILDOT335RY5TSZUJSETSF6BA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267627821 (266h47m0.450072801s) [noise=true , address=45.91.116.6:4976 , piece_id=6RKPBVLLDTIEYOBANAB4NRDYAY353LUCVAOAS2523RTXCVCDVO3A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267660202 (266h47m0.450105171s) [noise=true , address=145.79.227.33:4871 , piece_id=2VUU7K3BCWPKKHHU7CAXEBRITS6ED6WDFPU3ODBG2YPDTCZKWD3A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267886355 (266h47m0.450331325s) [noise=true , address=145.79.227.52:4446 , piece_id=SWREVABTLINLIKWZ5T4K4F6TAC5VF4PWHPPTIT2HVMEBFHRSNKEA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268219706 (266h47m0.450664677s) [noise=true , address=145.79.227.39:4013 , piece_id=IDWYWDFFNKZN5EY2THLNG57FF3JQNQVFVU6RF4MACLIEDF7ZV37A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268756349 (266h47m0.451201319s) [noise=true , address=145.79.227.48:4301 , piece_id=JYZZKQCYSWGQD3JTFIXNQ2UNLU4H2K7D2EAEB7EILRUHHWZG6X5A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268762169 (266h47m0.451207149s) [noise=true , address=145.79.227.46:4601 , piece_id=AWDYHRIULVSHJY4MMGUTV54D7WBTSRWTXUWX35HIYDNB63I4QPFQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268800502 (266h47m0.451245472s) [noise=true , address=145.79.227.51:4411 , piece_id=QX42UUIQRKDLVW2P4MDHGVM7YBDK4TB2LENZBVDLS4RMUQLPLHNQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269264038 (266h47m0.451709008s) [noise=true , address=145.79.227.22:4511 , piece_id=OGUKV6FBZNOYNTUO3A7M3Z532KQZH2K5AQIDPUKD3RYDPXFHBAEQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269456296 (266h47m0.451901276s) [noise=true , address=145.79.227.37:4565 , piece_id=JQVIFKPIBMXFTYYTHF3Q7DKEIFSMKV6FBXFOIZ4HJEDCT3S7YGJA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269827900 (266h47m0.45227287s) [noise=true , address=45.91.116.14:4191 , piece_id=HAYM5NIRM2ELGZ7FO7L2EY3HMAAED7JWEC4V7SD3BDHEADELNWUA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.270230122 (266h47m0.452675091s) [noise=true , address=145.79.227.24:4583 , piece_id=7ITWHDHIII3LFUA2AD3UQBXFXP43CFDIK4NKHYDD2BTGJII2WRBA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.346167333 (266h47m0.528612314s) [upload=234289]: Next returned nil segment Jan 26 18:43:22.346177152 (266h47m0.528622132s) [upload=234289]: Waiting for error group managing segments... Jan 26 18:43:22.355942092 (266h47m0.538387072s) [noise=true , address=145.79.227.52:4446 , piece_id=SWREVABTLINLIKWZ5T4K4F6TAC5VF4PWHPPTIT2HVMEBFHRSNKEA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.356544547 (266h47m0.538989517s) [noise=true , address=145.79.227.51:4411 , piece_id=QX42UUIQRKDLVW2P4MDHGVM7YBDK4TB2LENZBVDLS4RMUQLPLHNQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357475265 (266h47m0.539920235s) [noise=true , address=145.79.227.48:4301 , piece_id=JYZZKQCYSWGQD3JTFIXNQ2UNLU4H2K7D2EAEB7EILRUHHWZG6X5A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357741102 (266h47m0.540186082s) [noise=true , address=145.79.227.47:4265 , piece_id=RQLMIDMVU45GIR2VOBZQRVLZEEKI4TEU4EJVTLLNLKDHAS3GSGTQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357892725 (266h47m0.540337705s) [noise=true , address=145.79.227.24:4583 , piece_id=7ITWHDHIII3LFUA2AD3UQBXFXP43CFDIK4NKHYDD2BTGJII2WRBA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358205700 (266h47m0.54065068s) [noise=true , address=145.79.227.39:4013 , piece_id=IDWYWDFFNKZN5EY2THLNG57FF3JQNQVFVU6RF4MACLIEDF7ZV37A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358277304 (266h47m0.540722284s) [noise=true , address=145.79.227.46:4601 , piece_id=AWDYHRIULVSHJY4MMGUTV54D7WBTSRWTXUWX35HIYDNB63I4QPFQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358633879 (266h47m0.541078859s) [noise=true , address=145.79.227.13:4803 , piece_id=TVP3SVAKCCCFAOOVG3DAPLEAAL3IFP76TCQ4LN43I2TQNDZT7DGA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.359212861 (266h47m0.541657832s) [noise=true , address=145.79.227.33:4871 , piece_id=2VUU7K3BCWPKKHHU7CAXEBRITS6ED6WDFPU3ODBG2YPDTCZKWD3A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.359410610 (266h47m0.54185559s) [noise=true , address=145.79.227.22:4511 , piece_id=OGUKV6FBZNOYNTUO3A7M3Z532KQZH2K5AQIDPUKD3RYDPXFHBAEQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.374088006 (266h47m0.556532976s) [noise=true , address=145.79.227.37:4565 , piece_id=JQVIFKPIBMXFTYYTHF3Q7DKEIFSMKV6FBXFOIZ4HJEDCT3S7YGJA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:52.233014687 (266h47m30.415459677s) [noise=true , address=45.91.116.9:4261 , piece_id=BWWCW3CPBTPWOF4K2NUOXEZRMHZGILDOT335RY5TSZUJSETSF6BA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection Jan 26 18:43:52.233783362 (266h47m30.416228333s) [noise=true , address=45.91.116.7:4010 , piece_id=3RADWMUAMQOTQQF3YLXSJJOWSQRZEWVZJQXPHMADDWYQIKJX6UCA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233815402 (266h47m30.416260362s) [noise=true , address=45.91.116.14:4191 , piece_id=HAYM5NIRM2ELGZ7FO7L2EY3HMAAED7JWEC4V7SD3BDHEADELNWUA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: read tcp 5.161.89.252:12188->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233921791 (266h47m30.416366771s) [noise=true , address=45.91.116.6:4976 , piece_id=6RKPBVLLDTIEYOBANAB4NRDYAY353LUCVAOAS2523RTXCVCDVO3A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:121tumRJ6tGiip2dumJr9ZWMoU5BA2HuLEwU5GxBxzTZjMhv3Pp, address:45.91.116.6:4976): protocol: write tcp 5.161.89.252:62910->45.91.116.6:4976: use of closed network connection; close tcp 5.161.89.252:62910->45.91.116.6:4976: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233966906 (266h47m30.416411876s) [noise=true , address=45.91.116.12:4225 , piece_id=M7NFP2QJD5JTMJXROZSXKW6LAJ45WTJJ4XOJLBD4UQEDJJSEY4RA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection; write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection Jan 26 18:43:52.233984328 (266h47m30.416429288s) [seg_pos={0 0}, upload=234289]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 26 18:43:52.255878794 (266h47m30.438323804s) [upload=234289]: Done uploading segments... Jan 26 18:43:52.255942072 (266h47m30.438387072s) [upload=234289]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 334.746345ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 593.486722ms trace: https://jaeger.dev.storj.io/trace/6fe61816dac9c35f FAIL (2026-01-26 19:06:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 593.503013ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 349.47702ms trace: https://jaeger.dev.storj.io/trace/3bb5e6bb5aa7ad6b FAIL (2026-01-26 19:05:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 26 18:43:22.244729209 (266h47m0.42717419s) [upload=234289]: Starting upload Jan 26 18:43:22.244783651 (266h47m0.427228631s) [upload=234289]: Done starting upload Jan 26 18:43:22.244862287 (266h47m0.427307267s) [upload=234289]: Uploading segments... Jan 26 18:43:22.245010364 (266h47m0.427455334s) [upload=234289]: Got next segment. Inline: false Jan 26 18:43:22.245044468 (266h47m0.427489448s) [upload=234289]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 26 18:43:22.245048175 (266h47m0.427493155s) [upload=234289]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 26 18:43:22.266231092 (266h47m0.448676072s) [seg_pos={0 0}, upload=234289]: Begin upload segment... Jan 26 18:43:22.266262791 (266h47m0.448707761s) [seg_pos={0 0}, upload=234289]: Done begin upload segment. Jan 26 18:43:22.266285364 (266h47m0.448730334s) [noise=true , address=45.91.116.12:4225 , piece_id=M7NFP2QJD5JTMJXROZSXKW6LAJ45WTJJ4XOJLBD4UQEDJJSEY4RA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.266372465 (266h47m0.448817446s) [noise=true , address=145.79.227.47:4265 , piece_id=RQLMIDMVU45GIR2VOBZQRVLZEEKI4TEU4EJVTLLNLKDHAS3GSGTQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.266739602 (266h47m0.449184583s) [noise=true , address=45.91.116.7:4010 , piece_id=3RADWMUAMQOTQQF3YLXSJJOWSQRZEWVZJQXPHMADDWYQIKJX6UCA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267056043 (266h47m0.449501013s) [noise=true , address=145.79.227.13:4803 , piece_id=TVP3SVAKCCCFAOOVG3DAPLEAAL3IFP76TCQ4LN43I2TQNDZT7DGA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267372755 (266h47m0.449817725s) [noise=true , address=45.91.116.9:4261 , piece_id=BWWCW3CPBTPWOF4K2NUOXEZRMHZGILDOT335RY5TSZUJSETSF6BA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267627821 (266h47m0.450072801s) [noise=true , address=45.91.116.6:4976 , piece_id=6RKPBVLLDTIEYOBANAB4NRDYAY353LUCVAOAS2523RTXCVCDVO3A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267660202 (266h47m0.450105171s) [noise=true , address=145.79.227.33:4871 , piece_id=2VUU7K3BCWPKKHHU7CAXEBRITS6ED6WDFPU3ODBG2YPDTCZKWD3A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267886355 (266h47m0.450331325s) [noise=true , address=145.79.227.52:4446 , piece_id=SWREVABTLINLIKWZ5T4K4F6TAC5VF4PWHPPTIT2HVMEBFHRSNKEA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268219706 (266h47m0.450664677s) [noise=true , address=145.79.227.39:4013 , piece_id=IDWYWDFFNKZN5EY2THLNG57FF3JQNQVFVU6RF4MACLIEDF7ZV37A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268756349 (266h47m0.451201319s) [noise=true , address=145.79.227.48:4301 , piece_id=JYZZKQCYSWGQD3JTFIXNQ2UNLU4H2K7D2EAEB7EILRUHHWZG6X5A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268762169 (266h47m0.451207149s) [noise=true , address=145.79.227.46:4601 , piece_id=AWDYHRIULVSHJY4MMGUTV54D7WBTSRWTXUWX35HIYDNB63I4QPFQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268800502 (266h47m0.451245472s) [noise=true , address=145.79.227.51:4411 , piece_id=QX42UUIQRKDLVW2P4MDHGVM7YBDK4TB2LENZBVDLS4RMUQLPLHNQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269264038 (266h47m0.451709008s) [noise=true , address=145.79.227.22:4511 , piece_id=OGUKV6FBZNOYNTUO3A7M3Z532KQZH2K5AQIDPUKD3RYDPXFHBAEQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269456296 (266h47m0.451901276s) [noise=true , address=145.79.227.37:4565 , piece_id=JQVIFKPIBMXFTYYTHF3Q7DKEIFSMKV6FBXFOIZ4HJEDCT3S7YGJA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269827900 (266h47m0.45227287s) [noise=true , address=45.91.116.14:4191 , piece_id=HAYM5NIRM2ELGZ7FO7L2EY3HMAAED7JWEC4V7SD3BDHEADELNWUA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.270230122 (266h47m0.452675091s) [noise=true , address=145.79.227.24:4583 , piece_id=7ITWHDHIII3LFUA2AD3UQBXFXP43CFDIK4NKHYDD2BTGJII2WRBA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.346167333 (266h47m0.528612314s) [upload=234289]: Next returned nil segment Jan 26 18:43:22.346177152 (266h47m0.528622132s) [upload=234289]: Waiting for error group managing segments... Jan 26 18:43:22.355942092 (266h47m0.538387072s) [noise=true , address=145.79.227.52:4446 , piece_id=SWREVABTLINLIKWZ5T4K4F6TAC5VF4PWHPPTIT2HVMEBFHRSNKEA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.356544547 (266h47m0.538989517s) [noise=true , address=145.79.227.51:4411 , piece_id=QX42UUIQRKDLVW2P4MDHGVM7YBDK4TB2LENZBVDLS4RMUQLPLHNQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357475265 (266h47m0.539920235s) [noise=true , address=145.79.227.48:4301 , piece_id=JYZZKQCYSWGQD3JTFIXNQ2UNLU4H2K7D2EAEB7EILRUHHWZG6X5A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357741102 (266h47m0.540186082s) [noise=true , address=145.79.227.47:4265 , piece_id=RQLMIDMVU45GIR2VOBZQRVLZEEKI4TEU4EJVTLLNLKDHAS3GSGTQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357892725 (266h47m0.540337705s) [noise=true , address=145.79.227.24:4583 , piece_id=7ITWHDHIII3LFUA2AD3UQBXFXP43CFDIK4NKHYDD2BTGJII2WRBA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358205700 (266h47m0.54065068s) [noise=true , address=145.79.227.39:4013 , piece_id=IDWYWDFFNKZN5EY2THLNG57FF3JQNQVFVU6RF4MACLIEDF7ZV37A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358277304 (266h47m0.540722284s) [noise=true , address=145.79.227.46:4601 , piece_id=AWDYHRIULVSHJY4MMGUTV54D7WBTSRWTXUWX35HIYDNB63I4QPFQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358633879 (266h47m0.541078859s) [noise=true , address=145.79.227.13:4803 , piece_id=TVP3SVAKCCCFAOOVG3DAPLEAAL3IFP76TCQ4LN43I2TQNDZT7DGA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.359212861 (266h47m0.541657832s) [noise=true , address=145.79.227.33:4871 , piece_id=2VUU7K3BCWPKKHHU7CAXEBRITS6ED6WDFPU3ODBG2YPDTCZKWD3A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.359410610 (266h47m0.54185559s) [noise=true , address=145.79.227.22:4511 , piece_id=OGUKV6FBZNOYNTUO3A7M3Z532KQZH2K5AQIDPUKD3RYDPXFHBAEQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.374088006 (266h47m0.556532976s) [noise=true , address=145.79.227.37:4565 , piece_id=JQVIFKPIBMXFTYYTHF3Q7DKEIFSMKV6FBXFOIZ4HJEDCT3S7YGJA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:52.233014687 (266h47m30.415459677s) [noise=true , address=45.91.116.9:4261 , piece_id=BWWCW3CPBTPWOF4K2NUOXEZRMHZGILDOT335RY5TSZUJSETSF6BA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection Jan 26 18:43:52.233783362 (266h47m30.416228333s) [noise=true , address=45.91.116.7:4010 , piece_id=3RADWMUAMQOTQQF3YLXSJJOWSQRZEWVZJQXPHMADDWYQIKJX6UCA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233815402 (266h47m30.416260362s) [noise=true , address=45.91.116.14:4191 , piece_id=HAYM5NIRM2ELGZ7FO7L2EY3HMAAED7JWEC4V7SD3BDHEADELNWUA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: read tcp 5.161.89.252:12188->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233921791 (266h47m30.416366771s) [noise=true , address=45.91.116.6:4976 , piece_id=6RKPBVLLDTIEYOBANAB4NRDYAY353LUCVAOAS2523RTXCVCDVO3A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:121tumRJ6tGiip2dumJr9ZWMoU5BA2HuLEwU5GxBxzTZjMhv3Pp, address:45.91.116.6:4976): protocol: write tcp 5.161.89.252:62910->45.91.116.6:4976: use of closed network connection; close tcp 5.161.89.252:62910->45.91.116.6:4976: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233966906 (266h47m30.416411876s) [noise=true , address=45.91.116.12:4225 , piece_id=M7NFP2QJD5JTMJXROZSXKW6LAJ45WTJJ4XOJLBD4UQEDJJSEY4RA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection; write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection Jan 26 18:43:52.233984328 (266h47m30.416429288s) [seg_pos={0 0}, upload=234289]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 26 18:43:52.255878794 (266h47m30.438323804s) [upload=234289]: Done uploading segments... Jan 26 18:43:52.255942072 (266h47m30.438387072s) [upload=234289]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 349.495825ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [............................XX..............................] duration: 509.547553ms trace: https://jaeger.dev.storj.io/trace/460a0499eabe6dd0 FAIL (2026-01-26 19:05:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 509.580546ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 622.990318ms trace: https://jaeger.dev.storj.io/trace/6fe61816dac9c35f FAIL (2026-01-26 19:05:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 623.005596ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 648.492329ms trace: https://jaeger.dev.storj.io/trace/6fe61816dac9c35f FAIL (2026-01-26 19:04:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 648.511203ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.............................XX.............................] duration: 572.922112ms trace: https://jaeger.dev.storj.io/trace/460a0499eabe6dd0 FAIL (2026-01-26 19:04:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 572.938963ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 322.454437ms trace: https://jaeger.dev.storj.io/trace/3bb5e6bb5aa7ad6b FAIL (2026-01-26 19:04:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 26 18:43:22.244729209 (266h47m0.42717419s) [upload=234289]: Starting upload Jan 26 18:43:22.244783651 (266h47m0.427228631s) [upload=234289]: Done starting upload Jan 26 18:43:22.244862287 (266h47m0.427307267s) [upload=234289]: Uploading segments... Jan 26 18:43:22.245010364 (266h47m0.427455334s) [upload=234289]: Got next segment. Inline: false Jan 26 18:43:22.245044468 (266h47m0.427489448s) [upload=234289]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 26 18:43:22.245048175 (266h47m0.427493155s) [upload=234289]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 26 18:43:22.266231092 (266h47m0.448676072s) [seg_pos={0 0}, upload=234289]: Begin upload segment... Jan 26 18:43:22.266262791 (266h47m0.448707761s) [seg_pos={0 0}, upload=234289]: Done begin upload segment. Jan 26 18:43:22.266285364 (266h47m0.448730334s) [noise=true , address=45.91.116.12:4225 , piece_id=M7NFP2QJD5JTMJXROZSXKW6LAJ45WTJJ4XOJLBD4UQEDJJSEY4RA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.266372465 (266h47m0.448817446s) [noise=true , address=145.79.227.47:4265 , piece_id=RQLMIDMVU45GIR2VOBZQRVLZEEKI4TEU4EJVTLLNLKDHAS3GSGTQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.266739602 (266h47m0.449184583s) [noise=true , address=45.91.116.7:4010 , piece_id=3RADWMUAMQOTQQF3YLXSJJOWSQRZEWVZJQXPHMADDWYQIKJX6UCA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267056043 (266h47m0.449501013s) [noise=true , address=145.79.227.13:4803 , piece_id=TVP3SVAKCCCFAOOVG3DAPLEAAL3IFP76TCQ4LN43I2TQNDZT7DGA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267372755 (266h47m0.449817725s) [noise=true , address=45.91.116.9:4261 , piece_id=BWWCW3CPBTPWOF4K2NUOXEZRMHZGILDOT335RY5TSZUJSETSF6BA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267627821 (266h47m0.450072801s) [noise=true , address=45.91.116.6:4976 , piece_id=6RKPBVLLDTIEYOBANAB4NRDYAY353LUCVAOAS2523RTXCVCDVO3A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267660202 (266h47m0.450105171s) [noise=true , address=145.79.227.33:4871 , piece_id=2VUU7K3BCWPKKHHU7CAXEBRITS6ED6WDFPU3ODBG2YPDTCZKWD3A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267886355 (266h47m0.450331325s) [noise=true , address=145.79.227.52:4446 , piece_id=SWREVABTLINLIKWZ5T4K4F6TAC5VF4PWHPPTIT2HVMEBFHRSNKEA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268219706 (266h47m0.450664677s) [noise=true , address=145.79.227.39:4013 , piece_id=IDWYWDFFNKZN5EY2THLNG57FF3JQNQVFVU6RF4MACLIEDF7ZV37A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268756349 (266h47m0.451201319s) [noise=true , address=145.79.227.48:4301 , piece_id=JYZZKQCYSWGQD3JTFIXNQ2UNLU4H2K7D2EAEB7EILRUHHWZG6X5A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268762169 (266h47m0.451207149s) [noise=true , address=145.79.227.46:4601 , piece_id=AWDYHRIULVSHJY4MMGUTV54D7WBTSRWTXUWX35HIYDNB63I4QPFQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268800502 (266h47m0.451245472s) [noise=true , address=145.79.227.51:4411 , piece_id=QX42UUIQRKDLVW2P4MDHGVM7YBDK4TB2LENZBVDLS4RMUQLPLHNQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269264038 (266h47m0.451709008s) [noise=true , address=145.79.227.22:4511 , piece_id=OGUKV6FBZNOYNTUO3A7M3Z532KQZH2K5AQIDPUKD3RYDPXFHBAEQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269456296 (266h47m0.451901276s) [noise=true , address=145.79.227.37:4565 , piece_id=JQVIFKPIBMXFTYYTHF3Q7DKEIFSMKV6FBXFOIZ4HJEDCT3S7YGJA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269827900 (266h47m0.45227287s) [noise=true , address=45.91.116.14:4191 , piece_id=HAYM5NIRM2ELGZ7FO7L2EY3HMAAED7JWEC4V7SD3BDHEADELNWUA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.270230122 (266h47m0.452675091s) [noise=true , address=145.79.227.24:4583 , piece_id=7ITWHDHIII3LFUA2AD3UQBXFXP43CFDIK4NKHYDD2BTGJII2WRBA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.346167333 (266h47m0.528612314s) [upload=234289]: Next returned nil segment Jan 26 18:43:22.346177152 (266h47m0.528622132s) [upload=234289]: Waiting for error group managing segments... Jan 26 18:43:22.355942092 (266h47m0.538387072s) [noise=true , address=145.79.227.52:4446 , piece_id=SWREVABTLINLIKWZ5T4K4F6TAC5VF4PWHPPTIT2HVMEBFHRSNKEA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.356544547 (266h47m0.538989517s) [noise=true , address=145.79.227.51:4411 , piece_id=QX42UUIQRKDLVW2P4MDHGVM7YBDK4TB2LENZBVDLS4RMUQLPLHNQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357475265 (266h47m0.539920235s) [noise=true , address=145.79.227.48:4301 , piece_id=JYZZKQCYSWGQD3JTFIXNQ2UNLU4H2K7D2EAEB7EILRUHHWZG6X5A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357741102 (266h47m0.540186082s) [noise=true , address=145.79.227.47:4265 , piece_id=RQLMIDMVU45GIR2VOBZQRVLZEEKI4TEU4EJVTLLNLKDHAS3GSGTQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357892725 (266h47m0.540337705s) [noise=true , address=145.79.227.24:4583 , piece_id=7ITWHDHIII3LFUA2AD3UQBXFXP43CFDIK4NKHYDD2BTGJII2WRBA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358205700 (266h47m0.54065068s) [noise=true , address=145.79.227.39:4013 , piece_id=IDWYWDFFNKZN5EY2THLNG57FF3JQNQVFVU6RF4MACLIEDF7ZV37A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358277304 (266h47m0.540722284s) [noise=true , address=145.79.227.46:4601 , piece_id=AWDYHRIULVSHJY4MMGUTV54D7WBTSRWTXUWX35HIYDNB63I4QPFQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358633879 (266h47m0.541078859s) [noise=true , address=145.79.227.13:4803 , piece_id=TVP3SVAKCCCFAOOVG3DAPLEAAL3IFP76TCQ4LN43I2TQNDZT7DGA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.359212861 (266h47m0.541657832s) [noise=true , address=145.79.227.33:4871 , piece_id=2VUU7K3BCWPKKHHU7CAXEBRITS6ED6WDFPU3ODBG2YPDTCZKWD3A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.359410610 (266h47m0.54185559s) [noise=true , address=145.79.227.22:4511 , piece_id=OGUKV6FBZNOYNTUO3A7M3Z532KQZH2K5AQIDPUKD3RYDPXFHBAEQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.374088006 (266h47m0.556532976s) [noise=true , address=145.79.227.37:4565 , piece_id=JQVIFKPIBMXFTYYTHF3Q7DKEIFSMKV6FBXFOIZ4HJEDCT3S7YGJA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:52.233014687 (266h47m30.415459677s) [noise=true , address=45.91.116.9:4261 , piece_id=BWWCW3CPBTPWOF4K2NUOXEZRMHZGILDOT335RY5TSZUJSETSF6BA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection Jan 26 18:43:52.233783362 (266h47m30.416228333s) [noise=true , address=45.91.116.7:4010 , piece_id=3RADWMUAMQOTQQF3YLXSJJOWSQRZEWVZJQXPHMADDWYQIKJX6UCA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233815402 (266h47m30.416260362s) [noise=true , address=45.91.116.14:4191 , piece_id=HAYM5NIRM2ELGZ7FO7L2EY3HMAAED7JWEC4V7SD3BDHEADELNWUA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: read tcp 5.161.89.252:12188->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233921791 (266h47m30.416366771s) [noise=true , address=45.91.116.6:4976 , piece_id=6RKPBVLLDTIEYOBANAB4NRDYAY353LUCVAOAS2523RTXCVCDVO3A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:121tumRJ6tGiip2dumJr9ZWMoU5BA2HuLEwU5GxBxzTZjMhv3Pp, address:45.91.116.6:4976): protocol: write tcp 5.161.89.252:62910->45.91.116.6:4976: use of closed network connection; close tcp 5.161.89.252:62910->45.91.116.6:4976: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233966906 (266h47m30.416411876s) [noise=true , address=45.91.116.12:4225 , piece_id=M7NFP2QJD5JTMJXROZSXKW6LAJ45WTJJ4XOJLBD4UQEDJJSEY4RA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection; write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection Jan 26 18:43:52.233984328 (266h47m30.416429288s) [seg_pos={0 0}, upload=234289]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 26 18:43:52.255878794 (266h47m30.438323804s) [upload=234289]: Done uploading segments... Jan 26 18:43:52.255942072 (266h47m30.438387072s) [upload=234289]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 322.468555ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 361.571299ms trace: https://jaeger.dev.storj.io/trace/3bb5e6bb5aa7ad6b FAIL (2026-01-26 19:04:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 26 18:43:22.244729209 (266h47m0.42717419s) [upload=234289]: Starting upload Jan 26 18:43:22.244783651 (266h47m0.427228631s) [upload=234289]: Done starting upload Jan 26 18:43:22.244862287 (266h47m0.427307267s) [upload=234289]: Uploading segments... Jan 26 18:43:22.245010364 (266h47m0.427455334s) [upload=234289]: Got next segment. Inline: false Jan 26 18:43:22.245044468 (266h47m0.427489448s) [upload=234289]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 26 18:43:22.245048175 (266h47m0.427493155s) [upload=234289]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 26 18:43:22.266231092 (266h47m0.448676072s) [seg_pos={0 0}, upload=234289]: Begin upload segment... Jan 26 18:43:22.266262791 (266h47m0.448707761s) [seg_pos={0 0}, upload=234289]: Done begin upload segment. Jan 26 18:43:22.266285364 (266h47m0.448730334s) [noise=true , address=45.91.116.12:4225 , piece_id=M7NFP2QJD5JTMJXROZSXKW6LAJ45WTJJ4XOJLBD4UQEDJJSEY4RA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.266372465 (266h47m0.448817446s) [noise=true , address=145.79.227.47:4265 , piece_id=RQLMIDMVU45GIR2VOBZQRVLZEEKI4TEU4EJVTLLNLKDHAS3GSGTQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.266739602 (266h47m0.449184583s) [noise=true , address=45.91.116.7:4010 , piece_id=3RADWMUAMQOTQQF3YLXSJJOWSQRZEWVZJQXPHMADDWYQIKJX6UCA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267056043 (266h47m0.449501013s) [noise=true , address=145.79.227.13:4803 , piece_id=TVP3SVAKCCCFAOOVG3DAPLEAAL3IFP76TCQ4LN43I2TQNDZT7DGA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267372755 (266h47m0.449817725s) [noise=true , address=45.91.116.9:4261 , piece_id=BWWCW3CPBTPWOF4K2NUOXEZRMHZGILDOT335RY5TSZUJSETSF6BA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267627821 (266h47m0.450072801s) [noise=true , address=45.91.116.6:4976 , piece_id=6RKPBVLLDTIEYOBANAB4NRDYAY353LUCVAOAS2523RTXCVCDVO3A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267660202 (266h47m0.450105171s) [noise=true , address=145.79.227.33:4871 , piece_id=2VUU7K3BCWPKKHHU7CAXEBRITS6ED6WDFPU3ODBG2YPDTCZKWD3A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267886355 (266h47m0.450331325s) [noise=true , address=145.79.227.52:4446 , piece_id=SWREVABTLINLIKWZ5T4K4F6TAC5VF4PWHPPTIT2HVMEBFHRSNKEA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268219706 (266h47m0.450664677s) [noise=true , address=145.79.227.39:4013 , piece_id=IDWYWDFFNKZN5EY2THLNG57FF3JQNQVFVU6RF4MACLIEDF7ZV37A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268756349 (266h47m0.451201319s) [noise=true , address=145.79.227.48:4301 , piece_id=JYZZKQCYSWGQD3JTFIXNQ2UNLU4H2K7D2EAEB7EILRUHHWZG6X5A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268762169 (266h47m0.451207149s) [noise=true , address=145.79.227.46:4601 , piece_id=AWDYHRIULVSHJY4MMGUTV54D7WBTSRWTXUWX35HIYDNB63I4QPFQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268800502 (266h47m0.451245472s) [noise=true , address=145.79.227.51:4411 , piece_id=QX42UUIQRKDLVW2P4MDHGVM7YBDK4TB2LENZBVDLS4RMUQLPLHNQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269264038 (266h47m0.451709008s) [noise=true , address=145.79.227.22:4511 , piece_id=OGUKV6FBZNOYNTUO3A7M3Z532KQZH2K5AQIDPUKD3RYDPXFHBAEQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269456296 (266h47m0.451901276s) [noise=true , address=145.79.227.37:4565 , piece_id=JQVIFKPIBMXFTYYTHF3Q7DKEIFSMKV6FBXFOIZ4HJEDCT3S7YGJA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269827900 (266h47m0.45227287s) [noise=true , address=45.91.116.14:4191 , piece_id=HAYM5NIRM2ELGZ7FO7L2EY3HMAAED7JWEC4V7SD3BDHEADELNWUA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.270230122 (266h47m0.452675091s) [noise=true , address=145.79.227.24:4583 , piece_id=7ITWHDHIII3LFUA2AD3UQBXFXP43CFDIK4NKHYDD2BTGJII2WRBA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.346167333 (266h47m0.528612314s) [upload=234289]: Next returned nil segment Jan 26 18:43:22.346177152 (266h47m0.528622132s) [upload=234289]: Waiting for error group managing segments... Jan 26 18:43:22.355942092 (266h47m0.538387072s) [noise=true , address=145.79.227.52:4446 , piece_id=SWREVABTLINLIKWZ5T4K4F6TAC5VF4PWHPPTIT2HVMEBFHRSNKEA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.356544547 (266h47m0.538989517s) [noise=true , address=145.79.227.51:4411 , piece_id=QX42UUIQRKDLVW2P4MDHGVM7YBDK4TB2LENZBVDLS4RMUQLPLHNQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357475265 (266h47m0.539920235s) [noise=true , address=145.79.227.48:4301 , piece_id=JYZZKQCYSWGQD3JTFIXNQ2UNLU4H2K7D2EAEB7EILRUHHWZG6X5A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357741102 (266h47m0.540186082s) [noise=true , address=145.79.227.47:4265 , piece_id=RQLMIDMVU45GIR2VOBZQRVLZEEKI4TEU4EJVTLLNLKDHAS3GSGTQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357892725 (266h47m0.540337705s) [noise=true , address=145.79.227.24:4583 , piece_id=7ITWHDHIII3LFUA2AD3UQBXFXP43CFDIK4NKHYDD2BTGJII2WRBA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358205700 (266h47m0.54065068s) [noise=true , address=145.79.227.39:4013 , piece_id=IDWYWDFFNKZN5EY2THLNG57FF3JQNQVFVU6RF4MACLIEDF7ZV37A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358277304 (266h47m0.540722284s) [noise=true , address=145.79.227.46:4601 , piece_id=AWDYHRIULVSHJY4MMGUTV54D7WBTSRWTXUWX35HIYDNB63I4QPFQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358633879 (266h47m0.541078859s) [noise=true , address=145.79.227.13:4803 , piece_id=TVP3SVAKCCCFAOOVG3DAPLEAAL3IFP76TCQ4LN43I2TQNDZT7DGA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.359212861 (266h47m0.541657832s) [noise=true , address=145.79.227.33:4871 , piece_id=2VUU7K3BCWPKKHHU7CAXEBRITS6ED6WDFPU3ODBG2YPDTCZKWD3A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.359410610 (266h47m0.54185559s) [noise=true , address=145.79.227.22:4511 , piece_id=OGUKV6FBZNOYNTUO3A7M3Z532KQZH2K5AQIDPUKD3RYDPXFHBAEQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.374088006 (266h47m0.556532976s) [noise=true , address=145.79.227.37:4565 , piece_id=JQVIFKPIBMXFTYYTHF3Q7DKEIFSMKV6FBXFOIZ4HJEDCT3S7YGJA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:52.233014687 (266h47m30.415459677s) [noise=true , address=45.91.116.9:4261 , piece_id=BWWCW3CPBTPWOF4K2NUOXEZRMHZGILDOT335RY5TSZUJSETSF6BA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection Jan 26 18:43:52.233783362 (266h47m30.416228333s) [noise=true , address=45.91.116.7:4010 , piece_id=3RADWMUAMQOTQQF3YLXSJJOWSQRZEWVZJQXPHMADDWYQIKJX6UCA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233815402 (266h47m30.416260362s) [noise=true , address=45.91.116.14:4191 , piece_id=HAYM5NIRM2ELGZ7FO7L2EY3HMAAED7JWEC4V7SD3BDHEADELNWUA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: read tcp 5.161.89.252:12188->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233921791 (266h47m30.416366771s) [noise=true , address=45.91.116.6:4976 , piece_id=6RKPBVLLDTIEYOBANAB4NRDYAY353LUCVAOAS2523RTXCVCDVO3A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:121tumRJ6tGiip2dumJr9ZWMoU5BA2HuLEwU5GxBxzTZjMhv3Pp, address:45.91.116.6:4976): protocol: write tcp 5.161.89.252:62910->45.91.116.6:4976: use of closed network connection; close tcp 5.161.89.252:62910->45.91.116.6:4976: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233966906 (266h47m30.416411876s) [noise=true , address=45.91.116.12:4225 , piece_id=M7NFP2QJD5JTMJXROZSXKW6LAJ45WTJJ4XOJLBD4UQEDJJSEY4RA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection; write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection Jan 26 18:43:52.233984328 (266h47m30.416429288s) [seg_pos={0 0}, upload=234289]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 26 18:43:52.255878794 (266h47m30.438323804s) [upload=234289]: Done uploading segments... Jan 26 18:43:52.255942072 (266h47m30.438387072s) [upload=234289]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 361.591057ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 597.193276ms trace: https://jaeger.dev.storj.io/trace/6fe61816dac9c35f FAIL (2026-01-26 19:03:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 597.208174ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [..............................XX............................] duration: 764.595593ms trace: https://jaeger.dev.storj.io/trace/460a0499eabe6dd0 FAIL (2026-01-26 19:03:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 764.636729ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 630.249839ms trace: https://jaeger.dev.storj.io/trace/6fe61816dac9c35f FAIL (2026-01-26 19:03:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 630.273832ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 594.16089ms trace: https://jaeger.dev.storj.io/trace/6fe61816dac9c35f FAIL (2026-01-26 19:03:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 594.183402ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 356.310356ms trace: https://jaeger.dev.storj.io/trace/3bb5e6bb5aa7ad6b FAIL (2026-01-26 19:03:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 26 18:43:22.244729209 (266h47m0.42717419s) [upload=234289]: Starting upload Jan 26 18:43:22.244783651 (266h47m0.427228631s) [upload=234289]: Done starting upload Jan 26 18:43:22.244862287 (266h47m0.427307267s) [upload=234289]: Uploading segments... Jan 26 18:43:22.245010364 (266h47m0.427455334s) [upload=234289]: Got next segment. Inline: false Jan 26 18:43:22.245044468 (266h47m0.427489448s) [upload=234289]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 26 18:43:22.245048175 (266h47m0.427493155s) [upload=234289]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 26 18:43:22.266231092 (266h47m0.448676072s) [seg_pos={0 0}, upload=234289]: Begin upload segment... Jan 26 18:43:22.266262791 (266h47m0.448707761s) [seg_pos={0 0}, upload=234289]: Done begin upload segment. Jan 26 18:43:22.266285364 (266h47m0.448730334s) [noise=true , address=45.91.116.12:4225 , piece_id=M7NFP2QJD5JTMJXROZSXKW6LAJ45WTJJ4XOJLBD4UQEDJJSEY4RA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.266372465 (266h47m0.448817446s) [noise=true , address=145.79.227.47:4265 , piece_id=RQLMIDMVU45GIR2VOBZQRVLZEEKI4TEU4EJVTLLNLKDHAS3GSGTQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.266739602 (266h47m0.449184583s) [noise=true , address=45.91.116.7:4010 , piece_id=3RADWMUAMQOTQQF3YLXSJJOWSQRZEWVZJQXPHMADDWYQIKJX6UCA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267056043 (266h47m0.449501013s) [noise=true , address=145.79.227.13:4803 , piece_id=TVP3SVAKCCCFAOOVG3DAPLEAAL3IFP76TCQ4LN43I2TQNDZT7DGA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267372755 (266h47m0.449817725s) [noise=true , address=45.91.116.9:4261 , piece_id=BWWCW3CPBTPWOF4K2NUOXEZRMHZGILDOT335RY5TSZUJSETSF6BA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267627821 (266h47m0.450072801s) [noise=true , address=45.91.116.6:4976 , piece_id=6RKPBVLLDTIEYOBANAB4NRDYAY353LUCVAOAS2523RTXCVCDVO3A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267660202 (266h47m0.450105171s) [noise=true , address=145.79.227.33:4871 , piece_id=2VUU7K3BCWPKKHHU7CAXEBRITS6ED6WDFPU3ODBG2YPDTCZKWD3A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267886355 (266h47m0.450331325s) [noise=true , address=145.79.227.52:4446 , piece_id=SWREVABTLINLIKWZ5T4K4F6TAC5VF4PWHPPTIT2HVMEBFHRSNKEA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268219706 (266h47m0.450664677s) [noise=true , address=145.79.227.39:4013 , piece_id=IDWYWDFFNKZN5EY2THLNG57FF3JQNQVFVU6RF4MACLIEDF7ZV37A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268756349 (266h47m0.451201319s) [noise=true , address=145.79.227.48:4301 , piece_id=JYZZKQCYSWGQD3JTFIXNQ2UNLU4H2K7D2EAEB7EILRUHHWZG6X5A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268762169 (266h47m0.451207149s) [noise=true , address=145.79.227.46:4601 , piece_id=AWDYHRIULVSHJY4MMGUTV54D7WBTSRWTXUWX35HIYDNB63I4QPFQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268800502 (266h47m0.451245472s) [noise=true , address=145.79.227.51:4411 , piece_id=QX42UUIQRKDLVW2P4MDHGVM7YBDK4TB2LENZBVDLS4RMUQLPLHNQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269264038 (266h47m0.451709008s) [noise=true , address=145.79.227.22:4511 , piece_id=OGUKV6FBZNOYNTUO3A7M3Z532KQZH2K5AQIDPUKD3RYDPXFHBAEQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269456296 (266h47m0.451901276s) [noise=true , address=145.79.227.37:4565 , piece_id=JQVIFKPIBMXFTYYTHF3Q7DKEIFSMKV6FBXFOIZ4HJEDCT3S7YGJA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269827900 (266h47m0.45227287s) [noise=true , address=45.91.116.14:4191 , piece_id=HAYM5NIRM2ELGZ7FO7L2EY3HMAAED7JWEC4V7SD3BDHEADELNWUA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.270230122 (266h47m0.452675091s) [noise=true , address=145.79.227.24:4583 , piece_id=7ITWHDHIII3LFUA2AD3UQBXFXP43CFDIK4NKHYDD2BTGJII2WRBA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.346167333 (266h47m0.528612314s) [upload=234289]: Next returned nil segment Jan 26 18:43:22.346177152 (266h47m0.528622132s) [upload=234289]: Waiting for error group managing segments... Jan 26 18:43:22.355942092 (266h47m0.538387072s) [noise=true , address=145.79.227.52:4446 , piece_id=SWREVABTLINLIKWZ5T4K4F6TAC5VF4PWHPPTIT2HVMEBFHRSNKEA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.356544547 (266h47m0.538989517s) [noise=true , address=145.79.227.51:4411 , piece_id=QX42UUIQRKDLVW2P4MDHGVM7YBDK4TB2LENZBVDLS4RMUQLPLHNQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357475265 (266h47m0.539920235s) [noise=true , address=145.79.227.48:4301 , piece_id=JYZZKQCYSWGQD3JTFIXNQ2UNLU4H2K7D2EAEB7EILRUHHWZG6X5A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357741102 (266h47m0.540186082s) [noise=true , address=145.79.227.47:4265 , piece_id=RQLMIDMVU45GIR2VOBZQRVLZEEKI4TEU4EJVTLLNLKDHAS3GSGTQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357892725 (266h47m0.540337705s) [noise=true , address=145.79.227.24:4583 , piece_id=7ITWHDHIII3LFUA2AD3UQBXFXP43CFDIK4NKHYDD2BTGJII2WRBA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358205700 (266h47m0.54065068s) [noise=true , address=145.79.227.39:4013 , piece_id=IDWYWDFFNKZN5EY2THLNG57FF3JQNQVFVU6RF4MACLIEDF7ZV37A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358277304 (266h47m0.540722284s) [noise=true , address=145.79.227.46:4601 , piece_id=AWDYHRIULVSHJY4MMGUTV54D7WBTSRWTXUWX35HIYDNB63I4QPFQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358633879 (266h47m0.541078859s) [noise=true , address=145.79.227.13:4803 , piece_id=TVP3SVAKCCCFAOOVG3DAPLEAAL3IFP76TCQ4LN43I2TQNDZT7DGA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.359212861 (266h47m0.541657832s) [noise=true , address=145.79.227.33:4871 , piece_id=2VUU7K3BCWPKKHHU7CAXEBRITS6ED6WDFPU3ODBG2YPDTCZKWD3A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.359410610 (266h47m0.54185559s) [noise=true , address=145.79.227.22:4511 , piece_id=OGUKV6FBZNOYNTUO3A7M3Z532KQZH2K5AQIDPUKD3RYDPXFHBAEQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.374088006 (266h47m0.556532976s) [noise=true , address=145.79.227.37:4565 , piece_id=JQVIFKPIBMXFTYYTHF3Q7DKEIFSMKV6FBXFOIZ4HJEDCT3S7YGJA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:52.233014687 (266h47m30.415459677s) [noise=true , address=45.91.116.9:4261 , piece_id=BWWCW3CPBTPWOF4K2NUOXEZRMHZGILDOT335RY5TSZUJSETSF6BA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection Jan 26 18:43:52.233783362 (266h47m30.416228333s) [noise=true , address=45.91.116.7:4010 , piece_id=3RADWMUAMQOTQQF3YLXSJJOWSQRZEWVZJQXPHMADDWYQIKJX6UCA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233815402 (266h47m30.416260362s) [noise=true , address=45.91.116.14:4191 , piece_id=HAYM5NIRM2ELGZ7FO7L2EY3HMAAED7JWEC4V7SD3BDHEADELNWUA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: read tcp 5.161.89.252:12188->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233921791 (266h47m30.416366771s) [noise=true , address=45.91.116.6:4976 , piece_id=6RKPBVLLDTIEYOBANAB4NRDYAY353LUCVAOAS2523RTXCVCDVO3A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:121tumRJ6tGiip2dumJr9ZWMoU5BA2HuLEwU5GxBxzTZjMhv3Pp, address:45.91.116.6:4976): protocol: write tcp 5.161.89.252:62910->45.91.116.6:4976: use of closed network connection; close tcp 5.161.89.252:62910->45.91.116.6:4976: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233966906 (266h47m30.416411876s) [noise=true , address=45.91.116.12:4225 , piece_id=M7NFP2QJD5JTMJXROZSXKW6LAJ45WTJJ4XOJLBD4UQEDJJSEY4RA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection; write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection Jan 26 18:43:52.233984328 (266h47m30.416429288s) [seg_pos={0 0}, upload=234289]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 26 18:43:52.255878794 (266h47m30.438323804s) [upload=234289]: Done uploading segments... Jan 26 18:43:52.255942072 (266h47m30.438387072s) [upload=234289]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 356.330331ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [...............................XX...........................] duration: 503.218532ms trace: https://jaeger.dev.storj.io/trace/460a0499eabe6dd0 FAIL (2026-01-26 19:02:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 503.233008ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 596.754496ms trace: https://jaeger.dev.storj.io/trace/6fe61816dac9c35f FAIL (2026-01-26 19:02:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 596.778501ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 319.278887ms trace: https://jaeger.dev.storj.io/trace/3bb5e6bb5aa7ad6b FAIL (2026-01-26 19:01:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 26 18:43:22.244729209 (266h47m0.42717419s) [upload=234289]: Starting upload Jan 26 18:43:22.244783651 (266h47m0.427228631s) [upload=234289]: Done starting upload Jan 26 18:43:22.244862287 (266h47m0.427307267s) [upload=234289]: Uploading segments... Jan 26 18:43:22.245010364 (266h47m0.427455334s) [upload=234289]: Got next segment. Inline: false Jan 26 18:43:22.245044468 (266h47m0.427489448s) [upload=234289]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 26 18:43:22.245048175 (266h47m0.427493155s) [upload=234289]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 26 18:43:22.266231092 (266h47m0.448676072s) [seg_pos={0 0}, upload=234289]: Begin upload segment... Jan 26 18:43:22.266262791 (266h47m0.448707761s) [seg_pos={0 0}, upload=234289]: Done begin upload segment. Jan 26 18:43:22.266285364 (266h47m0.448730334s) [noise=true , address=45.91.116.12:4225 , piece_id=M7NFP2QJD5JTMJXROZSXKW6LAJ45WTJJ4XOJLBD4UQEDJJSEY4RA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.266372465 (266h47m0.448817446s) [noise=true , address=145.79.227.47:4265 , piece_id=RQLMIDMVU45GIR2VOBZQRVLZEEKI4TEU4EJVTLLNLKDHAS3GSGTQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.266739602 (266h47m0.449184583s) [noise=true , address=45.91.116.7:4010 , piece_id=3RADWMUAMQOTQQF3YLXSJJOWSQRZEWVZJQXPHMADDWYQIKJX6UCA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267056043 (266h47m0.449501013s) [noise=true , address=145.79.227.13:4803 , piece_id=TVP3SVAKCCCFAOOVG3DAPLEAAL3IFP76TCQ4LN43I2TQNDZT7DGA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267372755 (266h47m0.449817725s) [noise=true , address=45.91.116.9:4261 , piece_id=BWWCW3CPBTPWOF4K2NUOXEZRMHZGILDOT335RY5TSZUJSETSF6BA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267627821 (266h47m0.450072801s) [noise=true , address=45.91.116.6:4976 , piece_id=6RKPBVLLDTIEYOBANAB4NRDYAY353LUCVAOAS2523RTXCVCDVO3A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267660202 (266h47m0.450105171s) [noise=true , address=145.79.227.33:4871 , piece_id=2VUU7K3BCWPKKHHU7CAXEBRITS6ED6WDFPU3ODBG2YPDTCZKWD3A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267886355 (266h47m0.450331325s) [noise=true , address=145.79.227.52:4446 , piece_id=SWREVABTLINLIKWZ5T4K4F6TAC5VF4PWHPPTIT2HVMEBFHRSNKEA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268219706 (266h47m0.450664677s) [noise=true , address=145.79.227.39:4013 , piece_id=IDWYWDFFNKZN5EY2THLNG57FF3JQNQVFVU6RF4MACLIEDF7ZV37A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268756349 (266h47m0.451201319s) [noise=true , address=145.79.227.48:4301 , piece_id=JYZZKQCYSWGQD3JTFIXNQ2UNLU4H2K7D2EAEB7EILRUHHWZG6X5A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268762169 (266h47m0.451207149s) [noise=true , address=145.79.227.46:4601 , piece_id=AWDYHRIULVSHJY4MMGUTV54D7WBTSRWTXUWX35HIYDNB63I4QPFQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268800502 (266h47m0.451245472s) [noise=true , address=145.79.227.51:4411 , piece_id=QX42UUIQRKDLVW2P4MDHGVM7YBDK4TB2LENZBVDLS4RMUQLPLHNQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269264038 (266h47m0.451709008s) [noise=true , address=145.79.227.22:4511 , piece_id=OGUKV6FBZNOYNTUO3A7M3Z532KQZH2K5AQIDPUKD3RYDPXFHBAEQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269456296 (266h47m0.451901276s) [noise=true , address=145.79.227.37:4565 , piece_id=JQVIFKPIBMXFTYYTHF3Q7DKEIFSMKV6FBXFOIZ4HJEDCT3S7YGJA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269827900 (266h47m0.45227287s) [noise=true , address=45.91.116.14:4191 , piece_id=HAYM5NIRM2ELGZ7FO7L2EY3HMAAED7JWEC4V7SD3BDHEADELNWUA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.270230122 (266h47m0.452675091s) [noise=true , address=145.79.227.24:4583 , piece_id=7ITWHDHIII3LFUA2AD3UQBXFXP43CFDIK4NKHYDD2BTGJII2WRBA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.346167333 (266h47m0.528612314s) [upload=234289]: Next returned nil segment Jan 26 18:43:22.346177152 (266h47m0.528622132s) [upload=234289]: Waiting for error group managing segments... Jan 26 18:43:22.355942092 (266h47m0.538387072s) [noise=true , address=145.79.227.52:4446 , piece_id=SWREVABTLINLIKWZ5T4K4F6TAC5VF4PWHPPTIT2HVMEBFHRSNKEA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.356544547 (266h47m0.538989517s) [noise=true , address=145.79.227.51:4411 , piece_id=QX42UUIQRKDLVW2P4MDHGVM7YBDK4TB2LENZBVDLS4RMUQLPLHNQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357475265 (266h47m0.539920235s) [noise=true , address=145.79.227.48:4301 , piece_id=JYZZKQCYSWGQD3JTFIXNQ2UNLU4H2K7D2EAEB7EILRUHHWZG6X5A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357741102 (266h47m0.540186082s) [noise=true , address=145.79.227.47:4265 , piece_id=RQLMIDMVU45GIR2VOBZQRVLZEEKI4TEU4EJVTLLNLKDHAS3GSGTQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357892725 (266h47m0.540337705s) [noise=true , address=145.79.227.24:4583 , piece_id=7ITWHDHIII3LFUA2AD3UQBXFXP43CFDIK4NKHYDD2BTGJII2WRBA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358205700 (266h47m0.54065068s) [noise=true , address=145.79.227.39:4013 , piece_id=IDWYWDFFNKZN5EY2THLNG57FF3JQNQVFVU6RF4MACLIEDF7ZV37A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358277304 (266h47m0.540722284s) [noise=true , address=145.79.227.46:4601 , piece_id=AWDYHRIULVSHJY4MMGUTV54D7WBTSRWTXUWX35HIYDNB63I4QPFQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358633879 (266h47m0.541078859s) [noise=true , address=145.79.227.13:4803 , piece_id=TVP3SVAKCCCFAOOVG3DAPLEAAL3IFP76TCQ4LN43I2TQNDZT7DGA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.359212861 (266h47m0.541657832s) [noise=true , address=145.79.227.33:4871 , piece_id=2VUU7K3BCWPKKHHU7CAXEBRITS6ED6WDFPU3ODBG2YPDTCZKWD3A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.359410610 (266h47m0.54185559s) [noise=true , address=145.79.227.22:4511 , piece_id=OGUKV6FBZNOYNTUO3A7M3Z532KQZH2K5AQIDPUKD3RYDPXFHBAEQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.374088006 (266h47m0.556532976s) [noise=true , address=145.79.227.37:4565 , piece_id=JQVIFKPIBMXFTYYTHF3Q7DKEIFSMKV6FBXFOIZ4HJEDCT3S7YGJA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:52.233014687 (266h47m30.415459677s) [noise=true , address=45.91.116.9:4261 , piece_id=BWWCW3CPBTPWOF4K2NUOXEZRMHZGILDOT335RY5TSZUJSETSF6BA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection Jan 26 18:43:52.233783362 (266h47m30.416228333s) [noise=true , address=45.91.116.7:4010 , piece_id=3RADWMUAMQOTQQF3YLXSJJOWSQRZEWVZJQXPHMADDWYQIKJX6UCA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233815402 (266h47m30.416260362s) [noise=true , address=45.91.116.14:4191 , piece_id=HAYM5NIRM2ELGZ7FO7L2EY3HMAAED7JWEC4V7SD3BDHEADELNWUA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: read tcp 5.161.89.252:12188->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233921791 (266h47m30.416366771s) [noise=true , address=45.91.116.6:4976 , piece_id=6RKPBVLLDTIEYOBANAB4NRDYAY353LUCVAOAS2523RTXCVCDVO3A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:121tumRJ6tGiip2dumJr9ZWMoU5BA2HuLEwU5GxBxzTZjMhv3Pp, address:45.91.116.6:4976): protocol: write tcp 5.161.89.252:62910->45.91.116.6:4976: use of closed network connection; close tcp 5.161.89.252:62910->45.91.116.6:4976: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233966906 (266h47m30.416411876s) [noise=true , address=45.91.116.12:4225 , piece_id=M7NFP2QJD5JTMJXROZSXKW6LAJ45WTJJ4XOJLBD4UQEDJJSEY4RA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection; write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection Jan 26 18:43:52.233984328 (266h47m30.416429288s) [seg_pos={0 0}, upload=234289]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 26 18:43:52.255878794 (266h47m30.438323804s) [upload=234289]: Done uploading segments... Jan 26 18:43:52.255942072 (266h47m30.438387072s) [upload=234289]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 319.300368ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [................................XX..........................] duration: 707.85828ms trace: https://jaeger.dev.storj.io/trace/460a0499eabe6dd0 FAIL (2026-01-26 19:01:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 707.877466ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.................................XX.........................] duration: 504.662826ms trace: https://jaeger.dev.storj.io/trace/460a0499eabe6dd0 FAIL (2026-01-26 19:01:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 504.685609ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 587.410374ms trace: https://jaeger.dev.storj.io/trace/6fe61816dac9c35f FAIL (2026-01-26 19:01:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 587.433627ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 341.860254ms trace: https://jaeger.dev.storj.io/trace/3bb5e6bb5aa7ad6b FAIL (2026-01-26 19:00:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 26 18:43:22.244729209 (266h47m0.42717419s) [upload=234289]: Starting upload Jan 26 18:43:22.244783651 (266h47m0.427228631s) [upload=234289]: Done starting upload Jan 26 18:43:22.244862287 (266h47m0.427307267s) [upload=234289]: Uploading segments... Jan 26 18:43:22.245010364 (266h47m0.427455334s) [upload=234289]: Got next segment. Inline: false Jan 26 18:43:22.245044468 (266h47m0.427489448s) [upload=234289]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 26 18:43:22.245048175 (266h47m0.427493155s) [upload=234289]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 26 18:43:22.266231092 (266h47m0.448676072s) [seg_pos={0 0}, upload=234289]: Begin upload segment... Jan 26 18:43:22.266262791 (266h47m0.448707761s) [seg_pos={0 0}, upload=234289]: Done begin upload segment. Jan 26 18:43:22.266285364 (266h47m0.448730334s) [noise=true , address=45.91.116.12:4225 , piece_id=M7NFP2QJD5JTMJXROZSXKW6LAJ45WTJJ4XOJLBD4UQEDJJSEY4RA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.266372465 (266h47m0.448817446s) [noise=true , address=145.79.227.47:4265 , piece_id=RQLMIDMVU45GIR2VOBZQRVLZEEKI4TEU4EJVTLLNLKDHAS3GSGTQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.266739602 (266h47m0.449184583s) [noise=true , address=45.91.116.7:4010 , piece_id=3RADWMUAMQOTQQF3YLXSJJOWSQRZEWVZJQXPHMADDWYQIKJX6UCA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267056043 (266h47m0.449501013s) [noise=true , address=145.79.227.13:4803 , piece_id=TVP3SVAKCCCFAOOVG3DAPLEAAL3IFP76TCQ4LN43I2TQNDZT7DGA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267372755 (266h47m0.449817725s) [noise=true , address=45.91.116.9:4261 , piece_id=BWWCW3CPBTPWOF4K2NUOXEZRMHZGILDOT335RY5TSZUJSETSF6BA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267627821 (266h47m0.450072801s) [noise=true , address=45.91.116.6:4976 , piece_id=6RKPBVLLDTIEYOBANAB4NRDYAY353LUCVAOAS2523RTXCVCDVO3A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267660202 (266h47m0.450105171s) [noise=true , address=145.79.227.33:4871 , piece_id=2VUU7K3BCWPKKHHU7CAXEBRITS6ED6WDFPU3ODBG2YPDTCZKWD3A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267886355 (266h47m0.450331325s) [noise=true , address=145.79.227.52:4446 , piece_id=SWREVABTLINLIKWZ5T4K4F6TAC5VF4PWHPPTIT2HVMEBFHRSNKEA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268219706 (266h47m0.450664677s) [noise=true , address=145.79.227.39:4013 , piece_id=IDWYWDFFNKZN5EY2THLNG57FF3JQNQVFVU6RF4MACLIEDF7ZV37A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268756349 (266h47m0.451201319s) [noise=true , address=145.79.227.48:4301 , piece_id=JYZZKQCYSWGQD3JTFIXNQ2UNLU4H2K7D2EAEB7EILRUHHWZG6X5A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268762169 (266h47m0.451207149s) [noise=true , address=145.79.227.46:4601 , piece_id=AWDYHRIULVSHJY4MMGUTV54D7WBTSRWTXUWX35HIYDNB63I4QPFQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268800502 (266h47m0.451245472s) [noise=true , address=145.79.227.51:4411 , piece_id=QX42UUIQRKDLVW2P4MDHGVM7YBDK4TB2LENZBVDLS4RMUQLPLHNQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269264038 (266h47m0.451709008s) [noise=true , address=145.79.227.22:4511 , piece_id=OGUKV6FBZNOYNTUO3A7M3Z532KQZH2K5AQIDPUKD3RYDPXFHBAEQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269456296 (266h47m0.451901276s) [noise=true , address=145.79.227.37:4565 , piece_id=JQVIFKPIBMXFTYYTHF3Q7DKEIFSMKV6FBXFOIZ4HJEDCT3S7YGJA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269827900 (266h47m0.45227287s) [noise=true , address=45.91.116.14:4191 , piece_id=HAYM5NIRM2ELGZ7FO7L2EY3HMAAED7JWEC4V7SD3BDHEADELNWUA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.270230122 (266h47m0.452675091s) [noise=true , address=145.79.227.24:4583 , piece_id=7ITWHDHIII3LFUA2AD3UQBXFXP43CFDIK4NKHYDD2BTGJII2WRBA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.346167333 (266h47m0.528612314s) [upload=234289]: Next returned nil segment Jan 26 18:43:22.346177152 (266h47m0.528622132s) [upload=234289]: Waiting for error group managing segments... Jan 26 18:43:22.355942092 (266h47m0.538387072s) [noise=true , address=145.79.227.52:4446 , piece_id=SWREVABTLINLIKWZ5T4K4F6TAC5VF4PWHPPTIT2HVMEBFHRSNKEA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.356544547 (266h47m0.538989517s) [noise=true , address=145.79.227.51:4411 , piece_id=QX42UUIQRKDLVW2P4MDHGVM7YBDK4TB2LENZBVDLS4RMUQLPLHNQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357475265 (266h47m0.539920235s) [noise=true , address=145.79.227.48:4301 , piece_id=JYZZKQCYSWGQD3JTFIXNQ2UNLU4H2K7D2EAEB7EILRUHHWZG6X5A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357741102 (266h47m0.540186082s) [noise=true , address=145.79.227.47:4265 , piece_id=RQLMIDMVU45GIR2VOBZQRVLZEEKI4TEU4EJVTLLNLKDHAS3GSGTQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357892725 (266h47m0.540337705s) [noise=true , address=145.79.227.24:4583 , piece_id=7ITWHDHIII3LFUA2AD3UQBXFXP43CFDIK4NKHYDD2BTGJII2WRBA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358205700 (266h47m0.54065068s) [noise=true , address=145.79.227.39:4013 , piece_id=IDWYWDFFNKZN5EY2THLNG57FF3JQNQVFVU6RF4MACLIEDF7ZV37A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358277304 (266h47m0.540722284s) [noise=true , address=145.79.227.46:4601 , piece_id=AWDYHRIULVSHJY4MMGUTV54D7WBTSRWTXUWX35HIYDNB63I4QPFQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358633879 (266h47m0.541078859s) [noise=true , address=145.79.227.13:4803 , piece_id=TVP3SVAKCCCFAOOVG3DAPLEAAL3IFP76TCQ4LN43I2TQNDZT7DGA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.359212861 (266h47m0.541657832s) [noise=true , address=145.79.227.33:4871 , piece_id=2VUU7K3BCWPKKHHU7CAXEBRITS6ED6WDFPU3ODBG2YPDTCZKWD3A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.359410610 (266h47m0.54185559s) [noise=true , address=145.79.227.22:4511 , piece_id=OGUKV6FBZNOYNTUO3A7M3Z532KQZH2K5AQIDPUKD3RYDPXFHBAEQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.374088006 (266h47m0.556532976s) [noise=true , address=145.79.227.37:4565 , piece_id=JQVIFKPIBMXFTYYTHF3Q7DKEIFSMKV6FBXFOIZ4HJEDCT3S7YGJA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:52.233014687 (266h47m30.415459677s) [noise=true , address=45.91.116.9:4261 , piece_id=BWWCW3CPBTPWOF4K2NUOXEZRMHZGILDOT335RY5TSZUJSETSF6BA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection Jan 26 18:43:52.233783362 (266h47m30.416228333s) [noise=true , address=45.91.116.7:4010 , piece_id=3RADWMUAMQOTQQF3YLXSJJOWSQRZEWVZJQXPHMADDWYQIKJX6UCA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233815402 (266h47m30.416260362s) [noise=true , address=45.91.116.14:4191 , piece_id=HAYM5NIRM2ELGZ7FO7L2EY3HMAAED7JWEC4V7SD3BDHEADELNWUA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: read tcp 5.161.89.252:12188->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233921791 (266h47m30.416366771s) [noise=true , address=45.91.116.6:4976 , piece_id=6RKPBVLLDTIEYOBANAB4NRDYAY353LUCVAOAS2523RTXCVCDVO3A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:121tumRJ6tGiip2dumJr9ZWMoU5BA2HuLEwU5GxBxzTZjMhv3Pp, address:45.91.116.6:4976): protocol: write tcp 5.161.89.252:62910->45.91.116.6:4976: use of closed network connection; close tcp 5.161.89.252:62910->45.91.116.6:4976: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233966906 (266h47m30.416411876s) [noise=true , address=45.91.116.12:4225 , piece_id=M7NFP2QJD5JTMJXROZSXKW6LAJ45WTJJ4XOJLBD4UQEDJJSEY4RA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection; write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection Jan 26 18:43:52.233984328 (266h47m30.416429288s) [seg_pos={0 0}, upload=234289]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 26 18:43:52.255878794 (266h47m30.438323804s) [upload=234289]: Done uploading segments... Jan 26 18:43:52.255942072 (266h47m30.438387072s) [upload=234289]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 341.877065ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 771.724997ms trace: https://jaeger.dev.storj.io/trace/6fe61816dac9c35f FAIL (2026-01-26 19:00:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 771.778819ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [..................................XX........................] duration: 527.666416ms trace: https://jaeger.dev.storj.io/trace/460a0499eabe6dd0 FAIL (2026-01-26 19:00:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 527.693066ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 405.890916ms trace: https://jaeger.dev.storj.io/trace/3bb5e6bb5aa7ad6b FAIL (2026-01-26 19:00:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 26 18:43:22.244729209 (266h47m0.42717419s) [upload=234289]: Starting upload Jan 26 18:43:22.244783651 (266h47m0.427228631s) [upload=234289]: Done starting upload Jan 26 18:43:22.244862287 (266h47m0.427307267s) [upload=234289]: Uploading segments... Jan 26 18:43:22.245010364 (266h47m0.427455334s) [upload=234289]: Got next segment. Inline: false Jan 26 18:43:22.245044468 (266h47m0.427489448s) [upload=234289]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 26 18:43:22.245048175 (266h47m0.427493155s) [upload=234289]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 26 18:43:22.266231092 (266h47m0.448676072s) [seg_pos={0 0}, upload=234289]: Begin upload segment... Jan 26 18:43:22.266262791 (266h47m0.448707761s) [seg_pos={0 0}, upload=234289]: Done begin upload segment. Jan 26 18:43:22.266285364 (266h47m0.448730334s) [noise=true , address=45.91.116.12:4225 , piece_id=M7NFP2QJD5JTMJXROZSXKW6LAJ45WTJJ4XOJLBD4UQEDJJSEY4RA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.266372465 (266h47m0.448817446s) [noise=true , address=145.79.227.47:4265 , piece_id=RQLMIDMVU45GIR2VOBZQRVLZEEKI4TEU4EJVTLLNLKDHAS3GSGTQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.266739602 (266h47m0.449184583s) [noise=true , address=45.91.116.7:4010 , piece_id=3RADWMUAMQOTQQF3YLXSJJOWSQRZEWVZJQXPHMADDWYQIKJX6UCA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267056043 (266h47m0.449501013s) [noise=true , address=145.79.227.13:4803 , piece_id=TVP3SVAKCCCFAOOVG3DAPLEAAL3IFP76TCQ4LN43I2TQNDZT7DGA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267372755 (266h47m0.449817725s) [noise=true , address=45.91.116.9:4261 , piece_id=BWWCW3CPBTPWOF4K2NUOXEZRMHZGILDOT335RY5TSZUJSETSF6BA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267627821 (266h47m0.450072801s) [noise=true , address=45.91.116.6:4976 , piece_id=6RKPBVLLDTIEYOBANAB4NRDYAY353LUCVAOAS2523RTXCVCDVO3A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267660202 (266h47m0.450105171s) [noise=true , address=145.79.227.33:4871 , piece_id=2VUU7K3BCWPKKHHU7CAXEBRITS6ED6WDFPU3ODBG2YPDTCZKWD3A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267886355 (266h47m0.450331325s) [noise=true , address=145.79.227.52:4446 , piece_id=SWREVABTLINLIKWZ5T4K4F6TAC5VF4PWHPPTIT2HVMEBFHRSNKEA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268219706 (266h47m0.450664677s) [noise=true , address=145.79.227.39:4013 , piece_id=IDWYWDFFNKZN5EY2THLNG57FF3JQNQVFVU6RF4MACLIEDF7ZV37A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268756349 (266h47m0.451201319s) [noise=true , address=145.79.227.48:4301 , piece_id=JYZZKQCYSWGQD3JTFIXNQ2UNLU4H2K7D2EAEB7EILRUHHWZG6X5A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268762169 (266h47m0.451207149s) [noise=true , address=145.79.227.46:4601 , piece_id=AWDYHRIULVSHJY4MMGUTV54D7WBTSRWTXUWX35HIYDNB63I4QPFQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268800502 (266h47m0.451245472s) [noise=true , address=145.79.227.51:4411 , piece_id=QX42UUIQRKDLVW2P4MDHGVM7YBDK4TB2LENZBVDLS4RMUQLPLHNQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269264038 (266h47m0.451709008s) [noise=true , address=145.79.227.22:4511 , piece_id=OGUKV6FBZNOYNTUO3A7M3Z532KQZH2K5AQIDPUKD3RYDPXFHBAEQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269456296 (266h47m0.451901276s) [noise=true , address=145.79.227.37:4565 , piece_id=JQVIFKPIBMXFTYYTHF3Q7DKEIFSMKV6FBXFOIZ4HJEDCT3S7YGJA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269827900 (266h47m0.45227287s) [noise=true , address=45.91.116.14:4191 , piece_id=HAYM5NIRM2ELGZ7FO7L2EY3HMAAED7JWEC4V7SD3BDHEADELNWUA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.270230122 (266h47m0.452675091s) [noise=true , address=145.79.227.24:4583 , piece_id=7ITWHDHIII3LFUA2AD3UQBXFXP43CFDIK4NKHYDD2BTGJII2WRBA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.346167333 (266h47m0.528612314s) [upload=234289]: Next returned nil segment Jan 26 18:43:22.346177152 (266h47m0.528622132s) [upload=234289]: Waiting for error group managing segments... Jan 26 18:43:22.355942092 (266h47m0.538387072s) [noise=true , address=145.79.227.52:4446 , piece_id=SWREVABTLINLIKWZ5T4K4F6TAC5VF4PWHPPTIT2HVMEBFHRSNKEA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.356544547 (266h47m0.538989517s) [noise=true , address=145.79.227.51:4411 , piece_id=QX42UUIQRKDLVW2P4MDHGVM7YBDK4TB2LENZBVDLS4RMUQLPLHNQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357475265 (266h47m0.539920235s) [noise=true , address=145.79.227.48:4301 , piece_id=JYZZKQCYSWGQD3JTFIXNQ2UNLU4H2K7D2EAEB7EILRUHHWZG6X5A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357741102 (266h47m0.540186082s) [noise=true , address=145.79.227.47:4265 , piece_id=RQLMIDMVU45GIR2VOBZQRVLZEEKI4TEU4EJVTLLNLKDHAS3GSGTQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357892725 (266h47m0.540337705s) [noise=true , address=145.79.227.24:4583 , piece_id=7ITWHDHIII3LFUA2AD3UQBXFXP43CFDIK4NKHYDD2BTGJII2WRBA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358205700 (266h47m0.54065068s) [noise=true , address=145.79.227.39:4013 , piece_id=IDWYWDFFNKZN5EY2THLNG57FF3JQNQVFVU6RF4MACLIEDF7ZV37A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358277304 (266h47m0.540722284s) [noise=true , address=145.79.227.46:4601 , piece_id=AWDYHRIULVSHJY4MMGUTV54D7WBTSRWTXUWX35HIYDNB63I4QPFQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358633879 (266h47m0.541078859s) [noise=true , address=145.79.227.13:4803 , piece_id=TVP3SVAKCCCFAOOVG3DAPLEAAL3IFP76TCQ4LN43I2TQNDZT7DGA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.359212861 (266h47m0.541657832s) [noise=true , address=145.79.227.33:4871 , piece_id=2VUU7K3BCWPKKHHU7CAXEBRITS6ED6WDFPU3ODBG2YPDTCZKWD3A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.359410610 (266h47m0.54185559s) [noise=true , address=145.79.227.22:4511 , piece_id=OGUKV6FBZNOYNTUO3A7M3Z532KQZH2K5AQIDPUKD3RYDPXFHBAEQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.374088006 (266h47m0.556532976s) [noise=true , address=145.79.227.37:4565 , piece_id=JQVIFKPIBMXFTYYTHF3Q7DKEIFSMKV6FBXFOIZ4HJEDCT3S7YGJA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:52.233014687 (266h47m30.415459677s) [noise=true , address=45.91.116.9:4261 , piece_id=BWWCW3CPBTPWOF4K2NUOXEZRMHZGILDOT335RY5TSZUJSETSF6BA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection Jan 26 18:43:52.233783362 (266h47m30.416228333s) [noise=true , address=45.91.116.7:4010 , piece_id=3RADWMUAMQOTQQF3YLXSJJOWSQRZEWVZJQXPHMADDWYQIKJX6UCA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233815402 (266h47m30.416260362s) [noise=true , address=45.91.116.14:4191 , piece_id=HAYM5NIRM2ELGZ7FO7L2EY3HMAAED7JWEC4V7SD3BDHEADELNWUA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: read tcp 5.161.89.252:12188->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233921791 (266h47m30.416366771s) [noise=true , address=45.91.116.6:4976 , piece_id=6RKPBVLLDTIEYOBANAB4NRDYAY353LUCVAOAS2523RTXCVCDVO3A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:121tumRJ6tGiip2dumJr9ZWMoU5BA2HuLEwU5GxBxzTZjMhv3Pp, address:45.91.116.6:4976): protocol: write tcp 5.161.89.252:62910->45.91.116.6:4976: use of closed network connection; close tcp 5.161.89.252:62910->45.91.116.6:4976: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233966906 (266h47m30.416411876s) [noise=true , address=45.91.116.12:4225 , piece_id=M7NFP2QJD5JTMJXROZSXKW6LAJ45WTJJ4XOJLBD4UQEDJJSEY4RA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection; write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection Jan 26 18:43:52.233984328 (266h47m30.416429288s) [seg_pos={0 0}, upload=234289]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 26 18:43:52.255878794 (266h47m30.438323804s) [upload=234289]: Done uploading segments... Jan 26 18:43:52.255942072 (266h47m30.438387072s) [upload=234289]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 405.916374ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 620.092674ms trace: https://jaeger.dev.storj.io/trace/6fe61816dac9c35f FAIL (2026-01-26 18:59:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 620.113493ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [...................................XX.......................] duration: 490.214052ms trace: https://jaeger.dev.storj.io/trace/460a0499eabe6dd0 FAIL (2026-01-26 18:59:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 490.233909ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 329.750746ms trace: https://jaeger.dev.storj.io/trace/3bb5e6bb5aa7ad6b FAIL (2026-01-26 18:59:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 26 18:43:22.244729209 (266h47m0.42717419s) [upload=234289]: Starting upload Jan 26 18:43:22.244783651 (266h47m0.427228631s) [upload=234289]: Done starting upload Jan 26 18:43:22.244862287 (266h47m0.427307267s) [upload=234289]: Uploading segments... Jan 26 18:43:22.245010364 (266h47m0.427455334s) [upload=234289]: Got next segment. Inline: false Jan 26 18:43:22.245044468 (266h47m0.427489448s) [upload=234289]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 26 18:43:22.245048175 (266h47m0.427493155s) [upload=234289]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 26 18:43:22.266231092 (266h47m0.448676072s) [seg_pos={0 0}, upload=234289]: Begin upload segment... Jan 26 18:43:22.266262791 (266h47m0.448707761s) [seg_pos={0 0}, upload=234289]: Done begin upload segment. Jan 26 18:43:22.266285364 (266h47m0.448730334s) [noise=true , address=45.91.116.12:4225 , piece_id=M7NFP2QJD5JTMJXROZSXKW6LAJ45WTJJ4XOJLBD4UQEDJJSEY4RA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.266372465 (266h47m0.448817446s) [noise=true , address=145.79.227.47:4265 , piece_id=RQLMIDMVU45GIR2VOBZQRVLZEEKI4TEU4EJVTLLNLKDHAS3GSGTQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.266739602 (266h47m0.449184583s) [noise=true , address=45.91.116.7:4010 , piece_id=3RADWMUAMQOTQQF3YLXSJJOWSQRZEWVZJQXPHMADDWYQIKJX6UCA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267056043 (266h47m0.449501013s) [noise=true , address=145.79.227.13:4803 , piece_id=TVP3SVAKCCCFAOOVG3DAPLEAAL3IFP76TCQ4LN43I2TQNDZT7DGA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267372755 (266h47m0.449817725s) [noise=true , address=45.91.116.9:4261 , piece_id=BWWCW3CPBTPWOF4K2NUOXEZRMHZGILDOT335RY5TSZUJSETSF6BA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267627821 (266h47m0.450072801s) [noise=true , address=45.91.116.6:4976 , piece_id=6RKPBVLLDTIEYOBANAB4NRDYAY353LUCVAOAS2523RTXCVCDVO3A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267660202 (266h47m0.450105171s) [noise=true , address=145.79.227.33:4871 , piece_id=2VUU7K3BCWPKKHHU7CAXEBRITS6ED6WDFPU3ODBG2YPDTCZKWD3A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267886355 (266h47m0.450331325s) [noise=true , address=145.79.227.52:4446 , piece_id=SWREVABTLINLIKWZ5T4K4F6TAC5VF4PWHPPTIT2HVMEBFHRSNKEA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268219706 (266h47m0.450664677s) [noise=true , address=145.79.227.39:4013 , piece_id=IDWYWDFFNKZN5EY2THLNG57FF3JQNQVFVU6RF4MACLIEDF7ZV37A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268756349 (266h47m0.451201319s) [noise=true , address=145.79.227.48:4301 , piece_id=JYZZKQCYSWGQD3JTFIXNQ2UNLU4H2K7D2EAEB7EILRUHHWZG6X5A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268762169 (266h47m0.451207149s) [noise=true , address=145.79.227.46:4601 , piece_id=AWDYHRIULVSHJY4MMGUTV54D7WBTSRWTXUWX35HIYDNB63I4QPFQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268800502 (266h47m0.451245472s) [noise=true , address=145.79.227.51:4411 , piece_id=QX42UUIQRKDLVW2P4MDHGVM7YBDK4TB2LENZBVDLS4RMUQLPLHNQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269264038 (266h47m0.451709008s) [noise=true , address=145.79.227.22:4511 , piece_id=OGUKV6FBZNOYNTUO3A7M3Z532KQZH2K5AQIDPUKD3RYDPXFHBAEQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269456296 (266h47m0.451901276s) [noise=true , address=145.79.227.37:4565 , piece_id=JQVIFKPIBMXFTYYTHF3Q7DKEIFSMKV6FBXFOIZ4HJEDCT3S7YGJA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269827900 (266h47m0.45227287s) [noise=true , address=45.91.116.14:4191 , piece_id=HAYM5NIRM2ELGZ7FO7L2EY3HMAAED7JWEC4V7SD3BDHEADELNWUA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.270230122 (266h47m0.452675091s) [noise=true , address=145.79.227.24:4583 , piece_id=7ITWHDHIII3LFUA2AD3UQBXFXP43CFDIK4NKHYDD2BTGJII2WRBA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.346167333 (266h47m0.528612314s) [upload=234289]: Next returned nil segment Jan 26 18:43:22.346177152 (266h47m0.528622132s) [upload=234289]: Waiting for error group managing segments... Jan 26 18:43:22.355942092 (266h47m0.538387072s) [noise=true , address=145.79.227.52:4446 , piece_id=SWREVABTLINLIKWZ5T4K4F6TAC5VF4PWHPPTIT2HVMEBFHRSNKEA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.356544547 (266h47m0.538989517s) [noise=true , address=145.79.227.51:4411 , piece_id=QX42UUIQRKDLVW2P4MDHGVM7YBDK4TB2LENZBVDLS4RMUQLPLHNQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357475265 (266h47m0.539920235s) [noise=true , address=145.79.227.48:4301 , piece_id=JYZZKQCYSWGQD3JTFIXNQ2UNLU4H2K7D2EAEB7EILRUHHWZG6X5A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357741102 (266h47m0.540186082s) [noise=true , address=145.79.227.47:4265 , piece_id=RQLMIDMVU45GIR2VOBZQRVLZEEKI4TEU4EJVTLLNLKDHAS3GSGTQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357892725 (266h47m0.540337705s) [noise=true , address=145.79.227.24:4583 , piece_id=7ITWHDHIII3LFUA2AD3UQBXFXP43CFDIK4NKHYDD2BTGJII2WRBA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358205700 (266h47m0.54065068s) [noise=true , address=145.79.227.39:4013 , piece_id=IDWYWDFFNKZN5EY2THLNG57FF3JQNQVFVU6RF4MACLIEDF7ZV37A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358277304 (266h47m0.540722284s) [noise=true , address=145.79.227.46:4601 , piece_id=AWDYHRIULVSHJY4MMGUTV54D7WBTSRWTXUWX35HIYDNB63I4QPFQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358633879 (266h47m0.541078859s) [noise=true , address=145.79.227.13:4803 , piece_id=TVP3SVAKCCCFAOOVG3DAPLEAAL3IFP76TCQ4LN43I2TQNDZT7DGA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.359212861 (266h47m0.541657832s) [noise=true , address=145.79.227.33:4871 , piece_id=2VUU7K3BCWPKKHHU7CAXEBRITS6ED6WDFPU3ODBG2YPDTCZKWD3A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.359410610 (266h47m0.54185559s) [noise=true , address=145.79.227.22:4511 , piece_id=OGUKV6FBZNOYNTUO3A7M3Z532KQZH2K5AQIDPUKD3RYDPXFHBAEQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.374088006 (266h47m0.556532976s) [noise=true , address=145.79.227.37:4565 , piece_id=JQVIFKPIBMXFTYYTHF3Q7DKEIFSMKV6FBXFOIZ4HJEDCT3S7YGJA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:52.233014687 (266h47m30.415459677s) [noise=true , address=45.91.116.9:4261 , piece_id=BWWCW3CPBTPWOF4K2NUOXEZRMHZGILDOT335RY5TSZUJSETSF6BA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection Jan 26 18:43:52.233783362 (266h47m30.416228333s) [noise=true , address=45.91.116.7:4010 , piece_id=3RADWMUAMQOTQQF3YLXSJJOWSQRZEWVZJQXPHMADDWYQIKJX6UCA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233815402 (266h47m30.416260362s) [noise=true , address=45.91.116.14:4191 , piece_id=HAYM5NIRM2ELGZ7FO7L2EY3HMAAED7JWEC4V7SD3BDHEADELNWUA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: read tcp 5.161.89.252:12188->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233921791 (266h47m30.416366771s) [noise=true , address=45.91.116.6:4976 , piece_id=6RKPBVLLDTIEYOBANAB4NRDYAY353LUCVAOAS2523RTXCVCDVO3A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:121tumRJ6tGiip2dumJr9ZWMoU5BA2HuLEwU5GxBxzTZjMhv3Pp, address:45.91.116.6:4976): protocol: write tcp 5.161.89.252:62910->45.91.116.6:4976: use of closed network connection; close tcp 5.161.89.252:62910->45.91.116.6:4976: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233966906 (266h47m30.416411876s) [noise=true , address=45.91.116.12:4225 , piece_id=M7NFP2QJD5JTMJXROZSXKW6LAJ45WTJJ4XOJLBD4UQEDJJSEY4RA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection; write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection Jan 26 18:43:52.233984328 (266h47m30.416429288s) [seg_pos={0 0}, upload=234289]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 26 18:43:52.255878794 (266h47m30.438323804s) [upload=234289]: Done uploading segments... Jan 26 18:43:52.255942072 (266h47m30.438387072s) [upload=234289]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 329.769371ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 316.567864ms trace: https://jaeger.dev.storj.io/trace/3bb5e6bb5aa7ad6b FAIL (2026-01-26 18:59:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 26 18:43:22.244729209 (266h47m0.42717419s) [upload=234289]: Starting upload Jan 26 18:43:22.244783651 (266h47m0.427228631s) [upload=234289]: Done starting upload Jan 26 18:43:22.244862287 (266h47m0.427307267s) [upload=234289]: Uploading segments... Jan 26 18:43:22.245010364 (266h47m0.427455334s) [upload=234289]: Got next segment. Inline: false Jan 26 18:43:22.245044468 (266h47m0.427489448s) [upload=234289]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 26 18:43:22.245048175 (266h47m0.427493155s) [upload=234289]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 26 18:43:22.266231092 (266h47m0.448676072s) [seg_pos={0 0}, upload=234289]: Begin upload segment... Jan 26 18:43:22.266262791 (266h47m0.448707761s) [seg_pos={0 0}, upload=234289]: Done begin upload segment. Jan 26 18:43:22.266285364 (266h47m0.448730334s) [noise=true , address=45.91.116.12:4225 , piece_id=M7NFP2QJD5JTMJXROZSXKW6LAJ45WTJJ4XOJLBD4UQEDJJSEY4RA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.266372465 (266h47m0.448817446s) [noise=true , address=145.79.227.47:4265 , piece_id=RQLMIDMVU45GIR2VOBZQRVLZEEKI4TEU4EJVTLLNLKDHAS3GSGTQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.266739602 (266h47m0.449184583s) [noise=true , address=45.91.116.7:4010 , piece_id=3RADWMUAMQOTQQF3YLXSJJOWSQRZEWVZJQXPHMADDWYQIKJX6UCA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267056043 (266h47m0.449501013s) [noise=true , address=145.79.227.13:4803 , piece_id=TVP3SVAKCCCFAOOVG3DAPLEAAL3IFP76TCQ4LN43I2TQNDZT7DGA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267372755 (266h47m0.449817725s) [noise=true , address=45.91.116.9:4261 , piece_id=BWWCW3CPBTPWOF4K2NUOXEZRMHZGILDOT335RY5TSZUJSETSF6BA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267627821 (266h47m0.450072801s) [noise=true , address=45.91.116.6:4976 , piece_id=6RKPBVLLDTIEYOBANAB4NRDYAY353LUCVAOAS2523RTXCVCDVO3A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267660202 (266h47m0.450105171s) [noise=true , address=145.79.227.33:4871 , piece_id=2VUU7K3BCWPKKHHU7CAXEBRITS6ED6WDFPU3ODBG2YPDTCZKWD3A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267886355 (266h47m0.450331325s) [noise=true , address=145.79.227.52:4446 , piece_id=SWREVABTLINLIKWZ5T4K4F6TAC5VF4PWHPPTIT2HVMEBFHRSNKEA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268219706 (266h47m0.450664677s) [noise=true , address=145.79.227.39:4013 , piece_id=IDWYWDFFNKZN5EY2THLNG57FF3JQNQVFVU6RF4MACLIEDF7ZV37A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268756349 (266h47m0.451201319s) [noise=true , address=145.79.227.48:4301 , piece_id=JYZZKQCYSWGQD3JTFIXNQ2UNLU4H2K7D2EAEB7EILRUHHWZG6X5A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268762169 (266h47m0.451207149s) [noise=true , address=145.79.227.46:4601 , piece_id=AWDYHRIULVSHJY4MMGUTV54D7WBTSRWTXUWX35HIYDNB63I4QPFQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268800502 (266h47m0.451245472s) [noise=true , address=145.79.227.51:4411 , piece_id=QX42UUIQRKDLVW2P4MDHGVM7YBDK4TB2LENZBVDLS4RMUQLPLHNQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269264038 (266h47m0.451709008s) [noise=true , address=145.79.227.22:4511 , piece_id=OGUKV6FBZNOYNTUO3A7M3Z532KQZH2K5AQIDPUKD3RYDPXFHBAEQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269456296 (266h47m0.451901276s) [noise=true , address=145.79.227.37:4565 , piece_id=JQVIFKPIBMXFTYYTHF3Q7DKEIFSMKV6FBXFOIZ4HJEDCT3S7YGJA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269827900 (266h47m0.45227287s) [noise=true , address=45.91.116.14:4191 , piece_id=HAYM5NIRM2ELGZ7FO7L2EY3HMAAED7JWEC4V7SD3BDHEADELNWUA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.270230122 (266h47m0.452675091s) [noise=true , address=145.79.227.24:4583 , piece_id=7ITWHDHIII3LFUA2AD3UQBXFXP43CFDIK4NKHYDD2BTGJII2WRBA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.346167333 (266h47m0.528612314s) [upload=234289]: Next returned nil segment Jan 26 18:43:22.346177152 (266h47m0.528622132s) [upload=234289]: Waiting for error group managing segments... Jan 26 18:43:22.355942092 (266h47m0.538387072s) [noise=true , address=145.79.227.52:4446 , piece_id=SWREVABTLINLIKWZ5T4K4F6TAC5VF4PWHPPTIT2HVMEBFHRSNKEA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.356544547 (266h47m0.538989517s) [noise=true , address=145.79.227.51:4411 , piece_id=QX42UUIQRKDLVW2P4MDHGVM7YBDK4TB2LENZBVDLS4RMUQLPLHNQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357475265 (266h47m0.539920235s) [noise=true , address=145.79.227.48:4301 , piece_id=JYZZKQCYSWGQD3JTFIXNQ2UNLU4H2K7D2EAEB7EILRUHHWZG6X5A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357741102 (266h47m0.540186082s) [noise=true , address=145.79.227.47:4265 , piece_id=RQLMIDMVU45GIR2VOBZQRVLZEEKI4TEU4EJVTLLNLKDHAS3GSGTQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357892725 (266h47m0.540337705s) [noise=true , address=145.79.227.24:4583 , piece_id=7ITWHDHIII3LFUA2AD3UQBXFXP43CFDIK4NKHYDD2BTGJII2WRBA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358205700 (266h47m0.54065068s) [noise=true , address=145.79.227.39:4013 , piece_id=IDWYWDFFNKZN5EY2THLNG57FF3JQNQVFVU6RF4MACLIEDF7ZV37A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358277304 (266h47m0.540722284s) [noise=true , address=145.79.227.46:4601 , piece_id=AWDYHRIULVSHJY4MMGUTV54D7WBTSRWTXUWX35HIYDNB63I4QPFQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358633879 (266h47m0.541078859s) [noise=true , address=145.79.227.13:4803 , piece_id=TVP3SVAKCCCFAOOVG3DAPLEAAL3IFP76TCQ4LN43I2TQNDZT7DGA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.359212861 (266h47m0.541657832s) [noise=true , address=145.79.227.33:4871 , piece_id=2VUU7K3BCWPKKHHU7CAXEBRITS6ED6WDFPU3ODBG2YPDTCZKWD3A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.359410610 (266h47m0.54185559s) [noise=true , address=145.79.227.22:4511 , piece_id=OGUKV6FBZNOYNTUO3A7M3Z532KQZH2K5AQIDPUKD3RYDPXFHBAEQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.374088006 (266h47m0.556532976s) [noise=true , address=145.79.227.37:4565 , piece_id=JQVIFKPIBMXFTYYTHF3Q7DKEIFSMKV6FBXFOIZ4HJEDCT3S7YGJA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:52.233014687 (266h47m30.415459677s) [noise=true , address=45.91.116.9:4261 , piece_id=BWWCW3CPBTPWOF4K2NUOXEZRMHZGILDOT335RY5TSZUJSETSF6BA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection Jan 26 18:43:52.233783362 (266h47m30.416228333s) [noise=true , address=45.91.116.7:4010 , piece_id=3RADWMUAMQOTQQF3YLXSJJOWSQRZEWVZJQXPHMADDWYQIKJX6UCA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233815402 (266h47m30.416260362s) [noise=true , address=45.91.116.14:4191 , piece_id=HAYM5NIRM2ELGZ7FO7L2EY3HMAAED7JWEC4V7SD3BDHEADELNWUA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: read tcp 5.161.89.252:12188->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233921791 (266h47m30.416366771s) [noise=true , address=45.91.116.6:4976 , piece_id=6RKPBVLLDTIEYOBANAB4NRDYAY353LUCVAOAS2523RTXCVCDVO3A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:121tumRJ6tGiip2dumJr9ZWMoU5BA2HuLEwU5GxBxzTZjMhv3Pp, address:45.91.116.6:4976): protocol: write tcp 5.161.89.252:62910->45.91.116.6:4976: use of closed network connection; close tcp 5.161.89.252:62910->45.91.116.6:4976: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233966906 (266h47m30.416411876s) [noise=true , address=45.91.116.12:4225 , piece_id=M7NFP2QJD5JTMJXROZSXKW6LAJ45WTJJ4XOJLBD4UQEDJJSEY4RA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection; write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection Jan 26 18:43:52.233984328 (266h47m30.416429288s) [seg_pos={0 0}, upload=234289]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 26 18:43:52.255878794 (266h47m30.438323804s) [upload=234289]: Done uploading segments... Jan 26 18:43:52.255942072 (266h47m30.438387072s) [upload=234289]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 316.584895ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 564.75004ms trace: https://jaeger.dev.storj.io/trace/6fe61816dac9c35f FAIL (2026-01-26 18:59:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 564.786127ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [....................................XX......................] duration: 557.114279ms trace: https://jaeger.dev.storj.io/trace/460a0499eabe6dd0 FAIL (2026-01-26 18:58:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 557.12576ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.....................................XX.....................] duration: 726.621738ms trace: https://jaeger.dev.storj.io/trace/460a0499eabe6dd0 FAIL (2026-01-26 18:58:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 726.641104ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 397.03621ms trace: https://jaeger.dev.storj.io/trace/3bb5e6bb5aa7ad6b FAIL (2026-01-26 18:58:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 26 18:43:22.244729209 (266h47m0.42717419s) [upload=234289]: Starting upload Jan 26 18:43:22.244783651 (266h47m0.427228631s) [upload=234289]: Done starting upload Jan 26 18:43:22.244862287 (266h47m0.427307267s) [upload=234289]: Uploading segments... Jan 26 18:43:22.245010364 (266h47m0.427455334s) [upload=234289]: Got next segment. Inline: false Jan 26 18:43:22.245044468 (266h47m0.427489448s) [upload=234289]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 26 18:43:22.245048175 (266h47m0.427493155s) [upload=234289]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 26 18:43:22.266231092 (266h47m0.448676072s) [seg_pos={0 0}, upload=234289]: Begin upload segment... Jan 26 18:43:22.266262791 (266h47m0.448707761s) [seg_pos={0 0}, upload=234289]: Done begin upload segment. Jan 26 18:43:22.266285364 (266h47m0.448730334s) [noise=true , address=45.91.116.12:4225 , piece_id=M7NFP2QJD5JTMJXROZSXKW6LAJ45WTJJ4XOJLBD4UQEDJJSEY4RA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.266372465 (266h47m0.448817446s) [noise=true , address=145.79.227.47:4265 , piece_id=RQLMIDMVU45GIR2VOBZQRVLZEEKI4TEU4EJVTLLNLKDHAS3GSGTQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.266739602 (266h47m0.449184583s) [noise=true , address=45.91.116.7:4010 , piece_id=3RADWMUAMQOTQQF3YLXSJJOWSQRZEWVZJQXPHMADDWYQIKJX6UCA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267056043 (266h47m0.449501013s) [noise=true , address=145.79.227.13:4803 , piece_id=TVP3SVAKCCCFAOOVG3DAPLEAAL3IFP76TCQ4LN43I2TQNDZT7DGA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267372755 (266h47m0.449817725s) [noise=true , address=45.91.116.9:4261 , piece_id=BWWCW3CPBTPWOF4K2NUOXEZRMHZGILDOT335RY5TSZUJSETSF6BA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267627821 (266h47m0.450072801s) [noise=true , address=45.91.116.6:4976 , piece_id=6RKPBVLLDTIEYOBANAB4NRDYAY353LUCVAOAS2523RTXCVCDVO3A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267660202 (266h47m0.450105171s) [noise=true , address=145.79.227.33:4871 , piece_id=2VUU7K3BCWPKKHHU7CAXEBRITS6ED6WDFPU3ODBG2YPDTCZKWD3A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267886355 (266h47m0.450331325s) [noise=true , address=145.79.227.52:4446 , piece_id=SWREVABTLINLIKWZ5T4K4F6TAC5VF4PWHPPTIT2HVMEBFHRSNKEA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268219706 (266h47m0.450664677s) [noise=true , address=145.79.227.39:4013 , piece_id=IDWYWDFFNKZN5EY2THLNG57FF3JQNQVFVU6RF4MACLIEDF7ZV37A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268756349 (266h47m0.451201319s) [noise=true , address=145.79.227.48:4301 , piece_id=JYZZKQCYSWGQD3JTFIXNQ2UNLU4H2K7D2EAEB7EILRUHHWZG6X5A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268762169 (266h47m0.451207149s) [noise=true , address=145.79.227.46:4601 , piece_id=AWDYHRIULVSHJY4MMGUTV54D7WBTSRWTXUWX35HIYDNB63I4QPFQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268800502 (266h47m0.451245472s) [noise=true , address=145.79.227.51:4411 , piece_id=QX42UUIQRKDLVW2P4MDHGVM7YBDK4TB2LENZBVDLS4RMUQLPLHNQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269264038 (266h47m0.451709008s) [noise=true , address=145.79.227.22:4511 , piece_id=OGUKV6FBZNOYNTUO3A7M3Z532KQZH2K5AQIDPUKD3RYDPXFHBAEQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269456296 (266h47m0.451901276s) [noise=true , address=145.79.227.37:4565 , piece_id=JQVIFKPIBMXFTYYTHF3Q7DKEIFSMKV6FBXFOIZ4HJEDCT3S7YGJA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269827900 (266h47m0.45227287s) [noise=true , address=45.91.116.14:4191 , piece_id=HAYM5NIRM2ELGZ7FO7L2EY3HMAAED7JWEC4V7SD3BDHEADELNWUA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.270230122 (266h47m0.452675091s) [noise=true , address=145.79.227.24:4583 , piece_id=7ITWHDHIII3LFUA2AD3UQBXFXP43CFDIK4NKHYDD2BTGJII2WRBA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.346167333 (266h47m0.528612314s) [upload=234289]: Next returned nil segment Jan 26 18:43:22.346177152 (266h47m0.528622132s) [upload=234289]: Waiting for error group managing segments... Jan 26 18:43:22.355942092 (266h47m0.538387072s) [noise=true , address=145.79.227.52:4446 , piece_id=SWREVABTLINLIKWZ5T4K4F6TAC5VF4PWHPPTIT2HVMEBFHRSNKEA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.356544547 (266h47m0.538989517s) [noise=true , address=145.79.227.51:4411 , piece_id=QX42UUIQRKDLVW2P4MDHGVM7YBDK4TB2LENZBVDLS4RMUQLPLHNQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357475265 (266h47m0.539920235s) [noise=true , address=145.79.227.48:4301 , piece_id=JYZZKQCYSWGQD3JTFIXNQ2UNLU4H2K7D2EAEB7EILRUHHWZG6X5A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357741102 (266h47m0.540186082s) [noise=true , address=145.79.227.47:4265 , piece_id=RQLMIDMVU45GIR2VOBZQRVLZEEKI4TEU4EJVTLLNLKDHAS3GSGTQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357892725 (266h47m0.540337705s) [noise=true , address=145.79.227.24:4583 , piece_id=7ITWHDHIII3LFUA2AD3UQBXFXP43CFDIK4NKHYDD2BTGJII2WRBA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358205700 (266h47m0.54065068s) [noise=true , address=145.79.227.39:4013 , piece_id=IDWYWDFFNKZN5EY2THLNG57FF3JQNQVFVU6RF4MACLIEDF7ZV37A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358277304 (266h47m0.540722284s) [noise=true , address=145.79.227.46:4601 , piece_id=AWDYHRIULVSHJY4MMGUTV54D7WBTSRWTXUWX35HIYDNB63I4QPFQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358633879 (266h47m0.541078859s) [noise=true , address=145.79.227.13:4803 , piece_id=TVP3SVAKCCCFAOOVG3DAPLEAAL3IFP76TCQ4LN43I2TQNDZT7DGA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.359212861 (266h47m0.541657832s) [noise=true , address=145.79.227.33:4871 , piece_id=2VUU7K3BCWPKKHHU7CAXEBRITS6ED6WDFPU3ODBG2YPDTCZKWD3A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.359410610 (266h47m0.54185559s) [noise=true , address=145.79.227.22:4511 , piece_id=OGUKV6FBZNOYNTUO3A7M3Z532KQZH2K5AQIDPUKD3RYDPXFHBAEQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.374088006 (266h47m0.556532976s) [noise=true , address=145.79.227.37:4565 , piece_id=JQVIFKPIBMXFTYYTHF3Q7DKEIFSMKV6FBXFOIZ4HJEDCT3S7YGJA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:52.233014687 (266h47m30.415459677s) [noise=true , address=45.91.116.9:4261 , piece_id=BWWCW3CPBTPWOF4K2NUOXEZRMHZGILDOT335RY5TSZUJSETSF6BA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection Jan 26 18:43:52.233783362 (266h47m30.416228333s) [noise=true , address=45.91.116.7:4010 , piece_id=3RADWMUAMQOTQQF3YLXSJJOWSQRZEWVZJQXPHMADDWYQIKJX6UCA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233815402 (266h47m30.416260362s) [noise=true , address=45.91.116.14:4191 , piece_id=HAYM5NIRM2ELGZ7FO7L2EY3HMAAED7JWEC4V7SD3BDHEADELNWUA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: read tcp 5.161.89.252:12188->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233921791 (266h47m30.416366771s) [noise=true , address=45.91.116.6:4976 , piece_id=6RKPBVLLDTIEYOBANAB4NRDYAY353LUCVAOAS2523RTXCVCDVO3A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:121tumRJ6tGiip2dumJr9ZWMoU5BA2HuLEwU5GxBxzTZjMhv3Pp, address:45.91.116.6:4976): protocol: write tcp 5.161.89.252:62910->45.91.116.6:4976: use of closed network connection; close tcp 5.161.89.252:62910->45.91.116.6:4976: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233966906 (266h47m30.416411876s) [noise=true , address=45.91.116.12:4225 , piece_id=M7NFP2QJD5JTMJXROZSXKW6LAJ45WTJJ4XOJLBD4UQEDJJSEY4RA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection; write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection Jan 26 18:43:52.233984328 (266h47m30.416429288s) [seg_pos={0 0}, upload=234289]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 26 18:43:52.255878794 (266h47m30.438323804s) [upload=234289]: Done uploading segments... Jan 26 18:43:52.255942072 (266h47m30.438387072s) [upload=234289]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 397.05776ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 606.018239ms trace: https://jaeger.dev.storj.io/trace/6fe61816dac9c35f FAIL (2026-01-26 18:58:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 606.044749ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [......................................XX....................] duration: 506.014975ms trace: https://jaeger.dev.storj.io/trace/460a0499eabe6dd0 FAIL (2026-01-26 18:58:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 506.031085ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 417.712637ms trace: https://jaeger.dev.storj.io/trace/3bb5e6bb5aa7ad6b FAIL (2026-01-26 18:57:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 26 18:43:22.244729209 (266h47m0.42717419s) [upload=234289]: Starting upload Jan 26 18:43:22.244783651 (266h47m0.427228631s) [upload=234289]: Done starting upload Jan 26 18:43:22.244862287 (266h47m0.427307267s) [upload=234289]: Uploading segments... Jan 26 18:43:22.245010364 (266h47m0.427455334s) [upload=234289]: Got next segment. Inline: false Jan 26 18:43:22.245044468 (266h47m0.427489448s) [upload=234289]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 26 18:43:22.245048175 (266h47m0.427493155s) [upload=234289]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 26 18:43:22.266231092 (266h47m0.448676072s) [seg_pos={0 0}, upload=234289]: Begin upload segment... Jan 26 18:43:22.266262791 (266h47m0.448707761s) [seg_pos={0 0}, upload=234289]: Done begin upload segment. Jan 26 18:43:22.266285364 (266h47m0.448730334s) [noise=true , address=45.91.116.12:4225 , piece_id=M7NFP2QJD5JTMJXROZSXKW6LAJ45WTJJ4XOJLBD4UQEDJJSEY4RA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.266372465 (266h47m0.448817446s) [noise=true , address=145.79.227.47:4265 , piece_id=RQLMIDMVU45GIR2VOBZQRVLZEEKI4TEU4EJVTLLNLKDHAS3GSGTQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.266739602 (266h47m0.449184583s) [noise=true , address=45.91.116.7:4010 , piece_id=3RADWMUAMQOTQQF3YLXSJJOWSQRZEWVZJQXPHMADDWYQIKJX6UCA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267056043 (266h47m0.449501013s) [noise=true , address=145.79.227.13:4803 , piece_id=TVP3SVAKCCCFAOOVG3DAPLEAAL3IFP76TCQ4LN43I2TQNDZT7DGA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267372755 (266h47m0.449817725s) [noise=true , address=45.91.116.9:4261 , piece_id=BWWCW3CPBTPWOF4K2NUOXEZRMHZGILDOT335RY5TSZUJSETSF6BA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267627821 (266h47m0.450072801s) [noise=true , address=45.91.116.6:4976 , piece_id=6RKPBVLLDTIEYOBANAB4NRDYAY353LUCVAOAS2523RTXCVCDVO3A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267660202 (266h47m0.450105171s) [noise=true , address=145.79.227.33:4871 , piece_id=2VUU7K3BCWPKKHHU7CAXEBRITS6ED6WDFPU3ODBG2YPDTCZKWD3A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267886355 (266h47m0.450331325s) [noise=true , address=145.79.227.52:4446 , piece_id=SWREVABTLINLIKWZ5T4K4F6TAC5VF4PWHPPTIT2HVMEBFHRSNKEA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268219706 (266h47m0.450664677s) [noise=true , address=145.79.227.39:4013 , piece_id=IDWYWDFFNKZN5EY2THLNG57FF3JQNQVFVU6RF4MACLIEDF7ZV37A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268756349 (266h47m0.451201319s) [noise=true , address=145.79.227.48:4301 , piece_id=JYZZKQCYSWGQD3JTFIXNQ2UNLU4H2K7D2EAEB7EILRUHHWZG6X5A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268762169 (266h47m0.451207149s) [noise=true , address=145.79.227.46:4601 , piece_id=AWDYHRIULVSHJY4MMGUTV54D7WBTSRWTXUWX35HIYDNB63I4QPFQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268800502 (266h47m0.451245472s) [noise=true , address=145.79.227.51:4411 , piece_id=QX42UUIQRKDLVW2P4MDHGVM7YBDK4TB2LENZBVDLS4RMUQLPLHNQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269264038 (266h47m0.451709008s) [noise=true , address=145.79.227.22:4511 , piece_id=OGUKV6FBZNOYNTUO3A7M3Z532KQZH2K5AQIDPUKD3RYDPXFHBAEQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269456296 (266h47m0.451901276s) [noise=true , address=145.79.227.37:4565 , piece_id=JQVIFKPIBMXFTYYTHF3Q7DKEIFSMKV6FBXFOIZ4HJEDCT3S7YGJA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269827900 (266h47m0.45227287s) [noise=true , address=45.91.116.14:4191 , piece_id=HAYM5NIRM2ELGZ7FO7L2EY3HMAAED7JWEC4V7SD3BDHEADELNWUA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.270230122 (266h47m0.452675091s) [noise=true , address=145.79.227.24:4583 , piece_id=7ITWHDHIII3LFUA2AD3UQBXFXP43CFDIK4NKHYDD2BTGJII2WRBA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.346167333 (266h47m0.528612314s) [upload=234289]: Next returned nil segment Jan 26 18:43:22.346177152 (266h47m0.528622132s) [upload=234289]: Waiting for error group managing segments... Jan 26 18:43:22.355942092 (266h47m0.538387072s) [noise=true , address=145.79.227.52:4446 , piece_id=SWREVABTLINLIKWZ5T4K4F6TAC5VF4PWHPPTIT2HVMEBFHRSNKEA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.356544547 (266h47m0.538989517s) [noise=true , address=145.79.227.51:4411 , piece_id=QX42UUIQRKDLVW2P4MDHGVM7YBDK4TB2LENZBVDLS4RMUQLPLHNQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357475265 (266h47m0.539920235s) [noise=true , address=145.79.227.48:4301 , piece_id=JYZZKQCYSWGQD3JTFIXNQ2UNLU4H2K7D2EAEB7EILRUHHWZG6X5A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357741102 (266h47m0.540186082s) [noise=true , address=145.79.227.47:4265 , piece_id=RQLMIDMVU45GIR2VOBZQRVLZEEKI4TEU4EJVTLLNLKDHAS3GSGTQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357892725 (266h47m0.540337705s) [noise=true , address=145.79.227.24:4583 , piece_id=7ITWHDHIII3LFUA2AD3UQBXFXP43CFDIK4NKHYDD2BTGJII2WRBA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358205700 (266h47m0.54065068s) [noise=true , address=145.79.227.39:4013 , piece_id=IDWYWDFFNKZN5EY2THLNG57FF3JQNQVFVU6RF4MACLIEDF7ZV37A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358277304 (266h47m0.540722284s) [noise=true , address=145.79.227.46:4601 , piece_id=AWDYHRIULVSHJY4MMGUTV54D7WBTSRWTXUWX35HIYDNB63I4QPFQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358633879 (266h47m0.541078859s) [noise=true , address=145.79.227.13:4803 , piece_id=TVP3SVAKCCCFAOOVG3DAPLEAAL3IFP76TCQ4LN43I2TQNDZT7DGA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.359212861 (266h47m0.541657832s) [noise=true , address=145.79.227.33:4871 , piece_id=2VUU7K3BCWPKKHHU7CAXEBRITS6ED6WDFPU3ODBG2YPDTCZKWD3A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.359410610 (266h47m0.54185559s) [noise=true , address=145.79.227.22:4511 , piece_id=OGUKV6FBZNOYNTUO3A7M3Z532KQZH2K5AQIDPUKD3RYDPXFHBAEQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.374088006 (266h47m0.556532976s) [noise=true , address=145.79.227.37:4565 , piece_id=JQVIFKPIBMXFTYYTHF3Q7DKEIFSMKV6FBXFOIZ4HJEDCT3S7YGJA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:52.233014687 (266h47m30.415459677s) [noise=true , address=45.91.116.9:4261 , piece_id=BWWCW3CPBTPWOF4K2NUOXEZRMHZGILDOT335RY5TSZUJSETSF6BA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection Jan 26 18:43:52.233783362 (266h47m30.416228333s) [noise=true , address=45.91.116.7:4010 , piece_id=3RADWMUAMQOTQQF3YLXSJJOWSQRZEWVZJQXPHMADDWYQIKJX6UCA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233815402 (266h47m30.416260362s) [noise=true , address=45.91.116.14:4191 , piece_id=HAYM5NIRM2ELGZ7FO7L2EY3HMAAED7JWEC4V7SD3BDHEADELNWUA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: read tcp 5.161.89.252:12188->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233921791 (266h47m30.416366771s) [noise=true , address=45.91.116.6:4976 , piece_id=6RKPBVLLDTIEYOBANAB4NRDYAY353LUCVAOAS2523RTXCVCDVO3A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:121tumRJ6tGiip2dumJr9ZWMoU5BA2HuLEwU5GxBxzTZjMhv3Pp, address:45.91.116.6:4976): protocol: write tcp 5.161.89.252:62910->45.91.116.6:4976: use of closed network connection; close tcp 5.161.89.252:62910->45.91.116.6:4976: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233966906 (266h47m30.416411876s) [noise=true , address=45.91.116.12:4225 , piece_id=M7NFP2QJD5JTMJXROZSXKW6LAJ45WTJJ4XOJLBD4UQEDJJSEY4RA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection; write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection Jan 26 18:43:52.233984328 (266h47m30.416429288s) [seg_pos={0 0}, upload=234289]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 26 18:43:52.255878794 (266h47m30.438323804s) [upload=234289]: Done uploading segments... Jan 26 18:43:52.255942072 (266h47m30.438387072s) [upload=234289]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 417.764103ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 577.299346ms trace: https://jaeger.dev.storj.io/trace/6fe61816dac9c35f FAIL (2026-01-26 18:57:41 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 577.352666ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.......................................XX...................] duration: 508.599905ms trace: https://jaeger.dev.storj.io/trace/460a0499eabe6dd0 FAIL (2026-01-26 18:57:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 508.621825ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 365.204003ms trace: https://jaeger.dev.storj.io/trace/3bb5e6bb5aa7ad6b FAIL (2026-01-26 18:57:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 26 18:43:22.244729209 (266h47m0.42717419s) [upload=234289]: Starting upload Jan 26 18:43:22.244783651 (266h47m0.427228631s) [upload=234289]: Done starting upload Jan 26 18:43:22.244862287 (266h47m0.427307267s) [upload=234289]: Uploading segments... Jan 26 18:43:22.245010364 (266h47m0.427455334s) [upload=234289]: Got next segment. Inline: false Jan 26 18:43:22.245044468 (266h47m0.427489448s) [upload=234289]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 26 18:43:22.245048175 (266h47m0.427493155s) [upload=234289]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 26 18:43:22.266231092 (266h47m0.448676072s) [seg_pos={0 0}, upload=234289]: Begin upload segment... Jan 26 18:43:22.266262791 (266h47m0.448707761s) [seg_pos={0 0}, upload=234289]: Done begin upload segment. Jan 26 18:43:22.266285364 (266h47m0.448730334s) [noise=true , address=45.91.116.12:4225 , piece_id=M7NFP2QJD5JTMJXROZSXKW6LAJ45WTJJ4XOJLBD4UQEDJJSEY4RA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.266372465 (266h47m0.448817446s) [noise=true , address=145.79.227.47:4265 , piece_id=RQLMIDMVU45GIR2VOBZQRVLZEEKI4TEU4EJVTLLNLKDHAS3GSGTQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.266739602 (266h47m0.449184583s) [noise=true , address=45.91.116.7:4010 , piece_id=3RADWMUAMQOTQQF3YLXSJJOWSQRZEWVZJQXPHMADDWYQIKJX6UCA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267056043 (266h47m0.449501013s) [noise=true , address=145.79.227.13:4803 , piece_id=TVP3SVAKCCCFAOOVG3DAPLEAAL3IFP76TCQ4LN43I2TQNDZT7DGA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267372755 (266h47m0.449817725s) [noise=true , address=45.91.116.9:4261 , piece_id=BWWCW3CPBTPWOF4K2NUOXEZRMHZGILDOT335RY5TSZUJSETSF6BA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267627821 (266h47m0.450072801s) [noise=true , address=45.91.116.6:4976 , piece_id=6RKPBVLLDTIEYOBANAB4NRDYAY353LUCVAOAS2523RTXCVCDVO3A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267660202 (266h47m0.450105171s) [noise=true , address=145.79.227.33:4871 , piece_id=2VUU7K3BCWPKKHHU7CAXEBRITS6ED6WDFPU3ODBG2YPDTCZKWD3A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267886355 (266h47m0.450331325s) [noise=true , address=145.79.227.52:4446 , piece_id=SWREVABTLINLIKWZ5T4K4F6TAC5VF4PWHPPTIT2HVMEBFHRSNKEA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268219706 (266h47m0.450664677s) [noise=true , address=145.79.227.39:4013 , piece_id=IDWYWDFFNKZN5EY2THLNG57FF3JQNQVFVU6RF4MACLIEDF7ZV37A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268756349 (266h47m0.451201319s) [noise=true , address=145.79.227.48:4301 , piece_id=JYZZKQCYSWGQD3JTFIXNQ2UNLU4H2K7D2EAEB7EILRUHHWZG6X5A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268762169 (266h47m0.451207149s) [noise=true , address=145.79.227.46:4601 , piece_id=AWDYHRIULVSHJY4MMGUTV54D7WBTSRWTXUWX35HIYDNB63I4QPFQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268800502 (266h47m0.451245472s) [noise=true , address=145.79.227.51:4411 , piece_id=QX42UUIQRKDLVW2P4MDHGVM7YBDK4TB2LENZBVDLS4RMUQLPLHNQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269264038 (266h47m0.451709008s) [noise=true , address=145.79.227.22:4511 , piece_id=OGUKV6FBZNOYNTUO3A7M3Z532KQZH2K5AQIDPUKD3RYDPXFHBAEQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269456296 (266h47m0.451901276s) [noise=true , address=145.79.227.37:4565 , piece_id=JQVIFKPIBMXFTYYTHF3Q7DKEIFSMKV6FBXFOIZ4HJEDCT3S7YGJA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269827900 (266h47m0.45227287s) [noise=true , address=45.91.116.14:4191 , piece_id=HAYM5NIRM2ELGZ7FO7L2EY3HMAAED7JWEC4V7SD3BDHEADELNWUA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.270230122 (266h47m0.452675091s) [noise=true , address=145.79.227.24:4583 , piece_id=7ITWHDHIII3LFUA2AD3UQBXFXP43CFDIK4NKHYDD2BTGJII2WRBA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.346167333 (266h47m0.528612314s) [upload=234289]: Next returned nil segment Jan 26 18:43:22.346177152 (266h47m0.528622132s) [upload=234289]: Waiting for error group managing segments... Jan 26 18:43:22.355942092 (266h47m0.538387072s) [noise=true , address=145.79.227.52:4446 , piece_id=SWREVABTLINLIKWZ5T4K4F6TAC5VF4PWHPPTIT2HVMEBFHRSNKEA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.356544547 (266h47m0.538989517s) [noise=true , address=145.79.227.51:4411 , piece_id=QX42UUIQRKDLVW2P4MDHGVM7YBDK4TB2LENZBVDLS4RMUQLPLHNQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357475265 (266h47m0.539920235s) [noise=true , address=145.79.227.48:4301 , piece_id=JYZZKQCYSWGQD3JTFIXNQ2UNLU4H2K7D2EAEB7EILRUHHWZG6X5A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357741102 (266h47m0.540186082s) [noise=true , address=145.79.227.47:4265 , piece_id=RQLMIDMVU45GIR2VOBZQRVLZEEKI4TEU4EJVTLLNLKDHAS3GSGTQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357892725 (266h47m0.540337705s) [noise=true , address=145.79.227.24:4583 , piece_id=7ITWHDHIII3LFUA2AD3UQBXFXP43CFDIK4NKHYDD2BTGJII2WRBA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358205700 (266h47m0.54065068s) [noise=true , address=145.79.227.39:4013 , piece_id=IDWYWDFFNKZN5EY2THLNG57FF3JQNQVFVU6RF4MACLIEDF7ZV37A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358277304 (266h47m0.540722284s) [noise=true , address=145.79.227.46:4601 , piece_id=AWDYHRIULVSHJY4MMGUTV54D7WBTSRWTXUWX35HIYDNB63I4QPFQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358633879 (266h47m0.541078859s) [noise=true , address=145.79.227.13:4803 , piece_id=TVP3SVAKCCCFAOOVG3DAPLEAAL3IFP76TCQ4LN43I2TQNDZT7DGA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.359212861 (266h47m0.541657832s) [noise=true , address=145.79.227.33:4871 , piece_id=2VUU7K3BCWPKKHHU7CAXEBRITS6ED6WDFPU3ODBG2YPDTCZKWD3A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.359410610 (266h47m0.54185559s) [noise=true , address=145.79.227.22:4511 , piece_id=OGUKV6FBZNOYNTUO3A7M3Z532KQZH2K5AQIDPUKD3RYDPXFHBAEQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.374088006 (266h47m0.556532976s) [noise=true , address=145.79.227.37:4565 , piece_id=JQVIFKPIBMXFTYYTHF3Q7DKEIFSMKV6FBXFOIZ4HJEDCT3S7YGJA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:52.233014687 (266h47m30.415459677s) [noise=true , address=45.91.116.9:4261 , piece_id=BWWCW3CPBTPWOF4K2NUOXEZRMHZGILDOT335RY5TSZUJSETSF6BA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection Jan 26 18:43:52.233783362 (266h47m30.416228333s) [noise=true , address=45.91.116.7:4010 , piece_id=3RADWMUAMQOTQQF3YLXSJJOWSQRZEWVZJQXPHMADDWYQIKJX6UCA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233815402 (266h47m30.416260362s) [noise=true , address=45.91.116.14:4191 , piece_id=HAYM5NIRM2ELGZ7FO7L2EY3HMAAED7JWEC4V7SD3BDHEADELNWUA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: read tcp 5.161.89.252:12188->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233921791 (266h47m30.416366771s) [noise=true , address=45.91.116.6:4976 , piece_id=6RKPBVLLDTIEYOBANAB4NRDYAY353LUCVAOAS2523RTXCVCDVO3A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:121tumRJ6tGiip2dumJr9ZWMoU5BA2HuLEwU5GxBxzTZjMhv3Pp, address:45.91.116.6:4976): protocol: write tcp 5.161.89.252:62910->45.91.116.6:4976: use of closed network connection; close tcp 5.161.89.252:62910->45.91.116.6:4976: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233966906 (266h47m30.416411876s) [noise=true , address=45.91.116.12:4225 , piece_id=M7NFP2QJD5JTMJXROZSXKW6LAJ45WTJJ4XOJLBD4UQEDJJSEY4RA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection; write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection Jan 26 18:43:52.233984328 (266h47m30.416429288s) [seg_pos={0 0}, upload=234289]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 26 18:43:52.255878794 (266h47m30.438323804s) [upload=234289]: Done uploading segments... Jan 26 18:43:52.255942072 (266h47m30.438387072s) [upload=234289]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 365.233717ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 607.6578ms trace: https://jaeger.dev.storj.io/trace/6fe61816dac9c35f FAIL (2026-01-26 18:57:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 607.68545ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 320.002619ms trace: https://jaeger.dev.storj.io/trace/3bb5e6bb5aa7ad6b FAIL (2026-01-26 18:56:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 26 18:43:22.244729209 (266h47m0.42717419s) [upload=234289]: Starting upload Jan 26 18:43:22.244783651 (266h47m0.427228631s) [upload=234289]: Done starting upload Jan 26 18:43:22.244862287 (266h47m0.427307267s) [upload=234289]: Uploading segments... Jan 26 18:43:22.245010364 (266h47m0.427455334s) [upload=234289]: Got next segment. Inline: false Jan 26 18:43:22.245044468 (266h47m0.427489448s) [upload=234289]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 26 18:43:22.245048175 (266h47m0.427493155s) [upload=234289]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 26 18:43:22.266231092 (266h47m0.448676072s) [seg_pos={0 0}, upload=234289]: Begin upload segment... Jan 26 18:43:22.266262791 (266h47m0.448707761s) [seg_pos={0 0}, upload=234289]: Done begin upload segment. Jan 26 18:43:22.266285364 (266h47m0.448730334s) [noise=true , address=45.91.116.12:4225 , piece_id=M7NFP2QJD5JTMJXROZSXKW6LAJ45WTJJ4XOJLBD4UQEDJJSEY4RA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.266372465 (266h47m0.448817446s) [noise=true , address=145.79.227.47:4265 , piece_id=RQLMIDMVU45GIR2VOBZQRVLZEEKI4TEU4EJVTLLNLKDHAS3GSGTQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.266739602 (266h47m0.449184583s) [noise=true , address=45.91.116.7:4010 , piece_id=3RADWMUAMQOTQQF3YLXSJJOWSQRZEWVZJQXPHMADDWYQIKJX6UCA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267056043 (266h47m0.449501013s) [noise=true , address=145.79.227.13:4803 , piece_id=TVP3SVAKCCCFAOOVG3DAPLEAAL3IFP76TCQ4LN43I2TQNDZT7DGA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267372755 (266h47m0.449817725s) [noise=true , address=45.91.116.9:4261 , piece_id=BWWCW3CPBTPWOF4K2NUOXEZRMHZGILDOT335RY5TSZUJSETSF6BA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267627821 (266h47m0.450072801s) [noise=true , address=45.91.116.6:4976 , piece_id=6RKPBVLLDTIEYOBANAB4NRDYAY353LUCVAOAS2523RTXCVCDVO3A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267660202 (266h47m0.450105171s) [noise=true , address=145.79.227.33:4871 , piece_id=2VUU7K3BCWPKKHHU7CAXEBRITS6ED6WDFPU3ODBG2YPDTCZKWD3A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267886355 (266h47m0.450331325s) [noise=true , address=145.79.227.52:4446 , piece_id=SWREVABTLINLIKWZ5T4K4F6TAC5VF4PWHPPTIT2HVMEBFHRSNKEA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268219706 (266h47m0.450664677s) [noise=true , address=145.79.227.39:4013 , piece_id=IDWYWDFFNKZN5EY2THLNG57FF3JQNQVFVU6RF4MACLIEDF7ZV37A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268756349 (266h47m0.451201319s) [noise=true , address=145.79.227.48:4301 , piece_id=JYZZKQCYSWGQD3JTFIXNQ2UNLU4H2K7D2EAEB7EILRUHHWZG6X5A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268762169 (266h47m0.451207149s) [noise=true , address=145.79.227.46:4601 , piece_id=AWDYHRIULVSHJY4MMGUTV54D7WBTSRWTXUWX35HIYDNB63I4QPFQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268800502 (266h47m0.451245472s) [noise=true , address=145.79.227.51:4411 , piece_id=QX42UUIQRKDLVW2P4MDHGVM7YBDK4TB2LENZBVDLS4RMUQLPLHNQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269264038 (266h47m0.451709008s) [noise=true , address=145.79.227.22:4511 , piece_id=OGUKV6FBZNOYNTUO3A7M3Z532KQZH2K5AQIDPUKD3RYDPXFHBAEQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269456296 (266h47m0.451901276s) [noise=true , address=145.79.227.37:4565 , piece_id=JQVIFKPIBMXFTYYTHF3Q7DKEIFSMKV6FBXFOIZ4HJEDCT3S7YGJA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269827900 (266h47m0.45227287s) [noise=true , address=45.91.116.14:4191 , piece_id=HAYM5NIRM2ELGZ7FO7L2EY3HMAAED7JWEC4V7SD3BDHEADELNWUA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.270230122 (266h47m0.452675091s) [noise=true , address=145.79.227.24:4583 , piece_id=7ITWHDHIII3LFUA2AD3UQBXFXP43CFDIK4NKHYDD2BTGJII2WRBA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.346167333 (266h47m0.528612314s) [upload=234289]: Next returned nil segment Jan 26 18:43:22.346177152 (266h47m0.528622132s) [upload=234289]: Waiting for error group managing segments... Jan 26 18:43:22.355942092 (266h47m0.538387072s) [noise=true , address=145.79.227.52:4446 , piece_id=SWREVABTLINLIKWZ5T4K4F6TAC5VF4PWHPPTIT2HVMEBFHRSNKEA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.356544547 (266h47m0.538989517s) [noise=true , address=145.79.227.51:4411 , piece_id=QX42UUIQRKDLVW2P4MDHGVM7YBDK4TB2LENZBVDLS4RMUQLPLHNQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357475265 (266h47m0.539920235s) [noise=true , address=145.79.227.48:4301 , piece_id=JYZZKQCYSWGQD3JTFIXNQ2UNLU4H2K7D2EAEB7EILRUHHWZG6X5A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357741102 (266h47m0.540186082s) [noise=true , address=145.79.227.47:4265 , piece_id=RQLMIDMVU45GIR2VOBZQRVLZEEKI4TEU4EJVTLLNLKDHAS3GSGTQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357892725 (266h47m0.540337705s) [noise=true , address=145.79.227.24:4583 , piece_id=7ITWHDHIII3LFUA2AD3UQBXFXP43CFDIK4NKHYDD2BTGJII2WRBA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358205700 (266h47m0.54065068s) [noise=true , address=145.79.227.39:4013 , piece_id=IDWYWDFFNKZN5EY2THLNG57FF3JQNQVFVU6RF4MACLIEDF7ZV37A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358277304 (266h47m0.540722284s) [noise=true , address=145.79.227.46:4601 , piece_id=AWDYHRIULVSHJY4MMGUTV54D7WBTSRWTXUWX35HIYDNB63I4QPFQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358633879 (266h47m0.541078859s) [noise=true , address=145.79.227.13:4803 , piece_id=TVP3SVAKCCCFAOOVG3DAPLEAAL3IFP76TCQ4LN43I2TQNDZT7DGA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.359212861 (266h47m0.541657832s) [noise=true , address=145.79.227.33:4871 , piece_id=2VUU7K3BCWPKKHHU7CAXEBRITS6ED6WDFPU3ODBG2YPDTCZKWD3A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.359410610 (266h47m0.54185559s) [noise=true , address=145.79.227.22:4511 , piece_id=OGUKV6FBZNOYNTUO3A7M3Z532KQZH2K5AQIDPUKD3RYDPXFHBAEQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.374088006 (266h47m0.556532976s) [noise=true , address=145.79.227.37:4565 , piece_id=JQVIFKPIBMXFTYYTHF3Q7DKEIFSMKV6FBXFOIZ4HJEDCT3S7YGJA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:52.233014687 (266h47m30.415459677s) [noise=true , address=45.91.116.9:4261 , piece_id=BWWCW3CPBTPWOF4K2NUOXEZRMHZGILDOT335RY5TSZUJSETSF6BA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection Jan 26 18:43:52.233783362 (266h47m30.416228333s) [noise=true , address=45.91.116.7:4010 , piece_id=3RADWMUAMQOTQQF3YLXSJJOWSQRZEWVZJQXPHMADDWYQIKJX6UCA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233815402 (266h47m30.416260362s) [noise=true , address=45.91.116.14:4191 , piece_id=HAYM5NIRM2ELGZ7FO7L2EY3HMAAED7JWEC4V7SD3BDHEADELNWUA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: read tcp 5.161.89.252:12188->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233921791 (266h47m30.416366771s) [noise=true , address=45.91.116.6:4976 , piece_id=6RKPBVLLDTIEYOBANAB4NRDYAY353LUCVAOAS2523RTXCVCDVO3A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:121tumRJ6tGiip2dumJr9ZWMoU5BA2HuLEwU5GxBxzTZjMhv3Pp, address:45.91.116.6:4976): protocol: write tcp 5.161.89.252:62910->45.91.116.6:4976: use of closed network connection; close tcp 5.161.89.252:62910->45.91.116.6:4976: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233966906 (266h47m30.416411876s) [noise=true , address=45.91.116.12:4225 , piece_id=M7NFP2QJD5JTMJXROZSXKW6LAJ45WTJJ4XOJLBD4UQEDJJSEY4RA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection; write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection Jan 26 18:43:52.233984328 (266h47m30.416429288s) [seg_pos={0 0}, upload=234289]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 26 18:43:52.255878794 (266h47m30.438323804s) [upload=234289]: Done uploading segments... Jan 26 18:43:52.255942072 (266h47m30.438387072s) [upload=234289]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 320.019021ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [........................................XX..................] duration: 468.882031ms trace: https://jaeger.dev.storj.io/trace/460a0499eabe6dd0 FAIL (2026-01-26 18:56:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 468.899763ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.........................................XX.................] duration: 463.51764ms trace: https://jaeger.dev.storj.io/trace/460a0499eabe6dd0 FAIL (2026-01-26 18:56:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 463.527689ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 593.524334ms trace: https://jaeger.dev.storj.io/trace/6fe61816dac9c35f FAIL (2026-01-26 18:56:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 593.549851ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [..........................................XX................] duration: 463.923829ms trace: https://jaeger.dev.storj.io/trace/460a0499eabe6dd0 FAIL (2026-01-26 18:55:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 463.947102ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 371.953982ms trace: https://jaeger.dev.storj.io/trace/3bb5e6bb5aa7ad6b FAIL (2026-01-26 18:55:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 26 18:43:22.244729209 (266h47m0.42717419s) [upload=234289]: Starting upload Jan 26 18:43:22.244783651 (266h47m0.427228631s) [upload=234289]: Done starting upload Jan 26 18:43:22.244862287 (266h47m0.427307267s) [upload=234289]: Uploading segments... Jan 26 18:43:22.245010364 (266h47m0.427455334s) [upload=234289]: Got next segment. Inline: false Jan 26 18:43:22.245044468 (266h47m0.427489448s) [upload=234289]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 26 18:43:22.245048175 (266h47m0.427493155s) [upload=234289]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 26 18:43:22.266231092 (266h47m0.448676072s) [seg_pos={0 0}, upload=234289]: Begin upload segment... Jan 26 18:43:22.266262791 (266h47m0.448707761s) [seg_pos={0 0}, upload=234289]: Done begin upload segment. Jan 26 18:43:22.266285364 (266h47m0.448730334s) [noise=true , address=45.91.116.12:4225 , piece_id=M7NFP2QJD5JTMJXROZSXKW6LAJ45WTJJ4XOJLBD4UQEDJJSEY4RA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.266372465 (266h47m0.448817446s) [noise=true , address=145.79.227.47:4265 , piece_id=RQLMIDMVU45GIR2VOBZQRVLZEEKI4TEU4EJVTLLNLKDHAS3GSGTQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.266739602 (266h47m0.449184583s) [noise=true , address=45.91.116.7:4010 , piece_id=3RADWMUAMQOTQQF3YLXSJJOWSQRZEWVZJQXPHMADDWYQIKJX6UCA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267056043 (266h47m0.449501013s) [noise=true , address=145.79.227.13:4803 , piece_id=TVP3SVAKCCCFAOOVG3DAPLEAAL3IFP76TCQ4LN43I2TQNDZT7DGA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267372755 (266h47m0.449817725s) [noise=true , address=45.91.116.9:4261 , piece_id=BWWCW3CPBTPWOF4K2NUOXEZRMHZGILDOT335RY5TSZUJSETSF6BA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267627821 (266h47m0.450072801s) [noise=true , address=45.91.116.6:4976 , piece_id=6RKPBVLLDTIEYOBANAB4NRDYAY353LUCVAOAS2523RTXCVCDVO3A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267660202 (266h47m0.450105171s) [noise=true , address=145.79.227.33:4871 , piece_id=2VUU7K3BCWPKKHHU7CAXEBRITS6ED6WDFPU3ODBG2YPDTCZKWD3A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267886355 (266h47m0.450331325s) [noise=true , address=145.79.227.52:4446 , piece_id=SWREVABTLINLIKWZ5T4K4F6TAC5VF4PWHPPTIT2HVMEBFHRSNKEA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268219706 (266h47m0.450664677s) [noise=true , address=145.79.227.39:4013 , piece_id=IDWYWDFFNKZN5EY2THLNG57FF3JQNQVFVU6RF4MACLIEDF7ZV37A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268756349 (266h47m0.451201319s) [noise=true , address=145.79.227.48:4301 , piece_id=JYZZKQCYSWGQD3JTFIXNQ2UNLU4H2K7D2EAEB7EILRUHHWZG6X5A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268762169 (266h47m0.451207149s) [noise=true , address=145.79.227.46:4601 , piece_id=AWDYHRIULVSHJY4MMGUTV54D7WBTSRWTXUWX35HIYDNB63I4QPFQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268800502 (266h47m0.451245472s) [noise=true , address=145.79.227.51:4411 , piece_id=QX42UUIQRKDLVW2P4MDHGVM7YBDK4TB2LENZBVDLS4RMUQLPLHNQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269264038 (266h47m0.451709008s) [noise=true , address=145.79.227.22:4511 , piece_id=OGUKV6FBZNOYNTUO3A7M3Z532KQZH2K5AQIDPUKD3RYDPXFHBAEQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269456296 (266h47m0.451901276s) [noise=true , address=145.79.227.37:4565 , piece_id=JQVIFKPIBMXFTYYTHF3Q7DKEIFSMKV6FBXFOIZ4HJEDCT3S7YGJA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269827900 (266h47m0.45227287s) [noise=true , address=45.91.116.14:4191 , piece_id=HAYM5NIRM2ELGZ7FO7L2EY3HMAAED7JWEC4V7SD3BDHEADELNWUA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.270230122 (266h47m0.452675091s) [noise=true , address=145.79.227.24:4583 , piece_id=7ITWHDHIII3LFUA2AD3UQBXFXP43CFDIK4NKHYDD2BTGJII2WRBA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.346167333 (266h47m0.528612314s) [upload=234289]: Next returned nil segment Jan 26 18:43:22.346177152 (266h47m0.528622132s) [upload=234289]: Waiting for error group managing segments... Jan 26 18:43:22.355942092 (266h47m0.538387072s) [noise=true , address=145.79.227.52:4446 , piece_id=SWREVABTLINLIKWZ5T4K4F6TAC5VF4PWHPPTIT2HVMEBFHRSNKEA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.356544547 (266h47m0.538989517s) [noise=true , address=145.79.227.51:4411 , piece_id=QX42UUIQRKDLVW2P4MDHGVM7YBDK4TB2LENZBVDLS4RMUQLPLHNQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357475265 (266h47m0.539920235s) [noise=true , address=145.79.227.48:4301 , piece_id=JYZZKQCYSWGQD3JTFIXNQ2UNLU4H2K7D2EAEB7EILRUHHWZG6X5A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357741102 (266h47m0.540186082s) [noise=true , address=145.79.227.47:4265 , piece_id=RQLMIDMVU45GIR2VOBZQRVLZEEKI4TEU4EJVTLLNLKDHAS3GSGTQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357892725 (266h47m0.540337705s) [noise=true , address=145.79.227.24:4583 , piece_id=7ITWHDHIII3LFUA2AD3UQBXFXP43CFDIK4NKHYDD2BTGJII2WRBA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358205700 (266h47m0.54065068s) [noise=true , address=145.79.227.39:4013 , piece_id=IDWYWDFFNKZN5EY2THLNG57FF3JQNQVFVU6RF4MACLIEDF7ZV37A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358277304 (266h47m0.540722284s) [noise=true , address=145.79.227.46:4601 , piece_id=AWDYHRIULVSHJY4MMGUTV54D7WBTSRWTXUWX35HIYDNB63I4QPFQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358633879 (266h47m0.541078859s) [noise=true , address=145.79.227.13:4803 , piece_id=TVP3SVAKCCCFAOOVG3DAPLEAAL3IFP76TCQ4LN43I2TQNDZT7DGA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.359212861 (266h47m0.541657832s) [noise=true , address=145.79.227.33:4871 , piece_id=2VUU7K3BCWPKKHHU7CAXEBRITS6ED6WDFPU3ODBG2YPDTCZKWD3A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.359410610 (266h47m0.54185559s) [noise=true , address=145.79.227.22:4511 , piece_id=OGUKV6FBZNOYNTUO3A7M3Z532KQZH2K5AQIDPUKD3RYDPXFHBAEQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.374088006 (266h47m0.556532976s) [noise=true , address=145.79.227.37:4565 , piece_id=JQVIFKPIBMXFTYYTHF3Q7DKEIFSMKV6FBXFOIZ4HJEDCT3S7YGJA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:52.233014687 (266h47m30.415459677s) [noise=true , address=45.91.116.9:4261 , piece_id=BWWCW3CPBTPWOF4K2NUOXEZRMHZGILDOT335RY5TSZUJSETSF6BA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection Jan 26 18:43:52.233783362 (266h47m30.416228333s) [noise=true , address=45.91.116.7:4010 , piece_id=3RADWMUAMQOTQQF3YLXSJJOWSQRZEWVZJQXPHMADDWYQIKJX6UCA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233815402 (266h47m30.416260362s) [noise=true , address=45.91.116.14:4191 , piece_id=HAYM5NIRM2ELGZ7FO7L2EY3HMAAED7JWEC4V7SD3BDHEADELNWUA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: read tcp 5.161.89.252:12188->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233921791 (266h47m30.416366771s) [noise=true , address=45.91.116.6:4976 , piece_id=6RKPBVLLDTIEYOBANAB4NRDYAY353LUCVAOAS2523RTXCVCDVO3A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:121tumRJ6tGiip2dumJr9ZWMoU5BA2HuLEwU5GxBxzTZjMhv3Pp, address:45.91.116.6:4976): protocol: write tcp 5.161.89.252:62910->45.91.116.6:4976: use of closed network connection; close tcp 5.161.89.252:62910->45.91.116.6:4976: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233966906 (266h47m30.416411876s) [noise=true , address=45.91.116.12:4225 , piece_id=M7NFP2QJD5JTMJXROZSXKW6LAJ45WTJJ4XOJLBD4UQEDJJSEY4RA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection; write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection Jan 26 18:43:52.233984328 (266h47m30.416429288s) [seg_pos={0 0}, upload=234289]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 26 18:43:52.255878794 (266h47m30.438323804s) [upload=234289]: Done uploading segments... Jan 26 18:43:52.255942072 (266h47m30.438387072s) [upload=234289]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 371.971764ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 411.949654ms trace: https://jaeger.dev.storj.io/trace/3bb5e6bb5aa7ad6b FAIL (2026-01-26 18:55:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 26 18:43:22.244729209 (266h47m0.42717419s) [upload=234289]: Starting upload Jan 26 18:43:22.244783651 (266h47m0.427228631s) [upload=234289]: Done starting upload Jan 26 18:43:22.244862287 (266h47m0.427307267s) [upload=234289]: Uploading segments... Jan 26 18:43:22.245010364 (266h47m0.427455334s) [upload=234289]: Got next segment. Inline: false Jan 26 18:43:22.245044468 (266h47m0.427489448s) [upload=234289]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 26 18:43:22.245048175 (266h47m0.427493155s) [upload=234289]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 26 18:43:22.266231092 (266h47m0.448676072s) [seg_pos={0 0}, upload=234289]: Begin upload segment... Jan 26 18:43:22.266262791 (266h47m0.448707761s) [seg_pos={0 0}, upload=234289]: Done begin upload segment. Jan 26 18:43:22.266285364 (266h47m0.448730334s) [noise=true , address=45.91.116.12:4225 , piece_id=M7NFP2QJD5JTMJXROZSXKW6LAJ45WTJJ4XOJLBD4UQEDJJSEY4RA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.266372465 (266h47m0.448817446s) [noise=true , address=145.79.227.47:4265 , piece_id=RQLMIDMVU45GIR2VOBZQRVLZEEKI4TEU4EJVTLLNLKDHAS3GSGTQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.266739602 (266h47m0.449184583s) [noise=true , address=45.91.116.7:4010 , piece_id=3RADWMUAMQOTQQF3YLXSJJOWSQRZEWVZJQXPHMADDWYQIKJX6UCA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267056043 (266h47m0.449501013s) [noise=true , address=145.79.227.13:4803 , piece_id=TVP3SVAKCCCFAOOVG3DAPLEAAL3IFP76TCQ4LN43I2TQNDZT7DGA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267372755 (266h47m0.449817725s) [noise=true , address=45.91.116.9:4261 , piece_id=BWWCW3CPBTPWOF4K2NUOXEZRMHZGILDOT335RY5TSZUJSETSF6BA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267627821 (266h47m0.450072801s) [noise=true , address=45.91.116.6:4976 , piece_id=6RKPBVLLDTIEYOBANAB4NRDYAY353LUCVAOAS2523RTXCVCDVO3A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267660202 (266h47m0.450105171s) [noise=true , address=145.79.227.33:4871 , piece_id=2VUU7K3BCWPKKHHU7CAXEBRITS6ED6WDFPU3ODBG2YPDTCZKWD3A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267886355 (266h47m0.450331325s) [noise=true , address=145.79.227.52:4446 , piece_id=SWREVABTLINLIKWZ5T4K4F6TAC5VF4PWHPPTIT2HVMEBFHRSNKEA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268219706 (266h47m0.450664677s) [noise=true , address=145.79.227.39:4013 , piece_id=IDWYWDFFNKZN5EY2THLNG57FF3JQNQVFVU6RF4MACLIEDF7ZV37A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268756349 (266h47m0.451201319s) [noise=true , address=145.79.227.48:4301 , piece_id=JYZZKQCYSWGQD3JTFIXNQ2UNLU4H2K7D2EAEB7EILRUHHWZG6X5A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268762169 (266h47m0.451207149s) [noise=true , address=145.79.227.46:4601 , piece_id=AWDYHRIULVSHJY4MMGUTV54D7WBTSRWTXUWX35HIYDNB63I4QPFQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268800502 (266h47m0.451245472s) [noise=true , address=145.79.227.51:4411 , piece_id=QX42UUIQRKDLVW2P4MDHGVM7YBDK4TB2LENZBVDLS4RMUQLPLHNQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269264038 (266h47m0.451709008s) [noise=true , address=145.79.227.22:4511 , piece_id=OGUKV6FBZNOYNTUO3A7M3Z532KQZH2K5AQIDPUKD3RYDPXFHBAEQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269456296 (266h47m0.451901276s) [noise=true , address=145.79.227.37:4565 , piece_id=JQVIFKPIBMXFTYYTHF3Q7DKEIFSMKV6FBXFOIZ4HJEDCT3S7YGJA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269827900 (266h47m0.45227287s) [noise=true , address=45.91.116.14:4191 , piece_id=HAYM5NIRM2ELGZ7FO7L2EY3HMAAED7JWEC4V7SD3BDHEADELNWUA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.270230122 (266h47m0.452675091s) [noise=true , address=145.79.227.24:4583 , piece_id=7ITWHDHIII3LFUA2AD3UQBXFXP43CFDIK4NKHYDD2BTGJII2WRBA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.346167333 (266h47m0.528612314s) [upload=234289]: Next returned nil segment Jan 26 18:43:22.346177152 (266h47m0.528622132s) [upload=234289]: Waiting for error group managing segments... Jan 26 18:43:22.355942092 (266h47m0.538387072s) [noise=true , address=145.79.227.52:4446 , piece_id=SWREVABTLINLIKWZ5T4K4F6TAC5VF4PWHPPTIT2HVMEBFHRSNKEA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.356544547 (266h47m0.538989517s) [noise=true , address=145.79.227.51:4411 , piece_id=QX42UUIQRKDLVW2P4MDHGVM7YBDK4TB2LENZBVDLS4RMUQLPLHNQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357475265 (266h47m0.539920235s) [noise=true , address=145.79.227.48:4301 , piece_id=JYZZKQCYSWGQD3JTFIXNQ2UNLU4H2K7D2EAEB7EILRUHHWZG6X5A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357741102 (266h47m0.540186082s) [noise=true , address=145.79.227.47:4265 , piece_id=RQLMIDMVU45GIR2VOBZQRVLZEEKI4TEU4EJVTLLNLKDHAS3GSGTQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357892725 (266h47m0.540337705s) [noise=true , address=145.79.227.24:4583 , piece_id=7ITWHDHIII3LFUA2AD3UQBXFXP43CFDIK4NKHYDD2BTGJII2WRBA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358205700 (266h47m0.54065068s) [noise=true , address=145.79.227.39:4013 , piece_id=IDWYWDFFNKZN5EY2THLNG57FF3JQNQVFVU6RF4MACLIEDF7ZV37A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358277304 (266h47m0.540722284s) [noise=true , address=145.79.227.46:4601 , piece_id=AWDYHRIULVSHJY4MMGUTV54D7WBTSRWTXUWX35HIYDNB63I4QPFQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358633879 (266h47m0.541078859s) [noise=true , address=145.79.227.13:4803 , piece_id=TVP3SVAKCCCFAOOVG3DAPLEAAL3IFP76TCQ4LN43I2TQNDZT7DGA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.359212861 (266h47m0.541657832s) [noise=true , address=145.79.227.33:4871 , piece_id=2VUU7K3BCWPKKHHU7CAXEBRITS6ED6WDFPU3ODBG2YPDTCZKWD3A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.359410610 (266h47m0.54185559s) [noise=true , address=145.79.227.22:4511 , piece_id=OGUKV6FBZNOYNTUO3A7M3Z532KQZH2K5AQIDPUKD3RYDPXFHBAEQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.374088006 (266h47m0.556532976s) [noise=true , address=145.79.227.37:4565 , piece_id=JQVIFKPIBMXFTYYTHF3Q7DKEIFSMKV6FBXFOIZ4HJEDCT3S7YGJA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:52.233014687 (266h47m30.415459677s) [noise=true , address=45.91.116.9:4261 , piece_id=BWWCW3CPBTPWOF4K2NUOXEZRMHZGILDOT335RY5TSZUJSETSF6BA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection Jan 26 18:43:52.233783362 (266h47m30.416228333s) [noise=true , address=45.91.116.7:4010 , piece_id=3RADWMUAMQOTQQF3YLXSJJOWSQRZEWVZJQXPHMADDWYQIKJX6UCA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233815402 (266h47m30.416260362s) [noise=true , address=45.91.116.14:4191 , piece_id=HAYM5NIRM2ELGZ7FO7L2EY3HMAAED7JWEC4V7SD3BDHEADELNWUA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: read tcp 5.161.89.252:12188->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233921791 (266h47m30.416366771s) [noise=true , address=45.91.116.6:4976 , piece_id=6RKPBVLLDTIEYOBANAB4NRDYAY353LUCVAOAS2523RTXCVCDVO3A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:121tumRJ6tGiip2dumJr9ZWMoU5BA2HuLEwU5GxBxzTZjMhv3Pp, address:45.91.116.6:4976): protocol: write tcp 5.161.89.252:62910->45.91.116.6:4976: use of closed network connection; close tcp 5.161.89.252:62910->45.91.116.6:4976: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233966906 (266h47m30.416411876s) [noise=true , address=45.91.116.12:4225 , piece_id=M7NFP2QJD5JTMJXROZSXKW6LAJ45WTJJ4XOJLBD4UQEDJJSEY4RA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection; write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection Jan 26 18:43:52.233984328 (266h47m30.416429288s) [seg_pos={0 0}, upload=234289]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 26 18:43:52.255878794 (266h47m30.438323804s) [upload=234289]: Done uploading segments... Jan 26 18:43:52.255942072 (266h47m30.438387072s) [upload=234289]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 411.966305ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [...........................................XX...............] duration: 625.413546ms trace: https://jaeger.dev.storj.io/trace/460a0499eabe6dd0 FAIL (2026-01-26 18:55:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 625.429145ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 905.095642ms trace: https://jaeger.dev.storj.io/trace/6fe61816dac9c35f FAIL (2026-01-26 18:55:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 905.118605ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 308.792611ms trace: https://jaeger.dev.storj.io/trace/3bb5e6bb5aa7ad6b FAIL (2026-01-26 18:54:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Jan 26 18:43:22.244729209 (266h47m0.42717419s) [upload=234289]: Starting upload Jan 26 18:43:22.244783651 (266h47m0.427228631s) [upload=234289]: Done starting upload Jan 26 18:43:22.244862287 (266h47m0.427307267s) [upload=234289]: Uploading segments... Jan 26 18:43:22.245010364 (266h47m0.427455334s) [upload=234289]: Got next segment. Inline: false Jan 26 18:43:22.245044468 (266h47m0.427489448s) [upload=234289]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 26 18:43:22.245048175 (266h47m0.427493155s) [upload=234289]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 26 18:43:22.266231092 (266h47m0.448676072s) [seg_pos={0 0}, upload=234289]: Begin upload segment... Jan 26 18:43:22.266262791 (266h47m0.448707761s) [seg_pos={0 0}, upload=234289]: Done begin upload segment. Jan 26 18:43:22.266285364 (266h47m0.448730334s) [noise=true , address=45.91.116.12:4225 , piece_id=M7NFP2QJD5JTMJXROZSXKW6LAJ45WTJJ4XOJLBD4UQEDJJSEY4RA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.266372465 (266h47m0.448817446s) [noise=true , address=145.79.227.47:4265 , piece_id=RQLMIDMVU45GIR2VOBZQRVLZEEKI4TEU4EJVTLLNLKDHAS3GSGTQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.266739602 (266h47m0.449184583s) [noise=true , address=45.91.116.7:4010 , piece_id=3RADWMUAMQOTQQF3YLXSJJOWSQRZEWVZJQXPHMADDWYQIKJX6UCA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267056043 (266h47m0.449501013s) [noise=true , address=145.79.227.13:4803 , piece_id=TVP3SVAKCCCFAOOVG3DAPLEAAL3IFP76TCQ4LN43I2TQNDZT7DGA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267372755 (266h47m0.449817725s) [noise=true , address=45.91.116.9:4261 , piece_id=BWWCW3CPBTPWOF4K2NUOXEZRMHZGILDOT335RY5TSZUJSETSF6BA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267627821 (266h47m0.450072801s) [noise=true , address=45.91.116.6:4976 , piece_id=6RKPBVLLDTIEYOBANAB4NRDYAY353LUCVAOAS2523RTXCVCDVO3A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267660202 (266h47m0.450105171s) [noise=true , address=145.79.227.33:4871 , piece_id=2VUU7K3BCWPKKHHU7CAXEBRITS6ED6WDFPU3ODBG2YPDTCZKWD3A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.267886355 (266h47m0.450331325s) [noise=true , address=145.79.227.52:4446 , piece_id=SWREVABTLINLIKWZ5T4K4F6TAC5VF4PWHPPTIT2HVMEBFHRSNKEA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268219706 (266h47m0.450664677s) [noise=true , address=145.79.227.39:4013 , piece_id=IDWYWDFFNKZN5EY2THLNG57FF3JQNQVFVU6RF4MACLIEDF7ZV37A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268756349 (266h47m0.451201319s) [noise=true , address=145.79.227.48:4301 , piece_id=JYZZKQCYSWGQD3JTFIXNQ2UNLU4H2K7D2EAEB7EILRUHHWZG6X5A, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268762169 (266h47m0.451207149s) [noise=true , address=145.79.227.46:4601 , piece_id=AWDYHRIULVSHJY4MMGUTV54D7WBTSRWTXUWX35HIYDNB63I4QPFQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.268800502 (266h47m0.451245472s) [noise=true , address=145.79.227.51:4411 , piece_id=QX42UUIQRKDLVW2P4MDHGVM7YBDK4TB2LENZBVDLS4RMUQLPLHNQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269264038 (266h47m0.451709008s) [noise=true , address=145.79.227.22:4511 , piece_id=OGUKV6FBZNOYNTUO3A7M3Z532KQZH2K5AQIDPUKD3RYDPXFHBAEQ, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269456296 (266h47m0.451901276s) [noise=true , address=145.79.227.37:4565 , piece_id=JQVIFKPIBMXFTYYTHF3Q7DKEIFSMKV6FBXFOIZ4HJEDCT3S7YGJA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.269827900 (266h47m0.45227287s) [noise=true , address=45.91.116.14:4191 , piece_id=HAYM5NIRM2ELGZ7FO7L2EY3HMAAED7JWEC4V7SD3BDHEADELNWUA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.270230122 (266h47m0.452675091s) [noise=true , address=145.79.227.24:4583 , piece_id=7ITWHDHIII3LFUA2AD3UQBXFXP43CFDIK4NKHYDD2BTGJII2WRBA, seg_pos={0 0}, upload=234289]: Uploading piece... Jan 26 18:43:22.346167333 (266h47m0.528612314s) [upload=234289]: Next returned nil segment Jan 26 18:43:22.346177152 (266h47m0.528622132s) [upload=234289]: Waiting for error group managing segments... Jan 26 18:43:22.355942092 (266h47m0.538387072s) [noise=true , address=145.79.227.52:4446 , piece_id=SWREVABTLINLIKWZ5T4K4F6TAC5VF4PWHPPTIT2HVMEBFHRSNKEA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.356544547 (266h47m0.538989517s) [noise=true , address=145.79.227.51:4411 , piece_id=QX42UUIQRKDLVW2P4MDHGVM7YBDK4TB2LENZBVDLS4RMUQLPLHNQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357475265 (266h47m0.539920235s) [noise=true , address=145.79.227.48:4301 , piece_id=JYZZKQCYSWGQD3JTFIXNQ2UNLU4H2K7D2EAEB7EILRUHHWZG6X5A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357741102 (266h47m0.540186082s) [noise=true , address=145.79.227.47:4265 , piece_id=RQLMIDMVU45GIR2VOBZQRVLZEEKI4TEU4EJVTLLNLKDHAS3GSGTQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.357892725 (266h47m0.540337705s) [noise=true , address=145.79.227.24:4583 , piece_id=7ITWHDHIII3LFUA2AD3UQBXFXP43CFDIK4NKHYDD2BTGJII2WRBA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358205700 (266h47m0.54065068s) [noise=true , address=145.79.227.39:4013 , piece_id=IDWYWDFFNKZN5EY2THLNG57FF3JQNQVFVU6RF4MACLIEDF7ZV37A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358277304 (266h47m0.540722284s) [noise=true , address=145.79.227.46:4601 , piece_id=AWDYHRIULVSHJY4MMGUTV54D7WBTSRWTXUWX35HIYDNB63I4QPFQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.358633879 (266h47m0.541078859s) [noise=true , address=145.79.227.13:4803 , piece_id=TVP3SVAKCCCFAOOVG3DAPLEAAL3IFP76TCQ4LN43I2TQNDZT7DGA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.359212861 (266h47m0.541657832s) [noise=true , address=145.79.227.33:4871 , piece_id=2VUU7K3BCWPKKHHU7CAXEBRITS6ED6WDFPU3ODBG2YPDTCZKWD3A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.359410610 (266h47m0.54185559s) [noise=true , address=145.79.227.22:4511 , piece_id=OGUKV6FBZNOYNTUO3A7M3Z532KQZH2K5AQIDPUKD3RYDPXFHBAEQ, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:22.374088006 (266h47m0.556532976s) [noise=true , address=145.79.227.37:4565 , piece_id=JQVIFKPIBMXFTYYTHF3Q7DKEIFSMKV6FBXFOIZ4HJEDCT3S7YGJA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: <nil> Jan 26 18:43:52.233014687 (266h47m30.415459677s) [noise=true , address=45.91.116.9:4261 , piece_id=BWWCW3CPBTPWOF4K2NUOXEZRMHZGILDOT335RY5TSZUJSETSF6BA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:20506->45.91.116.9:4261: use of closed network connection Jan 26 18:43:52.233783362 (266h47m30.416228333s) [noise=true , address=45.91.116.7:4010 , piece_id=3RADWMUAMQOTQQF3YLXSJJOWSQRZEWVZJQXPHMADDWYQIKJX6UCA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233815402 (266h47m30.416260362s) [noise=true , address=45.91.116.14:4191 , piece_id=HAYM5NIRM2ELGZ7FO7L2EY3HMAAED7JWEC4V7SD3BDHEADELNWUA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: read tcp 5.161.89.252:12188->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233921791 (266h47m30.416366771s) [noise=true , address=45.91.116.6:4976 , piece_id=6RKPBVLLDTIEYOBANAB4NRDYAY353LUCVAOAS2523RTXCVCDVO3A, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:121tumRJ6tGiip2dumJr9ZWMoU5BA2HuLEwU5GxBxzTZjMhv3Pp, address:45.91.116.6:4976): protocol: write tcp 5.161.89.252:62910->45.91.116.6:4976: use of closed network connection; close tcp 5.161.89.252:62910->45.91.116.6:4976: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 26 18:43:52.233966906 (266h47m30.416411876s) [noise=true , address=45.91.116.12:4225 , piece_id=M7NFP2QJD5JTMJXROZSXKW6LAJ45WTJJ4XOJLBD4UQEDJJSEY4RA, seg_pos={0 0}, upload=234289]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection; write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:36958->45.91.116.12:4225: use of closed network connection Jan 26 18:43:52.233984328 (266h47m30.416429288s) [seg_pos={0 0}, upload=234289]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Jan 26 18:43:52.255878794 (266h47m30.438323804s) [upload=234289]: Done uploading segments... Jan 26 18:43:52.255942072 (266h47m30.438387072s) [upload=234289]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 308.812147ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [............................................XX..............] duration: 484.416735ms trace: https://jaeger.dev.storj.io/trace/460a0499eabe6dd0 FAIL (2026-01-26 18:54:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 484.436252ms core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)