Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 10.32789999s trace: https://jaeger.dev.storj.io/trace/7423ba250671cbd FAIL (2026-01-01 09:23:56 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7673s) [noise=true , address=77.90.31.19:4871 , piece_id=2TKPIFKUVQORPCLP6E2PZPO2KZHNLNEZC46ATUS4SVCEITGF2H6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.228823193 (641h43m10.926391529s) [noise=true , address=64.49.13.170:4725 , piece_id=HFHFBGX3XF552QUBTHTHRHXDEF46XSYIMGVTDK5IPP4ZOGLZDH4A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.229223031 (641h43m10.926791367s) [noise=true , address=145.79.227.44:4212 , piece_id=FN6TXVFBNBUJLWDNSGDY7TZ3R22X3WYWWDBJU3OWH2FLSNNYVSVQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.229659937 (641h43m10.927228274s) [noise=true , address=145.79.227.35:4508 , piece_id=XHGH3TJYENV5PAIPC5JZQO75WGPHIFLCBRM3YGPV2ZN44IP5C64A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230072067 (641h43m10.927640413s) [noise=true , address=77.90.31.11:4584 , piece_id=NDO6G5HBHC34HNFVEQBHOSMU3M3FE2I7HX4DOU2323LZEUDWYK6A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230506839 (641h43m10.928075176s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230914060 (641h43m10.928482396s) [noise=true , address=77.90.31.12:4600 , piece_id=6Y6CDWNKYNZDX3F742NFN3ZZWPBU6DYDYZ63DCQCC6CZO5PH3N6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.231676043 (641h43m10.929244388s) [noise=true , address=45.91.116.5:4320 , piece_id=CDLQXG23BHQ3IVWK2FCSBVJMUGIHYCU46QDCAVTGHIQO5US6NOKA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.232313173 (641h43m10.929881519s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.233623291 (641h43m10.931191627s) [noise=true , address=45.91.116.7:4023 , piece_id=TFIDFTFJKLIG42WVKWVUS4LEPL2EVY44UXVV5XRH6OR3F24VAZKQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.234970407 (641h43m10.932538743s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.235943375 (641h43m10.93351171s) [noise=true , address=77.90.31.10:4535 , piece_id=3TTFBUIF3JZ5U2XM3RNGNGWSFTOP67DOSYIWSOH547HYTRYTXILQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.236753539 (641h43m10.934321874s) [noise=true , address=145.79.227.29:4958 , piece_id=KCMJDACUTYHAMTXY5SBPOB4UK2FZMR64DKEMCR54K5QVPKOGN7PA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.237893047 (641h43m10.935461383s) [noise=true , address=145.79.227.34:4924 , piece_id=GB662FQNJW5RITZMPXWIR7CEBTDVDDZHYIU4TR5WVPNLXX45YNNQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.238855455 (641h43m10.936423791s) [noise=true , address=77.90.31.21:4890 , piece_id=BMFRDC32GD3VPM4MKW4O5EM4YXXDJMCGHO66IVMEKVPHD33UAZNA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.240104217 (641h43m10.937672554s) [noise=true , address=145.79.227.30:4778 , piece_id=H3RRCSB6XTCIAA4Z24XUC66IAOR2ULL5UXLKZ4XRCZTL7QEQKOYA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.347973445 (641h43m11.045541782s) [upload=564558]: Next returned nil segment Jan 1 09:12:23.347986520 (641h43m11.045554866s) [upload=564558]: Waiting for error group managing segments... Jan 1 09:12:23.360482443 (641h43m11.058050769s) [noise=true , address=45.91.116.5:4320 , piece_id=CDLQXG23BHQ3IVWK2FCSBVJMUGIHYCU46QDCAVTGHIQO5US6NOKA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.366766302 (641h43m11.064334628s) [noise=true , address=77.90.31.21:4890 , piece_id=BMFRDC32GD3VPM4MKW4O5EM4YXXDJMCGHO66IVMEKVPHD33UAZNA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.368835328 (641h43m11.066403654s) [noise=true , address=77.90.31.19:4871 , piece_id=2TKPIFKUVQORPCLP6E2PZPO2KZHNLNEZC46ATUS4SVCEITGF2H6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.376052029 (641h43m11.073620365s) [noise=true , address=145.79.227.34:4924 , piece_id=GB662FQNJW5RITZMPXWIR7CEBTDVDDZHYIU4TR5WVPNLXX45YNNQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.376352801 (641h43m11.073921148s) [noise=true , address=77.90.31.12:4600 , piece_id=6Y6CDWNKYNZDX3F742NFN3ZZWPBU6DYDYZ63DCQCC6CZO5PH3N6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.380006446 (641h43m11.077574782s) [noise=true , address=45.91.116.7:4023 , piece_id=TFIDFTFJKLIG42WVKWVUS4LEPL2EVY44UXVV5XRH6OR3F24VAZKQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.382791259 (641h43m11.080359585s) [noise=true , address=77.90.31.10:4535 , piece_id=3TTFBUIF3JZ5U2XM3RNGNGWSFTOP67DOSYIWSOH547HYTRYTXILQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.384255944 (641h43m11.081824281s) [noise=true , address=77.90.31.11:4584 , piece_id=NDO6G5HBHC34HNFVEQBHOSMU3M3FE2I7HX4DOU2323LZEUDWYK6A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.408697493 (641h43m11.106265829s) [noise=true , address=145.79.227.29:4958 , piece_id=KCMJDACUTYHAMTXY5SBPOB4UK2FZMR64DKEMCR54K5QVPKOGN7PA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.440358499 (641h43m11.137926836s) [noise=true , address=145.79.227.35:4508 , piece_id=XHGH3TJYENV5PAIPC5JZQO75WGPHIFLCBRM3YGPV2ZN44IP5C64A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.838636073 (641h43m11.53620441s) [noise=true , address=64.49.13.170:4725 , piece_id=HFHFBGX3XF552QUBTHTHRHXDEF46XSYIMGVTDK5IPP4ZOGLZDH4A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.250193406 (641h43m11.947761742s) [noise=true , address=145.79.227.44:4212 , piece_id=FN6TXVFBNBUJLWDNSGDY7TZ3R22X3WYWWDBJU3OWH2FLSNNYVSVQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.284772531 (641h43m11.982340878s) [noise=true , address=145.79.227.30:4778 , piece_id=H3RRCSB6XTCIAA4Z24XUC66IAOR2ULL5UXLKZ4XRCZTL7QEQKOYA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.307645411 (641h43m12.005213747s) [noise=true , address=145.79.227.43:4167 , piece_id=4NUTUYFT6GNH6QO6R3PCSNHKWBICOW2OQGLUD7YUUTV3UBCILO7Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.307664545 (641h43m12.005232882s) [seg_pos={0 0}, upload=564558]: Segment reached optimal threshold of 14 pieces. Jan 1 09:12:24.307973042 (641h43m12.005541388s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w21xeA7emhjphgYw2Qyz3uuHgPezuivmVD9KmrKmNZk3TnaGN): protocol: write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection; write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection Jan 1 09:12:24.307984343 (641h43m12.00555268s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308071798 (641h43m12.005640133s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308089229 (641h43m12.005657565s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308248627 (641h43m12.005816963s) [noise=true , address=145.79.227.40:4073 , piece_id=MOLBCHDQYKNI6MQZFXPGY773ZJAYSZQ7GXZTJ2OKS73EEOTURJEQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kGo5nNz8GyroAGoMQ75xDo4pppWPVsW9f8trLCWH6CqVXWsmK): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308258255 (641h43m12.005826591s) [noise=true , address=145.79.227.40:4073 , piece_id=MOLBCHDQYKNI6MQZFXPGY773ZJAYSZQ7GXZTJ2OKS73EEOTURJEQ, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308560900 (641h43m12.006129247s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308575699 (641h43m12.006144034s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308606416 (641h43m12.006174752s) [seg_pos={0 0}, upload=564558]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 1 09:12:24.308692145 (641h43m12.006260482s) [upload=564558]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 1 09:12:24.308697956 (641h43m12.006266293s) [upload=564558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 1 09:12:24.342871296 (641h43m12.040439642s) [upload=564558]: Done uploading segments... Jan 1 09:12:24.342888177 (641h43m12.040456514s) [upload=564558]: Upload finished. err: <nil> Duration: 10.327922823s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 10.387781663s trace: https://jaeger.dev.storj.io/trace/7423ba250671cbd FAIL (2026-01-01 09:22:54 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7673s) [noise=true , address=77.90.31.19:4871 , piece_id=2TKPIFKUVQORPCLP6E2PZPO2KZHNLNEZC46ATUS4SVCEITGF2H6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.228823193 (641h43m10.926391529s) [noise=true , address=64.49.13.170:4725 , piece_id=HFHFBGX3XF552QUBTHTHRHXDEF46XSYIMGVTDK5IPP4ZOGLZDH4A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.229223031 (641h43m10.926791367s) [noise=true , address=145.79.227.44:4212 , piece_id=FN6TXVFBNBUJLWDNSGDY7TZ3R22X3WYWWDBJU3OWH2FLSNNYVSVQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.229659937 (641h43m10.927228274s) [noise=true , address=145.79.227.35:4508 , piece_id=XHGH3TJYENV5PAIPC5JZQO75WGPHIFLCBRM3YGPV2ZN44IP5C64A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230072067 (641h43m10.927640413s) [noise=true , address=77.90.31.11:4584 , piece_id=NDO6G5HBHC34HNFVEQBHOSMU3M3FE2I7HX4DOU2323LZEUDWYK6A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230506839 (641h43m10.928075176s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230914060 (641h43m10.928482396s) [noise=true , address=77.90.31.12:4600 , piece_id=6Y6CDWNKYNZDX3F742NFN3ZZWPBU6DYDYZ63DCQCC6CZO5PH3N6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.231676043 (641h43m10.929244388s) [noise=true , address=45.91.116.5:4320 , piece_id=CDLQXG23BHQ3IVWK2FCSBVJMUGIHYCU46QDCAVTGHIQO5US6NOKA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.232313173 (641h43m10.929881519s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.233623291 (641h43m10.931191627s) [noise=true , address=45.91.116.7:4023 , piece_id=TFIDFTFJKLIG42WVKWVUS4LEPL2EVY44UXVV5XRH6OR3F24VAZKQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.234970407 (641h43m10.932538743s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.235943375 (641h43m10.93351171s) [noise=true , address=77.90.31.10:4535 , piece_id=3TTFBUIF3JZ5U2XM3RNGNGWSFTOP67DOSYIWSOH547HYTRYTXILQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.236753539 (641h43m10.934321874s) [noise=true , address=145.79.227.29:4958 , piece_id=KCMJDACUTYHAMTXY5SBPOB4UK2FZMR64DKEMCR54K5QVPKOGN7PA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.237893047 (641h43m10.935461383s) [noise=true , address=145.79.227.34:4924 , piece_id=GB662FQNJW5RITZMPXWIR7CEBTDVDDZHYIU4TR5WVPNLXX45YNNQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.238855455 (641h43m10.936423791s) [noise=true , address=77.90.31.21:4890 , piece_id=BMFRDC32GD3VPM4MKW4O5EM4YXXDJMCGHO66IVMEKVPHD33UAZNA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.240104217 (641h43m10.937672554s) [noise=true , address=145.79.227.30:4778 , piece_id=H3RRCSB6XTCIAA4Z24XUC66IAOR2ULL5UXLKZ4XRCZTL7QEQKOYA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.347973445 (641h43m11.045541782s) [upload=564558]: Next returned nil segment Jan 1 09:12:23.347986520 (641h43m11.045554866s) [upload=564558]: Waiting for error group managing segments... Jan 1 09:12:23.360482443 (641h43m11.058050769s) [noise=true , address=45.91.116.5:4320 , piece_id=CDLQXG23BHQ3IVWK2FCSBVJMUGIHYCU46QDCAVTGHIQO5US6NOKA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.366766302 (641h43m11.064334628s) [noise=true , address=77.90.31.21:4890 , piece_id=BMFRDC32GD3VPM4MKW4O5EM4YXXDJMCGHO66IVMEKVPHD33UAZNA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.368835328 (641h43m11.066403654s) [noise=true , address=77.90.31.19:4871 , piece_id=2TKPIFKUVQORPCLP6E2PZPO2KZHNLNEZC46ATUS4SVCEITGF2H6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.376052029 (641h43m11.073620365s) [noise=true , address=145.79.227.34:4924 , piece_id=GB662FQNJW5RITZMPXWIR7CEBTDVDDZHYIU4TR5WVPNLXX45YNNQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.376352801 (641h43m11.073921148s) [noise=true , address=77.90.31.12:4600 , piece_id=6Y6CDWNKYNZDX3F742NFN3ZZWPBU6DYDYZ63DCQCC6CZO5PH3N6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.380006446 (641h43m11.077574782s) [noise=true , address=45.91.116.7:4023 , piece_id=TFIDFTFJKLIG42WVKWVUS4LEPL2EVY44UXVV5XRH6OR3F24VAZKQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.382791259 (641h43m11.080359585s) [noise=true , address=77.90.31.10:4535 , piece_id=3TTFBUIF3JZ5U2XM3RNGNGWSFTOP67DOSYIWSOH547HYTRYTXILQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.384255944 (641h43m11.081824281s) [noise=true , address=77.90.31.11:4584 , piece_id=NDO6G5HBHC34HNFVEQBHOSMU3M3FE2I7HX4DOU2323LZEUDWYK6A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.408697493 (641h43m11.106265829s) [noise=true , address=145.79.227.29:4958 , piece_id=KCMJDACUTYHAMTXY5SBPOB4UK2FZMR64DKEMCR54K5QVPKOGN7PA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.440358499 (641h43m11.137926836s) [noise=true , address=145.79.227.35:4508 , piece_id=XHGH3TJYENV5PAIPC5JZQO75WGPHIFLCBRM3YGPV2ZN44IP5C64A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.838636073 (641h43m11.53620441s) [noise=true , address=64.49.13.170:4725 , piece_id=HFHFBGX3XF552QUBTHTHRHXDEF46XSYIMGVTDK5IPP4ZOGLZDH4A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.250193406 (641h43m11.947761742s) [noise=true , address=145.79.227.44:4212 , piece_id=FN6TXVFBNBUJLWDNSGDY7TZ3R22X3WYWWDBJU3OWH2FLSNNYVSVQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.284772531 (641h43m11.982340878s) [noise=true , address=145.79.227.30:4778 , piece_id=H3RRCSB6XTCIAA4Z24XUC66IAOR2ULL5UXLKZ4XRCZTL7QEQKOYA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.307645411 (641h43m12.005213747s) [noise=true , address=145.79.227.43:4167 , piece_id=4NUTUYFT6GNH6QO6R3PCSNHKWBICOW2OQGLUD7YUUTV3UBCILO7Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.307664545 (641h43m12.005232882s) [seg_pos={0 0}, upload=564558]: Segment reached optimal threshold of 14 pieces. Jan 1 09:12:24.307973042 (641h43m12.005541388s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w21xeA7emhjphgYw2Qyz3uuHgPezuivmVD9KmrKmNZk3TnaGN): protocol: write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection; write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection Jan 1 09:12:24.307984343 (641h43m12.00555268s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308071798 (641h43m12.005640133s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308089229 (641h43m12.005657565s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308248627 (641h43m12.005816963s) [noise=true , address=145.79.227.40:4073 , piece_id=MOLBCHDQYKNI6MQZFXPGY773ZJAYSZQ7GXZTJ2OKS73EEOTURJEQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kGo5nNz8GyroAGoMQ75xDo4pppWPVsW9f8trLCWH6CqVXWsmK): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308258255 (641h43m12.005826591s) [noise=true , address=145.79.227.40:4073 , piece_id=MOLBCHDQYKNI6MQZFXPGY773ZJAYSZQ7GXZTJ2OKS73EEOTURJEQ, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308560900 (641h43m12.006129247s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308575699 (641h43m12.006144034s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308606416 (641h43m12.006174752s) [seg_pos={0 0}, upload=564558]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 1 09:12:24.308692145 (641h43m12.006260482s) [upload=564558]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 1 09:12:24.308697956 (641h43m12.006266293s) [upload=564558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 1 09:12:24.342871296 (641h43m12.040439642s) [upload=564558]: Done uploading segments... Jan 1 09:12:24.342888177 (641h43m12.040456514s) [upload=564558]: Upload finished. err: <nil> Duration: 10.387804554s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 1.30933374s trace: https://jaeger.dev.storj.io/trace/7423ba250671cbd FAIL (2026-01-01 09:21:55 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7673s) [noise=true , address=77.90.31.19:4871 , piece_id=2TKPIFKUVQORPCLP6E2PZPO2KZHNLNEZC46ATUS4SVCEITGF2H6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.228823193 (641h43m10.926391529s) [noise=true , address=64.49.13.170:4725 , piece_id=HFHFBGX3XF552QUBTHTHRHXDEF46XSYIMGVTDK5IPP4ZOGLZDH4A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.229223031 (641h43m10.926791367s) [noise=true , address=145.79.227.44:4212 , piece_id=FN6TXVFBNBUJLWDNSGDY7TZ3R22X3WYWWDBJU3OWH2FLSNNYVSVQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.229659937 (641h43m10.927228274s) [noise=true , address=145.79.227.35:4508 , piece_id=XHGH3TJYENV5PAIPC5JZQO75WGPHIFLCBRM3YGPV2ZN44IP5C64A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230072067 (641h43m10.927640413s) [noise=true , address=77.90.31.11:4584 , piece_id=NDO6G5HBHC34HNFVEQBHOSMU3M3FE2I7HX4DOU2323LZEUDWYK6A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230506839 (641h43m10.928075176s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230914060 (641h43m10.928482396s) [noise=true , address=77.90.31.12:4600 , piece_id=6Y6CDWNKYNZDX3F742NFN3ZZWPBU6DYDYZ63DCQCC6CZO5PH3N6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.231676043 (641h43m10.929244388s) [noise=true , address=45.91.116.5:4320 , piece_id=CDLQXG23BHQ3IVWK2FCSBVJMUGIHYCU46QDCAVTGHIQO5US6NOKA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.232313173 (641h43m10.929881519s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.233623291 (641h43m10.931191627s) [noise=true , address=45.91.116.7:4023 , piece_id=TFIDFTFJKLIG42WVKWVUS4LEPL2EVY44UXVV5XRH6OR3F24VAZKQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.234970407 (641h43m10.932538743s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.235943375 (641h43m10.93351171s) [noise=true , address=77.90.31.10:4535 , piece_id=3TTFBUIF3JZ5U2XM3RNGNGWSFTOP67DOSYIWSOH547HYTRYTXILQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.236753539 (641h43m10.934321874s) [noise=true , address=145.79.227.29:4958 , piece_id=KCMJDACUTYHAMTXY5SBPOB4UK2FZMR64DKEMCR54K5QVPKOGN7PA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.237893047 (641h43m10.935461383s) [noise=true , address=145.79.227.34:4924 , piece_id=GB662FQNJW5RITZMPXWIR7CEBTDVDDZHYIU4TR5WVPNLXX45YNNQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.238855455 (641h43m10.936423791s) [noise=true , address=77.90.31.21:4890 , piece_id=BMFRDC32GD3VPM4MKW4O5EM4YXXDJMCGHO66IVMEKVPHD33UAZNA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.240104217 (641h43m10.937672554s) [noise=true , address=145.79.227.30:4778 , piece_id=H3RRCSB6XTCIAA4Z24XUC66IAOR2ULL5UXLKZ4XRCZTL7QEQKOYA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.347973445 (641h43m11.045541782s) [upload=564558]: Next returned nil segment Jan 1 09:12:23.347986520 (641h43m11.045554866s) [upload=564558]: Waiting for error group managing segments... Jan 1 09:12:23.360482443 (641h43m11.058050769s) [noise=true , address=45.91.116.5:4320 , piece_id=CDLQXG23BHQ3IVWK2FCSBVJMUGIHYCU46QDCAVTGHIQO5US6NOKA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.366766302 (641h43m11.064334628s) [noise=true , address=77.90.31.21:4890 , piece_id=BMFRDC32GD3VPM4MKW4O5EM4YXXDJMCGHO66IVMEKVPHD33UAZNA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.368835328 (641h43m11.066403654s) [noise=true , address=77.90.31.19:4871 , piece_id=2TKPIFKUVQORPCLP6E2PZPO2KZHNLNEZC46ATUS4SVCEITGF2H6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.376052029 (641h43m11.073620365s) [noise=true , address=145.79.227.34:4924 , piece_id=GB662FQNJW5RITZMPXWIR7CEBTDVDDZHYIU4TR5WVPNLXX45YNNQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.376352801 (641h43m11.073921148s) [noise=true , address=77.90.31.12:4600 , piece_id=6Y6CDWNKYNZDX3F742NFN3ZZWPBU6DYDYZ63DCQCC6CZO5PH3N6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.380006446 (641h43m11.077574782s) [noise=true , address=45.91.116.7:4023 , piece_id=TFIDFTFJKLIG42WVKWVUS4LEPL2EVY44UXVV5XRH6OR3F24VAZKQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.382791259 (641h43m11.080359585s) [noise=true , address=77.90.31.10:4535 , piece_id=3TTFBUIF3JZ5U2XM3RNGNGWSFTOP67DOSYIWSOH547HYTRYTXILQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.384255944 (641h43m11.081824281s) [noise=true , address=77.90.31.11:4584 , piece_id=NDO6G5HBHC34HNFVEQBHOSMU3M3FE2I7HX4DOU2323LZEUDWYK6A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.408697493 (641h43m11.106265829s) [noise=true , address=145.79.227.29:4958 , piece_id=KCMJDACUTYHAMTXY5SBPOB4UK2FZMR64DKEMCR54K5QVPKOGN7PA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.440358499 (641h43m11.137926836s) [noise=true , address=145.79.227.35:4508 , piece_id=XHGH3TJYENV5PAIPC5JZQO75WGPHIFLCBRM3YGPV2ZN44IP5C64A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.838636073 (641h43m11.53620441s) [noise=true , address=64.49.13.170:4725 , piece_id=HFHFBGX3XF552QUBTHTHRHXDEF46XSYIMGVTDK5IPP4ZOGLZDH4A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.250193406 (641h43m11.947761742s) [noise=true , address=145.79.227.44:4212 , piece_id=FN6TXVFBNBUJLWDNSGDY7TZ3R22X3WYWWDBJU3OWH2FLSNNYVSVQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.284772531 (641h43m11.982340878s) [noise=true , address=145.79.227.30:4778 , piece_id=H3RRCSB6XTCIAA4Z24XUC66IAOR2ULL5UXLKZ4XRCZTL7QEQKOYA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.307645411 (641h43m12.005213747s) [noise=true , address=145.79.227.43:4167 , piece_id=4NUTUYFT6GNH6QO6R3PCSNHKWBICOW2OQGLUD7YUUTV3UBCILO7Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.307664545 (641h43m12.005232882s) [seg_pos={0 0}, upload=564558]: Segment reached optimal threshold of 14 pieces. Jan 1 09:12:24.307973042 (641h43m12.005541388s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w21xeA7emhjphgYw2Qyz3uuHgPezuivmVD9KmrKmNZk3TnaGN): protocol: write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection; write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection Jan 1 09:12:24.307984343 (641h43m12.00555268s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308071798 (641h43m12.005640133s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308089229 (641h43m12.005657565s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308248627 (641h43m12.005816963s) [noise=true , address=145.79.227.40:4073 , piece_id=MOLBCHDQYKNI6MQZFXPGY773ZJAYSZQ7GXZTJ2OKS73EEOTURJEQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kGo5nNz8GyroAGoMQ75xDo4pppWPVsW9f8trLCWH6CqVXWsmK): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308258255 (641h43m12.005826591s) [noise=true , address=145.79.227.40:4073 , piece_id=MOLBCHDQYKNI6MQZFXPGY773ZJAYSZQ7GXZTJ2OKS73EEOTURJEQ, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308560900 (641h43m12.006129247s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308575699 (641h43m12.006144034s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308606416 (641h43m12.006174752s) [seg_pos={0 0}, upload=564558]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 1 09:12:24.308692145 (641h43m12.006260482s) [upload=564558]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 1 09:12:24.308697956 (641h43m12.006266293s) [upload=564558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 1 09:12:24.342871296 (641h43m12.040439642s) [upload=564558]: Done uploading segments... Jan 1 09:12:24.342888177 (641h43m12.040456514s) [upload=564558]: Upload finished. err: <nil> Duration: 1.309352684s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 807.75372ms trace: https://jaeger.dev.storj.io/trace/7423ba250671cbd FAIL (2026-01-01 09:20:48 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7673s) [noise=true , address=77.90.31.19:4871 , piece_id=2TKPIFKUVQORPCLP6E2PZPO2KZHNLNEZC46ATUS4SVCEITGF2H6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.228823193 (641h43m10.926391529s) [noise=true , address=64.49.13.170:4725 , piece_id=HFHFBGX3XF552QUBTHTHRHXDEF46XSYIMGVTDK5IPP4ZOGLZDH4A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.229223031 (641h43m10.926791367s) [noise=true , address=145.79.227.44:4212 , piece_id=FN6TXVFBNBUJLWDNSGDY7TZ3R22X3WYWWDBJU3OWH2FLSNNYVSVQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.229659937 (641h43m10.927228274s) [noise=true , address=145.79.227.35:4508 , piece_id=XHGH3TJYENV5PAIPC5JZQO75WGPHIFLCBRM3YGPV2ZN44IP5C64A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230072067 (641h43m10.927640413s) [noise=true , address=77.90.31.11:4584 , piece_id=NDO6G5HBHC34HNFVEQBHOSMU3M3FE2I7HX4DOU2323LZEUDWYK6A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230506839 (641h43m10.928075176s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230914060 (641h43m10.928482396s) [noise=true , address=77.90.31.12:4600 , piece_id=6Y6CDWNKYNZDX3F742NFN3ZZWPBU6DYDYZ63DCQCC6CZO5PH3N6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.231676043 (641h43m10.929244388s) [noise=true , address=45.91.116.5:4320 , piece_id=CDLQXG23BHQ3IVWK2FCSBVJMUGIHYCU46QDCAVTGHIQO5US6NOKA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.232313173 (641h43m10.929881519s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.233623291 (641h43m10.931191627s) [noise=true , address=45.91.116.7:4023 , piece_id=TFIDFTFJKLIG42WVKWVUS4LEPL2EVY44UXVV5XRH6OR3F24VAZKQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.234970407 (641h43m10.932538743s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.235943375 (641h43m10.93351171s) [noise=true , address=77.90.31.10:4535 , piece_id=3TTFBUIF3JZ5U2XM3RNGNGWSFTOP67DOSYIWSOH547HYTRYTXILQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.236753539 (641h43m10.934321874s) [noise=true , address=145.79.227.29:4958 , piece_id=KCMJDACUTYHAMTXY5SBPOB4UK2FZMR64DKEMCR54K5QVPKOGN7PA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.237893047 (641h43m10.935461383s) [noise=true , address=145.79.227.34:4924 , piece_id=GB662FQNJW5RITZMPXWIR7CEBTDVDDZHYIU4TR5WVPNLXX45YNNQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.238855455 (641h43m10.936423791s) [noise=true , address=77.90.31.21:4890 , piece_id=BMFRDC32GD3VPM4MKW4O5EM4YXXDJMCGHO66IVMEKVPHD33UAZNA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.240104217 (641h43m10.937672554s) [noise=true , address=145.79.227.30:4778 , piece_id=H3RRCSB6XTCIAA4Z24XUC66IAOR2ULL5UXLKZ4XRCZTL7QEQKOYA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.347973445 (641h43m11.045541782s) [upload=564558]: Next returned nil segment Jan 1 09:12:23.347986520 (641h43m11.045554866s) [upload=564558]: Waiting for error group managing segments... Jan 1 09:12:23.360482443 (641h43m11.058050769s) [noise=true , address=45.91.116.5:4320 , piece_id=CDLQXG23BHQ3IVWK2FCSBVJMUGIHYCU46QDCAVTGHIQO5US6NOKA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.366766302 (641h43m11.064334628s) [noise=true , address=77.90.31.21:4890 , piece_id=BMFRDC32GD3VPM4MKW4O5EM4YXXDJMCGHO66IVMEKVPHD33UAZNA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.368835328 (641h43m11.066403654s) [noise=true , address=77.90.31.19:4871 , piece_id=2TKPIFKUVQORPCLP6E2PZPO2KZHNLNEZC46ATUS4SVCEITGF2H6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.376052029 (641h43m11.073620365s) [noise=true , address=145.79.227.34:4924 , piece_id=GB662FQNJW5RITZMPXWIR7CEBTDVDDZHYIU4TR5WVPNLXX45YNNQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.376352801 (641h43m11.073921148s) [noise=true , address=77.90.31.12:4600 , piece_id=6Y6CDWNKYNZDX3F742NFN3ZZWPBU6DYDYZ63DCQCC6CZO5PH3N6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.380006446 (641h43m11.077574782s) [noise=true , address=45.91.116.7:4023 , piece_id=TFIDFTFJKLIG42WVKWVUS4LEPL2EVY44UXVV5XRH6OR3F24VAZKQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.382791259 (641h43m11.080359585s) [noise=true , address=77.90.31.10:4535 , piece_id=3TTFBUIF3JZ5U2XM3RNGNGWSFTOP67DOSYIWSOH547HYTRYTXILQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.384255944 (641h43m11.081824281s) [noise=true , address=77.90.31.11:4584 , piece_id=NDO6G5HBHC34HNFVEQBHOSMU3M3FE2I7HX4DOU2323LZEUDWYK6A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.408697493 (641h43m11.106265829s) [noise=true , address=145.79.227.29:4958 , piece_id=KCMJDACUTYHAMTXY5SBPOB4UK2FZMR64DKEMCR54K5QVPKOGN7PA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.440358499 (641h43m11.137926836s) [noise=true , address=145.79.227.35:4508 , piece_id=XHGH3TJYENV5PAIPC5JZQO75WGPHIFLCBRM3YGPV2ZN44IP5C64A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.838636073 (641h43m11.53620441s) [noise=true , address=64.49.13.170:4725 , piece_id=HFHFBGX3XF552QUBTHTHRHXDEF46XSYIMGVTDK5IPP4ZOGLZDH4A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.250193406 (641h43m11.947761742s) [noise=true , address=145.79.227.44:4212 , piece_id=FN6TXVFBNBUJLWDNSGDY7TZ3R22X3WYWWDBJU3OWH2FLSNNYVSVQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.284772531 (641h43m11.982340878s) [noise=true , address=145.79.227.30:4778 , piece_id=H3RRCSB6XTCIAA4Z24XUC66IAOR2ULL5UXLKZ4XRCZTL7QEQKOYA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.307645411 (641h43m12.005213747s) [noise=true , address=145.79.227.43:4167 , piece_id=4NUTUYFT6GNH6QO6R3PCSNHKWBICOW2OQGLUD7YUUTV3UBCILO7Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.307664545 (641h43m12.005232882s) [seg_pos={0 0}, upload=564558]: Segment reached optimal threshold of 14 pieces. Jan 1 09:12:24.307973042 (641h43m12.005541388s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w21xeA7emhjphgYw2Qyz3uuHgPezuivmVD9KmrKmNZk3TnaGN): protocol: write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection; write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection Jan 1 09:12:24.307984343 (641h43m12.00555268s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308071798 (641h43m12.005640133s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308089229 (641h43m12.005657565s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308248627 (641h43m12.005816963s) [noise=true , address=145.79.227.40:4073 , piece_id=MOLBCHDQYKNI6MQZFXPGY773ZJAYSZQ7GXZTJ2OKS73EEOTURJEQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kGo5nNz8GyroAGoMQ75xDo4pppWPVsW9f8trLCWH6CqVXWsmK): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308258255 (641h43m12.005826591s) [noise=true , address=145.79.227.40:4073 , piece_id=MOLBCHDQYKNI6MQZFXPGY773ZJAYSZQ7GXZTJ2OKS73EEOTURJEQ, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308560900 (641h43m12.006129247s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308575699 (641h43m12.006144034s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308606416 (641h43m12.006174752s) [seg_pos={0 0}, upload=564558]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 1 09:12:24.308692145 (641h43m12.006260482s) [upload=564558]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 1 09:12:24.308697956 (641h43m12.006266293s) [upload=564558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 1 09:12:24.342871296 (641h43m12.040439642s) [upload=564558]: Done uploading segments... Jan 1 09:12:24.342888177 (641h43m12.040456514s) [upload=564558]: Upload finished. err: <nil> Duration: 807.771023ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 1.628989014s trace: https://jaeger.dev.storj.io/trace/7423ba250671cbd FAIL (2026-01-01 09:20:32 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7673s) [noise=true , address=77.90.31.19:4871 , piece_id=2TKPIFKUVQORPCLP6E2PZPO2KZHNLNEZC46ATUS4SVCEITGF2H6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.228823193 (641h43m10.926391529s) [noise=true , address=64.49.13.170:4725 , piece_id=HFHFBGX3XF552QUBTHTHRHXDEF46XSYIMGVTDK5IPP4ZOGLZDH4A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.229223031 (641h43m10.926791367s) [noise=true , address=145.79.227.44:4212 , piece_id=FN6TXVFBNBUJLWDNSGDY7TZ3R22X3WYWWDBJU3OWH2FLSNNYVSVQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.229659937 (641h43m10.927228274s) [noise=true , address=145.79.227.35:4508 , piece_id=XHGH3TJYENV5PAIPC5JZQO75WGPHIFLCBRM3YGPV2ZN44IP5C64A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230072067 (641h43m10.927640413s) [noise=true , address=77.90.31.11:4584 , piece_id=NDO6G5HBHC34HNFVEQBHOSMU3M3FE2I7HX4DOU2323LZEUDWYK6A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230506839 (641h43m10.928075176s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230914060 (641h43m10.928482396s) [noise=true , address=77.90.31.12:4600 , piece_id=6Y6CDWNKYNZDX3F742NFN3ZZWPBU6DYDYZ63DCQCC6CZO5PH3N6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.231676043 (641h43m10.929244388s) [noise=true , address=45.91.116.5:4320 , piece_id=CDLQXG23BHQ3IVWK2FCSBVJMUGIHYCU46QDCAVTGHIQO5US6NOKA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.232313173 (641h43m10.929881519s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.233623291 (641h43m10.931191627s) [noise=true , address=45.91.116.7:4023 , piece_id=TFIDFTFJKLIG42WVKWVUS4LEPL2EVY44UXVV5XRH6OR3F24VAZKQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.234970407 (641h43m10.932538743s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.235943375 (641h43m10.93351171s) [noise=true , address=77.90.31.10:4535 , piece_id=3TTFBUIF3JZ5U2XM3RNGNGWSFTOP67DOSYIWSOH547HYTRYTXILQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.236753539 (641h43m10.934321874s) [noise=true , address=145.79.227.29:4958 , piece_id=KCMJDACUTYHAMTXY5SBPOB4UK2FZMR64DKEMCR54K5QVPKOGN7PA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.237893047 (641h43m10.935461383s) [noise=true , address=145.79.227.34:4924 , piece_id=GB662FQNJW5RITZMPXWIR7CEBTDVDDZHYIU4TR5WVPNLXX45YNNQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.238855455 (641h43m10.936423791s) [noise=true , address=77.90.31.21:4890 , piece_id=BMFRDC32GD3VPM4MKW4O5EM4YXXDJMCGHO66IVMEKVPHD33UAZNA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.240104217 (641h43m10.937672554s) [noise=true , address=145.79.227.30:4778 , piece_id=H3RRCSB6XTCIAA4Z24XUC66IAOR2ULL5UXLKZ4XRCZTL7QEQKOYA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.347973445 (641h43m11.045541782s) [upload=564558]: Next returned nil segment Jan 1 09:12:23.347986520 (641h43m11.045554866s) [upload=564558]: Waiting for error group managing segments... Jan 1 09:12:23.360482443 (641h43m11.058050769s) [noise=true , address=45.91.116.5:4320 , piece_id=CDLQXG23BHQ3IVWK2FCSBVJMUGIHYCU46QDCAVTGHIQO5US6NOKA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.366766302 (641h43m11.064334628s) [noise=true , address=77.90.31.21:4890 , piece_id=BMFRDC32GD3VPM4MKW4O5EM4YXXDJMCGHO66IVMEKVPHD33UAZNA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.368835328 (641h43m11.066403654s) [noise=true , address=77.90.31.19:4871 , piece_id=2TKPIFKUVQORPCLP6E2PZPO2KZHNLNEZC46ATUS4SVCEITGF2H6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.376052029 (641h43m11.073620365s) [noise=true , address=145.79.227.34:4924 , piece_id=GB662FQNJW5RITZMPXWIR7CEBTDVDDZHYIU4TR5WVPNLXX45YNNQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.376352801 (641h43m11.073921148s) [noise=true , address=77.90.31.12:4600 , piece_id=6Y6CDWNKYNZDX3F742NFN3ZZWPBU6DYDYZ63DCQCC6CZO5PH3N6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.380006446 (641h43m11.077574782s) [noise=true , address=45.91.116.7:4023 , piece_id=TFIDFTFJKLIG42WVKWVUS4LEPL2EVY44UXVV5XRH6OR3F24VAZKQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.382791259 (641h43m11.080359585s) [noise=true , address=77.90.31.10:4535 , piece_id=3TTFBUIF3JZ5U2XM3RNGNGWSFTOP67DOSYIWSOH547HYTRYTXILQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.384255944 (641h43m11.081824281s) [noise=true , address=77.90.31.11:4584 , piece_id=NDO6G5HBHC34HNFVEQBHOSMU3M3FE2I7HX4DOU2323LZEUDWYK6A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.408697493 (641h43m11.106265829s) [noise=true , address=145.79.227.29:4958 , piece_id=KCMJDACUTYHAMTXY5SBPOB4UK2FZMR64DKEMCR54K5QVPKOGN7PA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.440358499 (641h43m11.137926836s) [noise=true , address=145.79.227.35:4508 , piece_id=XHGH3TJYENV5PAIPC5JZQO75WGPHIFLCBRM3YGPV2ZN44IP5C64A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.838636073 (641h43m11.53620441s) [noise=true , address=64.49.13.170:4725 , piece_id=HFHFBGX3XF552QUBTHTHRHXDEF46XSYIMGVTDK5IPP4ZOGLZDH4A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.250193406 (641h43m11.947761742s) [noise=true , address=145.79.227.44:4212 , piece_id=FN6TXVFBNBUJLWDNSGDY7TZ3R22X3WYWWDBJU3OWH2FLSNNYVSVQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.284772531 (641h43m11.982340878s) [noise=true , address=145.79.227.30:4778 , piece_id=H3RRCSB6XTCIAA4Z24XUC66IAOR2ULL5UXLKZ4XRCZTL7QEQKOYA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.307645411 (641h43m12.005213747s) [noise=true , address=145.79.227.43:4167 , piece_id=4NUTUYFT6GNH6QO6R3PCSNHKWBICOW2OQGLUD7YUUTV3UBCILO7Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.307664545 (641h43m12.005232882s) [seg_pos={0 0}, upload=564558]: Segment reached optimal threshold of 14 pieces. Jan 1 09:12:24.307973042 (641h43m12.005541388s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w21xeA7emhjphgYw2Qyz3uuHgPezuivmVD9KmrKmNZk3TnaGN): protocol: write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection; write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection Jan 1 09:12:24.307984343 (641h43m12.00555268s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308071798 (641h43m12.005640133s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308089229 (641h43m12.005657565s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308248627 (641h43m12.005816963s) [noise=true , address=145.79.227.40:4073 , piece_id=MOLBCHDQYKNI6MQZFXPGY773ZJAYSZQ7GXZTJ2OKS73EEOTURJEQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kGo5nNz8GyroAGoMQ75xDo4pppWPVsW9f8trLCWH6CqVXWsmK): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308258255 (641h43m12.005826591s) [noise=true , address=145.79.227.40:4073 , piece_id=MOLBCHDQYKNI6MQZFXPGY773ZJAYSZQ7GXZTJ2OKS73EEOTURJEQ, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308560900 (641h43m12.006129247s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308575699 (641h43m12.006144034s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308606416 (641h43m12.006174752s) [seg_pos={0 0}, upload=564558]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 1 09:12:24.308692145 (641h43m12.006260482s) [upload=564558]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 1 09:12:24.308697956 (641h43m12.006266293s) [upload=564558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 1 09:12:24.342871296 (641h43m12.040439642s) [upload=564558]: Done uploading segments... Jan 1 09:12:24.342888177 (641h43m12.040456514s) [upload=564558]: Upload finished. err: <nil> Duration: 1.629007369s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 1.269465463s trace: https://jaeger.dev.storj.io/trace/7423ba250671cbd FAIL (2026-01-01 09:20:13 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7673s) [noise=true , address=77.90.31.19:4871 , piece_id=2TKPIFKUVQORPCLP6E2PZPO2KZHNLNEZC46ATUS4SVCEITGF2H6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.228823193 (641h43m10.926391529s) [noise=true , address=64.49.13.170:4725 , piece_id=HFHFBGX3XF552QUBTHTHRHXDEF46XSYIMGVTDK5IPP4ZOGLZDH4A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.229223031 (641h43m10.926791367s) [noise=true , address=145.79.227.44:4212 , piece_id=FN6TXVFBNBUJLWDNSGDY7TZ3R22X3WYWWDBJU3OWH2FLSNNYVSVQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.229659937 (641h43m10.927228274s) [noise=true , address=145.79.227.35:4508 , piece_id=XHGH3TJYENV5PAIPC5JZQO75WGPHIFLCBRM3YGPV2ZN44IP5C64A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230072067 (641h43m10.927640413s) [noise=true , address=77.90.31.11:4584 , piece_id=NDO6G5HBHC34HNFVEQBHOSMU3M3FE2I7HX4DOU2323LZEUDWYK6A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230506839 (641h43m10.928075176s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230914060 (641h43m10.928482396s) [noise=true , address=77.90.31.12:4600 , piece_id=6Y6CDWNKYNZDX3F742NFN3ZZWPBU6DYDYZ63DCQCC6CZO5PH3N6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.231676043 (641h43m10.929244388s) [noise=true , address=45.91.116.5:4320 , piece_id=CDLQXG23BHQ3IVWK2FCSBVJMUGIHYCU46QDCAVTGHIQO5US6NOKA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.232313173 (641h43m10.929881519s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.233623291 (641h43m10.931191627s) [noise=true , address=45.91.116.7:4023 , piece_id=TFIDFTFJKLIG42WVKWVUS4LEPL2EVY44UXVV5XRH6OR3F24VAZKQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.234970407 (641h43m10.932538743s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.235943375 (641h43m10.93351171s) [noise=true , address=77.90.31.10:4535 , piece_id=3TTFBUIF3JZ5U2XM3RNGNGWSFTOP67DOSYIWSOH547HYTRYTXILQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.236753539 (641h43m10.934321874s) [noise=true , address=145.79.227.29:4958 , piece_id=KCMJDACUTYHAMTXY5SBPOB4UK2FZMR64DKEMCR54K5QVPKOGN7PA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.237893047 (641h43m10.935461383s) [noise=true , address=145.79.227.34:4924 , piece_id=GB662FQNJW5RITZMPXWIR7CEBTDVDDZHYIU4TR5WVPNLXX45YNNQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.238855455 (641h43m10.936423791s) [noise=true , address=77.90.31.21:4890 , piece_id=BMFRDC32GD3VPM4MKW4O5EM4YXXDJMCGHO66IVMEKVPHD33UAZNA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.240104217 (641h43m10.937672554s) [noise=true , address=145.79.227.30:4778 , piece_id=H3RRCSB6XTCIAA4Z24XUC66IAOR2ULL5UXLKZ4XRCZTL7QEQKOYA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.347973445 (641h43m11.045541782s) [upload=564558]: Next returned nil segment Jan 1 09:12:23.347986520 (641h43m11.045554866s) [upload=564558]: Waiting for error group managing segments... Jan 1 09:12:23.360482443 (641h43m11.058050769s) [noise=true , address=45.91.116.5:4320 , piece_id=CDLQXG23BHQ3IVWK2FCSBVJMUGIHYCU46QDCAVTGHIQO5US6NOKA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.366766302 (641h43m11.064334628s) [noise=true , address=77.90.31.21:4890 , piece_id=BMFRDC32GD3VPM4MKW4O5EM4YXXDJMCGHO66IVMEKVPHD33UAZNA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.368835328 (641h43m11.066403654s) [noise=true , address=77.90.31.19:4871 , piece_id=2TKPIFKUVQORPCLP6E2PZPO2KZHNLNEZC46ATUS4SVCEITGF2H6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.376052029 (641h43m11.073620365s) [noise=true , address=145.79.227.34:4924 , piece_id=GB662FQNJW5RITZMPXWIR7CEBTDVDDZHYIU4TR5WVPNLXX45YNNQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.376352801 (641h43m11.073921148s) [noise=true , address=77.90.31.12:4600 , piece_id=6Y6CDWNKYNZDX3F742NFN3ZZWPBU6DYDYZ63DCQCC6CZO5PH3N6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.380006446 (641h43m11.077574782s) [noise=true , address=45.91.116.7:4023 , piece_id=TFIDFTFJKLIG42WVKWVUS4LEPL2EVY44UXVV5XRH6OR3F24VAZKQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.382791259 (641h43m11.080359585s) [noise=true , address=77.90.31.10:4535 , piece_id=3TTFBUIF3JZ5U2XM3RNGNGWSFTOP67DOSYIWSOH547HYTRYTXILQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.384255944 (641h43m11.081824281s) [noise=true , address=77.90.31.11:4584 , piece_id=NDO6G5HBHC34HNFVEQBHOSMU3M3FE2I7HX4DOU2323LZEUDWYK6A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.408697493 (641h43m11.106265829s) [noise=true , address=145.79.227.29:4958 , piece_id=KCMJDACUTYHAMTXY5SBPOB4UK2FZMR64DKEMCR54K5QVPKOGN7PA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.440358499 (641h43m11.137926836s) [noise=true , address=145.79.227.35:4508 , piece_id=XHGH3TJYENV5PAIPC5JZQO75WGPHIFLCBRM3YGPV2ZN44IP5C64A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.838636073 (641h43m11.53620441s) [noise=true , address=64.49.13.170:4725 , piece_id=HFHFBGX3XF552QUBTHTHRHXDEF46XSYIMGVTDK5IPP4ZOGLZDH4A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.250193406 (641h43m11.947761742s) [noise=true , address=145.79.227.44:4212 , piece_id=FN6TXVFBNBUJLWDNSGDY7TZ3R22X3WYWWDBJU3OWH2FLSNNYVSVQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.284772531 (641h43m11.982340878s) [noise=true , address=145.79.227.30:4778 , piece_id=H3RRCSB6XTCIAA4Z24XUC66IAOR2ULL5UXLKZ4XRCZTL7QEQKOYA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.307645411 (641h43m12.005213747s) [noise=true , address=145.79.227.43:4167 , piece_id=4NUTUYFT6GNH6QO6R3PCSNHKWBICOW2OQGLUD7YUUTV3UBCILO7Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.307664545 (641h43m12.005232882s) [seg_pos={0 0}, upload=564558]: Segment reached optimal threshold of 14 pieces. Jan 1 09:12:24.307973042 (641h43m12.005541388s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w21xeA7emhjphgYw2Qyz3uuHgPezuivmVD9KmrKmNZk3TnaGN): protocol: write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection; write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection Jan 1 09:12:24.307984343 (641h43m12.00555268s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308071798 (641h43m12.005640133s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308089229 (641h43m12.005657565s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308248627 (641h43m12.005816963s) [noise=true , address=145.79.227.40:4073 , piece_id=MOLBCHDQYKNI6MQZFXPGY773ZJAYSZQ7GXZTJ2OKS73EEOTURJEQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kGo5nNz8GyroAGoMQ75xDo4pppWPVsW9f8trLCWH6CqVXWsmK): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308258255 (641h43m12.005826591s) [noise=true , address=145.79.227.40:4073 , piece_id=MOLBCHDQYKNI6MQZFXPGY773ZJAYSZQ7GXZTJ2OKS73EEOTURJEQ, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308560900 (641h43m12.006129247s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308575699 (641h43m12.006144034s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308606416 (641h43m12.006174752s) [seg_pos={0 0}, upload=564558]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 1 09:12:24.308692145 (641h43m12.006260482s) [upload=564558]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 1 09:12:24.308697956 (641h43m12.006266293s) [upload=564558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 1 09:12:24.342871296 (641h43m12.040439642s) [upload=564558]: Done uploading segments... Jan 1 09:12:24.342888177 (641h43m12.040456514s) [upload=564558]: Upload finished. err: <nil> Duration: 1.269484959s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 1.780301167s trace: https://jaeger.dev.storj.io/trace/7423ba250671cbd FAIL (2026-01-01 09:19:12 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7673s) [noise=true , address=77.90.31.19:4871 , piece_id=2TKPIFKUVQORPCLP6E2PZPO2KZHNLNEZC46ATUS4SVCEITGF2H6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.228823193 (641h43m10.926391529s) [noise=true , address=64.49.13.170:4725 , piece_id=HFHFBGX3XF552QUBTHTHRHXDEF46XSYIMGVTDK5IPP4ZOGLZDH4A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.229223031 (641h43m10.926791367s) [noise=true , address=145.79.227.44:4212 , piece_id=FN6TXVFBNBUJLWDNSGDY7TZ3R22X3WYWWDBJU3OWH2FLSNNYVSVQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.229659937 (641h43m10.927228274s) [noise=true , address=145.79.227.35:4508 , piece_id=XHGH3TJYENV5PAIPC5JZQO75WGPHIFLCBRM3YGPV2ZN44IP5C64A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230072067 (641h43m10.927640413s) [noise=true , address=77.90.31.11:4584 , piece_id=NDO6G5HBHC34HNFVEQBHOSMU3M3FE2I7HX4DOU2323LZEUDWYK6A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230506839 (641h43m10.928075176s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230914060 (641h43m10.928482396s) [noise=true , address=77.90.31.12:4600 , piece_id=6Y6CDWNKYNZDX3F742NFN3ZZWPBU6DYDYZ63DCQCC6CZO5PH3N6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.231676043 (641h43m10.929244388s) [noise=true , address=45.91.116.5:4320 , piece_id=CDLQXG23BHQ3IVWK2FCSBVJMUGIHYCU46QDCAVTGHIQO5US6NOKA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.232313173 (641h43m10.929881519s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.233623291 (641h43m10.931191627s) [noise=true , address=45.91.116.7:4023 , piece_id=TFIDFTFJKLIG42WVKWVUS4LEPL2EVY44UXVV5XRH6OR3F24VAZKQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.234970407 (641h43m10.932538743s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.235943375 (641h43m10.93351171s) [noise=true , address=77.90.31.10:4535 , piece_id=3TTFBUIF3JZ5U2XM3RNGNGWSFTOP67DOSYIWSOH547HYTRYTXILQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.236753539 (641h43m10.934321874s) [noise=true , address=145.79.227.29:4958 , piece_id=KCMJDACUTYHAMTXY5SBPOB4UK2FZMR64DKEMCR54K5QVPKOGN7PA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.237893047 (641h43m10.935461383s) [noise=true , address=145.79.227.34:4924 , piece_id=GB662FQNJW5RITZMPXWIR7CEBTDVDDZHYIU4TR5WVPNLXX45YNNQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.238855455 (641h43m10.936423791s) [noise=true , address=77.90.31.21:4890 , piece_id=BMFRDC32GD3VPM4MKW4O5EM4YXXDJMCGHO66IVMEKVPHD33UAZNA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.240104217 (641h43m10.937672554s) [noise=true , address=145.79.227.30:4778 , piece_id=H3RRCSB6XTCIAA4Z24XUC66IAOR2ULL5UXLKZ4XRCZTL7QEQKOYA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.347973445 (641h43m11.045541782s) [upload=564558]: Next returned nil segment Jan 1 09:12:23.347986520 (641h43m11.045554866s) [upload=564558]: Waiting for error group managing segments... Jan 1 09:12:23.360482443 (641h43m11.058050769s) [noise=true , address=45.91.116.5:4320 , piece_id=CDLQXG23BHQ3IVWK2FCSBVJMUGIHYCU46QDCAVTGHIQO5US6NOKA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.366766302 (641h43m11.064334628s) [noise=true , address=77.90.31.21:4890 , piece_id=BMFRDC32GD3VPM4MKW4O5EM4YXXDJMCGHO66IVMEKVPHD33UAZNA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.368835328 (641h43m11.066403654s) [noise=true , address=77.90.31.19:4871 , piece_id=2TKPIFKUVQORPCLP6E2PZPO2KZHNLNEZC46ATUS4SVCEITGF2H6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.376052029 (641h43m11.073620365s) [noise=true , address=145.79.227.34:4924 , piece_id=GB662FQNJW5RITZMPXWIR7CEBTDVDDZHYIU4TR5WVPNLXX45YNNQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.376352801 (641h43m11.073921148s) [noise=true , address=77.90.31.12:4600 , piece_id=6Y6CDWNKYNZDX3F742NFN3ZZWPBU6DYDYZ63DCQCC6CZO5PH3N6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.380006446 (641h43m11.077574782s) [noise=true , address=45.91.116.7:4023 , piece_id=TFIDFTFJKLIG42WVKWVUS4LEPL2EVY44UXVV5XRH6OR3F24VAZKQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.382791259 (641h43m11.080359585s) [noise=true , address=77.90.31.10:4535 , piece_id=3TTFBUIF3JZ5U2XM3RNGNGWSFTOP67DOSYIWSOH547HYTRYTXILQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.384255944 (641h43m11.081824281s) [noise=true , address=77.90.31.11:4584 , piece_id=NDO6G5HBHC34HNFVEQBHOSMU3M3FE2I7HX4DOU2323LZEUDWYK6A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.408697493 (641h43m11.106265829s) [noise=true , address=145.79.227.29:4958 , piece_id=KCMJDACUTYHAMTXY5SBPOB4UK2FZMR64DKEMCR54K5QVPKOGN7PA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.440358499 (641h43m11.137926836s) [noise=true , address=145.79.227.35:4508 , piece_id=XHGH3TJYENV5PAIPC5JZQO75WGPHIFLCBRM3YGPV2ZN44IP5C64A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.838636073 (641h43m11.53620441s) [noise=true , address=64.49.13.170:4725 , piece_id=HFHFBGX3XF552QUBTHTHRHXDEF46XSYIMGVTDK5IPP4ZOGLZDH4A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.250193406 (641h43m11.947761742s) [noise=true , address=145.79.227.44:4212 , piece_id=FN6TXVFBNBUJLWDNSGDY7TZ3R22X3WYWWDBJU3OWH2FLSNNYVSVQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.284772531 (641h43m11.982340878s) [noise=true , address=145.79.227.30:4778 , piece_id=H3RRCSB6XTCIAA4Z24XUC66IAOR2ULL5UXLKZ4XRCZTL7QEQKOYA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.307645411 (641h43m12.005213747s) [noise=true , address=145.79.227.43:4167 , piece_id=4NUTUYFT6GNH6QO6R3PCSNHKWBICOW2OQGLUD7YUUTV3UBCILO7Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.307664545 (641h43m12.005232882s) [seg_pos={0 0}, upload=564558]: Segment reached optimal threshold of 14 pieces. Jan 1 09:12:24.307973042 (641h43m12.005541388s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w21xeA7emhjphgYw2Qyz3uuHgPezuivmVD9KmrKmNZk3TnaGN): protocol: write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection; write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection Jan 1 09:12:24.307984343 (641h43m12.00555268s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308071798 (641h43m12.005640133s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308089229 (641h43m12.005657565s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308248627 (641h43m12.005816963s) [noise=true , address=145.79.227.40:4073 , piece_id=MOLBCHDQYKNI6MQZFXPGY773ZJAYSZQ7GXZTJ2OKS73EEOTURJEQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kGo5nNz8GyroAGoMQ75xDo4pppWPVsW9f8trLCWH6CqVXWsmK): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308258255 (641h43m12.005826591s) [noise=true , address=145.79.227.40:4073 , piece_id=MOLBCHDQYKNI6MQZFXPGY773ZJAYSZQ7GXZTJ2OKS73EEOTURJEQ, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308560900 (641h43m12.006129247s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308575699 (641h43m12.006144034s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308606416 (641h43m12.006174752s) [seg_pos={0 0}, upload=564558]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 1 09:12:24.308692145 (641h43m12.006260482s) [upload=564558]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 1 09:12:24.308697956 (641h43m12.006266293s) [upload=564558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 1 09:12:24.342871296 (641h43m12.040439642s) [upload=564558]: Done uploading segments... Jan 1 09:12:24.342888177 (641h43m12.040456514s) [upload=564558]: Upload finished. err: <nil> Duration: 1.780337766s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 11.155754821s trace: https://jaeger.dev.storj.io/trace/7423ba250671cbd FAIL (2026-01-01 09:18:17 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7673s) [noise=true , address=77.90.31.19:4871 , piece_id=2TKPIFKUVQORPCLP6E2PZPO2KZHNLNEZC46ATUS4SVCEITGF2H6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.228823193 (641h43m10.926391529s) [noise=true , address=64.49.13.170:4725 , piece_id=HFHFBGX3XF552QUBTHTHRHXDEF46XSYIMGVTDK5IPP4ZOGLZDH4A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.229223031 (641h43m10.926791367s) [noise=true , address=145.79.227.44:4212 , piece_id=FN6TXVFBNBUJLWDNSGDY7TZ3R22X3WYWWDBJU3OWH2FLSNNYVSVQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.229659937 (641h43m10.927228274s) [noise=true , address=145.79.227.35:4508 , piece_id=XHGH3TJYENV5PAIPC5JZQO75WGPHIFLCBRM3YGPV2ZN44IP5C64A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230072067 (641h43m10.927640413s) [noise=true , address=77.90.31.11:4584 , piece_id=NDO6G5HBHC34HNFVEQBHOSMU3M3FE2I7HX4DOU2323LZEUDWYK6A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230506839 (641h43m10.928075176s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230914060 (641h43m10.928482396s) [noise=true , address=77.90.31.12:4600 , piece_id=6Y6CDWNKYNZDX3F742NFN3ZZWPBU6DYDYZ63DCQCC6CZO5PH3N6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.231676043 (641h43m10.929244388s) [noise=true , address=45.91.116.5:4320 , piece_id=CDLQXG23BHQ3IVWK2FCSBVJMUGIHYCU46QDCAVTGHIQO5US6NOKA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.232313173 (641h43m10.929881519s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.233623291 (641h43m10.931191627s) [noise=true , address=45.91.116.7:4023 , piece_id=TFIDFTFJKLIG42WVKWVUS4LEPL2EVY44UXVV5XRH6OR3F24VAZKQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.234970407 (641h43m10.932538743s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.235943375 (641h43m10.93351171s) [noise=true , address=77.90.31.10:4535 , piece_id=3TTFBUIF3JZ5U2XM3RNGNGWSFTOP67DOSYIWSOH547HYTRYTXILQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.236753539 (641h43m10.934321874s) [noise=true , address=145.79.227.29:4958 , piece_id=KCMJDACUTYHAMTXY5SBPOB4UK2FZMR64DKEMCR54K5QVPKOGN7PA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.237893047 (641h43m10.935461383s) [noise=true , address=145.79.227.34:4924 , piece_id=GB662FQNJW5RITZMPXWIR7CEBTDVDDZHYIU4TR5WVPNLXX45YNNQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.238855455 (641h43m10.936423791s) [noise=true , address=77.90.31.21:4890 , piece_id=BMFRDC32GD3VPM4MKW4O5EM4YXXDJMCGHO66IVMEKVPHD33UAZNA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.240104217 (641h43m10.937672554s) [noise=true , address=145.79.227.30:4778 , piece_id=H3RRCSB6XTCIAA4Z24XUC66IAOR2ULL5UXLKZ4XRCZTL7QEQKOYA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.347973445 (641h43m11.045541782s) [upload=564558]: Next returned nil segment Jan 1 09:12:23.347986520 (641h43m11.045554866s) [upload=564558]: Waiting for error group managing segments... Jan 1 09:12:23.360482443 (641h43m11.058050769s) [noise=true , address=45.91.116.5:4320 , piece_id=CDLQXG23BHQ3IVWK2FCSBVJMUGIHYCU46QDCAVTGHIQO5US6NOKA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.366766302 (641h43m11.064334628s) [noise=true , address=77.90.31.21:4890 , piece_id=BMFRDC32GD3VPM4MKW4O5EM4YXXDJMCGHO66IVMEKVPHD33UAZNA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.368835328 (641h43m11.066403654s) [noise=true , address=77.90.31.19:4871 , piece_id=2TKPIFKUVQORPCLP6E2PZPO2KZHNLNEZC46ATUS4SVCEITGF2H6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.376052029 (641h43m11.073620365s) [noise=true , address=145.79.227.34:4924 , piece_id=GB662FQNJW5RITZMPXWIR7CEBTDVDDZHYIU4TR5WVPNLXX45YNNQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.376352801 (641h43m11.073921148s) [noise=true , address=77.90.31.12:4600 , piece_id=6Y6CDWNKYNZDX3F742NFN3ZZWPBU6DYDYZ63DCQCC6CZO5PH3N6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.380006446 (641h43m11.077574782s) [noise=true , address=45.91.116.7:4023 , piece_id=TFIDFTFJKLIG42WVKWVUS4LEPL2EVY44UXVV5XRH6OR3F24VAZKQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.382791259 (641h43m11.080359585s) [noise=true , address=77.90.31.10:4535 , piece_id=3TTFBUIF3JZ5U2XM3RNGNGWSFTOP67DOSYIWSOH547HYTRYTXILQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.384255944 (641h43m11.081824281s) [noise=true , address=77.90.31.11:4584 , piece_id=NDO6G5HBHC34HNFVEQBHOSMU3M3FE2I7HX4DOU2323LZEUDWYK6A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.408697493 (641h43m11.106265829s) [noise=true , address=145.79.227.29:4958 , piece_id=KCMJDACUTYHAMTXY5SBPOB4UK2FZMR64DKEMCR54K5QVPKOGN7PA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.440358499 (641h43m11.137926836s) [noise=true , address=145.79.227.35:4508 , piece_id=XHGH3TJYENV5PAIPC5JZQO75WGPHIFLCBRM3YGPV2ZN44IP5C64A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.838636073 (641h43m11.53620441s) [noise=true , address=64.49.13.170:4725 , piece_id=HFHFBGX3XF552QUBTHTHRHXDEF46XSYIMGVTDK5IPP4ZOGLZDH4A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.250193406 (641h43m11.947761742s) [noise=true , address=145.79.227.44:4212 , piece_id=FN6TXVFBNBUJLWDNSGDY7TZ3R22X3WYWWDBJU3OWH2FLSNNYVSVQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.284772531 (641h43m11.982340878s) [noise=true , address=145.79.227.30:4778 , piece_id=H3RRCSB6XTCIAA4Z24XUC66IAOR2ULL5UXLKZ4XRCZTL7QEQKOYA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.307645411 (641h43m12.005213747s) [noise=true , address=145.79.227.43:4167 , piece_id=4NUTUYFT6GNH6QO6R3PCSNHKWBICOW2OQGLUD7YUUTV3UBCILO7Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.307664545 (641h43m12.005232882s) [seg_pos={0 0}, upload=564558]: Segment reached optimal threshold of 14 pieces. Jan 1 09:12:24.307973042 (641h43m12.005541388s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w21xeA7emhjphgYw2Qyz3uuHgPezuivmVD9KmrKmNZk3TnaGN): protocol: write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection; write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection Jan 1 09:12:24.307984343 (641h43m12.00555268s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308071798 (641h43m12.005640133s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308089229 (641h43m12.005657565s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308248627 (641h43m12.005816963s) [noise=true , address=145.79.227.40:4073 , piece_id=MOLBCHDQYKNI6MQZFXPGY773ZJAYSZQ7GXZTJ2OKS73EEOTURJEQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kGo5nNz8GyroAGoMQ75xDo4pppWPVsW9f8trLCWH6CqVXWsmK): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308258255 (641h43m12.005826591s) [noise=true , address=145.79.227.40:4073 , piece_id=MOLBCHDQYKNI6MQZFXPGY773ZJAYSZQ7GXZTJ2OKS73EEOTURJEQ, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308560900 (641h43m12.006129247s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308575699 (641h43m12.006144034s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308606416 (641h43m12.006174752s) [seg_pos={0 0}, upload=564558]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 1 09:12:24.308692145 (641h43m12.006260482s) [upload=564558]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 1 09:12:24.308697956 (641h43m12.006266293s) [upload=564558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 1 09:12:24.342871296 (641h43m12.040439642s) [upload=564558]: Done uploading segments... Jan 1 09:12:24.342888177 (641h43m12.040456514s) [upload=564558]: Upload finished. err: <nil> Duration: 11.155773165s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 11.21765816s trace: https://jaeger.dev.storj.io/trace/7423ba250671cbd FAIL (2026-01-01 09:17:06 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7673s) [noise=true , address=77.90.31.19:4871 , piece_id=2TKPIFKUVQORPCLP6E2PZPO2KZHNLNEZC46ATUS4SVCEITGF2H6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.228823193 (641h43m10.926391529s) [noise=true , address=64.49.13.170:4725 , piece_id=HFHFBGX3XF552QUBTHTHRHXDEF46XSYIMGVTDK5IPP4ZOGLZDH4A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.229223031 (641h43m10.926791367s) [noise=true , address=145.79.227.44:4212 , piece_id=FN6TXVFBNBUJLWDNSGDY7TZ3R22X3WYWWDBJU3OWH2FLSNNYVSVQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.229659937 (641h43m10.927228274s) [noise=true , address=145.79.227.35:4508 , piece_id=XHGH3TJYENV5PAIPC5JZQO75WGPHIFLCBRM3YGPV2ZN44IP5C64A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230072067 (641h43m10.927640413s) [noise=true , address=77.90.31.11:4584 , piece_id=NDO6G5HBHC34HNFVEQBHOSMU3M3FE2I7HX4DOU2323LZEUDWYK6A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230506839 (641h43m10.928075176s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230914060 (641h43m10.928482396s) [noise=true , address=77.90.31.12:4600 , piece_id=6Y6CDWNKYNZDX3F742NFN3ZZWPBU6DYDYZ63DCQCC6CZO5PH3N6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.231676043 (641h43m10.929244388s) [noise=true , address=45.91.116.5:4320 , piece_id=CDLQXG23BHQ3IVWK2FCSBVJMUGIHYCU46QDCAVTGHIQO5US6NOKA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.232313173 (641h43m10.929881519s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.233623291 (641h43m10.931191627s) [noise=true , address=45.91.116.7:4023 , piece_id=TFIDFTFJKLIG42WVKWVUS4LEPL2EVY44UXVV5XRH6OR3F24VAZKQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.234970407 (641h43m10.932538743s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.235943375 (641h43m10.93351171s) [noise=true , address=77.90.31.10:4535 , piece_id=3TTFBUIF3JZ5U2XM3RNGNGWSFTOP67DOSYIWSOH547HYTRYTXILQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.236753539 (641h43m10.934321874s) [noise=true , address=145.79.227.29:4958 , piece_id=KCMJDACUTYHAMTXY5SBPOB4UK2FZMR64DKEMCR54K5QVPKOGN7PA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.237893047 (641h43m10.935461383s) [noise=true , address=145.79.227.34:4924 , piece_id=GB662FQNJW5RITZMPXWIR7CEBTDVDDZHYIU4TR5WVPNLXX45YNNQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.238855455 (641h43m10.936423791s) [noise=true , address=77.90.31.21:4890 , piece_id=BMFRDC32GD3VPM4MKW4O5EM4YXXDJMCGHO66IVMEKVPHD33UAZNA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.240104217 (641h43m10.937672554s) [noise=true , address=145.79.227.30:4778 , piece_id=H3RRCSB6XTCIAA4Z24XUC66IAOR2ULL5UXLKZ4XRCZTL7QEQKOYA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.347973445 (641h43m11.045541782s) [upload=564558]: Next returned nil segment Jan 1 09:12:23.347986520 (641h43m11.045554866s) [upload=564558]: Waiting for error group managing segments... Jan 1 09:12:23.360482443 (641h43m11.058050769s) [noise=true , address=45.91.116.5:4320 , piece_id=CDLQXG23BHQ3IVWK2FCSBVJMUGIHYCU46QDCAVTGHIQO5US6NOKA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.366766302 (641h43m11.064334628s) [noise=true , address=77.90.31.21:4890 , piece_id=BMFRDC32GD3VPM4MKW4O5EM4YXXDJMCGHO66IVMEKVPHD33UAZNA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.368835328 (641h43m11.066403654s) [noise=true , address=77.90.31.19:4871 , piece_id=2TKPIFKUVQORPCLP6E2PZPO2KZHNLNEZC46ATUS4SVCEITGF2H6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.376052029 (641h43m11.073620365s) [noise=true , address=145.79.227.34:4924 , piece_id=GB662FQNJW5RITZMPXWIR7CEBTDVDDZHYIU4TR5WVPNLXX45YNNQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.376352801 (641h43m11.073921148s) [noise=true , address=77.90.31.12:4600 , piece_id=6Y6CDWNKYNZDX3F742NFN3ZZWPBU6DYDYZ63DCQCC6CZO5PH3N6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.380006446 (641h43m11.077574782s) [noise=true , address=45.91.116.7:4023 , piece_id=TFIDFTFJKLIG42WVKWVUS4LEPL2EVY44UXVV5XRH6OR3F24VAZKQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.382791259 (641h43m11.080359585s) [noise=true , address=77.90.31.10:4535 , piece_id=3TTFBUIF3JZ5U2XM3RNGNGWSFTOP67DOSYIWSOH547HYTRYTXILQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.384255944 (641h43m11.081824281s) [noise=true , address=77.90.31.11:4584 , piece_id=NDO6G5HBHC34HNFVEQBHOSMU3M3FE2I7HX4DOU2323LZEUDWYK6A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.408697493 (641h43m11.106265829s) [noise=true , address=145.79.227.29:4958 , piece_id=KCMJDACUTYHAMTXY5SBPOB4UK2FZMR64DKEMCR54K5QVPKOGN7PA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.440358499 (641h43m11.137926836s) [noise=true , address=145.79.227.35:4508 , piece_id=XHGH3TJYENV5PAIPC5JZQO75WGPHIFLCBRM3YGPV2ZN44IP5C64A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.838636073 (641h43m11.53620441s) [noise=true , address=64.49.13.170:4725 , piece_id=HFHFBGX3XF552QUBTHTHRHXDEF46XSYIMGVTDK5IPP4ZOGLZDH4A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.250193406 (641h43m11.947761742s) [noise=true , address=145.79.227.44:4212 , piece_id=FN6TXVFBNBUJLWDNSGDY7TZ3R22X3WYWWDBJU3OWH2FLSNNYVSVQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.284772531 (641h43m11.982340878s) [noise=true , address=145.79.227.30:4778 , piece_id=H3RRCSB6XTCIAA4Z24XUC66IAOR2ULL5UXLKZ4XRCZTL7QEQKOYA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.307645411 (641h43m12.005213747s) [noise=true , address=145.79.227.43:4167 , piece_id=4NUTUYFT6GNH6QO6R3PCSNHKWBICOW2OQGLUD7YUUTV3UBCILO7Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.307664545 (641h43m12.005232882s) [seg_pos={0 0}, upload=564558]: Segment reached optimal threshold of 14 pieces. Jan 1 09:12:24.307973042 (641h43m12.005541388s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w21xeA7emhjphgYw2Qyz3uuHgPezuivmVD9KmrKmNZk3TnaGN): protocol: write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection; write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection Jan 1 09:12:24.307984343 (641h43m12.00555268s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308071798 (641h43m12.005640133s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308089229 (641h43m12.005657565s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308248627 (641h43m12.005816963s) [noise=true , address=145.79.227.40:4073 , piece_id=MOLBCHDQYKNI6MQZFXPGY773ZJAYSZQ7GXZTJ2OKS73EEOTURJEQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kGo5nNz8GyroAGoMQ75xDo4pppWPVsW9f8trLCWH6CqVXWsmK): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308258255 (641h43m12.005826591s) [noise=true , address=145.79.227.40:4073 , piece_id=MOLBCHDQYKNI6MQZFXPGY773ZJAYSZQ7GXZTJ2OKS73EEOTURJEQ, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308560900 (641h43m12.006129247s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308575699 (641h43m12.006144034s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308606416 (641h43m12.006174752s) [seg_pos={0 0}, upload=564558]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 1 09:12:24.308692145 (641h43m12.006260482s) [upload=564558]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 1 09:12:24.308697956 (641h43m12.006266293s) [upload=564558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 1 09:12:24.342871296 (641h43m12.040439642s) [upload=564558]: Done uploading segments... Jan 1 09:12:24.342888177 (641h43m12.040456514s) [upload=564558]: Upload finished. err: <nil> Duration: 11.217681613s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 11.180339919s trace: https://jaeger.dev.storj.io/trace/7423ba250671cbd FAIL (2026-01-01 09:16:37 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7673s) [noise=true , address=77.90.31.19:4871 , piece_id=2TKPIFKUVQORPCLP6E2PZPO2KZHNLNEZC46ATUS4SVCEITGF2H6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.228823193 (641h43m10.926391529s) [noise=true , address=64.49.13.170:4725 , piece_id=HFHFBGX3XF552QUBTHTHRHXDEF46XSYIMGVTDK5IPP4ZOGLZDH4A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.229223031 (641h43m10.926791367s) [noise=true , address=145.79.227.44:4212 , piece_id=FN6TXVFBNBUJLWDNSGDY7TZ3R22X3WYWWDBJU3OWH2FLSNNYVSVQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.229659937 (641h43m10.927228274s) [noise=true , address=145.79.227.35:4508 , piece_id=XHGH3TJYENV5PAIPC5JZQO75WGPHIFLCBRM3YGPV2ZN44IP5C64A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230072067 (641h43m10.927640413s) [noise=true , address=77.90.31.11:4584 , piece_id=NDO6G5HBHC34HNFVEQBHOSMU3M3FE2I7HX4DOU2323LZEUDWYK6A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230506839 (641h43m10.928075176s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230914060 (641h43m10.928482396s) [noise=true , address=77.90.31.12:4600 , piece_id=6Y6CDWNKYNZDX3F742NFN3ZZWPBU6DYDYZ63DCQCC6CZO5PH3N6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.231676043 (641h43m10.929244388s) [noise=true , address=45.91.116.5:4320 , piece_id=CDLQXG23BHQ3IVWK2FCSBVJMUGIHYCU46QDCAVTGHIQO5US6NOKA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.232313173 (641h43m10.929881519s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.233623291 (641h43m10.931191627s) [noise=true , address=45.91.116.7:4023 , piece_id=TFIDFTFJKLIG42WVKWVUS4LEPL2EVY44UXVV5XRH6OR3F24VAZKQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.234970407 (641h43m10.932538743s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.235943375 (641h43m10.93351171s) [noise=true , address=77.90.31.10:4535 , piece_id=3TTFBUIF3JZ5U2XM3RNGNGWSFTOP67DOSYIWSOH547HYTRYTXILQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.236753539 (641h43m10.934321874s) [noise=true , address=145.79.227.29:4958 , piece_id=KCMJDACUTYHAMTXY5SBPOB4UK2FZMR64DKEMCR54K5QVPKOGN7PA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.237893047 (641h43m10.935461383s) [noise=true , address=145.79.227.34:4924 , piece_id=GB662FQNJW5RITZMPXWIR7CEBTDVDDZHYIU4TR5WVPNLXX45YNNQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.238855455 (641h43m10.936423791s) [noise=true , address=77.90.31.21:4890 , piece_id=BMFRDC32GD3VPM4MKW4O5EM4YXXDJMCGHO66IVMEKVPHD33UAZNA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.240104217 (641h43m10.937672554s) [noise=true , address=145.79.227.30:4778 , piece_id=H3RRCSB6XTCIAA4Z24XUC66IAOR2ULL5UXLKZ4XRCZTL7QEQKOYA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.347973445 (641h43m11.045541782s) [upload=564558]: Next returned nil segment Jan 1 09:12:23.347986520 (641h43m11.045554866s) [upload=564558]: Waiting for error group managing segments... Jan 1 09:12:23.360482443 (641h43m11.058050769s) [noise=true , address=45.91.116.5:4320 , piece_id=CDLQXG23BHQ3IVWK2FCSBVJMUGIHYCU46QDCAVTGHIQO5US6NOKA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.366766302 (641h43m11.064334628s) [noise=true , address=77.90.31.21:4890 , piece_id=BMFRDC32GD3VPM4MKW4O5EM4YXXDJMCGHO66IVMEKVPHD33UAZNA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.368835328 (641h43m11.066403654s) [noise=true , address=77.90.31.19:4871 , piece_id=2TKPIFKUVQORPCLP6E2PZPO2KZHNLNEZC46ATUS4SVCEITGF2H6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.376052029 (641h43m11.073620365s) [noise=true , address=145.79.227.34:4924 , piece_id=GB662FQNJW5RITZMPXWIR7CEBTDVDDZHYIU4TR5WVPNLXX45YNNQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.376352801 (641h43m11.073921148s) [noise=true , address=77.90.31.12:4600 , piece_id=6Y6CDWNKYNZDX3F742NFN3ZZWPBU6DYDYZ63DCQCC6CZO5PH3N6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.380006446 (641h43m11.077574782s) [noise=true , address=45.91.116.7:4023 , piece_id=TFIDFTFJKLIG42WVKWVUS4LEPL2EVY44UXVV5XRH6OR3F24VAZKQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.382791259 (641h43m11.080359585s) [noise=true , address=77.90.31.10:4535 , piece_id=3TTFBUIF3JZ5U2XM3RNGNGWSFTOP67DOSYIWSOH547HYTRYTXILQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.384255944 (641h43m11.081824281s) [noise=true , address=77.90.31.11:4584 , piece_id=NDO6G5HBHC34HNFVEQBHOSMU3M3FE2I7HX4DOU2323LZEUDWYK6A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.408697493 (641h43m11.106265829s) [noise=true , address=145.79.227.29:4958 , piece_id=KCMJDACUTYHAMTXY5SBPOB4UK2FZMR64DKEMCR54K5QVPKOGN7PA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.440358499 (641h43m11.137926836s) [noise=true , address=145.79.227.35:4508 , piece_id=XHGH3TJYENV5PAIPC5JZQO75WGPHIFLCBRM3YGPV2ZN44IP5C64A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.838636073 (641h43m11.53620441s) [noise=true , address=64.49.13.170:4725 , piece_id=HFHFBGX3XF552QUBTHTHRHXDEF46XSYIMGVTDK5IPP4ZOGLZDH4A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.250193406 (641h43m11.947761742s) [noise=true , address=145.79.227.44:4212 , piece_id=FN6TXVFBNBUJLWDNSGDY7TZ3R22X3WYWWDBJU3OWH2FLSNNYVSVQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.284772531 (641h43m11.982340878s) [noise=true , address=145.79.227.30:4778 , piece_id=H3RRCSB6XTCIAA4Z24XUC66IAOR2ULL5UXLKZ4XRCZTL7QEQKOYA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.307645411 (641h43m12.005213747s) [noise=true , address=145.79.227.43:4167 , piece_id=4NUTUYFT6GNH6QO6R3PCSNHKWBICOW2OQGLUD7YUUTV3UBCILO7Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.307664545 (641h43m12.005232882s) [seg_pos={0 0}, upload=564558]: Segment reached optimal threshold of 14 pieces. Jan 1 09:12:24.307973042 (641h43m12.005541388s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w21xeA7emhjphgYw2Qyz3uuHgPezuivmVD9KmrKmNZk3TnaGN): protocol: write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection; write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection Jan 1 09:12:24.307984343 (641h43m12.00555268s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308071798 (641h43m12.005640133s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308089229 (641h43m12.005657565s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308248627 (641h43m12.005816963s) [noise=true , address=145.79.227.40:4073 , piece_id=MOLBCHDQYKNI6MQZFXPGY773ZJAYSZQ7GXZTJ2OKS73EEOTURJEQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kGo5nNz8GyroAGoMQ75xDo4pppWPVsW9f8trLCWH6CqVXWsmK): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308258255 (641h43m12.005826591s) [noise=true , address=145.79.227.40:4073 , piece_id=MOLBCHDQYKNI6MQZFXPGY773ZJAYSZQ7GXZTJ2OKS73EEOTURJEQ, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308560900 (641h43m12.006129247s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308575699 (641h43m12.006144034s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308606416 (641h43m12.006174752s) [seg_pos={0 0}, upload=564558]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 1 09:12:24.308692145 (641h43m12.006260482s) [upload=564558]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 1 09:12:24.308697956 (641h43m12.006266293s) [upload=564558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 1 09:12:24.342871296 (641h43m12.040439642s) [upload=564558]: Done uploading segments... Jan 1 09:12:24.342888177 (641h43m12.040456514s) [upload=564558]: Upload finished. err: <nil> Duration: 11.180361829s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 1.635669624s trace: https://jaeger.dev.storj.io/trace/7423ba250671cbd FAIL (2026-01-01 09:15:30 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7673s) [noise=true , address=77.90.31.19:4871 , piece_id=2TKPIFKUVQORPCLP6E2PZPO2KZHNLNEZC46ATUS4SVCEITGF2H6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.228823193 (641h43m10.926391529s) [noise=true , address=64.49.13.170:4725 , piece_id=HFHFBGX3XF552QUBTHTHRHXDEF46XSYIMGVTDK5IPP4ZOGLZDH4A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.229223031 (641h43m10.926791367s) [noise=true , address=145.79.227.44:4212 , piece_id=FN6TXVFBNBUJLWDNSGDY7TZ3R22X3WYWWDBJU3OWH2FLSNNYVSVQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.229659937 (641h43m10.927228274s) [noise=true , address=145.79.227.35:4508 , piece_id=XHGH3TJYENV5PAIPC5JZQO75WGPHIFLCBRM3YGPV2ZN44IP5C64A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230072067 (641h43m10.927640413s) [noise=true , address=77.90.31.11:4584 , piece_id=NDO6G5HBHC34HNFVEQBHOSMU3M3FE2I7HX4DOU2323LZEUDWYK6A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230506839 (641h43m10.928075176s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230914060 (641h43m10.928482396s) [noise=true , address=77.90.31.12:4600 , piece_id=6Y6CDWNKYNZDX3F742NFN3ZZWPBU6DYDYZ63DCQCC6CZO5PH3N6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.231676043 (641h43m10.929244388s) [noise=true , address=45.91.116.5:4320 , piece_id=CDLQXG23BHQ3IVWK2FCSBVJMUGIHYCU46QDCAVTGHIQO5US6NOKA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.232313173 (641h43m10.929881519s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.233623291 (641h43m10.931191627s) [noise=true , address=45.91.116.7:4023 , piece_id=TFIDFTFJKLIG42WVKWVUS4LEPL2EVY44UXVV5XRH6OR3F24VAZKQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.234970407 (641h43m10.932538743s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.235943375 (641h43m10.93351171s) [noise=true , address=77.90.31.10:4535 , piece_id=3TTFBUIF3JZ5U2XM3RNGNGWSFTOP67DOSYIWSOH547HYTRYTXILQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.236753539 (641h43m10.934321874s) [noise=true , address=145.79.227.29:4958 , piece_id=KCMJDACUTYHAMTXY5SBPOB4UK2FZMR64DKEMCR54K5QVPKOGN7PA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.237893047 (641h43m10.935461383s) [noise=true , address=145.79.227.34:4924 , piece_id=GB662FQNJW5RITZMPXWIR7CEBTDVDDZHYIU4TR5WVPNLXX45YNNQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.238855455 (641h43m10.936423791s) [noise=true , address=77.90.31.21:4890 , piece_id=BMFRDC32GD3VPM4MKW4O5EM4YXXDJMCGHO66IVMEKVPHD33UAZNA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.240104217 (641h43m10.937672554s) [noise=true , address=145.79.227.30:4778 , piece_id=H3RRCSB6XTCIAA4Z24XUC66IAOR2ULL5UXLKZ4XRCZTL7QEQKOYA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.347973445 (641h43m11.045541782s) [upload=564558]: Next returned nil segment Jan 1 09:12:23.347986520 (641h43m11.045554866s) [upload=564558]: Waiting for error group managing segments... Jan 1 09:12:23.360482443 (641h43m11.058050769s) [noise=true , address=45.91.116.5:4320 , piece_id=CDLQXG23BHQ3IVWK2FCSBVJMUGIHYCU46QDCAVTGHIQO5US6NOKA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.366766302 (641h43m11.064334628s) [noise=true , address=77.90.31.21:4890 , piece_id=BMFRDC32GD3VPM4MKW4O5EM4YXXDJMCGHO66IVMEKVPHD33UAZNA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.368835328 (641h43m11.066403654s) [noise=true , address=77.90.31.19:4871 , piece_id=2TKPIFKUVQORPCLP6E2PZPO2KZHNLNEZC46ATUS4SVCEITGF2H6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.376052029 (641h43m11.073620365s) [noise=true , address=145.79.227.34:4924 , piece_id=GB662FQNJW5RITZMPXWIR7CEBTDVDDZHYIU4TR5WVPNLXX45YNNQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.376352801 (641h43m11.073921148s) [noise=true , address=77.90.31.12:4600 , piece_id=6Y6CDWNKYNZDX3F742NFN3ZZWPBU6DYDYZ63DCQCC6CZO5PH3N6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.380006446 (641h43m11.077574782s) [noise=true , address=45.91.116.7:4023 , piece_id=TFIDFTFJKLIG42WVKWVUS4LEPL2EVY44UXVV5XRH6OR3F24VAZKQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.382791259 (641h43m11.080359585s) [noise=true , address=77.90.31.10:4535 , piece_id=3TTFBUIF3JZ5U2XM3RNGNGWSFTOP67DOSYIWSOH547HYTRYTXILQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.384255944 (641h43m11.081824281s) [noise=true , address=77.90.31.11:4584 , piece_id=NDO6G5HBHC34HNFVEQBHOSMU3M3FE2I7HX4DOU2323LZEUDWYK6A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.408697493 (641h43m11.106265829s) [noise=true , address=145.79.227.29:4958 , piece_id=KCMJDACUTYHAMTXY5SBPOB4UK2FZMR64DKEMCR54K5QVPKOGN7PA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.440358499 (641h43m11.137926836s) [noise=true , address=145.79.227.35:4508 , piece_id=XHGH3TJYENV5PAIPC5JZQO75WGPHIFLCBRM3YGPV2ZN44IP5C64A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.838636073 (641h43m11.53620441s) [noise=true , address=64.49.13.170:4725 , piece_id=HFHFBGX3XF552QUBTHTHRHXDEF46XSYIMGVTDK5IPP4ZOGLZDH4A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.250193406 (641h43m11.947761742s) [noise=true , address=145.79.227.44:4212 , piece_id=FN6TXVFBNBUJLWDNSGDY7TZ3R22X3WYWWDBJU3OWH2FLSNNYVSVQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.284772531 (641h43m11.982340878s) [noise=true , address=145.79.227.30:4778 , piece_id=H3RRCSB6XTCIAA4Z24XUC66IAOR2ULL5UXLKZ4XRCZTL7QEQKOYA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.307645411 (641h43m12.005213747s) [noise=true , address=145.79.227.43:4167 , piece_id=4NUTUYFT6GNH6QO6R3PCSNHKWBICOW2OQGLUD7YUUTV3UBCILO7Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.307664545 (641h43m12.005232882s) [seg_pos={0 0}, upload=564558]: Segment reached optimal threshold of 14 pieces. Jan 1 09:12:24.307973042 (641h43m12.005541388s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w21xeA7emhjphgYw2Qyz3uuHgPezuivmVD9KmrKmNZk3TnaGN): protocol: write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection; write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection Jan 1 09:12:24.307984343 (641h43m12.00555268s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308071798 (641h43m12.005640133s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308089229 (641h43m12.005657565s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308248627 (641h43m12.005816963s) [noise=true , address=145.79.227.40:4073 , piece_id=MOLBCHDQYKNI6MQZFXPGY773ZJAYSZQ7GXZTJ2OKS73EEOTURJEQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kGo5nNz8GyroAGoMQ75xDo4pppWPVsW9f8trLCWH6CqVXWsmK): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308258255 (641h43m12.005826591s) [noise=true , address=145.79.227.40:4073 , piece_id=MOLBCHDQYKNI6MQZFXPGY773ZJAYSZQ7GXZTJ2OKS73EEOTURJEQ, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308560900 (641h43m12.006129247s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308575699 (641h43m12.006144034s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308606416 (641h43m12.006174752s) [seg_pos={0 0}, upload=564558]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 1 09:12:24.308692145 (641h43m12.006260482s) [upload=564558]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 1 09:12:24.308697956 (641h43m12.006266293s) [upload=564558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 1 09:12:24.342871296 (641h43m12.040439642s) [upload=564558]: Done uploading segments... Jan 1 09:12:24.342888177 (641h43m12.040456514s) [upload=564558]: Upload finished. err: <nil> Duration: 1.635722853s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 1.385152686s trace: https://jaeger.dev.storj.io/trace/7423ba250671cbd FAIL (2026-01-01 09:14:51 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7673s) [noise=true , address=77.90.31.19:4871 , piece_id=2TKPIFKUVQORPCLP6E2PZPO2KZHNLNEZC46ATUS4SVCEITGF2H6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.228823193 (641h43m10.926391529s) [noise=true , address=64.49.13.170:4725 , piece_id=HFHFBGX3XF552QUBTHTHRHXDEF46XSYIMGVTDK5IPP4ZOGLZDH4A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.229223031 (641h43m10.926791367s) [noise=true , address=145.79.227.44:4212 , piece_id=FN6TXVFBNBUJLWDNSGDY7TZ3R22X3WYWWDBJU3OWH2FLSNNYVSVQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.229659937 (641h43m10.927228274s) [noise=true , address=145.79.227.35:4508 , piece_id=XHGH3TJYENV5PAIPC5JZQO75WGPHIFLCBRM3YGPV2ZN44IP5C64A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230072067 (641h43m10.927640413s) [noise=true , address=77.90.31.11:4584 , piece_id=NDO6G5HBHC34HNFVEQBHOSMU3M3FE2I7HX4DOU2323LZEUDWYK6A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230506839 (641h43m10.928075176s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230914060 (641h43m10.928482396s) [noise=true , address=77.90.31.12:4600 , piece_id=6Y6CDWNKYNZDX3F742NFN3ZZWPBU6DYDYZ63DCQCC6CZO5PH3N6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.231676043 (641h43m10.929244388s) [noise=true , address=45.91.116.5:4320 , piece_id=CDLQXG23BHQ3IVWK2FCSBVJMUGIHYCU46QDCAVTGHIQO5US6NOKA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.232313173 (641h43m10.929881519s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.233623291 (641h43m10.931191627s) [noise=true , address=45.91.116.7:4023 , piece_id=TFIDFTFJKLIG42WVKWVUS4LEPL2EVY44UXVV5XRH6OR3F24VAZKQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.234970407 (641h43m10.932538743s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.235943375 (641h43m10.93351171s) [noise=true , address=77.90.31.10:4535 , piece_id=3TTFBUIF3JZ5U2XM3RNGNGWSFTOP67DOSYIWSOH547HYTRYTXILQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.236753539 (641h43m10.934321874s) [noise=true , address=145.79.227.29:4958 , piece_id=KCMJDACUTYHAMTXY5SBPOB4UK2FZMR64DKEMCR54K5QVPKOGN7PA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.237893047 (641h43m10.935461383s) [noise=true , address=145.79.227.34:4924 , piece_id=GB662FQNJW5RITZMPXWIR7CEBTDVDDZHYIU4TR5WVPNLXX45YNNQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.238855455 (641h43m10.936423791s) [noise=true , address=77.90.31.21:4890 , piece_id=BMFRDC32GD3VPM4MKW4O5EM4YXXDJMCGHO66IVMEKVPHD33UAZNA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.240104217 (641h43m10.937672554s) [noise=true , address=145.79.227.30:4778 , piece_id=H3RRCSB6XTCIAA4Z24XUC66IAOR2ULL5UXLKZ4XRCZTL7QEQKOYA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.347973445 (641h43m11.045541782s) [upload=564558]: Next returned nil segment Jan 1 09:12:23.347986520 (641h43m11.045554866s) [upload=564558]: Waiting for error group managing segments... Jan 1 09:12:23.360482443 (641h43m11.058050769s) [noise=true , address=45.91.116.5:4320 , piece_id=CDLQXG23BHQ3IVWK2FCSBVJMUGIHYCU46QDCAVTGHIQO5US6NOKA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.366766302 (641h43m11.064334628s) [noise=true , address=77.90.31.21:4890 , piece_id=BMFRDC32GD3VPM4MKW4O5EM4YXXDJMCGHO66IVMEKVPHD33UAZNA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.368835328 (641h43m11.066403654s) [noise=true , address=77.90.31.19:4871 , piece_id=2TKPIFKUVQORPCLP6E2PZPO2KZHNLNEZC46ATUS4SVCEITGF2H6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.376052029 (641h43m11.073620365s) [noise=true , address=145.79.227.34:4924 , piece_id=GB662FQNJW5RITZMPXWIR7CEBTDVDDZHYIU4TR5WVPNLXX45YNNQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.376352801 (641h43m11.073921148s) [noise=true , address=77.90.31.12:4600 , piece_id=6Y6CDWNKYNZDX3F742NFN3ZZWPBU6DYDYZ63DCQCC6CZO5PH3N6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.380006446 (641h43m11.077574782s) [noise=true , address=45.91.116.7:4023 , piece_id=TFIDFTFJKLIG42WVKWVUS4LEPL2EVY44UXVV5XRH6OR3F24VAZKQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.382791259 (641h43m11.080359585s) [noise=true , address=77.90.31.10:4535 , piece_id=3TTFBUIF3JZ5U2XM3RNGNGWSFTOP67DOSYIWSOH547HYTRYTXILQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.384255944 (641h43m11.081824281s) [noise=true , address=77.90.31.11:4584 , piece_id=NDO6G5HBHC34HNFVEQBHOSMU3M3FE2I7HX4DOU2323LZEUDWYK6A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.408697493 (641h43m11.106265829s) [noise=true , address=145.79.227.29:4958 , piece_id=KCMJDACUTYHAMTXY5SBPOB4UK2FZMR64DKEMCR54K5QVPKOGN7PA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.440358499 (641h43m11.137926836s) [noise=true , address=145.79.227.35:4508 , piece_id=XHGH3TJYENV5PAIPC5JZQO75WGPHIFLCBRM3YGPV2ZN44IP5C64A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.838636073 (641h43m11.53620441s) [noise=true , address=64.49.13.170:4725 , piece_id=HFHFBGX3XF552QUBTHTHRHXDEF46XSYIMGVTDK5IPP4ZOGLZDH4A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.250193406 (641h43m11.947761742s) [noise=true , address=145.79.227.44:4212 , piece_id=FN6TXVFBNBUJLWDNSGDY7TZ3R22X3WYWWDBJU3OWH2FLSNNYVSVQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.284772531 (641h43m11.982340878s) [noise=true , address=145.79.227.30:4778 , piece_id=H3RRCSB6XTCIAA4Z24XUC66IAOR2ULL5UXLKZ4XRCZTL7QEQKOYA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.307645411 (641h43m12.005213747s) [noise=true , address=145.79.227.43:4167 , piece_id=4NUTUYFT6GNH6QO6R3PCSNHKWBICOW2OQGLUD7YUUTV3UBCILO7Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.307664545 (641h43m12.005232882s) [seg_pos={0 0}, upload=564558]: Segment reached optimal threshold of 14 pieces. Jan 1 09:12:24.307973042 (641h43m12.005541388s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w21xeA7emhjphgYw2Qyz3uuHgPezuivmVD9KmrKmNZk3TnaGN): protocol: write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection; write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection Jan 1 09:12:24.307984343 (641h43m12.00555268s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308071798 (641h43m12.005640133s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308089229 (641h43m12.005657565s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308248627 (641h43m12.005816963s) [noise=true , address=145.79.227.40:4073 , piece_id=MOLBCHDQYKNI6MQZFXPGY773ZJAYSZQ7GXZTJ2OKS73EEOTURJEQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kGo5nNz8GyroAGoMQ75xDo4pppWPVsW9f8trLCWH6CqVXWsmK): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308258255 (641h43m12.005826591s) [noise=true , address=145.79.227.40:4073 , piece_id=MOLBCHDQYKNI6MQZFXPGY773ZJAYSZQ7GXZTJ2OKS73EEOTURJEQ, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308560900 (641h43m12.006129247s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308575699 (641h43m12.006144034s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308606416 (641h43m12.006174752s) [seg_pos={0 0}, upload=564558]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 1 09:12:24.308692145 (641h43m12.006260482s) [upload=564558]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 1 09:12:24.308697956 (641h43m12.006266293s) [upload=564558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 1 09:12:24.342871296 (641h43m12.040439642s) [upload=564558]: Done uploading segments... Jan 1 09:12:24.342888177 (641h43m12.040456514s) [upload=564558]: Upload finished. err: <nil> Duration: 1.385180158s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 6.643293583s trace: https://jaeger.dev.storj.io/trace/7423ba250671cbd FAIL (2026-01-01 09:14:11 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7673s) [noise=true , address=77.90.31.19:4871 , piece_id=2TKPIFKUVQORPCLP6E2PZPO2KZHNLNEZC46ATUS4SVCEITGF2H6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.228823193 (641h43m10.926391529s) [noise=true , address=64.49.13.170:4725 , piece_id=HFHFBGX3XF552QUBTHTHRHXDEF46XSYIMGVTDK5IPP4ZOGLZDH4A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.229223031 (641h43m10.926791367s) [noise=true , address=145.79.227.44:4212 , piece_id=FN6TXVFBNBUJLWDNSGDY7TZ3R22X3WYWWDBJU3OWH2FLSNNYVSVQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.229659937 (641h43m10.927228274s) [noise=true , address=145.79.227.35:4508 , piece_id=XHGH3TJYENV5PAIPC5JZQO75WGPHIFLCBRM3YGPV2ZN44IP5C64A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230072067 (641h43m10.927640413s) [noise=true , address=77.90.31.11:4584 , piece_id=NDO6G5HBHC34HNFVEQBHOSMU3M3FE2I7HX4DOU2323LZEUDWYK6A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230506839 (641h43m10.928075176s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230914060 (641h43m10.928482396s) [noise=true , address=77.90.31.12:4600 , piece_id=6Y6CDWNKYNZDX3F742NFN3ZZWPBU6DYDYZ63DCQCC6CZO5PH3N6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.231676043 (641h43m10.929244388s) [noise=true , address=45.91.116.5:4320 , piece_id=CDLQXG23BHQ3IVWK2FCSBVJMUGIHYCU46QDCAVTGHIQO5US6NOKA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.232313173 (641h43m10.929881519s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.233623291 (641h43m10.931191627s) [noise=true , address=45.91.116.7:4023 , piece_id=TFIDFTFJKLIG42WVKWVUS4LEPL2EVY44UXVV5XRH6OR3F24VAZKQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.234970407 (641h43m10.932538743s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.235943375 (641h43m10.93351171s) [noise=true , address=77.90.31.10:4535 , piece_id=3TTFBUIF3JZ5U2XM3RNGNGWSFTOP67DOSYIWSOH547HYTRYTXILQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.236753539 (641h43m10.934321874s) [noise=true , address=145.79.227.29:4958 , piece_id=KCMJDACUTYHAMTXY5SBPOB4UK2FZMR64DKEMCR54K5QVPKOGN7PA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.237893047 (641h43m10.935461383s) [noise=true , address=145.79.227.34:4924 , piece_id=GB662FQNJW5RITZMPXWIR7CEBTDVDDZHYIU4TR5WVPNLXX45YNNQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.238855455 (641h43m10.936423791s) [noise=true , address=77.90.31.21:4890 , piece_id=BMFRDC32GD3VPM4MKW4O5EM4YXXDJMCGHO66IVMEKVPHD33UAZNA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.240104217 (641h43m10.937672554s) [noise=true , address=145.79.227.30:4778 , piece_id=H3RRCSB6XTCIAA4Z24XUC66IAOR2ULL5UXLKZ4XRCZTL7QEQKOYA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.347973445 (641h43m11.045541782s) [upload=564558]: Next returned nil segment Jan 1 09:12:23.347986520 (641h43m11.045554866s) [upload=564558]: Waiting for error group managing segments... Jan 1 09:12:23.360482443 (641h43m11.058050769s) [noise=true , address=45.91.116.5:4320 , piece_id=CDLQXG23BHQ3IVWK2FCSBVJMUGIHYCU46QDCAVTGHIQO5US6NOKA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.366766302 (641h43m11.064334628s) [noise=true , address=77.90.31.21:4890 , piece_id=BMFRDC32GD3VPM4MKW4O5EM4YXXDJMCGHO66IVMEKVPHD33UAZNA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.368835328 (641h43m11.066403654s) [noise=true , address=77.90.31.19:4871 , piece_id=2TKPIFKUVQORPCLP6E2PZPO2KZHNLNEZC46ATUS4SVCEITGF2H6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.376052029 (641h43m11.073620365s) [noise=true , address=145.79.227.34:4924 , piece_id=GB662FQNJW5RITZMPXWIR7CEBTDVDDZHYIU4TR5WVPNLXX45YNNQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.376352801 (641h43m11.073921148s) [noise=true , address=77.90.31.12:4600 , piece_id=6Y6CDWNKYNZDX3F742NFN3ZZWPBU6DYDYZ63DCQCC6CZO5PH3N6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.380006446 (641h43m11.077574782s) [noise=true , address=45.91.116.7:4023 , piece_id=TFIDFTFJKLIG42WVKWVUS4LEPL2EVY44UXVV5XRH6OR3F24VAZKQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.382791259 (641h43m11.080359585s) [noise=true , address=77.90.31.10:4535 , piece_id=3TTFBUIF3JZ5U2XM3RNGNGWSFTOP67DOSYIWSOH547HYTRYTXILQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.384255944 (641h43m11.081824281s) [noise=true , address=77.90.31.11:4584 , piece_id=NDO6G5HBHC34HNFVEQBHOSMU3M3FE2I7HX4DOU2323LZEUDWYK6A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.408697493 (641h43m11.106265829s) [noise=true , address=145.79.227.29:4958 , piece_id=KCMJDACUTYHAMTXY5SBPOB4UK2FZMR64DKEMCR54K5QVPKOGN7PA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.440358499 (641h43m11.137926836s) [noise=true , address=145.79.227.35:4508 , piece_id=XHGH3TJYENV5PAIPC5JZQO75WGPHIFLCBRM3YGPV2ZN44IP5C64A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.838636073 (641h43m11.53620441s) [noise=true , address=64.49.13.170:4725 , piece_id=HFHFBGX3XF552QUBTHTHRHXDEF46XSYIMGVTDK5IPP4ZOGLZDH4A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.250193406 (641h43m11.947761742s) [noise=true , address=145.79.227.44:4212 , piece_id=FN6TXVFBNBUJLWDNSGDY7TZ3R22X3WYWWDBJU3OWH2FLSNNYVSVQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.284772531 (641h43m11.982340878s) [noise=true , address=145.79.227.30:4778 , piece_id=H3RRCSB6XTCIAA4Z24XUC66IAOR2ULL5UXLKZ4XRCZTL7QEQKOYA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.307645411 (641h43m12.005213747s) [noise=true , address=145.79.227.43:4167 , piece_id=4NUTUYFT6GNH6QO6R3PCSNHKWBICOW2OQGLUD7YUUTV3UBCILO7Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.307664545 (641h43m12.005232882s) [seg_pos={0 0}, upload=564558]: Segment reached optimal threshold of 14 pieces. Jan 1 09:12:24.307973042 (641h43m12.005541388s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w21xeA7emhjphgYw2Qyz3uuHgPezuivmVD9KmrKmNZk3TnaGN): protocol: write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection; write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection Jan 1 09:12:24.307984343 (641h43m12.00555268s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308071798 (641h43m12.005640133s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308089229 (641h43m12.005657565s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308248627 (641h43m12.005816963s) [noise=true , address=145.79.227.40:4073 , piece_id=MOLBCHDQYKNI6MQZFXPGY773ZJAYSZQ7GXZTJ2OKS73EEOTURJEQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kGo5nNz8GyroAGoMQ75xDo4pppWPVsW9f8trLCWH6CqVXWsmK): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308258255 (641h43m12.005826591s) [noise=true , address=145.79.227.40:4073 , piece_id=MOLBCHDQYKNI6MQZFXPGY773ZJAYSZQ7GXZTJ2OKS73EEOTURJEQ, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308560900 (641h43m12.006129247s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308575699 (641h43m12.006144034s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308606416 (641h43m12.006174752s) [seg_pos={0 0}, upload=564558]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 1 09:12:24.308692145 (641h43m12.006260482s) [upload=564558]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 1 09:12:24.308697956 (641h43m12.006266293s) [upload=564558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 1 09:12:24.342871296 (641h43m12.040439642s) [upload=564558]: Done uploading segments... Jan 1 09:12:24.342888177 (641h43m12.040456514s) [upload=564558]: Upload finished. err: <nil> Duration: 6.643317838s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 1.830670025s trace: https://jaeger.dev.storj.io/trace/7423ba250671cbd FAIL (2026-01-01 09:13:25 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7673s) [noise=true , address=77.90.31.19:4871 , piece_id=2TKPIFKUVQORPCLP6E2PZPO2KZHNLNEZC46ATUS4SVCEITGF2H6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.228823193 (641h43m10.926391529s) [noise=true , address=64.49.13.170:4725 , piece_id=HFHFBGX3XF552QUBTHTHRHXDEF46XSYIMGVTDK5IPP4ZOGLZDH4A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.229223031 (641h43m10.926791367s) [noise=true , address=145.79.227.44:4212 , piece_id=FN6TXVFBNBUJLWDNSGDY7TZ3R22X3WYWWDBJU3OWH2FLSNNYVSVQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.229659937 (641h43m10.927228274s) [noise=true , address=145.79.227.35:4508 , piece_id=XHGH3TJYENV5PAIPC5JZQO75WGPHIFLCBRM3YGPV2ZN44IP5C64A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230072067 (641h43m10.927640413s) [noise=true , address=77.90.31.11:4584 , piece_id=NDO6G5HBHC34HNFVEQBHOSMU3M3FE2I7HX4DOU2323LZEUDWYK6A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230506839 (641h43m10.928075176s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230914060 (641h43m10.928482396s) [noise=true , address=77.90.31.12:4600 , piece_id=6Y6CDWNKYNZDX3F742NFN3ZZWPBU6DYDYZ63DCQCC6CZO5PH3N6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.231676043 (641h43m10.929244388s) [noise=true , address=45.91.116.5:4320 , piece_id=CDLQXG23BHQ3IVWK2FCSBVJMUGIHYCU46QDCAVTGHIQO5US6NOKA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.232313173 (641h43m10.929881519s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.233623291 (641h43m10.931191627s) [noise=true , address=45.91.116.7:4023 , piece_id=TFIDFTFJKLIG42WVKWVUS4LEPL2EVY44UXVV5XRH6OR3F24VAZKQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.234970407 (641h43m10.932538743s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.235943375 (641h43m10.93351171s) [noise=true , address=77.90.31.10:4535 , piece_id=3TTFBUIF3JZ5U2XM3RNGNGWSFTOP67DOSYIWSOH547HYTRYTXILQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.236753539 (641h43m10.934321874s) [noise=true , address=145.79.227.29:4958 , piece_id=KCMJDACUTYHAMTXY5SBPOB4UK2FZMR64DKEMCR54K5QVPKOGN7PA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.237893047 (641h43m10.935461383s) [noise=true , address=145.79.227.34:4924 , piece_id=GB662FQNJW5RITZMPXWIR7CEBTDVDDZHYIU4TR5WVPNLXX45YNNQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.238855455 (641h43m10.936423791s) [noise=true , address=77.90.31.21:4890 , piece_id=BMFRDC32GD3VPM4MKW4O5EM4YXXDJMCGHO66IVMEKVPHD33UAZNA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.240104217 (641h43m10.937672554s) [noise=true , address=145.79.227.30:4778 , piece_id=H3RRCSB6XTCIAA4Z24XUC66IAOR2ULL5UXLKZ4XRCZTL7QEQKOYA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.347973445 (641h43m11.045541782s) [upload=564558]: Next returned nil segment Jan 1 09:12:23.347986520 (641h43m11.045554866s) [upload=564558]: Waiting for error group managing segments... Jan 1 09:12:23.360482443 (641h43m11.058050769s) [noise=true , address=45.91.116.5:4320 , piece_id=CDLQXG23BHQ3IVWK2FCSBVJMUGIHYCU46QDCAVTGHIQO5US6NOKA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.366766302 (641h43m11.064334628s) [noise=true , address=77.90.31.21:4890 , piece_id=BMFRDC32GD3VPM4MKW4O5EM4YXXDJMCGHO66IVMEKVPHD33UAZNA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.368835328 (641h43m11.066403654s) [noise=true , address=77.90.31.19:4871 , piece_id=2TKPIFKUVQORPCLP6E2PZPO2KZHNLNEZC46ATUS4SVCEITGF2H6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.376052029 (641h43m11.073620365s) [noise=true , address=145.79.227.34:4924 , piece_id=GB662FQNJW5RITZMPXWIR7CEBTDVDDZHYIU4TR5WVPNLXX45YNNQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.376352801 (641h43m11.073921148s) [noise=true , address=77.90.31.12:4600 , piece_id=6Y6CDWNKYNZDX3F742NFN3ZZWPBU6DYDYZ63DCQCC6CZO5PH3N6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.380006446 (641h43m11.077574782s) [noise=true , address=45.91.116.7:4023 , piece_id=TFIDFTFJKLIG42WVKWVUS4LEPL2EVY44UXVV5XRH6OR3F24VAZKQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.382791259 (641h43m11.080359585s) [noise=true , address=77.90.31.10:4535 , piece_id=3TTFBUIF3JZ5U2XM3RNGNGWSFTOP67DOSYIWSOH547HYTRYTXILQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.384255944 (641h43m11.081824281s) [noise=true , address=77.90.31.11:4584 , piece_id=NDO6G5HBHC34HNFVEQBHOSMU3M3FE2I7HX4DOU2323LZEUDWYK6A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.408697493 (641h43m11.106265829s) [noise=true , address=145.79.227.29:4958 , piece_id=KCMJDACUTYHAMTXY5SBPOB4UK2FZMR64DKEMCR54K5QVPKOGN7PA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.440358499 (641h43m11.137926836s) [noise=true , address=145.79.227.35:4508 , piece_id=XHGH3TJYENV5PAIPC5JZQO75WGPHIFLCBRM3YGPV2ZN44IP5C64A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.838636073 (641h43m11.53620441s) [noise=true , address=64.49.13.170:4725 , piece_id=HFHFBGX3XF552QUBTHTHRHXDEF46XSYIMGVTDK5IPP4ZOGLZDH4A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.250193406 (641h43m11.947761742s) [noise=true , address=145.79.227.44:4212 , piece_id=FN6TXVFBNBUJLWDNSGDY7TZ3R22X3WYWWDBJU3OWH2FLSNNYVSVQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.284772531 (641h43m11.982340878s) [noise=true , address=145.79.227.30:4778 , piece_id=H3RRCSB6XTCIAA4Z24XUC66IAOR2ULL5UXLKZ4XRCZTL7QEQKOYA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.307645411 (641h43m12.005213747s) [noise=true , address=145.79.227.43:4167 , piece_id=4NUTUYFT6GNH6QO6R3PCSNHKWBICOW2OQGLUD7YUUTV3UBCILO7Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.307664545 (641h43m12.005232882s) [seg_pos={0 0}, upload=564558]: Segment reached optimal threshold of 14 pieces. Jan 1 09:12:24.307973042 (641h43m12.005541388s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w21xeA7emhjphgYw2Qyz3uuHgPezuivmVD9KmrKmNZk3TnaGN): protocol: write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection; write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection Jan 1 09:12:24.307984343 (641h43m12.00555268s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308071798 (641h43m12.005640133s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308089229 (641h43m12.005657565s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308248627 (641h43m12.005816963s) [noise=true , address=145.79.227.40:4073 , piece_id=MOLBCHDQYKNI6MQZFXPGY773ZJAYSZQ7GXZTJ2OKS73EEOTURJEQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kGo5nNz8GyroAGoMQ75xDo4pppWPVsW9f8trLCWH6CqVXWsmK): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308258255 (641h43m12.005826591s) [noise=true , address=145.79.227.40:4073 , piece_id=MOLBCHDQYKNI6MQZFXPGY773ZJAYSZQ7GXZTJ2OKS73EEOTURJEQ, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308560900 (641h43m12.006129247s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308575699 (641h43m12.006144034s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308606416 (641h43m12.006174752s) [seg_pos={0 0}, upload=564558]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 1 09:12:24.308692145 (641h43m12.006260482s) [upload=564558]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 1 09:12:24.308697956 (641h43m12.006266293s) [upload=564558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 1 09:12:24.342871296 (641h43m12.040439642s) [upload=564558]: Done uploading segments... Jan 1 09:12:24.342888177 (641h43m12.040456514s) [upload=564558]: Upload finished. err: <nil> Duration: 1.83068302s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.002034808s trace: https://jaeger.dev.storj.io/trace/7423ba250671cbd FAIL (2026-01-01 09:13:23 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7673s) [noise=true , address=77.90.31.19:4871 , piece_id=2TKPIFKUVQORPCLP6E2PZPO2KZHNLNEZC46ATUS4SVCEITGF2H6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.228823193 (641h43m10.926391529s) [noise=true , address=64.49.13.170:4725 , piece_id=HFHFBGX3XF552QUBTHTHRHXDEF46XSYIMGVTDK5IPP4ZOGLZDH4A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.229223031 (641h43m10.926791367s) [noise=true , address=145.79.227.44:4212 , piece_id=FN6TXVFBNBUJLWDNSGDY7TZ3R22X3WYWWDBJU3OWH2FLSNNYVSVQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.229659937 (641h43m10.927228274s) [noise=true , address=145.79.227.35:4508 , piece_id=XHGH3TJYENV5PAIPC5JZQO75WGPHIFLCBRM3YGPV2ZN44IP5C64A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230072067 (641h43m10.927640413s) [noise=true , address=77.90.31.11:4584 , piece_id=NDO6G5HBHC34HNFVEQBHOSMU3M3FE2I7HX4DOU2323LZEUDWYK6A, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230506839 (641h43m10.928075176s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.230914060 (641h43m10.928482396s) [noise=true , address=77.90.31.12:4600 , piece_id=6Y6CDWNKYNZDX3F742NFN3ZZWPBU6DYDYZ63DCQCC6CZO5PH3N6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.231676043 (641h43m10.929244388s) [noise=true , address=45.91.116.5:4320 , piece_id=CDLQXG23BHQ3IVWK2FCSBVJMUGIHYCU46QDCAVTGHIQO5US6NOKA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.232313173 (641h43m10.929881519s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.233623291 (641h43m10.931191627s) [noise=true , address=45.91.116.7:4023 , piece_id=TFIDFTFJKLIG42WVKWVUS4LEPL2EVY44UXVV5XRH6OR3F24VAZKQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.234970407 (641h43m10.932538743s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.235943375 (641h43m10.93351171s) [noise=true , address=77.90.31.10:4535 , piece_id=3TTFBUIF3JZ5U2XM3RNGNGWSFTOP67DOSYIWSOH547HYTRYTXILQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.236753539 (641h43m10.934321874s) [noise=true , address=145.79.227.29:4958 , piece_id=KCMJDACUTYHAMTXY5SBPOB4UK2FZMR64DKEMCR54K5QVPKOGN7PA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.237893047 (641h43m10.935461383s) [noise=true , address=145.79.227.34:4924 , piece_id=GB662FQNJW5RITZMPXWIR7CEBTDVDDZHYIU4TR5WVPNLXX45YNNQ, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.238855455 (641h43m10.936423791s) [noise=true , address=77.90.31.21:4890 , piece_id=BMFRDC32GD3VPM4MKW4O5EM4YXXDJMCGHO66IVMEKVPHD33UAZNA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.240104217 (641h43m10.937672554s) [noise=true , address=145.79.227.30:4778 , piece_id=H3RRCSB6XTCIAA4Z24XUC66IAOR2ULL5UXLKZ4XRCZTL7QEQKOYA, seg_pos={0 0}, upload=564558]: Uploading piece... Jan 1 09:12:23.347973445 (641h43m11.045541782s) [upload=564558]: Next returned nil segment Jan 1 09:12:23.347986520 (641h43m11.045554866s) [upload=564558]: Waiting for error group managing segments... Jan 1 09:12:23.360482443 (641h43m11.058050769s) [noise=true , address=45.91.116.5:4320 , piece_id=CDLQXG23BHQ3IVWK2FCSBVJMUGIHYCU46QDCAVTGHIQO5US6NOKA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.366766302 (641h43m11.064334628s) [noise=true , address=77.90.31.21:4890 , piece_id=BMFRDC32GD3VPM4MKW4O5EM4YXXDJMCGHO66IVMEKVPHD33UAZNA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.368835328 (641h43m11.066403654s) [noise=true , address=77.90.31.19:4871 , piece_id=2TKPIFKUVQORPCLP6E2PZPO2KZHNLNEZC46ATUS4SVCEITGF2H6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.376052029 (641h43m11.073620365s) [noise=true , address=145.79.227.34:4924 , piece_id=GB662FQNJW5RITZMPXWIR7CEBTDVDDZHYIU4TR5WVPNLXX45YNNQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.376352801 (641h43m11.073921148s) [noise=true , address=77.90.31.12:4600 , piece_id=6Y6CDWNKYNZDX3F742NFN3ZZWPBU6DYDYZ63DCQCC6CZO5PH3N6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.380006446 (641h43m11.077574782s) [noise=true , address=45.91.116.7:4023 , piece_id=TFIDFTFJKLIG42WVKWVUS4LEPL2EVY44UXVV5XRH6OR3F24VAZKQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.382791259 (641h43m11.080359585s) [noise=true , address=77.90.31.10:4535 , piece_id=3TTFBUIF3JZ5U2XM3RNGNGWSFTOP67DOSYIWSOH547HYTRYTXILQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.384255944 (641h43m11.081824281s) [noise=true , address=77.90.31.11:4584 , piece_id=NDO6G5HBHC34HNFVEQBHOSMU3M3FE2I7HX4DOU2323LZEUDWYK6A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.408697493 (641h43m11.106265829s) [noise=true , address=145.79.227.29:4958 , piece_id=KCMJDACUTYHAMTXY5SBPOB4UK2FZMR64DKEMCR54K5QVPKOGN7PA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.440358499 (641h43m11.137926836s) [noise=true , address=145.79.227.35:4508 , piece_id=XHGH3TJYENV5PAIPC5JZQO75WGPHIFLCBRM3YGPV2ZN44IP5C64A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:23.838636073 (641h43m11.53620441s) [noise=true , address=64.49.13.170:4725 , piece_id=HFHFBGX3XF552QUBTHTHRHXDEF46XSYIMGVTDK5IPP4ZOGLZDH4A, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.250193406 (641h43m11.947761742s) [noise=true , address=145.79.227.44:4212 , piece_id=FN6TXVFBNBUJLWDNSGDY7TZ3R22X3WYWWDBJU3OWH2FLSNNYVSVQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.284772531 (641h43m11.982340878s) [noise=true , address=145.79.227.30:4778 , piece_id=H3RRCSB6XTCIAA4Z24XUC66IAOR2ULL5UXLKZ4XRCZTL7QEQKOYA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.307645411 (641h43m12.005213747s) [noise=true , address=145.79.227.43:4167 , piece_id=4NUTUYFT6GNH6QO6R3PCSNHKWBICOW2OQGLUD7YUUTV3UBCILO7Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: <nil> Jan 1 09:12:24.307664545 (641h43m12.005232882s) [seg_pos={0 0}, upload=564558]: Segment reached optimal threshold of 14 pieces. Jan 1 09:12:24.307973042 (641h43m12.005541388s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w21xeA7emhjphgYw2Qyz3uuHgPezuivmVD9KmrKmNZk3TnaGN): protocol: write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection; write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:32102->64.49.13.169:4716: use of closed network connection Jan 1 09:12:24.307984343 (641h43m12.00555268s) [noise=true , address=64.49.13.169:4716 , piece_id=WIEHGHWVJYDBXXH5SBQHO4OWE3TYFPUGSWIEMOTZLCOA23NHMJ2Q, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308071798 (641h43m12.005640133s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308089229 (641h43m12.005657565s) [noise=true , address=145.79.227.49:4367 , piece_id=RRZRLXP3QWZUFCJLG374KX2HPYBP3EWQLF3Y2GO3DU4DPUQTSG6Q, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308248627 (641h43m12.005816963s) [noise=true , address=145.79.227.40:4073 , piece_id=MOLBCHDQYKNI6MQZFXPGY773ZJAYSZQ7GXZTJ2OKS73EEOTURJEQ, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kGo5nNz8GyroAGoMQ75xDo4pppWPVsW9f8trLCWH6CqVXWsmK): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308258255 (641h43m12.005826591s) [noise=true , address=145.79.227.40:4073 , piece_id=MOLBCHDQYKNI6MQZFXPGY773ZJAYSZQ7GXZTJ2OKS73EEOTURJEQ, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308560900 (641h43m12.006129247s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YApHMARaC7Wxeqopt72gpnyJS1xYBwhV7wbU9NJdR6W7hukyq): protocol: expected piece hash; context canceled; EOF Jan 1 09:12:24.308575699 (641h43m12.006144034s) [noise=true , address=145.79.227.33:4874 , piece_id=FCXNBNJ6O4QJHXLRNYTEMWAYOV67YR3NXM4UWF47GN7Z5X3MC3YA, seg_pos={0 0}, upload=564558]: Long tail cancellation due to optimal threshold Jan 1 09:12:24.308606416 (641h43m12.006174752s) [seg_pos={0 0}, upload=564558]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 1 09:12:24.308692145 (641h43m12.006260482s) [upload=564558]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 1 09:12:24.308697956 (641h43m12.006266293s) [upload=564558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 1 09:12:24.342871296 (641h43m12.040439642s) [upload=564558]: Done uploading segments... Jan 1 09:12:24.342888177 (641h43m12.040456514s) [upload=564558]: Upload finished. err: <nil> Duration: 1m0.002049064s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [X...........................................................] duration: 484.24639ms trace: https://jaeger.dev.storj.io/trace/f5632f3159d5a2c FAIL (2026-01-01 05:59:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 484.282036ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.X..........................................................] duration: 492.38367ms trace: https://jaeger.dev.storj.io/trace/f5632f3159d5a2c FAIL (2026-01-01 05:58:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 492.446597ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..X.........................................................] duration: 521.620059ms trace: https://jaeger.dev.storj.io/trace/f5632f3159d5a2c FAIL (2026-01-01 05:57:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 521.664642ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...X........................................................] duration: 493.688404ms trace: https://jaeger.dev.storj.io/trace/f5632f3159d5a2c FAIL (2026-01-01 05:57:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 493.70803ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [....X.......................................................] duration: 505.173718ms trace: https://jaeger.dev.storj.io/trace/f5632f3159d5a2c FAIL (2026-01-01 05:56:41 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 505.186872ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.....X......................................................] duration: 467.68385ms trace: https://jaeger.dev.storj.io/trace/f5632f3159d5a2c FAIL (2026-01-01 05:55:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 467.706233ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [......X.....................................................] duration: 461.064317ms trace: https://jaeger.dev.storj.io/trace/f5632f3159d5a2c FAIL (2026-01-01 05:54:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 461.161487ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.......X....................................................] duration: 493.527869ms trace: https://jaeger.dev.storj.io/trace/f5632f3159d5a2c FAIL (2026-01-01 05:53:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 493.547657ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [........X...................................................] duration: 446.898309ms trace: https://jaeger.dev.storj.io/trace/f5632f3159d5a2c FAIL (2026-01-01 05:52:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 446.979651ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.........X..................................................] duration: 452.221733ms trace: https://jaeger.dev.storj.io/trace/f5632f3159d5a2c FAIL (2026-01-01 05:52:26 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 452.242473ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..........X.................................................] duration: 502.688103ms trace: https://jaeger.dev.storj.io/trace/f5632f3159d5a2c FAIL (2026-01-01 05:51:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 502.698963ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...........X................................................] duration: 435.658796ms trace: https://jaeger.dev.storj.io/trace/f5632f3159d5a2c FAIL (2026-01-01 05:50:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 435.676518ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [............X...............................................] duration: 472.05248ms trace: https://jaeger.dev.storj.io/trace/f5632f3159d5a2c FAIL (2026-01-01 05:49:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 472.072208ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.............X..............................................] duration: 488.778316ms trace: https://jaeger.dev.storj.io/trace/f5632f3159d5a2c FAIL (2026-01-01 05:49:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 488.793154ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..............X.............................................] duration: 479.905512ms trace: https://jaeger.dev.storj.io/trace/f5632f3159d5a2c FAIL (2026-01-01 05:48:50 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 479.927272ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...............X............................................] duration: 476.631484ms trace: https://jaeger.dev.storj.io/trace/f5632f3159d5a2c FAIL (2026-01-01 05:47:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 476.647314ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [................X...........................................] duration: 484.392872ms trace: https://jaeger.dev.storj.io/trace/f5632f3159d5a2c FAIL (2026-01-01 05:46:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 484.417128ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.................X..........................................] duration: 483.970613ms trace: https://jaeger.dev.storj.io/trace/f5632f3159d5a2c FAIL (2026-01-01 05:45:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 484.031086ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..................X.........................................] duration: 496.090927ms trace: https://jaeger.dev.storj.io/trace/f5632f3159d5a2c FAIL (2026-01-01 05:44:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 496.114202ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...................X........................................] duration: 542.85434ms trace: https://jaeger.dev.storj.io/trace/f5632f3159d5a2c FAIL (2026-01-01 05:44:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 542.881121ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [....................X.......................................] duration: 574.680428ms trace: https://jaeger.dev.storj.io/trace/f5632f3159d5a2c FAIL (2026-01-01 05:43:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 574.699664ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.....................X......................................] duration: 774.985966ms trace: https://jaeger.dev.storj.io/trace/f5632f3159d5a2c FAIL (2026-01-01 05:42:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 775.003619ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [......................X.....................................] duration: 516.294744ms trace: https://jaeger.dev.storj.io/trace/f5632f3159d5a2c FAIL (2026-01-01 05:41:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 516.317515ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.......................X....................................] duration: 647.852131ms trace: https://jaeger.dev.storj.io/trace/f5632f3159d5a2c FAIL (2026-01-01 05:40:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 647.894249ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [........................X...................................] duration: 513.608205ms trace: https://jaeger.dev.storj.io/trace/f5632f3159d5a2c FAIL (2026-01-01 05:40:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 513.629885ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.........................X..................................] duration: 770.117292ms trace: https://jaeger.dev.storj.io/trace/f5632f3159d5a2c FAIL (2026-01-01 05:39:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 770.13804ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..........................X.................................] duration: 485.883142ms trace: https://jaeger.dev.storj.io/trace/f5632f3159d5a2c FAIL (2026-01-01 05:38:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 485.899943ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...........................X................................] duration: 468.810486ms trace: https://jaeger.dev.storj.io/trace/f5632f3159d5a2c FAIL (2026-01-01 05:38:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 468.830534ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [............................X...............................] duration: 472.095932ms trace: https://jaeger.dev.storj.io/trace/f5632f3159d5a2c FAIL (2026-01-01 05:37:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 472.119245ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.............................X..............................] duration: 486.45485ms trace: https://jaeger.dev.storj.io/trace/f5632f3159d5a2c FAIL (2026-01-01 05:36:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 486.477712ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..............................X.............................] duration: 461.940491ms trace: https://jaeger.dev.storj.io/trace/f5632f3159d5a2c FAIL (2026-01-01 05:36:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 461.961971ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...............................X............................] duration: 476.010518ms trace: https://jaeger.dev.storj.io/trace/f5632f3159d5a2c FAIL (2026-01-01 05:34:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 476.103452ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [................................X...........................] duration: 450.50044ms trace: https://jaeger.dev.storj.io/trace/f5632f3159d5a2c FAIL (2026-01-01 05:34:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 450.524926ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.................................X..........................] duration: 456.433021ms trace: https://jaeger.dev.storj.io/trace/f5632f3159d5a2c FAIL (2026-01-01 05:33:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 456.455003ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..................................X.........................] duration: 446.2808ms trace: https://jaeger.dev.storj.io/trace/f5632f3159d5a2c FAIL (2026-01-01 05:32:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 446.303332ms core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)