Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
456.23784ms trace:
https://jaeger.dev.storj.io/trace/14ab9a15cfb4b1db
FAIL (2026-02-06 01:52:31 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Feb 6 01:30:24.409352463 (513h34m2.591797474s) [upload=451513]: Starting upload
Feb 6 01:30:24.409416172 (513h34m2.591861172s) [upload=451513]: Done starting upload
Feb 6 01:30:24.409489941 (513h34m2.59193494s) [upload=451513]: Uploading segments...
Feb 6 01:30:24.409812984 (513h34m2.592257984s) [upload=451513]: Got next segment. Inline: false
Feb 6 01:30:24.409855192 (513h34m2.592300192s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 6 01:30:24.409860782 (513h34m2.592305783s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 6 01:30:24.431132711 (513h34m2.613577711s) [seg_pos={0 0}, upload=451513]: Begin upload segment...
Feb 6 01:30:24.431179047 (513h34m2.613624047s) [seg_pos={0 0}, upload=451513]: Done begin upload segment.
Feb 6 01:30:24.431213932 (513h34m2.613658932s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431248958 (513h34m2.613693958s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431960537 (513h34m2.614405538s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.432469217 (513h34m2.614914217s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433082974 (513h34m2.615527974s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433533606 (513h34m2.615978606s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433968238 (513h34m2.616413238s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434385187 (513h34m2.616830187s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434866285 (513h34m2.617311285s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.436773027 (513h34m2.619218027s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.437309239 (513h34m2.619754238s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.439077833 (513h34m2.621522843s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.441279355 (513h34m2.623724355s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.443697523 (513h34m2.626142532s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.449466741 (513h34m2.63191174s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.452793996 (513h34m2.635238995s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.552544726 (513h34m2.734989706s) [upload=451513]: Next returned nil segment
Feb 6 01:30:24.552559414 (513h34m2.735004384s) [upload=451513]: Waiting for error group managing segments...
Feb 6 01:30:24.561278120 (513h34m2.743723091s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.561679390 (513h34m2.74412437s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562015829 (513h34m2.744460829s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562532243 (513h34m2.744977233s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562752153 (513h34m2.745197154s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563447382 (513h34m2.745892382s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563584749 (513h34m2.74602975s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.564182115 (513h34m2.746627125s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.566364202 (513h34m2.748809192s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.595247277 (513h34m2.777692287s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.604524598 (513h34m2.786969578s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:54.395745250 (513h34m32.57819027s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: read tcp 5.161.89.252:51992->77.90.31.11:4555: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.395849825 (513h34m32.578294835s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: read tcp 5.161.89.252:21936->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396069005 (513h34m32.578514015s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:9486->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396234965 (513h34m32.578679975s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:24396->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396285850 (513h34m32.578730849s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: read tcp 5.161.89.252:36106->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396330484 (513h34m32.578775493s) [seg_pos={0 0}, upload=451513]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Feb 6 01:30:54.411835949 (513h34m32.594280949s) [upload=451513]: Done uploading segments...
Feb 6 01:30:54.411862379 (513h34m32.594307378s) [upload=451513]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 456.256465ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
444.151161ms trace:
https://jaeger.dev.storj.io/trace/14ab9a15cfb4b1db
FAIL (2026-02-06 01:51:45 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Feb 6 01:30:24.409352463 (513h34m2.591797474s) [upload=451513]: Starting upload
Feb 6 01:30:24.409416172 (513h34m2.591861172s) [upload=451513]: Done starting upload
Feb 6 01:30:24.409489941 (513h34m2.59193494s) [upload=451513]: Uploading segments...
Feb 6 01:30:24.409812984 (513h34m2.592257984s) [upload=451513]: Got next segment. Inline: false
Feb 6 01:30:24.409855192 (513h34m2.592300192s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 6 01:30:24.409860782 (513h34m2.592305783s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 6 01:30:24.431132711 (513h34m2.613577711s) [seg_pos={0 0}, upload=451513]: Begin upload segment...
Feb 6 01:30:24.431179047 (513h34m2.613624047s) [seg_pos={0 0}, upload=451513]: Done begin upload segment.
Feb 6 01:30:24.431213932 (513h34m2.613658932s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431248958 (513h34m2.613693958s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431960537 (513h34m2.614405538s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.432469217 (513h34m2.614914217s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433082974 (513h34m2.615527974s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433533606 (513h34m2.615978606s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433968238 (513h34m2.616413238s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434385187 (513h34m2.616830187s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434866285 (513h34m2.617311285s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.436773027 (513h34m2.619218027s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.437309239 (513h34m2.619754238s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.439077833 (513h34m2.621522843s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.441279355 (513h34m2.623724355s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.443697523 (513h34m2.626142532s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.449466741 (513h34m2.63191174s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.452793996 (513h34m2.635238995s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.552544726 (513h34m2.734989706s) [upload=451513]: Next returned nil segment
Feb 6 01:30:24.552559414 (513h34m2.735004384s) [upload=451513]: Waiting for error group managing segments...
Feb 6 01:30:24.561278120 (513h34m2.743723091s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.561679390 (513h34m2.74412437s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562015829 (513h34m2.744460829s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562532243 (513h34m2.744977233s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562752153 (513h34m2.745197154s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563447382 (513h34m2.745892382s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563584749 (513h34m2.74602975s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.564182115 (513h34m2.746627125s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.566364202 (513h34m2.748809192s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.595247277 (513h34m2.777692287s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.604524598 (513h34m2.786969578s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:54.395745250 (513h34m32.57819027s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: read tcp 5.161.89.252:51992->77.90.31.11:4555: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.395849825 (513h34m32.578294835s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: read tcp 5.161.89.252:21936->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396069005 (513h34m32.578514015s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:9486->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396234965 (513h34m32.578679975s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:24396->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396285850 (513h34m32.578730849s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: read tcp 5.161.89.252:36106->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396330484 (513h34m32.578775493s) [seg_pos={0 0}, upload=451513]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Feb 6 01:30:54.411835949 (513h34m32.594280949s) [upload=451513]: Done uploading segments...
Feb 6 01:30:54.411862379 (513h34m32.594307378s) [upload=451513]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 444.174145ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
393.717969ms trace:
https://jaeger.dev.storj.io/trace/14ab9a15cfb4b1db
FAIL (2026-02-06 01:51:02 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Feb 6 01:30:24.409352463 (513h34m2.591797474s) [upload=451513]: Starting upload
Feb 6 01:30:24.409416172 (513h34m2.591861172s) [upload=451513]: Done starting upload
Feb 6 01:30:24.409489941 (513h34m2.59193494s) [upload=451513]: Uploading segments...
Feb 6 01:30:24.409812984 (513h34m2.592257984s) [upload=451513]: Got next segment. Inline: false
Feb 6 01:30:24.409855192 (513h34m2.592300192s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 6 01:30:24.409860782 (513h34m2.592305783s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 6 01:30:24.431132711 (513h34m2.613577711s) [seg_pos={0 0}, upload=451513]: Begin upload segment...
Feb 6 01:30:24.431179047 (513h34m2.613624047s) [seg_pos={0 0}, upload=451513]: Done begin upload segment.
Feb 6 01:30:24.431213932 (513h34m2.613658932s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431248958 (513h34m2.613693958s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431960537 (513h34m2.614405538s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.432469217 (513h34m2.614914217s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433082974 (513h34m2.615527974s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433533606 (513h34m2.615978606s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433968238 (513h34m2.616413238s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434385187 (513h34m2.616830187s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434866285 (513h34m2.617311285s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.436773027 (513h34m2.619218027s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.437309239 (513h34m2.619754238s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.439077833 (513h34m2.621522843s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.441279355 (513h34m2.623724355s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.443697523 (513h34m2.626142532s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.449466741 (513h34m2.63191174s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.452793996 (513h34m2.635238995s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.552544726 (513h34m2.734989706s) [upload=451513]: Next returned nil segment
Feb 6 01:30:24.552559414 (513h34m2.735004384s) [upload=451513]: Waiting for error group managing segments...
Feb 6 01:30:24.561278120 (513h34m2.743723091s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.561679390 (513h34m2.74412437s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562015829 (513h34m2.744460829s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562532243 (513h34m2.744977233s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562752153 (513h34m2.745197154s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563447382 (513h34m2.745892382s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563584749 (513h34m2.74602975s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.564182115 (513h34m2.746627125s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.566364202 (513h34m2.748809192s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.595247277 (513h34m2.777692287s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.604524598 (513h34m2.786969578s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:54.395745250 (513h34m32.57819027s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: read tcp 5.161.89.252:51992->77.90.31.11:4555: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.395849825 (513h34m32.578294835s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: read tcp 5.161.89.252:21936->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396069005 (513h34m32.578514015s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:9486->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396234965 (513h34m32.578679975s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:24396->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396285850 (513h34m32.578730849s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: read tcp 5.161.89.252:36106->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396330484 (513h34m32.578775493s) [seg_pos={0 0}, upload=451513]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Feb 6 01:30:54.411835949 (513h34m32.594280949s) [upload=451513]: Done uploading segments...
Feb 6 01:30:54.411862379 (513h34m32.594307378s) [upload=451513]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 393.740992ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
424.618834ms trace:
https://jaeger.dev.storj.io/trace/14ab9a15cfb4b1db
FAIL (2026-02-06 01:50:23 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Feb 6 01:30:24.409352463 (513h34m2.591797474s) [upload=451513]: Starting upload
Feb 6 01:30:24.409416172 (513h34m2.591861172s) [upload=451513]: Done starting upload
Feb 6 01:30:24.409489941 (513h34m2.59193494s) [upload=451513]: Uploading segments...
Feb 6 01:30:24.409812984 (513h34m2.592257984s) [upload=451513]: Got next segment. Inline: false
Feb 6 01:30:24.409855192 (513h34m2.592300192s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 6 01:30:24.409860782 (513h34m2.592305783s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 6 01:30:24.431132711 (513h34m2.613577711s) [seg_pos={0 0}, upload=451513]: Begin upload segment...
Feb 6 01:30:24.431179047 (513h34m2.613624047s) [seg_pos={0 0}, upload=451513]: Done begin upload segment.
Feb 6 01:30:24.431213932 (513h34m2.613658932s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431248958 (513h34m2.613693958s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431960537 (513h34m2.614405538s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.432469217 (513h34m2.614914217s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433082974 (513h34m2.615527974s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433533606 (513h34m2.615978606s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433968238 (513h34m2.616413238s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434385187 (513h34m2.616830187s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434866285 (513h34m2.617311285s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.436773027 (513h34m2.619218027s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.437309239 (513h34m2.619754238s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.439077833 (513h34m2.621522843s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.441279355 (513h34m2.623724355s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.443697523 (513h34m2.626142532s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.449466741 (513h34m2.63191174s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.452793996 (513h34m2.635238995s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.552544726 (513h34m2.734989706s) [upload=451513]: Next returned nil segment
Feb 6 01:30:24.552559414 (513h34m2.735004384s) [upload=451513]: Waiting for error group managing segments...
Feb 6 01:30:24.561278120 (513h34m2.743723091s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.561679390 (513h34m2.74412437s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562015829 (513h34m2.744460829s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562532243 (513h34m2.744977233s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562752153 (513h34m2.745197154s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563447382 (513h34m2.745892382s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563584749 (513h34m2.74602975s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.564182115 (513h34m2.746627125s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.566364202 (513h34m2.748809192s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.595247277 (513h34m2.777692287s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.604524598 (513h34m2.786969578s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:54.395745250 (513h34m32.57819027s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: read tcp 5.161.89.252:51992->77.90.31.11:4555: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.395849825 (513h34m32.578294835s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: read tcp 5.161.89.252:21936->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396069005 (513h34m32.578514015s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:9486->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396234965 (513h34m32.578679975s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:24396->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396285850 (513h34m32.578730849s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: read tcp 5.161.89.252:36106->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396330484 (513h34m32.578775493s) [seg_pos={0 0}, upload=451513]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Feb 6 01:30:54.411835949 (513h34m32.594280949s) [upload=451513]: Done uploading segments...
Feb 6 01:30:54.411862379 (513h34m32.594307378s) [upload=451513]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 424.633812ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
419.923585ms trace:
https://jaeger.dev.storj.io/trace/14ab9a15cfb4b1db
FAIL (2026-02-06 01:49:26 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Feb 6 01:30:24.409352463 (513h34m2.591797474s) [upload=451513]: Starting upload
Feb 6 01:30:24.409416172 (513h34m2.591861172s) [upload=451513]: Done starting upload
Feb 6 01:30:24.409489941 (513h34m2.59193494s) [upload=451513]: Uploading segments...
Feb 6 01:30:24.409812984 (513h34m2.592257984s) [upload=451513]: Got next segment. Inline: false
Feb 6 01:30:24.409855192 (513h34m2.592300192s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 6 01:30:24.409860782 (513h34m2.592305783s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 6 01:30:24.431132711 (513h34m2.613577711s) [seg_pos={0 0}, upload=451513]: Begin upload segment...
Feb 6 01:30:24.431179047 (513h34m2.613624047s) [seg_pos={0 0}, upload=451513]: Done begin upload segment.
Feb 6 01:30:24.431213932 (513h34m2.613658932s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431248958 (513h34m2.613693958s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431960537 (513h34m2.614405538s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.432469217 (513h34m2.614914217s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433082974 (513h34m2.615527974s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433533606 (513h34m2.615978606s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433968238 (513h34m2.616413238s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434385187 (513h34m2.616830187s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434866285 (513h34m2.617311285s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.436773027 (513h34m2.619218027s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.437309239 (513h34m2.619754238s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.439077833 (513h34m2.621522843s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.441279355 (513h34m2.623724355s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.443697523 (513h34m2.626142532s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.449466741 (513h34m2.63191174s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.452793996 (513h34m2.635238995s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.552544726 (513h34m2.734989706s) [upload=451513]: Next returned nil segment
Feb 6 01:30:24.552559414 (513h34m2.735004384s) [upload=451513]: Waiting for error group managing segments...
Feb 6 01:30:24.561278120 (513h34m2.743723091s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.561679390 (513h34m2.74412437s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562015829 (513h34m2.744460829s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562532243 (513h34m2.744977233s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562752153 (513h34m2.745197154s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563447382 (513h34m2.745892382s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563584749 (513h34m2.74602975s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.564182115 (513h34m2.746627125s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.566364202 (513h34m2.748809192s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.595247277 (513h34m2.777692287s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.604524598 (513h34m2.786969578s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:54.395745250 (513h34m32.57819027s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: read tcp 5.161.89.252:51992->77.90.31.11:4555: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.395849825 (513h34m32.578294835s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: read tcp 5.161.89.252:21936->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396069005 (513h34m32.578514015s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:9486->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396234965 (513h34m32.578679975s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:24396->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396285850 (513h34m32.578730849s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: read tcp 5.161.89.252:36106->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396330484 (513h34m32.578775493s) [seg_pos={0 0}, upload=451513]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Feb 6 01:30:54.411835949 (513h34m32.594280949s) [upload=451513]: Done uploading segments...
Feb 6 01:30:54.411862379 (513h34m32.594307378s) [upload=451513]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 419.945015ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
423.36415ms trace:
https://jaeger.dev.storj.io/trace/14ab9a15cfb4b1db
FAIL (2026-02-06 01:48:30 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Feb 6 01:30:24.409352463 (513h34m2.591797474s) [upload=451513]: Starting upload
Feb 6 01:30:24.409416172 (513h34m2.591861172s) [upload=451513]: Done starting upload
Feb 6 01:30:24.409489941 (513h34m2.59193494s) [upload=451513]: Uploading segments...
Feb 6 01:30:24.409812984 (513h34m2.592257984s) [upload=451513]: Got next segment. Inline: false
Feb 6 01:30:24.409855192 (513h34m2.592300192s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 6 01:30:24.409860782 (513h34m2.592305783s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 6 01:30:24.431132711 (513h34m2.613577711s) [seg_pos={0 0}, upload=451513]: Begin upload segment...
Feb 6 01:30:24.431179047 (513h34m2.613624047s) [seg_pos={0 0}, upload=451513]: Done begin upload segment.
Feb 6 01:30:24.431213932 (513h34m2.613658932s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431248958 (513h34m2.613693958s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431960537 (513h34m2.614405538s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.432469217 (513h34m2.614914217s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433082974 (513h34m2.615527974s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433533606 (513h34m2.615978606s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433968238 (513h34m2.616413238s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434385187 (513h34m2.616830187s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434866285 (513h34m2.617311285s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.436773027 (513h34m2.619218027s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.437309239 (513h34m2.619754238s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.439077833 (513h34m2.621522843s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.441279355 (513h34m2.623724355s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.443697523 (513h34m2.626142532s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.449466741 (513h34m2.63191174s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.452793996 (513h34m2.635238995s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.552544726 (513h34m2.734989706s) [upload=451513]: Next returned nil segment
Feb 6 01:30:24.552559414 (513h34m2.735004384s) [upload=451513]: Waiting for error group managing segments...
Feb 6 01:30:24.561278120 (513h34m2.743723091s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.561679390 (513h34m2.74412437s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562015829 (513h34m2.744460829s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562532243 (513h34m2.744977233s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562752153 (513h34m2.745197154s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563447382 (513h34m2.745892382s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563584749 (513h34m2.74602975s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.564182115 (513h34m2.746627125s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.566364202 (513h34m2.748809192s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.595247277 (513h34m2.777692287s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.604524598 (513h34m2.786969578s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:54.395745250 (513h34m32.57819027s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: read tcp 5.161.89.252:51992->77.90.31.11:4555: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.395849825 (513h34m32.578294835s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: read tcp 5.161.89.252:21936->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396069005 (513h34m32.578514015s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:9486->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396234965 (513h34m32.578679975s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:24396->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396285850 (513h34m32.578730849s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: read tcp 5.161.89.252:36106->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396330484 (513h34m32.578775493s) [seg_pos={0 0}, upload=451513]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Feb 6 01:30:54.411835949 (513h34m32.594280949s) [upload=451513]: Done uploading segments...
Feb 6 01:30:54.411862379 (513h34m32.594307378s) [upload=451513]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 423.391983ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
439.934637ms trace:
https://jaeger.dev.storj.io/trace/14ab9a15cfb4b1db
FAIL (2026-02-06 01:47:19 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Feb 6 01:30:24.409352463 (513h34m2.591797474s) [upload=451513]: Starting upload
Feb 6 01:30:24.409416172 (513h34m2.591861172s) [upload=451513]: Done starting upload
Feb 6 01:30:24.409489941 (513h34m2.59193494s) [upload=451513]: Uploading segments...
Feb 6 01:30:24.409812984 (513h34m2.592257984s) [upload=451513]: Got next segment. Inline: false
Feb 6 01:30:24.409855192 (513h34m2.592300192s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 6 01:30:24.409860782 (513h34m2.592305783s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 6 01:30:24.431132711 (513h34m2.613577711s) [seg_pos={0 0}, upload=451513]: Begin upload segment...
Feb 6 01:30:24.431179047 (513h34m2.613624047s) [seg_pos={0 0}, upload=451513]: Done begin upload segment.
Feb 6 01:30:24.431213932 (513h34m2.613658932s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431248958 (513h34m2.613693958s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431960537 (513h34m2.614405538s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.432469217 (513h34m2.614914217s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433082974 (513h34m2.615527974s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433533606 (513h34m2.615978606s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433968238 (513h34m2.616413238s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434385187 (513h34m2.616830187s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434866285 (513h34m2.617311285s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.436773027 (513h34m2.619218027s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.437309239 (513h34m2.619754238s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.439077833 (513h34m2.621522843s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.441279355 (513h34m2.623724355s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.443697523 (513h34m2.626142532s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.449466741 (513h34m2.63191174s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.452793996 (513h34m2.635238995s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.552544726 (513h34m2.734989706s) [upload=451513]: Next returned nil segment
Feb 6 01:30:24.552559414 (513h34m2.735004384s) [upload=451513]: Waiting for error group managing segments...
Feb 6 01:30:24.561278120 (513h34m2.743723091s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.561679390 (513h34m2.74412437s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562015829 (513h34m2.744460829s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562532243 (513h34m2.744977233s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562752153 (513h34m2.745197154s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563447382 (513h34m2.745892382s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563584749 (513h34m2.74602975s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.564182115 (513h34m2.746627125s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.566364202 (513h34m2.748809192s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.595247277 (513h34m2.777692287s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.604524598 (513h34m2.786969578s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:54.395745250 (513h34m32.57819027s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: read tcp 5.161.89.252:51992->77.90.31.11:4555: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.395849825 (513h34m32.578294835s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: read tcp 5.161.89.252:21936->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396069005 (513h34m32.578514015s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:9486->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396234965 (513h34m32.578679975s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:24396->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396285850 (513h34m32.578730849s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: read tcp 5.161.89.252:36106->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396330484 (513h34m32.578775493s) [seg_pos={0 0}, upload=451513]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Feb 6 01:30:54.411835949 (513h34m32.594280949s) [upload=451513]: Done uploading segments...
Feb 6 01:30:54.411862379 (513h34m32.594307378s) [upload=451513]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 439.955165ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
428.354483ms trace:
https://jaeger.dev.storj.io/trace/14ab9a15cfb4b1db
FAIL (2026-02-06 01:46:43 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Feb 6 01:30:24.409352463 (513h34m2.591797474s) [upload=451513]: Starting upload
Feb 6 01:30:24.409416172 (513h34m2.591861172s) [upload=451513]: Done starting upload
Feb 6 01:30:24.409489941 (513h34m2.59193494s) [upload=451513]: Uploading segments...
Feb 6 01:30:24.409812984 (513h34m2.592257984s) [upload=451513]: Got next segment. Inline: false
Feb 6 01:30:24.409855192 (513h34m2.592300192s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 6 01:30:24.409860782 (513h34m2.592305783s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 6 01:30:24.431132711 (513h34m2.613577711s) [seg_pos={0 0}, upload=451513]: Begin upload segment...
Feb 6 01:30:24.431179047 (513h34m2.613624047s) [seg_pos={0 0}, upload=451513]: Done begin upload segment.
Feb 6 01:30:24.431213932 (513h34m2.613658932s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431248958 (513h34m2.613693958s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431960537 (513h34m2.614405538s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.432469217 (513h34m2.614914217s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433082974 (513h34m2.615527974s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433533606 (513h34m2.615978606s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433968238 (513h34m2.616413238s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434385187 (513h34m2.616830187s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434866285 (513h34m2.617311285s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.436773027 (513h34m2.619218027s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.437309239 (513h34m2.619754238s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.439077833 (513h34m2.621522843s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.441279355 (513h34m2.623724355s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.443697523 (513h34m2.626142532s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.449466741 (513h34m2.63191174s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.452793996 (513h34m2.635238995s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.552544726 (513h34m2.734989706s) [upload=451513]: Next returned nil segment
Feb 6 01:30:24.552559414 (513h34m2.735004384s) [upload=451513]: Waiting for error group managing segments...
Feb 6 01:30:24.561278120 (513h34m2.743723091s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.561679390 (513h34m2.74412437s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562015829 (513h34m2.744460829s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562532243 (513h34m2.744977233s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562752153 (513h34m2.745197154s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563447382 (513h34m2.745892382s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563584749 (513h34m2.74602975s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.564182115 (513h34m2.746627125s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.566364202 (513h34m2.748809192s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.595247277 (513h34m2.777692287s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.604524598 (513h34m2.786969578s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:54.395745250 (513h34m32.57819027s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: read tcp 5.161.89.252:51992->77.90.31.11:4555: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.395849825 (513h34m32.578294835s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: read tcp 5.161.89.252:21936->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396069005 (513h34m32.578514015s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:9486->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396234965 (513h34m32.578679975s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:24396->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396285850 (513h34m32.578730849s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: read tcp 5.161.89.252:36106->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396330484 (513h34m32.578775493s) [seg_pos={0 0}, upload=451513]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Feb 6 01:30:54.411835949 (513h34m32.594280949s) [upload=451513]: Done uploading segments...
Feb 6 01:30:54.411862379 (513h34m32.594307378s) [upload=451513]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 428.374089ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
468.25566ms trace:
https://jaeger.dev.storj.io/trace/14ab9a15cfb4b1db
FAIL (2026-02-06 01:46:21 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Feb 6 01:30:24.409352463 (513h34m2.591797474s) [upload=451513]: Starting upload
Feb 6 01:30:24.409416172 (513h34m2.591861172s) [upload=451513]: Done starting upload
Feb 6 01:30:24.409489941 (513h34m2.59193494s) [upload=451513]: Uploading segments...
Feb 6 01:30:24.409812984 (513h34m2.592257984s) [upload=451513]: Got next segment. Inline: false
Feb 6 01:30:24.409855192 (513h34m2.592300192s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 6 01:30:24.409860782 (513h34m2.592305783s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 6 01:30:24.431132711 (513h34m2.613577711s) [seg_pos={0 0}, upload=451513]: Begin upload segment...
Feb 6 01:30:24.431179047 (513h34m2.613624047s) [seg_pos={0 0}, upload=451513]: Done begin upload segment.
Feb 6 01:30:24.431213932 (513h34m2.613658932s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431248958 (513h34m2.613693958s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431960537 (513h34m2.614405538s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.432469217 (513h34m2.614914217s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433082974 (513h34m2.615527974s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433533606 (513h34m2.615978606s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433968238 (513h34m2.616413238s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434385187 (513h34m2.616830187s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434866285 (513h34m2.617311285s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.436773027 (513h34m2.619218027s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.437309239 (513h34m2.619754238s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.439077833 (513h34m2.621522843s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.441279355 (513h34m2.623724355s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.443697523 (513h34m2.626142532s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.449466741 (513h34m2.63191174s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.452793996 (513h34m2.635238995s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.552544726 (513h34m2.734989706s) [upload=451513]: Next returned nil segment
Feb 6 01:30:24.552559414 (513h34m2.735004384s) [upload=451513]: Waiting for error group managing segments...
Feb 6 01:30:24.561278120 (513h34m2.743723091s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.561679390 (513h34m2.74412437s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562015829 (513h34m2.744460829s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562532243 (513h34m2.744977233s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562752153 (513h34m2.745197154s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563447382 (513h34m2.745892382s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563584749 (513h34m2.74602975s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.564182115 (513h34m2.746627125s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.566364202 (513h34m2.748809192s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.595247277 (513h34m2.777692287s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.604524598 (513h34m2.786969578s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:54.395745250 (513h34m32.57819027s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: read tcp 5.161.89.252:51992->77.90.31.11:4555: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.395849825 (513h34m32.578294835s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: read tcp 5.161.89.252:21936->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396069005 (513h34m32.578514015s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:9486->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396234965 (513h34m32.578679975s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:24396->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396285850 (513h34m32.578730849s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: read tcp 5.161.89.252:36106->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396330484 (513h34m32.578775493s) [seg_pos={0 0}, upload=451513]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Feb 6 01:30:54.411835949 (513h34m32.594280949s) [upload=451513]: Done uploading segments...
Feb 6 01:30:54.411862379 (513h34m32.594307378s) [upload=451513]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 468.275898ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
467.957384ms trace:
https://jaeger.dev.storj.io/trace/14ab9a15cfb4b1db
FAIL (2026-02-06 01:45:39 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Feb 6 01:30:24.409352463 (513h34m2.591797474s) [upload=451513]: Starting upload
Feb 6 01:30:24.409416172 (513h34m2.591861172s) [upload=451513]: Done starting upload
Feb 6 01:30:24.409489941 (513h34m2.59193494s) [upload=451513]: Uploading segments...
Feb 6 01:30:24.409812984 (513h34m2.592257984s) [upload=451513]: Got next segment. Inline: false
Feb 6 01:30:24.409855192 (513h34m2.592300192s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 6 01:30:24.409860782 (513h34m2.592305783s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 6 01:30:24.431132711 (513h34m2.613577711s) [seg_pos={0 0}, upload=451513]: Begin upload segment...
Feb 6 01:30:24.431179047 (513h34m2.613624047s) [seg_pos={0 0}, upload=451513]: Done begin upload segment.
Feb 6 01:30:24.431213932 (513h34m2.613658932s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431248958 (513h34m2.613693958s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431960537 (513h34m2.614405538s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.432469217 (513h34m2.614914217s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433082974 (513h34m2.615527974s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433533606 (513h34m2.615978606s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433968238 (513h34m2.616413238s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434385187 (513h34m2.616830187s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434866285 (513h34m2.617311285s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.436773027 (513h34m2.619218027s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.437309239 (513h34m2.619754238s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.439077833 (513h34m2.621522843s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.441279355 (513h34m2.623724355s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.443697523 (513h34m2.626142532s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.449466741 (513h34m2.63191174s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.452793996 (513h34m2.635238995s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.552544726 (513h34m2.734989706s) [upload=451513]: Next returned nil segment
Feb 6 01:30:24.552559414 (513h34m2.735004384s) [upload=451513]: Waiting for error group managing segments...
Feb 6 01:30:24.561278120 (513h34m2.743723091s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.561679390 (513h34m2.74412437s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562015829 (513h34m2.744460829s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562532243 (513h34m2.744977233s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562752153 (513h34m2.745197154s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563447382 (513h34m2.745892382s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563584749 (513h34m2.74602975s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.564182115 (513h34m2.746627125s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.566364202 (513h34m2.748809192s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.595247277 (513h34m2.777692287s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.604524598 (513h34m2.786969578s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:54.395745250 (513h34m32.57819027s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: read tcp 5.161.89.252:51992->77.90.31.11:4555: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.395849825 (513h34m32.578294835s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: read tcp 5.161.89.252:21936->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396069005 (513h34m32.578514015s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:9486->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396234965 (513h34m32.578679975s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:24396->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396285850 (513h34m32.578730849s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: read tcp 5.161.89.252:36106->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396330484 (513h34m32.578775493s) [seg_pos={0 0}, upload=451513]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Feb 6 01:30:54.411835949 (513h34m32.594280949s) [upload=451513]: Done uploading segments...
Feb 6 01:30:54.411862379 (513h34m32.594307378s) [upload=451513]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 467.982992ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
418.765951ms trace:
https://jaeger.dev.storj.io/trace/14ab9a15cfb4b1db
FAIL (2026-02-06 01:45:16 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Feb 6 01:30:24.409352463 (513h34m2.591797474s) [upload=451513]: Starting upload
Feb 6 01:30:24.409416172 (513h34m2.591861172s) [upload=451513]: Done starting upload
Feb 6 01:30:24.409489941 (513h34m2.59193494s) [upload=451513]: Uploading segments...
Feb 6 01:30:24.409812984 (513h34m2.592257984s) [upload=451513]: Got next segment. Inline: false
Feb 6 01:30:24.409855192 (513h34m2.592300192s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 6 01:30:24.409860782 (513h34m2.592305783s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 6 01:30:24.431132711 (513h34m2.613577711s) [seg_pos={0 0}, upload=451513]: Begin upload segment...
Feb 6 01:30:24.431179047 (513h34m2.613624047s) [seg_pos={0 0}, upload=451513]: Done begin upload segment.
Feb 6 01:30:24.431213932 (513h34m2.613658932s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431248958 (513h34m2.613693958s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431960537 (513h34m2.614405538s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.432469217 (513h34m2.614914217s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433082974 (513h34m2.615527974s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433533606 (513h34m2.615978606s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433968238 (513h34m2.616413238s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434385187 (513h34m2.616830187s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434866285 (513h34m2.617311285s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.436773027 (513h34m2.619218027s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.437309239 (513h34m2.619754238s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.439077833 (513h34m2.621522843s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.441279355 (513h34m2.623724355s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.443697523 (513h34m2.626142532s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.449466741 (513h34m2.63191174s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.452793996 (513h34m2.635238995s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.552544726 (513h34m2.734989706s) [upload=451513]: Next returned nil segment
Feb 6 01:30:24.552559414 (513h34m2.735004384s) [upload=451513]: Waiting for error group managing segments...
Feb 6 01:30:24.561278120 (513h34m2.743723091s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.561679390 (513h34m2.74412437s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562015829 (513h34m2.744460829s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562532243 (513h34m2.744977233s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562752153 (513h34m2.745197154s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563447382 (513h34m2.745892382s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563584749 (513h34m2.74602975s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.564182115 (513h34m2.746627125s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.566364202 (513h34m2.748809192s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.595247277 (513h34m2.777692287s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.604524598 (513h34m2.786969578s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:54.395745250 (513h34m32.57819027s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: read tcp 5.161.89.252:51992->77.90.31.11:4555: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.395849825 (513h34m32.578294835s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: read tcp 5.161.89.252:21936->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396069005 (513h34m32.578514015s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:9486->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396234965 (513h34m32.578679975s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:24396->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396285850 (513h34m32.578730849s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: read tcp 5.161.89.252:36106->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396330484 (513h34m32.578775493s) [seg_pos={0 0}, upload=451513]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Feb 6 01:30:54.411835949 (513h34m32.594280949s) [upload=451513]: Done uploading segments...
Feb 6 01:30:54.411862379 (513h34m32.594307378s) [upload=451513]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 418.786409ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
452.17893ms trace:
https://jaeger.dev.storj.io/trace/14ab9a15cfb4b1db
FAIL (2026-02-06 01:44:04 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Feb 6 01:30:24.409352463 (513h34m2.591797474s) [upload=451513]: Starting upload
Feb 6 01:30:24.409416172 (513h34m2.591861172s) [upload=451513]: Done starting upload
Feb 6 01:30:24.409489941 (513h34m2.59193494s) [upload=451513]: Uploading segments...
Feb 6 01:30:24.409812984 (513h34m2.592257984s) [upload=451513]: Got next segment. Inline: false
Feb 6 01:30:24.409855192 (513h34m2.592300192s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 6 01:30:24.409860782 (513h34m2.592305783s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 6 01:30:24.431132711 (513h34m2.613577711s) [seg_pos={0 0}, upload=451513]: Begin upload segment...
Feb 6 01:30:24.431179047 (513h34m2.613624047s) [seg_pos={0 0}, upload=451513]: Done begin upload segment.
Feb 6 01:30:24.431213932 (513h34m2.613658932s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431248958 (513h34m2.613693958s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431960537 (513h34m2.614405538s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.432469217 (513h34m2.614914217s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433082974 (513h34m2.615527974s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433533606 (513h34m2.615978606s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433968238 (513h34m2.616413238s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434385187 (513h34m2.616830187s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434866285 (513h34m2.617311285s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.436773027 (513h34m2.619218027s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.437309239 (513h34m2.619754238s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.439077833 (513h34m2.621522843s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.441279355 (513h34m2.623724355s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.443697523 (513h34m2.626142532s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.449466741 (513h34m2.63191174s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.452793996 (513h34m2.635238995s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.552544726 (513h34m2.734989706s) [upload=451513]: Next returned nil segment
Feb 6 01:30:24.552559414 (513h34m2.735004384s) [upload=451513]: Waiting for error group managing segments...
Feb 6 01:30:24.561278120 (513h34m2.743723091s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.561679390 (513h34m2.74412437s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562015829 (513h34m2.744460829s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562532243 (513h34m2.744977233s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562752153 (513h34m2.745197154s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563447382 (513h34m2.745892382s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563584749 (513h34m2.74602975s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.564182115 (513h34m2.746627125s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.566364202 (513h34m2.748809192s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.595247277 (513h34m2.777692287s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.604524598 (513h34m2.786969578s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:54.395745250 (513h34m32.57819027s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: read tcp 5.161.89.252:51992->77.90.31.11:4555: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.395849825 (513h34m32.578294835s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: read tcp 5.161.89.252:21936->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396069005 (513h34m32.578514015s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:9486->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396234965 (513h34m32.578679975s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:24396->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396285850 (513h34m32.578730849s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: read tcp 5.161.89.252:36106->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396330484 (513h34m32.578775493s) [seg_pos={0 0}, upload=451513]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Feb 6 01:30:54.411835949 (513h34m32.594280949s) [upload=451513]: Done uploading segments...
Feb 6 01:30:54.411862379 (513h34m32.594307378s) [upload=451513]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 452.200117ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
440.966804ms trace:
https://jaeger.dev.storj.io/trace/14ab9a15cfb4b1db
FAIL (2026-02-06 01:43:03 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Feb 6 01:30:24.409352463 (513h34m2.591797474s) [upload=451513]: Starting upload
Feb 6 01:30:24.409416172 (513h34m2.591861172s) [upload=451513]: Done starting upload
Feb 6 01:30:24.409489941 (513h34m2.59193494s) [upload=451513]: Uploading segments...
Feb 6 01:30:24.409812984 (513h34m2.592257984s) [upload=451513]: Got next segment. Inline: false
Feb 6 01:30:24.409855192 (513h34m2.592300192s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 6 01:30:24.409860782 (513h34m2.592305783s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 6 01:30:24.431132711 (513h34m2.613577711s) [seg_pos={0 0}, upload=451513]: Begin upload segment...
Feb 6 01:30:24.431179047 (513h34m2.613624047s) [seg_pos={0 0}, upload=451513]: Done begin upload segment.
Feb 6 01:30:24.431213932 (513h34m2.613658932s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431248958 (513h34m2.613693958s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431960537 (513h34m2.614405538s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.432469217 (513h34m2.614914217s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433082974 (513h34m2.615527974s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433533606 (513h34m2.615978606s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433968238 (513h34m2.616413238s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434385187 (513h34m2.616830187s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434866285 (513h34m2.617311285s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.436773027 (513h34m2.619218027s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.437309239 (513h34m2.619754238s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.439077833 (513h34m2.621522843s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.441279355 (513h34m2.623724355s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.443697523 (513h34m2.626142532s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.449466741 (513h34m2.63191174s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.452793996 (513h34m2.635238995s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.552544726 (513h34m2.734989706s) [upload=451513]: Next returned nil segment
Feb 6 01:30:24.552559414 (513h34m2.735004384s) [upload=451513]: Waiting for error group managing segments...
Feb 6 01:30:24.561278120 (513h34m2.743723091s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.561679390 (513h34m2.74412437s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562015829 (513h34m2.744460829s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562532243 (513h34m2.744977233s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562752153 (513h34m2.745197154s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563447382 (513h34m2.745892382s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563584749 (513h34m2.74602975s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.564182115 (513h34m2.746627125s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.566364202 (513h34m2.748809192s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.595247277 (513h34m2.777692287s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.604524598 (513h34m2.786969578s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:54.395745250 (513h34m32.57819027s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: read tcp 5.161.89.252:51992->77.90.31.11:4555: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.395849825 (513h34m32.578294835s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: read tcp 5.161.89.252:21936->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396069005 (513h34m32.578514015s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:9486->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396234965 (513h34m32.578679975s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:24396->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396285850 (513h34m32.578730849s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: read tcp 5.161.89.252:36106->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396330484 (513h34m32.578775493s) [seg_pos={0 0}, upload=451513]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Feb 6 01:30:54.411835949 (513h34m32.594280949s) [upload=451513]: Done uploading segments...
Feb 6 01:30:54.411862379 (513h34m32.594307378s) [upload=451513]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 440.989076ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
448.361567ms trace:
https://jaeger.dev.storj.io/trace/14ab9a15cfb4b1db
FAIL (2026-02-06 01:42:07 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Feb 6 01:30:24.409352463 (513h34m2.591797474s) [upload=451513]: Starting upload
Feb 6 01:30:24.409416172 (513h34m2.591861172s) [upload=451513]: Done starting upload
Feb 6 01:30:24.409489941 (513h34m2.59193494s) [upload=451513]: Uploading segments...
Feb 6 01:30:24.409812984 (513h34m2.592257984s) [upload=451513]: Got next segment. Inline: false
Feb 6 01:30:24.409855192 (513h34m2.592300192s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 6 01:30:24.409860782 (513h34m2.592305783s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 6 01:30:24.431132711 (513h34m2.613577711s) [seg_pos={0 0}, upload=451513]: Begin upload segment...
Feb 6 01:30:24.431179047 (513h34m2.613624047s) [seg_pos={0 0}, upload=451513]: Done begin upload segment.
Feb 6 01:30:24.431213932 (513h34m2.613658932s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431248958 (513h34m2.613693958s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431960537 (513h34m2.614405538s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.432469217 (513h34m2.614914217s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433082974 (513h34m2.615527974s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433533606 (513h34m2.615978606s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433968238 (513h34m2.616413238s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434385187 (513h34m2.616830187s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434866285 (513h34m2.617311285s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.436773027 (513h34m2.619218027s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.437309239 (513h34m2.619754238s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.439077833 (513h34m2.621522843s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.441279355 (513h34m2.623724355s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.443697523 (513h34m2.626142532s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.449466741 (513h34m2.63191174s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.452793996 (513h34m2.635238995s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.552544726 (513h34m2.734989706s) [upload=451513]: Next returned nil segment
Feb 6 01:30:24.552559414 (513h34m2.735004384s) [upload=451513]: Waiting for error group managing segments...
Feb 6 01:30:24.561278120 (513h34m2.743723091s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.561679390 (513h34m2.74412437s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562015829 (513h34m2.744460829s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562532243 (513h34m2.744977233s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562752153 (513h34m2.745197154s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563447382 (513h34m2.745892382s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563584749 (513h34m2.74602975s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.564182115 (513h34m2.746627125s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.566364202 (513h34m2.748809192s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.595247277 (513h34m2.777692287s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.604524598 (513h34m2.786969578s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:54.395745250 (513h34m32.57819027s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: read tcp 5.161.89.252:51992->77.90.31.11:4555: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.395849825 (513h34m32.578294835s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: read tcp 5.161.89.252:21936->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396069005 (513h34m32.578514015s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:9486->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396234965 (513h34m32.578679975s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:24396->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396285850 (513h34m32.578730849s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: read tcp 5.161.89.252:36106->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396330484 (513h34m32.578775493s) [seg_pos={0 0}, upload=451513]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Feb 6 01:30:54.411835949 (513h34m32.594280949s) [upload=451513]: Done uploading segments...
Feb 6 01:30:54.411862379 (513h34m32.594307378s) [upload=451513]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 448.387437ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
405.15679ms trace:
https://jaeger.dev.storj.io/trace/14ab9a15cfb4b1db
FAIL (2026-02-06 01:41:29 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Feb 6 01:30:24.409352463 (513h34m2.591797474s) [upload=451513]: Starting upload
Feb 6 01:30:24.409416172 (513h34m2.591861172s) [upload=451513]: Done starting upload
Feb 6 01:30:24.409489941 (513h34m2.59193494s) [upload=451513]: Uploading segments...
Feb 6 01:30:24.409812984 (513h34m2.592257984s) [upload=451513]: Got next segment. Inline: false
Feb 6 01:30:24.409855192 (513h34m2.592300192s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 6 01:30:24.409860782 (513h34m2.592305783s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 6 01:30:24.431132711 (513h34m2.613577711s) [seg_pos={0 0}, upload=451513]: Begin upload segment...
Feb 6 01:30:24.431179047 (513h34m2.613624047s) [seg_pos={0 0}, upload=451513]: Done begin upload segment.
Feb 6 01:30:24.431213932 (513h34m2.613658932s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431248958 (513h34m2.613693958s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431960537 (513h34m2.614405538s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.432469217 (513h34m2.614914217s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433082974 (513h34m2.615527974s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433533606 (513h34m2.615978606s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433968238 (513h34m2.616413238s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434385187 (513h34m2.616830187s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434866285 (513h34m2.617311285s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.436773027 (513h34m2.619218027s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.437309239 (513h34m2.619754238s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.439077833 (513h34m2.621522843s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.441279355 (513h34m2.623724355s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.443697523 (513h34m2.626142532s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.449466741 (513h34m2.63191174s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.452793996 (513h34m2.635238995s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.552544726 (513h34m2.734989706s) [upload=451513]: Next returned nil segment
Feb 6 01:30:24.552559414 (513h34m2.735004384s) [upload=451513]: Waiting for error group managing segments...
Feb 6 01:30:24.561278120 (513h34m2.743723091s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.561679390 (513h34m2.74412437s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562015829 (513h34m2.744460829s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562532243 (513h34m2.744977233s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562752153 (513h34m2.745197154s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563447382 (513h34m2.745892382s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563584749 (513h34m2.74602975s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.564182115 (513h34m2.746627125s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.566364202 (513h34m2.748809192s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.595247277 (513h34m2.777692287s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.604524598 (513h34m2.786969578s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:54.395745250 (513h34m32.57819027s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: read tcp 5.161.89.252:51992->77.90.31.11:4555: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.395849825 (513h34m32.578294835s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: read tcp 5.161.89.252:21936->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396069005 (513h34m32.578514015s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:9486->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396234965 (513h34m32.578679975s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:24396->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396285850 (513h34m32.578730849s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: read tcp 5.161.89.252:36106->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396330484 (513h34m32.578775493s) [seg_pos={0 0}, upload=451513]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Feb 6 01:30:54.411835949 (513h34m32.594280949s) [upload=451513]: Done uploading segments...
Feb 6 01:30:54.411862379 (513h34m32.594307378s) [upload=451513]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 405.177048ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
443.039947ms trace:
https://jaeger.dev.storj.io/trace/14ab9a15cfb4b1db
FAIL (2026-02-06 01:40:56 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Feb 6 01:30:24.409352463 (513h34m2.591797474s) [upload=451513]: Starting upload
Feb 6 01:30:24.409416172 (513h34m2.591861172s) [upload=451513]: Done starting upload
Feb 6 01:30:24.409489941 (513h34m2.59193494s) [upload=451513]: Uploading segments...
Feb 6 01:30:24.409812984 (513h34m2.592257984s) [upload=451513]: Got next segment. Inline: false
Feb 6 01:30:24.409855192 (513h34m2.592300192s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 6 01:30:24.409860782 (513h34m2.592305783s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 6 01:30:24.431132711 (513h34m2.613577711s) [seg_pos={0 0}, upload=451513]: Begin upload segment...
Feb 6 01:30:24.431179047 (513h34m2.613624047s) [seg_pos={0 0}, upload=451513]: Done begin upload segment.
Feb 6 01:30:24.431213932 (513h34m2.613658932s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431248958 (513h34m2.613693958s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431960537 (513h34m2.614405538s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.432469217 (513h34m2.614914217s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433082974 (513h34m2.615527974s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433533606 (513h34m2.615978606s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433968238 (513h34m2.616413238s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434385187 (513h34m2.616830187s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434866285 (513h34m2.617311285s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.436773027 (513h34m2.619218027s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.437309239 (513h34m2.619754238s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.439077833 (513h34m2.621522843s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.441279355 (513h34m2.623724355s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.443697523 (513h34m2.626142532s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.449466741 (513h34m2.63191174s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.452793996 (513h34m2.635238995s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.552544726 (513h34m2.734989706s) [upload=451513]: Next returned nil segment
Feb 6 01:30:24.552559414 (513h34m2.735004384s) [upload=451513]: Waiting for error group managing segments...
Feb 6 01:30:24.561278120 (513h34m2.743723091s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.561679390 (513h34m2.74412437s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562015829 (513h34m2.744460829s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562532243 (513h34m2.744977233s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562752153 (513h34m2.745197154s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563447382 (513h34m2.745892382s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563584749 (513h34m2.74602975s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.564182115 (513h34m2.746627125s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.566364202 (513h34m2.748809192s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.595247277 (513h34m2.777692287s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.604524598 (513h34m2.786969578s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:54.395745250 (513h34m32.57819027s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: read tcp 5.161.89.252:51992->77.90.31.11:4555: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.395849825 (513h34m32.578294835s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: read tcp 5.161.89.252:21936->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396069005 (513h34m32.578514015s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:9486->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396234965 (513h34m32.578679975s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:24396->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396285850 (513h34m32.578730849s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: read tcp 5.161.89.252:36106->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396330484 (513h34m32.578775493s) [seg_pos={0 0}, upload=451513]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Feb 6 01:30:54.411835949 (513h34m32.594280949s) [upload=451513]: Done uploading segments...
Feb 6 01:30:54.411862379 (513h34m32.594307378s) [upload=451513]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 443.061668ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
482.771077ms trace:
https://jaeger.dev.storj.io/trace/14ab9a15cfb4b1db
FAIL (2026-02-06 01:40:37 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Feb 6 01:30:24.409352463 (513h34m2.591797474s) [upload=451513]: Starting upload
Feb 6 01:30:24.409416172 (513h34m2.591861172s) [upload=451513]: Done starting upload
Feb 6 01:30:24.409489941 (513h34m2.59193494s) [upload=451513]: Uploading segments...
Feb 6 01:30:24.409812984 (513h34m2.592257984s) [upload=451513]: Got next segment. Inline: false
Feb 6 01:30:24.409855192 (513h34m2.592300192s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 6 01:30:24.409860782 (513h34m2.592305783s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 6 01:30:24.431132711 (513h34m2.613577711s) [seg_pos={0 0}, upload=451513]: Begin upload segment...
Feb 6 01:30:24.431179047 (513h34m2.613624047s) [seg_pos={0 0}, upload=451513]: Done begin upload segment.
Feb 6 01:30:24.431213932 (513h34m2.613658932s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431248958 (513h34m2.613693958s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431960537 (513h34m2.614405538s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.432469217 (513h34m2.614914217s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433082974 (513h34m2.615527974s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433533606 (513h34m2.615978606s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433968238 (513h34m2.616413238s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434385187 (513h34m2.616830187s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434866285 (513h34m2.617311285s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.436773027 (513h34m2.619218027s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.437309239 (513h34m2.619754238s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.439077833 (513h34m2.621522843s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.441279355 (513h34m2.623724355s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.443697523 (513h34m2.626142532s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.449466741 (513h34m2.63191174s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.452793996 (513h34m2.635238995s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.552544726 (513h34m2.734989706s) [upload=451513]: Next returned nil segment
Feb 6 01:30:24.552559414 (513h34m2.735004384s) [upload=451513]: Waiting for error group managing segments...
Feb 6 01:30:24.561278120 (513h34m2.743723091s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.561679390 (513h34m2.74412437s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562015829 (513h34m2.744460829s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562532243 (513h34m2.744977233s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562752153 (513h34m2.745197154s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563447382 (513h34m2.745892382s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563584749 (513h34m2.74602975s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.564182115 (513h34m2.746627125s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.566364202 (513h34m2.748809192s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.595247277 (513h34m2.777692287s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.604524598 (513h34m2.786969578s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:54.395745250 (513h34m32.57819027s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: read tcp 5.161.89.252:51992->77.90.31.11:4555: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.395849825 (513h34m32.578294835s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: read tcp 5.161.89.252:21936->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396069005 (513h34m32.578514015s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:9486->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396234965 (513h34m32.578679975s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:24396->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396285850 (513h34m32.578730849s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: read tcp 5.161.89.252:36106->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396330484 (513h34m32.578775493s) [seg_pos={0 0}, upload=451513]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Feb 6 01:30:54.411835949 (513h34m32.594280949s) [upload=451513]: Done uploading segments...
Feb 6 01:30:54.411862379 (513h34m32.594307378s) [upload=451513]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 482.817813ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
475.827846ms trace:
https://jaeger.dev.storj.io/trace/14ab9a15cfb4b1db
FAIL (2026-02-06 01:39:44 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Feb 6 01:30:24.409352463 (513h34m2.591797474s) [upload=451513]: Starting upload
Feb 6 01:30:24.409416172 (513h34m2.591861172s) [upload=451513]: Done starting upload
Feb 6 01:30:24.409489941 (513h34m2.59193494s) [upload=451513]: Uploading segments...
Feb 6 01:30:24.409812984 (513h34m2.592257984s) [upload=451513]: Got next segment. Inline: false
Feb 6 01:30:24.409855192 (513h34m2.592300192s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 6 01:30:24.409860782 (513h34m2.592305783s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 6 01:30:24.431132711 (513h34m2.613577711s) [seg_pos={0 0}, upload=451513]: Begin upload segment...
Feb 6 01:30:24.431179047 (513h34m2.613624047s) [seg_pos={0 0}, upload=451513]: Done begin upload segment.
Feb 6 01:30:24.431213932 (513h34m2.613658932s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431248958 (513h34m2.613693958s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431960537 (513h34m2.614405538s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.432469217 (513h34m2.614914217s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433082974 (513h34m2.615527974s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433533606 (513h34m2.615978606s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433968238 (513h34m2.616413238s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434385187 (513h34m2.616830187s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434866285 (513h34m2.617311285s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.436773027 (513h34m2.619218027s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.437309239 (513h34m2.619754238s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.439077833 (513h34m2.621522843s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.441279355 (513h34m2.623724355s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.443697523 (513h34m2.626142532s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.449466741 (513h34m2.63191174s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.452793996 (513h34m2.635238995s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.552544726 (513h34m2.734989706s) [upload=451513]: Next returned nil segment
Feb 6 01:30:24.552559414 (513h34m2.735004384s) [upload=451513]: Waiting for error group managing segments...
Feb 6 01:30:24.561278120 (513h34m2.743723091s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.561679390 (513h34m2.74412437s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562015829 (513h34m2.744460829s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562532243 (513h34m2.744977233s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562752153 (513h34m2.745197154s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563447382 (513h34m2.745892382s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563584749 (513h34m2.74602975s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.564182115 (513h34m2.746627125s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.566364202 (513h34m2.748809192s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.595247277 (513h34m2.777692287s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.604524598 (513h34m2.786969578s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:54.395745250 (513h34m32.57819027s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: read tcp 5.161.89.252:51992->77.90.31.11:4555: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.395849825 (513h34m32.578294835s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: read tcp 5.161.89.252:21936->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396069005 (513h34m32.578514015s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:9486->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396234965 (513h34m32.578679975s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:24396->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396285850 (513h34m32.578730849s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: read tcp 5.161.89.252:36106->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396330484 (513h34m32.578775493s) [seg_pos={0 0}, upload=451513]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Feb 6 01:30:54.411835949 (513h34m32.594280949s) [upload=451513]: Done uploading segments...
Feb 6 01:30:54.411862379 (513h34m32.594307378s) [upload=451513]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 475.844046ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
366.8182ms trace:
https://jaeger.dev.storj.io/trace/14ab9a15cfb4b1db
FAIL (2026-02-06 01:38:57 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Feb 6 01:30:24.409352463 (513h34m2.591797474s) [upload=451513]: Starting upload
Feb 6 01:30:24.409416172 (513h34m2.591861172s) [upload=451513]: Done starting upload
Feb 6 01:30:24.409489941 (513h34m2.59193494s) [upload=451513]: Uploading segments...
Feb 6 01:30:24.409812984 (513h34m2.592257984s) [upload=451513]: Got next segment. Inline: false
Feb 6 01:30:24.409855192 (513h34m2.592300192s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 6 01:30:24.409860782 (513h34m2.592305783s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 6 01:30:24.431132711 (513h34m2.613577711s) [seg_pos={0 0}, upload=451513]: Begin upload segment...
Feb 6 01:30:24.431179047 (513h34m2.613624047s) [seg_pos={0 0}, upload=451513]: Done begin upload segment.
Feb 6 01:30:24.431213932 (513h34m2.613658932s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431248958 (513h34m2.613693958s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431960537 (513h34m2.614405538s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.432469217 (513h34m2.614914217s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433082974 (513h34m2.615527974s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433533606 (513h34m2.615978606s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433968238 (513h34m2.616413238s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434385187 (513h34m2.616830187s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434866285 (513h34m2.617311285s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.436773027 (513h34m2.619218027s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.437309239 (513h34m2.619754238s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.439077833 (513h34m2.621522843s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.441279355 (513h34m2.623724355s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.443697523 (513h34m2.626142532s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.449466741 (513h34m2.63191174s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.452793996 (513h34m2.635238995s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.552544726 (513h34m2.734989706s) [upload=451513]: Next returned nil segment
Feb 6 01:30:24.552559414 (513h34m2.735004384s) [upload=451513]: Waiting for error group managing segments...
Feb 6 01:30:24.561278120 (513h34m2.743723091s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.561679390 (513h34m2.74412437s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562015829 (513h34m2.744460829s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562532243 (513h34m2.744977233s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562752153 (513h34m2.745197154s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563447382 (513h34m2.745892382s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563584749 (513h34m2.74602975s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.564182115 (513h34m2.746627125s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.566364202 (513h34m2.748809192s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.595247277 (513h34m2.777692287s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.604524598 (513h34m2.786969578s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:54.395745250 (513h34m32.57819027s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: read tcp 5.161.89.252:51992->77.90.31.11:4555: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.395849825 (513h34m32.578294835s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: read tcp 5.161.89.252:21936->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396069005 (513h34m32.578514015s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:9486->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396234965 (513h34m32.578679975s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:24396->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396285850 (513h34m32.578730849s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: read tcp 5.161.89.252:36106->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396330484 (513h34m32.578775493s) [seg_pos={0 0}, upload=451513]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Feb 6 01:30:54.411835949 (513h34m32.594280949s) [upload=451513]: Done uploading segments...
Feb 6 01:30:54.411862379 (513h34m32.594307378s) [upload=451513]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 366.83988ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
413.30067ms trace:
https://jaeger.dev.storj.io/trace/14ab9a15cfb4b1db
FAIL (2026-02-06 01:38:02 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Feb 6 01:30:24.409352463 (513h34m2.591797474s) [upload=451513]: Starting upload
Feb 6 01:30:24.409416172 (513h34m2.591861172s) [upload=451513]: Done starting upload
Feb 6 01:30:24.409489941 (513h34m2.59193494s) [upload=451513]: Uploading segments...
Feb 6 01:30:24.409812984 (513h34m2.592257984s) [upload=451513]: Got next segment. Inline: false
Feb 6 01:30:24.409855192 (513h34m2.592300192s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 6 01:30:24.409860782 (513h34m2.592305783s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 6 01:30:24.431132711 (513h34m2.613577711s) [seg_pos={0 0}, upload=451513]: Begin upload segment...
Feb 6 01:30:24.431179047 (513h34m2.613624047s) [seg_pos={0 0}, upload=451513]: Done begin upload segment.
Feb 6 01:30:24.431213932 (513h34m2.613658932s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431248958 (513h34m2.613693958s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431960537 (513h34m2.614405538s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.432469217 (513h34m2.614914217s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433082974 (513h34m2.615527974s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433533606 (513h34m2.615978606s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433968238 (513h34m2.616413238s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434385187 (513h34m2.616830187s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434866285 (513h34m2.617311285s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.436773027 (513h34m2.619218027s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.437309239 (513h34m2.619754238s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.439077833 (513h34m2.621522843s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.441279355 (513h34m2.623724355s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.443697523 (513h34m2.626142532s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.449466741 (513h34m2.63191174s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.452793996 (513h34m2.635238995s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.552544726 (513h34m2.734989706s) [upload=451513]: Next returned nil segment
Feb 6 01:30:24.552559414 (513h34m2.735004384s) [upload=451513]: Waiting for error group managing segments...
Feb 6 01:30:24.561278120 (513h34m2.743723091s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.561679390 (513h34m2.74412437s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562015829 (513h34m2.744460829s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562532243 (513h34m2.744977233s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562752153 (513h34m2.745197154s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563447382 (513h34m2.745892382s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563584749 (513h34m2.74602975s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.564182115 (513h34m2.746627125s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.566364202 (513h34m2.748809192s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.595247277 (513h34m2.777692287s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.604524598 (513h34m2.786969578s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:54.395745250 (513h34m32.57819027s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: read tcp 5.161.89.252:51992->77.90.31.11:4555: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.395849825 (513h34m32.578294835s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: read tcp 5.161.89.252:21936->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396069005 (513h34m32.578514015s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:9486->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396234965 (513h34m32.578679975s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:24396->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396285850 (513h34m32.578730849s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: read tcp 5.161.89.252:36106->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396330484 (513h34m32.578775493s) [seg_pos={0 0}, upload=451513]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Feb 6 01:30:54.411835949 (513h34m32.594280949s) [upload=451513]: Done uploading segments...
Feb 6 01:30:54.411862379 (513h34m32.594307378s) [upload=451513]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 413.318123ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
402.558414ms trace:
https://jaeger.dev.storj.io/trace/14ab9a15cfb4b1db
FAIL (2026-02-06 01:37:37 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Feb 6 01:30:24.409352463 (513h34m2.591797474s) [upload=451513]: Starting upload
Feb 6 01:30:24.409416172 (513h34m2.591861172s) [upload=451513]: Done starting upload
Feb 6 01:30:24.409489941 (513h34m2.59193494s) [upload=451513]: Uploading segments...
Feb 6 01:30:24.409812984 (513h34m2.592257984s) [upload=451513]: Got next segment. Inline: false
Feb 6 01:30:24.409855192 (513h34m2.592300192s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 6 01:30:24.409860782 (513h34m2.592305783s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 6 01:30:24.431132711 (513h34m2.613577711s) [seg_pos={0 0}, upload=451513]: Begin upload segment...
Feb 6 01:30:24.431179047 (513h34m2.613624047s) [seg_pos={0 0}, upload=451513]: Done begin upload segment.
Feb 6 01:30:24.431213932 (513h34m2.613658932s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431248958 (513h34m2.613693958s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431960537 (513h34m2.614405538s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.432469217 (513h34m2.614914217s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433082974 (513h34m2.615527974s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433533606 (513h34m2.615978606s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433968238 (513h34m2.616413238s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434385187 (513h34m2.616830187s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434866285 (513h34m2.617311285s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.436773027 (513h34m2.619218027s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.437309239 (513h34m2.619754238s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.439077833 (513h34m2.621522843s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.441279355 (513h34m2.623724355s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.443697523 (513h34m2.626142532s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.449466741 (513h34m2.63191174s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.452793996 (513h34m2.635238995s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.552544726 (513h34m2.734989706s) [upload=451513]: Next returned nil segment
Feb 6 01:30:24.552559414 (513h34m2.735004384s) [upload=451513]: Waiting for error group managing segments...
Feb 6 01:30:24.561278120 (513h34m2.743723091s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.561679390 (513h34m2.74412437s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562015829 (513h34m2.744460829s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562532243 (513h34m2.744977233s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562752153 (513h34m2.745197154s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563447382 (513h34m2.745892382s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563584749 (513h34m2.74602975s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.564182115 (513h34m2.746627125s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.566364202 (513h34m2.748809192s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.595247277 (513h34m2.777692287s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.604524598 (513h34m2.786969578s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:54.395745250 (513h34m32.57819027s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: read tcp 5.161.89.252:51992->77.90.31.11:4555: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.395849825 (513h34m32.578294835s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: read tcp 5.161.89.252:21936->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396069005 (513h34m32.578514015s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:9486->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396234965 (513h34m32.578679975s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:24396->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396285850 (513h34m32.578730849s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: read tcp 5.161.89.252:36106->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396330484 (513h34m32.578775493s) [seg_pos={0 0}, upload=451513]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Feb 6 01:30:54.411835949 (513h34m32.594280949s) [upload=451513]: Done uploading segments...
Feb 6 01:30:54.411862379 (513h34m32.594307378s) [upload=451513]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 402.580544ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
414.727386ms trace:
https://jaeger.dev.storj.io/trace/14ab9a15cfb4b1db
FAIL (2026-02-06 01:37:16 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Feb 6 01:30:24.409352463 (513h34m2.591797474s) [upload=451513]: Starting upload
Feb 6 01:30:24.409416172 (513h34m2.591861172s) [upload=451513]: Done starting upload
Feb 6 01:30:24.409489941 (513h34m2.59193494s) [upload=451513]: Uploading segments...
Feb 6 01:30:24.409812984 (513h34m2.592257984s) [upload=451513]: Got next segment. Inline: false
Feb 6 01:30:24.409855192 (513h34m2.592300192s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 6 01:30:24.409860782 (513h34m2.592305783s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 6 01:30:24.431132711 (513h34m2.613577711s) [seg_pos={0 0}, upload=451513]: Begin upload segment...
Feb 6 01:30:24.431179047 (513h34m2.613624047s) [seg_pos={0 0}, upload=451513]: Done begin upload segment.
Feb 6 01:30:24.431213932 (513h34m2.613658932s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431248958 (513h34m2.613693958s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431960537 (513h34m2.614405538s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.432469217 (513h34m2.614914217s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433082974 (513h34m2.615527974s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433533606 (513h34m2.615978606s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433968238 (513h34m2.616413238s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434385187 (513h34m2.616830187s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434866285 (513h34m2.617311285s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.436773027 (513h34m2.619218027s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.437309239 (513h34m2.619754238s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.439077833 (513h34m2.621522843s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.441279355 (513h34m2.623724355s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.443697523 (513h34m2.626142532s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.449466741 (513h34m2.63191174s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.452793996 (513h34m2.635238995s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.552544726 (513h34m2.734989706s) [upload=451513]: Next returned nil segment
Feb 6 01:30:24.552559414 (513h34m2.735004384s) [upload=451513]: Waiting for error group managing segments...
Feb 6 01:30:24.561278120 (513h34m2.743723091s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.561679390 (513h34m2.74412437s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562015829 (513h34m2.744460829s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562532243 (513h34m2.744977233s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562752153 (513h34m2.745197154s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563447382 (513h34m2.745892382s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563584749 (513h34m2.74602975s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.564182115 (513h34m2.746627125s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.566364202 (513h34m2.748809192s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.595247277 (513h34m2.777692287s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.604524598 (513h34m2.786969578s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:54.395745250 (513h34m32.57819027s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: read tcp 5.161.89.252:51992->77.90.31.11:4555: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.395849825 (513h34m32.578294835s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: read tcp 5.161.89.252:21936->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396069005 (513h34m32.578514015s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:9486->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396234965 (513h34m32.578679975s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:24396->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396285850 (513h34m32.578730849s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: read tcp 5.161.89.252:36106->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396330484 (513h34m32.578775493s) [seg_pos={0 0}, upload=451513]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Feb 6 01:30:54.411835949 (513h34m32.594280949s) [upload=451513]: Done uploading segments...
Feb 6 01:30:54.411862379 (513h34m32.594307378s) [upload=451513]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 414.748356ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
438.034066ms trace:
https://jaeger.dev.storj.io/trace/14ab9a15cfb4b1db
FAIL (2026-02-06 01:37:00 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Feb 6 01:30:24.409352463 (513h34m2.591797474s) [upload=451513]: Starting upload
Feb 6 01:30:24.409416172 (513h34m2.591861172s) [upload=451513]: Done starting upload
Feb 6 01:30:24.409489941 (513h34m2.59193494s) [upload=451513]: Uploading segments...
Feb 6 01:30:24.409812984 (513h34m2.592257984s) [upload=451513]: Got next segment. Inline: false
Feb 6 01:30:24.409855192 (513h34m2.592300192s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 6 01:30:24.409860782 (513h34m2.592305783s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 6 01:30:24.431132711 (513h34m2.613577711s) [seg_pos={0 0}, upload=451513]: Begin upload segment...
Feb 6 01:30:24.431179047 (513h34m2.613624047s) [seg_pos={0 0}, upload=451513]: Done begin upload segment.
Feb 6 01:30:24.431213932 (513h34m2.613658932s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431248958 (513h34m2.613693958s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431960537 (513h34m2.614405538s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.432469217 (513h34m2.614914217s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433082974 (513h34m2.615527974s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433533606 (513h34m2.615978606s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433968238 (513h34m2.616413238s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434385187 (513h34m2.616830187s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434866285 (513h34m2.617311285s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.436773027 (513h34m2.619218027s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.437309239 (513h34m2.619754238s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.439077833 (513h34m2.621522843s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.441279355 (513h34m2.623724355s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.443697523 (513h34m2.626142532s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.449466741 (513h34m2.63191174s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.452793996 (513h34m2.635238995s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.552544726 (513h34m2.734989706s) [upload=451513]: Next returned nil segment
Feb 6 01:30:24.552559414 (513h34m2.735004384s) [upload=451513]: Waiting for error group managing segments...
Feb 6 01:30:24.561278120 (513h34m2.743723091s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.561679390 (513h34m2.74412437s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562015829 (513h34m2.744460829s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562532243 (513h34m2.744977233s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562752153 (513h34m2.745197154s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563447382 (513h34m2.745892382s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563584749 (513h34m2.74602975s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.564182115 (513h34m2.746627125s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.566364202 (513h34m2.748809192s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.595247277 (513h34m2.777692287s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.604524598 (513h34m2.786969578s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:54.395745250 (513h34m32.57819027s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: read tcp 5.161.89.252:51992->77.90.31.11:4555: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.395849825 (513h34m32.578294835s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: read tcp 5.161.89.252:21936->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396069005 (513h34m32.578514015s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:9486->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396234965 (513h34m32.578679975s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:24396->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396285850 (513h34m32.578730849s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: read tcp 5.161.89.252:36106->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396330484 (513h34m32.578775493s) [seg_pos={0 0}, upload=451513]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Feb 6 01:30:54.411835949 (513h34m32.594280949s) [upload=451513]: Done uploading segments...
Feb 6 01:30:54.411862379 (513h34m32.594307378s) [upload=451513]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 438.062368ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
405.497844ms trace:
https://jaeger.dev.storj.io/trace/14ab9a15cfb4b1db
FAIL (2026-02-06 01:35:59 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Feb 6 01:30:24.409352463 (513h34m2.591797474s) [upload=451513]: Starting upload
Feb 6 01:30:24.409416172 (513h34m2.591861172s) [upload=451513]: Done starting upload
Feb 6 01:30:24.409489941 (513h34m2.59193494s) [upload=451513]: Uploading segments...
Feb 6 01:30:24.409812984 (513h34m2.592257984s) [upload=451513]: Got next segment. Inline: false
Feb 6 01:30:24.409855192 (513h34m2.592300192s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 6 01:30:24.409860782 (513h34m2.592305783s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 6 01:30:24.431132711 (513h34m2.613577711s) [seg_pos={0 0}, upload=451513]: Begin upload segment...
Feb 6 01:30:24.431179047 (513h34m2.613624047s) [seg_pos={0 0}, upload=451513]: Done begin upload segment.
Feb 6 01:30:24.431213932 (513h34m2.613658932s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431248958 (513h34m2.613693958s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431960537 (513h34m2.614405538s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.432469217 (513h34m2.614914217s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433082974 (513h34m2.615527974s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433533606 (513h34m2.615978606s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433968238 (513h34m2.616413238s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434385187 (513h34m2.616830187s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434866285 (513h34m2.617311285s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.436773027 (513h34m2.619218027s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.437309239 (513h34m2.619754238s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.439077833 (513h34m2.621522843s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.441279355 (513h34m2.623724355s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.443697523 (513h34m2.626142532s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.449466741 (513h34m2.63191174s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.452793996 (513h34m2.635238995s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.552544726 (513h34m2.734989706s) [upload=451513]: Next returned nil segment
Feb 6 01:30:24.552559414 (513h34m2.735004384s) [upload=451513]: Waiting for error group managing segments...
Feb 6 01:30:24.561278120 (513h34m2.743723091s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.561679390 (513h34m2.74412437s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562015829 (513h34m2.744460829s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562532243 (513h34m2.744977233s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562752153 (513h34m2.745197154s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563447382 (513h34m2.745892382s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563584749 (513h34m2.74602975s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.564182115 (513h34m2.746627125s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.566364202 (513h34m2.748809192s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.595247277 (513h34m2.777692287s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.604524598 (513h34m2.786969578s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:54.395745250 (513h34m32.57819027s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: read tcp 5.161.89.252:51992->77.90.31.11:4555: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.395849825 (513h34m32.578294835s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: read tcp 5.161.89.252:21936->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396069005 (513h34m32.578514015s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:9486->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396234965 (513h34m32.578679975s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:24396->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396285850 (513h34m32.578730849s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: read tcp 5.161.89.252:36106->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396330484 (513h34m32.578775493s) [seg_pos={0 0}, upload=451513]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Feb 6 01:30:54.411835949 (513h34m32.594280949s) [upload=451513]: Done uploading segments...
Feb 6 01:30:54.411862379 (513h34m32.594307378s) [upload=451513]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 405.514957ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
556.149934ms trace:
https://jaeger.dev.storj.io/trace/14ab9a15cfb4b1db
FAIL (2026-02-06 01:35:25 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Feb 6 01:30:24.409352463 (513h34m2.591797474s) [upload=451513]: Starting upload
Feb 6 01:30:24.409416172 (513h34m2.591861172s) [upload=451513]: Done starting upload
Feb 6 01:30:24.409489941 (513h34m2.59193494s) [upload=451513]: Uploading segments...
Feb 6 01:30:24.409812984 (513h34m2.592257984s) [upload=451513]: Got next segment. Inline: false
Feb 6 01:30:24.409855192 (513h34m2.592300192s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 6 01:30:24.409860782 (513h34m2.592305783s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 6 01:30:24.431132711 (513h34m2.613577711s) [seg_pos={0 0}, upload=451513]: Begin upload segment...
Feb 6 01:30:24.431179047 (513h34m2.613624047s) [seg_pos={0 0}, upload=451513]: Done begin upload segment.
Feb 6 01:30:24.431213932 (513h34m2.613658932s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431248958 (513h34m2.613693958s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431960537 (513h34m2.614405538s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.432469217 (513h34m2.614914217s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433082974 (513h34m2.615527974s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433533606 (513h34m2.615978606s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433968238 (513h34m2.616413238s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434385187 (513h34m2.616830187s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434866285 (513h34m2.617311285s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.436773027 (513h34m2.619218027s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.437309239 (513h34m2.619754238s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.439077833 (513h34m2.621522843s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.441279355 (513h34m2.623724355s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.443697523 (513h34m2.626142532s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.449466741 (513h34m2.63191174s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.452793996 (513h34m2.635238995s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.552544726 (513h34m2.734989706s) [upload=451513]: Next returned nil segment
Feb 6 01:30:24.552559414 (513h34m2.735004384s) [upload=451513]: Waiting for error group managing segments...
Feb 6 01:30:24.561278120 (513h34m2.743723091s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.561679390 (513h34m2.74412437s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562015829 (513h34m2.744460829s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562532243 (513h34m2.744977233s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562752153 (513h34m2.745197154s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563447382 (513h34m2.745892382s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563584749 (513h34m2.74602975s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.564182115 (513h34m2.746627125s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.566364202 (513h34m2.748809192s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.595247277 (513h34m2.777692287s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.604524598 (513h34m2.786969578s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:54.395745250 (513h34m32.57819027s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: read tcp 5.161.89.252:51992->77.90.31.11:4555: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.395849825 (513h34m32.578294835s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: read tcp 5.161.89.252:21936->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396069005 (513h34m32.578514015s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:9486->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396234965 (513h34m32.578679975s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:24396->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396285850 (513h34m32.578730849s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: read tcp 5.161.89.252:36106->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396330484 (513h34m32.578775493s) [seg_pos={0 0}, upload=451513]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Feb 6 01:30:54.411835949 (513h34m32.594280949s) [upload=451513]: Done uploading segments...
Feb 6 01:30:54.411862379 (513h34m32.594307378s) [upload=451513]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 556.169371ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
428.178043ms trace:
https://jaeger.dev.storj.io/trace/14ab9a15cfb4b1db
FAIL (2026-02-06 01:34:32 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Feb 6 01:30:24.409352463 (513h34m2.591797474s) [upload=451513]: Starting upload
Feb 6 01:30:24.409416172 (513h34m2.591861172s) [upload=451513]: Done starting upload
Feb 6 01:30:24.409489941 (513h34m2.59193494s) [upload=451513]: Uploading segments...
Feb 6 01:30:24.409812984 (513h34m2.592257984s) [upload=451513]: Got next segment. Inline: false
Feb 6 01:30:24.409855192 (513h34m2.592300192s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 6 01:30:24.409860782 (513h34m2.592305783s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 6 01:30:24.431132711 (513h34m2.613577711s) [seg_pos={0 0}, upload=451513]: Begin upload segment...
Feb 6 01:30:24.431179047 (513h34m2.613624047s) [seg_pos={0 0}, upload=451513]: Done begin upload segment.
Feb 6 01:30:24.431213932 (513h34m2.613658932s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431248958 (513h34m2.613693958s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431960537 (513h34m2.614405538s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.432469217 (513h34m2.614914217s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433082974 (513h34m2.615527974s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433533606 (513h34m2.615978606s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433968238 (513h34m2.616413238s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434385187 (513h34m2.616830187s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434866285 (513h34m2.617311285s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.436773027 (513h34m2.619218027s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.437309239 (513h34m2.619754238s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.439077833 (513h34m2.621522843s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.441279355 (513h34m2.623724355s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.443697523 (513h34m2.626142532s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.449466741 (513h34m2.63191174s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.452793996 (513h34m2.635238995s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.552544726 (513h34m2.734989706s) [upload=451513]: Next returned nil segment
Feb 6 01:30:24.552559414 (513h34m2.735004384s) [upload=451513]: Waiting for error group managing segments...
Feb 6 01:30:24.561278120 (513h34m2.743723091s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.561679390 (513h34m2.74412437s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562015829 (513h34m2.744460829s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562532243 (513h34m2.744977233s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562752153 (513h34m2.745197154s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563447382 (513h34m2.745892382s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563584749 (513h34m2.74602975s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.564182115 (513h34m2.746627125s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.566364202 (513h34m2.748809192s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.595247277 (513h34m2.777692287s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.604524598 (513h34m2.786969578s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:54.395745250 (513h34m32.57819027s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: read tcp 5.161.89.252:51992->77.90.31.11:4555: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.395849825 (513h34m32.578294835s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: read tcp 5.161.89.252:21936->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396069005 (513h34m32.578514015s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:9486->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396234965 (513h34m32.578679975s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:24396->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396285850 (513h34m32.578730849s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: read tcp 5.161.89.252:36106->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396330484 (513h34m32.578775493s) [seg_pos={0 0}, upload=451513]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Feb 6 01:30:54.411835949 (513h34m32.594280949s) [upload=451513]: Done uploading segments...
Feb 6 01:30:54.411862379 (513h34m32.594307378s) [upload=451513]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 428.215243ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
405.073571ms trace:
https://jaeger.dev.storj.io/trace/14ab9a15cfb4b1db
FAIL (2026-02-06 01:33:19 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Feb 6 01:30:24.409352463 (513h34m2.591797474s) [upload=451513]: Starting upload
Feb 6 01:30:24.409416172 (513h34m2.591861172s) [upload=451513]: Done starting upload
Feb 6 01:30:24.409489941 (513h34m2.59193494s) [upload=451513]: Uploading segments...
Feb 6 01:30:24.409812984 (513h34m2.592257984s) [upload=451513]: Got next segment. Inline: false
Feb 6 01:30:24.409855192 (513h34m2.592300192s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 6 01:30:24.409860782 (513h34m2.592305783s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 6 01:30:24.431132711 (513h34m2.613577711s) [seg_pos={0 0}, upload=451513]: Begin upload segment...
Feb 6 01:30:24.431179047 (513h34m2.613624047s) [seg_pos={0 0}, upload=451513]: Done begin upload segment.
Feb 6 01:30:24.431213932 (513h34m2.613658932s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431248958 (513h34m2.613693958s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431960537 (513h34m2.614405538s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.432469217 (513h34m2.614914217s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433082974 (513h34m2.615527974s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433533606 (513h34m2.615978606s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433968238 (513h34m2.616413238s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434385187 (513h34m2.616830187s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434866285 (513h34m2.617311285s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.436773027 (513h34m2.619218027s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.437309239 (513h34m2.619754238s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.439077833 (513h34m2.621522843s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.441279355 (513h34m2.623724355s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.443697523 (513h34m2.626142532s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.449466741 (513h34m2.63191174s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.452793996 (513h34m2.635238995s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.552544726 (513h34m2.734989706s) [upload=451513]: Next returned nil segment
Feb 6 01:30:24.552559414 (513h34m2.735004384s) [upload=451513]: Waiting for error group managing segments...
Feb 6 01:30:24.561278120 (513h34m2.743723091s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.561679390 (513h34m2.74412437s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562015829 (513h34m2.744460829s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562532243 (513h34m2.744977233s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562752153 (513h34m2.745197154s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563447382 (513h34m2.745892382s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563584749 (513h34m2.74602975s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.564182115 (513h34m2.746627125s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.566364202 (513h34m2.748809192s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.595247277 (513h34m2.777692287s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.604524598 (513h34m2.786969578s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:54.395745250 (513h34m32.57819027s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: read tcp 5.161.89.252:51992->77.90.31.11:4555: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.395849825 (513h34m32.578294835s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: read tcp 5.161.89.252:21936->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396069005 (513h34m32.578514015s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:9486->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396234965 (513h34m32.578679975s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:24396->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396285850 (513h34m32.578730849s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: read tcp 5.161.89.252:36106->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396330484 (513h34m32.578775493s) [seg_pos={0 0}, upload=451513]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Feb 6 01:30:54.411835949 (513h34m32.594280949s) [upload=451513]: Done uploading segments...
Feb 6 01:30:54.411862379 (513h34m32.594307378s) [upload=451513]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 405.094541ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
446.953907ms trace:
https://jaeger.dev.storj.io/trace/14ab9a15cfb4b1db
FAIL (2026-02-06 01:32:18 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Feb 6 01:30:24.409352463 (513h34m2.591797474s) [upload=451513]: Starting upload
Feb 6 01:30:24.409416172 (513h34m2.591861172s) [upload=451513]: Done starting upload
Feb 6 01:30:24.409489941 (513h34m2.59193494s) [upload=451513]: Uploading segments...
Feb 6 01:30:24.409812984 (513h34m2.592257984s) [upload=451513]: Got next segment. Inline: false
Feb 6 01:30:24.409855192 (513h34m2.592300192s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 6 01:30:24.409860782 (513h34m2.592305783s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 6 01:30:24.431132711 (513h34m2.613577711s) [seg_pos={0 0}, upload=451513]: Begin upload segment...
Feb 6 01:30:24.431179047 (513h34m2.613624047s) [seg_pos={0 0}, upload=451513]: Done begin upload segment.
Feb 6 01:30:24.431213932 (513h34m2.613658932s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431248958 (513h34m2.613693958s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431960537 (513h34m2.614405538s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.432469217 (513h34m2.614914217s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433082974 (513h34m2.615527974s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433533606 (513h34m2.615978606s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433968238 (513h34m2.616413238s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434385187 (513h34m2.616830187s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434866285 (513h34m2.617311285s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.436773027 (513h34m2.619218027s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.437309239 (513h34m2.619754238s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.439077833 (513h34m2.621522843s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.441279355 (513h34m2.623724355s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.443697523 (513h34m2.626142532s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.449466741 (513h34m2.63191174s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.452793996 (513h34m2.635238995s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.552544726 (513h34m2.734989706s) [upload=451513]: Next returned nil segment
Feb 6 01:30:24.552559414 (513h34m2.735004384s) [upload=451513]: Waiting for error group managing segments...
Feb 6 01:30:24.561278120 (513h34m2.743723091s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.561679390 (513h34m2.74412437s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562015829 (513h34m2.744460829s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562532243 (513h34m2.744977233s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562752153 (513h34m2.745197154s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563447382 (513h34m2.745892382s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563584749 (513h34m2.74602975s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.564182115 (513h34m2.746627125s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.566364202 (513h34m2.748809192s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.595247277 (513h34m2.777692287s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.604524598 (513h34m2.786969578s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:54.395745250 (513h34m32.57819027s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: read tcp 5.161.89.252:51992->77.90.31.11:4555: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.395849825 (513h34m32.578294835s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: read tcp 5.161.89.252:21936->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396069005 (513h34m32.578514015s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:9486->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396234965 (513h34m32.578679975s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:24396->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396285850 (513h34m32.578730849s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: read tcp 5.161.89.252:36106->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396330484 (513h34m32.578775493s) [seg_pos={0 0}, upload=451513]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Feb 6 01:30:54.411835949 (513h34m32.594280949s) [upload=451513]: Done uploading segments...
Feb 6 01:30:54.411862379 (513h34m32.594307378s) [upload=451513]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 446.974896ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
478.505107ms trace:
https://jaeger.dev.storj.io/trace/14ab9a15cfb4b1db
FAIL (2026-02-06 01:31:17 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Feb 6 01:30:24.409352463 (513h34m2.591797474s) [upload=451513]: Starting upload
Feb 6 01:30:24.409416172 (513h34m2.591861172s) [upload=451513]: Done starting upload
Feb 6 01:30:24.409489941 (513h34m2.59193494s) [upload=451513]: Uploading segments...
Feb 6 01:30:24.409812984 (513h34m2.592257984s) [upload=451513]: Got next segment. Inline: false
Feb 6 01:30:24.409855192 (513h34m2.592300192s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 6 01:30:24.409860782 (513h34m2.592305783s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 6 01:30:24.431132711 (513h34m2.613577711s) [seg_pos={0 0}, upload=451513]: Begin upload segment...
Feb 6 01:30:24.431179047 (513h34m2.613624047s) [seg_pos={0 0}, upload=451513]: Done begin upload segment.
Feb 6 01:30:24.431213932 (513h34m2.613658932s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431248958 (513h34m2.613693958s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431960537 (513h34m2.614405538s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.432469217 (513h34m2.614914217s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433082974 (513h34m2.615527974s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433533606 (513h34m2.615978606s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433968238 (513h34m2.616413238s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434385187 (513h34m2.616830187s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434866285 (513h34m2.617311285s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.436773027 (513h34m2.619218027s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.437309239 (513h34m2.619754238s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.439077833 (513h34m2.621522843s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.441279355 (513h34m2.623724355s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.443697523 (513h34m2.626142532s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.449466741 (513h34m2.63191174s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.452793996 (513h34m2.635238995s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.552544726 (513h34m2.734989706s) [upload=451513]: Next returned nil segment
Feb 6 01:30:24.552559414 (513h34m2.735004384s) [upload=451513]: Waiting for error group managing segments...
Feb 6 01:30:24.561278120 (513h34m2.743723091s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.561679390 (513h34m2.74412437s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562015829 (513h34m2.744460829s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562532243 (513h34m2.744977233s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562752153 (513h34m2.745197154s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563447382 (513h34m2.745892382s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563584749 (513h34m2.74602975s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.564182115 (513h34m2.746627125s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.566364202 (513h34m2.748809192s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.595247277 (513h34m2.777692287s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.604524598 (513h34m2.786969578s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:54.395745250 (513h34m32.57819027s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: read tcp 5.161.89.252:51992->77.90.31.11:4555: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.395849825 (513h34m32.578294835s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: read tcp 5.161.89.252:21936->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396069005 (513h34m32.578514015s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:9486->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396234965 (513h34m32.578679975s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:24396->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396285850 (513h34m32.578730849s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: read tcp 5.161.89.252:36106->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396330484 (513h34m32.578775493s) [seg_pos={0 0}, upload=451513]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Feb 6 01:30:54.411835949 (513h34m32.594280949s) [upload=451513]: Done uploading segments...
Feb 6 01:30:54.411862379 (513h34m32.594307378s) [upload=451513]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 478.541615ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.018173195s trace:
https://jaeger.dev.storj.io/trace/14ab9a15cfb4b1db
FAIL (2026-02-06 01:30:54 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Feb 6 01:30:24.409352463 (513h34m2.591797474s) [upload=451513]: Starting upload
Feb 6 01:30:24.409416172 (513h34m2.591861172s) [upload=451513]: Done starting upload
Feb 6 01:30:24.409489941 (513h34m2.59193494s) [upload=451513]: Uploading segments...
Feb 6 01:30:24.409812984 (513h34m2.592257984s) [upload=451513]: Got next segment. Inline: false
Feb 6 01:30:24.409855192 (513h34m2.592300192s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 6 01:30:24.409860782 (513h34m2.592305783s) [upload=451513]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 6 01:30:24.431132711 (513h34m2.613577711s) [seg_pos={0 0}, upload=451513]: Begin upload segment...
Feb 6 01:30:24.431179047 (513h34m2.613624047s) [seg_pos={0 0}, upload=451513]: Done begin upload segment.
Feb 6 01:30:24.431213932 (513h34m2.613658932s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431248958 (513h34m2.613693958s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.431960537 (513h34m2.614405538s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.432469217 (513h34m2.614914217s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433082974 (513h34m2.615527974s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433533606 (513h34m2.615978606s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.433968238 (513h34m2.616413238s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434385187 (513h34m2.616830187s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.434866285 (513h34m2.617311285s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.436773027 (513h34m2.619218027s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.437309239 (513h34m2.619754238s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.439077833 (513h34m2.621522843s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.441279355 (513h34m2.623724355s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.443697523 (513h34m2.626142532s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.449466741 (513h34m2.63191174s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.452793996 (513h34m2.635238995s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Uploading piece...
Feb 6 01:30:24.552544726 (513h34m2.734989706s) [upload=451513]: Next returned nil segment
Feb 6 01:30:24.552559414 (513h34m2.735004384s) [upload=451513]: Waiting for error group managing segments...
Feb 6 01:30:24.561278120 (513h34m2.743723091s) [noise=true , address=145.79.227.15:4876 , piece_id=LT63U5EHI5ODYXYRXZZ7O4SZLAWKTPSWZSACJCLGM7MON4E5KV3Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.561679390 (513h34m2.74412437s) [noise=true , address=45.91.116.7:4011 , piece_id=YMOSKEVTLGKSMQWTSOJYKHLT3QRDEWTJTB23GXLFIECTPK7DXI6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562015829 (513h34m2.744460829s) [noise=true , address=45.91.116.8:4046 , piece_id=MATIZYD2OB3DKZ2ET3CPQ7YQ7RLLGTDVI2HJI7JI7R3VZOX336UQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562532243 (513h34m2.744977233s) [noise=true , address=45.91.116.12:4255 , piece_id=NI75XI3OZNIJ36FMRC66GA4AT3I6LTIDPONW2TFWL4IQMJB2T5LA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.562752153 (513h34m2.745197154s) [noise=true , address=79.127.219.38:4821 , piece_id=AA3IE2DA2ZRYPMN6RPWBUO4MUIA23KNKHQ3UB3BZF5A2DJ4AZVYA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563447382 (513h34m2.745892382s) [noise=true , address=45.91.116.12:4225 , piece_id=U334CRSIYQDG5MT6FES66XZCJOU34BTDLS3DJYA7FW45G2WPTX3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.563584749 (513h34m2.74602975s) [noise=true , address=45.91.116.4:4953 , piece_id=U7VFV4E6BA3LHHCN5WVLNXAFX4OIHBB6LPJBT6MD7K7L7K6EN7MQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.564182115 (513h34m2.746627125s) [noise=true , address=45.91.116.13:4153 , piece_id=QCSVP4ADI45ZHMFHLCUABMYLYJE5IGYX55T3SEVQLOCXR2GFKE3A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.566364202 (513h34m2.748809192s) [noise=true , address=79.127.219.41:4925 , piece_id=OCXS5TKFBER46BZUXSXKWHPRDWSWFCVGZLBXHW7J354DCBHKW74A, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.595247277 (513h34m2.777692287s) [noise=true , address=145.79.227.45:4230 , piece_id=I62ECZEFSIYRDIMWQ7PCFSTAFO3VJDQE72OWDWRJHN3JIAJBPWVQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:24.604524598 (513h34m2.786969578s) [noise=true , address=79.127.219.45:4858 , piece_id=QS3V4TIRXWV7ZWLI77XSVLQAF627KECZBWT4E5NEPDZTQQQI7BSA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: <nil>
Feb 6 01:30:54.395745250 (513h34m32.57819027s) [noise=true , address=77.90.31.11:4555 , piece_id=CRXWY7FGYJFT5N7JQSNS6PU7VI2CF5HALQXL6VLS44VE3UI6MUJA, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: read tcp 5.161.89.252:51992->77.90.31.11:4555: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.395849825 (513h34m32.578294835s) [noise=true , address=77.90.31.12:4589 , piece_id=XQHYKDV37OLNPPZS7FJN7LUT6B4V5BGA5WPPLOSPZWHTTOUAZ2FQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: read tcp 5.161.89.252:21936->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396069005 (513h34m32.578514015s) [noise=true , address=77.90.31.12:4590 , piece_id=POWB6XDWEHCIVAFCDNGUO2QOQCCYS7GBZ3IQDYZN5VJ3OGB6AWGQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:9486->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396234965 (513h34m32.578679975s) [noise=true , address=77.90.31.15:4697 , piece_id=HLS5WMIDO43DXOVHB4MVSIE4L4S37WHZXF4Y4YACOMK6G3SLDY6Q, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:24396->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396285850 (513h34m32.578730849s) [noise=true , address=77.90.31.10:4517 , piece_id=4YENW3VLAEOI3BL2XY3KN4JQTJDICZKLS5E74GH7TG2UFJVUVTIQ, seg_pos={0 0}, upload=451513]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: read tcp 5.161.89.252:36106->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 6 01:30:54.396330484 (513h34m32.578775493s) [seg_pos={0 0}, upload=451513]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Feb 6 01:30:54.411835949 (513h34m32.594280949s) [upload=451513]: Done uploading segments...
Feb 6 01:30:54.411862379 (513h34m32.594307378s) [upload=451513]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 30.018189967s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [X...........................................................] duration:
774.246067ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/32b933b8cd1b914f
FAIL (2026-02-06 00:38:47 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 774.264311ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.X..........................................................] duration:
281.211781ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/32b933b8cd1b914f
FAIL (2026-02-06 00:38:25 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 281.236709ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [..X.........................................................] duration:
269.160378ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/32b933b8cd1b914f
FAIL (2026-02-06 00:37:43 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 269.177812ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [...X........................................................] duration:
294.313708ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/32b933b8cd1b914f
FAIL (2026-02-06 00:37:20 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 294.325761ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [....X.......................................................] duration:
287.611469ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/32b933b8cd1b914f
FAIL (2026-02-06 00:36:29 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 287.634422ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.....X......................................................] duration:
276.189631ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/32b933b8cd1b914f
FAIL (2026-02-06 00:35:22 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 276.209839ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [......X.....................................................] duration:
281.600459ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/32b933b8cd1b914f
FAIL (2026-02-06 00:34:25 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 281.618342ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.......X....................................................] duration:
280.647479ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/32b933b8cd1b914f
FAIL (2026-02-06 00:34:09 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 280.660623ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [........X...................................................] duration:
283.679664ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/32b933b8cd1b914f
FAIL (2026-02-06 00:33:19 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 283.776766ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.........X..................................................] duration:
281.615877ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/32b933b8cd1b914f
FAIL (2026-02-06 00:32:31 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 281.638479ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [..........X.................................................] duration:
296.867782ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/32b933b8cd1b914f
FAIL (2026-02-06 00:31:31 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 296.881888ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [...........X................................................] duration:
764.821935ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/32b933b8cd1b914f
FAIL (2026-02-06 00:30:36 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 764.840229ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [............X...............................................] duration:
803.710877ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/32b933b8cd1b914f
FAIL (2026-02-06 00:29:52 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 803.735131ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.............X..............................................] duration:
286.884206ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/32b933b8cd1b914f
FAIL (2026-02-06 00:28:49 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 286.904585ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [..............X.............................................] duration:
271.771014ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/32b933b8cd1b914f
FAIL (2026-02-06 00:27:58 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 271.793305ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [...............X............................................] duration:
810.387979ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/32b933b8cd1b914f
FAIL (2026-02-06 00:26:46 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 810.407917ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [................X...........................................] duration:
281.607689ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/32b933b8cd1b914f
FAIL (2026-02-06 00:25:40 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 281.64535ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.................X..........................................] duration:
756.121863ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/32b933b8cd1b914f
FAIL (2026-02-06 00:25:07 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 756.145177ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [..................X.........................................] duration:
276.78886ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/32b933b8cd1b914f
FAIL (2026-02-06 00:24:10 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 276.808095ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [...................X........................................] duration:
284.584681ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/32b933b8cd1b914f
FAIL (2026-02-06 00:23:05 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 284.604728ms
edge
linksharing
bgp
ap1
|