Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.282985417s trace:
https://jaeger.dev.storj.io/trace/6735d4b874ab1ef5
FAIL (2026-01-09 08:22:27 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
03564596s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.408402825 (832h8m36.105971141s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.409232034 (832h8m36.10680034s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.410100727 (832h8m36.107669033s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.411643299 (832h8m36.109211605s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.412026585 (832h8m36.109594931s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.413398217 (832h8m36.110966523s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414194315 (832h8m36.111762621s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414527187 (832h8m36.112095493s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.417979455 (832h8m36.115547771s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.419110590 (832h8m36.116678906s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.420189664 (832h8m36.117757981s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.421246770 (832h8m36.118815076s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.864750971 (832h8m36.562319277s) [upload=732073]: Next returned nil segment
Jan 9 07:37:48.864760439 (832h8m36.562328755s) [upload=732073]: Waiting for error group managing segments...
Jan 9 07:37:49.079903909 (832h8m36.777472216s) [noise=true , address=185.167.204.205:4014 , piece_id=JTQC4RDGKGUW7LPJKMG4FQQP4PDZURUNCLN7D5IR6DVYKCXTDXMQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081476859 (832h8m36.779045164s) [noise=true , address=185.167.204.205:4036 , piece_id=36F5ETODK33CJ3DYLVDO74ILEUCO46EOGFSDOIYFIZOFMSYCWZJQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081854243 (832h8m36.779422549s) [noise=true , address=185.167.204.206:4047 , piece_id=NX5VZNEAAQWZIVENWWI6D6JGPSVAR25G7UNLR4VM2IO3R5R2RNFA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.084019388 (832h8m36.781587694s) [noise=true , address=185.167.204.205:4030 , piece_id=XDZNUF4U7B3LBSGGDF5KQMFAMULAVDBGV77W2HLB3TQ6A63T2LKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085665192 (832h8m36.783233498s) [noise=true , address=185.167.204.205:4016 , piece_id=7DOGCUU3CLYQEXEDHJEA3TBLPZXG2ZYZ2ELHPMI6ABEN3SCHVIGA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085685219 (832h8m36.783253526s) [noise=true , address=185.167.204.206:4063 , piece_id=TS7CR4OJYFCIVJTYUIDMZG6OFGDTD2UEXBTYXRCUPX6PPKWMQI3Q, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.092142522 (832h8m36.789710829s) [noise=true , address=89.149.201.147:4003 , piece_id=G44C4AXJFDLENH24JTOYRMOT2W2TQYKBG4VKCTJVI42IWDZAUMKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.094372309 (832h8m36.791940614s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.099207151 (832h8m36.796775457s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.100548106 (832h8m36.798116402s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.126257155 (832h8m36.82382546s) [noise=true , address=185.167.204.206:4068 , piece_id=4BHBFT7M5FRFXI2BHSA6EKXDFCU3GCXBVVITTB2WIEFU4P36VAIA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.133142828 (832h8m36.830711144s) [noise=true , address=185.167.204.205:4011 , piece_id=ZWVL45YULGYIG6D32ZEKCXGMIQQYVH4JVEXQPL32SNGOBDYWN3KQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.134306753 (832h8m36.831875069s) [noise=true , address=185.167.204.206:4040 , piece_id=FW2G4XCVY4LOVZSHQ25TCFTCDYMRLHXVNBU76OIIGI2UTTIIQXKQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.142641292 (832h8m36.840209598s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.151782239 (832h8m36.849350555s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152331545 (832h8m36.849899861s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152813115 (832h8m36.850381431s) [noise=true , address=185.167.204.205:4026 , piece_id=SKCE257VNOP62EKHFZQGGYZ7AIA5GWCT4ZW7IQOXQJSVDYKODMRQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.172329604 (832h8m36.869897921s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.179173059 (832h8m36.876741375s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.196489869 (832h8m36.894058175s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.198678477 (832h8m36.896246784s) [noise=true , address=81.171.14.70:4045 , piece_id=J5I4QOVP6ROOB6ZCB75VRTP37ISKCLJ6BJNRZTT3CHOZO2ORKQ5A, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.576067236 (832h8m37.273635542s) [noise=true , address=81.171.14.70:4026 , piece_id=XXAI6MD34XUH6PEPYOVHKMG4GXCEAM4WHKZDM3UHXSKNG2NAPOMA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.612447320 (832h8m37.310015636s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.674090269 (832h8m37.371658585s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.698435238 (832h8m37.396003554s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:38:48.005767171 (832h9m35.703335477s) [noise=true , address=81.171.14.70:4042 , piece_id=SBER7MUZFU5HXAAQN5W7IPGYZ4RQZNX7LCV3PHDCQIIN2P7GHVGQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: context deadline exceeded; context deadline exceeded
Jan 9 07:38:48.005822034 (832h9m35.70339034s) [noise=true , address=81.171.14.70:4035 , piece_id=JCZZOD3KHUISYLIPJKGMAHZ5QOPKTZMHIPGUCAGJHBZX2ZYBALUA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: rpc: dial tcp 81.171.14.70:4035: i/o timeout; context deadline exceeded
Jan 9 07:38:48.005952648 (832h9m35.703520984s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 5.161.89.252:32526->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 9 07:38:48.005994226 (832h9m35.703562562s) [seg_pos={0 0}, upload=732073]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 9 07:38:48.109550624 (832h9m35.80711896s) [upload=732073]: Done uploading segments...
Jan 9 07:38:48.109585420 (832h9m35.807153755s) [upload=732073]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.283002509s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.616546068s trace:
https://jaeger.dev.storj.io/trace/6735d4b874ab1ef5
FAIL (2026-01-09 08:21:59 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
03564596s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.408402825 (832h8m36.105971141s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.409232034 (832h8m36.10680034s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.410100727 (832h8m36.107669033s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.411643299 (832h8m36.109211605s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.412026585 (832h8m36.109594931s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.413398217 (832h8m36.110966523s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414194315 (832h8m36.111762621s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414527187 (832h8m36.112095493s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.417979455 (832h8m36.115547771s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.419110590 (832h8m36.116678906s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.420189664 (832h8m36.117757981s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.421246770 (832h8m36.118815076s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.864750971 (832h8m36.562319277s) [upload=732073]: Next returned nil segment
Jan 9 07:37:48.864760439 (832h8m36.562328755s) [upload=732073]: Waiting for error group managing segments...
Jan 9 07:37:49.079903909 (832h8m36.777472216s) [noise=true , address=185.167.204.205:4014 , piece_id=JTQC4RDGKGUW7LPJKMG4FQQP4PDZURUNCLN7D5IR6DVYKCXTDXMQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081476859 (832h8m36.779045164s) [noise=true , address=185.167.204.205:4036 , piece_id=36F5ETODK33CJ3DYLVDO74ILEUCO46EOGFSDOIYFIZOFMSYCWZJQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081854243 (832h8m36.779422549s) [noise=true , address=185.167.204.206:4047 , piece_id=NX5VZNEAAQWZIVENWWI6D6JGPSVAR25G7UNLR4VM2IO3R5R2RNFA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.084019388 (832h8m36.781587694s) [noise=true , address=185.167.204.205:4030 , piece_id=XDZNUF4U7B3LBSGGDF5KQMFAMULAVDBGV77W2HLB3TQ6A63T2LKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085665192 (832h8m36.783233498s) [noise=true , address=185.167.204.205:4016 , piece_id=7DOGCUU3CLYQEXEDHJEA3TBLPZXG2ZYZ2ELHPMI6ABEN3SCHVIGA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085685219 (832h8m36.783253526s) [noise=true , address=185.167.204.206:4063 , piece_id=TS7CR4OJYFCIVJTYUIDMZG6OFGDTD2UEXBTYXRCUPX6PPKWMQI3Q, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.092142522 (832h8m36.789710829s) [noise=true , address=89.149.201.147:4003 , piece_id=G44C4AXJFDLENH24JTOYRMOT2W2TQYKBG4VKCTJVI42IWDZAUMKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.094372309 (832h8m36.791940614s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.099207151 (832h8m36.796775457s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.100548106 (832h8m36.798116402s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.126257155 (832h8m36.82382546s) [noise=true , address=185.167.204.206:4068 , piece_id=4BHBFT7M5FRFXI2BHSA6EKXDFCU3GCXBVVITTB2WIEFU4P36VAIA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.133142828 (832h8m36.830711144s) [noise=true , address=185.167.204.205:4011 , piece_id=ZWVL45YULGYIG6D32ZEKCXGMIQQYVH4JVEXQPL32SNGOBDYWN3KQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.134306753 (832h8m36.831875069s) [noise=true , address=185.167.204.206:4040 , piece_id=FW2G4XCVY4LOVZSHQ25TCFTCDYMRLHXVNBU76OIIGI2UTTIIQXKQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.142641292 (832h8m36.840209598s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.151782239 (832h8m36.849350555s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152331545 (832h8m36.849899861s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152813115 (832h8m36.850381431s) [noise=true , address=185.167.204.205:4026 , piece_id=SKCE257VNOP62EKHFZQGGYZ7AIA5GWCT4ZW7IQOXQJSVDYKODMRQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.172329604 (832h8m36.869897921s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.179173059 (832h8m36.876741375s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.196489869 (832h8m36.894058175s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.198678477 (832h8m36.896246784s) [noise=true , address=81.171.14.70:4045 , piece_id=J5I4QOVP6ROOB6ZCB75VRTP37ISKCLJ6BJNRZTT3CHOZO2ORKQ5A, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.576067236 (832h8m37.273635542s) [noise=true , address=81.171.14.70:4026 , piece_id=XXAI6MD34XUH6PEPYOVHKMG4GXCEAM4WHKZDM3UHXSKNG2NAPOMA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.612447320 (832h8m37.310015636s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.674090269 (832h8m37.371658585s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.698435238 (832h8m37.396003554s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:38:48.005767171 (832h9m35.703335477s) [noise=true , address=81.171.14.70:4042 , piece_id=SBER7MUZFU5HXAAQN5W7IPGYZ4RQZNX7LCV3PHDCQIIN2P7GHVGQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: context deadline exceeded; context deadline exceeded
Jan 9 07:38:48.005822034 (832h9m35.70339034s) [noise=true , address=81.171.14.70:4035 , piece_id=JCZZOD3KHUISYLIPJKGMAHZ5QOPKTZMHIPGUCAGJHBZX2ZYBALUA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: rpc: dial tcp 81.171.14.70:4035: i/o timeout; context deadline exceeded
Jan 9 07:38:48.005952648 (832h9m35.703520984s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 5.161.89.252:32526->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 9 07:38:48.005994226 (832h9m35.703562562s) [seg_pos={0 0}, upload=732073]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 9 07:38:48.109550624 (832h9m35.80711896s) [upload=732073]: Done uploading segments...
Jan 9 07:38:48.109585420 (832h9m35.807153755s) [upload=732073]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.616566877s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
3 out of 60 is failed (threshold=3) [.XXX........................................................] duration:
204.79043ms trace:
https://jaeger.dev.storj.io/trace/f4bac8f86eddf53
FAIL (2026-01-09 08:21:49 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 204.835865ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [X.X.........................................................] duration:
2.290093774s trace:
https://jaeger.dev.storj.io/trace/6735d4b874ab1ef5
FAIL (2026-01-09 08:20:54 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
03564596s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.408402825 (832h8m36.105971141s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.409232034 (832h8m36.10680034s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.410100727 (832h8m36.107669033s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.411643299 (832h8m36.109211605s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.412026585 (832h8m36.109594931s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.413398217 (832h8m36.110966523s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414194315 (832h8m36.111762621s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414527187 (832h8m36.112095493s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.417979455 (832h8m36.115547771s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.419110590 (832h8m36.116678906s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.420189664 (832h8m36.117757981s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.421246770 (832h8m36.118815076s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.864750971 (832h8m36.562319277s) [upload=732073]: Next returned nil segment
Jan 9 07:37:48.864760439 (832h8m36.562328755s) [upload=732073]: Waiting for error group managing segments...
Jan 9 07:37:49.079903909 (832h8m36.777472216s) [noise=true , address=185.167.204.205:4014 , piece_id=JTQC4RDGKGUW7LPJKMG4FQQP4PDZURUNCLN7D5IR6DVYKCXTDXMQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081476859 (832h8m36.779045164s) [noise=true , address=185.167.204.205:4036 , piece_id=36F5ETODK33CJ3DYLVDO74ILEUCO46EOGFSDOIYFIZOFMSYCWZJQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081854243 (832h8m36.779422549s) [noise=true , address=185.167.204.206:4047 , piece_id=NX5VZNEAAQWZIVENWWI6D6JGPSVAR25G7UNLR4VM2IO3R5R2RNFA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.084019388 (832h8m36.781587694s) [noise=true , address=185.167.204.205:4030 , piece_id=XDZNUF4U7B3LBSGGDF5KQMFAMULAVDBGV77W2HLB3TQ6A63T2LKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085665192 (832h8m36.783233498s) [noise=true , address=185.167.204.205:4016 , piece_id=7DOGCUU3CLYQEXEDHJEA3TBLPZXG2ZYZ2ELHPMI6ABEN3SCHVIGA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085685219 (832h8m36.783253526s) [noise=true , address=185.167.204.206:4063 , piece_id=TS7CR4OJYFCIVJTYUIDMZG6OFGDTD2UEXBTYXRCUPX6PPKWMQI3Q, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.092142522 (832h8m36.789710829s) [noise=true , address=89.149.201.147:4003 , piece_id=G44C4AXJFDLENH24JTOYRMOT2W2TQYKBG4VKCTJVI42IWDZAUMKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.094372309 (832h8m36.791940614s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.099207151 (832h8m36.796775457s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.100548106 (832h8m36.798116402s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.126257155 (832h8m36.82382546s) [noise=true , address=185.167.204.206:4068 , piece_id=4BHBFT7M5FRFXI2BHSA6EKXDFCU3GCXBVVITTB2WIEFU4P36VAIA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.133142828 (832h8m36.830711144s) [noise=true , address=185.167.204.205:4011 , piece_id=ZWVL45YULGYIG6D32ZEKCXGMIQQYVH4JVEXQPL32SNGOBDYWN3KQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.134306753 (832h8m36.831875069s) [noise=true , address=185.167.204.206:4040 , piece_id=FW2G4XCVY4LOVZSHQ25TCFTCDYMRLHXVNBU76OIIGI2UTTIIQXKQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.142641292 (832h8m36.840209598s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.151782239 (832h8m36.849350555s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152331545 (832h8m36.849899861s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152813115 (832h8m36.850381431s) [noise=true , address=185.167.204.205:4026 , piece_id=SKCE257VNOP62EKHFZQGGYZ7AIA5GWCT4ZW7IQOXQJSVDYKODMRQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.172329604 (832h8m36.869897921s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.179173059 (832h8m36.876741375s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.196489869 (832h8m36.894058175s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.198678477 (832h8m36.896246784s) [noise=true , address=81.171.14.70:4045 , piece_id=J5I4QOVP6ROOB6ZCB75VRTP37ISKCLJ6BJNRZTT3CHOZO2ORKQ5A, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.576067236 (832h8m37.273635542s) [noise=true , address=81.171.14.70:4026 , piece_id=XXAI6MD34XUH6PEPYOVHKMG4GXCEAM4WHKZDM3UHXSKNG2NAPOMA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.612447320 (832h8m37.310015636s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.674090269 (832h8m37.371658585s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.698435238 (832h8m37.396003554s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:38:48.005767171 (832h9m35.703335477s) [noise=true , address=81.171.14.70:4042 , piece_id=SBER7MUZFU5HXAAQN5W7IPGYZ4RQZNX7LCV3PHDCQIIN2P7GHVGQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: context deadline exceeded; context deadline exceeded
Jan 9 07:38:48.005822034 (832h9m35.70339034s) [noise=true , address=81.171.14.70:4035 , piece_id=JCZZOD3KHUISYLIPJKGMAHZ5QOPKTZMHIPGUCAGJHBZX2ZYBALUA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: rpc: dial tcp 81.171.14.70:4035: i/o timeout; context deadline exceeded
Jan 9 07:38:48.005952648 (832h9m35.703520984s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 5.161.89.252:32526->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 9 07:38:48.005994226 (832h9m35.703562562s) [seg_pos={0 0}, upload=732073]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 9 07:38:48.109550624 (832h9m35.80711896s) [upload=732073]: Done uploading segments...
Jan 9 07:38:48.109585420 (832h9m35.807153755s) [upload=732073]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.29011293s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
131.210893ms target:
https://version.storj.io/ trace:
https://jaeger.dev.storj.io/trace/1634496fdb368bf9
FAIL (2026-01-09 08:20:52 UTC)
orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: i/o timeout
Duration: 131.223517ms
core
website
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
3 out of 60 is failed (threshold=3) [..XXX.......................................................] duration:
167.96211ms trace:
https://jaeger.dev.storj.io/trace/f4bac8f86eddf53
FAIL (2026-01-09 08:20:51 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 167.979904ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
380.656398ms trace:
https://jaeger.dev.storj.io/trace/5af4d89436e82463
FAIL (2026-01-09 08:20:48 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 380.681485ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [XX.X........................................................] duration:
2.166458153s trace:
https://jaeger.dev.storj.io/trace/6735d4b874ab1ef5
FAIL (2026-01-09 08:20:34 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
03564596s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.408402825 (832h8m36.105971141s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.409232034 (832h8m36.10680034s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.410100727 (832h8m36.107669033s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.411643299 (832h8m36.109211605s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.412026585 (832h8m36.109594931s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.413398217 (832h8m36.110966523s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414194315 (832h8m36.111762621s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414527187 (832h8m36.112095493s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.417979455 (832h8m36.115547771s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.419110590 (832h8m36.116678906s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.420189664 (832h8m36.117757981s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.421246770 (832h8m36.118815076s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.864750971 (832h8m36.562319277s) [upload=732073]: Next returned nil segment
Jan 9 07:37:48.864760439 (832h8m36.562328755s) [upload=732073]: Waiting for error group managing segments...
Jan 9 07:37:49.079903909 (832h8m36.777472216s) [noise=true , address=185.167.204.205:4014 , piece_id=JTQC4RDGKGUW7LPJKMG4FQQP4PDZURUNCLN7D5IR6DVYKCXTDXMQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081476859 (832h8m36.779045164s) [noise=true , address=185.167.204.205:4036 , piece_id=36F5ETODK33CJ3DYLVDO74ILEUCO46EOGFSDOIYFIZOFMSYCWZJQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081854243 (832h8m36.779422549s) [noise=true , address=185.167.204.206:4047 , piece_id=NX5VZNEAAQWZIVENWWI6D6JGPSVAR25G7UNLR4VM2IO3R5R2RNFA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.084019388 (832h8m36.781587694s) [noise=true , address=185.167.204.205:4030 , piece_id=XDZNUF4U7B3LBSGGDF5KQMFAMULAVDBGV77W2HLB3TQ6A63T2LKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085665192 (832h8m36.783233498s) [noise=true , address=185.167.204.205:4016 , piece_id=7DOGCUU3CLYQEXEDHJEA3TBLPZXG2ZYZ2ELHPMI6ABEN3SCHVIGA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085685219 (832h8m36.783253526s) [noise=true , address=185.167.204.206:4063 , piece_id=TS7CR4OJYFCIVJTYUIDMZG6OFGDTD2UEXBTYXRCUPX6PPKWMQI3Q, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.092142522 (832h8m36.789710829s) [noise=true , address=89.149.201.147:4003 , piece_id=G44C4AXJFDLENH24JTOYRMOT2W2TQYKBG4VKCTJVI42IWDZAUMKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.094372309 (832h8m36.791940614s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.099207151 (832h8m36.796775457s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.100548106 (832h8m36.798116402s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.126257155 (832h8m36.82382546s) [noise=true , address=185.167.204.206:4068 , piece_id=4BHBFT7M5FRFXI2BHSA6EKXDFCU3GCXBVVITTB2WIEFU4P36VAIA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.133142828 (832h8m36.830711144s) [noise=true , address=185.167.204.205:4011 , piece_id=ZWVL45YULGYIG6D32ZEKCXGMIQQYVH4JVEXQPL32SNGOBDYWN3KQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.134306753 (832h8m36.831875069s) [noise=true , address=185.167.204.206:4040 , piece_id=FW2G4XCVY4LOVZSHQ25TCFTCDYMRLHXVNBU76OIIGI2UTTIIQXKQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.142641292 (832h8m36.840209598s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.151782239 (832h8m36.849350555s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152331545 (832h8m36.849899861s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152813115 (832h8m36.850381431s) [noise=true , address=185.167.204.205:4026 , piece_id=SKCE257VNOP62EKHFZQGGYZ7AIA5GWCT4ZW7IQOXQJSVDYKODMRQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.172329604 (832h8m36.869897921s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.179173059 (832h8m36.876741375s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.196489869 (832h8m36.894058175s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.198678477 (832h8m36.896246784s) [noise=true , address=81.171.14.70:4045 , piece_id=J5I4QOVP6ROOB6ZCB75VRTP37ISKCLJ6BJNRZTT3CHOZO2ORKQ5A, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.576067236 (832h8m37.273635542s) [noise=true , address=81.171.14.70:4026 , piece_id=XXAI6MD34XUH6PEPYOVHKMG4GXCEAM4WHKZDM3UHXSKNG2NAPOMA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.612447320 (832h8m37.310015636s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.674090269 (832h8m37.371658585s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.698435238 (832h8m37.396003554s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:38:48.005767171 (832h9m35.703335477s) [noise=true , address=81.171.14.70:4042 , piece_id=SBER7MUZFU5HXAAQN5W7IPGYZ4RQZNX7LCV3PHDCQIIN2P7GHVGQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: context deadline exceeded; context deadline exceeded
Jan 9 07:38:48.005822034 (832h9m35.70339034s) [noise=true , address=81.171.14.70:4035 , piece_id=JCZZOD3KHUISYLIPJKGMAHZ5QOPKTZMHIPGUCAGJHBZX2ZYBALUA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: rpc: dial tcp 81.171.14.70:4035: i/o timeout; context deadline exceeded
Jan 9 07:38:48.005952648 (832h9m35.703520984s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 5.161.89.252:32526->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 9 07:38:48.005994226 (832h9m35.703562562s) [seg_pos={0 0}, upload=732073]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 9 07:38:48.109550624 (832h9m35.80711896s) [upload=732073]: Done uploading segments...
Jan 9 07:38:48.109585420 (832h9m35.807153755s) [upload=732073]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.166477329s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
40.18879ms target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/562634a9d869637c
FAIL (2026-01-09 08:20:24 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout
Duration: 40.21479ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
2 out of 60 is failed (threshold=3) [XX..........................................................] duration:
130.958251ms target:
https://version.storj.io/ trace:
https://jaeger.dev.storj.io/trace/1634496fdb368bf9
FAIL (2026-01-09 08:20:06 UTC)
orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: i/o timeout
Duration: 130.981724ms
core
website
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
369.615709ms trace:
https://jaeger.dev.storj.io/trace/5af4d89436e82463
FAIL (2026-01-09 08:19:58 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 369.638262ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
2 out of 60 is failed (threshold=3) [.XX.........................................................] duration:
135.055155ms target:
https://version.storj.io/ trace:
https://jaeger.dev.storj.io/trace/1634496fdb368bf9
FAIL (2026-01-09 08:19:48 UTC)
orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: i/o timeout
Duration: 135.077836ms
core
website
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
17.200855ms target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/562634a9d869637c
FAIL (2026-01-09 08:19:47 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout
Duration: 17.217315ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
3 out of 60 is failed (threshold=3) [...XXX......................................................] duration:
226.664887ms trace:
https://jaeger.dev.storj.io/trace/f4bac8f86eddf53
FAIL (2026-01-09 08:19:38 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 226.684053ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
35.176325ms target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/562634a9d869637c
FAIL (2026-01-09 08:19:27 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout
Duration: 35.198517ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [.XX.X.......................................................] duration:
2.764221844s trace:
https://jaeger.dev.storj.io/trace/6735d4b874ab1ef5
FAIL (2026-01-09 08:19:25 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
03564596s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.408402825 (832h8m36.105971141s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.409232034 (832h8m36.10680034s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.410100727 (832h8m36.107669033s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.411643299 (832h8m36.109211605s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.412026585 (832h8m36.109594931s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.413398217 (832h8m36.110966523s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414194315 (832h8m36.111762621s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414527187 (832h8m36.112095493s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.417979455 (832h8m36.115547771s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.419110590 (832h8m36.116678906s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.420189664 (832h8m36.117757981s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.421246770 (832h8m36.118815076s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.864750971 (832h8m36.562319277s) [upload=732073]: Next returned nil segment
Jan 9 07:37:48.864760439 (832h8m36.562328755s) [upload=732073]: Waiting for error group managing segments...
Jan 9 07:37:49.079903909 (832h8m36.777472216s) [noise=true , address=185.167.204.205:4014 , piece_id=JTQC4RDGKGUW7LPJKMG4FQQP4PDZURUNCLN7D5IR6DVYKCXTDXMQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081476859 (832h8m36.779045164s) [noise=true , address=185.167.204.205:4036 , piece_id=36F5ETODK33CJ3DYLVDO74ILEUCO46EOGFSDOIYFIZOFMSYCWZJQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081854243 (832h8m36.779422549s) [noise=true , address=185.167.204.206:4047 , piece_id=NX5VZNEAAQWZIVENWWI6D6JGPSVAR25G7UNLR4VM2IO3R5R2RNFA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.084019388 (832h8m36.781587694s) [noise=true , address=185.167.204.205:4030 , piece_id=XDZNUF4U7B3LBSGGDF5KQMFAMULAVDBGV77W2HLB3TQ6A63T2LKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085665192 (832h8m36.783233498s) [noise=true , address=185.167.204.205:4016 , piece_id=7DOGCUU3CLYQEXEDHJEA3TBLPZXG2ZYZ2ELHPMI6ABEN3SCHVIGA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085685219 (832h8m36.783253526s) [noise=true , address=185.167.204.206:4063 , piece_id=TS7CR4OJYFCIVJTYUIDMZG6OFGDTD2UEXBTYXRCUPX6PPKWMQI3Q, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.092142522 (832h8m36.789710829s) [noise=true , address=89.149.201.147:4003 , piece_id=G44C4AXJFDLENH24JTOYRMOT2W2TQYKBG4VKCTJVI42IWDZAUMKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.094372309 (832h8m36.791940614s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.099207151 (832h8m36.796775457s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.100548106 (832h8m36.798116402s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.126257155 (832h8m36.82382546s) [noise=true , address=185.167.204.206:4068 , piece_id=4BHBFT7M5FRFXI2BHSA6EKXDFCU3GCXBVVITTB2WIEFU4P36VAIA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.133142828 (832h8m36.830711144s) [noise=true , address=185.167.204.205:4011 , piece_id=ZWVL45YULGYIG6D32ZEKCXGMIQQYVH4JVEXQPL32SNGOBDYWN3KQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.134306753 (832h8m36.831875069s) [noise=true , address=185.167.204.206:4040 , piece_id=FW2G4XCVY4LOVZSHQ25TCFTCDYMRLHXVNBU76OIIGI2UTTIIQXKQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.142641292 (832h8m36.840209598s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.151782239 (832h8m36.849350555s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152331545 (832h8m36.849899861s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152813115 (832h8m36.850381431s) [noise=true , address=185.167.204.205:4026 , piece_id=SKCE257VNOP62EKHFZQGGYZ7AIA5GWCT4ZW7IQOXQJSVDYKODMRQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.172329604 (832h8m36.869897921s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.179173059 (832h8m36.876741375s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.196489869 (832h8m36.894058175s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.198678477 (832h8m36.896246784s) [noise=true , address=81.171.14.70:4045 , piece_id=J5I4QOVP6ROOB6ZCB75VRTP37ISKCLJ6BJNRZTT3CHOZO2ORKQ5A, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.576067236 (832h8m37.273635542s) [noise=true , address=81.171.14.70:4026 , piece_id=XXAI6MD34XUH6PEPYOVHKMG4GXCEAM4WHKZDM3UHXSKNG2NAPOMA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.612447320 (832h8m37.310015636s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.674090269 (832h8m37.371658585s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.698435238 (832h8m37.396003554s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:38:48.005767171 (832h9m35.703335477s) [noise=true , address=81.171.14.70:4042 , piece_id=SBER7MUZFU5HXAAQN5W7IPGYZ4RQZNX7LCV3PHDCQIIN2P7GHVGQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: context deadline exceeded; context deadline exceeded
Jan 9 07:38:48.005822034 (832h9m35.70339034s) [noise=true , address=81.171.14.70:4035 , piece_id=JCZZOD3KHUISYLIPJKGMAHZ5QOPKTZMHIPGUCAGJHBZX2ZYBALUA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: rpc: dial tcp 81.171.14.70:4035: i/o timeout; context deadline exceeded
Jan 9 07:38:48.005952648 (832h9m35.703520984s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 5.161.89.252:32526->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 9 07:38:48.005994226 (832h9m35.703562562s) [seg_pos={0 0}, upload=732073]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 9 07:38:48.109550624 (832h9m35.80711896s) [upload=732073]: Done uploading segments...
Jan 9 07:38:48.109585420 (832h9m35.807153755s) [upload=732073]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.76424671s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [X.X.........................................................] duration:
330.674646ms trace:
https://jaeger.dev.storj.io/trace/5af4d89436e82463
FAIL (2026-01-09 08:19:08 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 330.69272ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
2 out of 60 is failed (threshold=3) [..XX........................................................] duration:
132.315668ms target:
https://version.storj.io/ trace:
https://jaeger.dev.storj.io/trace/1634496fdb368bf9
FAIL (2026-01-09 08:19:05 UTC)
orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: i/o timeout
Duration: 132.341206ms
core
website
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [..XX.X......................................................] duration:
2.721373905s trace:
https://jaeger.dev.storj.io/trace/6735d4b874ab1ef5
FAIL (2026-01-09 08:18:55 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
03564596s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.408402825 (832h8m36.105971141s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.409232034 (832h8m36.10680034s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.410100727 (832h8m36.107669033s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.411643299 (832h8m36.109211605s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.412026585 (832h8m36.109594931s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.413398217 (832h8m36.110966523s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414194315 (832h8m36.111762621s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414527187 (832h8m36.112095493s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.417979455 (832h8m36.115547771s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.419110590 (832h8m36.116678906s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.420189664 (832h8m36.117757981s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.421246770 (832h8m36.118815076s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.864750971 (832h8m36.562319277s) [upload=732073]: Next returned nil segment
Jan 9 07:37:48.864760439 (832h8m36.562328755s) [upload=732073]: Waiting for error group managing segments...
Jan 9 07:37:49.079903909 (832h8m36.777472216s) [noise=true , address=185.167.204.205:4014 , piece_id=JTQC4RDGKGUW7LPJKMG4FQQP4PDZURUNCLN7D5IR6DVYKCXTDXMQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081476859 (832h8m36.779045164s) [noise=true , address=185.167.204.205:4036 , piece_id=36F5ETODK33CJ3DYLVDO74ILEUCO46EOGFSDOIYFIZOFMSYCWZJQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081854243 (832h8m36.779422549s) [noise=true , address=185.167.204.206:4047 , piece_id=NX5VZNEAAQWZIVENWWI6D6JGPSVAR25G7UNLR4VM2IO3R5R2RNFA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.084019388 (832h8m36.781587694s) [noise=true , address=185.167.204.205:4030 , piece_id=XDZNUF4U7B3LBSGGDF5KQMFAMULAVDBGV77W2HLB3TQ6A63T2LKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085665192 (832h8m36.783233498s) [noise=true , address=185.167.204.205:4016 , piece_id=7DOGCUU3CLYQEXEDHJEA3TBLPZXG2ZYZ2ELHPMI6ABEN3SCHVIGA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085685219 (832h8m36.783253526s) [noise=true , address=185.167.204.206:4063 , piece_id=TS7CR4OJYFCIVJTYUIDMZG6OFGDTD2UEXBTYXRCUPX6PPKWMQI3Q, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.092142522 (832h8m36.789710829s) [noise=true , address=89.149.201.147:4003 , piece_id=G44C4AXJFDLENH24JTOYRMOT2W2TQYKBG4VKCTJVI42IWDZAUMKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.094372309 (832h8m36.791940614s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.099207151 (832h8m36.796775457s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.100548106 (832h8m36.798116402s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.126257155 (832h8m36.82382546s) [noise=true , address=185.167.204.206:4068 , piece_id=4BHBFT7M5FRFXI2BHSA6EKXDFCU3GCXBVVITTB2WIEFU4P36VAIA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.133142828 (832h8m36.830711144s) [noise=true , address=185.167.204.205:4011 , piece_id=ZWVL45YULGYIG6D32ZEKCXGMIQQYVH4JVEXQPL32SNGOBDYWN3KQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.134306753 (832h8m36.831875069s) [noise=true , address=185.167.204.206:4040 , piece_id=FW2G4XCVY4LOVZSHQ25TCFTCDYMRLHXVNBU76OIIGI2UTTIIQXKQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.142641292 (832h8m36.840209598s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.151782239 (832h8m36.849350555s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152331545 (832h8m36.849899861s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152813115 (832h8m36.850381431s) [noise=true , address=185.167.204.205:4026 , piece_id=SKCE257VNOP62EKHFZQGGYZ7AIA5GWCT4ZW7IQOXQJSVDYKODMRQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.172329604 (832h8m36.869897921s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.179173059 (832h8m36.876741375s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.196489869 (832h8m36.894058175s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.198678477 (832h8m36.896246784s) [noise=true , address=81.171.14.70:4045 , piece_id=J5I4QOVP6ROOB6ZCB75VRTP37ISKCLJ6BJNRZTT3CHOZO2ORKQ5A, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.576067236 (832h8m37.273635542s) [noise=true , address=81.171.14.70:4026 , piece_id=XXAI6MD34XUH6PEPYOVHKMG4GXCEAM4WHKZDM3UHXSKNG2NAPOMA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.612447320 (832h8m37.310015636s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.674090269 (832h8m37.371658585s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.698435238 (832h8m37.396003554s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:38:48.005767171 (832h9m35.703335477s) [noise=true , address=81.171.14.70:4042 , piece_id=SBER7MUZFU5HXAAQN5W7IPGYZ4RQZNX7LCV3PHDCQIIN2P7GHVGQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: context deadline exceeded; context deadline exceeded
Jan 9 07:38:48.005822034 (832h9m35.70339034s) [noise=true , address=81.171.14.70:4035 , piece_id=JCZZOD3KHUISYLIPJKGMAHZ5QOPKTZMHIPGUCAGJHBZX2ZYBALUA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: rpc: dial tcp 81.171.14.70:4035: i/o timeout; context deadline exceeded
Jan 9 07:38:48.005952648 (832h9m35.703520984s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 5.161.89.252:32526->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 9 07:38:48.005994226 (832h9m35.703562562s) [seg_pos={0 0}, upload=732073]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 9 07:38:48.109550624 (832h9m35.80711896s) [upload=732073]: Done uploading segments...
Jan 9 07:38:48.109585420 (832h9m35.807153755s) [upload=732073]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.721397389s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
3 out of 60 is failed (threshold=3) [....XXX.....................................................] duration:
171.548691ms trace:
https://jaeger.dev.storj.io/trace/f4bac8f86eddf53
FAIL (2026-01-09 08:18:52 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 171.56439ms
edge
gateway
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
40.604054ms trace:
https://jaeger.dev.storj.io/trace/4d3b7b3eb36724ba
FAIL (2026-01-09 08:18:52 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 40.62351ms
edge
authservice
http
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X.X........................................................] duration:
356.214779ms trace:
https://jaeger.dev.storj.io/trace/5af4d89436e82463
FAIL (2026-01-09 08:18:50 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 356.231199ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
2 out of 60 is failed (threshold=3) [...XX.......................................................] duration:
130.360744ms target:
https://version.storj.io/ trace:
https://jaeger.dev.storj.io/trace/1634496fdb368bf9
FAIL (2026-01-09 08:18:19 UTC)
orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: i/o timeout
Duration: 130.378167ms
core
website
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
16.557071ms target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/562634a9d869637c
FAIL (2026-01-09 08:18:18 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout
Duration: 16.575185ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....XXX....................................................] duration:
188.451979ms trace:
https://jaeger.dev.storj.io/trace/f4bac8f86eddf53
FAIL (2026-01-09 08:18:10 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 188.475983ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [...XX.X.....................................................] duration:
2.386535364s trace:
https://jaeger.dev.storj.io/trace/6735d4b874ab1ef5
FAIL (2026-01-09 08:17:59 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
03564596s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.408402825 (832h8m36.105971141s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.409232034 (832h8m36.10680034s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.410100727 (832h8m36.107669033s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.411643299 (832h8m36.109211605s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.412026585 (832h8m36.109594931s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.413398217 (832h8m36.110966523s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414194315 (832h8m36.111762621s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414527187 (832h8m36.112095493s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.417979455 (832h8m36.115547771s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.419110590 (832h8m36.116678906s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.420189664 (832h8m36.117757981s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.421246770 (832h8m36.118815076s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.864750971 (832h8m36.562319277s) [upload=732073]: Next returned nil segment
Jan 9 07:37:48.864760439 (832h8m36.562328755s) [upload=732073]: Waiting for error group managing segments...
Jan 9 07:37:49.079903909 (832h8m36.777472216s) [noise=true , address=185.167.204.205:4014 , piece_id=JTQC4RDGKGUW7LPJKMG4FQQP4PDZURUNCLN7D5IR6DVYKCXTDXMQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081476859 (832h8m36.779045164s) [noise=true , address=185.167.204.205:4036 , piece_id=36F5ETODK33CJ3DYLVDO74ILEUCO46EOGFSDOIYFIZOFMSYCWZJQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081854243 (832h8m36.779422549s) [noise=true , address=185.167.204.206:4047 , piece_id=NX5VZNEAAQWZIVENWWI6D6JGPSVAR25G7UNLR4VM2IO3R5R2RNFA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.084019388 (832h8m36.781587694s) [noise=true , address=185.167.204.205:4030 , piece_id=XDZNUF4U7B3LBSGGDF5KQMFAMULAVDBGV77W2HLB3TQ6A63T2LKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085665192 (832h8m36.783233498s) [noise=true , address=185.167.204.205:4016 , piece_id=7DOGCUU3CLYQEXEDHJEA3TBLPZXG2ZYZ2ELHPMI6ABEN3SCHVIGA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085685219 (832h8m36.783253526s) [noise=true , address=185.167.204.206:4063 , piece_id=TS7CR4OJYFCIVJTYUIDMZG6OFGDTD2UEXBTYXRCUPX6PPKWMQI3Q, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.092142522 (832h8m36.789710829s) [noise=true , address=89.149.201.147:4003 , piece_id=G44C4AXJFDLENH24JTOYRMOT2W2TQYKBG4VKCTJVI42IWDZAUMKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.094372309 (832h8m36.791940614s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.099207151 (832h8m36.796775457s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.100548106 (832h8m36.798116402s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.126257155 (832h8m36.82382546s) [noise=true , address=185.167.204.206:4068 , piece_id=4BHBFT7M5FRFXI2BHSA6EKXDFCU3GCXBVVITTB2WIEFU4P36VAIA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.133142828 (832h8m36.830711144s) [noise=true , address=185.167.204.205:4011 , piece_id=ZWVL45YULGYIG6D32ZEKCXGMIQQYVH4JVEXQPL32SNGOBDYWN3KQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.134306753 (832h8m36.831875069s) [noise=true , address=185.167.204.206:4040 , piece_id=FW2G4XCVY4LOVZSHQ25TCFTCDYMRLHXVNBU76OIIGI2UTTIIQXKQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.142641292 (832h8m36.840209598s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.151782239 (832h8m36.849350555s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152331545 (832h8m36.849899861s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152813115 (832h8m36.850381431s) [noise=true , address=185.167.204.205:4026 , piece_id=SKCE257VNOP62EKHFZQGGYZ7AIA5GWCT4ZW7IQOXQJSVDYKODMRQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.172329604 (832h8m36.869897921s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.179173059 (832h8m36.876741375s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.196489869 (832h8m36.894058175s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.198678477 (832h8m36.896246784s) [noise=true , address=81.171.14.70:4045 , piece_id=J5I4QOVP6ROOB6ZCB75VRTP37ISKCLJ6BJNRZTT3CHOZO2ORKQ5A, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.576067236 (832h8m37.273635542s) [noise=true , address=81.171.14.70:4026 , piece_id=XXAI6MD34XUH6PEPYOVHKMG4GXCEAM4WHKZDM3UHXSKNG2NAPOMA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.612447320 (832h8m37.310015636s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.674090269 (832h8m37.371658585s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.698435238 (832h8m37.396003554s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:38:48.005767171 (832h9m35.703335477s) [noise=true , address=81.171.14.70:4042 , piece_id=SBER7MUZFU5HXAAQN5W7IPGYZ4RQZNX7LCV3PHDCQIIN2P7GHVGQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: context deadline exceeded; context deadline exceeded
Jan 9 07:38:48.005822034 (832h9m35.70339034s) [noise=true , address=81.171.14.70:4035 , piece_id=JCZZOD3KHUISYLIPJKGMAHZ5QOPKTZMHIPGUCAGJHBZX2ZYBALUA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: rpc: dial tcp 81.171.14.70:4035: i/o timeout; context deadline exceeded
Jan 9 07:38:48.005952648 (832h9m35.703520984s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 5.161.89.252:32526->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 9 07:38:48.005994226 (832h9m35.703562562s) [seg_pos={0 0}, upload=732073]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 9 07:38:48.109550624 (832h9m35.80711896s) [upload=732073]: Done uploading segments...
Jan 9 07:38:48.109585420 (832h9m35.807153755s) [upload=732073]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.386562254s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
37.374913ms target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/562634a9d869637c
FAIL (2026-01-09 08:17:58 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout
Duration: 37.395541ms
edge
gateway
vhost
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
2 out of 60 is failed (threshold=3) [XX..........................................................] duration:
38.421877ms trace:
https://jaeger.dev.storj.io/trace/4d3b7b3eb36724ba
FAIL (2026-01-09 08:17:48 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 38.445752ms
edge
authservice
http
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [....XX.X....................................................] duration:
2.590902671s trace:
https://jaeger.dev.storj.io/trace/6735d4b874ab1ef5
FAIL (2026-01-09 08:17:38 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
03564596s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.408402825 (832h8m36.105971141s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.409232034 (832h8m36.10680034s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.410100727 (832h8m36.107669033s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.411643299 (832h8m36.109211605s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.412026585 (832h8m36.109594931s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.413398217 (832h8m36.110966523s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414194315 (832h8m36.111762621s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414527187 (832h8m36.112095493s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.417979455 (832h8m36.115547771s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.419110590 (832h8m36.116678906s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.420189664 (832h8m36.117757981s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.421246770 (832h8m36.118815076s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.864750971 (832h8m36.562319277s) [upload=732073]: Next returned nil segment
Jan 9 07:37:48.864760439 (832h8m36.562328755s) [upload=732073]: Waiting for error group managing segments...
Jan 9 07:37:49.079903909 (832h8m36.777472216s) [noise=true , address=185.167.204.205:4014 , piece_id=JTQC4RDGKGUW7LPJKMG4FQQP4PDZURUNCLN7D5IR6DVYKCXTDXMQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081476859 (832h8m36.779045164s) [noise=true , address=185.167.204.205:4036 , piece_id=36F5ETODK33CJ3DYLVDO74ILEUCO46EOGFSDOIYFIZOFMSYCWZJQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081854243 (832h8m36.779422549s) [noise=true , address=185.167.204.206:4047 , piece_id=NX5VZNEAAQWZIVENWWI6D6JGPSVAR25G7UNLR4VM2IO3R5R2RNFA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.084019388 (832h8m36.781587694s) [noise=true , address=185.167.204.205:4030 , piece_id=XDZNUF4U7B3LBSGGDF5KQMFAMULAVDBGV77W2HLB3TQ6A63T2LKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085665192 (832h8m36.783233498s) [noise=true , address=185.167.204.205:4016 , piece_id=7DOGCUU3CLYQEXEDHJEA3TBLPZXG2ZYZ2ELHPMI6ABEN3SCHVIGA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085685219 (832h8m36.783253526s) [noise=true , address=185.167.204.206:4063 , piece_id=TS7CR4OJYFCIVJTYUIDMZG6OFGDTD2UEXBTYXRCUPX6PPKWMQI3Q, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.092142522 (832h8m36.789710829s) [noise=true , address=89.149.201.147:4003 , piece_id=G44C4AXJFDLENH24JTOYRMOT2W2TQYKBG4VKCTJVI42IWDZAUMKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.094372309 (832h8m36.791940614s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.099207151 (832h8m36.796775457s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.100548106 (832h8m36.798116402s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.126257155 (832h8m36.82382546s) [noise=true , address=185.167.204.206:4068 , piece_id=4BHBFT7M5FRFXI2BHSA6EKXDFCU3GCXBVVITTB2WIEFU4P36VAIA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.133142828 (832h8m36.830711144s) [noise=true , address=185.167.204.205:4011 , piece_id=ZWVL45YULGYIG6D32ZEKCXGMIQQYVH4JVEXQPL32SNGOBDYWN3KQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.134306753 (832h8m36.831875069s) [noise=true , address=185.167.204.206:4040 , piece_id=FW2G4XCVY4LOVZSHQ25TCFTCDYMRLHXVNBU76OIIGI2UTTIIQXKQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.142641292 (832h8m36.840209598s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.151782239 (832h8m36.849350555s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152331545 (832h8m36.849899861s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152813115 (832h8m36.850381431s) [noise=true , address=185.167.204.205:4026 , piece_id=SKCE257VNOP62EKHFZQGGYZ7AIA5GWCT4ZW7IQOXQJSVDYKODMRQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.172329604 (832h8m36.869897921s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.179173059 (832h8m36.876741375s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.196489869 (832h8m36.894058175s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.198678477 (832h8m36.896246784s) [noise=true , address=81.171.14.70:4045 , piece_id=J5I4QOVP6ROOB6ZCB75VRTP37ISKCLJ6BJNRZTT3CHOZO2ORKQ5A, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.576067236 (832h8m37.273635542s) [noise=true , address=81.171.14.70:4026 , piece_id=XXAI6MD34XUH6PEPYOVHKMG4GXCEAM4WHKZDM3UHXSKNG2NAPOMA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.612447320 (832h8m37.310015636s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.674090269 (832h8m37.371658585s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.698435238 (832h8m37.396003554s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:38:48.005767171 (832h9m35.703335477s) [noise=true , address=81.171.14.70:4042 , piece_id=SBER7MUZFU5HXAAQN5W7IPGYZ4RQZNX7LCV3PHDCQIIN2P7GHVGQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: context deadline exceeded; context deadline exceeded
Jan 9 07:38:48.005822034 (832h9m35.70339034s) [noise=true , address=81.171.14.70:4035 , piece_id=JCZZOD3KHUISYLIPJKGMAHZ5QOPKTZMHIPGUCAGJHBZX2ZYBALUA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: rpc: dial tcp 81.171.14.70:4035: i/o timeout; context deadline exceeded
Jan 9 07:38:48.005952648 (832h9m35.703520984s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 5.161.89.252:32526->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 9 07:38:48.005994226 (832h9m35.703562562s) [seg_pos={0 0}, upload=732073]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 9 07:38:48.109550624 (832h9m35.80711896s) [upload=732073]: Done uploading segments...
Jan 9 07:38:48.109585420 (832h9m35.807153755s) [upload=732073]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.590921566s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X.X.......................................................] duration:
325.098245ms trace:
https://jaeger.dev.storj.io/trace/5af4d89436e82463
FAIL (2026-01-09 08:17:36 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 325.114085ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
3 out of 60 is failed (threshold=3) [......XXX...................................................] duration:
178.815846ms trace:
https://jaeger.dev.storj.io/trace/f4bac8f86eddf53
FAIL (2026-01-09 08:17:32 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 178.837948ms
edge
gateway
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
2 out of 60 is failed (threshold=3) [.XX.........................................................] duration:
46.910435ms trace:
https://jaeger.dev.storj.io/trace/4d3b7b3eb36724ba
FAIL (2026-01-09 08:17:29 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 46.922168ms
edge
authservice
http
us-select-1
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
2 out of 60 is failed (threshold=3) [....XX......................................................] duration:
129.399567ms target:
https://version.storj.io/ trace:
https://jaeger.dev.storj.io/trace/1634496fdb368bf9
FAIL (2026-01-09 08:17:22 UTC)
orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: i/o timeout
Duration: 129.441135ms
core
website
|
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
3.208214ms target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/2ac98d14171470eb
FAIL (2026-01-09 08:17:22 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout
Duration: 3.220547ms
edge
linksharing
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [.....XX.X...................................................] duration:
2.207206385s trace:
https://jaeger.dev.storj.io/trace/6735d4b874ab1ef5
FAIL (2026-01-09 08:17:14 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
03564596s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.408402825 (832h8m36.105971141s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.409232034 (832h8m36.10680034s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.410100727 (832h8m36.107669033s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.411643299 (832h8m36.109211605s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.412026585 (832h8m36.109594931s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.413398217 (832h8m36.110966523s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414194315 (832h8m36.111762621s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414527187 (832h8m36.112095493s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.417979455 (832h8m36.115547771s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.419110590 (832h8m36.116678906s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.420189664 (832h8m36.117757981s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.421246770 (832h8m36.118815076s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.864750971 (832h8m36.562319277s) [upload=732073]: Next returned nil segment
Jan 9 07:37:48.864760439 (832h8m36.562328755s) [upload=732073]: Waiting for error group managing segments...
Jan 9 07:37:49.079903909 (832h8m36.777472216s) [noise=true , address=185.167.204.205:4014 , piece_id=JTQC4RDGKGUW7LPJKMG4FQQP4PDZURUNCLN7D5IR6DVYKCXTDXMQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081476859 (832h8m36.779045164s) [noise=true , address=185.167.204.205:4036 , piece_id=36F5ETODK33CJ3DYLVDO74ILEUCO46EOGFSDOIYFIZOFMSYCWZJQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081854243 (832h8m36.779422549s) [noise=true , address=185.167.204.206:4047 , piece_id=NX5VZNEAAQWZIVENWWI6D6JGPSVAR25G7UNLR4VM2IO3R5R2RNFA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.084019388 (832h8m36.781587694s) [noise=true , address=185.167.204.205:4030 , piece_id=XDZNUF4U7B3LBSGGDF5KQMFAMULAVDBGV77W2HLB3TQ6A63T2LKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085665192 (832h8m36.783233498s) [noise=true , address=185.167.204.205:4016 , piece_id=7DOGCUU3CLYQEXEDHJEA3TBLPZXG2ZYZ2ELHPMI6ABEN3SCHVIGA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085685219 (832h8m36.783253526s) [noise=true , address=185.167.204.206:4063 , piece_id=TS7CR4OJYFCIVJTYUIDMZG6OFGDTD2UEXBTYXRCUPX6PPKWMQI3Q, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.092142522 (832h8m36.789710829s) [noise=true , address=89.149.201.147:4003 , piece_id=G44C4AXJFDLENH24JTOYRMOT2W2TQYKBG4VKCTJVI42IWDZAUMKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.094372309 (832h8m36.791940614s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.099207151 (832h8m36.796775457s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.100548106 (832h8m36.798116402s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.126257155 (832h8m36.82382546s) [noise=true , address=185.167.204.206:4068 , piece_id=4BHBFT7M5FRFXI2BHSA6EKXDFCU3GCXBVVITTB2WIEFU4P36VAIA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.133142828 (832h8m36.830711144s) [noise=true , address=185.167.204.205:4011 , piece_id=ZWVL45YULGYIG6D32ZEKCXGMIQQYVH4JVEXQPL32SNGOBDYWN3KQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.134306753 (832h8m36.831875069s) [noise=true , address=185.167.204.206:4040 , piece_id=FW2G4XCVY4LOVZSHQ25TCFTCDYMRLHXVNBU76OIIGI2UTTIIQXKQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.142641292 (832h8m36.840209598s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.151782239 (832h8m36.849350555s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152331545 (832h8m36.849899861s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152813115 (832h8m36.850381431s) [noise=true , address=185.167.204.205:4026 , piece_id=SKCE257VNOP62EKHFZQGGYZ7AIA5GWCT4ZW7IQOXQJSVDYKODMRQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.172329604 (832h8m36.869897921s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.179173059 (832h8m36.876741375s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.196489869 (832h8m36.894058175s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.198678477 (832h8m36.896246784s) [noise=true , address=81.171.14.70:4045 , piece_id=J5I4QOVP6ROOB6ZCB75VRTP37ISKCLJ6BJNRZTT3CHOZO2ORKQ5A, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.576067236 (832h8m37.273635542s) [noise=true , address=81.171.14.70:4026 , piece_id=XXAI6MD34XUH6PEPYOVHKMG4GXCEAM4WHKZDM3UHXSKNG2NAPOMA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.612447320 (832h8m37.310015636s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.674090269 (832h8m37.371658585s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.698435238 (832h8m37.396003554s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:38:48.005767171 (832h9m35.703335477s) [noise=true , address=81.171.14.70:4042 , piece_id=SBER7MUZFU5HXAAQN5W7IPGYZ4RQZNX7LCV3PHDCQIIN2P7GHVGQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: context deadline exceeded; context deadline exceeded
Jan 9 07:38:48.005822034 (832h9m35.70339034s) [noise=true , address=81.171.14.70:4035 , piece_id=JCZZOD3KHUISYLIPJKGMAHZ5QOPKTZMHIPGUCAGJHBZX2ZYBALUA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: rpc: dial tcp 81.171.14.70:4035: i/o timeout; context deadline exceeded
Jan 9 07:38:48.005952648 (832h9m35.703520984s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 5.161.89.252:32526->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 9 07:38:48.005994226 (832h9m35.703562562s) [seg_pos={0 0}, upload=732073]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 9 07:38:48.109550624 (832h9m35.80711896s) [upload=732073]: Done uploading segments...
Jan 9 07:38:48.109585420 (832h9m35.807153755s) [upload=732073]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.207320128s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X.X......................................................] duration:
370.314585ms trace:
https://jaeger.dev.storj.io/trace/5af4d89436e82463
FAIL (2026-01-09 08:17:13 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 370.408009ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
20.042032ms target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/562634a9d869637c
FAIL (2026-01-09 08:17:05 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout
Duration: 20.065696ms
edge
gateway
vhost
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
2 out of 60 is failed (threshold=3) [..XX........................................................] duration:
35.86369ms trace:
https://jaeger.dev.storj.io/trace/4d3b7b3eb36724ba
FAIL (2026-01-09 08:16:57 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 35.87979ms
edge
authservice
http
us-select-1
|
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
9.466777ms target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/2ac98d14171470eb
FAIL (2026-01-09 08:16:54 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout
Duration: 9.486904ms
edge
linksharing
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
27.348772ms target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/562634a9d869637c
FAIL (2026-01-09 08:16:49 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout
Duration: 27.374981ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [......XX.X..................................................] duration:
2.684928416s trace:
https://jaeger.dev.storj.io/trace/6735d4b874ab1ef5
FAIL (2026-01-09 08:16:39 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
03564596s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.408402825 (832h8m36.105971141s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.409232034 (832h8m36.10680034s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.410100727 (832h8m36.107669033s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.411643299 (832h8m36.109211605s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.412026585 (832h8m36.109594931s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.413398217 (832h8m36.110966523s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414194315 (832h8m36.111762621s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414527187 (832h8m36.112095493s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.417979455 (832h8m36.115547771s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.419110590 (832h8m36.116678906s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.420189664 (832h8m36.117757981s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.421246770 (832h8m36.118815076s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.864750971 (832h8m36.562319277s) [upload=732073]: Next returned nil segment
Jan 9 07:37:48.864760439 (832h8m36.562328755s) [upload=732073]: Waiting for error group managing segments...
Jan 9 07:37:49.079903909 (832h8m36.777472216s) [noise=true , address=185.167.204.205:4014 , piece_id=JTQC4RDGKGUW7LPJKMG4FQQP4PDZURUNCLN7D5IR6DVYKCXTDXMQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081476859 (832h8m36.779045164s) [noise=true , address=185.167.204.205:4036 , piece_id=36F5ETODK33CJ3DYLVDO74ILEUCO46EOGFSDOIYFIZOFMSYCWZJQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081854243 (832h8m36.779422549s) [noise=true , address=185.167.204.206:4047 , piece_id=NX5VZNEAAQWZIVENWWI6D6JGPSVAR25G7UNLR4VM2IO3R5R2RNFA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.084019388 (832h8m36.781587694s) [noise=true , address=185.167.204.205:4030 , piece_id=XDZNUF4U7B3LBSGGDF5KQMFAMULAVDBGV77W2HLB3TQ6A63T2LKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085665192 (832h8m36.783233498s) [noise=true , address=185.167.204.205:4016 , piece_id=7DOGCUU3CLYQEXEDHJEA3TBLPZXG2ZYZ2ELHPMI6ABEN3SCHVIGA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085685219 (832h8m36.783253526s) [noise=true , address=185.167.204.206:4063 , piece_id=TS7CR4OJYFCIVJTYUIDMZG6OFGDTD2UEXBTYXRCUPX6PPKWMQI3Q, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.092142522 (832h8m36.789710829s) [noise=true , address=89.149.201.147:4003 , piece_id=G44C4AXJFDLENH24JTOYRMOT2W2TQYKBG4VKCTJVI42IWDZAUMKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.094372309 (832h8m36.791940614s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.099207151 (832h8m36.796775457s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.100548106 (832h8m36.798116402s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.126257155 (832h8m36.82382546s) [noise=true , address=185.167.204.206:4068 , piece_id=4BHBFT7M5FRFXI2BHSA6EKXDFCU3GCXBVVITTB2WIEFU4P36VAIA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.133142828 (832h8m36.830711144s) [noise=true , address=185.167.204.205:4011 , piece_id=ZWVL45YULGYIG6D32ZEKCXGMIQQYVH4JVEXQPL32SNGOBDYWN3KQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.134306753 (832h8m36.831875069s) [noise=true , address=185.167.204.206:4040 , piece_id=FW2G4XCVY4LOVZSHQ25TCFTCDYMRLHXVNBU76OIIGI2UTTIIQXKQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.142641292 (832h8m36.840209598s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.151782239 (832h8m36.849350555s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152331545 (832h8m36.849899861s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152813115 (832h8m36.850381431s) [noise=true , address=185.167.204.205:4026 , piece_id=SKCE257VNOP62EKHFZQGGYZ7AIA5GWCT4ZW7IQOXQJSVDYKODMRQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.172329604 (832h8m36.869897921s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.179173059 (832h8m36.876741375s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.196489869 (832h8m36.894058175s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.198678477 (832h8m36.896246784s) [noise=true , address=81.171.14.70:4045 , piece_id=J5I4QOVP6ROOB6ZCB75VRTP37ISKCLJ6BJNRZTT3CHOZO2ORKQ5A, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.576067236 (832h8m37.273635542s) [noise=true , address=81.171.14.70:4026 , piece_id=XXAI6MD34XUH6PEPYOVHKMG4GXCEAM4WHKZDM3UHXSKNG2NAPOMA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.612447320 (832h8m37.310015636s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.674090269 (832h8m37.371658585s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.698435238 (832h8m37.396003554s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:38:48.005767171 (832h9m35.703335477s) [noise=true , address=81.171.14.70:4042 , piece_id=SBER7MUZFU5HXAAQN5W7IPGYZ4RQZNX7LCV3PHDCQIIN2P7GHVGQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: context deadline exceeded; context deadline exceeded
Jan 9 07:38:48.005822034 (832h9m35.70339034s) [noise=true , address=81.171.14.70:4035 , piece_id=JCZZOD3KHUISYLIPJKGMAHZ5QOPKTZMHIPGUCAGJHBZX2ZYBALUA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: rpc: dial tcp 81.171.14.70:4035: i/o timeout; context deadline exceeded
Jan 9 07:38:48.005952648 (832h9m35.703520984s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 5.161.89.252:32526->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 9 07:38:48.005994226 (832h9m35.703562562s) [seg_pos={0 0}, upload=732073]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 9 07:38:48.109550624 (832h9m35.80711896s) [upload=732073]: Done uploading segments...
Jan 9 07:38:48.109585420 (832h9m35.807153755s) [upload=732073]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.684987968s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......XXX..................................................] duration:
220.525224ms trace:
https://jaeger.dev.storj.io/trace/f4bac8f86eddf53
FAIL (2026-01-09 08:16:33 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 220.56544ms
edge
gateway
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
2 out of 60 is failed (threshold=3) [...XX.......................................................] duration:
40.286712ms trace:
https://jaeger.dev.storj.io/trace/4d3b7b3eb36724ba
FAIL (2026-01-09 08:16:26 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 40.310547ms
edge
authservice
http
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
3 out of 60 is failed (threshold=3) [........XXX.................................................] duration:
173.120657ms trace:
https://jaeger.dev.storj.io/trace/f4bac8f86eddf53
FAIL (2026-01-09 08:16:12 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 173.158328ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
2 out of 60 is failed (threshold=3) [.....XX.....................................................] duration:
131.309406ms target:
https://version.storj.io/ trace:
https://jaeger.dev.storj.io/trace/1634496fdb368bf9
FAIL (2026-01-09 08:16:08 UTC)
orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: i/o timeout
Duration: 131.331517ms
core
website
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X.X.....................................................] duration:
329.355958ms trace:
https://jaeger.dev.storj.io/trace/5af4d89436e82463
FAIL (2026-01-09 08:16:04 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 329.376638ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
9.843349ms target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/2ac98d14171470eb
FAIL (2026-01-09 08:15:58 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout
Duration: 9.861854ms
edge
linksharing
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
23.8093ms target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/562634a9d869637c
FAIL (2026-01-09 08:15:47 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout
Duration: 23.826142ms
edge
gateway
vhost
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
2 out of 60 is failed (threshold=3) [....XX......................................................] duration:
54.089809ms trace:
https://jaeger.dev.storj.io/trace/4d3b7b3eb36724ba
FAIL (2026-01-09 08:15:45 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 54.138218ms
edge
authservice
http
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [.......XX.X.................................................] duration:
2.27133514s trace:
https://jaeger.dev.storj.io/trace/6735d4b874ab1ef5
FAIL (2026-01-09 08:15:38 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
03564596s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.408402825 (832h8m36.105971141s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.409232034 (832h8m36.10680034s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.410100727 (832h8m36.107669033s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.411643299 (832h8m36.109211605s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.412026585 (832h8m36.109594931s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.413398217 (832h8m36.110966523s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414194315 (832h8m36.111762621s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414527187 (832h8m36.112095493s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.417979455 (832h8m36.115547771s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.419110590 (832h8m36.116678906s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.420189664 (832h8m36.117757981s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.421246770 (832h8m36.118815076s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.864750971 (832h8m36.562319277s) [upload=732073]: Next returned nil segment
Jan 9 07:37:48.864760439 (832h8m36.562328755s) [upload=732073]: Waiting for error group managing segments...
Jan 9 07:37:49.079903909 (832h8m36.777472216s) [noise=true , address=185.167.204.205:4014 , piece_id=JTQC4RDGKGUW7LPJKMG4FQQP4PDZURUNCLN7D5IR6DVYKCXTDXMQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081476859 (832h8m36.779045164s) [noise=true , address=185.167.204.205:4036 , piece_id=36F5ETODK33CJ3DYLVDO74ILEUCO46EOGFSDOIYFIZOFMSYCWZJQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081854243 (832h8m36.779422549s) [noise=true , address=185.167.204.206:4047 , piece_id=NX5VZNEAAQWZIVENWWI6D6JGPSVAR25G7UNLR4VM2IO3R5R2RNFA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.084019388 (832h8m36.781587694s) [noise=true , address=185.167.204.205:4030 , piece_id=XDZNUF4U7B3LBSGGDF5KQMFAMULAVDBGV77W2HLB3TQ6A63T2LKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085665192 (832h8m36.783233498s) [noise=true , address=185.167.204.205:4016 , piece_id=7DOGCUU3CLYQEXEDHJEA3TBLPZXG2ZYZ2ELHPMI6ABEN3SCHVIGA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085685219 (832h8m36.783253526s) [noise=true , address=185.167.204.206:4063 , piece_id=TS7CR4OJYFCIVJTYUIDMZG6OFGDTD2UEXBTYXRCUPX6PPKWMQI3Q, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.092142522 (832h8m36.789710829s) [noise=true , address=89.149.201.147:4003 , piece_id=G44C4AXJFDLENH24JTOYRMOT2W2TQYKBG4VKCTJVI42IWDZAUMKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.094372309 (832h8m36.791940614s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.099207151 (832h8m36.796775457s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.100548106 (832h8m36.798116402s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.126257155 (832h8m36.82382546s) [noise=true , address=185.167.204.206:4068 , piece_id=4BHBFT7M5FRFXI2BHSA6EKXDFCU3GCXBVVITTB2WIEFU4P36VAIA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.133142828 (832h8m36.830711144s) [noise=true , address=185.167.204.205:4011 , piece_id=ZWVL45YULGYIG6D32ZEKCXGMIQQYVH4JVEXQPL32SNGOBDYWN3KQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.134306753 (832h8m36.831875069s) [noise=true , address=185.167.204.206:4040 , piece_id=FW2G4XCVY4LOVZSHQ25TCFTCDYMRLHXVNBU76OIIGI2UTTIIQXKQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.142641292 (832h8m36.840209598s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.151782239 (832h8m36.849350555s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152331545 (832h8m36.849899861s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152813115 (832h8m36.850381431s) [noise=true , address=185.167.204.205:4026 , piece_id=SKCE257VNOP62EKHFZQGGYZ7AIA5GWCT4ZW7IQOXQJSVDYKODMRQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.172329604 (832h8m36.869897921s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.179173059 (832h8m36.876741375s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.196489869 (832h8m36.894058175s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.198678477 (832h8m36.896246784s) [noise=true , address=81.171.14.70:4045 , piece_id=J5I4QOVP6ROOB6ZCB75VRTP37ISKCLJ6BJNRZTT3CHOZO2ORKQ5A, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.576067236 (832h8m37.273635542s) [noise=true , address=81.171.14.70:4026 , piece_id=XXAI6MD34XUH6PEPYOVHKMG4GXCEAM4WHKZDM3UHXSKNG2NAPOMA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.612447320 (832h8m37.310015636s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.674090269 (832h8m37.371658585s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.698435238 (832h8m37.396003554s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:38:48.005767171 (832h9m35.703335477s) [noise=true , address=81.171.14.70:4042 , piece_id=SBER7MUZFU5HXAAQN5W7IPGYZ4RQZNX7LCV3PHDCQIIN2P7GHVGQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: context deadline exceeded; context deadline exceeded
Jan 9 07:38:48.005822034 (832h9m35.70339034s) [noise=true , address=81.171.14.70:4035 , piece_id=JCZZOD3KHUISYLIPJKGMAHZ5QOPKTZMHIPGUCAGJHBZX2ZYBALUA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: rpc: dial tcp 81.171.14.70:4035: i/o timeout; context deadline exceeded
Jan 9 07:38:48.005952648 (832h9m35.703520984s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 5.161.89.252:32526->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 9 07:38:48.005994226 (832h9m35.703562562s) [seg_pos={0 0}, upload=732073]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 9 07:38:48.109550624 (832h9m35.80711896s) [upload=732073]: Done uploading segments...
Jan 9 07:38:48.109585420 (832h9m35.807153755s) [upload=732073]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.271355218s
core
uplink
eu-select-1
eu1-placement-15
|