Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
2 out of 60 is failed (threshold=3) [..........................XX................................] duration:
38.623916ms trace:
https://jaeger.dev.storj.io/trace/4d3b7b3eb36724ba
FAIL (2026-01-09 07:59:10 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 38.638703ms
edge
authservice
http
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
3 out of 60 is failed (threshold=3) [................................XXX.........................] duration:
212.993276ms trace:
https://jaeger.dev.storj.io/trace/f4bac8f86eddf53
FAIL (2026-01-09 07:59:09 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 213.013134ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [.............................XX.X...........................] duration:
2.262309275s trace:
https://jaeger.dev.storj.io/trace/6735d4b874ab1ef5
FAIL (2026-01-09 07:59:08 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
03564596s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.408402825 (832h8m36.105971141s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.409232034 (832h8m36.10680034s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.410100727 (832h8m36.107669033s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.411643299 (832h8m36.109211605s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.412026585 (832h8m36.109594931s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.413398217 (832h8m36.110966523s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414194315 (832h8m36.111762621s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414527187 (832h8m36.112095493s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.417979455 (832h8m36.115547771s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.419110590 (832h8m36.116678906s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.420189664 (832h8m36.117757981s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.421246770 (832h8m36.118815076s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.864750971 (832h8m36.562319277s) [upload=732073]: Next returned nil segment
Jan 9 07:37:48.864760439 (832h8m36.562328755s) [upload=732073]: Waiting for error group managing segments...
Jan 9 07:37:49.079903909 (832h8m36.777472216s) [noise=true , address=185.167.204.205:4014 , piece_id=JTQC4RDGKGUW7LPJKMG4FQQP4PDZURUNCLN7D5IR6DVYKCXTDXMQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081476859 (832h8m36.779045164s) [noise=true , address=185.167.204.205:4036 , piece_id=36F5ETODK33CJ3DYLVDO74ILEUCO46EOGFSDOIYFIZOFMSYCWZJQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081854243 (832h8m36.779422549s) [noise=true , address=185.167.204.206:4047 , piece_id=NX5VZNEAAQWZIVENWWI6D6JGPSVAR25G7UNLR4VM2IO3R5R2RNFA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.084019388 (832h8m36.781587694s) [noise=true , address=185.167.204.205:4030 , piece_id=XDZNUF4U7B3LBSGGDF5KQMFAMULAVDBGV77W2HLB3TQ6A63T2LKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085665192 (832h8m36.783233498s) [noise=true , address=185.167.204.205:4016 , piece_id=7DOGCUU3CLYQEXEDHJEA3TBLPZXG2ZYZ2ELHPMI6ABEN3SCHVIGA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085685219 (832h8m36.783253526s) [noise=true , address=185.167.204.206:4063 , piece_id=TS7CR4OJYFCIVJTYUIDMZG6OFGDTD2UEXBTYXRCUPX6PPKWMQI3Q, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.092142522 (832h8m36.789710829s) [noise=true , address=89.149.201.147:4003 , piece_id=G44C4AXJFDLENH24JTOYRMOT2W2TQYKBG4VKCTJVI42IWDZAUMKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.094372309 (832h8m36.791940614s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.099207151 (832h8m36.796775457s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.100548106 (832h8m36.798116402s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.126257155 (832h8m36.82382546s) [noise=true , address=185.167.204.206:4068 , piece_id=4BHBFT7M5FRFXI2BHSA6EKXDFCU3GCXBVVITTB2WIEFU4P36VAIA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.133142828 (832h8m36.830711144s) [noise=true , address=185.167.204.205:4011 , piece_id=ZWVL45YULGYIG6D32ZEKCXGMIQQYVH4JVEXQPL32SNGOBDYWN3KQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.134306753 (832h8m36.831875069s) [noise=true , address=185.167.204.206:4040 , piece_id=FW2G4XCVY4LOVZSHQ25TCFTCDYMRLHXVNBU76OIIGI2UTTIIQXKQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.142641292 (832h8m36.840209598s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.151782239 (832h8m36.849350555s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152331545 (832h8m36.849899861s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152813115 (832h8m36.850381431s) [noise=true , address=185.167.204.205:4026 , piece_id=SKCE257VNOP62EKHFZQGGYZ7AIA5GWCT4ZW7IQOXQJSVDYKODMRQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.172329604 (832h8m36.869897921s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.179173059 (832h8m36.876741375s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.196489869 (832h8m36.894058175s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.198678477 (832h8m36.896246784s) [noise=true , address=81.171.14.70:4045 , piece_id=J5I4QOVP6ROOB6ZCB75VRTP37ISKCLJ6BJNRZTT3CHOZO2ORKQ5A, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.576067236 (832h8m37.273635542s) [noise=true , address=81.171.14.70:4026 , piece_id=XXAI6MD34XUH6PEPYOVHKMG4GXCEAM4WHKZDM3UHXSKNG2NAPOMA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.612447320 (832h8m37.310015636s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.674090269 (832h8m37.371658585s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.698435238 (832h8m37.396003554s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:38:48.005767171 (832h9m35.703335477s) [noise=true , address=81.171.14.70:4042 , piece_id=SBER7MUZFU5HXAAQN5W7IPGYZ4RQZNX7LCV3PHDCQIIN2P7GHVGQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: context deadline exceeded; context deadline exceeded
Jan 9 07:38:48.005822034 (832h9m35.70339034s) [noise=true , address=81.171.14.70:4035 , piece_id=JCZZOD3KHUISYLIPJKGMAHZ5QOPKTZMHIPGUCAGJHBZX2ZYBALUA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: rpc: dial tcp 81.171.14.70:4035: i/o timeout; context deadline exceeded
Jan 9 07:38:48.005952648 (832h9m35.703520984s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 5.161.89.252:32526->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 9 07:38:48.005994226 (832h9m35.703562562s) [seg_pos={0 0}, upload=732073]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 9 07:38:48.109550624 (832h9m35.80711896s) [upload=732073]: Done uploading segments...
Jan 9 07:38:48.109585420 (832h9m35.807153755s) [upload=732073]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.262324324s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
25.122133ms target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/562634a9d869637c
FAIL (2026-01-09 07:58:53 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout
Duration: 25.145598ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................X.X...............................] duration:
353.913106ms trace:
https://jaeger.dev.storj.io/trace/5af4d89436e82463
FAIL (2026-01-09 07:58:44 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 353.93621ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
2 out of 60 is failed (threshold=3) [...........................XX...............................] duration:
133.195911ms target:
https://version.storj.io/ trace:
https://jaeger.dev.storj.io/trace/1634496fdb368bf9
FAIL (2026-01-09 07:58:43 UTC)
orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: i/o timeout
Duration: 133.210459ms
core
website
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [..............................XX.X..........................] duration:
2.775453378s trace:
https://jaeger.dev.storj.io/trace/6735d4b874ab1ef5
FAIL (2026-01-09 07:58:34 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
03564596s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.408402825 (832h8m36.105971141s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.409232034 (832h8m36.10680034s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.410100727 (832h8m36.107669033s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.411643299 (832h8m36.109211605s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.412026585 (832h8m36.109594931s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.413398217 (832h8m36.110966523s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414194315 (832h8m36.111762621s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414527187 (832h8m36.112095493s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.417979455 (832h8m36.115547771s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.419110590 (832h8m36.116678906s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.420189664 (832h8m36.117757981s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.421246770 (832h8m36.118815076s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.864750971 (832h8m36.562319277s) [upload=732073]: Next returned nil segment
Jan 9 07:37:48.864760439 (832h8m36.562328755s) [upload=732073]: Waiting for error group managing segments...
Jan 9 07:37:49.079903909 (832h8m36.777472216s) [noise=true , address=185.167.204.205:4014 , piece_id=JTQC4RDGKGUW7LPJKMG4FQQP4PDZURUNCLN7D5IR6DVYKCXTDXMQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081476859 (832h8m36.779045164s) [noise=true , address=185.167.204.205:4036 , piece_id=36F5ETODK33CJ3DYLVDO74ILEUCO46EOGFSDOIYFIZOFMSYCWZJQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081854243 (832h8m36.779422549s) [noise=true , address=185.167.204.206:4047 , piece_id=NX5VZNEAAQWZIVENWWI6D6JGPSVAR25G7UNLR4VM2IO3R5R2RNFA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.084019388 (832h8m36.781587694s) [noise=true , address=185.167.204.205:4030 , piece_id=XDZNUF4U7B3LBSGGDF5KQMFAMULAVDBGV77W2HLB3TQ6A63T2LKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085665192 (832h8m36.783233498s) [noise=true , address=185.167.204.205:4016 , piece_id=7DOGCUU3CLYQEXEDHJEA3TBLPZXG2ZYZ2ELHPMI6ABEN3SCHVIGA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085685219 (832h8m36.783253526s) [noise=true , address=185.167.204.206:4063 , piece_id=TS7CR4OJYFCIVJTYUIDMZG6OFGDTD2UEXBTYXRCUPX6PPKWMQI3Q, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.092142522 (832h8m36.789710829s) [noise=true , address=89.149.201.147:4003 , piece_id=G44C4AXJFDLENH24JTOYRMOT2W2TQYKBG4VKCTJVI42IWDZAUMKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.094372309 (832h8m36.791940614s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.099207151 (832h8m36.796775457s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.100548106 (832h8m36.798116402s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.126257155 (832h8m36.82382546s) [noise=true , address=185.167.204.206:4068 , piece_id=4BHBFT7M5FRFXI2BHSA6EKXDFCU3GCXBVVITTB2WIEFU4P36VAIA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.133142828 (832h8m36.830711144s) [noise=true , address=185.167.204.205:4011 , piece_id=ZWVL45YULGYIG6D32ZEKCXGMIQQYVH4JVEXQPL32SNGOBDYWN3KQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.134306753 (832h8m36.831875069s) [noise=true , address=185.167.204.206:4040 , piece_id=FW2G4XCVY4LOVZSHQ25TCFTCDYMRLHXVNBU76OIIGI2UTTIIQXKQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.142641292 (832h8m36.840209598s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.151782239 (832h8m36.849350555s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152331545 (832h8m36.849899861s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152813115 (832h8m36.850381431s) [noise=true , address=185.167.204.205:4026 , piece_id=SKCE257VNOP62EKHFZQGGYZ7AIA5GWCT4ZW7IQOXQJSVDYKODMRQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.172329604 (832h8m36.869897921s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.179173059 (832h8m36.876741375s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.196489869 (832h8m36.894058175s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.198678477 (832h8m36.896246784s) [noise=true , address=81.171.14.70:4045 , piece_id=J5I4QOVP6ROOB6ZCB75VRTP37ISKCLJ6BJNRZTT3CHOZO2ORKQ5A, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.576067236 (832h8m37.273635542s) [noise=true , address=81.171.14.70:4026 , piece_id=XXAI6MD34XUH6PEPYOVHKMG4GXCEAM4WHKZDM3UHXSKNG2NAPOMA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.612447320 (832h8m37.310015636s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.674090269 (832h8m37.371658585s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.698435238 (832h8m37.396003554s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:38:48.005767171 (832h9m35.703335477s) [noise=true , address=81.171.14.70:4042 , piece_id=SBER7MUZFU5HXAAQN5W7IPGYZ4RQZNX7LCV3PHDCQIIN2P7GHVGQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: context deadline exceeded; context deadline exceeded
Jan 9 07:38:48.005822034 (832h9m35.70339034s) [noise=true , address=81.171.14.70:4035 , piece_id=JCZZOD3KHUISYLIPJKGMAHZ5QOPKTZMHIPGUCAGJHBZX2ZYBALUA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: rpc: dial tcp 81.171.14.70:4035: i/o timeout; context deadline exceeded
Jan 9 07:38:48.005952648 (832h9m35.703520984s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 5.161.89.252:32526->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 9 07:38:48.005994226 (832h9m35.703562562s) [seg_pos={0 0}, upload=732073]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 9 07:38:48.109550624 (832h9m35.80711896s) [upload=732073]: Done uploading segments...
Jan 9 07:38:48.109585420 (832h9m35.807153755s) [upload=732073]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.775474407s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)antiblip:
3 out of 60 is failed (threshold=3) [.....................XX..X..................................] duration:
26.361227ms target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/2ac98d14171470eb
FAIL (2026-01-09 07:58:34 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout
Duration: 26.377888ms
edge
linksharing
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
2 out of 60 is failed (threshold=3) [...........................XX...............................] duration:
248.71537ms trace:
https://jaeger.dev.storj.io/trace/4d3b7b3eb36724ba
FAIL (2026-01-09 07:58:29 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 248.731471ms
edge
authservice
http
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
19.852528ms target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/562634a9d869637c
FAIL (2026-01-09 07:58:09 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout
Duration: 19.879509ms
edge
gateway
vhost
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
2 out of 60 is failed (threshold=3) [............................XX..............................] duration:
40.880059ms trace:
https://jaeger.dev.storj.io/trace/4d3b7b3eb36724ba
FAIL (2026-01-09 07:58:09 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 40.903503ms
edge
authservice
http
us-select-1
|
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)antiblip:
3 out of 60 is failed (threshold=3) [......................XX..X.................................] duration:
4.085433ms target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/2ac98d14171470eb
FAIL (2026-01-09 07:58:06 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout
Duration: 4.108827ms
edge
linksharing
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
3 out of 60 is failed (threshold=3) [.................................XXX........................] duration:
172.101973ms trace:
https://jaeger.dev.storj.io/trace/f4bac8f86eddf53
FAIL (2026-01-09 07:57:58 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 172.126098ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
2 out of 60 is failed (threshold=3) [............................XX..............................] duration:
131.702282ms target:
https://version.storj.io/ trace:
https://jaeger.dev.storj.io/trace/1634496fdb368bf9
FAIL (2026-01-09 07:57:49 UTC)
orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: i/o timeout
Duration: 131.720035ms
core
website
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
41.466515ms target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/562634a9d869637c
FAIL (2026-01-09 07:57:45 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout
Duration: 41.480512ms
edge
gateway
vhost
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
2 out of 60 is failed (threshold=3) [.............................XX.............................] duration:
38.362307ms trace:
https://jaeger.dev.storj.io/trace/4d3b7b3eb36724ba
FAIL (2026-01-09 07:57:44 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 38.382233ms
edge
authservice
http
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................X.X..............................] duration:
330.998228ms trace:
https://jaeger.dev.storj.io/trace/5af4d89436e82463
FAIL (2026-01-09 07:57:43 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 331.017365ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)antiblip:
3 out of 60 is failed (threshold=3) [.......................XX..X................................] duration:
8.271333ms target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/2ac98d14171470eb
FAIL (2026-01-09 07:57:29 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout
Duration: 8.292281ms
edge
linksharing
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [...............................XX.X.........................] duration:
2.624201515s trace:
https://jaeger.dev.storj.io/trace/6735d4b874ab1ef5
FAIL (2026-01-09 07:57:25 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
03564596s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.408402825 (832h8m36.105971141s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.409232034 (832h8m36.10680034s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.410100727 (832h8m36.107669033s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.411643299 (832h8m36.109211605s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.412026585 (832h8m36.109594931s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.413398217 (832h8m36.110966523s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414194315 (832h8m36.111762621s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414527187 (832h8m36.112095493s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.417979455 (832h8m36.115547771s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.419110590 (832h8m36.116678906s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.420189664 (832h8m36.117757981s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.421246770 (832h8m36.118815076s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.864750971 (832h8m36.562319277s) [upload=732073]: Next returned nil segment
Jan 9 07:37:48.864760439 (832h8m36.562328755s) [upload=732073]: Waiting for error group managing segments...
Jan 9 07:37:49.079903909 (832h8m36.777472216s) [noise=true , address=185.167.204.205:4014 , piece_id=JTQC4RDGKGUW7LPJKMG4FQQP4PDZURUNCLN7D5IR6DVYKCXTDXMQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081476859 (832h8m36.779045164s) [noise=true , address=185.167.204.205:4036 , piece_id=36F5ETODK33CJ3DYLVDO74ILEUCO46EOGFSDOIYFIZOFMSYCWZJQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081854243 (832h8m36.779422549s) [noise=true , address=185.167.204.206:4047 , piece_id=NX5VZNEAAQWZIVENWWI6D6JGPSVAR25G7UNLR4VM2IO3R5R2RNFA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.084019388 (832h8m36.781587694s) [noise=true , address=185.167.204.205:4030 , piece_id=XDZNUF4U7B3LBSGGDF5KQMFAMULAVDBGV77W2HLB3TQ6A63T2LKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085665192 (832h8m36.783233498s) [noise=true , address=185.167.204.205:4016 , piece_id=7DOGCUU3CLYQEXEDHJEA3TBLPZXG2ZYZ2ELHPMI6ABEN3SCHVIGA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085685219 (832h8m36.783253526s) [noise=true , address=185.167.204.206:4063 , piece_id=TS7CR4OJYFCIVJTYUIDMZG6OFGDTD2UEXBTYXRCUPX6PPKWMQI3Q, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.092142522 (832h8m36.789710829s) [noise=true , address=89.149.201.147:4003 , piece_id=G44C4AXJFDLENH24JTOYRMOT2W2TQYKBG4VKCTJVI42IWDZAUMKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.094372309 (832h8m36.791940614s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.099207151 (832h8m36.796775457s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.100548106 (832h8m36.798116402s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.126257155 (832h8m36.82382546s) [noise=true , address=185.167.204.206:4068 , piece_id=4BHBFT7M5FRFXI2BHSA6EKXDFCU3GCXBVVITTB2WIEFU4P36VAIA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.133142828 (832h8m36.830711144s) [noise=true , address=185.167.204.205:4011 , piece_id=ZWVL45YULGYIG6D32ZEKCXGMIQQYVH4JVEXQPL32SNGOBDYWN3KQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.134306753 (832h8m36.831875069s) [noise=true , address=185.167.204.206:4040 , piece_id=FW2G4XCVY4LOVZSHQ25TCFTCDYMRLHXVNBU76OIIGI2UTTIIQXKQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.142641292 (832h8m36.840209598s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.151782239 (832h8m36.849350555s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152331545 (832h8m36.849899861s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152813115 (832h8m36.850381431s) [noise=true , address=185.167.204.205:4026 , piece_id=SKCE257VNOP62EKHFZQGGYZ7AIA5GWCT4ZW7IQOXQJSVDYKODMRQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.172329604 (832h8m36.869897921s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.179173059 (832h8m36.876741375s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.196489869 (832h8m36.894058175s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.198678477 (832h8m36.896246784s) [noise=true , address=81.171.14.70:4045 , piece_id=J5I4QOVP6ROOB6ZCB75VRTP37ISKCLJ6BJNRZTT3CHOZO2ORKQ5A, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.576067236 (832h8m37.273635542s) [noise=true , address=81.171.14.70:4026 , piece_id=XXAI6MD34XUH6PEPYOVHKMG4GXCEAM4WHKZDM3UHXSKNG2NAPOMA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.612447320 (832h8m37.310015636s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.674090269 (832h8m37.371658585s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.698435238 (832h8m37.396003554s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:38:48.005767171 (832h9m35.703335477s) [noise=true , address=81.171.14.70:4042 , piece_id=SBER7MUZFU5HXAAQN5W7IPGYZ4RQZNX7LCV3PHDCQIIN2P7GHVGQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: context deadline exceeded; context deadline exceeded
Jan 9 07:38:48.005822034 (832h9m35.70339034s) [noise=true , address=81.171.14.70:4035 , piece_id=JCZZOD3KHUISYLIPJKGMAHZ5QOPKTZMHIPGUCAGJHBZX2ZYBALUA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: rpc: dial tcp 81.171.14.70:4035: i/o timeout; context deadline exceeded
Jan 9 07:38:48.005952648 (832h9m35.703520984s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 5.161.89.252:32526->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 9 07:38:48.005994226 (832h9m35.703562562s) [seg_pos={0 0}, upload=732073]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 9 07:38:48.109550624 (832h9m35.80711896s) [upload=732073]: Done uploading segments...
Jan 9 07:38:48.109585420 (832h9m35.807153755s) [upload=732073]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.624225479s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
3 out of 60 is failed (threshold=3) [..................................XXX.......................] duration:
154.340384ms trace:
https://jaeger.dev.storj.io/trace/f4bac8f86eddf53
FAIL (2026-01-09 07:57:13 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 154.364027ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)antiblip:
3 out of 60 is failed (threshold=3) [........................XX..X...............................] duration:
3.225194ms target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/2ac98d14171470eb
FAIL (2026-01-09 07:57:12 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout
Duration: 3.2388ms
edge
linksharing
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
2 out of 60 is failed (threshold=3) [..............................XX............................] duration:
40.518688ms trace:
https://jaeger.dev.storj.io/trace/4d3b7b3eb36724ba
FAIL (2026-01-09 07:57:09 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 40.550337ms
edge
authservice
http
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [................................XX.X........................] duration:
2.662917209s trace:
https://jaeger.dev.storj.io/trace/6735d4b874ab1ef5
FAIL (2026-01-09 07:57:00 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
03564596s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.408402825 (832h8m36.105971141s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.409232034 (832h8m36.10680034s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.410100727 (832h8m36.107669033s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.411643299 (832h8m36.109211605s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.412026585 (832h8m36.109594931s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.413398217 (832h8m36.110966523s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414194315 (832h8m36.111762621s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414527187 (832h8m36.112095493s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.417979455 (832h8m36.115547771s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.419110590 (832h8m36.116678906s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.420189664 (832h8m36.117757981s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.421246770 (832h8m36.118815076s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.864750971 (832h8m36.562319277s) [upload=732073]: Next returned nil segment
Jan 9 07:37:48.864760439 (832h8m36.562328755s) [upload=732073]: Waiting for error group managing segments...
Jan 9 07:37:49.079903909 (832h8m36.777472216s) [noise=true , address=185.167.204.205:4014 , piece_id=JTQC4RDGKGUW7LPJKMG4FQQP4PDZURUNCLN7D5IR6DVYKCXTDXMQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081476859 (832h8m36.779045164s) [noise=true , address=185.167.204.205:4036 , piece_id=36F5ETODK33CJ3DYLVDO74ILEUCO46EOGFSDOIYFIZOFMSYCWZJQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081854243 (832h8m36.779422549s) [noise=true , address=185.167.204.206:4047 , piece_id=NX5VZNEAAQWZIVENWWI6D6JGPSVAR25G7UNLR4VM2IO3R5R2RNFA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.084019388 (832h8m36.781587694s) [noise=true , address=185.167.204.205:4030 , piece_id=XDZNUF4U7B3LBSGGDF5KQMFAMULAVDBGV77W2HLB3TQ6A63T2LKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085665192 (832h8m36.783233498s) [noise=true , address=185.167.204.205:4016 , piece_id=7DOGCUU3CLYQEXEDHJEA3TBLPZXG2ZYZ2ELHPMI6ABEN3SCHVIGA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085685219 (832h8m36.783253526s) [noise=true , address=185.167.204.206:4063 , piece_id=TS7CR4OJYFCIVJTYUIDMZG6OFGDTD2UEXBTYXRCUPX6PPKWMQI3Q, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.092142522 (832h8m36.789710829s) [noise=true , address=89.149.201.147:4003 , piece_id=G44C4AXJFDLENH24JTOYRMOT2W2TQYKBG4VKCTJVI42IWDZAUMKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.094372309 (832h8m36.791940614s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.099207151 (832h8m36.796775457s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.100548106 (832h8m36.798116402s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.126257155 (832h8m36.82382546s) [noise=true , address=185.167.204.206:4068 , piece_id=4BHBFT7M5FRFXI2BHSA6EKXDFCU3GCXBVVITTB2WIEFU4P36VAIA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.133142828 (832h8m36.830711144s) [noise=true , address=185.167.204.205:4011 , piece_id=ZWVL45YULGYIG6D32ZEKCXGMIQQYVH4JVEXQPL32SNGOBDYWN3KQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.134306753 (832h8m36.831875069s) [noise=true , address=185.167.204.206:4040 , piece_id=FW2G4XCVY4LOVZSHQ25TCFTCDYMRLHXVNBU76OIIGI2UTTIIQXKQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.142641292 (832h8m36.840209598s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.151782239 (832h8m36.849350555s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152331545 (832h8m36.849899861s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152813115 (832h8m36.850381431s) [noise=true , address=185.167.204.205:4026 , piece_id=SKCE257VNOP62EKHFZQGGYZ7AIA5GWCT4ZW7IQOXQJSVDYKODMRQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.172329604 (832h8m36.869897921s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.179173059 (832h8m36.876741375s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.196489869 (832h8m36.894058175s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.198678477 (832h8m36.896246784s) [noise=true , address=81.171.14.70:4045 , piece_id=J5I4QOVP6ROOB6ZCB75VRTP37ISKCLJ6BJNRZTT3CHOZO2ORKQ5A, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.576067236 (832h8m37.273635542s) [noise=true , address=81.171.14.70:4026 , piece_id=XXAI6MD34XUH6PEPYOVHKMG4GXCEAM4WHKZDM3UHXSKNG2NAPOMA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.612447320 (832h8m37.310015636s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.674090269 (832h8m37.371658585s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.698435238 (832h8m37.396003554s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:38:48.005767171 (832h9m35.703335477s) [noise=true , address=81.171.14.70:4042 , piece_id=SBER7MUZFU5HXAAQN5W7IPGYZ4RQZNX7LCV3PHDCQIIN2P7GHVGQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: context deadline exceeded; context deadline exceeded
Jan 9 07:38:48.005822034 (832h9m35.70339034s) [noise=true , address=81.171.14.70:4035 , piece_id=JCZZOD3KHUISYLIPJKGMAHZ5QOPKTZMHIPGUCAGJHBZX2ZYBALUA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: rpc: dial tcp 81.171.14.70:4035: i/o timeout; context deadline exceeded
Jan 9 07:38:48.005952648 (832h9m35.703520984s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 5.161.89.252:32526->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 9 07:38:48.005994226 (832h9m35.703562562s) [seg_pos={0 0}, upload=732073]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 9 07:38:48.109550624 (832h9m35.80711896s) [upload=732073]: Done uploading segments...
Jan 9 07:38:48.109585420 (832h9m35.807153755s) [upload=732073]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.662938309s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)antiblip:
3 out of 60 is failed (threshold=3) [.........................XX..X..............................] duration:
4.10547ms target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/2ac98d14171470eb
FAIL (2026-01-09 07:56:56 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout
Duration: 4.127932ms
edge
linksharing
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
3 out of 60 is failed (threshold=3) [...................................XXX......................] duration:
297.828352ms trace:
https://jaeger.dev.storj.io/trace/f4bac8f86eddf53
FAIL (2026-01-09 07:56:52 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 297.846847ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
38.248265ms target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/562634a9d869637c
FAIL (2026-01-09 07:56:49 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout
Duration: 38.274253ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [.................................XX.X.......................] duration:
2.662567688s trace:
https://jaeger.dev.storj.io/trace/6735d4b874ab1ef5
FAIL (2026-01-09 07:56:41 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
03564596s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.408402825 (832h8m36.105971141s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.409232034 (832h8m36.10680034s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.410100727 (832h8m36.107669033s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.411643299 (832h8m36.109211605s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.412026585 (832h8m36.109594931s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.413398217 (832h8m36.110966523s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414194315 (832h8m36.111762621s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414527187 (832h8m36.112095493s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.417979455 (832h8m36.115547771s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.419110590 (832h8m36.116678906s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.420189664 (832h8m36.117757981s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.421246770 (832h8m36.118815076s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.864750971 (832h8m36.562319277s) [upload=732073]: Next returned nil segment
Jan 9 07:37:48.864760439 (832h8m36.562328755s) [upload=732073]: Waiting for error group managing segments...
Jan 9 07:37:49.079903909 (832h8m36.777472216s) [noise=true , address=185.167.204.205:4014 , piece_id=JTQC4RDGKGUW7LPJKMG4FQQP4PDZURUNCLN7D5IR6DVYKCXTDXMQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081476859 (832h8m36.779045164s) [noise=true , address=185.167.204.205:4036 , piece_id=36F5ETODK33CJ3DYLVDO74ILEUCO46EOGFSDOIYFIZOFMSYCWZJQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081854243 (832h8m36.779422549s) [noise=true , address=185.167.204.206:4047 , piece_id=NX5VZNEAAQWZIVENWWI6D6JGPSVAR25G7UNLR4VM2IO3R5R2RNFA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.084019388 (832h8m36.781587694s) [noise=true , address=185.167.204.205:4030 , piece_id=XDZNUF4U7B3LBSGGDF5KQMFAMULAVDBGV77W2HLB3TQ6A63T2LKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085665192 (832h8m36.783233498s) [noise=true , address=185.167.204.205:4016 , piece_id=7DOGCUU3CLYQEXEDHJEA3TBLPZXG2ZYZ2ELHPMI6ABEN3SCHVIGA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085685219 (832h8m36.783253526s) [noise=true , address=185.167.204.206:4063 , piece_id=TS7CR4OJYFCIVJTYUIDMZG6OFGDTD2UEXBTYXRCUPX6PPKWMQI3Q, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.092142522 (832h8m36.789710829s) [noise=true , address=89.149.201.147:4003 , piece_id=G44C4AXJFDLENH24JTOYRMOT2W2TQYKBG4VKCTJVI42IWDZAUMKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.094372309 (832h8m36.791940614s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.099207151 (832h8m36.796775457s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.100548106 (832h8m36.798116402s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.126257155 (832h8m36.82382546s) [noise=true , address=185.167.204.206:4068 , piece_id=4BHBFT7M5FRFXI2BHSA6EKXDFCU3GCXBVVITTB2WIEFU4P36VAIA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.133142828 (832h8m36.830711144s) [noise=true , address=185.167.204.205:4011 , piece_id=ZWVL45YULGYIG6D32ZEKCXGMIQQYVH4JVEXQPL32SNGOBDYWN3KQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.134306753 (832h8m36.831875069s) [noise=true , address=185.167.204.206:4040 , piece_id=FW2G4XCVY4LOVZSHQ25TCFTCDYMRLHXVNBU76OIIGI2UTTIIQXKQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.142641292 (832h8m36.840209598s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.151782239 (832h8m36.849350555s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152331545 (832h8m36.849899861s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152813115 (832h8m36.850381431s) [noise=true , address=185.167.204.205:4026 , piece_id=SKCE257VNOP62EKHFZQGGYZ7AIA5GWCT4ZW7IQOXQJSVDYKODMRQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.172329604 (832h8m36.869897921s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.179173059 (832h8m36.876741375s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.196489869 (832h8m36.894058175s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.198678477 (832h8m36.896246784s) [noise=true , address=81.171.14.70:4045 , piece_id=J5I4QOVP6ROOB6ZCB75VRTP37ISKCLJ6BJNRZTT3CHOZO2ORKQ5A, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.576067236 (832h8m37.273635542s) [noise=true , address=81.171.14.70:4026 , piece_id=XXAI6MD34XUH6PEPYOVHKMG4GXCEAM4WHKZDM3UHXSKNG2NAPOMA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.612447320 (832h8m37.310015636s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.674090269 (832h8m37.371658585s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.698435238 (832h8m37.396003554s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:38:48.005767171 (832h9m35.703335477s) [noise=true , address=81.171.14.70:4042 , piece_id=SBER7MUZFU5HXAAQN5W7IPGYZ4RQZNX7LCV3PHDCQIIN2P7GHVGQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: context deadline exceeded; context deadline exceeded
Jan 9 07:38:48.005822034 (832h9m35.70339034s) [noise=true , address=81.171.14.70:4035 , piece_id=JCZZOD3KHUISYLIPJKGMAHZ5QOPKTZMHIPGUCAGJHBZX2ZYBALUA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: rpc: dial tcp 81.171.14.70:4035: i/o timeout; context deadline exceeded
Jan 9 07:38:48.005952648 (832h9m35.703520984s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 5.161.89.252:32526->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 9 07:38:48.005994226 (832h9m35.703562562s) [seg_pos={0 0}, upload=732073]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 9 07:38:48.109550624 (832h9m35.80711896s) [upload=732073]: Done uploading segments...
Jan 9 07:38:48.109585420 (832h9m35.807153755s) [upload=732073]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.662584589s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................X.X.............................] duration:
335.517031ms trace:
https://jaeger.dev.storj.io/trace/5af4d89436e82463
FAIL (2026-01-09 07:56:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 335.52717ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
2 out of 60 is failed (threshold=3) [.............................XX.............................] duration:
129.619822ms target:
https://version.storj.io/ trace:
https://jaeger.dev.storj.io/trace/1634496fdb368bf9
FAIL (2026-01-09 07:56:38 UTC)
orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: i/o timeout
Duration: 129.639729ms
core
website
|
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)antiblip:
3 out of 60 is failed (threshold=3) [..........................XX..X.............................] duration:
15.103515ms target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/2ac98d14171470eb
FAIL (2026-01-09 07:56:33 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout
Duration: 15.201819ms
edge
linksharing
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................X.X............................] duration:
326.671213ms trace:
https://jaeger.dev.storj.io/trace/5af4d89436e82463
FAIL (2026-01-09 07:56:24 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 326.688447ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................X.X...........................] duration:
354.856538ms trace:
https://jaeger.dev.storj.io/trace/5af4d89436e82463
FAIL (2026-01-09 07:56:08 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 354.913836ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
3 out of 60 is failed (threshold=3) [....................................XXX.....................] duration:
164.877979ms trace:
https://jaeger.dev.storj.io/trace/f4bac8f86eddf53
FAIL (2026-01-09 07:56:01 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 164.896574ms
edge
gateway
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
2 out of 60 is failed (threshold=3) [...............................XX...........................] duration:
47.56444ms trace:
https://jaeger.dev.storj.io/trace/4d3b7b3eb36724ba
FAIL (2026-01-09 07:56:01 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 47.580849ms
edge
authservice
http
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
32.318737ms target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/562634a9d869637c
FAIL (2026-01-09 07:55:53 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout
Duration: 32.34213ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
2 out of 60 is failed (threshold=3) [..............................XX............................] duration:
131.042799ms target:
https://version.storj.io/ trace:
https://jaeger.dev.storj.io/trace/1634496fdb368bf9
FAIL (2026-01-09 07:55:51 UTC)
orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: i/o timeout
Duration: 131.063508ms
core
website
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [..................................XX.X......................] duration:
2.239434205s trace:
https://jaeger.dev.storj.io/trace/6735d4b874ab1ef5
FAIL (2026-01-09 07:55:46 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
03564596s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.408402825 (832h8m36.105971141s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.409232034 (832h8m36.10680034s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.410100727 (832h8m36.107669033s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.411643299 (832h8m36.109211605s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.412026585 (832h8m36.109594931s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.413398217 (832h8m36.110966523s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414194315 (832h8m36.111762621s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414527187 (832h8m36.112095493s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.417979455 (832h8m36.115547771s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.419110590 (832h8m36.116678906s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.420189664 (832h8m36.117757981s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.421246770 (832h8m36.118815076s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.864750971 (832h8m36.562319277s) [upload=732073]: Next returned nil segment
Jan 9 07:37:48.864760439 (832h8m36.562328755s) [upload=732073]: Waiting for error group managing segments...
Jan 9 07:37:49.079903909 (832h8m36.777472216s) [noise=true , address=185.167.204.205:4014 , piece_id=JTQC4RDGKGUW7LPJKMG4FQQP4PDZURUNCLN7D5IR6DVYKCXTDXMQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081476859 (832h8m36.779045164s) [noise=true , address=185.167.204.205:4036 , piece_id=36F5ETODK33CJ3DYLVDO74ILEUCO46EOGFSDOIYFIZOFMSYCWZJQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081854243 (832h8m36.779422549s) [noise=true , address=185.167.204.206:4047 , piece_id=NX5VZNEAAQWZIVENWWI6D6JGPSVAR25G7UNLR4VM2IO3R5R2RNFA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.084019388 (832h8m36.781587694s) [noise=true , address=185.167.204.205:4030 , piece_id=XDZNUF4U7B3LBSGGDF5KQMFAMULAVDBGV77W2HLB3TQ6A63T2LKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085665192 (832h8m36.783233498s) [noise=true , address=185.167.204.205:4016 , piece_id=7DOGCUU3CLYQEXEDHJEA3TBLPZXG2ZYZ2ELHPMI6ABEN3SCHVIGA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085685219 (832h8m36.783253526s) [noise=true , address=185.167.204.206:4063 , piece_id=TS7CR4OJYFCIVJTYUIDMZG6OFGDTD2UEXBTYXRCUPX6PPKWMQI3Q, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.092142522 (832h8m36.789710829s) [noise=true , address=89.149.201.147:4003 , piece_id=G44C4AXJFDLENH24JTOYRMOT2W2TQYKBG4VKCTJVI42IWDZAUMKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.094372309 (832h8m36.791940614s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.099207151 (832h8m36.796775457s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.100548106 (832h8m36.798116402s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.126257155 (832h8m36.82382546s) [noise=true , address=185.167.204.206:4068 , piece_id=4BHBFT7M5FRFXI2BHSA6EKXDFCU3GCXBVVITTB2WIEFU4P36VAIA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.133142828 (832h8m36.830711144s) [noise=true , address=185.167.204.205:4011 , piece_id=ZWVL45YULGYIG6D32ZEKCXGMIQQYVH4JVEXQPL32SNGOBDYWN3KQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.134306753 (832h8m36.831875069s) [noise=true , address=185.167.204.206:4040 , piece_id=FW2G4XCVY4LOVZSHQ25TCFTCDYMRLHXVNBU76OIIGI2UTTIIQXKQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.142641292 (832h8m36.840209598s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.151782239 (832h8m36.849350555s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152331545 (832h8m36.849899861s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152813115 (832h8m36.850381431s) [noise=true , address=185.167.204.205:4026 , piece_id=SKCE257VNOP62EKHFZQGGYZ7AIA5GWCT4ZW7IQOXQJSVDYKODMRQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.172329604 (832h8m36.869897921s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.179173059 (832h8m36.876741375s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.196489869 (832h8m36.894058175s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.198678477 (832h8m36.896246784s) [noise=true , address=81.171.14.70:4045 , piece_id=J5I4QOVP6ROOB6ZCB75VRTP37ISKCLJ6BJNRZTT3CHOZO2ORKQ5A, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.576067236 (832h8m37.273635542s) [noise=true , address=81.171.14.70:4026 , piece_id=XXAI6MD34XUH6PEPYOVHKMG4GXCEAM4WHKZDM3UHXSKNG2NAPOMA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.612447320 (832h8m37.310015636s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.674090269 (832h8m37.371658585s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.698435238 (832h8m37.396003554s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:38:48.005767171 (832h9m35.703335477s) [noise=true , address=81.171.14.70:4042 , piece_id=SBER7MUZFU5HXAAQN5W7IPGYZ4RQZNX7LCV3PHDCQIIN2P7GHVGQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: context deadline exceeded; context deadline exceeded
Jan 9 07:38:48.005822034 (832h9m35.70339034s) [noise=true , address=81.171.14.70:4035 , piece_id=JCZZOD3KHUISYLIPJKGMAHZ5QOPKTZMHIPGUCAGJHBZX2ZYBALUA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: rpc: dial tcp 81.171.14.70:4035: i/o timeout; context deadline exceeded
Jan 9 07:38:48.005952648 (832h9m35.703520984s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 5.161.89.252:32526->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 9 07:38:48.005994226 (832h9m35.703562562s) [seg_pos={0 0}, upload=732073]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 9 07:38:48.109550624 (832h9m35.80711896s) [upload=732073]: Done uploading segments...
Jan 9 07:38:48.109585420 (832h9m35.807153755s) [upload=732073]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.239454223s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)antiblip:
3 out of 60 is failed (threshold=3) [...........................XX..X............................] duration:
8.423586ms target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/2ac98d14171470eb
FAIL (2026-01-09 07:55:41 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout
Duration: 8.438654ms
edge
linksharing
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................X.X..........................] duration:
335.943145ms trace:
https://jaeger.dev.storj.io/trace/5af4d89436e82463
FAIL (2026-01-09 07:55:22 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 335.963353ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)antiblip:
3 out of 60 is failed (threshold=3) [............................XX..X...........................] duration:
4.609281ms target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/2ac98d14171470eb
FAIL (2026-01-09 07:55:06 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout
Duration: 4.631361ms
edge
linksharing
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....................................XXX....................] duration:
192.929014ms trace:
https://jaeger.dev.storj.io/trace/f4bac8f86eddf53
FAIL (2026-01-09 07:55:00 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 192.940235ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
27.833157ms target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/562634a9d869637c
FAIL (2026-01-09 07:54:58 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout
Duration: 27.852824ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [...................................XX.X.....................] duration:
2.693877788s trace:
https://jaeger.dev.storj.io/trace/6735d4b874ab1ef5
FAIL (2026-01-09 07:54:55 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
03564596s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.408402825 (832h8m36.105971141s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.409232034 (832h8m36.10680034s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.410100727 (832h8m36.107669033s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.411643299 (832h8m36.109211605s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.412026585 (832h8m36.109594931s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.413398217 (832h8m36.110966523s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414194315 (832h8m36.111762621s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414527187 (832h8m36.112095493s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.417979455 (832h8m36.115547771s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.419110590 (832h8m36.116678906s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.420189664 (832h8m36.117757981s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.421246770 (832h8m36.118815076s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.864750971 (832h8m36.562319277s) [upload=732073]: Next returned nil segment
Jan 9 07:37:48.864760439 (832h8m36.562328755s) [upload=732073]: Waiting for error group managing segments...
Jan 9 07:37:49.079903909 (832h8m36.777472216s) [noise=true , address=185.167.204.205:4014 , piece_id=JTQC4RDGKGUW7LPJKMG4FQQP4PDZURUNCLN7D5IR6DVYKCXTDXMQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081476859 (832h8m36.779045164s) [noise=true , address=185.167.204.205:4036 , piece_id=36F5ETODK33CJ3DYLVDO74ILEUCO46EOGFSDOIYFIZOFMSYCWZJQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081854243 (832h8m36.779422549s) [noise=true , address=185.167.204.206:4047 , piece_id=NX5VZNEAAQWZIVENWWI6D6JGPSVAR25G7UNLR4VM2IO3R5R2RNFA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.084019388 (832h8m36.781587694s) [noise=true , address=185.167.204.205:4030 , piece_id=XDZNUF4U7B3LBSGGDF5KQMFAMULAVDBGV77W2HLB3TQ6A63T2LKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085665192 (832h8m36.783233498s) [noise=true , address=185.167.204.205:4016 , piece_id=7DOGCUU3CLYQEXEDHJEA3TBLPZXG2ZYZ2ELHPMI6ABEN3SCHVIGA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085685219 (832h8m36.783253526s) [noise=true , address=185.167.204.206:4063 , piece_id=TS7CR4OJYFCIVJTYUIDMZG6OFGDTD2UEXBTYXRCUPX6PPKWMQI3Q, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.092142522 (832h8m36.789710829s) [noise=true , address=89.149.201.147:4003 , piece_id=G44C4AXJFDLENH24JTOYRMOT2W2TQYKBG4VKCTJVI42IWDZAUMKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.094372309 (832h8m36.791940614s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.099207151 (832h8m36.796775457s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.100548106 (832h8m36.798116402s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.126257155 (832h8m36.82382546s) [noise=true , address=185.167.204.206:4068 , piece_id=4BHBFT7M5FRFXI2BHSA6EKXDFCU3GCXBVVITTB2WIEFU4P36VAIA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.133142828 (832h8m36.830711144s) [noise=true , address=185.167.204.205:4011 , piece_id=ZWVL45YULGYIG6D32ZEKCXGMIQQYVH4JVEXQPL32SNGOBDYWN3KQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.134306753 (832h8m36.831875069s) [noise=true , address=185.167.204.206:4040 , piece_id=FW2G4XCVY4LOVZSHQ25TCFTCDYMRLHXVNBU76OIIGI2UTTIIQXKQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.142641292 (832h8m36.840209598s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.151782239 (832h8m36.849350555s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152331545 (832h8m36.849899861s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152813115 (832h8m36.850381431s) [noise=true , address=185.167.204.205:4026 , piece_id=SKCE257VNOP62EKHFZQGGYZ7AIA5GWCT4ZW7IQOXQJSVDYKODMRQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.172329604 (832h8m36.869897921s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.179173059 (832h8m36.876741375s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.196489869 (832h8m36.894058175s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.198678477 (832h8m36.896246784s) [noise=true , address=81.171.14.70:4045 , piece_id=J5I4QOVP6ROOB6ZCB75VRTP37ISKCLJ6BJNRZTT3CHOZO2ORKQ5A, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.576067236 (832h8m37.273635542s) [noise=true , address=81.171.14.70:4026 , piece_id=XXAI6MD34XUH6PEPYOVHKMG4GXCEAM4WHKZDM3UHXSKNG2NAPOMA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.612447320 (832h8m37.310015636s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.674090269 (832h8m37.371658585s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.698435238 (832h8m37.396003554s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:38:48.005767171 (832h9m35.703335477s) [noise=true , address=81.171.14.70:4042 , piece_id=SBER7MUZFU5HXAAQN5W7IPGYZ4RQZNX7LCV3PHDCQIIN2P7GHVGQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: context deadline exceeded; context deadline exceeded
Jan 9 07:38:48.005822034 (832h9m35.70339034s) [noise=true , address=81.171.14.70:4035 , piece_id=JCZZOD3KHUISYLIPJKGMAHZ5QOPKTZMHIPGUCAGJHBZX2ZYBALUA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: rpc: dial tcp 81.171.14.70:4035: i/o timeout; context deadline exceeded
Jan 9 07:38:48.005952648 (832h9m35.703520984s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 5.161.89.252:32526->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 9 07:38:48.005994226 (832h9m35.703562562s) [seg_pos={0 0}, upload=732073]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 9 07:38:48.109550624 (832h9m35.80711896s) [upload=732073]: Done uploading segments...
Jan 9 07:38:48.109585420 (832h9m35.807153755s) [upload=732073]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.693898196s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
2 out of 60 is failed (threshold=3) [................................XX..........................] duration:
36.232768ms trace:
https://jaeger.dev.storj.io/trace/4d3b7b3eb36724ba
FAIL (2026-01-09 07:54:46 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 36.250132ms
edge
authservice
http
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
26.513843ms target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/562634a9d869637c
FAIL (2026-01-09 07:54:40 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout
Duration: 26.535764ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
2 out of 60 is failed (threshold=3) [...............................XX...........................] duration:
132.268799ms target:
https://version.storj.io/ trace:
https://jaeger.dev.storj.io/trace/1634496fdb368bf9
FAIL (2026-01-09 07:54:39 UTC)
orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: i/o timeout
Duration: 132.290861ms
core
website
|
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)antiblip:
3 out of 60 is failed (threshold=3) [.............................XX..X..........................] duration:
9.207502ms target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/2ac98d14171470eb
FAIL (2026-01-09 07:54:27 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout
Duration: 9.226246ms
edge
linksharing
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [....................................XX.X....................] duration:
2.19417757s trace:
https://jaeger.dev.storj.io/trace/6735d4b874ab1ef5
FAIL (2026-01-09 07:54:22 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
03564596s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.408402825 (832h8m36.105971141s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.409232034 (832h8m36.10680034s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.410100727 (832h8m36.107669033s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.411643299 (832h8m36.109211605s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.412026585 (832h8m36.109594931s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.413398217 (832h8m36.110966523s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414194315 (832h8m36.111762621s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414527187 (832h8m36.112095493s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.417979455 (832h8m36.115547771s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.419110590 (832h8m36.116678906s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.420189664 (832h8m36.117757981s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.421246770 (832h8m36.118815076s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.864750971 (832h8m36.562319277s) [upload=732073]: Next returned nil segment
Jan 9 07:37:48.864760439 (832h8m36.562328755s) [upload=732073]: Waiting for error group managing segments...
Jan 9 07:37:49.079903909 (832h8m36.777472216s) [noise=true , address=185.167.204.205:4014 , piece_id=JTQC4RDGKGUW7LPJKMG4FQQP4PDZURUNCLN7D5IR6DVYKCXTDXMQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081476859 (832h8m36.779045164s) [noise=true , address=185.167.204.205:4036 , piece_id=36F5ETODK33CJ3DYLVDO74ILEUCO46EOGFSDOIYFIZOFMSYCWZJQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081854243 (832h8m36.779422549s) [noise=true , address=185.167.204.206:4047 , piece_id=NX5VZNEAAQWZIVENWWI6D6JGPSVAR25G7UNLR4VM2IO3R5R2RNFA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.084019388 (832h8m36.781587694s) [noise=true , address=185.167.204.205:4030 , piece_id=XDZNUF4U7B3LBSGGDF5KQMFAMULAVDBGV77W2HLB3TQ6A63T2LKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085665192 (832h8m36.783233498s) [noise=true , address=185.167.204.205:4016 , piece_id=7DOGCUU3CLYQEXEDHJEA3TBLPZXG2ZYZ2ELHPMI6ABEN3SCHVIGA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085685219 (832h8m36.783253526s) [noise=true , address=185.167.204.206:4063 , piece_id=TS7CR4OJYFCIVJTYUIDMZG6OFGDTD2UEXBTYXRCUPX6PPKWMQI3Q, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.092142522 (832h8m36.789710829s) [noise=true , address=89.149.201.147:4003 , piece_id=G44C4AXJFDLENH24JTOYRMOT2W2TQYKBG4VKCTJVI42IWDZAUMKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.094372309 (832h8m36.791940614s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.099207151 (832h8m36.796775457s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.100548106 (832h8m36.798116402s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.126257155 (832h8m36.82382546s) [noise=true , address=185.167.204.206:4068 , piece_id=4BHBFT7M5FRFXI2BHSA6EKXDFCU3GCXBVVITTB2WIEFU4P36VAIA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.133142828 (832h8m36.830711144s) [noise=true , address=185.167.204.205:4011 , piece_id=ZWVL45YULGYIG6D32ZEKCXGMIQQYVH4JVEXQPL32SNGOBDYWN3KQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.134306753 (832h8m36.831875069s) [noise=true , address=185.167.204.206:4040 , piece_id=FW2G4XCVY4LOVZSHQ25TCFTCDYMRLHXVNBU76OIIGI2UTTIIQXKQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.142641292 (832h8m36.840209598s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.151782239 (832h8m36.849350555s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152331545 (832h8m36.849899861s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152813115 (832h8m36.850381431s) [noise=true , address=185.167.204.205:4026 , piece_id=SKCE257VNOP62EKHFZQGGYZ7AIA5GWCT4ZW7IQOXQJSVDYKODMRQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.172329604 (832h8m36.869897921s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.179173059 (832h8m36.876741375s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.196489869 (832h8m36.894058175s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.198678477 (832h8m36.896246784s) [noise=true , address=81.171.14.70:4045 , piece_id=J5I4QOVP6ROOB6ZCB75VRTP37ISKCLJ6BJNRZTT3CHOZO2ORKQ5A, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.576067236 (832h8m37.273635542s) [noise=true , address=81.171.14.70:4026 , piece_id=XXAI6MD34XUH6PEPYOVHKMG4GXCEAM4WHKZDM3UHXSKNG2NAPOMA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.612447320 (832h8m37.310015636s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.674090269 (832h8m37.371658585s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.698435238 (832h8m37.396003554s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:38:48.005767171 (832h9m35.703335477s) [noise=true , address=81.171.14.70:4042 , piece_id=SBER7MUZFU5HXAAQN5W7IPGYZ4RQZNX7LCV3PHDCQIIN2P7GHVGQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: context deadline exceeded; context deadline exceeded
Jan 9 07:38:48.005822034 (832h9m35.70339034s) [noise=true , address=81.171.14.70:4035 , piece_id=JCZZOD3KHUISYLIPJKGMAHZ5QOPKTZMHIPGUCAGJHBZX2ZYBALUA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: rpc: dial tcp 81.171.14.70:4035: i/o timeout; context deadline exceeded
Jan 9 07:38:48.005952648 (832h9m35.703520984s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 5.161.89.252:32526->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 9 07:38:48.005994226 (832h9m35.703562562s) [seg_pos={0 0}, upload=732073]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 9 07:38:48.109550624 (832h9m35.80711896s) [upload=732073]: Done uploading segments...
Jan 9 07:38:48.109585420 (832h9m35.807153755s) [upload=732073]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.194197026s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [................................X.X.........................] duration:
329.333119ms trace:
https://jaeger.dev.storj.io/trace/5af4d89436e82463
FAIL (2026-01-09 07:54:14 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 329.351563ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
2 out of 60 is failed (threshold=3) [................................XX..........................] duration:
139.152821ms target:
https://version.storj.io/ trace:
https://jaeger.dev.storj.io/trace/1634496fdb368bf9
FAIL (2026-01-09 07:54:02 UTC)
orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: i/o timeout
Duration: 139.170795ms
core
website
|