Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
2 out of 60 is failed (threshold=3) [.................................XX.........................] duration:
46.207073ms trace:
https://jaeger.dev.storj.io/trace/4d3b7b3eb36724ba
FAIL (2026-01-09 07:53:53 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 46.234833ms
edge
authservice
http
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [.....................................XX.X...................] duration:
2.738965912s trace:
https://jaeger.dev.storj.io/trace/6735d4b874ab1ef5
FAIL (2026-01-09 07:53:51 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
03564596s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.408402825 (832h8m36.105971141s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.409232034 (832h8m36.10680034s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.410100727 (832h8m36.107669033s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.411643299 (832h8m36.109211605s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.412026585 (832h8m36.109594931s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.413398217 (832h8m36.110966523s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414194315 (832h8m36.111762621s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414527187 (832h8m36.112095493s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.417979455 (832h8m36.115547771s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.419110590 (832h8m36.116678906s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.420189664 (832h8m36.117757981s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.421246770 (832h8m36.118815076s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.864750971 (832h8m36.562319277s) [upload=732073]: Next returned nil segment
Jan 9 07:37:48.864760439 (832h8m36.562328755s) [upload=732073]: Waiting for error group managing segments...
Jan 9 07:37:49.079903909 (832h8m36.777472216s) [noise=true , address=185.167.204.205:4014 , piece_id=JTQC4RDGKGUW7LPJKMG4FQQP4PDZURUNCLN7D5IR6DVYKCXTDXMQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081476859 (832h8m36.779045164s) [noise=true , address=185.167.204.205:4036 , piece_id=36F5ETODK33CJ3DYLVDO74ILEUCO46EOGFSDOIYFIZOFMSYCWZJQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081854243 (832h8m36.779422549s) [noise=true , address=185.167.204.206:4047 , piece_id=NX5VZNEAAQWZIVENWWI6D6JGPSVAR25G7UNLR4VM2IO3R5R2RNFA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.084019388 (832h8m36.781587694s) [noise=true , address=185.167.204.205:4030 , piece_id=XDZNUF4U7B3LBSGGDF5KQMFAMULAVDBGV77W2HLB3TQ6A63T2LKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085665192 (832h8m36.783233498s) [noise=true , address=185.167.204.205:4016 , piece_id=7DOGCUU3CLYQEXEDHJEA3TBLPZXG2ZYZ2ELHPMI6ABEN3SCHVIGA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085685219 (832h8m36.783253526s) [noise=true , address=185.167.204.206:4063 , piece_id=TS7CR4OJYFCIVJTYUIDMZG6OFGDTD2UEXBTYXRCUPX6PPKWMQI3Q, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.092142522 (832h8m36.789710829s) [noise=true , address=89.149.201.147:4003 , piece_id=G44C4AXJFDLENH24JTOYRMOT2W2TQYKBG4VKCTJVI42IWDZAUMKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.094372309 (832h8m36.791940614s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.099207151 (832h8m36.796775457s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.100548106 (832h8m36.798116402s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.126257155 (832h8m36.82382546s) [noise=true , address=185.167.204.206:4068 , piece_id=4BHBFT7M5FRFXI2BHSA6EKXDFCU3GCXBVVITTB2WIEFU4P36VAIA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.133142828 (832h8m36.830711144s) [noise=true , address=185.167.204.205:4011 , piece_id=ZWVL45YULGYIG6D32ZEKCXGMIQQYVH4JVEXQPL32SNGOBDYWN3KQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.134306753 (832h8m36.831875069s) [noise=true , address=185.167.204.206:4040 , piece_id=FW2G4XCVY4LOVZSHQ25TCFTCDYMRLHXVNBU76OIIGI2UTTIIQXKQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.142641292 (832h8m36.840209598s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.151782239 (832h8m36.849350555s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152331545 (832h8m36.849899861s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152813115 (832h8m36.850381431s) [noise=true , address=185.167.204.205:4026 , piece_id=SKCE257VNOP62EKHFZQGGYZ7AIA5GWCT4ZW7IQOXQJSVDYKODMRQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.172329604 (832h8m36.869897921s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.179173059 (832h8m36.876741375s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.196489869 (832h8m36.894058175s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.198678477 (832h8m36.896246784s) [noise=true , address=81.171.14.70:4045 , piece_id=J5I4QOVP6ROOB6ZCB75VRTP37ISKCLJ6BJNRZTT3CHOZO2ORKQ5A, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.576067236 (832h8m37.273635542s) [noise=true , address=81.171.14.70:4026 , piece_id=XXAI6MD34XUH6PEPYOVHKMG4GXCEAM4WHKZDM3UHXSKNG2NAPOMA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.612447320 (832h8m37.310015636s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.674090269 (832h8m37.371658585s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.698435238 (832h8m37.396003554s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:38:48.005767171 (832h9m35.703335477s) [noise=true , address=81.171.14.70:4042 , piece_id=SBER7MUZFU5HXAAQN5W7IPGYZ4RQZNX7LCV3PHDCQIIN2P7GHVGQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: context deadline exceeded; context deadline exceeded
Jan 9 07:38:48.005822034 (832h9m35.70339034s) [noise=true , address=81.171.14.70:4035 , piece_id=JCZZOD3KHUISYLIPJKGMAHZ5QOPKTZMHIPGUCAGJHBZX2ZYBALUA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: rpc: dial tcp 81.171.14.70:4035: i/o timeout; context deadline exceeded
Jan 9 07:38:48.005952648 (832h9m35.703520984s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 5.161.89.252:32526->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 9 07:38:48.005994226 (832h9m35.703562562s) [seg_pos={0 0}, upload=732073]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 9 07:38:48.109550624 (832h9m35.80711896s) [upload=732073]: Done uploading segments...
Jan 9 07:38:48.109585420 (832h9m35.807153755s) [upload=732073]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.739004745s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
3 out of 60 is failed (threshold=3) [......................................XXX...................] duration:
167.192752ms trace:
https://jaeger.dev.storj.io/trace/f4bac8f86eddf53
FAIL (2026-01-09 07:53:50 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 167.424707ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................................X.X........................] duration:
358.824574ms trace:
https://jaeger.dev.storj.io/trace/5af4d89436e82463
FAIL (2026-01-09 07:53:43 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 358.853508ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
22.891796ms target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/562634a9d869637c
FAIL (2026-01-09 07:53:41 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout
Duration: 22.920159ms
edge
gateway
vhost
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
2 out of 60 is failed (threshold=3) [..................................XX........................] duration:
41.051902ms trace:
https://jaeger.dev.storj.io/trace/4d3b7b3eb36724ba
FAIL (2026-01-09 07:53:31 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 41.076087ms
edge
authservice
http
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......................................XXX..................] duration:
168.87793ms trace:
https://jaeger.dev.storj.io/trace/f4bac8f86eddf53
FAIL (2026-01-09 07:53:28 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 168.897197ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
19.212403ms target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/562634a9d869637c
FAIL (2026-01-09 07:53:18 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout
Duration: 19.249641ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
2 out of 60 is failed (threshold=3) [.................................XX.........................] duration:
137.693534ms target:
https://version.storj.io/ trace:
https://jaeger.dev.storj.io/trace/1634496fdb368bf9
FAIL (2026-01-09 07:53:17 UTC)
orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: i/o timeout
Duration: 137.718452ms
core
website
|
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)antiblip:
3 out of 60 is failed (threshold=3) [..............................XX..X.........................] duration:
10.168406ms target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/2ac98d14171470eb
FAIL (2026-01-09 07:53:15 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout
Duration: 10.190377ms
edge
linksharing
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................................X.X.......................] duration:
335.114548ms trace:
https://jaeger.dev.storj.io/trace/5af4d89436e82463
FAIL (2026-01-09 07:53:09 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 335.130869ms
edge
gateway
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
2 out of 60 is failed (threshold=3) [...................................XX.......................] duration:
47.906687ms trace:
https://jaeger.dev.storj.io/trace/4d3b7b3eb36724ba
FAIL (2026-01-09 07:52:53 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 47.925703ms
edge
authservice
http
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................................X.X......................] duration:
341.830494ms trace:
https://jaeger.dev.storj.io/trace/5af4d89436e82463
FAIL (2026-01-09 07:52:52 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 341.85449ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [......................................XX.X..................] duration:
2.660917344s trace:
https://jaeger.dev.storj.io/trace/6735d4b874ab1ef5
FAIL (2026-01-09 07:52:45 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
03564596s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.408402825 (832h8m36.105971141s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.409232034 (832h8m36.10680034s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.410100727 (832h8m36.107669033s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.411643299 (832h8m36.109211605s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.412026585 (832h8m36.109594931s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.413398217 (832h8m36.110966523s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414194315 (832h8m36.111762621s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414527187 (832h8m36.112095493s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.417979455 (832h8m36.115547771s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.419110590 (832h8m36.116678906s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.420189664 (832h8m36.117757981s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.421246770 (832h8m36.118815076s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.864750971 (832h8m36.562319277s) [upload=732073]: Next returned nil segment
Jan 9 07:37:48.864760439 (832h8m36.562328755s) [upload=732073]: Waiting for error group managing segments...
Jan 9 07:37:49.079903909 (832h8m36.777472216s) [noise=true , address=185.167.204.205:4014 , piece_id=JTQC4RDGKGUW7LPJKMG4FQQP4PDZURUNCLN7D5IR6DVYKCXTDXMQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081476859 (832h8m36.779045164s) [noise=true , address=185.167.204.205:4036 , piece_id=36F5ETODK33CJ3DYLVDO74ILEUCO46EOGFSDOIYFIZOFMSYCWZJQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081854243 (832h8m36.779422549s) [noise=true , address=185.167.204.206:4047 , piece_id=NX5VZNEAAQWZIVENWWI6D6JGPSVAR25G7UNLR4VM2IO3R5R2RNFA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.084019388 (832h8m36.781587694s) [noise=true , address=185.167.204.205:4030 , piece_id=XDZNUF4U7B3LBSGGDF5KQMFAMULAVDBGV77W2HLB3TQ6A63T2LKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085665192 (832h8m36.783233498s) [noise=true , address=185.167.204.205:4016 , piece_id=7DOGCUU3CLYQEXEDHJEA3TBLPZXG2ZYZ2ELHPMI6ABEN3SCHVIGA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085685219 (832h8m36.783253526s) [noise=true , address=185.167.204.206:4063 , piece_id=TS7CR4OJYFCIVJTYUIDMZG6OFGDTD2UEXBTYXRCUPX6PPKWMQI3Q, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.092142522 (832h8m36.789710829s) [noise=true , address=89.149.201.147:4003 , piece_id=G44C4AXJFDLENH24JTOYRMOT2W2TQYKBG4VKCTJVI42IWDZAUMKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.094372309 (832h8m36.791940614s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.099207151 (832h8m36.796775457s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.100548106 (832h8m36.798116402s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.126257155 (832h8m36.82382546s) [noise=true , address=185.167.204.206:4068 , piece_id=4BHBFT7M5FRFXI2BHSA6EKXDFCU3GCXBVVITTB2WIEFU4P36VAIA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.133142828 (832h8m36.830711144s) [noise=true , address=185.167.204.205:4011 , piece_id=ZWVL45YULGYIG6D32ZEKCXGMIQQYVH4JVEXQPL32SNGOBDYWN3KQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.134306753 (832h8m36.831875069s) [noise=true , address=185.167.204.206:4040 , piece_id=FW2G4XCVY4LOVZSHQ25TCFTCDYMRLHXVNBU76OIIGI2UTTIIQXKQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.142641292 (832h8m36.840209598s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.151782239 (832h8m36.849350555s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152331545 (832h8m36.849899861s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152813115 (832h8m36.850381431s) [noise=true , address=185.167.204.205:4026 , piece_id=SKCE257VNOP62EKHFZQGGYZ7AIA5GWCT4ZW7IQOXQJSVDYKODMRQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.172329604 (832h8m36.869897921s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.179173059 (832h8m36.876741375s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.196489869 (832h8m36.894058175s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.198678477 (832h8m36.896246784s) [noise=true , address=81.171.14.70:4045 , piece_id=J5I4QOVP6ROOB6ZCB75VRTP37ISKCLJ6BJNRZTT3CHOZO2ORKQ5A, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.576067236 (832h8m37.273635542s) [noise=true , address=81.171.14.70:4026 , piece_id=XXAI6MD34XUH6PEPYOVHKMG4GXCEAM4WHKZDM3UHXSKNG2NAPOMA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.612447320 (832h8m37.310015636s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.674090269 (832h8m37.371658585s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.698435238 (832h8m37.396003554s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:38:48.005767171 (832h9m35.703335477s) [noise=true , address=81.171.14.70:4042 , piece_id=SBER7MUZFU5HXAAQN5W7IPGYZ4RQZNX7LCV3PHDCQIIN2P7GHVGQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: context deadline exceeded; context deadline exceeded
Jan 9 07:38:48.005822034 (832h9m35.70339034s) [noise=true , address=81.171.14.70:4035 , piece_id=JCZZOD3KHUISYLIPJKGMAHZ5QOPKTZMHIPGUCAGJHBZX2ZYBALUA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: rpc: dial tcp 81.171.14.70:4035: i/o timeout; context deadline exceeded
Jan 9 07:38:48.005952648 (832h9m35.703520984s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 5.161.89.252:32526->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 9 07:38:48.005994226 (832h9m35.703562562s) [seg_pos={0 0}, upload=732073]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 9 07:38:48.109550624 (832h9m35.80711896s) [upload=732073]: Done uploading segments...
Jan 9 07:38:48.109585420 (832h9m35.807153755s) [upload=732073]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.660941699s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
2 out of 60 is failed (threshold=3) [..................................XX........................] duration:
130.111618ms target:
https://version.storj.io/ trace:
https://jaeger.dev.storj.io/trace/1634496fdb368bf9
FAIL (2026-01-09 07:52:41 UTC)
orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: i/o timeout
Duration: 130.173273ms
core
website
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
42.647431ms target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/562634a9d869637c
FAIL (2026-01-09 07:52:39 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout
Duration: 42.671727ms
edge
gateway
vhost
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
2 out of 60 is failed (threshold=3) [....................................XX......................] duration:
122.821491ms trace:
https://jaeger.dev.storj.io/trace/4d3b7b3eb36724ba
FAIL (2026-01-09 07:52:25 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 122.849695ms
edge
authservice
http
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
3 out of 60 is failed (threshold=3) [........................................XXX.................] duration:
268.451932ms trace:
https://jaeger.dev.storj.io/trace/f4bac8f86eddf53
FAIL (2026-01-09 07:52:18 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 268.480837ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)antiblip:
3 out of 60 is failed (threshold=3) [...............................XX..X........................] duration:
5.007125ms target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/2ac98d14171470eb
FAIL (2026-01-09 07:52:16 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout
Duration: 5.032192ms
edge
linksharing
us-select-1
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
2 out of 60 is failed (threshold=3) [...................................XX.......................] duration:
128.15249ms target:
https://version.storj.io/ trace:
https://jaeger.dev.storj.io/trace/1634496fdb368bf9
FAIL (2026-01-09 07:51:46 UTC)
orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: i/o timeout
Duration: 128.169763ms
core
website
|
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)antiblip:
3 out of 60 is failed (threshold=3) [................................XX..X.......................] duration:
9.431319ms target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/2ac98d14171470eb
FAIL (2026-01-09 07:51:44 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout
Duration: 9.44799ms
edge
linksharing
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [.......................................XX.X.................] duration:
2.691871974s trace:
https://jaeger.dev.storj.io/trace/6735d4b874ab1ef5
FAIL (2026-01-09 07:51:40 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
03564596s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.408402825 (832h8m36.105971141s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.409232034 (832h8m36.10680034s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.410100727 (832h8m36.107669033s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.411643299 (832h8m36.109211605s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.412026585 (832h8m36.109594931s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.413398217 (832h8m36.110966523s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414194315 (832h8m36.111762621s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414527187 (832h8m36.112095493s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.417979455 (832h8m36.115547771s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.419110590 (832h8m36.116678906s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.420189664 (832h8m36.117757981s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.421246770 (832h8m36.118815076s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.864750971 (832h8m36.562319277s) [upload=732073]: Next returned nil segment
Jan 9 07:37:48.864760439 (832h8m36.562328755s) [upload=732073]: Waiting for error group managing segments...
Jan 9 07:37:49.079903909 (832h8m36.777472216s) [noise=true , address=185.167.204.205:4014 , piece_id=JTQC4RDGKGUW7LPJKMG4FQQP4PDZURUNCLN7D5IR6DVYKCXTDXMQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081476859 (832h8m36.779045164s) [noise=true , address=185.167.204.205:4036 , piece_id=36F5ETODK33CJ3DYLVDO74ILEUCO46EOGFSDOIYFIZOFMSYCWZJQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081854243 (832h8m36.779422549s) [noise=true , address=185.167.204.206:4047 , piece_id=NX5VZNEAAQWZIVENWWI6D6JGPSVAR25G7UNLR4VM2IO3R5R2RNFA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.084019388 (832h8m36.781587694s) [noise=true , address=185.167.204.205:4030 , piece_id=XDZNUF4U7B3LBSGGDF5KQMFAMULAVDBGV77W2HLB3TQ6A63T2LKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085665192 (832h8m36.783233498s) [noise=true , address=185.167.204.205:4016 , piece_id=7DOGCUU3CLYQEXEDHJEA3TBLPZXG2ZYZ2ELHPMI6ABEN3SCHVIGA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085685219 (832h8m36.783253526s) [noise=true , address=185.167.204.206:4063 , piece_id=TS7CR4OJYFCIVJTYUIDMZG6OFGDTD2UEXBTYXRCUPX6PPKWMQI3Q, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.092142522 (832h8m36.789710829s) [noise=true , address=89.149.201.147:4003 , piece_id=G44C4AXJFDLENH24JTOYRMOT2W2TQYKBG4VKCTJVI42IWDZAUMKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.094372309 (832h8m36.791940614s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.099207151 (832h8m36.796775457s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.100548106 (832h8m36.798116402s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.126257155 (832h8m36.82382546s) [noise=true , address=185.167.204.206:4068 , piece_id=4BHBFT7M5FRFXI2BHSA6EKXDFCU3GCXBVVITTB2WIEFU4P36VAIA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.133142828 (832h8m36.830711144s) [noise=true , address=185.167.204.205:4011 , piece_id=ZWVL45YULGYIG6D32ZEKCXGMIQQYVH4JVEXQPL32SNGOBDYWN3KQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.134306753 (832h8m36.831875069s) [noise=true , address=185.167.204.206:4040 , piece_id=FW2G4XCVY4LOVZSHQ25TCFTCDYMRLHXVNBU76OIIGI2UTTIIQXKQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.142641292 (832h8m36.840209598s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.151782239 (832h8m36.849350555s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152331545 (832h8m36.849899861s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152813115 (832h8m36.850381431s) [noise=true , address=185.167.204.205:4026 , piece_id=SKCE257VNOP62EKHFZQGGYZ7AIA5GWCT4ZW7IQOXQJSVDYKODMRQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.172329604 (832h8m36.869897921s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.179173059 (832h8m36.876741375s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.196489869 (832h8m36.894058175s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.198678477 (832h8m36.896246784s) [noise=true , address=81.171.14.70:4045 , piece_id=J5I4QOVP6ROOB6ZCB75VRTP37ISKCLJ6BJNRZTT3CHOZO2ORKQ5A, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.576067236 (832h8m37.273635542s) [noise=true , address=81.171.14.70:4026 , piece_id=XXAI6MD34XUH6PEPYOVHKMG4GXCEAM4WHKZDM3UHXSKNG2NAPOMA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.612447320 (832h8m37.310015636s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.674090269 (832h8m37.371658585s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.698435238 (832h8m37.396003554s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:38:48.005767171 (832h9m35.703335477s) [noise=true , address=81.171.14.70:4042 , piece_id=SBER7MUZFU5HXAAQN5W7IPGYZ4RQZNX7LCV3PHDCQIIN2P7GHVGQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: context deadline exceeded; context deadline exceeded
Jan 9 07:38:48.005822034 (832h9m35.70339034s) [noise=true , address=81.171.14.70:4035 , piece_id=JCZZOD3KHUISYLIPJKGMAHZ5QOPKTZMHIPGUCAGJHBZX2ZYBALUA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: rpc: dial tcp 81.171.14.70:4035: i/o timeout; context deadline exceeded
Jan 9 07:38:48.005952648 (832h9m35.703520984s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 5.161.89.252:32526->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 9 07:38:48.005994226 (832h9m35.703562562s) [seg_pos={0 0}, upload=732073]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 9 07:38:48.109550624 (832h9m35.80711896s) [upload=732073]: Done uploading segments...
Jan 9 07:38:48.109585420 (832h9m35.807153755s) [upload=732073]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.691886742s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................................X.X.....................] duration:
377.993474ms trace:
https://jaeger.dev.storj.io/trace/5af4d89436e82463
FAIL (2026-01-09 07:51:40 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 378.013911ms
edge
gateway
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
2 out of 60 is failed (threshold=3) [.....................................XX.....................] duration:
35.948709ms trace:
https://jaeger.dev.storj.io/trace/4d3b7b3eb36724ba
FAIL (2026-01-09 07:51:36 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 35.961181ms
edge
authservice
http
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
24.983935ms target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/562634a9d869637c
FAIL (2026-01-09 07:51:32 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout
Duration: 25.005065ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X.X....................] duration:
352.796874ms trace:
https://jaeger.dev.storj.io/trace/5af4d89436e82463
FAIL (2026-01-09 07:51:18 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 352.81647ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [........................................XX.X................] duration:
2.231773264s trace:
https://jaeger.dev.storj.io/trace/6735d4b874ab1ef5
FAIL (2026-01-09 07:51:15 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
03564596s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.408402825 (832h8m36.105971141s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.409232034 (832h8m36.10680034s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.410100727 (832h8m36.107669033s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.411643299 (832h8m36.109211605s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.412026585 (832h8m36.109594931s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.413398217 (832h8m36.110966523s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414194315 (832h8m36.111762621s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414527187 (832h8m36.112095493s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.417979455 (832h8m36.115547771s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.419110590 (832h8m36.116678906s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.420189664 (832h8m36.117757981s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.421246770 (832h8m36.118815076s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.864750971 (832h8m36.562319277s) [upload=732073]: Next returned nil segment
Jan 9 07:37:48.864760439 (832h8m36.562328755s) [upload=732073]: Waiting for error group managing segments...
Jan 9 07:37:49.079903909 (832h8m36.777472216s) [noise=true , address=185.167.204.205:4014 , piece_id=JTQC4RDGKGUW7LPJKMG4FQQP4PDZURUNCLN7D5IR6DVYKCXTDXMQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081476859 (832h8m36.779045164s) [noise=true , address=185.167.204.205:4036 , piece_id=36F5ETODK33CJ3DYLVDO74ILEUCO46EOGFSDOIYFIZOFMSYCWZJQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081854243 (832h8m36.779422549s) [noise=true , address=185.167.204.206:4047 , piece_id=NX5VZNEAAQWZIVENWWI6D6JGPSVAR25G7UNLR4VM2IO3R5R2RNFA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.084019388 (832h8m36.781587694s) [noise=true , address=185.167.204.205:4030 , piece_id=XDZNUF4U7B3LBSGGDF5KQMFAMULAVDBGV77W2HLB3TQ6A63T2LKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085665192 (832h8m36.783233498s) [noise=true , address=185.167.204.205:4016 , piece_id=7DOGCUU3CLYQEXEDHJEA3TBLPZXG2ZYZ2ELHPMI6ABEN3SCHVIGA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085685219 (832h8m36.783253526s) [noise=true , address=185.167.204.206:4063 , piece_id=TS7CR4OJYFCIVJTYUIDMZG6OFGDTD2UEXBTYXRCUPX6PPKWMQI3Q, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.092142522 (832h8m36.789710829s) [noise=true , address=89.149.201.147:4003 , piece_id=G44C4AXJFDLENH24JTOYRMOT2W2TQYKBG4VKCTJVI42IWDZAUMKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.094372309 (832h8m36.791940614s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.099207151 (832h8m36.796775457s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.100548106 (832h8m36.798116402s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.126257155 (832h8m36.82382546s) [noise=true , address=185.167.204.206:4068 , piece_id=4BHBFT7M5FRFXI2BHSA6EKXDFCU3GCXBVVITTB2WIEFU4P36VAIA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.133142828 (832h8m36.830711144s) [noise=true , address=185.167.204.205:4011 , piece_id=ZWVL45YULGYIG6D32ZEKCXGMIQQYVH4JVEXQPL32SNGOBDYWN3KQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.134306753 (832h8m36.831875069s) [noise=true , address=185.167.204.206:4040 , piece_id=FW2G4XCVY4LOVZSHQ25TCFTCDYMRLHXVNBU76OIIGI2UTTIIQXKQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.142641292 (832h8m36.840209598s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.151782239 (832h8m36.849350555s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152331545 (832h8m36.849899861s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152813115 (832h8m36.850381431s) [noise=true , address=185.167.204.205:4026 , piece_id=SKCE257VNOP62EKHFZQGGYZ7AIA5GWCT4ZW7IQOXQJSVDYKODMRQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.172329604 (832h8m36.869897921s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.179173059 (832h8m36.876741375s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.196489869 (832h8m36.894058175s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.198678477 (832h8m36.896246784s) [noise=true , address=81.171.14.70:4045 , piece_id=J5I4QOVP6ROOB6ZCB75VRTP37ISKCLJ6BJNRZTT3CHOZO2ORKQ5A, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.576067236 (832h8m37.273635542s) [noise=true , address=81.171.14.70:4026 , piece_id=XXAI6MD34XUH6PEPYOVHKMG4GXCEAM4WHKZDM3UHXSKNG2NAPOMA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.612447320 (832h8m37.310015636s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.674090269 (832h8m37.371658585s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.698435238 (832h8m37.396003554s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:38:48.005767171 (832h9m35.703335477s) [noise=true , address=81.171.14.70:4042 , piece_id=SBER7MUZFU5HXAAQN5W7IPGYZ4RQZNX7LCV3PHDCQIIN2P7GHVGQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: context deadline exceeded; context deadline exceeded
Jan 9 07:38:48.005822034 (832h9m35.70339034s) [noise=true , address=81.171.14.70:4035 , piece_id=JCZZOD3KHUISYLIPJKGMAHZ5QOPKTZMHIPGUCAGJHBZX2ZYBALUA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: rpc: dial tcp 81.171.14.70:4035: i/o timeout; context deadline exceeded
Jan 9 07:38:48.005952648 (832h9m35.703520984s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 5.161.89.252:32526->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 9 07:38:48.005994226 (832h9m35.703562562s) [seg_pos={0 0}, upload=732073]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 9 07:38:48.109550624 (832h9m35.80711896s) [upload=732073]: Done uploading segments...
Jan 9 07:38:48.109585420 (832h9m35.807153755s) [upload=732073]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.231787831s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........................................XXX................] duration:
222.337774ms trace:
https://jaeger.dev.storj.io/trace/f4bac8f86eddf53
FAIL (2026-01-09 07:51:13 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 222.39932ms
edge
gateway
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
2 out of 60 is failed (threshold=3) [......................................XX....................] duration:
69.714625ms trace:
https://jaeger.dev.storj.io/trace/4d3b7b3eb36724ba
FAIL (2026-01-09 07:51:11 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 69.739632ms
edge
authservice
http
us-select-1
|
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)antiblip:
3 out of 60 is failed (threshold=3) [.................................XX..X......................] duration:
3.277633ms target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/2ac98d14171470eb
FAIL (2026-01-09 07:51:05 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout
Duration: 3.293442ms
edge
linksharing
us-select-1
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
2 out of 60 is failed (threshold=3) [....................................XX......................] duration:
130.256569ms target:
https://version.storj.io/ trace:
https://jaeger.dev.storj.io/trace/1634496fdb368bf9
FAIL (2026-01-09 07:50:59 UTC)
orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: i/o timeout
Duration: 130.273651ms
core
website
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
38.995811ms target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/562634a9d869637c
FAIL (2026-01-09 07:50:45 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout
Duration: 39.007372ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
2 out of 60 is failed (threshold=3) [.....................................XX.....................] duration:
130.917163ms target:
https://version.storj.io/ trace:
https://jaeger.dev.storj.io/trace/1634496fdb368bf9
FAIL (2026-01-09 07:50:40 UTC)
orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: i/o timeout
Duration: 130.937431ms
core
website
|
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)antiblip:
3 out of 60 is failed (threshold=3) [..................................XX..X.....................] duration:
9.192864ms target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/2ac98d14171470eb
FAIL (2026-01-09 07:50:34 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout
Duration: 9.211629ms
edge
linksharing
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........................................XXX...............] duration:
166.597802ms trace:
https://jaeger.dev.storj.io/trace/f4bac8f86eddf53
FAIL (2026-01-09 07:50:33 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 166.614433ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................................X.X...................] duration:
336.570337ms trace:
https://jaeger.dev.storj.io/trace/5af4d89436e82463
FAIL (2026-01-09 07:50:24 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 336.587739ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [.........................................XX.X...............] duration:
2.640371311s trace:
https://jaeger.dev.storj.io/trace/6735d4b874ab1ef5
FAIL (2026-01-09 07:50:15 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
03564596s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.408402825 (832h8m36.105971141s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.409232034 (832h8m36.10680034s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.410100727 (832h8m36.107669033s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.411643299 (832h8m36.109211605s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.412026585 (832h8m36.109594931s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.413398217 (832h8m36.110966523s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414194315 (832h8m36.111762621s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414527187 (832h8m36.112095493s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.417979455 (832h8m36.115547771s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.419110590 (832h8m36.116678906s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.420189664 (832h8m36.117757981s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.421246770 (832h8m36.118815076s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.864750971 (832h8m36.562319277s) [upload=732073]: Next returned nil segment
Jan 9 07:37:48.864760439 (832h8m36.562328755s) [upload=732073]: Waiting for error group managing segments...
Jan 9 07:37:49.079903909 (832h8m36.777472216s) [noise=true , address=185.167.204.205:4014 , piece_id=JTQC4RDGKGUW7LPJKMG4FQQP4PDZURUNCLN7D5IR6DVYKCXTDXMQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081476859 (832h8m36.779045164s) [noise=true , address=185.167.204.205:4036 , piece_id=36F5ETODK33CJ3DYLVDO74ILEUCO46EOGFSDOIYFIZOFMSYCWZJQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081854243 (832h8m36.779422549s) [noise=true , address=185.167.204.206:4047 , piece_id=NX5VZNEAAQWZIVENWWI6D6JGPSVAR25G7UNLR4VM2IO3R5R2RNFA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.084019388 (832h8m36.781587694s) [noise=true , address=185.167.204.205:4030 , piece_id=XDZNUF4U7B3LBSGGDF5KQMFAMULAVDBGV77W2HLB3TQ6A63T2LKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085665192 (832h8m36.783233498s) [noise=true , address=185.167.204.205:4016 , piece_id=7DOGCUU3CLYQEXEDHJEA3TBLPZXG2ZYZ2ELHPMI6ABEN3SCHVIGA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085685219 (832h8m36.783253526s) [noise=true , address=185.167.204.206:4063 , piece_id=TS7CR4OJYFCIVJTYUIDMZG6OFGDTD2UEXBTYXRCUPX6PPKWMQI3Q, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.092142522 (832h8m36.789710829s) [noise=true , address=89.149.201.147:4003 , piece_id=G44C4AXJFDLENH24JTOYRMOT2W2TQYKBG4VKCTJVI42IWDZAUMKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.094372309 (832h8m36.791940614s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.099207151 (832h8m36.796775457s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.100548106 (832h8m36.798116402s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.126257155 (832h8m36.82382546s) [noise=true , address=185.167.204.206:4068 , piece_id=4BHBFT7M5FRFXI2BHSA6EKXDFCU3GCXBVVITTB2WIEFU4P36VAIA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.133142828 (832h8m36.830711144s) [noise=true , address=185.167.204.205:4011 , piece_id=ZWVL45YULGYIG6D32ZEKCXGMIQQYVH4JVEXQPL32SNGOBDYWN3KQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.134306753 (832h8m36.831875069s) [noise=true , address=185.167.204.206:4040 , piece_id=FW2G4XCVY4LOVZSHQ25TCFTCDYMRLHXVNBU76OIIGI2UTTIIQXKQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.142641292 (832h8m36.840209598s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.151782239 (832h8m36.849350555s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152331545 (832h8m36.849899861s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152813115 (832h8m36.850381431s) [noise=true , address=185.167.204.205:4026 , piece_id=SKCE257VNOP62EKHFZQGGYZ7AIA5GWCT4ZW7IQOXQJSVDYKODMRQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.172329604 (832h8m36.869897921s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.179173059 (832h8m36.876741375s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.196489869 (832h8m36.894058175s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.198678477 (832h8m36.896246784s) [noise=true , address=81.171.14.70:4045 , piece_id=J5I4QOVP6ROOB6ZCB75VRTP37ISKCLJ6BJNRZTT3CHOZO2ORKQ5A, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.576067236 (832h8m37.273635542s) [noise=true , address=81.171.14.70:4026 , piece_id=XXAI6MD34XUH6PEPYOVHKMG4GXCEAM4WHKZDM3UHXSKNG2NAPOMA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.612447320 (832h8m37.310015636s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.674090269 (832h8m37.371658585s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.698435238 (832h8m37.396003554s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:38:48.005767171 (832h9m35.703335477s) [noise=true , address=81.171.14.70:4042 , piece_id=SBER7MUZFU5HXAAQN5W7IPGYZ4RQZNX7LCV3PHDCQIIN2P7GHVGQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: context deadline exceeded; context deadline exceeded
Jan 9 07:38:48.005822034 (832h9m35.70339034s) [noise=true , address=81.171.14.70:4035 , piece_id=JCZZOD3KHUISYLIPJKGMAHZ5QOPKTZMHIPGUCAGJHBZX2ZYBALUA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: rpc: dial tcp 81.171.14.70:4035: i/o timeout; context deadline exceeded
Jan 9 07:38:48.005952648 (832h9m35.703520984s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 5.161.89.252:32526->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 9 07:38:48.005994226 (832h9m35.703562562s) [seg_pos={0 0}, upload=732073]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 9 07:38:48.109550624 (832h9m35.80711896s) [upload=732073]: Done uploading segments...
Jan 9 07:38:48.109585420 (832h9m35.807153755s) [upload=732073]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.640389014s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
2 out of 60 is failed (threshold=3) [.......................................XX...................] duration:
37.972259ms trace:
https://jaeger.dev.storj.io/trace/4d3b7b3eb36724ba
FAIL (2026-01-09 07:50:02 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 37.994772ms
edge
authservice
http
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................................X.X..................] duration:
368.778968ms trace:
https://jaeger.dev.storj.io/trace/5af4d89436e82463
FAIL (2026-01-09 07:49:59 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 368.795619ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)antiblip:
3 out of 60 is failed (threshold=3) [...................................XX..X....................] duration:
3.557295ms target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/2ac98d14171470eb
FAIL (2026-01-09 07:49:53 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout
Duration: 3.572684ms
edge
linksharing
us-select-1
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
2 out of 60 is failed (threshold=3) [......................................XX....................] duration:
130.645906ms target:
https://version.storj.io/ trace:
https://jaeger.dev.storj.io/trace/1634496fdb368bf9
FAIL (2026-01-09 07:49:50 UTC)
orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: i/o timeout
Duration: 130.666325ms
core
website
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........................................XXX..............] duration:
195.117591ms trace:
https://jaeger.dev.storj.io/trace/f4bac8f86eddf53
FAIL (2026-01-09 07:49:50 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 195.153267ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)antiblip:
3 out of 60 is failed (threshold=3) [....................................XX..X...................] duration:
9.332544ms target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/2ac98d14171470eb
FAIL (2026-01-09 07:49:37 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout
Duration: 9.347603ms
edge
linksharing
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
35.163722ms target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/562634a9d869637c
FAIL (2026-01-09 07:49:31 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout
Duration: 35.186696ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [..........................................XX.X..............] duration:
2.652411389s trace:
https://jaeger.dev.storj.io/trace/6735d4b874ab1ef5
FAIL (2026-01-09 07:49:29 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
03564596s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.408402825 (832h8m36.105971141s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.409232034 (832h8m36.10680034s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.410100727 (832h8m36.107669033s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.411643299 (832h8m36.109211605s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.412026585 (832h8m36.109594931s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.413398217 (832h8m36.110966523s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414194315 (832h8m36.111762621s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414527187 (832h8m36.112095493s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.417979455 (832h8m36.115547771s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.419110590 (832h8m36.116678906s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.420189664 (832h8m36.117757981s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.421246770 (832h8m36.118815076s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.864750971 (832h8m36.562319277s) [upload=732073]: Next returned nil segment
Jan 9 07:37:48.864760439 (832h8m36.562328755s) [upload=732073]: Waiting for error group managing segments...
Jan 9 07:37:49.079903909 (832h8m36.777472216s) [noise=true , address=185.167.204.205:4014 , piece_id=JTQC4RDGKGUW7LPJKMG4FQQP4PDZURUNCLN7D5IR6DVYKCXTDXMQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081476859 (832h8m36.779045164s) [noise=true , address=185.167.204.205:4036 , piece_id=36F5ETODK33CJ3DYLVDO74ILEUCO46EOGFSDOIYFIZOFMSYCWZJQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081854243 (832h8m36.779422549s) [noise=true , address=185.167.204.206:4047 , piece_id=NX5VZNEAAQWZIVENWWI6D6JGPSVAR25G7UNLR4VM2IO3R5R2RNFA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.084019388 (832h8m36.781587694s) [noise=true , address=185.167.204.205:4030 , piece_id=XDZNUF4U7B3LBSGGDF5KQMFAMULAVDBGV77W2HLB3TQ6A63T2LKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085665192 (832h8m36.783233498s) [noise=true , address=185.167.204.205:4016 , piece_id=7DOGCUU3CLYQEXEDHJEA3TBLPZXG2ZYZ2ELHPMI6ABEN3SCHVIGA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085685219 (832h8m36.783253526s) [noise=true , address=185.167.204.206:4063 , piece_id=TS7CR4OJYFCIVJTYUIDMZG6OFGDTD2UEXBTYXRCUPX6PPKWMQI3Q, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.092142522 (832h8m36.789710829s) [noise=true , address=89.149.201.147:4003 , piece_id=G44C4AXJFDLENH24JTOYRMOT2W2TQYKBG4VKCTJVI42IWDZAUMKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.094372309 (832h8m36.791940614s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.099207151 (832h8m36.796775457s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.100548106 (832h8m36.798116402s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.126257155 (832h8m36.82382546s) [noise=true , address=185.167.204.206:4068 , piece_id=4BHBFT7M5FRFXI2BHSA6EKXDFCU3GCXBVVITTB2WIEFU4P36VAIA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.133142828 (832h8m36.830711144s) [noise=true , address=185.167.204.205:4011 , piece_id=ZWVL45YULGYIG6D32ZEKCXGMIQQYVH4JVEXQPL32SNGOBDYWN3KQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.134306753 (832h8m36.831875069s) [noise=true , address=185.167.204.206:4040 , piece_id=FW2G4XCVY4LOVZSHQ25TCFTCDYMRLHXVNBU76OIIGI2UTTIIQXKQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.142641292 (832h8m36.840209598s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.151782239 (832h8m36.849350555s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152331545 (832h8m36.849899861s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152813115 (832h8m36.850381431s) [noise=true , address=185.167.204.205:4026 , piece_id=SKCE257VNOP62EKHFZQGGYZ7AIA5GWCT4ZW7IQOXQJSVDYKODMRQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.172329604 (832h8m36.869897921s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.179173059 (832h8m36.876741375s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.196489869 (832h8m36.894058175s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.198678477 (832h8m36.896246784s) [noise=true , address=81.171.14.70:4045 , piece_id=J5I4QOVP6ROOB6ZCB75VRTP37ISKCLJ6BJNRZTT3CHOZO2ORKQ5A, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.576067236 (832h8m37.273635542s) [noise=true , address=81.171.14.70:4026 , piece_id=XXAI6MD34XUH6PEPYOVHKMG4GXCEAM4WHKZDM3UHXSKNG2NAPOMA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.612447320 (832h8m37.310015636s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.674090269 (832h8m37.371658585s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.698435238 (832h8m37.396003554s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:38:48.005767171 (832h9m35.703335477s) [noise=true , address=81.171.14.70:4042 , piece_id=SBER7MUZFU5HXAAQN5W7IPGYZ4RQZNX7LCV3PHDCQIIN2P7GHVGQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: context deadline exceeded; context deadline exceeded
Jan 9 07:38:48.005822034 (832h9m35.70339034s) [noise=true , address=81.171.14.70:4035 , piece_id=JCZZOD3KHUISYLIPJKGMAHZ5QOPKTZMHIPGUCAGJHBZX2ZYBALUA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: rpc: dial tcp 81.171.14.70:4035: i/o timeout; context deadline exceeded
Jan 9 07:38:48.005952648 (832h9m35.703520984s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 5.161.89.252:32526->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 9 07:38:48.005994226 (832h9m35.703562562s) [seg_pos={0 0}, upload=732073]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 9 07:38:48.109550624 (832h9m35.80711896s) [upload=732073]: Done uploading segments...
Jan 9 07:38:48.109585420 (832h9m35.807153755s) [upload=732073]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.652428109s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)antiblip:
2 out of 60 is failed (threshold=3) [.......................................XX...................] duration:
132.911109ms target:
https://version.storj.io/ trace:
https://jaeger.dev.storj.io/trace/1634496fdb368bf9
FAIL (2026-01-09 07:49:26 UTC)
orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: i/o timeout
Duration: 132.92832ms
core
website
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
2 out of 60 is failed (threshold=3) [........................................XX..................] duration:
112.85434ms trace:
https://jaeger.dev.storj.io/trace/4d3b7b3eb36724ba
FAIL (2026-01-09 07:49:13 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 112.872775ms
edge
authservice
http
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [...........................................XX.X.............] duration:
2.692511719s trace:
https://jaeger.dev.storj.io/trace/6735d4b874ab1ef5
FAIL (2026-01-09 07:49:09 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
03564596s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.408402825 (832h8m36.105971141s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.409232034 (832h8m36.10680034s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.410100727 (832h8m36.107669033s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.411643299 (832h8m36.109211605s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.412026585 (832h8m36.109594931s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.413398217 (832h8m36.110966523s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414194315 (832h8m36.111762621s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.414527187 (832h8m36.112095493s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.417979455 (832h8m36.115547771s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.419110590 (832h8m36.116678906s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.420189664 (832h8m36.117757981s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.421246770 (832h8m36.118815076s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Uploading piece...
Jan 9 07:37:48.864750971 (832h8m36.562319277s) [upload=732073]: Next returned nil segment
Jan 9 07:37:48.864760439 (832h8m36.562328755s) [upload=732073]: Waiting for error group managing segments...
Jan 9 07:37:49.079903909 (832h8m36.777472216s) [noise=true , address=185.167.204.205:4014 , piece_id=JTQC4RDGKGUW7LPJKMG4FQQP4PDZURUNCLN7D5IR6DVYKCXTDXMQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081476859 (832h8m36.779045164s) [noise=true , address=185.167.204.205:4036 , piece_id=36F5ETODK33CJ3DYLVDO74ILEUCO46EOGFSDOIYFIZOFMSYCWZJQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.081854243 (832h8m36.779422549s) [noise=true , address=185.167.204.206:4047 , piece_id=NX5VZNEAAQWZIVENWWI6D6JGPSVAR25G7UNLR4VM2IO3R5R2RNFA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.084019388 (832h8m36.781587694s) [noise=true , address=185.167.204.205:4030 , piece_id=XDZNUF4U7B3LBSGGDF5KQMFAMULAVDBGV77W2HLB3TQ6A63T2LKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085665192 (832h8m36.783233498s) [noise=true , address=185.167.204.205:4016 , piece_id=7DOGCUU3CLYQEXEDHJEA3TBLPZXG2ZYZ2ELHPMI6ABEN3SCHVIGA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.085685219 (832h8m36.783253526s) [noise=true , address=185.167.204.206:4063 , piece_id=TS7CR4OJYFCIVJTYUIDMZG6OFGDTD2UEXBTYXRCUPX6PPKWMQI3Q, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.092142522 (832h8m36.789710829s) [noise=true , address=89.149.201.147:4003 , piece_id=G44C4AXJFDLENH24JTOYRMOT2W2TQYKBG4VKCTJVI42IWDZAUMKA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.094372309 (832h8m36.791940614s) [noise=true , address=185.167.204.205:4012 , piece_id=YROJIOL65Q6C42TNRXEZK5HG6BX6OKI2CVPDNY2GJLUBINJW5LDQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.099207151 (832h8m36.796775457s) [noise=true , address=185.167.204.205:4032 , piece_id=IB7MTNECBUTI3HZETWXPRWGC7QQ5UXDAX2J7YHTQBSL6ONRPSLBA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.100548106 (832h8m36.798116402s) [noise=true , address=185.167.204.206:4057 , piece_id=3ZTVSTHOJ7TUSM4TCHP2IVYOFZT2OTIJBESDXESWJDFW4WO7KMUQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.126257155 (832h8m36.82382546s) [noise=true , address=185.167.204.206:4068 , piece_id=4BHBFT7M5FRFXI2BHSA6EKXDFCU3GCXBVVITTB2WIEFU4P36VAIA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.133142828 (832h8m36.830711144s) [noise=true , address=185.167.204.205:4011 , piece_id=ZWVL45YULGYIG6D32ZEKCXGMIQQYVH4JVEXQPL32SNGOBDYWN3KQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.134306753 (832h8m36.831875069s) [noise=true , address=185.167.204.206:4040 , piece_id=FW2G4XCVY4LOVZSHQ25TCFTCDYMRLHXVNBU76OIIGI2UTTIIQXKQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.142641292 (832h8m36.840209598s) [noise=true , address=185.167.204.206:4067 , piece_id=2DTXYVPZLS7S62Z6IZPVOFIHRHSVY7B7IJHIRHVO5CH43GB2SXNQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.151782239 (832h8m36.849350555s) [noise=true , address=185.167.204.205:4028 , piece_id=RPCBBZZAPSXDWW7C34NW5IVGZAHK3VOQ2WWH3HXVHL4G2JHZHAYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152331545 (832h8m36.849899861s) [noise=true , address=185.167.204.205:4004 , piece_id=E4XBIGX4UTWAVZKILNG7ACWT2AU4HODVJ4KE5ZC6MDMHF3HRDPYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.152813115 (832h8m36.850381431s) [noise=true , address=185.167.204.205:4026 , piece_id=SKCE257VNOP62EKHFZQGGYZ7AIA5GWCT4ZW7IQOXQJSVDYKODMRQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.172329604 (832h8m36.869897921s) [noise=true , address=81.171.14.70:4033 , piece_id=45L4VTN5C5JBKYPYJ3SQ2FHQYGMW4F4O4H6HHO7M54HE3M7KR2OQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.179173059 (832h8m36.876741375s) [noise=true , address=81.171.14.70:4027 , piece_id=AOA4V42HEZCHE76MN57TRL5HJJTKXY3AGBZ42PMTN6N4LLL2PGYQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.196489869 (832h8m36.894058175s) [noise=true , address=89.149.201.147:4016 , piece_id=ZUKJFGWOOYUE75R6KYHXQYTG7LZAJEKXPEYJ56MCT3M25BJOQ4LA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.198678477 (832h8m36.896246784s) [noise=true , address=81.171.14.70:4045 , piece_id=J5I4QOVP6ROOB6ZCB75VRTP37ISKCLJ6BJNRZTT3CHOZO2ORKQ5A, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.576067236 (832h8m37.273635542s) [noise=true , address=81.171.14.70:4026 , piece_id=XXAI6MD34XUH6PEPYOVHKMG4GXCEAM4WHKZDM3UHXSKNG2NAPOMA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.612447320 (832h8m37.310015636s) [noise=true , address=89.149.201.147:4001 , piece_id=OPRMDMUQ5FXPFIOFIJR3FJJ7OXEMD4WP23NCUPHU2EHKMHCB26UQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.674090269 (832h8m37.371658585s) [noise=true , address=81.171.14.70:4044 , piece_id=FU3WQSNKED4DSNWICNOS2ILMLVLIHUPDJEA6YZHZIABPLNVOMANQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:37:49.698435238 (832h8m37.396003554s) [noise=true , address=81.171.14.70:4046 , piece_id=KE6Q72DSHTKE3DXDBGRSMJDPOGQ7LGRHEEGMDZE775EG5M6Y54DQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: <nil>
Jan 9 07:38:48.005767171 (832h9m35.703335477s) [noise=true , address=81.171.14.70:4042 , piece_id=SBER7MUZFU5HXAAQN5W7IPGYZ4RQZNX7LCV3PHDCQIIN2P7GHVGQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: context deadline exceeded; context deadline exceeded
Jan 9 07:38:48.005822034 (832h9m35.70339034s) [noise=true , address=81.171.14.70:4035 , piece_id=JCZZOD3KHUISYLIPJKGMAHZ5QOPKTZMHIPGUCAGJHBZX2ZYBALUA, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:12eLYJKne3yP1fZ1oPDLM7Xqs3GQ3ju4ZQedAiojXdVkcxNpzeA, address:81.171.14.70:4035): protocol: rpc: dial tcp 81.171.14.70:4035: i/o timeout; context deadline exceeded
Jan 9 07:38:48.005952648 (832h9m35.703520984s) [noise=true , address=81.171.14.70:4040 , piece_id=4YLXOFDJJCSEZB4SLTTCPETIY3LGXCYXPTWZAC7IMLMCXA2H6ATQ, seg_pos={0 0}, upload=732073]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 5.161.89.252:32526->81.171.14.70:4040: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 9 07:38:48.005994226 (832h9m35.703562562s) [seg_pos={0 0}, upload=732073]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Jan 9 07:38:48.109550624 (832h9m35.80711896s) [upload=732073]: Done uploading segments...
Jan 9 07:38:48.109585420 (832h9m35.807153755s) [upload=732073]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.692532176s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................................X.X.................] duration:
338.453516ms trace:
https://jaeger.dev.storj.io/trace/5af4d89436e82463
FAIL (2026-01-09 07:49:01 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 338.474165ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)antiblip:
3 out of 60 is failed (threshold=3) [.....................................XX..X..................] duration:
4.90862ms target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/2ac98d14171470eb
FAIL (2026-01-09 07:48:47 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout
Duration: 4.932735ms
edge
linksharing
us-select-1
|