Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X..................XX.......................................] duration:
372.564459ms
FAIL (2025-08-27 18:36:38 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 27 18:03:41.638525810 (25m4.868011167s) [upload=427]: Starting upload
Aug 27 18:03:41.638576486 (25m4.868061843s) [upload=427]: Done starting upload
Aug 27 18:03:41.638791290 (25m4.868276656s) [upload=427]: Uploading segments...
Aug 27 18:03:41.638966970 (25m4.868452327s) [upload=427]: Got next segment. Inline: false
Aug 27 18:03:41.639007015 (25m4.868492382s) [upload=427]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 27 18:03:41.639011594 (25m4.868496951s) [upload=427]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 27 18:03:53.103881964 (25m16.333367311s) [seg_pos={0 0}, upload=427]: Begin upload segment...
Aug 27 18:03:53.103933962 (25m16.333419319s) [seg_pos={0 0}, upload=427]: Done begin upload segment.
Aug 27 18:03:53.103943780 (25m16.333429138s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.103955252 (25m16.333440599s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104260056 (25m16.333745413s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104293498 (25m16.333778855s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104478375 (25m16.333963732s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104710141 (25m16.334195488s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104931056 (25m16.334416413s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105171478 (25m16.334656825s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105223215 (25m16.334708572s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105541594 (25m16.335026941s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105802835 (25m16.335288182s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106098240 (25m16.335583587s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106328002 (25m16.335813349s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106534229 (25m16.336019577s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106741769 (25m16.336227126s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106951844 (25m16.336437191s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.107183559 (25m16.336668917s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.107392001 (25m16.336877348s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.194419054 (25m16.423904401s) [upload=427]: Next returned nil segment
Aug 27 18:03:53.194432399 (25m16.423917746s) [upload=427]: Waiting for error group managing segments...
Aug 27 18:03:53.206440678 (25m16.435926035s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.207394130 (25m16.436879477s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.223636688 (25m16.453122045s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.223865307 (25m16.453350664s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.226291497 (25m16.455776844s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.229012241 (25m16.458497598s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.233683981 (25m16.463169338s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.237346655 (25m16.466832002s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.240931372 (25m16.470416719s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.241309432 (25m16.470794779s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.242649120 (25m16.472134467s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.243678826 (25m16.473164163s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.244908456 (25m16.474393803s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.254532134 (25m16.484017491s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.254554055 (25m16.484039403s) [seg_pos={0 0}, upload=427]: Segment reached optimal threshold of 14 pieces.
Aug 27 18:03:53.254688477 (25m16.484173824s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuahEyfok8Hk4fBNcdrZQWoQZiCXfNWdbfqPMnbEPmdZQ3R1o): protocol: expected piece hash; context canceled; EOF
Aug 27 18:03:53.254720447 (25m16.484205795s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Aug 27 18:03:53.254824613 (25m16.484309961s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxBiYLx8eWayRmXGXzNyRKAMLEcL7gJ7VU4wLvKhN2nCQbqwf): protocol: expected piece hash; context canceled; EOF
Aug 27 18:03:53.254883715 (25m16.484369062s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wEmEB8Up7sKbBXuoZu9fx9e7cyuFDc8HVBt1g2x6ajDFj2Pnh): protocol: read tcp 5.161.89.252:51414->79.127.205.246:4266: use of closed network connection; conn closed: op
Aug 27 18:03:53.254896749 (25m16.484382106s) [seg_pos={0 0}, upload=427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 27 18:03:53.254967893 (25m16.484453239s) [upload=427]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 27 18:03:53.254973643 (25m16.48445899s) [upload=427]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 27 18:04:06.332254005 (25m29.561739352s) [upload=427]: Done uploading segments...
Aug 27 18:04:06.332269443 (25m29.561754791s) [upload=427]: Upload finished. err: <nil>
Duration: 372.617278ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
17.087359ms target:
https://us1.storj.io/login
FAIL (2025-08-27 18:36:36 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused
Duration: 17.111533ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
419.83122ms
FAIL (2025-08-27 18:36:10 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 27 18:02:44.881381573 (24m8.11086692s) [upload=412]: Starting upload Aug 27 18:02:44.881449762 (24m8.110935109s) [upload=412]: Done starting upload Aug 27 18:02:44.881583483 (24m8.11106882s) [upload=412]: Uploading segments... Aug 27 18:02:44.881690004 (24m8.111175361s) [upload=412]: Got next segment. Inline: false Aug 27 18:02:44.881723887 (24m8.111209244s) [upload=412]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 27 18:02:44.881728085 (24m8.111213432s) [upload=412]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 27 18:03:14.867281026 (24m38.096766413s) [upload=412]: Next segment err: context deadline exceeded Aug 27 18:03:14.867364802 (24m38.09685018s) [upload=412]: Done uploading segments... Aug 27 18:03:14.867391553 (24m38.09687693s) [upload=412]: Upload finished. err: context deadline exceeded
Duration: 419.853271ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X..................XX......................................] duration:
380.295356ms
FAIL (2025-08-27 18:36:02 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 27 18:03:41.638525810 (25m4.868011167s) [upload=427]: Starting upload
Aug 27 18:03:41.638576486 (25m4.868061843s) [upload=427]: Done starting upload
Aug 27 18:03:41.638791290 (25m4.868276656s) [upload=427]: Uploading segments...
Aug 27 18:03:41.638966970 (25m4.868452327s) [upload=427]: Got next segment. Inline: false
Aug 27 18:03:41.639007015 (25m4.868492382s) [upload=427]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 27 18:03:41.639011594 (25m4.868496951s) [upload=427]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 27 18:03:53.103881964 (25m16.333367311s) [seg_pos={0 0}, upload=427]: Begin upload segment...
Aug 27 18:03:53.103933962 (25m16.333419319s) [seg_pos={0 0}, upload=427]: Done begin upload segment.
Aug 27 18:03:53.103943780 (25m16.333429138s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.103955252 (25m16.333440599s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104260056 (25m16.333745413s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104293498 (25m16.333778855s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104478375 (25m16.333963732s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104710141 (25m16.334195488s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104931056 (25m16.334416413s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105171478 (25m16.334656825s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105223215 (25m16.334708572s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105541594 (25m16.335026941s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105802835 (25m16.335288182s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106098240 (25m16.335583587s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106328002 (25m16.335813349s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106534229 (25m16.336019577s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106741769 (25m16.336227126s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106951844 (25m16.336437191s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.107183559 (25m16.336668917s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.107392001 (25m16.336877348s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.194419054 (25m16.423904401s) [upload=427]: Next returned nil segment
Aug 27 18:03:53.194432399 (25m16.423917746s) [upload=427]: Waiting for error group managing segments...
Aug 27 18:03:53.206440678 (25m16.435926035s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.207394130 (25m16.436879477s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.223636688 (25m16.453122045s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.223865307 (25m16.453350664s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.226291497 (25m16.455776844s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.229012241 (25m16.458497598s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.233683981 (25m16.463169338s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.237346655 (25m16.466832002s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.240931372 (25m16.470416719s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.241309432 (25m16.470794779s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.242649120 (25m16.472134467s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.243678826 (25m16.473164163s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.244908456 (25m16.474393803s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.254532134 (25m16.484017491s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.254554055 (25m16.484039403s) [seg_pos={0 0}, upload=427]: Segment reached optimal threshold of 14 pieces.
Aug 27 18:03:53.254688477 (25m16.484173824s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuahEyfok8Hk4fBNcdrZQWoQZiCXfNWdbfqPMnbEPmdZQ3R1o): protocol: expected piece hash; context canceled; EOF
Aug 27 18:03:53.254720447 (25m16.484205795s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Aug 27 18:03:53.254824613 (25m16.484309961s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxBiYLx8eWayRmXGXzNyRKAMLEcL7gJ7VU4wLvKhN2nCQbqwf): protocol: expected piece hash; context canceled; EOF
Aug 27 18:03:53.254883715 (25m16.484369062s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wEmEB8Up7sKbBXuoZu9fx9e7cyuFDc8HVBt1g2x6ajDFj2Pnh): protocol: read tcp 5.161.89.252:51414->79.127.205.246:4266: use of closed network connection; conn closed: op
Aug 27 18:03:53.254896749 (25m16.484382106s) [seg_pos={0 0}, upload=427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 27 18:03:53.254967893 (25m16.484453239s) [upload=427]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 27 18:03:53.254973643 (25m16.48445899s) [upload=427]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 27 18:04:06.332254005 (25m29.561739352s) [upload=427]: Done uploading segments...
Aug 27 18:04:06.332269443 (25m29.561754791s) [upload=427]: Upload finished. err: <nil>
Duration: 380.320794ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
11.965952ms target:
https://us1.storj.io/login
FAIL (2025-08-27 18:35:53 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused
Duration: 11.984738ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...........X.....XX..X.................................X....] duration:
208.507083ms
FAIL (2025-08-27 18:35:50 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 27 18:32:06.151405362 (53m29.380890709s) [upload=913]: Starting upload
Aug 27 18:32:06.151448432 (53m29.38093378s) [upload=913]: Done starting upload
Aug 27 18:32:06.151500542 (53m29.380985878s) [upload=913]: Uploading segments...
Aug 27 18:32:06.151553911 (53m29.381039279s) [upload=913]: Got next segment. Inline: true
Aug 27 18:32:06.151561485 (53m29.381046833s) [upload=913]: Waiting for error group managing segments...
Aug 27 18:32:06.151602423 (53m29.38108777s) [upload=913]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 27 18:32:06.151605919 (53m29.381091266s) [upload=913]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 27 18:32:06.151608564 (53m29.381093911s) [upload=913]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 27 18:32:06.221844564 (53m29.451329911s) [upload=913]: Done uploading segments...
Aug 27 18:32:06.221859612 (53m29.451344959s) [upload=913]: Upload finished. err: <nil>
Duration: 208.564341ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
370.010696ms
FAIL (2025-08-27 18:35:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 27 18:02:44.881381573 (24m8.11086692s) [upload=412]: Starting upload Aug 27 18:02:44.881449762 (24m8.110935109s) [upload=412]: Done starting upload Aug 27 18:02:44.881583483 (24m8.11106882s) [upload=412]: Uploading segments... Aug 27 18:02:44.881690004 (24m8.111175361s) [upload=412]: Got next segment. Inline: false Aug 27 18:02:44.881723887 (24m8.111209244s) [upload=412]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 27 18:02:44.881728085 (24m8.111213432s) [upload=412]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 27 18:03:14.867281026 (24m38.096766413s) [upload=412]: Next segment err: context deadline exceeded Aug 27 18:03:14.867364802 (24m38.09685018s) [upload=412]: Done uploading segments... Aug 27 18:03:14.867391553 (24m38.09687693s) [upload=412]: Upload finished. err: context deadline exceeded
Duration: 370.032026ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X..................XX.....................................] duration:
387.082805ms
FAIL (2025-08-27 18:34:48 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 27 18:03:41.638525810 (25m4.868011167s) [upload=427]: Starting upload
Aug 27 18:03:41.638576486 (25m4.868061843s) [upload=427]: Done starting upload
Aug 27 18:03:41.638791290 (25m4.868276656s) [upload=427]: Uploading segments...
Aug 27 18:03:41.638966970 (25m4.868452327s) [upload=427]: Got next segment. Inline: false
Aug 27 18:03:41.639007015 (25m4.868492382s) [upload=427]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 27 18:03:41.639011594 (25m4.868496951s) [upload=427]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 27 18:03:53.103881964 (25m16.333367311s) [seg_pos={0 0}, upload=427]: Begin upload segment...
Aug 27 18:03:53.103933962 (25m16.333419319s) [seg_pos={0 0}, upload=427]: Done begin upload segment.
Aug 27 18:03:53.103943780 (25m16.333429138s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.103955252 (25m16.333440599s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104260056 (25m16.333745413s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104293498 (25m16.333778855s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104478375 (25m16.333963732s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104710141 (25m16.334195488s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104931056 (25m16.334416413s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105171478 (25m16.334656825s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105223215 (25m16.334708572s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105541594 (25m16.335026941s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105802835 (25m16.335288182s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106098240 (25m16.335583587s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106328002 (25m16.335813349s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106534229 (25m16.336019577s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106741769 (25m16.336227126s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106951844 (25m16.336437191s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.107183559 (25m16.336668917s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.107392001 (25m16.336877348s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.194419054 (25m16.423904401s) [upload=427]: Next returned nil segment
Aug 27 18:03:53.194432399 (25m16.423917746s) [upload=427]: Waiting for error group managing segments...
Aug 27 18:03:53.206440678 (25m16.435926035s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.207394130 (25m16.436879477s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.223636688 (25m16.453122045s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.223865307 (25m16.453350664s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.226291497 (25m16.455776844s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.229012241 (25m16.458497598s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.233683981 (25m16.463169338s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.237346655 (25m16.466832002s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.240931372 (25m16.470416719s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.241309432 (25m16.470794779s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.242649120 (25m16.472134467s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.243678826 (25m16.473164163s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.244908456 (25m16.474393803s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.254532134 (25m16.484017491s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.254554055 (25m16.484039403s) [seg_pos={0 0}, upload=427]: Segment reached optimal threshold of 14 pieces.
Aug 27 18:03:53.254688477 (25m16.484173824s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuahEyfok8Hk4fBNcdrZQWoQZiCXfNWdbfqPMnbEPmdZQ3R1o): protocol: expected piece hash; context canceled; EOF
Aug 27 18:03:53.254720447 (25m16.484205795s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Aug 27 18:03:53.254824613 (25m16.484309961s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxBiYLx8eWayRmXGXzNyRKAMLEcL7gJ7VU4wLvKhN2nCQbqwf): protocol: expected piece hash; context canceled; EOF
Aug 27 18:03:53.254883715 (25m16.484369062s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wEmEB8Up7sKbBXuoZu9fx9e7cyuFDc8HVBt1g2x6ajDFj2Pnh): protocol: read tcp 5.161.89.252:51414->79.127.205.246:4266: use of closed network connection; conn closed: op
Aug 27 18:03:53.254896749 (25m16.484382106s) [seg_pos={0 0}, upload=427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 27 18:03:53.254967893 (25m16.484453239s) [upload=427]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 27 18:03:53.254973643 (25m16.48445899s) [upload=427]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 27 18:04:06.332254005 (25m29.561739352s) [upload=427]: Done uploading segments...
Aug 27 18:04:06.332269443 (25m29.561754791s) [upload=427]: Upload finished. err: <nil>
Duration: 387.101069ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [............X.....XX..X.................................X...] duration:
152.542518ms
FAIL (2025-08-27 18:34:46 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 27 18:32:06.151405362 (53m29.380890709s) [upload=913]: Starting upload
Aug 27 18:32:06.151448432 (53m29.38093378s) [upload=913]: Done starting upload
Aug 27 18:32:06.151500542 (53m29.380985878s) [upload=913]: Uploading segments...
Aug 27 18:32:06.151553911 (53m29.381039279s) [upload=913]: Got next segment. Inline: true
Aug 27 18:32:06.151561485 (53m29.381046833s) [upload=913]: Waiting for error group managing segments...
Aug 27 18:32:06.151602423 (53m29.38108777s) [upload=913]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 27 18:32:06.151605919 (53m29.381091266s) [upload=913]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 27 18:32:06.151608564 (53m29.381093911s) [upload=913]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 27 18:32:06.221844564 (53m29.451329911s) [upload=913]: Done uploading segments...
Aug 27 18:32:06.221859612 (53m29.451344959s) [upload=913]: Upload finished. err: <nil>
Duration: 152.555713ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
12.958128ms target:
https://us1.storj.io/login
FAIL (2025-08-27 18:34:40 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused
Duration: 12.971653ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X..................XX....................................] duration:
471.204455ms
FAIL (2025-08-27 18:34:21 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 27 18:03:41.638525810 (25m4.868011167s) [upload=427]: Starting upload
Aug 27 18:03:41.638576486 (25m4.868061843s) [upload=427]: Done starting upload
Aug 27 18:03:41.638791290 (25m4.868276656s) [upload=427]: Uploading segments...
Aug 27 18:03:41.638966970 (25m4.868452327s) [upload=427]: Got next segment. Inline: false
Aug 27 18:03:41.639007015 (25m4.868492382s) [upload=427]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 27 18:03:41.639011594 (25m4.868496951s) [upload=427]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 27 18:03:53.103881964 (25m16.333367311s) [seg_pos={0 0}, upload=427]: Begin upload segment...
Aug 27 18:03:53.103933962 (25m16.333419319s) [seg_pos={0 0}, upload=427]: Done begin upload segment.
Aug 27 18:03:53.103943780 (25m16.333429138s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.103955252 (25m16.333440599s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104260056 (25m16.333745413s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104293498 (25m16.333778855s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104478375 (25m16.333963732s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104710141 (25m16.334195488s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104931056 (25m16.334416413s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105171478 (25m16.334656825s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105223215 (25m16.334708572s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105541594 (25m16.335026941s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105802835 (25m16.335288182s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106098240 (25m16.335583587s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106328002 (25m16.335813349s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106534229 (25m16.336019577s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106741769 (25m16.336227126s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106951844 (25m16.336437191s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.107183559 (25m16.336668917s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.107392001 (25m16.336877348s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.194419054 (25m16.423904401s) [upload=427]: Next returned nil segment
Aug 27 18:03:53.194432399 (25m16.423917746s) [upload=427]: Waiting for error group managing segments...
Aug 27 18:03:53.206440678 (25m16.435926035s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.207394130 (25m16.436879477s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.223636688 (25m16.453122045s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.223865307 (25m16.453350664s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.226291497 (25m16.455776844s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.229012241 (25m16.458497598s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.233683981 (25m16.463169338s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.237346655 (25m16.466832002s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.240931372 (25m16.470416719s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.241309432 (25m16.470794779s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.242649120 (25m16.472134467s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.243678826 (25m16.473164163s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.244908456 (25m16.474393803s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.254532134 (25m16.484017491s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.254554055 (25m16.484039403s) [seg_pos={0 0}, upload=427]: Segment reached optimal threshold of 14 pieces.
Aug 27 18:03:53.254688477 (25m16.484173824s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuahEyfok8Hk4fBNcdrZQWoQZiCXfNWdbfqPMnbEPmdZQ3R1o): protocol: expected piece hash; context canceled; EOF
Aug 27 18:03:53.254720447 (25m16.484205795s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Aug 27 18:03:53.254824613 (25m16.484309961s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxBiYLx8eWayRmXGXzNyRKAMLEcL7gJ7VU4wLvKhN2nCQbqwf): protocol: expected piece hash; context canceled; EOF
Aug 27 18:03:53.254883715 (25m16.484369062s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wEmEB8Up7sKbBXuoZu9fx9e7cyuFDc8HVBt1g2x6ajDFj2Pnh): protocol: read tcp 5.161.89.252:51414->79.127.205.246:4266: use of closed network connection; conn closed: op
Aug 27 18:03:53.254896749 (25m16.484382106s) [seg_pos={0 0}, upload=427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 27 18:03:53.254967893 (25m16.484453239s) [upload=427]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 27 18:03:53.254973643 (25m16.48445899s) [upload=427]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 27 18:04:06.332254005 (25m29.561739352s) [upload=427]: Done uploading segments...
Aug 27 18:04:06.332269443 (25m29.561754791s) [upload=427]: Upload finished. err: <nil>
Duration: 471.228711ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
564.396606ms
FAIL (2025-08-27 18:34:04 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 27 18:02:44.881381573 (24m8.11086692s) [upload=412]: Starting upload Aug 27 18:02:44.881449762 (24m8.110935109s) [upload=412]: Done starting upload Aug 27 18:02:44.881583483 (24m8.11106882s) [upload=412]: Uploading segments... Aug 27 18:02:44.881690004 (24m8.111175361s) [upload=412]: Got next segment. Inline: false Aug 27 18:02:44.881723887 (24m8.111209244s) [upload=412]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 27 18:02:44.881728085 (24m8.111213432s) [upload=412]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 27 18:03:14.867281026 (24m38.096766413s) [upload=412]: Next segment err: context deadline exceeded Aug 27 18:03:14.867364802 (24m38.09685018s) [upload=412]: Done uploading segments... Aug 27 18:03:14.867391553 (24m38.09687693s) [upload=412]: Upload finished. err: context deadline exceeded
Duration: 564.411252ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X..................XX...................................] duration:
375.092558ms
FAIL (2025-08-27 18:33:52 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 27 18:03:41.638525810 (25m4.868011167s) [upload=427]: Starting upload
Aug 27 18:03:41.638576486 (25m4.868061843s) [upload=427]: Done starting upload
Aug 27 18:03:41.638791290 (25m4.868276656s) [upload=427]: Uploading segments...
Aug 27 18:03:41.638966970 (25m4.868452327s) [upload=427]: Got next segment. Inline: false
Aug 27 18:03:41.639007015 (25m4.868492382s) [upload=427]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 27 18:03:41.639011594 (25m4.868496951s) [upload=427]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 27 18:03:53.103881964 (25m16.333367311s) [seg_pos={0 0}, upload=427]: Begin upload segment...
Aug 27 18:03:53.103933962 (25m16.333419319s) [seg_pos={0 0}, upload=427]: Done begin upload segment.
Aug 27 18:03:53.103943780 (25m16.333429138s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.103955252 (25m16.333440599s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104260056 (25m16.333745413s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104293498 (25m16.333778855s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104478375 (25m16.333963732s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104710141 (25m16.334195488s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104931056 (25m16.334416413s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105171478 (25m16.334656825s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105223215 (25m16.334708572s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105541594 (25m16.335026941s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105802835 (25m16.335288182s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106098240 (25m16.335583587s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106328002 (25m16.335813349s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106534229 (25m16.336019577s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106741769 (25m16.336227126s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106951844 (25m16.336437191s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.107183559 (25m16.336668917s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.107392001 (25m16.336877348s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.194419054 (25m16.423904401s) [upload=427]: Next returned nil segment
Aug 27 18:03:53.194432399 (25m16.423917746s) [upload=427]: Waiting for error group managing segments...
Aug 27 18:03:53.206440678 (25m16.435926035s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.207394130 (25m16.436879477s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.223636688 (25m16.453122045s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.223865307 (25m16.453350664s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.226291497 (25m16.455776844s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.229012241 (25m16.458497598s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.233683981 (25m16.463169338s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.237346655 (25m16.466832002s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.240931372 (25m16.470416719s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.241309432 (25m16.470794779s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.242649120 (25m16.472134467s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.243678826 (25m16.473164163s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.244908456 (25m16.474393803s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.254532134 (25m16.484017491s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.254554055 (25m16.484039403s) [seg_pos={0 0}, upload=427]: Segment reached optimal threshold of 14 pieces.
Aug 27 18:03:53.254688477 (25m16.484173824s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuahEyfok8Hk4fBNcdrZQWoQZiCXfNWdbfqPMnbEPmdZQ3R1o): protocol: expected piece hash; context canceled; EOF
Aug 27 18:03:53.254720447 (25m16.484205795s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Aug 27 18:03:53.254824613 (25m16.484309961s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxBiYLx8eWayRmXGXzNyRKAMLEcL7gJ7VU4wLvKhN2nCQbqwf): protocol: expected piece hash; context canceled; EOF
Aug 27 18:03:53.254883715 (25m16.484369062s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wEmEB8Up7sKbBXuoZu9fx9e7cyuFDc8HVBt1g2x6ajDFj2Pnh): protocol: read tcp 5.161.89.252:51414->79.127.205.246:4266: use of closed network connection; conn closed: op
Aug 27 18:03:53.254896749 (25m16.484382106s) [seg_pos={0 0}, upload=427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 27 18:03:53.254967893 (25m16.484453239s) [upload=427]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 27 18:03:53.254973643 (25m16.48445899s) [upload=427]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 27 18:04:06.332254005 (25m29.561739352s) [upload=427]: Done uploading segments...
Aug 27 18:04:06.332269443 (25m29.561754791s) [upload=427]: Upload finished. err: <nil>
Duration: 375.118667ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
10.163052ms target:
https://us1.storj.io/login
FAIL (2025-08-27 18:33:49 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused
Duration: 10.181097ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
389.666171ms
FAIL (2025-08-27 18:33:47 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 27 18:02:44.881381573 (24m8.11086692s) [upload=412]: Starting upload Aug 27 18:02:44.881449762 (24m8.110935109s) [upload=412]: Done starting upload Aug 27 18:02:44.881583483 (24m8.11106882s) [upload=412]: Uploading segments... Aug 27 18:02:44.881690004 (24m8.111175361s) [upload=412]: Got next segment. Inline: false Aug 27 18:02:44.881723887 (24m8.111209244s) [upload=412]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 27 18:02:44.881728085 (24m8.111213432s) [upload=412]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 27 18:03:14.867281026 (24m38.096766413s) [upload=412]: Next segment err: context deadline exceeded Aug 27 18:03:14.867364802 (24m38.09685018s) [upload=412]: Done uploading segments... Aug 27 18:03:14.867391553 (24m38.09687693s) [upload=412]: Upload finished. err: context deadline exceeded
Duration: 389.681771ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.............X.....XX..X.................................X..] duration:
125.869311ms
FAIL (2025-08-27 18:33:31 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 27 18:32:06.151405362 (53m29.380890709s) [upload=913]: Starting upload
Aug 27 18:32:06.151448432 (53m29.38093378s) [upload=913]: Done starting upload
Aug 27 18:32:06.151500542 (53m29.380985878s) [upload=913]: Uploading segments...
Aug 27 18:32:06.151553911 (53m29.381039279s) [upload=913]: Got next segment. Inline: true
Aug 27 18:32:06.151561485 (53m29.381046833s) [upload=913]: Waiting for error group managing segments...
Aug 27 18:32:06.151602423 (53m29.38108777s) [upload=913]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 27 18:32:06.151605919 (53m29.381091266s) [upload=913]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 27 18:32:06.151608564 (53m29.381093911s) [upload=913]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 27 18:32:06.221844564 (53m29.451329911s) [upload=913]: Done uploading segments...
Aug 27 18:32:06.221859612 (53m29.451344959s) [upload=913]: Upload finished. err: <nil>
Duration: 125.893536ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
418.34091ms
FAIL (2025-08-27 18:33:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 27 18:02:44.881381573 (24m8.11086692s) [upload=412]: Starting upload Aug 27 18:02:44.881449762 (24m8.110935109s) [upload=412]: Done starting upload Aug 27 18:02:44.881583483 (24m8.11106882s) [upload=412]: Uploading segments... Aug 27 18:02:44.881690004 (24m8.111175361s) [upload=412]: Got next segment. Inline: false Aug 27 18:02:44.881723887 (24m8.111209244s) [upload=412]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 27 18:02:44.881728085 (24m8.111213432s) [upload=412]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 27 18:03:14.867281026 (24m38.096766413s) [upload=412]: Next segment err: context deadline exceeded Aug 27 18:03:14.867364802 (24m38.09685018s) [upload=412]: Done uploading segments... Aug 27 18:03:14.867391553 (24m38.09687693s) [upload=412]: Upload finished. err: context deadline exceeded
Duration: 418.384061ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
11.950392ms target:
https://us1.storj.io/login
FAIL (2025-08-27 18:33:16 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused
Duration: 11.967315ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..............X.....XX..X.................................X.] duration:
133.063053ms
FAIL (2025-08-27 18:32:42 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 27 18:32:06.151405362 (53m29.380890709s) [upload=913]: Starting upload
Aug 27 18:32:06.151448432 (53m29.38093378s) [upload=913]: Done starting upload
Aug 27 18:32:06.151500542 (53m29.380985878s) [upload=913]: Uploading segments...
Aug 27 18:32:06.151553911 (53m29.381039279s) [upload=913]: Got next segment. Inline: true
Aug 27 18:32:06.151561485 (53m29.381046833s) [upload=913]: Waiting for error group managing segments...
Aug 27 18:32:06.151602423 (53m29.38108777s) [upload=913]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 27 18:32:06.151605919 (53m29.381091266s) [upload=913]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 27 18:32:06.151608564 (53m29.381093911s) [upload=913]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 27 18:32:06.221844564 (53m29.451329911s) [upload=913]: Done uploading segments...
Aug 27 18:32:06.221859612 (53m29.451344959s) [upload=913]: Upload finished. err: <nil>
Duration: 133.084433ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X..................XX..................................] duration:
470.618924ms
FAIL (2025-08-27 18:32:38 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 27 18:03:41.638525810 (25m4.868011167s) [upload=427]: Starting upload
Aug 27 18:03:41.638576486 (25m4.868061843s) [upload=427]: Done starting upload
Aug 27 18:03:41.638791290 (25m4.868276656s) [upload=427]: Uploading segments...
Aug 27 18:03:41.638966970 (25m4.868452327s) [upload=427]: Got next segment. Inline: false
Aug 27 18:03:41.639007015 (25m4.868492382s) [upload=427]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 27 18:03:41.639011594 (25m4.868496951s) [upload=427]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 27 18:03:53.103881964 (25m16.333367311s) [seg_pos={0 0}, upload=427]: Begin upload segment...
Aug 27 18:03:53.103933962 (25m16.333419319s) [seg_pos={0 0}, upload=427]: Done begin upload segment.
Aug 27 18:03:53.103943780 (25m16.333429138s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.103955252 (25m16.333440599s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104260056 (25m16.333745413s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104293498 (25m16.333778855s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104478375 (25m16.333963732s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104710141 (25m16.334195488s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104931056 (25m16.334416413s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105171478 (25m16.334656825s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105223215 (25m16.334708572s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105541594 (25m16.335026941s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105802835 (25m16.335288182s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106098240 (25m16.335583587s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106328002 (25m16.335813349s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106534229 (25m16.336019577s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106741769 (25m16.336227126s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106951844 (25m16.336437191s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.107183559 (25m16.336668917s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.107392001 (25m16.336877348s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.194419054 (25m16.423904401s) [upload=427]: Next returned nil segment
Aug 27 18:03:53.194432399 (25m16.423917746s) [upload=427]: Waiting for error group managing segments...
Aug 27 18:03:53.206440678 (25m16.435926035s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.207394130 (25m16.436879477s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.223636688 (25m16.453122045s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.223865307 (25m16.453350664s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.226291497 (25m16.455776844s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.229012241 (25m16.458497598s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.233683981 (25m16.463169338s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.237346655 (25m16.466832002s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.240931372 (25m16.470416719s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.241309432 (25m16.470794779s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.242649120 (25m16.472134467s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.243678826 (25m16.473164163s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.244908456 (25m16.474393803s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.254532134 (25m16.484017491s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.254554055 (25m16.484039403s) [seg_pos={0 0}, upload=427]: Segment reached optimal threshold of 14 pieces.
Aug 27 18:03:53.254688477 (25m16.484173824s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuahEyfok8Hk4fBNcdrZQWoQZiCXfNWdbfqPMnbEPmdZQ3R1o): protocol: expected piece hash; context canceled; EOF
Aug 27 18:03:53.254720447 (25m16.484205795s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Aug 27 18:03:53.254824613 (25m16.484309961s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxBiYLx8eWayRmXGXzNyRKAMLEcL7gJ7VU4wLvKhN2nCQbqwf): protocol: expected piece hash; context canceled; EOF
Aug 27 18:03:53.254883715 (25m16.484369062s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wEmEB8Up7sKbBXuoZu9fx9e7cyuFDc8HVBt1g2x6ajDFj2Pnh): protocol: read tcp 5.161.89.252:51414->79.127.205.246:4266: use of closed network connection; conn closed: op
Aug 27 18:03:53.254896749 (25m16.484382106s) [seg_pos={0 0}, upload=427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 27 18:03:53.254967893 (25m16.484453239s) [upload=427]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 27 18:03:53.254973643 (25m16.48445899s) [upload=427]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 27 18:04:06.332254005 (25m29.561739352s) [upload=427]: Done uploading segments...
Aug 27 18:04:06.332269443 (25m29.561754791s) [upload=427]: Upload finished. err: <nil>
Duration: 470.646065ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
359.422277ms
FAIL (2025-08-27 18:32:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 27 18:02:44.881381573 (24m8.11086692s) [upload=412]: Starting upload Aug 27 18:02:44.881449762 (24m8.110935109s) [upload=412]: Done starting upload Aug 27 18:02:44.881583483 (24m8.11106882s) [upload=412]: Uploading segments... Aug 27 18:02:44.881690004 (24m8.111175361s) [upload=412]: Got next segment. Inline: false Aug 27 18:02:44.881723887 (24m8.111209244s) [upload=412]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 27 18:02:44.881728085 (24m8.111213432s) [upload=412]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 27 18:03:14.867281026 (24m38.096766413s) [upload=412]: Next segment err: context deadline exceeded Aug 27 18:03:14.867364802 (24m38.09685018s) [upload=412]: Done uploading segments... Aug 27 18:03:14.867391553 (24m38.09687693s) [upload=412]: Upload finished. err: context deadline exceeded
Duration: 359.444619ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
13.531516ms target:
https://us1.storj.io/login
FAIL (2025-08-27 18:32:07 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused
Duration: 13.553467ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [X..............X.....XX..X.................................X] duration:
127.685125ms
FAIL (2025-08-27 18:32:06 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 27 18:32:06.151405362 (53m29.380890709s) [upload=913]: Starting upload
Aug 27 18:32:06.151448432 (53m29.38093378s) [upload=913]: Done starting upload
Aug 27 18:32:06.151500542 (53m29.380985878s) [upload=913]: Uploading segments...
Aug 27 18:32:06.151553911 (53m29.381039279s) [upload=913]: Got next segment. Inline: true
Aug 27 18:32:06.151561485 (53m29.381046833s) [upload=913]: Waiting for error group managing segments...
Aug 27 18:32:06.151602423 (53m29.38108777s) [upload=913]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 27 18:32:06.151605919 (53m29.381091266s) [upload=913]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 27 18:32:06.151608564 (53m29.381093911s) [upload=913]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 27 18:32:06.221844564 (53m29.451329911s) [upload=913]: Done uploading segments...
Aug 27 18:32:06.221859612 (53m29.451344959s) [upload=913]: Upload finished. err: <nil>
Duration: 127.708438ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X..................XX.................................] duration:
648.252076ms
FAIL (2025-08-27 18:31:52 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 27 18:03:41.638525810 (25m4.868011167s) [upload=427]: Starting upload
Aug 27 18:03:41.638576486 (25m4.868061843s) [upload=427]: Done starting upload
Aug 27 18:03:41.638791290 (25m4.868276656s) [upload=427]: Uploading segments...
Aug 27 18:03:41.638966970 (25m4.868452327s) [upload=427]: Got next segment. Inline: false
Aug 27 18:03:41.639007015 (25m4.868492382s) [upload=427]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 27 18:03:41.639011594 (25m4.868496951s) [upload=427]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 27 18:03:53.103881964 (25m16.333367311s) [seg_pos={0 0}, upload=427]: Begin upload segment...
Aug 27 18:03:53.103933962 (25m16.333419319s) [seg_pos={0 0}, upload=427]: Done begin upload segment.
Aug 27 18:03:53.103943780 (25m16.333429138s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.103955252 (25m16.333440599s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104260056 (25m16.333745413s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104293498 (25m16.333778855s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104478375 (25m16.333963732s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104710141 (25m16.334195488s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104931056 (25m16.334416413s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105171478 (25m16.334656825s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105223215 (25m16.334708572s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105541594 (25m16.335026941s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105802835 (25m16.335288182s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106098240 (25m16.335583587s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106328002 (25m16.335813349s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106534229 (25m16.336019577s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106741769 (25m16.336227126s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106951844 (25m16.336437191s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.107183559 (25m16.336668917s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.107392001 (25m16.336877348s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.194419054 (25m16.423904401s) [upload=427]: Next returned nil segment
Aug 27 18:03:53.194432399 (25m16.423917746s) [upload=427]: Waiting for error group managing segments...
Aug 27 18:03:53.206440678 (25m16.435926035s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.207394130 (25m16.436879477s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.223636688 (25m16.453122045s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.223865307 (25m16.453350664s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.226291497 (25m16.455776844s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.229012241 (25m16.458497598s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.233683981 (25m16.463169338s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.237346655 (25m16.466832002s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.240931372 (25m16.470416719s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.241309432 (25m16.470794779s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.242649120 (25m16.472134467s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.243678826 (25m16.473164163s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.244908456 (25m16.474393803s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.254532134 (25m16.484017491s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.254554055 (25m16.484039403s) [seg_pos={0 0}, upload=427]: Segment reached optimal threshold of 14 pieces.
Aug 27 18:03:53.254688477 (25m16.484173824s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuahEyfok8Hk4fBNcdrZQWoQZiCXfNWdbfqPMnbEPmdZQ3R1o): protocol: expected piece hash; context canceled; EOF
Aug 27 18:03:53.254720447 (25m16.484205795s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Aug 27 18:03:53.254824613 (25m16.484309961s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxBiYLx8eWayRmXGXzNyRKAMLEcL7gJ7VU4wLvKhN2nCQbqwf): protocol: expected piece hash; context canceled; EOF
Aug 27 18:03:53.254883715 (25m16.484369062s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wEmEB8Up7sKbBXuoZu9fx9e7cyuFDc8HVBt1g2x6ajDFj2Pnh): protocol: read tcp 5.161.89.252:51414->79.127.205.246:4266: use of closed network connection; conn closed: op
Aug 27 18:03:53.254896749 (25m16.484382106s) [seg_pos={0 0}, upload=427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 27 18:03:53.254967893 (25m16.484453239s) [upload=427]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 27 18:03:53.254973643 (25m16.48445899s) [upload=427]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 27 18:04:06.332254005 (25m29.561739352s) [upload=427]: Done uploading segments...
Aug 27 18:04:06.332269443 (25m29.561754791s) [upload=427]: Upload finished. err: <nil>
Duration: 648.278827ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
11.755818ms target:
https://us1.storj.io/login
FAIL (2025-08-27 18:31:41 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused
Duration: 11.767249ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
603.697467ms
FAIL (2025-08-27 18:31:35 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 27 18:02:44.881381573 (24m8.11086692s) [upload=412]: Starting upload Aug 27 18:02:44.881449762 (24m8.110935109s) [upload=412]: Done starting upload Aug 27 18:02:44.881583483 (24m8.11106882s) [upload=412]: Uploading segments... Aug 27 18:02:44.881690004 (24m8.111175361s) [upload=412]: Got next segment. Inline: false Aug 27 18:02:44.881723887 (24m8.111209244s) [upload=412]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 27 18:02:44.881728085 (24m8.111213432s) [upload=412]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 27 18:03:14.867281026 (24m38.096766413s) [upload=412]: Next segment err: context deadline exceeded Aug 27 18:03:14.867364802 (24m38.09685018s) [upload=412]: Done uploading segments... Aug 27 18:03:14.867391553 (24m38.09687693s) [upload=412]: Upload finished. err: context deadline exceeded
Duration: 603.72033ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
10.217836ms target:
https://us1.storj.io/login
FAIL (2025-08-27 18:31:24 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused
Duration: 10.233536ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.X..............X.....XX..X.................................] duration:
131.403584ms
FAIL (2025-08-27 18:31:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 27 18:04:43.275353764 (26m6.504839141s) [upload=444]: Starting upload Aug 27 18:04:43.275413156 (26m6.504898532s) [upload=444]: Done starting upload Aug 27 18:04:43.275481715 (26m6.504967091s) [upload=444]: Uploading segments... Aug 27 18:04:43.275532750 (26m6.505018127s) [upload=444]: Got next segment. Inline: true Aug 27 18:04:43.275539142 (26m6.505024519s) [upload=444]: Waiting for error group managing segments... Aug 27 18:04:43.275591671 (26m6.505077049s) [upload=444]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 27 18:04:43.275599667 (26m6.505085114s) [upload=444]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 27 18:04:43.275606289 (26m6.505091676s) [upload=444]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 27 18:04:45.342492051 (26m8.571977398s) [upload=444]: Done uploading segments... Aug 27 18:04:45.342506197 (26m8.571991555s) [upload=444]: Upload finished. err: <nil>
Duration: 131.432557ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..X..............X.....XX..X................................] duration:
137.339683ms
FAIL (2025-08-27 18:30:59 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 27 18:04:43.275353764 (26m6.504839141s) [upload=444]: Starting upload Aug 27 18:04:43.275413156 (26m6.504898532s) [upload=444]: Done starting upload Aug 27 18:04:43.275481715 (26m6.504967091s) [upload=444]: Uploading segments... Aug 27 18:04:43.275532750 (26m6.505018127s) [upload=444]: Got next segment. Inline: true Aug 27 18:04:43.275539142 (26m6.505024519s) [upload=444]: Waiting for error group managing segments... Aug 27 18:04:43.275591671 (26m6.505077049s) [upload=444]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 27 18:04:43.275599667 (26m6.505085114s) [upload=444]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 27 18:04:43.275606289 (26m6.505091676s) [upload=444]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 27 18:04:45.342492051 (26m8.571977398s) [upload=444]: Done uploading segments... Aug 27 18:04:45.342506197 (26m8.571991555s) [upload=444]: Upload finished. err: <nil>
Duration: 137.364428ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
376.304457ms
FAIL (2025-08-27 18:30:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 27 18:02:44.881381573 (24m8.11086692s) [upload=412]: Starting upload Aug 27 18:02:44.881449762 (24m8.110935109s) [upload=412]: Done starting upload Aug 27 18:02:44.881583483 (24m8.11106882s) [upload=412]: Uploading segments... Aug 27 18:02:44.881690004 (24m8.111175361s) [upload=412]: Got next segment. Inline: false Aug 27 18:02:44.881723887 (24m8.111209244s) [upload=412]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 27 18:02:44.881728085 (24m8.111213432s) [upload=412]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 27 18:03:14.867281026 (24m38.096766413s) [upload=412]: Next segment err: context deadline exceeded Aug 27 18:03:14.867364802 (24m38.09685018s) [upload=412]: Done uploading segments... Aug 27 18:03:14.867391553 (24m38.09687693s) [upload=412]: Upload finished. err: context deadline exceeded
Duration: 376.328513ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X..................XX................................] duration:
372.653457ms
FAIL (2025-08-27 18:30:41 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 27 18:03:41.638525810 (25m4.868011167s) [upload=427]: Starting upload
Aug 27 18:03:41.638576486 (25m4.868061843s) [upload=427]: Done starting upload
Aug 27 18:03:41.638791290 (25m4.868276656s) [upload=427]: Uploading segments...
Aug 27 18:03:41.638966970 (25m4.868452327s) [upload=427]: Got next segment. Inline: false
Aug 27 18:03:41.639007015 (25m4.868492382s) [upload=427]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 27 18:03:41.639011594 (25m4.868496951s) [upload=427]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 27 18:03:53.103881964 (25m16.333367311s) [seg_pos={0 0}, upload=427]: Begin upload segment...
Aug 27 18:03:53.103933962 (25m16.333419319s) [seg_pos={0 0}, upload=427]: Done begin upload segment.
Aug 27 18:03:53.103943780 (25m16.333429138s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.103955252 (25m16.333440599s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104260056 (25m16.333745413s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104293498 (25m16.333778855s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104478375 (25m16.333963732s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104710141 (25m16.334195488s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104931056 (25m16.334416413s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105171478 (25m16.334656825s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105223215 (25m16.334708572s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105541594 (25m16.335026941s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105802835 (25m16.335288182s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106098240 (25m16.335583587s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106328002 (25m16.335813349s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106534229 (25m16.336019577s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106741769 (25m16.336227126s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106951844 (25m16.336437191s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.107183559 (25m16.336668917s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.107392001 (25m16.336877348s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.194419054 (25m16.423904401s) [upload=427]: Next returned nil segment
Aug 27 18:03:53.194432399 (25m16.423917746s) [upload=427]: Waiting for error group managing segments...
Aug 27 18:03:53.206440678 (25m16.435926035s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.207394130 (25m16.436879477s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.223636688 (25m16.453122045s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.223865307 (25m16.453350664s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.226291497 (25m16.455776844s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.229012241 (25m16.458497598s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.233683981 (25m16.463169338s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.237346655 (25m16.466832002s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.240931372 (25m16.470416719s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.241309432 (25m16.470794779s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.242649120 (25m16.472134467s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.243678826 (25m16.473164163s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.244908456 (25m16.474393803s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.254532134 (25m16.484017491s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.254554055 (25m16.484039403s) [seg_pos={0 0}, upload=427]: Segment reached optimal threshold of 14 pieces.
Aug 27 18:03:53.254688477 (25m16.484173824s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuahEyfok8Hk4fBNcdrZQWoQZiCXfNWdbfqPMnbEPmdZQ3R1o): protocol: expected piece hash; context canceled; EOF
Aug 27 18:03:53.254720447 (25m16.484205795s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Aug 27 18:03:53.254824613 (25m16.484309961s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxBiYLx8eWayRmXGXzNyRKAMLEcL7gJ7VU4wLvKhN2nCQbqwf): protocol: expected piece hash; context canceled; EOF
Aug 27 18:03:53.254883715 (25m16.484369062s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wEmEB8Up7sKbBXuoZu9fx9e7cyuFDc8HVBt1g2x6ajDFj2Pnh): protocol: read tcp 5.161.89.252:51414->79.127.205.246:4266: use of closed network connection; conn closed: op
Aug 27 18:03:53.254896749 (25m16.484382106s) [seg_pos={0 0}, upload=427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 27 18:03:53.254967893 (25m16.484453239s) [upload=427]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 27 18:03:53.254973643 (25m16.48445899s) [upload=427]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 27 18:04:06.332254005 (25m29.561739352s) [upload=427]: Done uploading segments...
Aug 27 18:04:06.332269443 (25m29.561754791s) [upload=427]: Upload finished. err: <nil>
Duration: 372.675158ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
12.098972ms target:
https://us1.storj.io/login
FAIL (2025-08-27 18:30:32 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused
Duration: 12.116525ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........X..................XX...............................] duration:
400.687893ms
FAIL (2025-08-27 18:30:08 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 27 18:03:41.638525810 (25m4.868011167s) [upload=427]: Starting upload
Aug 27 18:03:41.638576486 (25m4.868061843s) [upload=427]: Done starting upload
Aug 27 18:03:41.638791290 (25m4.868276656s) [upload=427]: Uploading segments...
Aug 27 18:03:41.638966970 (25m4.868452327s) [upload=427]: Got next segment. Inline: false
Aug 27 18:03:41.639007015 (25m4.868492382s) [upload=427]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 27 18:03:41.639011594 (25m4.868496951s) [upload=427]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 27 18:03:53.103881964 (25m16.333367311s) [seg_pos={0 0}, upload=427]: Begin upload segment...
Aug 27 18:03:53.103933962 (25m16.333419319s) [seg_pos={0 0}, upload=427]: Done begin upload segment.
Aug 27 18:03:53.103943780 (25m16.333429138s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.103955252 (25m16.333440599s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104260056 (25m16.333745413s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104293498 (25m16.333778855s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104478375 (25m16.333963732s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104710141 (25m16.334195488s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104931056 (25m16.334416413s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105171478 (25m16.334656825s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105223215 (25m16.334708572s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105541594 (25m16.335026941s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105802835 (25m16.335288182s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106098240 (25m16.335583587s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106328002 (25m16.335813349s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106534229 (25m16.336019577s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106741769 (25m16.336227126s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106951844 (25m16.336437191s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.107183559 (25m16.336668917s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.107392001 (25m16.336877348s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.194419054 (25m16.423904401s) [upload=427]: Next returned nil segment
Aug 27 18:03:53.194432399 (25m16.423917746s) [upload=427]: Waiting for error group managing segments...
Aug 27 18:03:53.206440678 (25m16.435926035s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.207394130 (25m16.436879477s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.223636688 (25m16.453122045s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.223865307 (25m16.453350664s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.226291497 (25m16.455776844s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.229012241 (25m16.458497598s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.233683981 (25m16.463169338s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.237346655 (25m16.466832002s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.240931372 (25m16.470416719s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.241309432 (25m16.470794779s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.242649120 (25m16.472134467s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.243678826 (25m16.473164163s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.244908456 (25m16.474393803s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.254532134 (25m16.484017491s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.254554055 (25m16.484039403s) [seg_pos={0 0}, upload=427]: Segment reached optimal threshold of 14 pieces.
Aug 27 18:03:53.254688477 (25m16.484173824s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuahEyfok8Hk4fBNcdrZQWoQZiCXfNWdbfqPMnbEPmdZQ3R1o): protocol: expected piece hash; context canceled; EOF
Aug 27 18:03:53.254720447 (25m16.484205795s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Aug 27 18:03:53.254824613 (25m16.484309961s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxBiYLx8eWayRmXGXzNyRKAMLEcL7gJ7VU4wLvKhN2nCQbqwf): protocol: expected piece hash; context canceled; EOF
Aug 27 18:03:53.254883715 (25m16.484369062s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wEmEB8Up7sKbBXuoZu9fx9e7cyuFDc8HVBt1g2x6ajDFj2Pnh): protocol: read tcp 5.161.89.252:51414->79.127.205.246:4266: use of closed network connection; conn closed: op
Aug 27 18:03:53.254896749 (25m16.484382106s) [seg_pos={0 0}, upload=427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 27 18:03:53.254967893 (25m16.484453239s) [upload=427]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 27 18:03:53.254973643 (25m16.48445899s) [upload=427]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 27 18:04:06.332254005 (25m29.561739352s) [upload=427]: Done uploading segments...
Aug 27 18:04:06.332269443 (25m29.561754791s) [upload=427]: Upload finished. err: <nil>
Duration: 400.711768ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
12.205002ms target:
https://us1.storj.io/login
FAIL (2025-08-27 18:30:04 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused
Duration: 12.226883ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...X..............X.....XX..X...............................] duration:
223.850242ms
FAIL (2025-08-27 18:29:50 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 27 18:04:43.275353764 (26m6.504839141s) [upload=444]: Starting upload Aug 27 18:04:43.275413156 (26m6.504898532s) [upload=444]: Done starting upload Aug 27 18:04:43.275481715 (26m6.504967091s) [upload=444]: Uploading segments... Aug 27 18:04:43.275532750 (26m6.505018127s) [upload=444]: Got next segment. Inline: true Aug 27 18:04:43.275539142 (26m6.505024519s) [upload=444]: Waiting for error group managing segments... Aug 27 18:04:43.275591671 (26m6.505077049s) [upload=444]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 27 18:04:43.275599667 (26m6.505085114s) [upload=444]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 27 18:04:43.275606289 (26m6.505091676s) [upload=444]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 27 18:04:45.342492051 (26m8.571977398s) [upload=444]: Done uploading segments... Aug 27 18:04:45.342506197 (26m8.571991555s) [upload=444]: Upload finished. err: <nil>
Duration: 223.87503ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
383.428806ms
FAIL (2025-08-27 18:29:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 27 18:02:44.881381573 (24m8.11086692s) [upload=412]: Starting upload Aug 27 18:02:44.881449762 (24m8.110935109s) [upload=412]: Done starting upload Aug 27 18:02:44.881583483 (24m8.11106882s) [upload=412]: Uploading segments... Aug 27 18:02:44.881690004 (24m8.111175361s) [upload=412]: Got next segment. Inline: false Aug 27 18:02:44.881723887 (24m8.111209244s) [upload=412]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 27 18:02:44.881728085 (24m8.111213432s) [upload=412]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 27 18:03:14.867281026 (24m38.096766413s) [upload=412]: Next segment err: context deadline exceeded Aug 27 18:03:14.867364802 (24m38.09685018s) [upload=412]: Done uploading segments... Aug 27 18:03:14.867391553 (24m38.09687693s) [upload=412]: Upload finished. err: context deadline exceeded
Duration: 383.467219ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
16.831607ms target:
https://us1.storj.io/login
FAIL (2025-08-27 18:29:15 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused
Duration: 16.892632ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
526.207239ms
FAIL (2025-08-27 18:29:14 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 27 18:02:44.881381573 (24m8.11086692s) [upload=412]: Starting upload Aug 27 18:02:44.881449762 (24m8.110935109s) [upload=412]: Done starting upload Aug 27 18:02:44.881583483 (24m8.11106882s) [upload=412]: Uploading segments... Aug 27 18:02:44.881690004 (24m8.111175361s) [upload=412]: Got next segment. Inline: false Aug 27 18:02:44.881723887 (24m8.111209244s) [upload=412]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 27 18:02:44.881728085 (24m8.111213432s) [upload=412]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 27 18:03:14.867281026 (24m38.096766413s) [upload=412]: Next segment err: context deadline exceeded Aug 27 18:03:14.867364802 (24m38.09685018s) [upload=412]: Done uploading segments... Aug 27 18:03:14.867391553 (24m38.09687693s) [upload=412]: Upload finished. err: context deadline exceeded
Duration: 526.252144ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [....X..............X.....XX..X..............................] duration:
167.432367ms
FAIL (2025-08-27 18:29:06 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 27 18:04:43.275353764 (26m6.504839141s) [upload=444]: Starting upload Aug 27 18:04:43.275413156 (26m6.504898532s) [upload=444]: Done starting upload Aug 27 18:04:43.275481715 (26m6.504967091s) [upload=444]: Uploading segments... Aug 27 18:04:43.275532750 (26m6.505018127s) [upload=444]: Got next segment. Inline: true Aug 27 18:04:43.275539142 (26m6.505024519s) [upload=444]: Waiting for error group managing segments... Aug 27 18:04:43.275591671 (26m6.505077049s) [upload=444]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 27 18:04:43.275599667 (26m6.505085114s) [upload=444]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 27 18:04:43.275606289 (26m6.505091676s) [upload=444]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 27 18:04:45.342492051 (26m8.571977398s) [upload=444]: Done uploading segments... Aug 27 18:04:45.342506197 (26m8.571991555s) [upload=444]: Upload finished. err: <nil>
Duration: 167.466471ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........X..................XX..............................] duration:
414.934897ms
FAIL (2025-08-27 18:28:56 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 27 18:03:41.638525810 (25m4.868011167s) [upload=427]: Starting upload
Aug 27 18:03:41.638576486 (25m4.868061843s) [upload=427]: Done starting upload
Aug 27 18:03:41.638791290 (25m4.868276656s) [upload=427]: Uploading segments...
Aug 27 18:03:41.638966970 (25m4.868452327s) [upload=427]: Got next segment. Inline: false
Aug 27 18:03:41.639007015 (25m4.868492382s) [upload=427]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 27 18:03:41.639011594 (25m4.868496951s) [upload=427]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 27 18:03:53.103881964 (25m16.333367311s) [seg_pos={0 0}, upload=427]: Begin upload segment...
Aug 27 18:03:53.103933962 (25m16.333419319s) [seg_pos={0 0}, upload=427]: Done begin upload segment.
Aug 27 18:03:53.103943780 (25m16.333429138s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.103955252 (25m16.333440599s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104260056 (25m16.333745413s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104293498 (25m16.333778855s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104478375 (25m16.333963732s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104710141 (25m16.334195488s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104931056 (25m16.334416413s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105171478 (25m16.334656825s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105223215 (25m16.334708572s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105541594 (25m16.335026941s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105802835 (25m16.335288182s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106098240 (25m16.335583587s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106328002 (25m16.335813349s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106534229 (25m16.336019577s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106741769 (25m16.336227126s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106951844 (25m16.336437191s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.107183559 (25m16.336668917s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.107392001 (25m16.336877348s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.194419054 (25m16.423904401s) [upload=427]: Next returned nil segment
Aug 27 18:03:53.194432399 (25m16.423917746s) [upload=427]: Waiting for error group managing segments...
Aug 27 18:03:53.206440678 (25m16.435926035s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.207394130 (25m16.436879477s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.223636688 (25m16.453122045s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.223865307 (25m16.453350664s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.226291497 (25m16.455776844s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.229012241 (25m16.458497598s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.233683981 (25m16.463169338s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.237346655 (25m16.466832002s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.240931372 (25m16.470416719s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.241309432 (25m16.470794779s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.242649120 (25m16.472134467s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.243678826 (25m16.473164163s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.244908456 (25m16.474393803s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.254532134 (25m16.484017491s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.254554055 (25m16.484039403s) [seg_pos={0 0}, upload=427]: Segment reached optimal threshold of 14 pieces.
Aug 27 18:03:53.254688477 (25m16.484173824s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuahEyfok8Hk4fBNcdrZQWoQZiCXfNWdbfqPMnbEPmdZQ3R1o): protocol: expected piece hash; context canceled; EOF
Aug 27 18:03:53.254720447 (25m16.484205795s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Aug 27 18:03:53.254824613 (25m16.484309961s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxBiYLx8eWayRmXGXzNyRKAMLEcL7gJ7VU4wLvKhN2nCQbqwf): protocol: expected piece hash; context canceled; EOF
Aug 27 18:03:53.254883715 (25m16.484369062s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wEmEB8Up7sKbBXuoZu9fx9e7cyuFDc8HVBt1g2x6ajDFj2Pnh): protocol: read tcp 5.161.89.252:51414->79.127.205.246:4266: use of closed network connection; conn closed: op
Aug 27 18:03:53.254896749 (25m16.484382106s) [seg_pos={0 0}, upload=427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 27 18:03:53.254967893 (25m16.484453239s) [upload=427]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 27 18:03:53.254973643 (25m16.48445899s) [upload=427]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 27 18:04:06.332254005 (25m29.561739352s) [upload=427]: Done uploading segments...
Aug 27 18:04:06.332269443 (25m29.561754791s) [upload=427]: Upload finished. err: <nil>
Duration: 414.962849ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
370.041192ms
FAIL (2025-08-27 18:28:48 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 27 18:02:44.881381573 (24m8.11086692s) [upload=412]: Starting upload Aug 27 18:02:44.881449762 (24m8.110935109s) [upload=412]: Done starting upload Aug 27 18:02:44.881583483 (24m8.11106882s) [upload=412]: Uploading segments... Aug 27 18:02:44.881690004 (24m8.111175361s) [upload=412]: Got next segment. Inline: false Aug 27 18:02:44.881723887 (24m8.111209244s) [upload=412]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 27 18:02:44.881728085 (24m8.111213432s) [upload=412]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 27 18:03:14.867281026 (24m38.096766413s) [upload=412]: Next segment err: context deadline exceeded Aug 27 18:03:14.867364802 (24m38.09685018s) [upload=412]: Done uploading segments... Aug 27 18:03:14.867391553 (24m38.09687693s) [upload=412]: Upload finished. err: context deadline exceeded
Duration: 370.064355ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
391.541536ms
FAIL (2025-08-27 18:28:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 27 18:02:44.881381573 (24m8.11086692s) [upload=412]: Starting upload Aug 27 18:02:44.881449762 (24m8.110935109s) [upload=412]: Done starting upload Aug 27 18:02:44.881583483 (24m8.11106882s) [upload=412]: Uploading segments... Aug 27 18:02:44.881690004 (24m8.111175361s) [upload=412]: Got next segment. Inline: false Aug 27 18:02:44.881723887 (24m8.111209244s) [upload=412]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 27 18:02:44.881728085 (24m8.111213432s) [upload=412]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 27 18:03:14.867281026 (24m38.096766413s) [upload=412]: Next segment err: context deadline exceeded Aug 27 18:03:14.867364802 (24m38.09685018s) [upload=412]: Done uploading segments... Aug 27 18:03:14.867391553 (24m38.09687693s) [upload=412]: Upload finished. err: context deadline exceeded
Duration: 391.566293ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.....X..............X.....XX..X.............................] duration:
237.105904ms
FAIL (2025-08-27 18:28:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 27 18:04:43.275353764 (26m6.504839141s) [upload=444]: Starting upload Aug 27 18:04:43.275413156 (26m6.504898532s) [upload=444]: Done starting upload Aug 27 18:04:43.275481715 (26m6.504967091s) [upload=444]: Uploading segments... Aug 27 18:04:43.275532750 (26m6.505018127s) [upload=444]: Got next segment. Inline: true Aug 27 18:04:43.275539142 (26m6.505024519s) [upload=444]: Waiting for error group managing segments... Aug 27 18:04:43.275591671 (26m6.505077049s) [upload=444]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 27 18:04:43.275599667 (26m6.505085114s) [upload=444]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 27 18:04:43.275606289 (26m6.505091676s) [upload=444]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 27 18:04:45.342492051 (26m8.571977398s) [upload=444]: Done uploading segments... Aug 27 18:04:45.342506197 (26m8.571991555s) [upload=444]: Upload finished. err: <nil>
Duration: 237.137284ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
11.007391ms target:
https://us1.storj.io/login
FAIL (2025-08-27 18:28:07 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused
Duration: 11.030674ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
389.82456ms
FAIL (2025-08-27 18:27:59 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 27 18:02:44.881381573 (24m8.11086692s) [upload=412]: Starting upload Aug 27 18:02:44.881449762 (24m8.110935109s) [upload=412]: Done starting upload Aug 27 18:02:44.881583483 (24m8.11106882s) [upload=412]: Uploading segments... Aug 27 18:02:44.881690004 (24m8.111175361s) [upload=412]: Got next segment. Inline: false Aug 27 18:02:44.881723887 (24m8.111209244s) [upload=412]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 27 18:02:44.881728085 (24m8.111213432s) [upload=412]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 27 18:03:14.867281026 (24m38.096766413s) [upload=412]: Next segment err: context deadline exceeded Aug 27 18:03:14.867364802 (24m38.09685018s) [upload=412]: Done uploading segments... Aug 27 18:03:14.867391553 (24m38.09687693s) [upload=412]: Upload finished. err: context deadline exceeded
Duration: 389.847112ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........X..................XX.............................] duration:
372.718274ms
FAIL (2025-08-27 18:27:52 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 27 18:03:41.638525810 (25m4.868011167s) [upload=427]: Starting upload
Aug 27 18:03:41.638576486 (25m4.868061843s) [upload=427]: Done starting upload
Aug 27 18:03:41.638791290 (25m4.868276656s) [upload=427]: Uploading segments...
Aug 27 18:03:41.638966970 (25m4.868452327s) [upload=427]: Got next segment. Inline: false
Aug 27 18:03:41.639007015 (25m4.868492382s) [upload=427]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 27 18:03:41.639011594 (25m4.868496951s) [upload=427]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 27 18:03:53.103881964 (25m16.333367311s) [seg_pos={0 0}, upload=427]: Begin upload segment...
Aug 27 18:03:53.103933962 (25m16.333419319s) [seg_pos={0 0}, upload=427]: Done begin upload segment.
Aug 27 18:03:53.103943780 (25m16.333429138s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.103955252 (25m16.333440599s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104260056 (25m16.333745413s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104293498 (25m16.333778855s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104478375 (25m16.333963732s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104710141 (25m16.334195488s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.104931056 (25m16.334416413s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105171478 (25m16.334656825s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105223215 (25m16.334708572s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105541594 (25m16.335026941s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.105802835 (25m16.335288182s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106098240 (25m16.335583587s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106328002 (25m16.335813349s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106534229 (25m16.336019577s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106741769 (25m16.336227126s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.106951844 (25m16.336437191s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.107183559 (25m16.336668917s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.107392001 (25m16.336877348s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Uploading piece...
Aug 27 18:03:53.194419054 (25m16.423904401s) [upload=427]: Next returned nil segment
Aug 27 18:03:53.194432399 (25m16.423917746s) [upload=427]: Waiting for error group managing segments...
Aug 27 18:03:53.206440678 (25m16.435926035s) [noise=true , address=79.127.219.51:4213 , piece_id=AIY4Q7YXECWIVYAUUZJQIO6FU7IHBGJOCJX5KJK42YUOQ6QJFHFQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.207394130 (25m16.436879477s) [noise=true , address=104.36.82.22:4521 , piece_id=VISV5KN5WPA5OCJZ3C7KV6QZ5IF33YU27ROJGQHVBH3HBJSNQACQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.223636688 (25m16.453122045s) [noise=true , address=104.36.82.50:4038 , piece_id=G4PQ7YI3PLYCBMUJT75274LLZ4S4RLKRAD3PN5IEWGTXBOZRZI5A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.223865307 (25m16.453350664s) [noise=true , address=79.127.219.47:4071 , piece_id=7QG2SCEBU6NM2T5AUAGJBXWZFRFBCQLUNJYVC6O3SQYFQ4A46GWA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.226291497 (25m16.455776844s) [noise=true , address=104.36.82.60:4369 , piece_id=KFDOQSXGQMNI3PAFD2CMZVOIDCVQ25KSTOJQCDBCMHWVUJHOS7RQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.229012241 (25m16.458497598s) [noise=true , address=104.36.82.35:4605 , piece_id=4PXTUCI3A6QOYZ444ZNNRYW457ZOSSS55CRUEORVVOBXXR4RDXRQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.233683981 (25m16.463169338s) [noise=true , address=104.36.82.23:4451 , piece_id=TIQHFCPTAZ7LP5ZR4P5HQ54VVZHDTYB36DPVOCRKQ7YFYFGXYCVQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.237346655 (25m16.466832002s) [noise=true , address=45.91.116.13:4156 , piece_id=PGKD52QA7NEPI5E3OUX3MDDB22IKXITR3KJB5QBJAVV3GHL2L6TA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.240931372 (25m16.470416719s) [noise=true , address=45.91.116.9:4286 , piece_id=SMFA4VDXFTETCDUWRPFVSXVS7H3PHJP5NKZBEESBXA23JFVCY2GQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.241309432 (25m16.470794779s) [noise=true , address=104.36.82.5:4866 , piece_id=3FZI74SGG73ZZREGMO6Z3JZWOMTXNA4UZCYTHPAI5GARS6GOVXQA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.242649120 (25m16.472134467s) [noise=true , address=104.36.82.7:4922 , piece_id=O5EJ5WJEBTQL6TNAIOK37QVAKV67KT6Q7WLSDSHUXY76RZEZXLSA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.243678826 (25m16.473164163s) [noise=true , address=77.90.31.13:4639 , piece_id=P2G3KONGEGQELZK4GSMO2UA4QXSQGRAZJ4IN242C24Y2W7WJKCVA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.244908456 (25m16.474393803s) [noise=true , address=77.90.31.10:4535 , piece_id=DRFQYZXRDLU36Q4ZSMHQEWXEY4D3SM3FKA4KHKV3F6LQOBPDRI7A, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.254532134 (25m16.484017491s) [noise=true , address=104.36.82.12:4152 , piece_id=BH4F2HFOEVJFZBI5LXWS2ZIL5IPRRR7FTMADLJ63YSQ5XQSGYYAA, seg_pos={0 0}, upload=427]: Done uploading piece. err: <nil>
Aug 27 18:03:53.254554055 (25m16.484039403s) [seg_pos={0 0}, upload=427]: Segment reached optimal threshold of 14 pieces.
Aug 27 18:03:53.254688477 (25m16.484173824s) [noise=true , address=104.36.82.58:4288 , piece_id=JBVHFVLS5IWKEO6ICY4MJEK5EYCOPBHKBGQW376CIHEGZFMEIC6Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuahEyfok8Hk4fBNcdrZQWoQZiCXfNWdbfqPMnbEPmdZQ3R1o): protocol: expected piece hash; context canceled; EOF
Aug 27 18:03:53.254720447 (25m16.484205795s) [noise=true , address=104.36.82.49:4984 , piece_id=BDOKQ4AI3ZKDY3YSSKNRMKJMZJKMZ46AV2LLTUD34QFYB7WRW3QQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Aug 27 18:03:53.254824613 (25m16.484309961s) [noise=true , address=77.90.31.21:4911 , piece_id=IYZNRE6FN4NH5Q4LWHINCLNLBWAOISS4IF6UZA4CH5LG3EWWUN3Q, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxBiYLx8eWayRmXGXzNyRKAMLEcL7gJ7VU4wLvKhN2nCQbqwf): protocol: expected piece hash; context canceled; EOF
Aug 27 18:03:53.254883715 (25m16.484369062s) [noise=true , address=79.127.205.246:4266 , piece_id=JACVXHWASX75BEUR3LM56YMHTLR44TIKRNCVUD5N3RTADFMFKTIQ, seg_pos={0 0}, upload=427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wEmEB8Up7sKbBXuoZu9fx9e7cyuFDc8HVBt1g2x6ajDFj2Pnh): protocol: read tcp 5.161.89.252:51414->79.127.205.246:4266: use of closed network connection; conn closed: op
Aug 27 18:03:53.254896749 (25m16.484382106s) [seg_pos={0 0}, upload=427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 27 18:03:53.254967893 (25m16.484453239s) [upload=427]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 27 18:03:53.254973643 (25m16.48445899s) [upload=427]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 27 18:04:06.332254005 (25m29.561739352s) [upload=427]: Done uploading segments...
Aug 27 18:04:06.332269443 (25m29.561754791s) [upload=427]: Upload finished. err: <nil>
Duration: 372.752227ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
495.402051ms
FAIL (2025-08-27 18:27:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 27 18:02:44.881381573 (24m8.11086692s) [upload=412]: Starting upload Aug 27 18:02:44.881449762 (24m8.110935109s) [upload=412]: Done starting upload Aug 27 18:02:44.881583483 (24m8.11106882s) [upload=412]: Uploading segments... Aug 27 18:02:44.881690004 (24m8.111175361s) [upload=412]: Got next segment. Inline: false Aug 27 18:02:44.881723887 (24m8.111209244s) [upload=412]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 27 18:02:44.881728085 (24m8.111213432s) [upload=412]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 27 18:03:14.867281026 (24m38.096766413s) [upload=412]: Next segment err: context deadline exceeded Aug 27 18:03:14.867364802 (24m38.09685018s) [upload=412]: Done uploading segments... Aug 27 18:03:14.867391553 (24m38.09687693s) [upload=412]: Upload finished. err: context deadline exceeded
Duration: 495.426127ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [......X..............X.....XX..X............................] duration:
150.680717ms
FAIL (2025-08-27 18:27:19 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 27 18:04:43.275353764 (26m6.504839141s) [upload=444]: Starting upload Aug 27 18:04:43.275413156 (26m6.504898532s) [upload=444]: Done starting upload Aug 27 18:04:43.275481715 (26m6.504967091s) [upload=444]: Uploading segments... Aug 27 18:04:43.275532750 (26m6.505018127s) [upload=444]: Got next segment. Inline: true Aug 27 18:04:43.275539142 (26m6.505024519s) [upload=444]: Waiting for error group managing segments... Aug 27 18:04:43.275591671 (26m6.505077049s) [upload=444]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 27 18:04:43.275599667 (26m6.505085114s) [upload=444]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 27 18:04:43.275606289 (26m6.505091676s) [upload=444]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 27 18:04:45.342492051 (26m8.571977398s) [upload=444]: Done uploading segments... Aug 27 18:04:45.342506197 (26m8.571991555s) [upload=444]: Upload finished. err: <nil>
Duration: 150.699633ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
10.620493ms target:
https://us1.storj.io/login
FAIL (2025-08-27 18:27:16 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused
Duration: 10.636552ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
365.897893ms
FAIL (2025-08-27 18:27:13 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 27 18:02:44.881381573 (24m8.11086692s) [upload=412]: Starting upload Aug 27 18:02:44.881449762 (24m8.110935109s) [upload=412]: Done starting upload Aug 27 18:02:44.881583483 (24m8.11106882s) [upload=412]: Uploading segments... Aug 27 18:02:44.881690004 (24m8.111175361s) [upload=412]: Got next segment. Inline: false Aug 27 18:02:44.881723887 (24m8.111209244s) [upload=412]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 27 18:02:44.881728085 (24m8.111213432s) [upload=412]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 27 18:03:14.867281026 (24m38.096766413s) [upload=412]: Next segment err: context deadline exceeded Aug 27 18:03:14.867364802 (24m38.09685018s) [upload=412]: Done uploading segments... Aug 27 18:03:14.867391553 (24m38.09687693s) [upload=412]: Upload finished. err: context deadline exceeded
Duration: 365.916788ms
core
uplink
us-select-1
|