Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
714.094153ms
FAIL (2025-09-12 02:10:16 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
:59:15.378098034 (323h50m50.730883142s) [noise=true , address=45.91.116.4:4940 , piece_id=EMNBQXH7HWLUVVBITPOFLPN53PQCYJTLPRVUT26LGWFWDVSSCJOQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378123783 (323h50m50.730908891s) [noise=true , address=45.91.116.4:4939 , piece_id=AEHOROTNIH2HOK3I3IYBX6Z2O6EVJJ3X3XEVDSMLTUOEDQ4IDXSA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378309039 (323h50m50.731094138s) [noise=true , address=45.91.116.11:4119 , piece_id=E4B57AXXN47LWBROI56VNUOEEJGIUAG5HKSFAMVMWP6HY47MAX2A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378354746 (323h50m50.731139854s) [noise=true , address=145.79.227.7:4293 , piece_id=S4OWYYNSUEXWKUNNC4B55LCRZWZ3LYDZ2NYHOZMSTJKDRSPQ674Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378527370 (323h50m50.731312478s) [noise=true , address=145.79.227.2:4113 , piece_id=TZW66MNIECHLORJUTKASPIDXQ3YI5HGFF6ZNS6JM57E367J7BJ2A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378623882 (323h50m50.73140899s) [noise=true , address=45.91.116.10:4082 , piece_id=24TTTULWU3PFF7EQWYL6PCY3KGLRAI54YE46GPO2OSPQK6MJVZ4Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378809740 (323h50m50.731594838s) [noise=true , address=77.90.31.17:4770 , piece_id=LGERV2CLKEAG37DE7A7LRVKHU7HWNAAAKKETAHQLRFR7VKAXEK3Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378859052 (323h50m50.731644161s) [noise=true , address=45.91.116.9:4261 , piece_id=P4SJMKSGG7JDU2ZQYI22UTFQFKXSSSTXWBIFSLE5H7JOGP3A435Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379035553 (323h50m50.731820661s) [noise=true , address=77.90.31.14:4662 , piece_id=6EANR4YVRNF24RZE3HSJIB3TVEJQI2KCKTQWQ76QP5UAVCEGKZHA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379111616 (323h50m50.731896714s) [noise=true , address=77.90.31.15:4697 , piece_id=T6TMEMNWFPM34JROLTR7HF77SZY6S6YLSK2YBNELY5XIOAAV26CA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379290201 (323h50m50.732075309s) [noise=true , address=45.91.116.8:4047 , piece_id=K4JGAIX4MJFY3MVGHQCDDNT7Z2AUSDOKW7S5V5KFKFPYNMWHJW7A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379346777 (323h50m50.732131885s) [noise=true , address=45.91.116.5:4297 , piece_id=3VHITF6WV6XDY54VCC6FYYAZNFBVWZQRQW4OOSUOGEAXCBTJWZIQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.383413107 (323h50m50.736198204s) [noise=true , address=45.91.116.12:4227 , piece_id=N7S4SDFIJ7WYJXJGDIW3WZEV36LH77ZDRQ3IEMT26WHT2QCOHTWQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.386513151 (323h50m50.739298259s) [noise=true , address=145.79.227.14:4840 , piece_id=3HZCIAMPRCDC4OVO7CHGWU5P3H5ZCK326TZO5PTHU4XHRVY4OW5Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.466237594 (323h50m50.819022703s) [upload=285162]: Next returned nil segment
Sep 12 01:59:15.466247814 (323h50m50.819032922s) [upload=285162]: Waiting for error group managing segments...
Sep 12 01:59:15.484118391 (323h50m50.836903489s) [noise=true , address=145.79.227.2:4113 , piece_id=TZW66MNIECHLORJUTKASPIDXQ3YI5HGFF6ZNS6JM57E367J7BJ2A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:15.496496905 (323h50m50.849282013s) [noise=true , address=145.79.227.14:4840 , piece_id=3HZCIAMPRCDC4OVO7CHGWU5P3H5ZCK326TZO5PTHU4XHRVY4OW5Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:15.496623622 (323h50m50.84940873s) [noise=true , address=145.79.227.7:4293 , piece_id=S4OWYYNSUEXWKUNNC4B55LCRZWZ3LYDZ2NYHOZMSTJKDRSPQ674Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:37.850874528 (323h51m13.203659657s) [noise=true , address=77.90.31.15:4697 , piece_id=T6TMEMNWFPM34JROLTR7HF77SZY6S6YLSK2YBNELY5XIOAAV26CA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:40.290963073 (323h51m15.643748171s) [noise=true , address=45.91.116.12:4227 , piece_id=N7S4SDFIJ7WYJXJGDIW3WZEV36LH77ZDRQ3IEMT26WHT2QCOHTWQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:40.804126508 (323h51m16.156911635s) [noise=true , address=77.90.31.17:4770 , piece_id=LGERV2CLKEAG37DE7A7LRVKHU7HWNAAAKKETAHQLRFR7VKAXEK3Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:42.448883426 (323h51m17.801668564s) [noise=true , address=45.91.116.8:4047 , piece_id=K4JGAIX4MJFY3MVGHQCDDNT7Z2AUSDOKW7S5V5KFKFPYNMWHJW7A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:42.526900384 (323h51m17.879685513s) [noise=true , address=77.90.31.10:4519 , piece_id=MRSLI7YEDG5CPD2FBXKE55D5NG5AIOZST6NGRSKRLBLL23LTUGSA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:45.340332642 (323h51m20.69311775s) [noise=true , address=45.91.116.4:4939 , piece_id=AEHOROTNIH2HOK3I3IYBX6Z2O6EVJJ3X3XEVDSMLTUOEDQ4IDXSA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection; write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection
Sep 12 01:59:45.340383718 (323h51m20.693168826s) [noise=true , address=77.90.31.14:4662 , piece_id=6EANR4YVRNF24RZE3HSJIB3TVEJQI2KCKTQWQ76QP5UAVCEGKZHA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 5.161.89.252:48308->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 12 01:59:45.340392985 (323h51m20.693178093s) [noise=true , address=45.91.116.11:4119 , piece_id=E4B57AXXN47LWBROI56VNUOEEJGIUAG5HKSFAMVMWP6HY47MAX2A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection
Sep 12 01:59:45.340418192 (323h51m20.6932033s) [noise=true , address=45.91.116.4:4940 , piece_id=EMNBQXH7HWLUVVBITPOFLPN53PQCYJTLPRVUT26LGWFWDVSSCJOQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection; write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection
Sep 12 01:59:45.340452597 (323h51m20.693237695s) [noise=true , address=45.91.116.10:4082 , piece_id=24TTTULWU3PFF7EQWYL6PCY3KGLRAI54YE46GPO2OSPQK6MJVZ4Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection; write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection
Sep 12 01:59:45.340457857 (323h51m20.693242965s) [noise=true , address=45.91.116.12:4225 , piece_id=FFJGLRNIEZFTHTOEQAMTDXWSOSAT37Y5OMPXWJS35QJEPINFKNHA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection; write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection
Sep 12 01:59:45.340474879 (323h51m20.693259987s) [noise=true , address=45.91.116.9:4261 , piece_id=P4SJMKSGG7JDU2ZQYI22UTFQFKXSSSTXWBIFSLE5H7JOGP3A435Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection
Sep 12 01:59:45.340489676 (323h51m20.693274784s) [noise=true , address=45.91.116.5:4297 , piece_id=3VHITF6WV6XDY54VCC6FYYAZNFBVWZQRQW4OOSUOGEAXCBTJWZIQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection; write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection
Sep 12 01:59:45.340510295 (323h51m20.693295404s) [seg_pos={0 0}, upload=285162]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Sep 12 01:59:45.363290614 (323h51m20.716075722s) [upload=285162]: Done uploading segments...
Sep 12 01:59:45.363306744 (323h51m20.716091852s) [upload=285162]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 714.118197ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
482.819906ms
FAIL (2025-09-12 02:09:15 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
:59:15.378098034 (323h50m50.730883142s) [noise=true , address=45.91.116.4:4940 , piece_id=EMNBQXH7HWLUVVBITPOFLPN53PQCYJTLPRVUT26LGWFWDVSSCJOQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378123783 (323h50m50.730908891s) [noise=true , address=45.91.116.4:4939 , piece_id=AEHOROTNIH2HOK3I3IYBX6Z2O6EVJJ3X3XEVDSMLTUOEDQ4IDXSA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378309039 (323h50m50.731094138s) [noise=true , address=45.91.116.11:4119 , piece_id=E4B57AXXN47LWBROI56VNUOEEJGIUAG5HKSFAMVMWP6HY47MAX2A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378354746 (323h50m50.731139854s) [noise=true , address=145.79.227.7:4293 , piece_id=S4OWYYNSUEXWKUNNC4B55LCRZWZ3LYDZ2NYHOZMSTJKDRSPQ674Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378527370 (323h50m50.731312478s) [noise=true , address=145.79.227.2:4113 , piece_id=TZW66MNIECHLORJUTKASPIDXQ3YI5HGFF6ZNS6JM57E367J7BJ2A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378623882 (323h50m50.73140899s) [noise=true , address=45.91.116.10:4082 , piece_id=24TTTULWU3PFF7EQWYL6PCY3KGLRAI54YE46GPO2OSPQK6MJVZ4Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378809740 (323h50m50.731594838s) [noise=true , address=77.90.31.17:4770 , piece_id=LGERV2CLKEAG37DE7A7LRVKHU7HWNAAAKKETAHQLRFR7VKAXEK3Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378859052 (323h50m50.731644161s) [noise=true , address=45.91.116.9:4261 , piece_id=P4SJMKSGG7JDU2ZQYI22UTFQFKXSSSTXWBIFSLE5H7JOGP3A435Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379035553 (323h50m50.731820661s) [noise=true , address=77.90.31.14:4662 , piece_id=6EANR4YVRNF24RZE3HSJIB3TVEJQI2KCKTQWQ76QP5UAVCEGKZHA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379111616 (323h50m50.731896714s) [noise=true , address=77.90.31.15:4697 , piece_id=T6TMEMNWFPM34JROLTR7HF77SZY6S6YLSK2YBNELY5XIOAAV26CA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379290201 (323h50m50.732075309s) [noise=true , address=45.91.116.8:4047 , piece_id=K4JGAIX4MJFY3MVGHQCDDNT7Z2AUSDOKW7S5V5KFKFPYNMWHJW7A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379346777 (323h50m50.732131885s) [noise=true , address=45.91.116.5:4297 , piece_id=3VHITF6WV6XDY54VCC6FYYAZNFBVWZQRQW4OOSUOGEAXCBTJWZIQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.383413107 (323h50m50.736198204s) [noise=true , address=45.91.116.12:4227 , piece_id=N7S4SDFIJ7WYJXJGDIW3WZEV36LH77ZDRQ3IEMT26WHT2QCOHTWQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.386513151 (323h50m50.739298259s) [noise=true , address=145.79.227.14:4840 , piece_id=3HZCIAMPRCDC4OVO7CHGWU5P3H5ZCK326TZO5PTHU4XHRVY4OW5Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.466237594 (323h50m50.819022703s) [upload=285162]: Next returned nil segment
Sep 12 01:59:15.466247814 (323h50m50.819032922s) [upload=285162]: Waiting for error group managing segments...
Sep 12 01:59:15.484118391 (323h50m50.836903489s) [noise=true , address=145.79.227.2:4113 , piece_id=TZW66MNIECHLORJUTKASPIDXQ3YI5HGFF6ZNS6JM57E367J7BJ2A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:15.496496905 (323h50m50.849282013s) [noise=true , address=145.79.227.14:4840 , piece_id=3HZCIAMPRCDC4OVO7CHGWU5P3H5ZCK326TZO5PTHU4XHRVY4OW5Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:15.496623622 (323h50m50.84940873s) [noise=true , address=145.79.227.7:4293 , piece_id=S4OWYYNSUEXWKUNNC4B55LCRZWZ3LYDZ2NYHOZMSTJKDRSPQ674Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:37.850874528 (323h51m13.203659657s) [noise=true , address=77.90.31.15:4697 , piece_id=T6TMEMNWFPM34JROLTR7HF77SZY6S6YLSK2YBNELY5XIOAAV26CA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:40.290963073 (323h51m15.643748171s) [noise=true , address=45.91.116.12:4227 , piece_id=N7S4SDFIJ7WYJXJGDIW3WZEV36LH77ZDRQ3IEMT26WHT2QCOHTWQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:40.804126508 (323h51m16.156911635s) [noise=true , address=77.90.31.17:4770 , piece_id=LGERV2CLKEAG37DE7A7LRVKHU7HWNAAAKKETAHQLRFR7VKAXEK3Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:42.448883426 (323h51m17.801668564s) [noise=true , address=45.91.116.8:4047 , piece_id=K4JGAIX4MJFY3MVGHQCDDNT7Z2AUSDOKW7S5V5KFKFPYNMWHJW7A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:42.526900384 (323h51m17.879685513s) [noise=true , address=77.90.31.10:4519 , piece_id=MRSLI7YEDG5CPD2FBXKE55D5NG5AIOZST6NGRSKRLBLL23LTUGSA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:45.340332642 (323h51m20.69311775s) [noise=true , address=45.91.116.4:4939 , piece_id=AEHOROTNIH2HOK3I3IYBX6Z2O6EVJJ3X3XEVDSMLTUOEDQ4IDXSA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection; write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection
Sep 12 01:59:45.340383718 (323h51m20.693168826s) [noise=true , address=77.90.31.14:4662 , piece_id=6EANR4YVRNF24RZE3HSJIB3TVEJQI2KCKTQWQ76QP5UAVCEGKZHA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 5.161.89.252:48308->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 12 01:59:45.340392985 (323h51m20.693178093s) [noise=true , address=45.91.116.11:4119 , piece_id=E4B57AXXN47LWBROI56VNUOEEJGIUAG5HKSFAMVMWP6HY47MAX2A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection
Sep 12 01:59:45.340418192 (323h51m20.6932033s) [noise=true , address=45.91.116.4:4940 , piece_id=EMNBQXH7HWLUVVBITPOFLPN53PQCYJTLPRVUT26LGWFWDVSSCJOQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection; write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection
Sep 12 01:59:45.340452597 (323h51m20.693237695s) [noise=true , address=45.91.116.10:4082 , piece_id=24TTTULWU3PFF7EQWYL6PCY3KGLRAI54YE46GPO2OSPQK6MJVZ4Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection; write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection
Sep 12 01:59:45.340457857 (323h51m20.693242965s) [noise=true , address=45.91.116.12:4225 , piece_id=FFJGLRNIEZFTHTOEQAMTDXWSOSAT37Y5OMPXWJS35QJEPINFKNHA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection; write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection
Sep 12 01:59:45.340474879 (323h51m20.693259987s) [noise=true , address=45.91.116.9:4261 , piece_id=P4SJMKSGG7JDU2ZQYI22UTFQFKXSSSTXWBIFSLE5H7JOGP3A435Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection
Sep 12 01:59:45.340489676 (323h51m20.693274784s) [noise=true , address=45.91.116.5:4297 , piece_id=3VHITF6WV6XDY54VCC6FYYAZNFBVWZQRQW4OOSUOGEAXCBTJWZIQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection; write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection
Sep 12 01:59:45.340510295 (323h51m20.693295404s) [seg_pos={0 0}, upload=285162]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Sep 12 01:59:45.363290614 (323h51m20.716075722s) [upload=285162]: Done uploading segments...
Sep 12 01:59:45.363306744 (323h51m20.716091852s) [upload=285162]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 482.838791ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
445.782751ms
FAIL (2025-09-12 02:08:44 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
:59:15.378098034 (323h50m50.730883142s) [noise=true , address=45.91.116.4:4940 , piece_id=EMNBQXH7HWLUVVBITPOFLPN53PQCYJTLPRVUT26LGWFWDVSSCJOQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378123783 (323h50m50.730908891s) [noise=true , address=45.91.116.4:4939 , piece_id=AEHOROTNIH2HOK3I3IYBX6Z2O6EVJJ3X3XEVDSMLTUOEDQ4IDXSA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378309039 (323h50m50.731094138s) [noise=true , address=45.91.116.11:4119 , piece_id=E4B57AXXN47LWBROI56VNUOEEJGIUAG5HKSFAMVMWP6HY47MAX2A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378354746 (323h50m50.731139854s) [noise=true , address=145.79.227.7:4293 , piece_id=S4OWYYNSUEXWKUNNC4B55LCRZWZ3LYDZ2NYHOZMSTJKDRSPQ674Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378527370 (323h50m50.731312478s) [noise=true , address=145.79.227.2:4113 , piece_id=TZW66MNIECHLORJUTKASPIDXQ3YI5HGFF6ZNS6JM57E367J7BJ2A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378623882 (323h50m50.73140899s) [noise=true , address=45.91.116.10:4082 , piece_id=24TTTULWU3PFF7EQWYL6PCY3KGLRAI54YE46GPO2OSPQK6MJVZ4Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378809740 (323h50m50.731594838s) [noise=true , address=77.90.31.17:4770 , piece_id=LGERV2CLKEAG37DE7A7LRVKHU7HWNAAAKKETAHQLRFR7VKAXEK3Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378859052 (323h50m50.731644161s) [noise=true , address=45.91.116.9:4261 , piece_id=P4SJMKSGG7JDU2ZQYI22UTFQFKXSSSTXWBIFSLE5H7JOGP3A435Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379035553 (323h50m50.731820661s) [noise=true , address=77.90.31.14:4662 , piece_id=6EANR4YVRNF24RZE3HSJIB3TVEJQI2KCKTQWQ76QP5UAVCEGKZHA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379111616 (323h50m50.731896714s) [noise=true , address=77.90.31.15:4697 , piece_id=T6TMEMNWFPM34JROLTR7HF77SZY6S6YLSK2YBNELY5XIOAAV26CA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379290201 (323h50m50.732075309s) [noise=true , address=45.91.116.8:4047 , piece_id=K4JGAIX4MJFY3MVGHQCDDNT7Z2AUSDOKW7S5V5KFKFPYNMWHJW7A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379346777 (323h50m50.732131885s) [noise=true , address=45.91.116.5:4297 , piece_id=3VHITF6WV6XDY54VCC6FYYAZNFBVWZQRQW4OOSUOGEAXCBTJWZIQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.383413107 (323h50m50.736198204s) [noise=true , address=45.91.116.12:4227 , piece_id=N7S4SDFIJ7WYJXJGDIW3WZEV36LH77ZDRQ3IEMT26WHT2QCOHTWQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.386513151 (323h50m50.739298259s) [noise=true , address=145.79.227.14:4840 , piece_id=3HZCIAMPRCDC4OVO7CHGWU5P3H5ZCK326TZO5PTHU4XHRVY4OW5Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.466237594 (323h50m50.819022703s) [upload=285162]: Next returned nil segment
Sep 12 01:59:15.466247814 (323h50m50.819032922s) [upload=285162]: Waiting for error group managing segments...
Sep 12 01:59:15.484118391 (323h50m50.836903489s) [noise=true , address=145.79.227.2:4113 , piece_id=TZW66MNIECHLORJUTKASPIDXQ3YI5HGFF6ZNS6JM57E367J7BJ2A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:15.496496905 (323h50m50.849282013s) [noise=true , address=145.79.227.14:4840 , piece_id=3HZCIAMPRCDC4OVO7CHGWU5P3H5ZCK326TZO5PTHU4XHRVY4OW5Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:15.496623622 (323h50m50.84940873s) [noise=true , address=145.79.227.7:4293 , piece_id=S4OWYYNSUEXWKUNNC4B55LCRZWZ3LYDZ2NYHOZMSTJKDRSPQ674Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:37.850874528 (323h51m13.203659657s) [noise=true , address=77.90.31.15:4697 , piece_id=T6TMEMNWFPM34JROLTR7HF77SZY6S6YLSK2YBNELY5XIOAAV26CA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:40.290963073 (323h51m15.643748171s) [noise=true , address=45.91.116.12:4227 , piece_id=N7S4SDFIJ7WYJXJGDIW3WZEV36LH77ZDRQ3IEMT26WHT2QCOHTWQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:40.804126508 (323h51m16.156911635s) [noise=true , address=77.90.31.17:4770 , piece_id=LGERV2CLKEAG37DE7A7LRVKHU7HWNAAAKKETAHQLRFR7VKAXEK3Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:42.448883426 (323h51m17.801668564s) [noise=true , address=45.91.116.8:4047 , piece_id=K4JGAIX4MJFY3MVGHQCDDNT7Z2AUSDOKW7S5V5KFKFPYNMWHJW7A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:42.526900384 (323h51m17.879685513s) [noise=true , address=77.90.31.10:4519 , piece_id=MRSLI7YEDG5CPD2FBXKE55D5NG5AIOZST6NGRSKRLBLL23LTUGSA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:45.340332642 (323h51m20.69311775s) [noise=true , address=45.91.116.4:4939 , piece_id=AEHOROTNIH2HOK3I3IYBX6Z2O6EVJJ3X3XEVDSMLTUOEDQ4IDXSA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection; write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection
Sep 12 01:59:45.340383718 (323h51m20.693168826s) [noise=true , address=77.90.31.14:4662 , piece_id=6EANR4YVRNF24RZE3HSJIB3TVEJQI2KCKTQWQ76QP5UAVCEGKZHA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 5.161.89.252:48308->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 12 01:59:45.340392985 (323h51m20.693178093s) [noise=true , address=45.91.116.11:4119 , piece_id=E4B57AXXN47LWBROI56VNUOEEJGIUAG5HKSFAMVMWP6HY47MAX2A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection
Sep 12 01:59:45.340418192 (323h51m20.6932033s) [noise=true , address=45.91.116.4:4940 , piece_id=EMNBQXH7HWLUVVBITPOFLPN53PQCYJTLPRVUT26LGWFWDVSSCJOQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection; write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection
Sep 12 01:59:45.340452597 (323h51m20.693237695s) [noise=true , address=45.91.116.10:4082 , piece_id=24TTTULWU3PFF7EQWYL6PCY3KGLRAI54YE46GPO2OSPQK6MJVZ4Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection; write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection
Sep 12 01:59:45.340457857 (323h51m20.693242965s) [noise=true , address=45.91.116.12:4225 , piece_id=FFJGLRNIEZFTHTOEQAMTDXWSOSAT37Y5OMPXWJS35QJEPINFKNHA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection; write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection
Sep 12 01:59:45.340474879 (323h51m20.693259987s) [noise=true , address=45.91.116.9:4261 , piece_id=P4SJMKSGG7JDU2ZQYI22UTFQFKXSSSTXWBIFSLE5H7JOGP3A435Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection
Sep 12 01:59:45.340489676 (323h51m20.693274784s) [noise=true , address=45.91.116.5:4297 , piece_id=3VHITF6WV6XDY54VCC6FYYAZNFBVWZQRQW4OOSUOGEAXCBTJWZIQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection; write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection
Sep 12 01:59:45.340510295 (323h51m20.693295404s) [seg_pos={0 0}, upload=285162]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Sep 12 01:59:45.363290614 (323h51m20.716075722s) [upload=285162]: Done uploading segments...
Sep 12 01:59:45.363306744 (323h51m20.716091852s) [upload=285162]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 445.803601ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
665.392894ms
FAIL (2025-09-12 02:07:58 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
:59:15.378098034 (323h50m50.730883142s) [noise=true , address=45.91.116.4:4940 , piece_id=EMNBQXH7HWLUVVBITPOFLPN53PQCYJTLPRVUT26LGWFWDVSSCJOQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378123783 (323h50m50.730908891s) [noise=true , address=45.91.116.4:4939 , piece_id=AEHOROTNIH2HOK3I3IYBX6Z2O6EVJJ3X3XEVDSMLTUOEDQ4IDXSA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378309039 (323h50m50.731094138s) [noise=true , address=45.91.116.11:4119 , piece_id=E4B57AXXN47LWBROI56VNUOEEJGIUAG5HKSFAMVMWP6HY47MAX2A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378354746 (323h50m50.731139854s) [noise=true , address=145.79.227.7:4293 , piece_id=S4OWYYNSUEXWKUNNC4B55LCRZWZ3LYDZ2NYHOZMSTJKDRSPQ674Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378527370 (323h50m50.731312478s) [noise=true , address=145.79.227.2:4113 , piece_id=TZW66MNIECHLORJUTKASPIDXQ3YI5HGFF6ZNS6JM57E367J7BJ2A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378623882 (323h50m50.73140899s) [noise=true , address=45.91.116.10:4082 , piece_id=24TTTULWU3PFF7EQWYL6PCY3KGLRAI54YE46GPO2OSPQK6MJVZ4Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378809740 (323h50m50.731594838s) [noise=true , address=77.90.31.17:4770 , piece_id=LGERV2CLKEAG37DE7A7LRVKHU7HWNAAAKKETAHQLRFR7VKAXEK3Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378859052 (323h50m50.731644161s) [noise=true , address=45.91.116.9:4261 , piece_id=P4SJMKSGG7JDU2ZQYI22UTFQFKXSSSTXWBIFSLE5H7JOGP3A435Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379035553 (323h50m50.731820661s) [noise=true , address=77.90.31.14:4662 , piece_id=6EANR4YVRNF24RZE3HSJIB3TVEJQI2KCKTQWQ76QP5UAVCEGKZHA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379111616 (323h50m50.731896714s) [noise=true , address=77.90.31.15:4697 , piece_id=T6TMEMNWFPM34JROLTR7HF77SZY6S6YLSK2YBNELY5XIOAAV26CA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379290201 (323h50m50.732075309s) [noise=true , address=45.91.116.8:4047 , piece_id=K4JGAIX4MJFY3MVGHQCDDNT7Z2AUSDOKW7S5V5KFKFPYNMWHJW7A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379346777 (323h50m50.732131885s) [noise=true , address=45.91.116.5:4297 , piece_id=3VHITF6WV6XDY54VCC6FYYAZNFBVWZQRQW4OOSUOGEAXCBTJWZIQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.383413107 (323h50m50.736198204s) [noise=true , address=45.91.116.12:4227 , piece_id=N7S4SDFIJ7WYJXJGDIW3WZEV36LH77ZDRQ3IEMT26WHT2QCOHTWQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.386513151 (323h50m50.739298259s) [noise=true , address=145.79.227.14:4840 , piece_id=3HZCIAMPRCDC4OVO7CHGWU5P3H5ZCK326TZO5PTHU4XHRVY4OW5Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.466237594 (323h50m50.819022703s) [upload=285162]: Next returned nil segment
Sep 12 01:59:15.466247814 (323h50m50.819032922s) [upload=285162]: Waiting for error group managing segments...
Sep 12 01:59:15.484118391 (323h50m50.836903489s) [noise=true , address=145.79.227.2:4113 , piece_id=TZW66MNIECHLORJUTKASPIDXQ3YI5HGFF6ZNS6JM57E367J7BJ2A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:15.496496905 (323h50m50.849282013s) [noise=true , address=145.79.227.14:4840 , piece_id=3HZCIAMPRCDC4OVO7CHGWU5P3H5ZCK326TZO5PTHU4XHRVY4OW5Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:15.496623622 (323h50m50.84940873s) [noise=true , address=145.79.227.7:4293 , piece_id=S4OWYYNSUEXWKUNNC4B55LCRZWZ3LYDZ2NYHOZMSTJKDRSPQ674Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:37.850874528 (323h51m13.203659657s) [noise=true , address=77.90.31.15:4697 , piece_id=T6TMEMNWFPM34JROLTR7HF77SZY6S6YLSK2YBNELY5XIOAAV26CA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:40.290963073 (323h51m15.643748171s) [noise=true , address=45.91.116.12:4227 , piece_id=N7S4SDFIJ7WYJXJGDIW3WZEV36LH77ZDRQ3IEMT26WHT2QCOHTWQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:40.804126508 (323h51m16.156911635s) [noise=true , address=77.90.31.17:4770 , piece_id=LGERV2CLKEAG37DE7A7LRVKHU7HWNAAAKKETAHQLRFR7VKAXEK3Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:42.448883426 (323h51m17.801668564s) [noise=true , address=45.91.116.8:4047 , piece_id=K4JGAIX4MJFY3MVGHQCDDNT7Z2AUSDOKW7S5V5KFKFPYNMWHJW7A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:42.526900384 (323h51m17.879685513s) [noise=true , address=77.90.31.10:4519 , piece_id=MRSLI7YEDG5CPD2FBXKE55D5NG5AIOZST6NGRSKRLBLL23LTUGSA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:45.340332642 (323h51m20.69311775s) [noise=true , address=45.91.116.4:4939 , piece_id=AEHOROTNIH2HOK3I3IYBX6Z2O6EVJJ3X3XEVDSMLTUOEDQ4IDXSA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection; write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection
Sep 12 01:59:45.340383718 (323h51m20.693168826s) [noise=true , address=77.90.31.14:4662 , piece_id=6EANR4YVRNF24RZE3HSJIB3TVEJQI2KCKTQWQ76QP5UAVCEGKZHA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 5.161.89.252:48308->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 12 01:59:45.340392985 (323h51m20.693178093s) [noise=true , address=45.91.116.11:4119 , piece_id=E4B57AXXN47LWBROI56VNUOEEJGIUAG5HKSFAMVMWP6HY47MAX2A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection
Sep 12 01:59:45.340418192 (323h51m20.6932033s) [noise=true , address=45.91.116.4:4940 , piece_id=EMNBQXH7HWLUVVBITPOFLPN53PQCYJTLPRVUT26LGWFWDVSSCJOQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection; write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection
Sep 12 01:59:45.340452597 (323h51m20.693237695s) [noise=true , address=45.91.116.10:4082 , piece_id=24TTTULWU3PFF7EQWYL6PCY3KGLRAI54YE46GPO2OSPQK6MJVZ4Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection; write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection
Sep 12 01:59:45.340457857 (323h51m20.693242965s) [noise=true , address=45.91.116.12:4225 , piece_id=FFJGLRNIEZFTHTOEQAMTDXWSOSAT37Y5OMPXWJS35QJEPINFKNHA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection; write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection
Sep 12 01:59:45.340474879 (323h51m20.693259987s) [noise=true , address=45.91.116.9:4261 , piece_id=P4SJMKSGG7JDU2ZQYI22UTFQFKXSSSTXWBIFSLE5H7JOGP3A435Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection
Sep 12 01:59:45.340489676 (323h51m20.693274784s) [noise=true , address=45.91.116.5:4297 , piece_id=3VHITF6WV6XDY54VCC6FYYAZNFBVWZQRQW4OOSUOGEAXCBTJWZIQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection; write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection
Sep 12 01:59:45.340510295 (323h51m20.693295404s) [seg_pos={0 0}, upload=285162]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Sep 12 01:59:45.363290614 (323h51m20.716075722s) [upload=285162]: Done uploading segments...
Sep 12 01:59:45.363306744 (323h51m20.716091852s) [upload=285162]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 665.42351ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
730.664222ms
FAIL (2025-09-12 02:07:31 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
:59:15.378098034 (323h50m50.730883142s) [noise=true , address=45.91.116.4:4940 , piece_id=EMNBQXH7HWLUVVBITPOFLPN53PQCYJTLPRVUT26LGWFWDVSSCJOQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378123783 (323h50m50.730908891s) [noise=true , address=45.91.116.4:4939 , piece_id=AEHOROTNIH2HOK3I3IYBX6Z2O6EVJJ3X3XEVDSMLTUOEDQ4IDXSA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378309039 (323h50m50.731094138s) [noise=true , address=45.91.116.11:4119 , piece_id=E4B57AXXN47LWBROI56VNUOEEJGIUAG5HKSFAMVMWP6HY47MAX2A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378354746 (323h50m50.731139854s) [noise=true , address=145.79.227.7:4293 , piece_id=S4OWYYNSUEXWKUNNC4B55LCRZWZ3LYDZ2NYHOZMSTJKDRSPQ674Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378527370 (323h50m50.731312478s) [noise=true , address=145.79.227.2:4113 , piece_id=TZW66MNIECHLORJUTKASPIDXQ3YI5HGFF6ZNS6JM57E367J7BJ2A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378623882 (323h50m50.73140899s) [noise=true , address=45.91.116.10:4082 , piece_id=24TTTULWU3PFF7EQWYL6PCY3KGLRAI54YE46GPO2OSPQK6MJVZ4Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378809740 (323h50m50.731594838s) [noise=true , address=77.90.31.17:4770 , piece_id=LGERV2CLKEAG37DE7A7LRVKHU7HWNAAAKKETAHQLRFR7VKAXEK3Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378859052 (323h50m50.731644161s) [noise=true , address=45.91.116.9:4261 , piece_id=P4SJMKSGG7JDU2ZQYI22UTFQFKXSSSTXWBIFSLE5H7JOGP3A435Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379035553 (323h50m50.731820661s) [noise=true , address=77.90.31.14:4662 , piece_id=6EANR4YVRNF24RZE3HSJIB3TVEJQI2KCKTQWQ76QP5UAVCEGKZHA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379111616 (323h50m50.731896714s) [noise=true , address=77.90.31.15:4697 , piece_id=T6TMEMNWFPM34JROLTR7HF77SZY6S6YLSK2YBNELY5XIOAAV26CA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379290201 (323h50m50.732075309s) [noise=true , address=45.91.116.8:4047 , piece_id=K4JGAIX4MJFY3MVGHQCDDNT7Z2AUSDOKW7S5V5KFKFPYNMWHJW7A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379346777 (323h50m50.732131885s) [noise=true , address=45.91.116.5:4297 , piece_id=3VHITF6WV6XDY54VCC6FYYAZNFBVWZQRQW4OOSUOGEAXCBTJWZIQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.383413107 (323h50m50.736198204s) [noise=true , address=45.91.116.12:4227 , piece_id=N7S4SDFIJ7WYJXJGDIW3WZEV36LH77ZDRQ3IEMT26WHT2QCOHTWQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.386513151 (323h50m50.739298259s) [noise=true , address=145.79.227.14:4840 , piece_id=3HZCIAMPRCDC4OVO7CHGWU5P3H5ZCK326TZO5PTHU4XHRVY4OW5Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.466237594 (323h50m50.819022703s) [upload=285162]: Next returned nil segment
Sep 12 01:59:15.466247814 (323h50m50.819032922s) [upload=285162]: Waiting for error group managing segments...
Sep 12 01:59:15.484118391 (323h50m50.836903489s) [noise=true , address=145.79.227.2:4113 , piece_id=TZW66MNIECHLORJUTKASPIDXQ3YI5HGFF6ZNS6JM57E367J7BJ2A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:15.496496905 (323h50m50.849282013s) [noise=true , address=145.79.227.14:4840 , piece_id=3HZCIAMPRCDC4OVO7CHGWU5P3H5ZCK326TZO5PTHU4XHRVY4OW5Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:15.496623622 (323h50m50.84940873s) [noise=true , address=145.79.227.7:4293 , piece_id=S4OWYYNSUEXWKUNNC4B55LCRZWZ3LYDZ2NYHOZMSTJKDRSPQ674Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:37.850874528 (323h51m13.203659657s) [noise=true , address=77.90.31.15:4697 , piece_id=T6TMEMNWFPM34JROLTR7HF77SZY6S6YLSK2YBNELY5XIOAAV26CA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:40.290963073 (323h51m15.643748171s) [noise=true , address=45.91.116.12:4227 , piece_id=N7S4SDFIJ7WYJXJGDIW3WZEV36LH77ZDRQ3IEMT26WHT2QCOHTWQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:40.804126508 (323h51m16.156911635s) [noise=true , address=77.90.31.17:4770 , piece_id=LGERV2CLKEAG37DE7A7LRVKHU7HWNAAAKKETAHQLRFR7VKAXEK3Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:42.448883426 (323h51m17.801668564s) [noise=true , address=45.91.116.8:4047 , piece_id=K4JGAIX4MJFY3MVGHQCDDNT7Z2AUSDOKW7S5V5KFKFPYNMWHJW7A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:42.526900384 (323h51m17.879685513s) [noise=true , address=77.90.31.10:4519 , piece_id=MRSLI7YEDG5CPD2FBXKE55D5NG5AIOZST6NGRSKRLBLL23LTUGSA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:45.340332642 (323h51m20.69311775s) [noise=true , address=45.91.116.4:4939 , piece_id=AEHOROTNIH2HOK3I3IYBX6Z2O6EVJJ3X3XEVDSMLTUOEDQ4IDXSA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection; write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection
Sep 12 01:59:45.340383718 (323h51m20.693168826s) [noise=true , address=77.90.31.14:4662 , piece_id=6EANR4YVRNF24RZE3HSJIB3TVEJQI2KCKTQWQ76QP5UAVCEGKZHA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 5.161.89.252:48308->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 12 01:59:45.340392985 (323h51m20.693178093s) [noise=true , address=45.91.116.11:4119 , piece_id=E4B57AXXN47LWBROI56VNUOEEJGIUAG5HKSFAMVMWP6HY47MAX2A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection
Sep 12 01:59:45.340418192 (323h51m20.6932033s) [noise=true , address=45.91.116.4:4940 , piece_id=EMNBQXH7HWLUVVBITPOFLPN53PQCYJTLPRVUT26LGWFWDVSSCJOQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection; write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection
Sep 12 01:59:45.340452597 (323h51m20.693237695s) [noise=true , address=45.91.116.10:4082 , piece_id=24TTTULWU3PFF7EQWYL6PCY3KGLRAI54YE46GPO2OSPQK6MJVZ4Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection; write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection
Sep 12 01:59:45.340457857 (323h51m20.693242965s) [noise=true , address=45.91.116.12:4225 , piece_id=FFJGLRNIEZFTHTOEQAMTDXWSOSAT37Y5OMPXWJS35QJEPINFKNHA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection; write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection
Sep 12 01:59:45.340474879 (323h51m20.693259987s) [noise=true , address=45.91.116.9:4261 , piece_id=P4SJMKSGG7JDU2ZQYI22UTFQFKXSSSTXWBIFSLE5H7JOGP3A435Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection
Sep 12 01:59:45.340489676 (323h51m20.693274784s) [noise=true , address=45.91.116.5:4297 , piece_id=3VHITF6WV6XDY54VCC6FYYAZNFBVWZQRQW4OOSUOGEAXCBTJWZIQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection; write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection
Sep 12 01:59:45.340510295 (323h51m20.693295404s) [seg_pos={0 0}, upload=285162]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Sep 12 01:59:45.363290614 (323h51m20.716075722s) [upload=285162]: Done uploading segments...
Sep 12 01:59:45.363306744 (323h51m20.716091852s) [upload=285162]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 730.690631ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
492.875091ms
FAIL (2025-09-12 02:06:42 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
:59:15.378098034 (323h50m50.730883142s) [noise=true , address=45.91.116.4:4940 , piece_id=EMNBQXH7HWLUVVBITPOFLPN53PQCYJTLPRVUT26LGWFWDVSSCJOQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378123783 (323h50m50.730908891s) [noise=true , address=45.91.116.4:4939 , piece_id=AEHOROTNIH2HOK3I3IYBX6Z2O6EVJJ3X3XEVDSMLTUOEDQ4IDXSA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378309039 (323h50m50.731094138s) [noise=true , address=45.91.116.11:4119 , piece_id=E4B57AXXN47LWBROI56VNUOEEJGIUAG5HKSFAMVMWP6HY47MAX2A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378354746 (323h50m50.731139854s) [noise=true , address=145.79.227.7:4293 , piece_id=S4OWYYNSUEXWKUNNC4B55LCRZWZ3LYDZ2NYHOZMSTJKDRSPQ674Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378527370 (323h50m50.731312478s) [noise=true , address=145.79.227.2:4113 , piece_id=TZW66MNIECHLORJUTKASPIDXQ3YI5HGFF6ZNS6JM57E367J7BJ2A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378623882 (323h50m50.73140899s) [noise=true , address=45.91.116.10:4082 , piece_id=24TTTULWU3PFF7EQWYL6PCY3KGLRAI54YE46GPO2OSPQK6MJVZ4Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378809740 (323h50m50.731594838s) [noise=true , address=77.90.31.17:4770 , piece_id=LGERV2CLKEAG37DE7A7LRVKHU7HWNAAAKKETAHQLRFR7VKAXEK3Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378859052 (323h50m50.731644161s) [noise=true , address=45.91.116.9:4261 , piece_id=P4SJMKSGG7JDU2ZQYI22UTFQFKXSSSTXWBIFSLE5H7JOGP3A435Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379035553 (323h50m50.731820661s) [noise=true , address=77.90.31.14:4662 , piece_id=6EANR4YVRNF24RZE3HSJIB3TVEJQI2KCKTQWQ76QP5UAVCEGKZHA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379111616 (323h50m50.731896714s) [noise=true , address=77.90.31.15:4697 , piece_id=T6TMEMNWFPM34JROLTR7HF77SZY6S6YLSK2YBNELY5XIOAAV26CA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379290201 (323h50m50.732075309s) [noise=true , address=45.91.116.8:4047 , piece_id=K4JGAIX4MJFY3MVGHQCDDNT7Z2AUSDOKW7S5V5KFKFPYNMWHJW7A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379346777 (323h50m50.732131885s) [noise=true , address=45.91.116.5:4297 , piece_id=3VHITF6WV6XDY54VCC6FYYAZNFBVWZQRQW4OOSUOGEAXCBTJWZIQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.383413107 (323h50m50.736198204s) [noise=true , address=45.91.116.12:4227 , piece_id=N7S4SDFIJ7WYJXJGDIW3WZEV36LH77ZDRQ3IEMT26WHT2QCOHTWQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.386513151 (323h50m50.739298259s) [noise=true , address=145.79.227.14:4840 , piece_id=3HZCIAMPRCDC4OVO7CHGWU5P3H5ZCK326TZO5PTHU4XHRVY4OW5Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.466237594 (323h50m50.819022703s) [upload=285162]: Next returned nil segment
Sep 12 01:59:15.466247814 (323h50m50.819032922s) [upload=285162]: Waiting for error group managing segments...
Sep 12 01:59:15.484118391 (323h50m50.836903489s) [noise=true , address=145.79.227.2:4113 , piece_id=TZW66MNIECHLORJUTKASPIDXQ3YI5HGFF6ZNS6JM57E367J7BJ2A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:15.496496905 (323h50m50.849282013s) [noise=true , address=145.79.227.14:4840 , piece_id=3HZCIAMPRCDC4OVO7CHGWU5P3H5ZCK326TZO5PTHU4XHRVY4OW5Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:15.496623622 (323h50m50.84940873s) [noise=true , address=145.79.227.7:4293 , piece_id=S4OWYYNSUEXWKUNNC4B55LCRZWZ3LYDZ2NYHOZMSTJKDRSPQ674Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:37.850874528 (323h51m13.203659657s) [noise=true , address=77.90.31.15:4697 , piece_id=T6TMEMNWFPM34JROLTR7HF77SZY6S6YLSK2YBNELY5XIOAAV26CA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:40.290963073 (323h51m15.643748171s) [noise=true , address=45.91.116.12:4227 , piece_id=N7S4SDFIJ7WYJXJGDIW3WZEV36LH77ZDRQ3IEMT26WHT2QCOHTWQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:40.804126508 (323h51m16.156911635s) [noise=true , address=77.90.31.17:4770 , piece_id=LGERV2CLKEAG37DE7A7LRVKHU7HWNAAAKKETAHQLRFR7VKAXEK3Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:42.448883426 (323h51m17.801668564s) [noise=true , address=45.91.116.8:4047 , piece_id=K4JGAIX4MJFY3MVGHQCDDNT7Z2AUSDOKW7S5V5KFKFPYNMWHJW7A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:42.526900384 (323h51m17.879685513s) [noise=true , address=77.90.31.10:4519 , piece_id=MRSLI7YEDG5CPD2FBXKE55D5NG5AIOZST6NGRSKRLBLL23LTUGSA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:45.340332642 (323h51m20.69311775s) [noise=true , address=45.91.116.4:4939 , piece_id=AEHOROTNIH2HOK3I3IYBX6Z2O6EVJJ3X3XEVDSMLTUOEDQ4IDXSA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection; write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection
Sep 12 01:59:45.340383718 (323h51m20.693168826s) [noise=true , address=77.90.31.14:4662 , piece_id=6EANR4YVRNF24RZE3HSJIB3TVEJQI2KCKTQWQ76QP5UAVCEGKZHA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 5.161.89.252:48308->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 12 01:59:45.340392985 (323h51m20.693178093s) [noise=true , address=45.91.116.11:4119 , piece_id=E4B57AXXN47LWBROI56VNUOEEJGIUAG5HKSFAMVMWP6HY47MAX2A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection
Sep 12 01:59:45.340418192 (323h51m20.6932033s) [noise=true , address=45.91.116.4:4940 , piece_id=EMNBQXH7HWLUVVBITPOFLPN53PQCYJTLPRVUT26LGWFWDVSSCJOQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection; write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection
Sep 12 01:59:45.340452597 (323h51m20.693237695s) [noise=true , address=45.91.116.10:4082 , piece_id=24TTTULWU3PFF7EQWYL6PCY3KGLRAI54YE46GPO2OSPQK6MJVZ4Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection; write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection
Sep 12 01:59:45.340457857 (323h51m20.693242965s) [noise=true , address=45.91.116.12:4225 , piece_id=FFJGLRNIEZFTHTOEQAMTDXWSOSAT37Y5OMPXWJS35QJEPINFKNHA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection; write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection
Sep 12 01:59:45.340474879 (323h51m20.693259987s) [noise=true , address=45.91.116.9:4261 , piece_id=P4SJMKSGG7JDU2ZQYI22UTFQFKXSSSTXWBIFSLE5H7JOGP3A435Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection
Sep 12 01:59:45.340489676 (323h51m20.693274784s) [noise=true , address=45.91.116.5:4297 , piece_id=3VHITF6WV6XDY54VCC6FYYAZNFBVWZQRQW4OOSUOGEAXCBTJWZIQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection; write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection
Sep 12 01:59:45.340510295 (323h51m20.693295404s) [seg_pos={0 0}, upload=285162]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Sep 12 01:59:45.363290614 (323h51m20.716075722s) [upload=285162]: Done uploading segments...
Sep 12 01:59:45.363306744 (323h51m20.716091852s) [upload=285162]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 492.892986ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
483.495094ms
FAIL (2025-09-12 02:06:02 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
:59:15.378098034 (323h50m50.730883142s) [noise=true , address=45.91.116.4:4940 , piece_id=EMNBQXH7HWLUVVBITPOFLPN53PQCYJTLPRVUT26LGWFWDVSSCJOQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378123783 (323h50m50.730908891s) [noise=true , address=45.91.116.4:4939 , piece_id=AEHOROTNIH2HOK3I3IYBX6Z2O6EVJJ3X3XEVDSMLTUOEDQ4IDXSA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378309039 (323h50m50.731094138s) [noise=true , address=45.91.116.11:4119 , piece_id=E4B57AXXN47LWBROI56VNUOEEJGIUAG5HKSFAMVMWP6HY47MAX2A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378354746 (323h50m50.731139854s) [noise=true , address=145.79.227.7:4293 , piece_id=S4OWYYNSUEXWKUNNC4B55LCRZWZ3LYDZ2NYHOZMSTJKDRSPQ674Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378527370 (323h50m50.731312478s) [noise=true , address=145.79.227.2:4113 , piece_id=TZW66MNIECHLORJUTKASPIDXQ3YI5HGFF6ZNS6JM57E367J7BJ2A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378623882 (323h50m50.73140899s) [noise=true , address=45.91.116.10:4082 , piece_id=24TTTULWU3PFF7EQWYL6PCY3KGLRAI54YE46GPO2OSPQK6MJVZ4Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378809740 (323h50m50.731594838s) [noise=true , address=77.90.31.17:4770 , piece_id=LGERV2CLKEAG37DE7A7LRVKHU7HWNAAAKKETAHQLRFR7VKAXEK3Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378859052 (323h50m50.731644161s) [noise=true , address=45.91.116.9:4261 , piece_id=P4SJMKSGG7JDU2ZQYI22UTFQFKXSSSTXWBIFSLE5H7JOGP3A435Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379035553 (323h50m50.731820661s) [noise=true , address=77.90.31.14:4662 , piece_id=6EANR4YVRNF24RZE3HSJIB3TVEJQI2KCKTQWQ76QP5UAVCEGKZHA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379111616 (323h50m50.731896714s) [noise=true , address=77.90.31.15:4697 , piece_id=T6TMEMNWFPM34JROLTR7HF77SZY6S6YLSK2YBNELY5XIOAAV26CA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379290201 (323h50m50.732075309s) [noise=true , address=45.91.116.8:4047 , piece_id=K4JGAIX4MJFY3MVGHQCDDNT7Z2AUSDOKW7S5V5KFKFPYNMWHJW7A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379346777 (323h50m50.732131885s) [noise=true , address=45.91.116.5:4297 , piece_id=3VHITF6WV6XDY54VCC6FYYAZNFBVWZQRQW4OOSUOGEAXCBTJWZIQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.383413107 (323h50m50.736198204s) [noise=true , address=45.91.116.12:4227 , piece_id=N7S4SDFIJ7WYJXJGDIW3WZEV36LH77ZDRQ3IEMT26WHT2QCOHTWQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.386513151 (323h50m50.739298259s) [noise=true , address=145.79.227.14:4840 , piece_id=3HZCIAMPRCDC4OVO7CHGWU5P3H5ZCK326TZO5PTHU4XHRVY4OW5Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.466237594 (323h50m50.819022703s) [upload=285162]: Next returned nil segment
Sep 12 01:59:15.466247814 (323h50m50.819032922s) [upload=285162]: Waiting for error group managing segments...
Sep 12 01:59:15.484118391 (323h50m50.836903489s) [noise=true , address=145.79.227.2:4113 , piece_id=TZW66MNIECHLORJUTKASPIDXQ3YI5HGFF6ZNS6JM57E367J7BJ2A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:15.496496905 (323h50m50.849282013s) [noise=true , address=145.79.227.14:4840 , piece_id=3HZCIAMPRCDC4OVO7CHGWU5P3H5ZCK326TZO5PTHU4XHRVY4OW5Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:15.496623622 (323h50m50.84940873s) [noise=true , address=145.79.227.7:4293 , piece_id=S4OWYYNSUEXWKUNNC4B55LCRZWZ3LYDZ2NYHOZMSTJKDRSPQ674Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:37.850874528 (323h51m13.203659657s) [noise=true , address=77.90.31.15:4697 , piece_id=T6TMEMNWFPM34JROLTR7HF77SZY6S6YLSK2YBNELY5XIOAAV26CA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:40.290963073 (323h51m15.643748171s) [noise=true , address=45.91.116.12:4227 , piece_id=N7S4SDFIJ7WYJXJGDIW3WZEV36LH77ZDRQ3IEMT26WHT2QCOHTWQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:40.804126508 (323h51m16.156911635s) [noise=true , address=77.90.31.17:4770 , piece_id=LGERV2CLKEAG37DE7A7LRVKHU7HWNAAAKKETAHQLRFR7VKAXEK3Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:42.448883426 (323h51m17.801668564s) [noise=true , address=45.91.116.8:4047 , piece_id=K4JGAIX4MJFY3MVGHQCDDNT7Z2AUSDOKW7S5V5KFKFPYNMWHJW7A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:42.526900384 (323h51m17.879685513s) [noise=true , address=77.90.31.10:4519 , piece_id=MRSLI7YEDG5CPD2FBXKE55D5NG5AIOZST6NGRSKRLBLL23LTUGSA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:45.340332642 (323h51m20.69311775s) [noise=true , address=45.91.116.4:4939 , piece_id=AEHOROTNIH2HOK3I3IYBX6Z2O6EVJJ3X3XEVDSMLTUOEDQ4IDXSA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection; write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection
Sep 12 01:59:45.340383718 (323h51m20.693168826s) [noise=true , address=77.90.31.14:4662 , piece_id=6EANR4YVRNF24RZE3HSJIB3TVEJQI2KCKTQWQ76QP5UAVCEGKZHA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 5.161.89.252:48308->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 12 01:59:45.340392985 (323h51m20.693178093s) [noise=true , address=45.91.116.11:4119 , piece_id=E4B57AXXN47LWBROI56VNUOEEJGIUAG5HKSFAMVMWP6HY47MAX2A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection
Sep 12 01:59:45.340418192 (323h51m20.6932033s) [noise=true , address=45.91.116.4:4940 , piece_id=EMNBQXH7HWLUVVBITPOFLPN53PQCYJTLPRVUT26LGWFWDVSSCJOQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection; write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection
Sep 12 01:59:45.340452597 (323h51m20.693237695s) [noise=true , address=45.91.116.10:4082 , piece_id=24TTTULWU3PFF7EQWYL6PCY3KGLRAI54YE46GPO2OSPQK6MJVZ4Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection; write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection
Sep 12 01:59:45.340457857 (323h51m20.693242965s) [noise=true , address=45.91.116.12:4225 , piece_id=FFJGLRNIEZFTHTOEQAMTDXWSOSAT37Y5OMPXWJS35QJEPINFKNHA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection; write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection
Sep 12 01:59:45.340474879 (323h51m20.693259987s) [noise=true , address=45.91.116.9:4261 , piece_id=P4SJMKSGG7JDU2ZQYI22UTFQFKXSSSTXWBIFSLE5H7JOGP3A435Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection
Sep 12 01:59:45.340489676 (323h51m20.693274784s) [noise=true , address=45.91.116.5:4297 , piece_id=3VHITF6WV6XDY54VCC6FYYAZNFBVWZQRQW4OOSUOGEAXCBTJWZIQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection; write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection
Sep 12 01:59:45.340510295 (323h51m20.693295404s) [seg_pos={0 0}, upload=285162]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Sep 12 01:59:45.363290614 (323h51m20.716075722s) [upload=285162]: Done uploading segments...
Sep 12 01:59:45.363306744 (323h51m20.716091852s) [upload=285162]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 483.517085ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
470.438137ms
FAIL (2025-09-12 02:05:18 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
:59:15.378098034 (323h50m50.730883142s) [noise=true , address=45.91.116.4:4940 , piece_id=EMNBQXH7HWLUVVBITPOFLPN53PQCYJTLPRVUT26LGWFWDVSSCJOQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378123783 (323h50m50.730908891s) [noise=true , address=45.91.116.4:4939 , piece_id=AEHOROTNIH2HOK3I3IYBX6Z2O6EVJJ3X3XEVDSMLTUOEDQ4IDXSA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378309039 (323h50m50.731094138s) [noise=true , address=45.91.116.11:4119 , piece_id=E4B57AXXN47LWBROI56VNUOEEJGIUAG5HKSFAMVMWP6HY47MAX2A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378354746 (323h50m50.731139854s) [noise=true , address=145.79.227.7:4293 , piece_id=S4OWYYNSUEXWKUNNC4B55LCRZWZ3LYDZ2NYHOZMSTJKDRSPQ674Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378527370 (323h50m50.731312478s) [noise=true , address=145.79.227.2:4113 , piece_id=TZW66MNIECHLORJUTKASPIDXQ3YI5HGFF6ZNS6JM57E367J7BJ2A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378623882 (323h50m50.73140899s) [noise=true , address=45.91.116.10:4082 , piece_id=24TTTULWU3PFF7EQWYL6PCY3KGLRAI54YE46GPO2OSPQK6MJVZ4Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378809740 (323h50m50.731594838s) [noise=true , address=77.90.31.17:4770 , piece_id=LGERV2CLKEAG37DE7A7LRVKHU7HWNAAAKKETAHQLRFR7VKAXEK3Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378859052 (323h50m50.731644161s) [noise=true , address=45.91.116.9:4261 , piece_id=P4SJMKSGG7JDU2ZQYI22UTFQFKXSSSTXWBIFSLE5H7JOGP3A435Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379035553 (323h50m50.731820661s) [noise=true , address=77.90.31.14:4662 , piece_id=6EANR4YVRNF24RZE3HSJIB3TVEJQI2KCKTQWQ76QP5UAVCEGKZHA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379111616 (323h50m50.731896714s) [noise=true , address=77.90.31.15:4697 , piece_id=T6TMEMNWFPM34JROLTR7HF77SZY6S6YLSK2YBNELY5XIOAAV26CA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379290201 (323h50m50.732075309s) [noise=true , address=45.91.116.8:4047 , piece_id=K4JGAIX4MJFY3MVGHQCDDNT7Z2AUSDOKW7S5V5KFKFPYNMWHJW7A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379346777 (323h50m50.732131885s) [noise=true , address=45.91.116.5:4297 , piece_id=3VHITF6WV6XDY54VCC6FYYAZNFBVWZQRQW4OOSUOGEAXCBTJWZIQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.383413107 (323h50m50.736198204s) [noise=true , address=45.91.116.12:4227 , piece_id=N7S4SDFIJ7WYJXJGDIW3WZEV36LH77ZDRQ3IEMT26WHT2QCOHTWQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.386513151 (323h50m50.739298259s) [noise=true , address=145.79.227.14:4840 , piece_id=3HZCIAMPRCDC4OVO7CHGWU5P3H5ZCK326TZO5PTHU4XHRVY4OW5Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.466237594 (323h50m50.819022703s) [upload=285162]: Next returned nil segment
Sep 12 01:59:15.466247814 (323h50m50.819032922s) [upload=285162]: Waiting for error group managing segments...
Sep 12 01:59:15.484118391 (323h50m50.836903489s) [noise=true , address=145.79.227.2:4113 , piece_id=TZW66MNIECHLORJUTKASPIDXQ3YI5HGFF6ZNS6JM57E367J7BJ2A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:15.496496905 (323h50m50.849282013s) [noise=true , address=145.79.227.14:4840 , piece_id=3HZCIAMPRCDC4OVO7CHGWU5P3H5ZCK326TZO5PTHU4XHRVY4OW5Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:15.496623622 (323h50m50.84940873s) [noise=true , address=145.79.227.7:4293 , piece_id=S4OWYYNSUEXWKUNNC4B55LCRZWZ3LYDZ2NYHOZMSTJKDRSPQ674Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:37.850874528 (323h51m13.203659657s) [noise=true , address=77.90.31.15:4697 , piece_id=T6TMEMNWFPM34JROLTR7HF77SZY6S6YLSK2YBNELY5XIOAAV26CA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:40.290963073 (323h51m15.643748171s) [noise=true , address=45.91.116.12:4227 , piece_id=N7S4SDFIJ7WYJXJGDIW3WZEV36LH77ZDRQ3IEMT26WHT2QCOHTWQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:40.804126508 (323h51m16.156911635s) [noise=true , address=77.90.31.17:4770 , piece_id=LGERV2CLKEAG37DE7A7LRVKHU7HWNAAAKKETAHQLRFR7VKAXEK3Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:42.448883426 (323h51m17.801668564s) [noise=true , address=45.91.116.8:4047 , piece_id=K4JGAIX4MJFY3MVGHQCDDNT7Z2AUSDOKW7S5V5KFKFPYNMWHJW7A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:42.526900384 (323h51m17.879685513s) [noise=true , address=77.90.31.10:4519 , piece_id=MRSLI7YEDG5CPD2FBXKE55D5NG5AIOZST6NGRSKRLBLL23LTUGSA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:45.340332642 (323h51m20.69311775s) [noise=true , address=45.91.116.4:4939 , piece_id=AEHOROTNIH2HOK3I3IYBX6Z2O6EVJJ3X3XEVDSMLTUOEDQ4IDXSA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection; write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection
Sep 12 01:59:45.340383718 (323h51m20.693168826s) [noise=true , address=77.90.31.14:4662 , piece_id=6EANR4YVRNF24RZE3HSJIB3TVEJQI2KCKTQWQ76QP5UAVCEGKZHA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 5.161.89.252:48308->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 12 01:59:45.340392985 (323h51m20.693178093s) [noise=true , address=45.91.116.11:4119 , piece_id=E4B57AXXN47LWBROI56VNUOEEJGIUAG5HKSFAMVMWP6HY47MAX2A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection
Sep 12 01:59:45.340418192 (323h51m20.6932033s) [noise=true , address=45.91.116.4:4940 , piece_id=EMNBQXH7HWLUVVBITPOFLPN53PQCYJTLPRVUT26LGWFWDVSSCJOQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection; write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection
Sep 12 01:59:45.340452597 (323h51m20.693237695s) [noise=true , address=45.91.116.10:4082 , piece_id=24TTTULWU3PFF7EQWYL6PCY3KGLRAI54YE46GPO2OSPQK6MJVZ4Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection; write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection
Sep 12 01:59:45.340457857 (323h51m20.693242965s) [noise=true , address=45.91.116.12:4225 , piece_id=FFJGLRNIEZFTHTOEQAMTDXWSOSAT37Y5OMPXWJS35QJEPINFKNHA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection; write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection
Sep 12 01:59:45.340474879 (323h51m20.693259987s) [noise=true , address=45.91.116.9:4261 , piece_id=P4SJMKSGG7JDU2ZQYI22UTFQFKXSSSTXWBIFSLE5H7JOGP3A435Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection
Sep 12 01:59:45.340489676 (323h51m20.693274784s) [noise=true , address=45.91.116.5:4297 , piece_id=3VHITF6WV6XDY54VCC6FYYAZNFBVWZQRQW4OOSUOGEAXCBTJWZIQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection; write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection
Sep 12 01:59:45.340510295 (323h51m20.693295404s) [seg_pos={0 0}, upload=285162]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Sep 12 01:59:45.363290614 (323h51m20.716075722s) [upload=285162]: Done uploading segments...
Sep 12 01:59:45.363306744 (323h51m20.716091852s) [upload=285162]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 470.474775ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
612.218984ms
FAIL (2025-09-12 02:04:13 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
:59:15.378098034 (323h50m50.730883142s) [noise=true , address=45.91.116.4:4940 , piece_id=EMNBQXH7HWLUVVBITPOFLPN53PQCYJTLPRVUT26LGWFWDVSSCJOQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378123783 (323h50m50.730908891s) [noise=true , address=45.91.116.4:4939 , piece_id=AEHOROTNIH2HOK3I3IYBX6Z2O6EVJJ3X3XEVDSMLTUOEDQ4IDXSA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378309039 (323h50m50.731094138s) [noise=true , address=45.91.116.11:4119 , piece_id=E4B57AXXN47LWBROI56VNUOEEJGIUAG5HKSFAMVMWP6HY47MAX2A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378354746 (323h50m50.731139854s) [noise=true , address=145.79.227.7:4293 , piece_id=S4OWYYNSUEXWKUNNC4B55LCRZWZ3LYDZ2NYHOZMSTJKDRSPQ674Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378527370 (323h50m50.731312478s) [noise=true , address=145.79.227.2:4113 , piece_id=TZW66MNIECHLORJUTKASPIDXQ3YI5HGFF6ZNS6JM57E367J7BJ2A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378623882 (323h50m50.73140899s) [noise=true , address=45.91.116.10:4082 , piece_id=24TTTULWU3PFF7EQWYL6PCY3KGLRAI54YE46GPO2OSPQK6MJVZ4Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378809740 (323h50m50.731594838s) [noise=true , address=77.90.31.17:4770 , piece_id=LGERV2CLKEAG37DE7A7LRVKHU7HWNAAAKKETAHQLRFR7VKAXEK3Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378859052 (323h50m50.731644161s) [noise=true , address=45.91.116.9:4261 , piece_id=P4SJMKSGG7JDU2ZQYI22UTFQFKXSSSTXWBIFSLE5H7JOGP3A435Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379035553 (323h50m50.731820661s) [noise=true , address=77.90.31.14:4662 , piece_id=6EANR4YVRNF24RZE3HSJIB3TVEJQI2KCKTQWQ76QP5UAVCEGKZHA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379111616 (323h50m50.731896714s) [noise=true , address=77.90.31.15:4697 , piece_id=T6TMEMNWFPM34JROLTR7HF77SZY6S6YLSK2YBNELY5XIOAAV26CA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379290201 (323h50m50.732075309s) [noise=true , address=45.91.116.8:4047 , piece_id=K4JGAIX4MJFY3MVGHQCDDNT7Z2AUSDOKW7S5V5KFKFPYNMWHJW7A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379346777 (323h50m50.732131885s) [noise=true , address=45.91.116.5:4297 , piece_id=3VHITF6WV6XDY54VCC6FYYAZNFBVWZQRQW4OOSUOGEAXCBTJWZIQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.383413107 (323h50m50.736198204s) [noise=true , address=45.91.116.12:4227 , piece_id=N7S4SDFIJ7WYJXJGDIW3WZEV36LH77ZDRQ3IEMT26WHT2QCOHTWQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.386513151 (323h50m50.739298259s) [noise=true , address=145.79.227.14:4840 , piece_id=3HZCIAMPRCDC4OVO7CHGWU5P3H5ZCK326TZO5PTHU4XHRVY4OW5Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.466237594 (323h50m50.819022703s) [upload=285162]: Next returned nil segment
Sep 12 01:59:15.466247814 (323h50m50.819032922s) [upload=285162]: Waiting for error group managing segments...
Sep 12 01:59:15.484118391 (323h50m50.836903489s) [noise=true , address=145.79.227.2:4113 , piece_id=TZW66MNIECHLORJUTKASPIDXQ3YI5HGFF6ZNS6JM57E367J7BJ2A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:15.496496905 (323h50m50.849282013s) [noise=true , address=145.79.227.14:4840 , piece_id=3HZCIAMPRCDC4OVO7CHGWU5P3H5ZCK326TZO5PTHU4XHRVY4OW5Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:15.496623622 (323h50m50.84940873s) [noise=true , address=145.79.227.7:4293 , piece_id=S4OWYYNSUEXWKUNNC4B55LCRZWZ3LYDZ2NYHOZMSTJKDRSPQ674Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:37.850874528 (323h51m13.203659657s) [noise=true , address=77.90.31.15:4697 , piece_id=T6TMEMNWFPM34JROLTR7HF77SZY6S6YLSK2YBNELY5XIOAAV26CA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:40.290963073 (323h51m15.643748171s) [noise=true , address=45.91.116.12:4227 , piece_id=N7S4SDFIJ7WYJXJGDIW3WZEV36LH77ZDRQ3IEMT26WHT2QCOHTWQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:40.804126508 (323h51m16.156911635s) [noise=true , address=77.90.31.17:4770 , piece_id=LGERV2CLKEAG37DE7A7LRVKHU7HWNAAAKKETAHQLRFR7VKAXEK3Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:42.448883426 (323h51m17.801668564s) [noise=true , address=45.91.116.8:4047 , piece_id=K4JGAIX4MJFY3MVGHQCDDNT7Z2AUSDOKW7S5V5KFKFPYNMWHJW7A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:42.526900384 (323h51m17.879685513s) [noise=true , address=77.90.31.10:4519 , piece_id=MRSLI7YEDG5CPD2FBXKE55D5NG5AIOZST6NGRSKRLBLL23LTUGSA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:45.340332642 (323h51m20.69311775s) [noise=true , address=45.91.116.4:4939 , piece_id=AEHOROTNIH2HOK3I3IYBX6Z2O6EVJJ3X3XEVDSMLTUOEDQ4IDXSA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection; write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection
Sep 12 01:59:45.340383718 (323h51m20.693168826s) [noise=true , address=77.90.31.14:4662 , piece_id=6EANR4YVRNF24RZE3HSJIB3TVEJQI2KCKTQWQ76QP5UAVCEGKZHA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 5.161.89.252:48308->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 12 01:59:45.340392985 (323h51m20.693178093s) [noise=true , address=45.91.116.11:4119 , piece_id=E4B57AXXN47LWBROI56VNUOEEJGIUAG5HKSFAMVMWP6HY47MAX2A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection
Sep 12 01:59:45.340418192 (323h51m20.6932033s) [noise=true , address=45.91.116.4:4940 , piece_id=EMNBQXH7HWLUVVBITPOFLPN53PQCYJTLPRVUT26LGWFWDVSSCJOQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection; write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection
Sep 12 01:59:45.340452597 (323h51m20.693237695s) [noise=true , address=45.91.116.10:4082 , piece_id=24TTTULWU3PFF7EQWYL6PCY3KGLRAI54YE46GPO2OSPQK6MJVZ4Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection; write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection
Sep 12 01:59:45.340457857 (323h51m20.693242965s) [noise=true , address=45.91.116.12:4225 , piece_id=FFJGLRNIEZFTHTOEQAMTDXWSOSAT37Y5OMPXWJS35QJEPINFKNHA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection; write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection
Sep 12 01:59:45.340474879 (323h51m20.693259987s) [noise=true , address=45.91.116.9:4261 , piece_id=P4SJMKSGG7JDU2ZQYI22UTFQFKXSSSTXWBIFSLE5H7JOGP3A435Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection
Sep 12 01:59:45.340489676 (323h51m20.693274784s) [noise=true , address=45.91.116.5:4297 , piece_id=3VHITF6WV6XDY54VCC6FYYAZNFBVWZQRQW4OOSUOGEAXCBTJWZIQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection; write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection
Sep 12 01:59:45.340510295 (323h51m20.693295404s) [seg_pos={0 0}, upload=285162]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Sep 12 01:59:45.363290614 (323h51m20.716075722s) [upload=285162]: Done uploading segments...
Sep 12 01:59:45.363306744 (323h51m20.716091852s) [upload=285162]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 612.246115ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
437.296861ms
FAIL (2025-09-12 02:03:02 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
:59:15.378098034 (323h50m50.730883142s) [noise=true , address=45.91.116.4:4940 , piece_id=EMNBQXH7HWLUVVBITPOFLPN53PQCYJTLPRVUT26LGWFWDVSSCJOQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378123783 (323h50m50.730908891s) [noise=true , address=45.91.116.4:4939 , piece_id=AEHOROTNIH2HOK3I3IYBX6Z2O6EVJJ3X3XEVDSMLTUOEDQ4IDXSA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378309039 (323h50m50.731094138s) [noise=true , address=45.91.116.11:4119 , piece_id=E4B57AXXN47LWBROI56VNUOEEJGIUAG5HKSFAMVMWP6HY47MAX2A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378354746 (323h50m50.731139854s) [noise=true , address=145.79.227.7:4293 , piece_id=S4OWYYNSUEXWKUNNC4B55LCRZWZ3LYDZ2NYHOZMSTJKDRSPQ674Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378527370 (323h50m50.731312478s) [noise=true , address=145.79.227.2:4113 , piece_id=TZW66MNIECHLORJUTKASPIDXQ3YI5HGFF6ZNS6JM57E367J7BJ2A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378623882 (323h50m50.73140899s) [noise=true , address=45.91.116.10:4082 , piece_id=24TTTULWU3PFF7EQWYL6PCY3KGLRAI54YE46GPO2OSPQK6MJVZ4Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378809740 (323h50m50.731594838s) [noise=true , address=77.90.31.17:4770 , piece_id=LGERV2CLKEAG37DE7A7LRVKHU7HWNAAAKKETAHQLRFR7VKAXEK3Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378859052 (323h50m50.731644161s) [noise=true , address=45.91.116.9:4261 , piece_id=P4SJMKSGG7JDU2ZQYI22UTFQFKXSSSTXWBIFSLE5H7JOGP3A435Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379035553 (323h50m50.731820661s) [noise=true , address=77.90.31.14:4662 , piece_id=6EANR4YVRNF24RZE3HSJIB3TVEJQI2KCKTQWQ76QP5UAVCEGKZHA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379111616 (323h50m50.731896714s) [noise=true , address=77.90.31.15:4697 , piece_id=T6TMEMNWFPM34JROLTR7HF77SZY6S6YLSK2YBNELY5XIOAAV26CA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379290201 (323h50m50.732075309s) [noise=true , address=45.91.116.8:4047 , piece_id=K4JGAIX4MJFY3MVGHQCDDNT7Z2AUSDOKW7S5V5KFKFPYNMWHJW7A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379346777 (323h50m50.732131885s) [noise=true , address=45.91.116.5:4297 , piece_id=3VHITF6WV6XDY54VCC6FYYAZNFBVWZQRQW4OOSUOGEAXCBTJWZIQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.383413107 (323h50m50.736198204s) [noise=true , address=45.91.116.12:4227 , piece_id=N7S4SDFIJ7WYJXJGDIW3WZEV36LH77ZDRQ3IEMT26WHT2QCOHTWQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.386513151 (323h50m50.739298259s) [noise=true , address=145.79.227.14:4840 , piece_id=3HZCIAMPRCDC4OVO7CHGWU5P3H5ZCK326TZO5PTHU4XHRVY4OW5Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.466237594 (323h50m50.819022703s) [upload=285162]: Next returned nil segment
Sep 12 01:59:15.466247814 (323h50m50.819032922s) [upload=285162]: Waiting for error group managing segments...
Sep 12 01:59:15.484118391 (323h50m50.836903489s) [noise=true , address=145.79.227.2:4113 , piece_id=TZW66MNIECHLORJUTKASPIDXQ3YI5HGFF6ZNS6JM57E367J7BJ2A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:15.496496905 (323h50m50.849282013s) [noise=true , address=145.79.227.14:4840 , piece_id=3HZCIAMPRCDC4OVO7CHGWU5P3H5ZCK326TZO5PTHU4XHRVY4OW5Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:15.496623622 (323h50m50.84940873s) [noise=true , address=145.79.227.7:4293 , piece_id=S4OWYYNSUEXWKUNNC4B55LCRZWZ3LYDZ2NYHOZMSTJKDRSPQ674Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:37.850874528 (323h51m13.203659657s) [noise=true , address=77.90.31.15:4697 , piece_id=T6TMEMNWFPM34JROLTR7HF77SZY6S6YLSK2YBNELY5XIOAAV26CA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:40.290963073 (323h51m15.643748171s) [noise=true , address=45.91.116.12:4227 , piece_id=N7S4SDFIJ7WYJXJGDIW3WZEV36LH77ZDRQ3IEMT26WHT2QCOHTWQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:40.804126508 (323h51m16.156911635s) [noise=true , address=77.90.31.17:4770 , piece_id=LGERV2CLKEAG37DE7A7LRVKHU7HWNAAAKKETAHQLRFR7VKAXEK3Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:42.448883426 (323h51m17.801668564s) [noise=true , address=45.91.116.8:4047 , piece_id=K4JGAIX4MJFY3MVGHQCDDNT7Z2AUSDOKW7S5V5KFKFPYNMWHJW7A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:42.526900384 (323h51m17.879685513s) [noise=true , address=77.90.31.10:4519 , piece_id=MRSLI7YEDG5CPD2FBXKE55D5NG5AIOZST6NGRSKRLBLL23LTUGSA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:45.340332642 (323h51m20.69311775s) [noise=true , address=45.91.116.4:4939 , piece_id=AEHOROTNIH2HOK3I3IYBX6Z2O6EVJJ3X3XEVDSMLTUOEDQ4IDXSA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection; write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection
Sep 12 01:59:45.340383718 (323h51m20.693168826s) [noise=true , address=77.90.31.14:4662 , piece_id=6EANR4YVRNF24RZE3HSJIB3TVEJQI2KCKTQWQ76QP5UAVCEGKZHA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 5.161.89.252:48308->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 12 01:59:45.340392985 (323h51m20.693178093s) [noise=true , address=45.91.116.11:4119 , piece_id=E4B57AXXN47LWBROI56VNUOEEJGIUAG5HKSFAMVMWP6HY47MAX2A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection
Sep 12 01:59:45.340418192 (323h51m20.6932033s) [noise=true , address=45.91.116.4:4940 , piece_id=EMNBQXH7HWLUVVBITPOFLPN53PQCYJTLPRVUT26LGWFWDVSSCJOQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection; write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection
Sep 12 01:59:45.340452597 (323h51m20.693237695s) [noise=true , address=45.91.116.10:4082 , piece_id=24TTTULWU3PFF7EQWYL6PCY3KGLRAI54YE46GPO2OSPQK6MJVZ4Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection; write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection
Sep 12 01:59:45.340457857 (323h51m20.693242965s) [noise=true , address=45.91.116.12:4225 , piece_id=FFJGLRNIEZFTHTOEQAMTDXWSOSAT37Y5OMPXWJS35QJEPINFKNHA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection; write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection
Sep 12 01:59:45.340474879 (323h51m20.693259987s) [noise=true , address=45.91.116.9:4261 , piece_id=P4SJMKSGG7JDU2ZQYI22UTFQFKXSSSTXWBIFSLE5H7JOGP3A435Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection
Sep 12 01:59:45.340489676 (323h51m20.693274784s) [noise=true , address=45.91.116.5:4297 , piece_id=3VHITF6WV6XDY54VCC6FYYAZNFBVWZQRQW4OOSUOGEAXCBTJWZIQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection; write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection
Sep 12 01:59:45.340510295 (323h51m20.693295404s) [seg_pos={0 0}, upload=285162]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Sep 12 01:59:45.363290614 (323h51m20.716075722s) [upload=285162]: Done uploading segments...
Sep 12 01:59:45.363306744 (323h51m20.716091852s) [upload=285162]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 437.322519ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
430.225532ms
FAIL (2025-09-12 02:02:27 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
:59:15.378098034 (323h50m50.730883142s) [noise=true , address=45.91.116.4:4940 , piece_id=EMNBQXH7HWLUVVBITPOFLPN53PQCYJTLPRVUT26LGWFWDVSSCJOQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378123783 (323h50m50.730908891s) [noise=true , address=45.91.116.4:4939 , piece_id=AEHOROTNIH2HOK3I3IYBX6Z2O6EVJJ3X3XEVDSMLTUOEDQ4IDXSA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378309039 (323h50m50.731094138s) [noise=true , address=45.91.116.11:4119 , piece_id=E4B57AXXN47LWBROI56VNUOEEJGIUAG5HKSFAMVMWP6HY47MAX2A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378354746 (323h50m50.731139854s) [noise=true , address=145.79.227.7:4293 , piece_id=S4OWYYNSUEXWKUNNC4B55LCRZWZ3LYDZ2NYHOZMSTJKDRSPQ674Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378527370 (323h50m50.731312478s) [noise=true , address=145.79.227.2:4113 , piece_id=TZW66MNIECHLORJUTKASPIDXQ3YI5HGFF6ZNS6JM57E367J7BJ2A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378623882 (323h50m50.73140899s) [noise=true , address=45.91.116.10:4082 , piece_id=24TTTULWU3PFF7EQWYL6PCY3KGLRAI54YE46GPO2OSPQK6MJVZ4Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378809740 (323h50m50.731594838s) [noise=true , address=77.90.31.17:4770 , piece_id=LGERV2CLKEAG37DE7A7LRVKHU7HWNAAAKKETAHQLRFR7VKAXEK3Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378859052 (323h50m50.731644161s) [noise=true , address=45.91.116.9:4261 , piece_id=P4SJMKSGG7JDU2ZQYI22UTFQFKXSSSTXWBIFSLE5H7JOGP3A435Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379035553 (323h50m50.731820661s) [noise=true , address=77.90.31.14:4662 , piece_id=6EANR4YVRNF24RZE3HSJIB3TVEJQI2KCKTQWQ76QP5UAVCEGKZHA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379111616 (323h50m50.731896714s) [noise=true , address=77.90.31.15:4697 , piece_id=T6TMEMNWFPM34JROLTR7HF77SZY6S6YLSK2YBNELY5XIOAAV26CA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379290201 (323h50m50.732075309s) [noise=true , address=45.91.116.8:4047 , piece_id=K4JGAIX4MJFY3MVGHQCDDNT7Z2AUSDOKW7S5V5KFKFPYNMWHJW7A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379346777 (323h50m50.732131885s) [noise=true , address=45.91.116.5:4297 , piece_id=3VHITF6WV6XDY54VCC6FYYAZNFBVWZQRQW4OOSUOGEAXCBTJWZIQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.383413107 (323h50m50.736198204s) [noise=true , address=45.91.116.12:4227 , piece_id=N7S4SDFIJ7WYJXJGDIW3WZEV36LH77ZDRQ3IEMT26WHT2QCOHTWQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.386513151 (323h50m50.739298259s) [noise=true , address=145.79.227.14:4840 , piece_id=3HZCIAMPRCDC4OVO7CHGWU5P3H5ZCK326TZO5PTHU4XHRVY4OW5Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.466237594 (323h50m50.819022703s) [upload=285162]: Next returned nil segment
Sep 12 01:59:15.466247814 (323h50m50.819032922s) [upload=285162]: Waiting for error group managing segments...
Sep 12 01:59:15.484118391 (323h50m50.836903489s) [noise=true , address=145.79.227.2:4113 , piece_id=TZW66MNIECHLORJUTKASPIDXQ3YI5HGFF6ZNS6JM57E367J7BJ2A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:15.496496905 (323h50m50.849282013s) [noise=true , address=145.79.227.14:4840 , piece_id=3HZCIAMPRCDC4OVO7CHGWU5P3H5ZCK326TZO5PTHU4XHRVY4OW5Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:15.496623622 (323h50m50.84940873s) [noise=true , address=145.79.227.7:4293 , piece_id=S4OWYYNSUEXWKUNNC4B55LCRZWZ3LYDZ2NYHOZMSTJKDRSPQ674Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:37.850874528 (323h51m13.203659657s) [noise=true , address=77.90.31.15:4697 , piece_id=T6TMEMNWFPM34JROLTR7HF77SZY6S6YLSK2YBNELY5XIOAAV26CA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:40.290963073 (323h51m15.643748171s) [noise=true , address=45.91.116.12:4227 , piece_id=N7S4SDFIJ7WYJXJGDIW3WZEV36LH77ZDRQ3IEMT26WHT2QCOHTWQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:40.804126508 (323h51m16.156911635s) [noise=true , address=77.90.31.17:4770 , piece_id=LGERV2CLKEAG37DE7A7LRVKHU7HWNAAAKKETAHQLRFR7VKAXEK3Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:42.448883426 (323h51m17.801668564s) [noise=true , address=45.91.116.8:4047 , piece_id=K4JGAIX4MJFY3MVGHQCDDNT7Z2AUSDOKW7S5V5KFKFPYNMWHJW7A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:42.526900384 (323h51m17.879685513s) [noise=true , address=77.90.31.10:4519 , piece_id=MRSLI7YEDG5CPD2FBXKE55D5NG5AIOZST6NGRSKRLBLL23LTUGSA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:45.340332642 (323h51m20.69311775s) [noise=true , address=45.91.116.4:4939 , piece_id=AEHOROTNIH2HOK3I3IYBX6Z2O6EVJJ3X3XEVDSMLTUOEDQ4IDXSA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection; write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection
Sep 12 01:59:45.340383718 (323h51m20.693168826s) [noise=true , address=77.90.31.14:4662 , piece_id=6EANR4YVRNF24RZE3HSJIB3TVEJQI2KCKTQWQ76QP5UAVCEGKZHA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 5.161.89.252:48308->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 12 01:59:45.340392985 (323h51m20.693178093s) [noise=true , address=45.91.116.11:4119 , piece_id=E4B57AXXN47LWBROI56VNUOEEJGIUAG5HKSFAMVMWP6HY47MAX2A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection
Sep 12 01:59:45.340418192 (323h51m20.6932033s) [noise=true , address=45.91.116.4:4940 , piece_id=EMNBQXH7HWLUVVBITPOFLPN53PQCYJTLPRVUT26LGWFWDVSSCJOQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection; write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection
Sep 12 01:59:45.340452597 (323h51m20.693237695s) [noise=true , address=45.91.116.10:4082 , piece_id=24TTTULWU3PFF7EQWYL6PCY3KGLRAI54YE46GPO2OSPQK6MJVZ4Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection; write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection
Sep 12 01:59:45.340457857 (323h51m20.693242965s) [noise=true , address=45.91.116.12:4225 , piece_id=FFJGLRNIEZFTHTOEQAMTDXWSOSAT37Y5OMPXWJS35QJEPINFKNHA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection; write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection
Sep 12 01:59:45.340474879 (323h51m20.693259987s) [noise=true , address=45.91.116.9:4261 , piece_id=P4SJMKSGG7JDU2ZQYI22UTFQFKXSSSTXWBIFSLE5H7JOGP3A435Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection
Sep 12 01:59:45.340489676 (323h51m20.693274784s) [noise=true , address=45.91.116.5:4297 , piece_id=3VHITF6WV6XDY54VCC6FYYAZNFBVWZQRQW4OOSUOGEAXCBTJWZIQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection; write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection
Sep 12 01:59:45.340510295 (323h51m20.693295404s) [seg_pos={0 0}, upload=285162]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Sep 12 01:59:45.363290614 (323h51m20.716075722s) [upload=285162]: Done uploading segments...
Sep 12 01:59:45.363306744 (323h51m20.716091852s) [upload=285162]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 430.252864ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
700.178795ms
FAIL (2025-09-12 02:02:06 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
:59:15.378098034 (323h50m50.730883142s) [noise=true , address=45.91.116.4:4940 , piece_id=EMNBQXH7HWLUVVBITPOFLPN53PQCYJTLPRVUT26LGWFWDVSSCJOQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378123783 (323h50m50.730908891s) [noise=true , address=45.91.116.4:4939 , piece_id=AEHOROTNIH2HOK3I3IYBX6Z2O6EVJJ3X3XEVDSMLTUOEDQ4IDXSA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378309039 (323h50m50.731094138s) [noise=true , address=45.91.116.11:4119 , piece_id=E4B57AXXN47LWBROI56VNUOEEJGIUAG5HKSFAMVMWP6HY47MAX2A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378354746 (323h50m50.731139854s) [noise=true , address=145.79.227.7:4293 , piece_id=S4OWYYNSUEXWKUNNC4B55LCRZWZ3LYDZ2NYHOZMSTJKDRSPQ674Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378527370 (323h50m50.731312478s) [noise=true , address=145.79.227.2:4113 , piece_id=TZW66MNIECHLORJUTKASPIDXQ3YI5HGFF6ZNS6JM57E367J7BJ2A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378623882 (323h50m50.73140899s) [noise=true , address=45.91.116.10:4082 , piece_id=24TTTULWU3PFF7EQWYL6PCY3KGLRAI54YE46GPO2OSPQK6MJVZ4Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378809740 (323h50m50.731594838s) [noise=true , address=77.90.31.17:4770 , piece_id=LGERV2CLKEAG37DE7A7LRVKHU7HWNAAAKKETAHQLRFR7VKAXEK3Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378859052 (323h50m50.731644161s) [noise=true , address=45.91.116.9:4261 , piece_id=P4SJMKSGG7JDU2ZQYI22UTFQFKXSSSTXWBIFSLE5H7JOGP3A435Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379035553 (323h50m50.731820661s) [noise=true , address=77.90.31.14:4662 , piece_id=6EANR4YVRNF24RZE3HSJIB3TVEJQI2KCKTQWQ76QP5UAVCEGKZHA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379111616 (323h50m50.731896714s) [noise=true , address=77.90.31.15:4697 , piece_id=T6TMEMNWFPM34JROLTR7HF77SZY6S6YLSK2YBNELY5XIOAAV26CA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379290201 (323h50m50.732075309s) [noise=true , address=45.91.116.8:4047 , piece_id=K4JGAIX4MJFY3MVGHQCDDNT7Z2AUSDOKW7S5V5KFKFPYNMWHJW7A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379346777 (323h50m50.732131885s) [noise=true , address=45.91.116.5:4297 , piece_id=3VHITF6WV6XDY54VCC6FYYAZNFBVWZQRQW4OOSUOGEAXCBTJWZIQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.383413107 (323h50m50.736198204s) [noise=true , address=45.91.116.12:4227 , piece_id=N7S4SDFIJ7WYJXJGDIW3WZEV36LH77ZDRQ3IEMT26WHT2QCOHTWQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.386513151 (323h50m50.739298259s) [noise=true , address=145.79.227.14:4840 , piece_id=3HZCIAMPRCDC4OVO7CHGWU5P3H5ZCK326TZO5PTHU4XHRVY4OW5Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.466237594 (323h50m50.819022703s) [upload=285162]: Next returned nil segment
Sep 12 01:59:15.466247814 (323h50m50.819032922s) [upload=285162]: Waiting for error group managing segments...
Sep 12 01:59:15.484118391 (323h50m50.836903489s) [noise=true , address=145.79.227.2:4113 , piece_id=TZW66MNIECHLORJUTKASPIDXQ3YI5HGFF6ZNS6JM57E367J7BJ2A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:15.496496905 (323h50m50.849282013s) [noise=true , address=145.79.227.14:4840 , piece_id=3HZCIAMPRCDC4OVO7CHGWU5P3H5ZCK326TZO5PTHU4XHRVY4OW5Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:15.496623622 (323h50m50.84940873s) [noise=true , address=145.79.227.7:4293 , piece_id=S4OWYYNSUEXWKUNNC4B55LCRZWZ3LYDZ2NYHOZMSTJKDRSPQ674Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:37.850874528 (323h51m13.203659657s) [noise=true , address=77.90.31.15:4697 , piece_id=T6TMEMNWFPM34JROLTR7HF77SZY6S6YLSK2YBNELY5XIOAAV26CA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:40.290963073 (323h51m15.643748171s) [noise=true , address=45.91.116.12:4227 , piece_id=N7S4SDFIJ7WYJXJGDIW3WZEV36LH77ZDRQ3IEMT26WHT2QCOHTWQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:40.804126508 (323h51m16.156911635s) [noise=true , address=77.90.31.17:4770 , piece_id=LGERV2CLKEAG37DE7A7LRVKHU7HWNAAAKKETAHQLRFR7VKAXEK3Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:42.448883426 (323h51m17.801668564s) [noise=true , address=45.91.116.8:4047 , piece_id=K4JGAIX4MJFY3MVGHQCDDNT7Z2AUSDOKW7S5V5KFKFPYNMWHJW7A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:42.526900384 (323h51m17.879685513s) [noise=true , address=77.90.31.10:4519 , piece_id=MRSLI7YEDG5CPD2FBXKE55D5NG5AIOZST6NGRSKRLBLL23LTUGSA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:45.340332642 (323h51m20.69311775s) [noise=true , address=45.91.116.4:4939 , piece_id=AEHOROTNIH2HOK3I3IYBX6Z2O6EVJJ3X3XEVDSMLTUOEDQ4IDXSA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection; write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection
Sep 12 01:59:45.340383718 (323h51m20.693168826s) [noise=true , address=77.90.31.14:4662 , piece_id=6EANR4YVRNF24RZE3HSJIB3TVEJQI2KCKTQWQ76QP5UAVCEGKZHA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 5.161.89.252:48308->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 12 01:59:45.340392985 (323h51m20.693178093s) [noise=true , address=45.91.116.11:4119 , piece_id=E4B57AXXN47LWBROI56VNUOEEJGIUAG5HKSFAMVMWP6HY47MAX2A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection
Sep 12 01:59:45.340418192 (323h51m20.6932033s) [noise=true , address=45.91.116.4:4940 , piece_id=EMNBQXH7HWLUVVBITPOFLPN53PQCYJTLPRVUT26LGWFWDVSSCJOQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection; write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection
Sep 12 01:59:45.340452597 (323h51m20.693237695s) [noise=true , address=45.91.116.10:4082 , piece_id=24TTTULWU3PFF7EQWYL6PCY3KGLRAI54YE46GPO2OSPQK6MJVZ4Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection; write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection
Sep 12 01:59:45.340457857 (323h51m20.693242965s) [noise=true , address=45.91.116.12:4225 , piece_id=FFJGLRNIEZFTHTOEQAMTDXWSOSAT37Y5OMPXWJS35QJEPINFKNHA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection; write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection
Sep 12 01:59:45.340474879 (323h51m20.693259987s) [noise=true , address=45.91.116.9:4261 , piece_id=P4SJMKSGG7JDU2ZQYI22UTFQFKXSSSTXWBIFSLE5H7JOGP3A435Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection
Sep 12 01:59:45.340489676 (323h51m20.693274784s) [noise=true , address=45.91.116.5:4297 , piece_id=3VHITF6WV6XDY54VCC6FYYAZNFBVWZQRQW4OOSUOGEAXCBTJWZIQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection; write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection
Sep 12 01:59:45.340510295 (323h51m20.693295404s) [seg_pos={0 0}, upload=285162]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Sep 12 01:59:45.363290614 (323h51m20.716075722s) [upload=285162]: Done uploading segments...
Sep 12 01:59:45.363306744 (323h51m20.716091852s) [upload=285162]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 700.202911ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
407.299097ms
FAIL (2025-09-12 02:01:46 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
:59:15.378098034 (323h50m50.730883142s) [noise=true , address=45.91.116.4:4940 , piece_id=EMNBQXH7HWLUVVBITPOFLPN53PQCYJTLPRVUT26LGWFWDVSSCJOQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378123783 (323h50m50.730908891s) [noise=true , address=45.91.116.4:4939 , piece_id=AEHOROTNIH2HOK3I3IYBX6Z2O6EVJJ3X3XEVDSMLTUOEDQ4IDXSA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378309039 (323h50m50.731094138s) [noise=true , address=45.91.116.11:4119 , piece_id=E4B57AXXN47LWBROI56VNUOEEJGIUAG5HKSFAMVMWP6HY47MAX2A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378354746 (323h50m50.731139854s) [noise=true , address=145.79.227.7:4293 , piece_id=S4OWYYNSUEXWKUNNC4B55LCRZWZ3LYDZ2NYHOZMSTJKDRSPQ674Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378527370 (323h50m50.731312478s) [noise=true , address=145.79.227.2:4113 , piece_id=TZW66MNIECHLORJUTKASPIDXQ3YI5HGFF6ZNS6JM57E367J7BJ2A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378623882 (323h50m50.73140899s) [noise=true , address=45.91.116.10:4082 , piece_id=24TTTULWU3PFF7EQWYL6PCY3KGLRAI54YE46GPO2OSPQK6MJVZ4Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378809740 (323h50m50.731594838s) [noise=true , address=77.90.31.17:4770 , piece_id=LGERV2CLKEAG37DE7A7LRVKHU7HWNAAAKKETAHQLRFR7VKAXEK3Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378859052 (323h50m50.731644161s) [noise=true , address=45.91.116.9:4261 , piece_id=P4SJMKSGG7JDU2ZQYI22UTFQFKXSSSTXWBIFSLE5H7JOGP3A435Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379035553 (323h50m50.731820661s) [noise=true , address=77.90.31.14:4662 , piece_id=6EANR4YVRNF24RZE3HSJIB3TVEJQI2KCKTQWQ76QP5UAVCEGKZHA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379111616 (323h50m50.731896714s) [noise=true , address=77.90.31.15:4697 , piece_id=T6TMEMNWFPM34JROLTR7HF77SZY6S6YLSK2YBNELY5XIOAAV26CA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379290201 (323h50m50.732075309s) [noise=true , address=45.91.116.8:4047 , piece_id=K4JGAIX4MJFY3MVGHQCDDNT7Z2AUSDOKW7S5V5KFKFPYNMWHJW7A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379346777 (323h50m50.732131885s) [noise=true , address=45.91.116.5:4297 , piece_id=3VHITF6WV6XDY54VCC6FYYAZNFBVWZQRQW4OOSUOGEAXCBTJWZIQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.383413107 (323h50m50.736198204s) [noise=true , address=45.91.116.12:4227 , piece_id=N7S4SDFIJ7WYJXJGDIW3WZEV36LH77ZDRQ3IEMT26WHT2QCOHTWQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.386513151 (323h50m50.739298259s) [noise=true , address=145.79.227.14:4840 , piece_id=3HZCIAMPRCDC4OVO7CHGWU5P3H5ZCK326TZO5PTHU4XHRVY4OW5Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.466237594 (323h50m50.819022703s) [upload=285162]: Next returned nil segment
Sep 12 01:59:15.466247814 (323h50m50.819032922s) [upload=285162]: Waiting for error group managing segments...
Sep 12 01:59:15.484118391 (323h50m50.836903489s) [noise=true , address=145.79.227.2:4113 , piece_id=TZW66MNIECHLORJUTKASPIDXQ3YI5HGFF6ZNS6JM57E367J7BJ2A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:15.496496905 (323h50m50.849282013s) [noise=true , address=145.79.227.14:4840 , piece_id=3HZCIAMPRCDC4OVO7CHGWU5P3H5ZCK326TZO5PTHU4XHRVY4OW5Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:15.496623622 (323h50m50.84940873s) [noise=true , address=145.79.227.7:4293 , piece_id=S4OWYYNSUEXWKUNNC4B55LCRZWZ3LYDZ2NYHOZMSTJKDRSPQ674Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:37.850874528 (323h51m13.203659657s) [noise=true , address=77.90.31.15:4697 , piece_id=T6TMEMNWFPM34JROLTR7HF77SZY6S6YLSK2YBNELY5XIOAAV26CA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:40.290963073 (323h51m15.643748171s) [noise=true , address=45.91.116.12:4227 , piece_id=N7S4SDFIJ7WYJXJGDIW3WZEV36LH77ZDRQ3IEMT26WHT2QCOHTWQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:40.804126508 (323h51m16.156911635s) [noise=true , address=77.90.31.17:4770 , piece_id=LGERV2CLKEAG37DE7A7LRVKHU7HWNAAAKKETAHQLRFR7VKAXEK3Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:42.448883426 (323h51m17.801668564s) [noise=true , address=45.91.116.8:4047 , piece_id=K4JGAIX4MJFY3MVGHQCDDNT7Z2AUSDOKW7S5V5KFKFPYNMWHJW7A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:42.526900384 (323h51m17.879685513s) [noise=true , address=77.90.31.10:4519 , piece_id=MRSLI7YEDG5CPD2FBXKE55D5NG5AIOZST6NGRSKRLBLL23LTUGSA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:45.340332642 (323h51m20.69311775s) [noise=true , address=45.91.116.4:4939 , piece_id=AEHOROTNIH2HOK3I3IYBX6Z2O6EVJJ3X3XEVDSMLTUOEDQ4IDXSA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection; write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection
Sep 12 01:59:45.340383718 (323h51m20.693168826s) [noise=true , address=77.90.31.14:4662 , piece_id=6EANR4YVRNF24RZE3HSJIB3TVEJQI2KCKTQWQ76QP5UAVCEGKZHA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 5.161.89.252:48308->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 12 01:59:45.340392985 (323h51m20.693178093s) [noise=true , address=45.91.116.11:4119 , piece_id=E4B57AXXN47LWBROI56VNUOEEJGIUAG5HKSFAMVMWP6HY47MAX2A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection
Sep 12 01:59:45.340418192 (323h51m20.6932033s) [noise=true , address=45.91.116.4:4940 , piece_id=EMNBQXH7HWLUVVBITPOFLPN53PQCYJTLPRVUT26LGWFWDVSSCJOQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection; write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection
Sep 12 01:59:45.340452597 (323h51m20.693237695s) [noise=true , address=45.91.116.10:4082 , piece_id=24TTTULWU3PFF7EQWYL6PCY3KGLRAI54YE46GPO2OSPQK6MJVZ4Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection; write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection
Sep 12 01:59:45.340457857 (323h51m20.693242965s) [noise=true , address=45.91.116.12:4225 , piece_id=FFJGLRNIEZFTHTOEQAMTDXWSOSAT37Y5OMPXWJS35QJEPINFKNHA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection; write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection
Sep 12 01:59:45.340474879 (323h51m20.693259987s) [noise=true , address=45.91.116.9:4261 , piece_id=P4SJMKSGG7JDU2ZQYI22UTFQFKXSSSTXWBIFSLE5H7JOGP3A435Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection
Sep 12 01:59:45.340489676 (323h51m20.693274784s) [noise=true , address=45.91.116.5:4297 , piece_id=3VHITF6WV6XDY54VCC6FYYAZNFBVWZQRQW4OOSUOGEAXCBTJWZIQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection; write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection
Sep 12 01:59:45.340510295 (323h51m20.693295404s) [seg_pos={0 0}, upload=285162]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Sep 12 01:59:45.363290614 (323h51m20.716075722s) [upload=285162]: Done uploading segments...
Sep 12 01:59:45.363306744 (323h51m20.716091852s) [upload=285162]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 407.315158ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
633.547177ms
FAIL (2025-09-12 02:00:43 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
:59:15.378098034 (323h50m50.730883142s) [noise=true , address=45.91.116.4:4940 , piece_id=EMNBQXH7HWLUVVBITPOFLPN53PQCYJTLPRVUT26LGWFWDVSSCJOQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378123783 (323h50m50.730908891s) [noise=true , address=45.91.116.4:4939 , piece_id=AEHOROTNIH2HOK3I3IYBX6Z2O6EVJJ3X3XEVDSMLTUOEDQ4IDXSA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378309039 (323h50m50.731094138s) [noise=true , address=45.91.116.11:4119 , piece_id=E4B57AXXN47LWBROI56VNUOEEJGIUAG5HKSFAMVMWP6HY47MAX2A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378354746 (323h50m50.731139854s) [noise=true , address=145.79.227.7:4293 , piece_id=S4OWYYNSUEXWKUNNC4B55LCRZWZ3LYDZ2NYHOZMSTJKDRSPQ674Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378527370 (323h50m50.731312478s) [noise=true , address=145.79.227.2:4113 , piece_id=TZW66MNIECHLORJUTKASPIDXQ3YI5HGFF6ZNS6JM57E367J7BJ2A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378623882 (323h50m50.73140899s) [noise=true , address=45.91.116.10:4082 , piece_id=24TTTULWU3PFF7EQWYL6PCY3KGLRAI54YE46GPO2OSPQK6MJVZ4Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378809740 (323h50m50.731594838s) [noise=true , address=77.90.31.17:4770 , piece_id=LGERV2CLKEAG37DE7A7LRVKHU7HWNAAAKKETAHQLRFR7VKAXEK3Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378859052 (323h50m50.731644161s) [noise=true , address=45.91.116.9:4261 , piece_id=P4SJMKSGG7JDU2ZQYI22UTFQFKXSSSTXWBIFSLE5H7JOGP3A435Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379035553 (323h50m50.731820661s) [noise=true , address=77.90.31.14:4662 , piece_id=6EANR4YVRNF24RZE3HSJIB3TVEJQI2KCKTQWQ76QP5UAVCEGKZHA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379111616 (323h50m50.731896714s) [noise=true , address=77.90.31.15:4697 , piece_id=T6TMEMNWFPM34JROLTR7HF77SZY6S6YLSK2YBNELY5XIOAAV26CA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379290201 (323h50m50.732075309s) [noise=true , address=45.91.116.8:4047 , piece_id=K4JGAIX4MJFY3MVGHQCDDNT7Z2AUSDOKW7S5V5KFKFPYNMWHJW7A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379346777 (323h50m50.732131885s) [noise=true , address=45.91.116.5:4297 , piece_id=3VHITF6WV6XDY54VCC6FYYAZNFBVWZQRQW4OOSUOGEAXCBTJWZIQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.383413107 (323h50m50.736198204s) [noise=true , address=45.91.116.12:4227 , piece_id=N7S4SDFIJ7WYJXJGDIW3WZEV36LH77ZDRQ3IEMT26WHT2QCOHTWQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.386513151 (323h50m50.739298259s) [noise=true , address=145.79.227.14:4840 , piece_id=3HZCIAMPRCDC4OVO7CHGWU5P3H5ZCK326TZO5PTHU4XHRVY4OW5Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.466237594 (323h50m50.819022703s) [upload=285162]: Next returned nil segment
Sep 12 01:59:15.466247814 (323h50m50.819032922s) [upload=285162]: Waiting for error group managing segments...
Sep 12 01:59:15.484118391 (323h50m50.836903489s) [noise=true , address=145.79.227.2:4113 , piece_id=TZW66MNIECHLORJUTKASPIDXQ3YI5HGFF6ZNS6JM57E367J7BJ2A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:15.496496905 (323h50m50.849282013s) [noise=true , address=145.79.227.14:4840 , piece_id=3HZCIAMPRCDC4OVO7CHGWU5P3H5ZCK326TZO5PTHU4XHRVY4OW5Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:15.496623622 (323h50m50.84940873s) [noise=true , address=145.79.227.7:4293 , piece_id=S4OWYYNSUEXWKUNNC4B55LCRZWZ3LYDZ2NYHOZMSTJKDRSPQ674Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:37.850874528 (323h51m13.203659657s) [noise=true , address=77.90.31.15:4697 , piece_id=T6TMEMNWFPM34JROLTR7HF77SZY6S6YLSK2YBNELY5XIOAAV26CA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:40.290963073 (323h51m15.643748171s) [noise=true , address=45.91.116.12:4227 , piece_id=N7S4SDFIJ7WYJXJGDIW3WZEV36LH77ZDRQ3IEMT26WHT2QCOHTWQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:40.804126508 (323h51m16.156911635s) [noise=true , address=77.90.31.17:4770 , piece_id=LGERV2CLKEAG37DE7A7LRVKHU7HWNAAAKKETAHQLRFR7VKAXEK3Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:42.448883426 (323h51m17.801668564s) [noise=true , address=45.91.116.8:4047 , piece_id=K4JGAIX4MJFY3MVGHQCDDNT7Z2AUSDOKW7S5V5KFKFPYNMWHJW7A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:42.526900384 (323h51m17.879685513s) [noise=true , address=77.90.31.10:4519 , piece_id=MRSLI7YEDG5CPD2FBXKE55D5NG5AIOZST6NGRSKRLBLL23LTUGSA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:45.340332642 (323h51m20.69311775s) [noise=true , address=45.91.116.4:4939 , piece_id=AEHOROTNIH2HOK3I3IYBX6Z2O6EVJJ3X3XEVDSMLTUOEDQ4IDXSA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection; write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection
Sep 12 01:59:45.340383718 (323h51m20.693168826s) [noise=true , address=77.90.31.14:4662 , piece_id=6EANR4YVRNF24RZE3HSJIB3TVEJQI2KCKTQWQ76QP5UAVCEGKZHA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 5.161.89.252:48308->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 12 01:59:45.340392985 (323h51m20.693178093s) [noise=true , address=45.91.116.11:4119 , piece_id=E4B57AXXN47LWBROI56VNUOEEJGIUAG5HKSFAMVMWP6HY47MAX2A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection
Sep 12 01:59:45.340418192 (323h51m20.6932033s) [noise=true , address=45.91.116.4:4940 , piece_id=EMNBQXH7HWLUVVBITPOFLPN53PQCYJTLPRVUT26LGWFWDVSSCJOQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection; write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection
Sep 12 01:59:45.340452597 (323h51m20.693237695s) [noise=true , address=45.91.116.10:4082 , piece_id=24TTTULWU3PFF7EQWYL6PCY3KGLRAI54YE46GPO2OSPQK6MJVZ4Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection; write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection
Sep 12 01:59:45.340457857 (323h51m20.693242965s) [noise=true , address=45.91.116.12:4225 , piece_id=FFJGLRNIEZFTHTOEQAMTDXWSOSAT37Y5OMPXWJS35QJEPINFKNHA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection; write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection
Sep 12 01:59:45.340474879 (323h51m20.693259987s) [noise=true , address=45.91.116.9:4261 , piece_id=P4SJMKSGG7JDU2ZQYI22UTFQFKXSSSTXWBIFSLE5H7JOGP3A435Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection
Sep 12 01:59:45.340489676 (323h51m20.693274784s) [noise=true , address=45.91.116.5:4297 , piece_id=3VHITF6WV6XDY54VCC6FYYAZNFBVWZQRQW4OOSUOGEAXCBTJWZIQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection; write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection
Sep 12 01:59:45.340510295 (323h51m20.693295404s) [seg_pos={0 0}, upload=285162]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Sep 12 01:59:45.363290614 (323h51m20.716075722s) [upload=285162]: Done uploading segments...
Sep 12 01:59:45.363306744 (323h51m20.716091852s) [upload=285162]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 633.573246ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
367.335214ms
FAIL (2025-09-12 01:59:45 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
:59:15.378098034 (323h50m50.730883142s) [noise=true , address=45.91.116.4:4940 , piece_id=EMNBQXH7HWLUVVBITPOFLPN53PQCYJTLPRVUT26LGWFWDVSSCJOQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378123783 (323h50m50.730908891s) [noise=true , address=45.91.116.4:4939 , piece_id=AEHOROTNIH2HOK3I3IYBX6Z2O6EVJJ3X3XEVDSMLTUOEDQ4IDXSA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378309039 (323h50m50.731094138s) [noise=true , address=45.91.116.11:4119 , piece_id=E4B57AXXN47LWBROI56VNUOEEJGIUAG5HKSFAMVMWP6HY47MAX2A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378354746 (323h50m50.731139854s) [noise=true , address=145.79.227.7:4293 , piece_id=S4OWYYNSUEXWKUNNC4B55LCRZWZ3LYDZ2NYHOZMSTJKDRSPQ674Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378527370 (323h50m50.731312478s) [noise=true , address=145.79.227.2:4113 , piece_id=TZW66MNIECHLORJUTKASPIDXQ3YI5HGFF6ZNS6JM57E367J7BJ2A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378623882 (323h50m50.73140899s) [noise=true , address=45.91.116.10:4082 , piece_id=24TTTULWU3PFF7EQWYL6PCY3KGLRAI54YE46GPO2OSPQK6MJVZ4Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378809740 (323h50m50.731594838s) [noise=true , address=77.90.31.17:4770 , piece_id=LGERV2CLKEAG37DE7A7LRVKHU7HWNAAAKKETAHQLRFR7VKAXEK3Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.378859052 (323h50m50.731644161s) [noise=true , address=45.91.116.9:4261 , piece_id=P4SJMKSGG7JDU2ZQYI22UTFQFKXSSSTXWBIFSLE5H7JOGP3A435Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379035553 (323h50m50.731820661s) [noise=true , address=77.90.31.14:4662 , piece_id=6EANR4YVRNF24RZE3HSJIB3TVEJQI2KCKTQWQ76QP5UAVCEGKZHA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379111616 (323h50m50.731896714s) [noise=true , address=77.90.31.15:4697 , piece_id=T6TMEMNWFPM34JROLTR7HF77SZY6S6YLSK2YBNELY5XIOAAV26CA, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379290201 (323h50m50.732075309s) [noise=true , address=45.91.116.8:4047 , piece_id=K4JGAIX4MJFY3MVGHQCDDNT7Z2AUSDOKW7S5V5KFKFPYNMWHJW7A, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.379346777 (323h50m50.732131885s) [noise=true , address=45.91.116.5:4297 , piece_id=3VHITF6WV6XDY54VCC6FYYAZNFBVWZQRQW4OOSUOGEAXCBTJWZIQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.383413107 (323h50m50.736198204s) [noise=true , address=45.91.116.12:4227 , piece_id=N7S4SDFIJ7WYJXJGDIW3WZEV36LH77ZDRQ3IEMT26WHT2QCOHTWQ, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.386513151 (323h50m50.739298259s) [noise=true , address=145.79.227.14:4840 , piece_id=3HZCIAMPRCDC4OVO7CHGWU5P3H5ZCK326TZO5PTHU4XHRVY4OW5Q, seg_pos={0 0}, upload=285162]: Uploading piece...
Sep 12 01:59:15.466237594 (323h50m50.819022703s) [upload=285162]: Next returned nil segment
Sep 12 01:59:15.466247814 (323h50m50.819032922s) [upload=285162]: Waiting for error group managing segments...
Sep 12 01:59:15.484118391 (323h50m50.836903489s) [noise=true , address=145.79.227.2:4113 , piece_id=TZW66MNIECHLORJUTKASPIDXQ3YI5HGFF6ZNS6JM57E367J7BJ2A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:15.496496905 (323h50m50.849282013s) [noise=true , address=145.79.227.14:4840 , piece_id=3HZCIAMPRCDC4OVO7CHGWU5P3H5ZCK326TZO5PTHU4XHRVY4OW5Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:15.496623622 (323h50m50.84940873s) [noise=true , address=145.79.227.7:4293 , piece_id=S4OWYYNSUEXWKUNNC4B55LCRZWZ3LYDZ2NYHOZMSTJKDRSPQ674Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:37.850874528 (323h51m13.203659657s) [noise=true , address=77.90.31.15:4697 , piece_id=T6TMEMNWFPM34JROLTR7HF77SZY6S6YLSK2YBNELY5XIOAAV26CA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:40.290963073 (323h51m15.643748171s) [noise=true , address=45.91.116.12:4227 , piece_id=N7S4SDFIJ7WYJXJGDIW3WZEV36LH77ZDRQ3IEMT26WHT2QCOHTWQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:40.804126508 (323h51m16.156911635s) [noise=true , address=77.90.31.17:4770 , piece_id=LGERV2CLKEAG37DE7A7LRVKHU7HWNAAAKKETAHQLRFR7VKAXEK3Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:42.448883426 (323h51m17.801668564s) [noise=true , address=45.91.116.8:4047 , piece_id=K4JGAIX4MJFY3MVGHQCDDNT7Z2AUSDOKW7S5V5KFKFPYNMWHJW7A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:42.526900384 (323h51m17.879685513s) [noise=true , address=77.90.31.10:4519 , piece_id=MRSLI7YEDG5CPD2FBXKE55D5NG5AIOZST6NGRSKRLBLL23LTUGSA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: <nil>
Sep 12 01:59:45.340332642 (323h51m20.69311775s) [noise=true , address=45.91.116.4:4939 , piece_id=AEHOROTNIH2HOK3I3IYBX6Z2O6EVJJ3X3XEVDSMLTUOEDQ4IDXSA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection; write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:31698->45.91.116.4:4939: use of closed network connection
Sep 12 01:59:45.340383718 (323h51m20.693168826s) [noise=true , address=77.90.31.14:4662 , piece_id=6EANR4YVRNF24RZE3HSJIB3TVEJQI2KCKTQWQ76QP5UAVCEGKZHA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: read tcp 5.161.89.252:48308->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Sep 12 01:59:45.340392985 (323h51m20.693178093s) [noise=true , address=45.91.116.11:4119 , piece_id=E4B57AXXN47LWBROI56VNUOEEJGIUAG5HKSFAMVMWP6HY47MAX2A, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:41058->45.91.116.11:4119: use of closed network connection
Sep 12 01:59:45.340418192 (323h51m20.6932033s) [noise=true , address=45.91.116.4:4940 , piece_id=EMNBQXH7HWLUVVBITPOFLPN53PQCYJTLPRVUT26LGWFWDVSSCJOQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection; write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:23972->45.91.116.4:4940: use of closed network connection
Sep 12 01:59:45.340452597 (323h51m20.693237695s) [noise=true , address=45.91.116.10:4082 , piece_id=24TTTULWU3PFF7EQWYL6PCY3KGLRAI54YE46GPO2OSPQK6MJVZ4Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection; write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:57330->45.91.116.10:4082: use of closed network connection
Sep 12 01:59:45.340457857 (323h51m20.693242965s) [noise=true , address=45.91.116.12:4225 , piece_id=FFJGLRNIEZFTHTOEQAMTDXWSOSAT37Y5OMPXWJS35QJEPINFKNHA, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection; write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12974->45.91.116.12:4225: use of closed network connection
Sep 12 01:59:45.340474879 (323h51m20.693259987s) [noise=true , address=45.91.116.9:4261 , piece_id=P4SJMKSGG7JDU2ZQYI22UTFQFKXSSSTXWBIFSLE5H7JOGP3A435Q, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53556->45.91.116.9:4261: use of closed network connection
Sep 12 01:59:45.340489676 (323h51m20.693274784s) [noise=true , address=45.91.116.5:4297 , piece_id=3VHITF6WV6XDY54VCC6FYYAZNFBVWZQRQW4OOSUOGEAXCBTJWZIQ, seg_pos={0 0}, upload=285162]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection; write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63834->45.91.116.5:4297: use of closed network connection
Sep 12 01:59:45.340510295 (323h51m20.693295404s) [seg_pos={0 0}, upload=285162]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Sep 12 01:59:45.363290614 (323h51m20.716075722s) [upload=285162]: Done uploading segments...
Sep 12 01:59:45.363306744 (323h51m20.716091852s) [upload=285162]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 367.349652ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
434.405349ms
FAIL (2025-09-11 22:36:22 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 434.427261ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
644.372658ms
FAIL (2025-09-11 22:35:21 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 644.392515ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
512.213324ms
FAIL (2025-09-11 22:35:05 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 512.233833ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [X..X........................................................] duration:
512.512655ms
FAIL (2025-09-11 22:34:47 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 512.561557ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [XX..X.......................................................] duration:
492.731732ms
FAIL (2025-09-11 22:33:55 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 492.799598ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [XXX..X......................................................] duration:
522.963408ms
FAIL (2025-09-11 22:33:19 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 522.987763ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
5 out of 60 is failed (threshold=3) [XXXX..X.....................................................] duration:
984.177802ms
FAIL (2025-09-11 22:32:12 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 984.197419ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
6 out of 60 is failed (threshold=3) [XXXXX..X....................................................] duration:
636.714296ms
FAIL (2025-09-11 22:31:43 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 636.736038ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
885.926415ms
FAIL (2025-09-11 22:31:18 UTC)
orbiter warning: context deadline exceeded
Duration: 885.948587ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [XX..........................................................] duration:
725.791872ms
FAIL (2025-09-11 22:30:32 UTC)
orbiter warning: context deadline exceeded
Duration: 725.809616ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
7 out of 60 is failed (threshold=3) [XXXXXX..X...................................................] duration:
676.30968ms
FAIL (2025-09-11 22:30:31 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 676.333104ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
8 out of 60 is failed (threshold=3) [XXXXXXX..X..................................................] duration:
977.854232ms
FAIL (2025-09-11 22:29:53 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 977.876803ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.XX.........................................................] duration:
846.966842ms
FAIL (2025-09-11 22:29:32 UTC)
orbiter warning: context deadline exceeded
Duration: 846.99153ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
8 out of 60 is failed (threshold=3) [.XXXXXXX..X.................................................] duration:
530.898283ms
FAIL (2025-09-11 22:29:22 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 530.915765ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [..XX........................................................] duration:
742.663866ms
FAIL (2025-09-11 22:29:12 UTC)
orbiter warning: context deadline exceeded
Duration: 742.689664ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [...XX.......................................................] duration:
750.76277ms
FAIL (2025-09-11 22:28:40 UTC)
orbiter warning: context deadline exceeded
Duration: 750.786417ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
8 out of 60 is failed (threshold=3) [..XXXXXXX..X................................................] duration:
878.631835ms
FAIL (2025-09-11 22:28:26 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 878.652403ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [X...XX......................................................] duration:
679.195562ms
FAIL (2025-09-11 22:27:55 UTC)
orbiter warning: context deadline exceeded
Duration: 679.212885ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
8 out of 60 is failed (threshold=3) [...XXXXXXX..X...............................................] duration:
424.023789ms
FAIL (2025-09-11 22:27:43 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 424.048024ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
9 out of 60 is failed (threshold=3) [X...XXXXXXX..X..............................................] duration:
534.239121ms
FAIL (2025-09-11 22:27:27 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 534.262725ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [.X...XX.....................................................] duration:
1.137813516s
FAIL (2025-09-11 22:27:08 UTC)
orbiter warning: context deadline exceeded
Duration: 1.137833543s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
10 out of 60 is failed (threshold=3) [XX...XXXXXXX..X.............................................] duration:
428.476391ms
FAIL (2025-09-11 22:27:00 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 428.507961ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
728.195203ms
FAIL (2025-09-11 22:26:14 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 3)
======LOGS======
Sep 11 21:45:40.463003522 (319h37m15.81578865s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Uploading piece...
Sep 11 21:45:40.463551491 (319h37m15.816336618s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Uploading piece...
Sep 11 21:45:40.463970126 (319h37m15.816755264s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Uploading piece...
Sep 11 21:45:40.464402466 (319h37m15.817187605s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Uploading piece...
Sep 11 21:45:40.464802326 (319h37m15.817587465s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Uploading piece...
Sep 11 21:45:40.892558581 (319h37m16.24534372s) [upload=281456]: Next returned nil segment
Sep 11 21:45:40.892580002 (319h37m16.245365129s) [upload=281456]: Waiting for error group managing segments...
Sep 11 21:45:41.035387083 (319h37m16.388172221s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil>
Sep 11 21:45:41.036541769 (319h37m16.389326896s) [noise=true , address=145.79.227.17:4969 , piece_id=S7JY5DVXUSQBTVHVR44O4AOCKIEFXCAINAJX3XG4NC5RROKIUITQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil>
Sep 11 21:45:41.196799468 (319h37m16.549584597s) [noise=true , address=145.79.227.13:4803 , piece_id=VPZ3FZ6OFMHC2X4HK5LBHNMVU2AAMFW6U7EY2ZND43ULWOFTGEDQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil>
Sep 11 21:46:10.424396656 (319h37m45.777181764s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection
Sep 11 21:46:10.424472478 (319h37m45.777257576s) [noise=true , address=45.91.116.14:4190 , piece_id=SMJHAECOFSEHXHYMQKY7JLZVYNKT6CXWVHXAXRVVLMD27QBNOQBA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection
Sep 11 21:46:10.424489680 (319h37m45.777274788s) [noise=true , address=45.91.116.11:4119 , piece_id=MAC3C2IVL5JZ2A7NREPRNQ4LIHGXPEPKSKGFHMPXKKB25WO5YOOA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection
Sep 11 21:46:10.424563619 (319h37m45.777348727s) [noise=true , address=77.90.31.15:4697 , piece_id=DV7DTDIM2B7B2DTYD4Y55OTODEJDEL5ZKGEJ452MIGPFEWCMZF7Q, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection
Sep 11 21:46:10.424594106 (319h37m45.777379214s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection
Sep 11 21:46:10.424617690 (319h37m45.777402788s) [noise=true , address=45.91.116.9:4261 , piece_id=DVT7RNVBMGVG7ZY3FS3IU3VQZGIKMIY2EUF576JNTP3YZBENLRKQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection
Sep 11 21:46:10.424639601 (319h37m45.777424709s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection
Sep 11 21:46:10.424658607 (319h37m45.777443715s) [noise=true , address=45.91.116.7:4009 , piece_id=6ROEZYTFXYP3MHGFWVTN23CW3HBDD6MCLGRGWMZVCRCVSNEWAYUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection
Sep 11 21:46:10.424679837 (319h37m45.777464945s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection
Sep 11 21:46:10.424719922 (319h37m45.77750503s) [noise=true , address=45.91.116.12:4226 , piece_id=MYIAGHV7UCQK7QJVPWDTK4AIVDCJ4Z2LETUHNDRPV6U5SXT6BJRA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection
Sep 11 21:46:10.424736864 (319h37m45.777521972s) [noise=true , address=77.90.31.13:4627 , piece_id=UB7DQL5YGYTJIBOO7WGBOW2RI5AEYZRJ475SMGTJSNVHK7HGTUUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection
Sep 11 21:46:10.424749978 (319h37m45.777535086s) [noise=true , address=77.90.31.19:4841 , piece_id=RUGEOBC7PNZO2HBP2ZBOIXIPZE6FOEME7NQOL72C4DPU7FCOSVMA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection
Sep 11 21:46:10.424807897 (319h37m45.777593005s) [noise=true , address=45.91.116.14:4189 , piece_id=TZPP5WXGVSDMPEELWZ7ZYXNE2WV6PGSC6NCRONPCRFMDIBJLF56A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: context deadline exceeded; context deadline exceeded
Sep 11 21:46:10.424822825 (319h37m45.777607933s) [seg_pos={0 0}, upload=281456]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil>
Sep 11 21:46:10.440712797 (319h37m45.793497905s) [upload=281456]: Done uploading segments...
Sep 11 21:46:10.440723677 (319h37m45.793508775s) [upload=281456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3)
Duration: 728.224798ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [..X...XX....................................................] duration:
684.315802ms
FAIL (2025-09-11 22:26:10 UTC)
orbiter warning: context deadline exceeded
Duration: 684.337342ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
10 out of 60 is failed (threshold=3) [.XX...XXXXXXX..X............................................] duration:
915.482068ms
FAIL (2025-09-11 22:26:07 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 915.496836ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [XX..........................................................] duration:
492.851597ms
FAIL (2025-09-11 22:25:49 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 3)
======LOGS======
Sep 11 21:45:40.463003522 (319h37m15.81578865s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Uploading piece...
Sep 11 21:45:40.463551491 (319h37m15.816336618s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Uploading piece...
Sep 11 21:45:40.463970126 (319h37m15.816755264s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Uploading piece...
Sep 11 21:45:40.464402466 (319h37m15.817187605s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Uploading piece...
Sep 11 21:45:40.464802326 (319h37m15.817587465s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Uploading piece...
Sep 11 21:45:40.892558581 (319h37m16.24534372s) [upload=281456]: Next returned nil segment
Sep 11 21:45:40.892580002 (319h37m16.245365129s) [upload=281456]: Waiting for error group managing segments...
Sep 11 21:45:41.035387083 (319h37m16.388172221s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil>
Sep 11 21:45:41.036541769 (319h37m16.389326896s) [noise=true , address=145.79.227.17:4969 , piece_id=S7JY5DVXUSQBTVHVR44O4AOCKIEFXCAINAJX3XG4NC5RROKIUITQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil>
Sep 11 21:45:41.196799468 (319h37m16.549584597s) [noise=true , address=145.79.227.13:4803 , piece_id=VPZ3FZ6OFMHC2X4HK5LBHNMVU2AAMFW6U7EY2ZND43ULWOFTGEDQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil>
Sep 11 21:46:10.424396656 (319h37m45.777181764s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection
Sep 11 21:46:10.424472478 (319h37m45.777257576s) [noise=true , address=45.91.116.14:4190 , piece_id=SMJHAECOFSEHXHYMQKY7JLZVYNKT6CXWVHXAXRVVLMD27QBNOQBA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection
Sep 11 21:46:10.424489680 (319h37m45.777274788s) [noise=true , address=45.91.116.11:4119 , piece_id=MAC3C2IVL5JZ2A7NREPRNQ4LIHGXPEPKSKGFHMPXKKB25WO5YOOA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection
Sep 11 21:46:10.424563619 (319h37m45.777348727s) [noise=true , address=77.90.31.15:4697 , piece_id=DV7DTDIM2B7B2DTYD4Y55OTODEJDEL5ZKGEJ452MIGPFEWCMZF7Q, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection
Sep 11 21:46:10.424594106 (319h37m45.777379214s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection
Sep 11 21:46:10.424617690 (319h37m45.777402788s) [noise=true , address=45.91.116.9:4261 , piece_id=DVT7RNVBMGVG7ZY3FS3IU3VQZGIKMIY2EUF576JNTP3YZBENLRKQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection
Sep 11 21:46:10.424639601 (319h37m45.777424709s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection
Sep 11 21:46:10.424658607 (319h37m45.777443715s) [noise=true , address=45.91.116.7:4009 , piece_id=6ROEZYTFXYP3MHGFWVTN23CW3HBDD6MCLGRGWMZVCRCVSNEWAYUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection
Sep 11 21:46:10.424679837 (319h37m45.777464945s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection
Sep 11 21:46:10.424719922 (319h37m45.77750503s) [noise=true , address=45.91.116.12:4226 , piece_id=MYIAGHV7UCQK7QJVPWDTK4AIVDCJ4Z2LETUHNDRPV6U5SXT6BJRA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection
Sep 11 21:46:10.424736864 (319h37m45.777521972s) [noise=true , address=77.90.31.13:4627 , piece_id=UB7DQL5YGYTJIBOO7WGBOW2RI5AEYZRJ475SMGTJSNVHK7HGTUUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection
Sep 11 21:46:10.424749978 (319h37m45.777535086s) [noise=true , address=77.90.31.19:4841 , piece_id=RUGEOBC7PNZO2HBP2ZBOIXIPZE6FOEME7NQOL72C4DPU7FCOSVMA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection
Sep 11 21:46:10.424807897 (319h37m45.777593005s) [noise=true , address=45.91.116.14:4189 , piece_id=TZPP5WXGVSDMPEELWZ7ZYXNE2WV6PGSC6NCRONPCRFMDIBJLF56A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: context deadline exceeded; context deadline exceeded
Sep 11 21:46:10.424822825 (319h37m45.777607933s) [seg_pos={0 0}, upload=281456]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil>
Sep 11 21:46:10.440712797 (319h37m45.793497905s) [upload=281456]: Done uploading segments...
Sep 11 21:46:10.440723677 (319h37m45.793508775s) [upload=281456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3)
Duration: 492.868759ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.XX.........................................................] duration:
452.737637ms
FAIL (2025-09-11 22:25:28 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 3)
======LOGS======
Sep 11 21:45:40.463003522 (319h37m15.81578865s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Uploading piece...
Sep 11 21:45:40.463551491 (319h37m15.816336618s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Uploading piece...
Sep 11 21:45:40.463970126 (319h37m15.816755264s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Uploading piece...
Sep 11 21:45:40.464402466 (319h37m15.817187605s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Uploading piece...
Sep 11 21:45:40.464802326 (319h37m15.817587465s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Uploading piece...
Sep 11 21:45:40.892558581 (319h37m16.24534372s) [upload=281456]: Next returned nil segment
Sep 11 21:45:40.892580002 (319h37m16.245365129s) [upload=281456]: Waiting for error group managing segments...
Sep 11 21:45:41.035387083 (319h37m16.388172221s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil>
Sep 11 21:45:41.036541769 (319h37m16.389326896s) [noise=true , address=145.79.227.17:4969 , piece_id=S7JY5DVXUSQBTVHVR44O4AOCKIEFXCAINAJX3XG4NC5RROKIUITQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil>
Sep 11 21:45:41.196799468 (319h37m16.549584597s) [noise=true , address=145.79.227.13:4803 , piece_id=VPZ3FZ6OFMHC2X4HK5LBHNMVU2AAMFW6U7EY2ZND43ULWOFTGEDQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil>
Sep 11 21:46:10.424396656 (319h37m45.777181764s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection
Sep 11 21:46:10.424472478 (319h37m45.777257576s) [noise=true , address=45.91.116.14:4190 , piece_id=SMJHAECOFSEHXHYMQKY7JLZVYNKT6CXWVHXAXRVVLMD27QBNOQBA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection
Sep 11 21:46:10.424489680 (319h37m45.777274788s) [noise=true , address=45.91.116.11:4119 , piece_id=MAC3C2IVL5JZ2A7NREPRNQ4LIHGXPEPKSKGFHMPXKKB25WO5YOOA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection
Sep 11 21:46:10.424563619 (319h37m45.777348727s) [noise=true , address=77.90.31.15:4697 , piece_id=DV7DTDIM2B7B2DTYD4Y55OTODEJDEL5ZKGEJ452MIGPFEWCMZF7Q, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection
Sep 11 21:46:10.424594106 (319h37m45.777379214s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection
Sep 11 21:46:10.424617690 (319h37m45.777402788s) [noise=true , address=45.91.116.9:4261 , piece_id=DVT7RNVBMGVG7ZY3FS3IU3VQZGIKMIY2EUF576JNTP3YZBENLRKQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection
Sep 11 21:46:10.424639601 (319h37m45.777424709s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection
Sep 11 21:46:10.424658607 (319h37m45.777443715s) [noise=true , address=45.91.116.7:4009 , piece_id=6ROEZYTFXYP3MHGFWVTN23CW3HBDD6MCLGRGWMZVCRCVSNEWAYUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection
Sep 11 21:46:10.424679837 (319h37m45.777464945s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection
Sep 11 21:46:10.424719922 (319h37m45.77750503s) [noise=true , address=45.91.116.12:4226 , piece_id=MYIAGHV7UCQK7QJVPWDTK4AIVDCJ4Z2LETUHNDRPV6U5SXT6BJRA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection
Sep 11 21:46:10.424736864 (319h37m45.777521972s) [noise=true , address=77.90.31.13:4627 , piece_id=UB7DQL5YGYTJIBOO7WGBOW2RI5AEYZRJ475SMGTJSNVHK7HGTUUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection
Sep 11 21:46:10.424749978 (319h37m45.777535086s) [noise=true , address=77.90.31.19:4841 , piece_id=RUGEOBC7PNZO2HBP2ZBOIXIPZE6FOEME7NQOL72C4DPU7FCOSVMA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection
Sep 11 21:46:10.424807897 (319h37m45.777593005s) [noise=true , address=45.91.116.14:4189 , piece_id=TZPP5WXGVSDMPEELWZ7ZYXNE2WV6PGSC6NCRONPCRFMDIBJLF56A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: context deadline exceeded; context deadline exceeded
Sep 11 21:46:10.424822825 (319h37m45.777607933s) [seg_pos={0 0}, upload=281456]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil>
Sep 11 21:46:10.440712797 (319h37m45.793497905s) [upload=281456]: Done uploading segments...
Sep 11 21:46:10.440723677 (319h37m45.793508775s) [upload=281456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3)
Duration: 452.761381ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
10 out of 60 is failed (threshold=3) [..XX...XXXXXXX..X...........................................] duration:
488.207363ms
FAIL (2025-09-11 22:24:56 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 488.230228ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [...X...XX...................................................] duration:
726.828075ms
FAIL (2025-09-11 22:24:55 UTC)
orbiter warning: context deadline exceeded
Duration: 726.848063ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..XX........................................................] duration:
421.873099ms
FAIL (2025-09-11 22:24:39 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 3)
======LOGS======
Sep 11 21:45:40.463003522 (319h37m15.81578865s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Uploading piece...
Sep 11 21:45:40.463551491 (319h37m15.816336618s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Uploading piece...
Sep 11 21:45:40.463970126 (319h37m15.816755264s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Uploading piece...
Sep 11 21:45:40.464402466 (319h37m15.817187605s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Uploading piece...
Sep 11 21:45:40.464802326 (319h37m15.817587465s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Uploading piece...
Sep 11 21:45:40.892558581 (319h37m16.24534372s) [upload=281456]: Next returned nil segment
Sep 11 21:45:40.892580002 (319h37m16.245365129s) [upload=281456]: Waiting for error group managing segments...
Sep 11 21:45:41.035387083 (319h37m16.388172221s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil>
Sep 11 21:45:41.036541769 (319h37m16.389326896s) [noise=true , address=145.79.227.17:4969 , piece_id=S7JY5DVXUSQBTVHVR44O4AOCKIEFXCAINAJX3XG4NC5RROKIUITQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil>
Sep 11 21:45:41.196799468 (319h37m16.549584597s) [noise=true , address=145.79.227.13:4803 , piece_id=VPZ3FZ6OFMHC2X4HK5LBHNMVU2AAMFW6U7EY2ZND43ULWOFTGEDQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil>
Sep 11 21:46:10.424396656 (319h37m45.777181764s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection
Sep 11 21:46:10.424472478 (319h37m45.777257576s) [noise=true , address=45.91.116.14:4190 , piece_id=SMJHAECOFSEHXHYMQKY7JLZVYNKT6CXWVHXAXRVVLMD27QBNOQBA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection
Sep 11 21:46:10.424489680 (319h37m45.777274788s) [noise=true , address=45.91.116.11:4119 , piece_id=MAC3C2IVL5JZ2A7NREPRNQ4LIHGXPEPKSKGFHMPXKKB25WO5YOOA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection
Sep 11 21:46:10.424563619 (319h37m45.777348727s) [noise=true , address=77.90.31.15:4697 , piece_id=DV7DTDIM2B7B2DTYD4Y55OTODEJDEL5ZKGEJ452MIGPFEWCMZF7Q, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection
Sep 11 21:46:10.424594106 (319h37m45.777379214s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection
Sep 11 21:46:10.424617690 (319h37m45.777402788s) [noise=true , address=45.91.116.9:4261 , piece_id=DVT7RNVBMGVG7ZY3FS3IU3VQZGIKMIY2EUF576JNTP3YZBENLRKQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection
Sep 11 21:46:10.424639601 (319h37m45.777424709s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection
Sep 11 21:46:10.424658607 (319h37m45.777443715s) [noise=true , address=45.91.116.7:4009 , piece_id=6ROEZYTFXYP3MHGFWVTN23CW3HBDD6MCLGRGWMZVCRCVSNEWAYUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection
Sep 11 21:46:10.424679837 (319h37m45.777464945s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection
Sep 11 21:46:10.424719922 (319h37m45.77750503s) [noise=true , address=45.91.116.12:4226 , piece_id=MYIAGHV7UCQK7QJVPWDTK4AIVDCJ4Z2LETUHNDRPV6U5SXT6BJRA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection
Sep 11 21:46:10.424736864 (319h37m45.777521972s) [noise=true , address=77.90.31.13:4627 , piece_id=UB7DQL5YGYTJIBOO7WGBOW2RI5AEYZRJ475SMGTJSNVHK7HGTUUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection
Sep 11 21:46:10.424749978 (319h37m45.777535086s) [noise=true , address=77.90.31.19:4841 , piece_id=RUGEOBC7PNZO2HBP2ZBOIXIPZE6FOEME7NQOL72C4DPU7FCOSVMA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection
Sep 11 21:46:10.424807897 (319h37m45.777593005s) [noise=true , address=45.91.116.14:4189 , piece_id=TZPP5WXGVSDMPEELWZ7ZYXNE2WV6PGSC6NCRONPCRFMDIBJLF56A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: context deadline exceeded; context deadline exceeded
Sep 11 21:46:10.424822825 (319h37m45.777607933s) [seg_pos={0 0}, upload=281456]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil>
Sep 11 21:46:10.440712797 (319h37m45.793497905s) [upload=281456]: Done uploading segments...
Sep 11 21:46:10.440723677 (319h37m45.793508775s) [upload=281456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3)
Duration: 421.891812ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [....X...XX..................................................] duration:
675.08982ms
FAIL (2025-09-11 22:24:24 UTC)
orbiter warning: context deadline exceeded
Duration: 675.22304ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
10 out of 60 is failed (threshold=3) [...XX...XXXXXXX..X..........................................] duration:
1.424065313s
FAIL (2025-09-11 22:24:13 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.424086402s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...XX.......................................................] duration:
623.945029ms
FAIL (2025-09-11 22:24:02 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 3)
======LOGS======
Sep 11 21:45:40.463003522 (319h37m15.81578865s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Uploading piece...
Sep 11 21:45:40.463551491 (319h37m15.816336618s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Uploading piece...
Sep 11 21:45:40.463970126 (319h37m15.816755264s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Uploading piece...
Sep 11 21:45:40.464402466 (319h37m15.817187605s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Uploading piece...
Sep 11 21:45:40.464802326 (319h37m15.817587465s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Uploading piece...
Sep 11 21:45:40.892558581 (319h37m16.24534372s) [upload=281456]: Next returned nil segment
Sep 11 21:45:40.892580002 (319h37m16.245365129s) [upload=281456]: Waiting for error group managing segments...
Sep 11 21:45:41.035387083 (319h37m16.388172221s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil>
Sep 11 21:45:41.036541769 (319h37m16.389326896s) [noise=true , address=145.79.227.17:4969 , piece_id=S7JY5DVXUSQBTVHVR44O4AOCKIEFXCAINAJX3XG4NC5RROKIUITQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil>
Sep 11 21:45:41.196799468 (319h37m16.549584597s) [noise=true , address=145.79.227.13:4803 , piece_id=VPZ3FZ6OFMHC2X4HK5LBHNMVU2AAMFW6U7EY2ZND43ULWOFTGEDQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil>
Sep 11 21:46:10.424396656 (319h37m45.777181764s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection
Sep 11 21:46:10.424472478 (319h37m45.777257576s) [noise=true , address=45.91.116.14:4190 , piece_id=SMJHAECOFSEHXHYMQKY7JLZVYNKT6CXWVHXAXRVVLMD27QBNOQBA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection
Sep 11 21:46:10.424489680 (319h37m45.777274788s) [noise=true , address=45.91.116.11:4119 , piece_id=MAC3C2IVL5JZ2A7NREPRNQ4LIHGXPEPKSKGFHMPXKKB25WO5YOOA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection
Sep 11 21:46:10.424563619 (319h37m45.777348727s) [noise=true , address=77.90.31.15:4697 , piece_id=DV7DTDIM2B7B2DTYD4Y55OTODEJDEL5ZKGEJ452MIGPFEWCMZF7Q, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection
Sep 11 21:46:10.424594106 (319h37m45.777379214s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection
Sep 11 21:46:10.424617690 (319h37m45.777402788s) [noise=true , address=45.91.116.9:4261 , piece_id=DVT7RNVBMGVG7ZY3FS3IU3VQZGIKMIY2EUF576JNTP3YZBENLRKQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection
Sep 11 21:46:10.424639601 (319h37m45.777424709s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection
Sep 11 21:46:10.424658607 (319h37m45.777443715s) [noise=true , address=45.91.116.7:4009 , piece_id=6ROEZYTFXYP3MHGFWVTN23CW3HBDD6MCLGRGWMZVCRCVSNEWAYUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection
Sep 11 21:46:10.424679837 (319h37m45.777464945s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection
Sep 11 21:46:10.424719922 (319h37m45.77750503s) [noise=true , address=45.91.116.12:4226 , piece_id=MYIAGHV7UCQK7QJVPWDTK4AIVDCJ4Z2LETUHNDRPV6U5SXT6BJRA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection
Sep 11 21:46:10.424736864 (319h37m45.777521972s) [noise=true , address=77.90.31.13:4627 , piece_id=UB7DQL5YGYTJIBOO7WGBOW2RI5AEYZRJ475SMGTJSNVHK7HGTUUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection
Sep 11 21:46:10.424749978 (319h37m45.777535086s) [noise=true , address=77.90.31.19:4841 , piece_id=RUGEOBC7PNZO2HBP2ZBOIXIPZE6FOEME7NQOL72C4DPU7FCOSVMA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection
Sep 11 21:46:10.424807897 (319h37m45.777593005s) [noise=true , address=45.91.116.14:4189 , piece_id=TZPP5WXGVSDMPEELWZ7ZYXNE2WV6PGSC6NCRONPCRFMDIBJLF56A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: context deadline exceeded; context deadline exceeded
Sep 11 21:46:10.424822825 (319h37m45.777607933s) [seg_pos={0 0}, upload=281456]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil>
Sep 11 21:46:10.440712797 (319h37m45.793497905s) [upload=281456]: Done uploading segments...
Sep 11 21:46:10.440723677 (319h37m45.793508775s) [upload=281456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3)
Duration: 623.98272ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
11 out of 60 is failed (threshold=3) [X...XX...XXXXXXX..X.........................................] duration:
440.908391ms
FAIL (2025-09-11 22:23:54 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 440.935883ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [X...XX......................................................] duration:
608.496166ms
FAIL (2025-09-11 22:23:40 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 3)
======LOGS======
Sep 11 21:45:40.463003522 (319h37m15.81578865s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Uploading piece...
Sep 11 21:45:40.463551491 (319h37m15.816336618s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Uploading piece...
Sep 11 21:45:40.463970126 (319h37m15.816755264s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Uploading piece...
Sep 11 21:45:40.464402466 (319h37m15.817187605s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Uploading piece...
Sep 11 21:45:40.464802326 (319h37m15.817587465s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Uploading piece...
Sep 11 21:45:40.892558581 (319h37m16.24534372s) [upload=281456]: Next returned nil segment
Sep 11 21:45:40.892580002 (319h37m16.245365129s) [upload=281456]: Waiting for error group managing segments...
Sep 11 21:45:41.035387083 (319h37m16.388172221s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil>
Sep 11 21:45:41.036541769 (319h37m16.389326896s) [noise=true , address=145.79.227.17:4969 , piece_id=S7JY5DVXUSQBTVHVR44O4AOCKIEFXCAINAJX3XG4NC5RROKIUITQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil>
Sep 11 21:45:41.196799468 (319h37m16.549584597s) [noise=true , address=145.79.227.13:4803 , piece_id=VPZ3FZ6OFMHC2X4HK5LBHNMVU2AAMFW6U7EY2ZND43ULWOFTGEDQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil>
Sep 11 21:46:10.424396656 (319h37m45.777181764s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection
Sep 11 21:46:10.424472478 (319h37m45.777257576s) [noise=true , address=45.91.116.14:4190 , piece_id=SMJHAECOFSEHXHYMQKY7JLZVYNKT6CXWVHXAXRVVLMD27QBNOQBA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection
Sep 11 21:46:10.424489680 (319h37m45.777274788s) [noise=true , address=45.91.116.11:4119 , piece_id=MAC3C2IVL5JZ2A7NREPRNQ4LIHGXPEPKSKGFHMPXKKB25WO5YOOA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection
Sep 11 21:46:10.424563619 (319h37m45.777348727s) [noise=true , address=77.90.31.15:4697 , piece_id=DV7DTDIM2B7B2DTYD4Y55OTODEJDEL5ZKGEJ452MIGPFEWCMZF7Q, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection
Sep 11 21:46:10.424594106 (319h37m45.777379214s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection
Sep 11 21:46:10.424617690 (319h37m45.777402788s) [noise=true , address=45.91.116.9:4261 , piece_id=DVT7RNVBMGVG7ZY3FS3IU3VQZGIKMIY2EUF576JNTP3YZBENLRKQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection
Sep 11 21:46:10.424639601 (319h37m45.777424709s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection
Sep 11 21:46:10.424658607 (319h37m45.777443715s) [noise=true , address=45.91.116.7:4009 , piece_id=6ROEZYTFXYP3MHGFWVTN23CW3HBDD6MCLGRGWMZVCRCVSNEWAYUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection
Sep 11 21:46:10.424679837 (319h37m45.777464945s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection
Sep 11 21:46:10.424719922 (319h37m45.77750503s) [noise=true , address=45.91.116.12:4226 , piece_id=MYIAGHV7UCQK7QJVPWDTK4AIVDCJ4Z2LETUHNDRPV6U5SXT6BJRA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection
Sep 11 21:46:10.424736864 (319h37m45.777521972s) [noise=true , address=77.90.31.13:4627 , piece_id=UB7DQL5YGYTJIBOO7WGBOW2RI5AEYZRJ475SMGTJSNVHK7HGTUUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection
Sep 11 21:46:10.424749978 (319h37m45.777535086s) [noise=true , address=77.90.31.19:4841 , piece_id=RUGEOBC7PNZO2HBP2ZBOIXIPZE6FOEME7NQOL72C4DPU7FCOSVMA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection
Sep 11 21:46:10.424807897 (319h37m45.777593005s) [noise=true , address=45.91.116.14:4189 , piece_id=TZPP5WXGVSDMPEELWZ7ZYXNE2WV6PGSC6NCRONPCRFMDIBJLF56A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: context deadline exceeded; context deadline exceeded
Sep 11 21:46:10.424822825 (319h37m45.777607933s) [seg_pos={0 0}, upload=281456]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil>
Sep 11 21:46:10.440712797 (319h37m45.793497905s) [upload=281456]: Done uploading segments...
Sep 11 21:46:10.440723677 (319h37m45.793508775s) [upload=281456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3)
Duration: 608.522655ms
core
uplink
us-select-1
|