Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [....XXX.XXXXX.........X........X..................X...X.....] duration: 737.883788ms FAIL (2025-09-22 05:14:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 737.901862ms edge gateway us-select-1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 4.952729954s FAIL (2025-09-22 05:14:42 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.952752406s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [......X........................X...X.......X.X.......XXX.X..] duration: 389.477446ms FAIL (2025-09-22 05:14:40 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== Sep 22 05:13:22.974514149 (567h4m58.327299246s) [upload=499082]: Starting upload Sep 22 05:13:22.974553142 (567h4m58.32733825s) [upload=499082]: Done starting upload Sep 22 05:13:22.974795697 (567h4m58.327580796s) [upload=499082]: Uploading segments... Sep 22 05:13:22.974830853 (567h4m58.327615961s) [upload=499082]: Got next segment. Inline: false Sep 22 05:13:22.974859567 (567h4m58.327644675s) [upload=499082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 05:13:22.974863354 (567h4m58.327648452s) [upload=499082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 05:13:22.995531139 (567h4m58.348316247s) [seg_pos={0 0}, upload=499082]: Begin upload segment... Sep 22 05:13:22.995558891 (567h4m58.348343999s) [seg_pos={0 0}, upload=499082]: Done begin upload segment. Sep 22 05:13:22.995576263 (567h4m58.348361361s) [noise=true , address=77.90.31.14:4661 , piece_id=BCCLCYQJSDSBEKWVMOJW6VDFKAYXXFCC3WISWFCMH62YRSXPZL4Q, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.995593626 (567h4m58.348378734s) [noise=true , address=45.91.116.5:4298 , piece_id=HZYWW6ZOBVLZ6GGMRGHFT4SDX3T5XFVB4CNHAAPA3DHZDE2VSTLA, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.995856730 (567h4m58.348641838s) [noise=true , address=45.91.116.9:4263 , piece_id=EYZH2GFDEPB4YGJRU3LDQKP2DJOV5ME4CDKUSBNSEMJUBXTL3SCA, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.996051304 (567h4m58.348836403s) [noise=true , address=145.79.227.5:4222 , piece_id=ZVWHNKTH55VY7QSVV7IKTHMZYD3BZURLN2Y45V7LM2WR2ZVKFVCA, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.996144419 (567h4m58.348929527s) [noise=true , address=77.90.31.12:4589 , piece_id=UKYJOOHDHBE5G3XDLCHRMBYDDNOCD7DLIWJL5VK7KSDI5MNKOH4A, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.996371937 (567h4m58.349157035s) [noise=true , address=145.79.227.7:4293 , piece_id=BMK4JUEYIWUOFN5FVW64U5WP6MUBGH7XKBXBIKVM7JE7SRLUUBJA, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.996425477 (567h4m58.349210576s) [noise=true , address=45.91.116.10:4081 , piece_id=UOD7HX7P5KTA5DLNZTEDLDLUQ7H6AM7Q2ABJPG6MZOIQNQFAMCPA, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.996621155 (567h4m58.349406252s) [noise=true , address=145.79.227.18:4007 , piece_id=FSL2KKXHZ7YWIFAZ2EVDGVKY5MZQFLBDYXF57OKGNEHPY5IBCYFA, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.996791824 (567h4m58.349576922s) [noise=true , address=77.90.31.19:4841 , piece_id=H5WPXGJDIHQ66XZSQUJPPX3EXJOFL2KRSTZ4UVR4P2QLU7LAPCYQ, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.996935534 (567h4m58.349720632s) [noise=true , address=145.79.227.16:4909 , piece_id=KX7ICHBES3KTJDVVMW35OQYLVP2P44GWLXDSFX4MPDGGDWNPB5HQ, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.997112546 (567h4m58.349897644s) [noise=true , address=45.91.116.4:4937 , piece_id=FB6MXGDCQFW7ROO223XG7BCIL4Y6DMOT26RT44YMJEVWMV4X4M6A, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.997166287 (567h4m58.349951386s) [noise=true , address=145.79.227.6:4257 , piece_id=6IPNPD32GSFAFCREBBLJZ4H6XOLLBNTH6JIPAZWNYNBTGQS2BE7A, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.997440823 (567h4m58.350225921s) [noise=true , address=77.90.31.21:4877 , piece_id=AIESKL35MRMMC26KNVQEKJJ5OMKQCAFEJQPQEQMXRGC64UQSNOCQ, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.997445731 (567h4m58.35023083s) [noise=true , address=77.90.31.15:4699 , piece_id=4KPROWW2WVAAQPNEFPZOGFE5RYKAPQE6SU3Y43BNFGV2G52LV6ZQ, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.997681825 (567h4m58.350466933s) [noise=true , address=145.79.227.14:4837 , piece_id=6L6HHGUQOZHMMSUAR3KHC74GSU6V57HNFF2HHL2ANDR62XVSUWEQ, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.997846784 (567h4m58.350631892s) [noise=true , address=145.79.227.13:4801 , piece_id=MSXGDHBKD76BMLOMN6J6EX2ZU2USYSDSEPG3E4MHRRLXCJAY5FWQ, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:23.081452328 (567h4m58.434237426s) [upload=499082]: Next returned nil segment Sep 22 05:13:23.081461074 (567h4m58.434246172s) [upload=499082]: Waiting for error group managing segments... Sep 22 05:13:23.090125544 (567h4m58.442910641s) [noise=true , address=45.91.116.9:4263 , piece_id=EYZH2GFDEPB4YGJRU3LDQKP2DJOV5ME4CDKUSBNSEMJUBXTL3SCA, seg_pos={0 0}, upload=499082]: Done uploading piece. err: <nil> Sep 22 05:13:23.090835847 (567h4m58.443620945s) [noise=true , address=77.90.31.21:4877 , piece_id=AIESKL35MRMMC26KNVQEKJJ5OMKQCAFEJQPQEQMXRGC64UQSNOCQ, seg_pos={0 0}, upload=499082]: Done uploading piece. err: <nil> Sep 22 05:13:23.092184747 (567h4m58.444969836s) [noise=true , address=77.90.31.12:4589 , piece_id=UKYJOOHDHBE5G3XDLCHRMBYDDNOCD7DLIWJL5VK7KSDI5MNKOH4A, seg_pos={0 0}, upload=499082]: Done uploading piece. err: <nil> Sep 22 05:13:23.092233589 (567h4m58.445018687s) [noise=true , address=77.90.31.15:4699 , piece_id=4KPROWW2WVAAQPNEFPZOGFE5RYKAPQE6SU3Y43BNFGV2G52LV6ZQ, seg_pos={0 0}, upload=499082]: Done uploading piece. err: <nil> Sep 22 05:13:23.092562237 (567h4m58.445347334s) [noise=true , address=45.91.116.5:4298 , piece_id=HZYWW6ZOBVLZ6GGMRGHFT4SDX3T5XFVB4CNHAAPA3DHZDE2VSTLA, seg_pos={0 0}, upload=499082]: Done uploading piece. err: <nil> Sep 22 05:13:23.092602883 (567h4m58.445387981s) [noise=true , address=45.91.116.10:4081 , piece_id=UOD7HX7P5KTA5DLNZTEDLDLUQ7H6AM7Q2ABJPG6MZOIQNQFAMCPA, seg_pos={0 0}, upload=499082]: Done uploading piece. err: <nil> Sep 22 05:13:23.092928704 (567h4m58.445713802s) [noise=true , address=45.91.116.4:4937 , piece_id=FB6MXGDCQFW7ROO223XG7BCIL4Y6DMOT26RT44YMJEVWMV4X4M6A, seg_pos={0 0}, upload=499082]: Done uploading piece. err: <nil> Sep 22 05:13:23.094037113 (567h4m58.446822212s) [noise=true , address=77.90.31.19:4841 , piece_id=H5WPXGJDIHQ66XZSQUJPPX3EXJOFL2KRSTZ4UVR4P2QLU7LAPCYQ, seg_pos={0 0}, upload=499082]: Done uploading piece. err: <nil> Sep 22 05:13:23.094231209 (567h4m58.447016306s) [noise=true , address=77.90.31.14:4661 , piece_id=BCCLCYQJSDSBEKWVMOJW6VDFKAYXXFCC3WISWFCMH62YRSXPZL4Q, seg_pos={0 0}, upload=499082]: Done uploading piece. err: <nil> Sep 22 05:13:24.674433201 (567h5m0.027218298s) [noise=true , address=145.79.227.14:4837 , piece_id=6L6HHGUQOZHMMSUAR3KHC74GSU6V57HNFF2HHL2ANDR62XVSUWEQ, seg_pos={0 0}, upload=499082]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: rpc: dial tcp 145.79.227.14:4837: connect: no route to host; manager closed: conn closed: op Sep 22 05:13:25.350750932 (567h5m0.703536029s) [noise=true , address=145.79.227.5:4222 , piece_id=ZVWHNKTH55VY7QSVV7IKTHMZYD3BZURLN2Y45V7LM2WR2ZVKFVCA, seg_pos={0 0}, upload=499082]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: connect: no route to host; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:13:25.734546118 (567h5m1.087331215s) [noise=true , address=145.79.227.16:4909 , piece_id=KX7ICHBES3KTJDVVMW35OQYLVP2P44GWLXDSFX4MPDGGDWNPB5HQ, seg_pos={0 0}, upload=499082]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: rpc: dial tcp 145.79.227.16:4909: connect: no route to host; manager closed: conn closed: op Sep 22 05:13:52.962101348 (567h5m28.314886457s) [noise=true , address=145.79.227.7:4293 , piece_id=BMK4JUEYIWUOFN5FVW64U5WP6MUBGH7XKBXBIKVM7JE7SRLUUBJA, seg_pos={0 0}, upload=499082]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: rpc: dial tcp 145.79.227.7:4293: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:13:52.962169526 (567h5m28.314954624s) [noise=true , address=145.79.227.18:4007 , piece_id=FSL2KKXHZ7YWIFAZ2EVDGVKY5MZQFLBDYXF57OKGNEHPY5IBCYFA, seg_pos={0 0}, upload=499082]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: rpc: dial tcp 145.79.227.18:4007: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:13:52.962192690 (567h5m28.314977788s) [noise=true , address=145.79.227.13:4801 , piece_id=MSXGDHBKD76BMLOMN6J6EX2ZU2USYSDSEPG3E4MHRRLXCJAY5FWQ, seg_pos={0 0}, upload=499082]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: rpc: dial tcp 145.79.227.13:4801: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:13:52.962209011 (567h5m28.314994119s) [noise=true , address=145.79.227.6:4257 , piece_id=6IPNPD32GSFAFCREBBLJZ4H6XOLLBNTH6JIPAZWNYNBTGQS2BE7A, seg_pos={0 0}, upload=499082]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: rpc: dial tcp 145.79.227.6:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:13:52.962229659 (567h5m28.315014767s) [seg_pos={0 0}, upload=499082]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Sep 22 05:13:52.976475153 (567h5m28.329260251s) [upload=499082]: Done uploading segments... Sep 22 05:13:52.976487135 (567h5m28.329272243s) [upload=499082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 389.497023ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [.......X........................X...X.......X.X.......XXX.X.] duration: 760.924627ms FAIL (2025-09-22 05:14:19 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== Sep 22 05:13:22.974514149 (567h4m58.327299246s) [upload=499082]: Starting upload Sep 22 05:13:22.974553142 (567h4m58.32733825s) [upload=499082]: Done starting upload Sep 22 05:13:22.974795697 (567h4m58.327580796s) [upload=499082]: Uploading segments... Sep 22 05:13:22.974830853 (567h4m58.327615961s) [upload=499082]: Got next segment. Inline: false Sep 22 05:13:22.974859567 (567h4m58.327644675s) [upload=499082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 05:13:22.974863354 (567h4m58.327648452s) [upload=499082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 05:13:22.995531139 (567h4m58.348316247s) [seg_pos={0 0}, upload=499082]: Begin upload segment... Sep 22 05:13:22.995558891 (567h4m58.348343999s) [seg_pos={0 0}, upload=499082]: Done begin upload segment. Sep 22 05:13:22.995576263 (567h4m58.348361361s) [noise=true , address=77.90.31.14:4661 , piece_id=BCCLCYQJSDSBEKWVMOJW6VDFKAYXXFCC3WISWFCMH62YRSXPZL4Q, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.995593626 (567h4m58.348378734s) [noise=true , address=45.91.116.5:4298 , piece_id=HZYWW6ZOBVLZ6GGMRGHFT4SDX3T5XFVB4CNHAAPA3DHZDE2VSTLA, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.995856730 (567h4m58.348641838s) [noise=true , address=45.91.116.9:4263 , piece_id=EYZH2GFDEPB4YGJRU3LDQKP2DJOV5ME4CDKUSBNSEMJUBXTL3SCA, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.996051304 (567h4m58.348836403s) [noise=true , address=145.79.227.5:4222 , piece_id=ZVWHNKTH55VY7QSVV7IKTHMZYD3BZURLN2Y45V7LM2WR2ZVKFVCA, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.996144419 (567h4m58.348929527s) [noise=true , address=77.90.31.12:4589 , piece_id=UKYJOOHDHBE5G3XDLCHRMBYDDNOCD7DLIWJL5VK7KSDI5MNKOH4A, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.996371937 (567h4m58.349157035s) [noise=true , address=145.79.227.7:4293 , piece_id=BMK4JUEYIWUOFN5FVW64U5WP6MUBGH7XKBXBIKVM7JE7SRLUUBJA, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.996425477 (567h4m58.349210576s) [noise=true , address=45.91.116.10:4081 , piece_id=UOD7HX7P5KTA5DLNZTEDLDLUQ7H6AM7Q2ABJPG6MZOIQNQFAMCPA, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.996621155 (567h4m58.349406252s) [noise=true , address=145.79.227.18:4007 , piece_id=FSL2KKXHZ7YWIFAZ2EVDGVKY5MZQFLBDYXF57OKGNEHPY5IBCYFA, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.996791824 (567h4m58.349576922s) [noise=true , address=77.90.31.19:4841 , piece_id=H5WPXGJDIHQ66XZSQUJPPX3EXJOFL2KRSTZ4UVR4P2QLU7LAPCYQ, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.996935534 (567h4m58.349720632s) [noise=true , address=145.79.227.16:4909 , piece_id=KX7ICHBES3KTJDVVMW35OQYLVP2P44GWLXDSFX4MPDGGDWNPB5HQ, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.997112546 (567h4m58.349897644s) [noise=true , address=45.91.116.4:4937 , piece_id=FB6MXGDCQFW7ROO223XG7BCIL4Y6DMOT26RT44YMJEVWMV4X4M6A, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.997166287 (567h4m58.349951386s) [noise=true , address=145.79.227.6:4257 , piece_id=6IPNPD32GSFAFCREBBLJZ4H6XOLLBNTH6JIPAZWNYNBTGQS2BE7A, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.997440823 (567h4m58.350225921s) [noise=true , address=77.90.31.21:4877 , piece_id=AIESKL35MRMMC26KNVQEKJJ5OMKQCAFEJQPQEQMXRGC64UQSNOCQ, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.997445731 (567h4m58.35023083s) [noise=true , address=77.90.31.15:4699 , piece_id=4KPROWW2WVAAQPNEFPZOGFE5RYKAPQE6SU3Y43BNFGV2G52LV6ZQ, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.997681825 (567h4m58.350466933s) [noise=true , address=145.79.227.14:4837 , piece_id=6L6HHGUQOZHMMSUAR3KHC74GSU6V57HNFF2HHL2ANDR62XVSUWEQ, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.997846784 (567h4m58.350631892s) [noise=true , address=145.79.227.13:4801 , piece_id=MSXGDHBKD76BMLOMN6J6EX2ZU2USYSDSEPG3E4MHRRLXCJAY5FWQ, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:23.081452328 (567h4m58.434237426s) [upload=499082]: Next returned nil segment Sep 22 05:13:23.081461074 (567h4m58.434246172s) [upload=499082]: Waiting for error group managing segments... Sep 22 05:13:23.090125544 (567h4m58.442910641s) [noise=true , address=45.91.116.9:4263 , piece_id=EYZH2GFDEPB4YGJRU3LDQKP2DJOV5ME4CDKUSBNSEMJUBXTL3SCA, seg_pos={0 0}, upload=499082]: Done uploading piece. err: <nil> Sep 22 05:13:23.090835847 (567h4m58.443620945s) [noise=true , address=77.90.31.21:4877 , piece_id=AIESKL35MRMMC26KNVQEKJJ5OMKQCAFEJQPQEQMXRGC64UQSNOCQ, seg_pos={0 0}, upload=499082]: Done uploading piece. err: <nil> Sep 22 05:13:23.092184747 (567h4m58.444969836s) [noise=true , address=77.90.31.12:4589 , piece_id=UKYJOOHDHBE5G3XDLCHRMBYDDNOCD7DLIWJL5VK7KSDI5MNKOH4A, seg_pos={0 0}, upload=499082]: Done uploading piece. err: <nil> Sep 22 05:13:23.092233589 (567h4m58.445018687s) [noise=true , address=77.90.31.15:4699 , piece_id=4KPROWW2WVAAQPNEFPZOGFE5RYKAPQE6SU3Y43BNFGV2G52LV6ZQ, seg_pos={0 0}, upload=499082]: Done uploading piece. err: <nil> Sep 22 05:13:23.092562237 (567h4m58.445347334s) [noise=true , address=45.91.116.5:4298 , piece_id=HZYWW6ZOBVLZ6GGMRGHFT4SDX3T5XFVB4CNHAAPA3DHZDE2VSTLA, seg_pos={0 0}, upload=499082]: Done uploading piece. err: <nil> Sep 22 05:13:23.092602883 (567h4m58.445387981s) [noise=true , address=45.91.116.10:4081 , piece_id=UOD7HX7P5KTA5DLNZTEDLDLUQ7H6AM7Q2ABJPG6MZOIQNQFAMCPA, seg_pos={0 0}, upload=499082]: Done uploading piece. err: <nil> Sep 22 05:13:23.092928704 (567h4m58.445713802s) [noise=true , address=45.91.116.4:4937 , piece_id=FB6MXGDCQFW7ROO223XG7BCIL4Y6DMOT26RT44YMJEVWMV4X4M6A, seg_pos={0 0}, upload=499082]: Done uploading piece. err: <nil> Sep 22 05:13:23.094037113 (567h4m58.446822212s) [noise=true , address=77.90.31.19:4841 , piece_id=H5WPXGJDIHQ66XZSQUJPPX3EXJOFL2KRSTZ4UVR4P2QLU7LAPCYQ, seg_pos={0 0}, upload=499082]: Done uploading piece. err: <nil> Sep 22 05:13:23.094231209 (567h4m58.447016306s) [noise=true , address=77.90.31.14:4661 , piece_id=BCCLCYQJSDSBEKWVMOJW6VDFKAYXXFCC3WISWFCMH62YRSXPZL4Q, seg_pos={0 0}, upload=499082]: Done uploading piece. err: <nil> Sep 22 05:13:24.674433201 (567h5m0.027218298s) [noise=true , address=145.79.227.14:4837 , piece_id=6L6HHGUQOZHMMSUAR3KHC74GSU6V57HNFF2HHL2ANDR62XVSUWEQ, seg_pos={0 0}, upload=499082]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: rpc: dial tcp 145.79.227.14:4837: connect: no route to host; manager closed: conn closed: op Sep 22 05:13:25.350750932 (567h5m0.703536029s) [noise=true , address=145.79.227.5:4222 , piece_id=ZVWHNKTH55VY7QSVV7IKTHMZYD3BZURLN2Y45V7LM2WR2ZVKFVCA, seg_pos={0 0}, upload=499082]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: connect: no route to host; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:13:25.734546118 (567h5m1.087331215s) [noise=true , address=145.79.227.16:4909 , piece_id=KX7ICHBES3KTJDVVMW35OQYLVP2P44GWLXDSFX4MPDGGDWNPB5HQ, seg_pos={0 0}, upload=499082]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: rpc: dial tcp 145.79.227.16:4909: connect: no route to host; manager closed: conn closed: op Sep 22 05:13:52.962101348 (567h5m28.314886457s) [noise=true , address=145.79.227.7:4293 , piece_id=BMK4JUEYIWUOFN5FVW64U5WP6MUBGH7XKBXBIKVM7JE7SRLUUBJA, seg_pos={0 0}, upload=499082]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: rpc: dial tcp 145.79.227.7:4293: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:13:52.962169526 (567h5m28.314954624s) [noise=true , address=145.79.227.18:4007 , piece_id=FSL2KKXHZ7YWIFAZ2EVDGVKY5MZQFLBDYXF57OKGNEHPY5IBCYFA, seg_pos={0 0}, upload=499082]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: rpc: dial tcp 145.79.227.18:4007: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:13:52.962192690 (567h5m28.314977788s) [noise=true , address=145.79.227.13:4801 , piece_id=MSXGDHBKD76BMLOMN6J6EX2ZU2USYSDSEPG3E4MHRRLXCJAY5FWQ, seg_pos={0 0}, upload=499082]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: rpc: dial tcp 145.79.227.13:4801: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:13:52.962209011 (567h5m28.314994119s) [noise=true , address=145.79.227.6:4257 , piece_id=6IPNPD32GSFAFCREBBLJZ4H6XOLLBNTH6JIPAZWNYNBTGQS2BE7A, seg_pos={0 0}, upload=499082]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: rpc: dial tcp 145.79.227.6:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:13:52.962229659 (567h5m28.315014767s) [seg_pos={0 0}, upload=499082]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Sep 22 05:13:52.976475153 (567h5m28.329260251s) [upload=499082]: Done uploading segments... Sep 22 05:13:52.976487135 (567h5m28.329272243s) [upload=499082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 760.94711ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 3 out of 60 is failed (threshold=3) [.............................................X.X..X.........] duration: 653.481152ms FAIL (2025-09-22 05:14:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== .79.227.27:4717 , piece_id=BJYH4RBBMPRDAB7I3S64JA2RKDSZWEW5WZESL4UBGMHIJ3DJZOFA, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.443356010 (566h58m39.796141139s) [noise=true , address=145.79.227.15:4890 , piece_id=SXSKTDJ6WKYGYLIHY7JPJU4CCIB57Y73COOERWFTPOVJDBAMHVAQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.443765328 (566h58m39.796550456s) [noise=true , address=145.79.227.33:4892 , piece_id=IRPSKGA5QTCEYH3H22ZGWUB4PSLWSKDOUGMXH7LAGRTZGO6NEYMQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444090558 (566h58m39.796875686s) [noise=true , address=145.79.227.29:4973 , piece_id=7EWN3F2YPAAAMXRUZHQ7FPYME3PCS7YABMIWY75JXHY2E4PN52FQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444188903 (566h58m39.79697403s) [noise=true , address=145.79.227.10:4419 , piece_id=JB2SSRHP2V2URKBPHPPLPML5SFLEUSF3WBA3HVLX3T5M7DK6TP5Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444577773 (566h58m39.797362901s) [noise=true , address=145.79.227.52:4474 , piece_id=AJ55FCPIVDMXVKKZ4VEX5DSJDHENFIWPYEXBRXZUAFD4FH2ERM3Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444677179 (566h58m39.797462307s) [noise=true , address=145.79.227.25:4629 , piece_id=FE4IVKMTA2UCEVM3IFR6CBPRXIRK7CFJMV7UPO4NULLDPEMHI5GQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444962344 (566h58m39.797747472s) [noise=true , address=145.79.227.22:4518 , piece_id=QH2EP26EVUZVNQ4U3CJKZD5HLJ4OTLMDPZEVOW7SWA3RGRMZPVJA, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.445216612 (566h58m39.79800174s) [noise=true , address=145.79.227.13:4815 , piece_id=FKNQGYM6WHIOTFUJOGQPTVBUCCMKIJKM5634ORIXIRIKXGDLAX7Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.445329904 (566h58m39.798115033s) [noise=true , address=145.79.227.30:4790 , piece_id=NFLSQZPJ6PTFYTBRAZGGIZWJAJHYPSTIKYCHGMOK3NV562QQDX4A, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.445688447 (566h58m39.798473585s) [noise=true , address=145.79.227.46:4624 , piece_id=RLMCJZCLQM62QP3XQLDDQ22CLWHRASVOLU5CDXQVDPQ7ABHESU5Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.445754561 (566h58m39.798539689s) [noise=true , address=145.79.227.14:4866 , piece_id=NRUKXI3FQCGQI5WSURFOD5MWY5L5OJUV3B7RZLX33CAN5TXBCK4Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.446085091 (566h58m39.79887022s) [noise=true , address=77.90.31.18:4831 , piece_id=6YYF7O7WASB7L4BUMO6FRX3NGH3QPEB2EDMGZ52RUZYPEXI2D5CQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.446552749 (566h58m39.799337917s) [noise=true , address=66.23.193.175:4553 , piece_id=CUWCYLLGC2OZTEVGQTZH4H5DQWPRNZSNGW7LMZNM6U5KJI7ZCCIA, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.447022330 (566h58m39.799807459s) [noise=true , address=145.79.227.8:4355 , piece_id=3VMN7GJIJ4DSSRBC3EXPJLXGAO2KIFJ3HUZXPBN4GC7CXOYNSXRA, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.447446877 (566h58m39.800232005s) [noise=true , address=145.79.227.2:4118 , piece_id=UMZVCTVPRDDERUTNRCRLPVCHJL6MSGHIGLEIXO66FQC7NP7RNCUQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.447878927 (566h58m39.800664056s) [noise=true , address=145.79.227.12:4782 , piece_id=Q2WT5KUQ4UWHYNV5SW6XOJ4AMNPDLGIFWR2BVNAQGDJJ3ECNHAJQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.448061300 (566h58m39.800846428s) [noise=true , address=145.79.227.11:4736 , piece_id=DCW7GQ2BVMIED4W5FNS33XEDUEIT232O5NHZHGFPGGEFRL6IK3YQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.528619474 (566h58m39.881404572s) [upload=498993]: Next returned nil segment Sep 22 05:07:04.528630534 (566h58m39.881415643s) [upload=498993]: Waiting for error group managing segments... Sep 22 05:07:04.538575067 (566h58m39.891360164s) [noise=true , address=145.79.227.30:4790 , piece_id=NFLSQZPJ6PTFYTBRAZGGIZWJAJHYPSTIKYCHGMOK3NV562QQDX4A, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.539546860 (566h58m39.892331958s) [noise=true , address=145.79.227.27:4717 , piece_id=BJYH4RBBMPRDAB7I3S64JA2RKDSZWEW5WZESL4UBGMHIJ3DJZOFA, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.539973170 (566h58m39.892758267s) [noise=true , address=77.90.31.18:4831 , piece_id=6YYF7O7WASB7L4BUMO6FRX3NGH3QPEB2EDMGZ52RUZYPEXI2D5CQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.540146776 (566h58m39.892931913s) [noise=true , address=145.79.227.33:4892 , piece_id=IRPSKGA5QTCEYH3H22ZGWUB4PSLWSKDOUGMXH7LAGRTZGO6NEYMQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.540291638 (566h58m39.893076746s) [noise=true , address=145.79.227.29:4973 , piece_id=7EWN3F2YPAAAMXRUZHQ7FPYME3PCS7YABMIWY75JXHY2E4PN52FQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.540795884 (566h58m39.893581022s) [noise=true , address=145.79.227.52:4474 , piece_id=AJ55FCPIVDMXVKKZ4VEX5DSJDHENFIWPYEXBRXZUAFD4FH2ERM3Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.544155669 (566h58m39.896940767s) [noise=true , address=145.79.227.25:4629 , piece_id=FE4IVKMTA2UCEVM3IFR6CBPRXIRK7CFJMV7UPO4NULLDPEMHI5GQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.552098143 (566h58m39.904883281s) [noise=true , address=145.79.227.46:4624 , piece_id=RLMCJZCLQM62QP3XQLDDQ22CLWHRASVOLU5CDXQVDPQ7ABHESU5Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.552115576 (566h58m39.904900674s) [noise=true , address=145.79.227.22:4518 , piece_id=QH2EP26EVUZVNQ4U3CJKZD5HLJ4OTLMDPZEVOW7SWA3RGRMZPVJA, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:05.041097924 (566h58m40.393883022s) [noise=true , address=66.23.193.175:4553 , piece_id=CUWCYLLGC2OZTEVGQTZH4H5DQWPRNZSNGW7LMZNM6U5KJI7ZCCIA, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:05.506063937 (566h58m40.858849035s) [noise=true , address=145.79.227.11:4736 , piece_id=DCW7GQ2BVMIED4W5FNS33XEDUEIT232O5NHZHGFPGGEFRL6IK3YQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1ejnWsitdrh68vSJvjR2QnRg4kva8DFRzqvvUuDkXM6zKUDWNC, address:145.79.227.11:4736): protocol: rpc: dial tcp 145.79.227.11:4736: connect: no route to host; manager closed: conn closed: op Sep 22 05:08:04.401016602 (566h59m39.75380173s) [noise=true , address=145.79.227.10:4419 , piece_id=JB2SSRHP2V2URKBPHPPLPML5SFLEUSF3WBA3HVLX3T5M7DK6TP5Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1YnhzSepDNJ6FEFq6ifLdmaGm7BZhMYs7JWbGmShbi38gSxxXL, address:145.79.227.10:4419): protocol: rpc: dial tcp 145.79.227.10:4419: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401091332 (566h59m39.753876461s) [noise=true , address=145.79.227.12:4782 , piece_id=Q2WT5KUQ4UWHYNV5SW6XOJ4AMNPDLGIFWR2BVNAQGDJJ3ECNHAJQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:17C7Wx6yE15jDtqqsQwWVj444YkvHBUWkkXjoCxfXPiErwyGKQ, address:145.79.227.12:4782): protocol: rpc: dial tcp 145.79.227.12:4782: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401101101 (566h59m39.753886229s) [noise=true , address=145.79.227.15:4890 , piece_id=SXSKTDJ6WKYGYLIHY7JPJU4CCIB57Y73COOERWFTPOVJDBAMHVAQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1gakF2Cctzc6EhFScfLfBHJdcDHqMBcey4mNoToEwbtk8Pwix5, address:145.79.227.15:4890): protocol: rpc: dial tcp 145.79.227.15:4890: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401148540 (566h59m39.753933678s) [noise=true , address=145.79.227.14:4866 , piece_id=NRUKXI3FQCGQI5WSURFOD5MWY5L5OJUV3B7RZLX33CAN5TXBCK4Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1zUcYfJE8xRW2Tow7bGB3PeNrVBUzVWR82JADkVwPdSr4CTPyr, address:145.79.227.14:4866): protocol: rpc: dial tcp 145.79.227.14:4866: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401183265 (566h59m39.753968403s) [noise=true , address=145.79.227.13:4815 , piece_id=FKNQGYM6WHIOTFUJOGQPTVBUCCMKIJKM5634ORIXIRIKXGDLAX7Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa, address:145.79.227.13:4815): protocol: rpc: dial tcp 145.79.227.13:4815: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401203854 (566h59m39.753988992s) [noise=true , address=145.79.227.2:4118 , piece_id=UMZVCTVPRDDERUTNRCRLPVCHJL6MSGHIGLEIXO66FQC7NP7RNCUQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:12ty5LHXwLmHC7nRPmVfj2wVEif6JQAQQ5Z5218vv1fKK5sD3zE, address:145.79.227.2:4118): protocol: rpc: dial tcp 145.79.227.2:4118: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401243117 (566h59m39.754028245s) [noise=true , address=145.79.227.8:4355 , piece_id=3VMN7GJIJ4DSSRBC3EXPJLXGAO2KIFJ3HUZXPBN4GC7CXOYNSXRA, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:12mRuEpX7CMxWXVdHrTi3zF3v9t3LcqE6mJKzocajEvYHM52a7T, address:145.79.227.8:4355): protocol: rpc: dial tcp 145.79.227.8:4355: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401288963 (566h59m39.754074102s) [seg_pos={0 0}, upload=498993]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Sep 22 05:08:04.415054225 (566h59m39.767839353s) [upload=498993]: Done uploading segments... Sep 22 05:08:04.415080705 (566h59m39.767865833s) [upload=498993]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 653.507701ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.....XXX.XXXXX.........X........X..................X...X....] duration: 410.387686ms FAIL (2025-09-22 05:14:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 410.404587ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [........X........................X...X.......X.X.......XXX.X] duration: 30.015930129s FAIL (2025-09-22 05:13:52 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== Sep 22 05:13:22.974514149 (567h4m58.327299246s) [upload=499082]: Starting upload Sep 22 05:13:22.974553142 (567h4m58.32733825s) [upload=499082]: Done starting upload Sep 22 05:13:22.974795697 (567h4m58.327580796s) [upload=499082]: Uploading segments... Sep 22 05:13:22.974830853 (567h4m58.327615961s) [upload=499082]: Got next segment. Inline: false Sep 22 05:13:22.974859567 (567h4m58.327644675s) [upload=499082]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 05:13:22.974863354 (567h4m58.327648452s) [upload=499082]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 05:13:22.995531139 (567h4m58.348316247s) [seg_pos={0 0}, upload=499082]: Begin upload segment... Sep 22 05:13:22.995558891 (567h4m58.348343999s) [seg_pos={0 0}, upload=499082]: Done begin upload segment. Sep 22 05:13:22.995576263 (567h4m58.348361361s) [noise=true , address=77.90.31.14:4661 , piece_id=BCCLCYQJSDSBEKWVMOJW6VDFKAYXXFCC3WISWFCMH62YRSXPZL4Q, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.995593626 (567h4m58.348378734s) [noise=true , address=45.91.116.5:4298 , piece_id=HZYWW6ZOBVLZ6GGMRGHFT4SDX3T5XFVB4CNHAAPA3DHZDE2VSTLA, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.995856730 (567h4m58.348641838s) [noise=true , address=45.91.116.9:4263 , piece_id=EYZH2GFDEPB4YGJRU3LDQKP2DJOV5ME4CDKUSBNSEMJUBXTL3SCA, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.996051304 (567h4m58.348836403s) [noise=true , address=145.79.227.5:4222 , piece_id=ZVWHNKTH55VY7QSVV7IKTHMZYD3BZURLN2Y45V7LM2WR2ZVKFVCA, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.996144419 (567h4m58.348929527s) [noise=true , address=77.90.31.12:4589 , piece_id=UKYJOOHDHBE5G3XDLCHRMBYDDNOCD7DLIWJL5VK7KSDI5MNKOH4A, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.996371937 (567h4m58.349157035s) [noise=true , address=145.79.227.7:4293 , piece_id=BMK4JUEYIWUOFN5FVW64U5WP6MUBGH7XKBXBIKVM7JE7SRLUUBJA, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.996425477 (567h4m58.349210576s) [noise=true , address=45.91.116.10:4081 , piece_id=UOD7HX7P5KTA5DLNZTEDLDLUQ7H6AM7Q2ABJPG6MZOIQNQFAMCPA, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.996621155 (567h4m58.349406252s) [noise=true , address=145.79.227.18:4007 , piece_id=FSL2KKXHZ7YWIFAZ2EVDGVKY5MZQFLBDYXF57OKGNEHPY5IBCYFA, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.996791824 (567h4m58.349576922s) [noise=true , address=77.90.31.19:4841 , piece_id=H5WPXGJDIHQ66XZSQUJPPX3EXJOFL2KRSTZ4UVR4P2QLU7LAPCYQ, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.996935534 (567h4m58.349720632s) [noise=true , address=145.79.227.16:4909 , piece_id=KX7ICHBES3KTJDVVMW35OQYLVP2P44GWLXDSFX4MPDGGDWNPB5HQ, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.997112546 (567h4m58.349897644s) [noise=true , address=45.91.116.4:4937 , piece_id=FB6MXGDCQFW7ROO223XG7BCIL4Y6DMOT26RT44YMJEVWMV4X4M6A, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.997166287 (567h4m58.349951386s) [noise=true , address=145.79.227.6:4257 , piece_id=6IPNPD32GSFAFCREBBLJZ4H6XOLLBNTH6JIPAZWNYNBTGQS2BE7A, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.997440823 (567h4m58.350225921s) [noise=true , address=77.90.31.21:4877 , piece_id=AIESKL35MRMMC26KNVQEKJJ5OMKQCAFEJQPQEQMXRGC64UQSNOCQ, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.997445731 (567h4m58.35023083s) [noise=true , address=77.90.31.15:4699 , piece_id=4KPROWW2WVAAQPNEFPZOGFE5RYKAPQE6SU3Y43BNFGV2G52LV6ZQ, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.997681825 (567h4m58.350466933s) [noise=true , address=145.79.227.14:4837 , piece_id=6L6HHGUQOZHMMSUAR3KHC74GSU6V57HNFF2HHL2ANDR62XVSUWEQ, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:22.997846784 (567h4m58.350631892s) [noise=true , address=145.79.227.13:4801 , piece_id=MSXGDHBKD76BMLOMN6J6EX2ZU2USYSDSEPG3E4MHRRLXCJAY5FWQ, seg_pos={0 0}, upload=499082]: Uploading piece... Sep 22 05:13:23.081452328 (567h4m58.434237426s) [upload=499082]: Next returned nil segment Sep 22 05:13:23.081461074 (567h4m58.434246172s) [upload=499082]: Waiting for error group managing segments... Sep 22 05:13:23.090125544 (567h4m58.442910641s) [noise=true , address=45.91.116.9:4263 , piece_id=EYZH2GFDEPB4YGJRU3LDQKP2DJOV5ME4CDKUSBNSEMJUBXTL3SCA, seg_pos={0 0}, upload=499082]: Done uploading piece. err: <nil> Sep 22 05:13:23.090835847 (567h4m58.443620945s) [noise=true , address=77.90.31.21:4877 , piece_id=AIESKL35MRMMC26KNVQEKJJ5OMKQCAFEJQPQEQMXRGC64UQSNOCQ, seg_pos={0 0}, upload=499082]: Done uploading piece. err: <nil> Sep 22 05:13:23.092184747 (567h4m58.444969836s) [noise=true , address=77.90.31.12:4589 , piece_id=UKYJOOHDHBE5G3XDLCHRMBYDDNOCD7DLIWJL5VK7KSDI5MNKOH4A, seg_pos={0 0}, upload=499082]: Done uploading piece. err: <nil> Sep 22 05:13:23.092233589 (567h4m58.445018687s) [noise=true , address=77.90.31.15:4699 , piece_id=4KPROWW2WVAAQPNEFPZOGFE5RYKAPQE6SU3Y43BNFGV2G52LV6ZQ, seg_pos={0 0}, upload=499082]: Done uploading piece. err: <nil> Sep 22 05:13:23.092562237 (567h4m58.445347334s) [noise=true , address=45.91.116.5:4298 , piece_id=HZYWW6ZOBVLZ6GGMRGHFT4SDX3T5XFVB4CNHAAPA3DHZDE2VSTLA, seg_pos={0 0}, upload=499082]: Done uploading piece. err: <nil> Sep 22 05:13:23.092602883 (567h4m58.445387981s) [noise=true , address=45.91.116.10:4081 , piece_id=UOD7HX7P5KTA5DLNZTEDLDLUQ7H6AM7Q2ABJPG6MZOIQNQFAMCPA, seg_pos={0 0}, upload=499082]: Done uploading piece. err: <nil> Sep 22 05:13:23.092928704 (567h4m58.445713802s) [noise=true , address=45.91.116.4:4937 , piece_id=FB6MXGDCQFW7ROO223XG7BCIL4Y6DMOT26RT44YMJEVWMV4X4M6A, seg_pos={0 0}, upload=499082]: Done uploading piece. err: <nil> Sep 22 05:13:23.094037113 (567h4m58.446822212s) [noise=true , address=77.90.31.19:4841 , piece_id=H5WPXGJDIHQ66XZSQUJPPX3EXJOFL2KRSTZ4UVR4P2QLU7LAPCYQ, seg_pos={0 0}, upload=499082]: Done uploading piece. err: <nil> Sep 22 05:13:23.094231209 (567h4m58.447016306s) [noise=true , address=77.90.31.14:4661 , piece_id=BCCLCYQJSDSBEKWVMOJW6VDFKAYXXFCC3WISWFCMH62YRSXPZL4Q, seg_pos={0 0}, upload=499082]: Done uploading piece. err: <nil> Sep 22 05:13:24.674433201 (567h5m0.027218298s) [noise=true , address=145.79.227.14:4837 , piece_id=6L6HHGUQOZHMMSUAR3KHC74GSU6V57HNFF2HHL2ANDR62XVSUWEQ, seg_pos={0 0}, upload=499082]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:145.79.227.14:4837): protocol: rpc: dial tcp 145.79.227.14:4837: connect: no route to host; manager closed: conn closed: op Sep 22 05:13:25.350750932 (567h5m0.703536029s) [noise=true , address=145.79.227.5:4222 , piece_id=ZVWHNKTH55VY7QSVV7IKTHMZYD3BZURLN2Y45V7LM2WR2ZVKFVCA, seg_pos={0 0}, upload=499082]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:145.79.227.5:4222): protocol: rpc: dial tcp 145.79.227.5:4222: connect: no route to host; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:13:25.734546118 (567h5m1.087331215s) [noise=true , address=145.79.227.16:4909 , piece_id=KX7ICHBES3KTJDVVMW35OQYLVP2P44GWLXDSFX4MPDGGDWNPB5HQ, seg_pos={0 0}, upload=499082]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: rpc: dial tcp 145.79.227.16:4909: connect: no route to host; manager closed: conn closed: op Sep 22 05:13:52.962101348 (567h5m28.314886457s) [noise=true , address=145.79.227.7:4293 , piece_id=BMK4JUEYIWUOFN5FVW64U5WP6MUBGH7XKBXBIKVM7JE7SRLUUBJA, seg_pos={0 0}, upload=499082]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:145.79.227.7:4293): protocol: rpc: dial tcp 145.79.227.7:4293: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:13:52.962169526 (567h5m28.314954624s) [noise=true , address=145.79.227.18:4007 , piece_id=FSL2KKXHZ7YWIFAZ2EVDGVKY5MZQFLBDYXF57OKGNEHPY5IBCYFA, seg_pos={0 0}, upload=499082]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: rpc: dial tcp 145.79.227.18:4007: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:13:52.962192690 (567h5m28.314977788s) [noise=true , address=145.79.227.13:4801 , piece_id=MSXGDHBKD76BMLOMN6J6EX2ZU2USYSDSEPG3E4MHRRLXCJAY5FWQ, seg_pos={0 0}, upload=499082]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:145.79.227.13:4801): protocol: rpc: dial tcp 145.79.227.13:4801: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:13:52.962209011 (567h5m28.314994119s) [noise=true , address=145.79.227.6:4257 , piece_id=6IPNPD32GSFAFCREBBLJZ4H6XOLLBNTH6JIPAZWNYNBTGQS2BE7A, seg_pos={0 0}, upload=499082]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: rpc: dial tcp 145.79.227.6:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:13:52.962229659 (567h5m28.315014767s) [seg_pos={0 0}, upload=499082]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Sep 22 05:13:52.976475153 (567h5m28.329260251s) [upload=499082]: Done uploading segments... Sep 22 05:13:52.976487135 (567h5m28.329272243s) [upload=499082]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 30.015945729s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 3 out of 60 is failed (threshold=3) [..............................................X.X..X........] duration: 572.060458ms FAIL (2025-09-22 05:13:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== .79.227.27:4717 , piece_id=BJYH4RBBMPRDAB7I3S64JA2RKDSZWEW5WZESL4UBGMHIJ3DJZOFA, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.443356010 (566h58m39.796141139s) [noise=true , address=145.79.227.15:4890 , piece_id=SXSKTDJ6WKYGYLIHY7JPJU4CCIB57Y73COOERWFTPOVJDBAMHVAQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.443765328 (566h58m39.796550456s) [noise=true , address=145.79.227.33:4892 , piece_id=IRPSKGA5QTCEYH3H22ZGWUB4PSLWSKDOUGMXH7LAGRTZGO6NEYMQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444090558 (566h58m39.796875686s) [noise=true , address=145.79.227.29:4973 , piece_id=7EWN3F2YPAAAMXRUZHQ7FPYME3PCS7YABMIWY75JXHY2E4PN52FQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444188903 (566h58m39.79697403s) [noise=true , address=145.79.227.10:4419 , piece_id=JB2SSRHP2V2URKBPHPPLPML5SFLEUSF3WBA3HVLX3T5M7DK6TP5Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444577773 (566h58m39.797362901s) [noise=true , address=145.79.227.52:4474 , piece_id=AJ55FCPIVDMXVKKZ4VEX5DSJDHENFIWPYEXBRXZUAFD4FH2ERM3Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444677179 (566h58m39.797462307s) [noise=true , address=145.79.227.25:4629 , piece_id=FE4IVKMTA2UCEVM3IFR6CBPRXIRK7CFJMV7UPO4NULLDPEMHI5GQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444962344 (566h58m39.797747472s) [noise=true , address=145.79.227.22:4518 , piece_id=QH2EP26EVUZVNQ4U3CJKZD5HLJ4OTLMDPZEVOW7SWA3RGRMZPVJA, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.445216612 (566h58m39.79800174s) [noise=true , address=145.79.227.13:4815 , piece_id=FKNQGYM6WHIOTFUJOGQPTVBUCCMKIJKM5634ORIXIRIKXGDLAX7Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.445329904 (566h58m39.798115033s) [noise=true , address=145.79.227.30:4790 , piece_id=NFLSQZPJ6PTFYTBRAZGGIZWJAJHYPSTIKYCHGMOK3NV562QQDX4A, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.445688447 (566h58m39.798473585s) [noise=true , address=145.79.227.46:4624 , piece_id=RLMCJZCLQM62QP3XQLDDQ22CLWHRASVOLU5CDXQVDPQ7ABHESU5Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.445754561 (566h58m39.798539689s) [noise=true , address=145.79.227.14:4866 , piece_id=NRUKXI3FQCGQI5WSURFOD5MWY5L5OJUV3B7RZLX33CAN5TXBCK4Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.446085091 (566h58m39.79887022s) [noise=true , address=77.90.31.18:4831 , piece_id=6YYF7O7WASB7L4BUMO6FRX3NGH3QPEB2EDMGZ52RUZYPEXI2D5CQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.446552749 (566h58m39.799337917s) [noise=true , address=66.23.193.175:4553 , piece_id=CUWCYLLGC2OZTEVGQTZH4H5DQWPRNZSNGW7LMZNM6U5KJI7ZCCIA, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.447022330 (566h58m39.799807459s) [noise=true , address=145.79.227.8:4355 , piece_id=3VMN7GJIJ4DSSRBC3EXPJLXGAO2KIFJ3HUZXPBN4GC7CXOYNSXRA, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.447446877 (566h58m39.800232005s) [noise=true , address=145.79.227.2:4118 , piece_id=UMZVCTVPRDDERUTNRCRLPVCHJL6MSGHIGLEIXO66FQC7NP7RNCUQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.447878927 (566h58m39.800664056s) [noise=true , address=145.79.227.12:4782 , piece_id=Q2WT5KUQ4UWHYNV5SW6XOJ4AMNPDLGIFWR2BVNAQGDJJ3ECNHAJQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.448061300 (566h58m39.800846428s) [noise=true , address=145.79.227.11:4736 , piece_id=DCW7GQ2BVMIED4W5FNS33XEDUEIT232O5NHZHGFPGGEFRL6IK3YQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.528619474 (566h58m39.881404572s) [upload=498993]: Next returned nil segment Sep 22 05:07:04.528630534 (566h58m39.881415643s) [upload=498993]: Waiting for error group managing segments... Sep 22 05:07:04.538575067 (566h58m39.891360164s) [noise=true , address=145.79.227.30:4790 , piece_id=NFLSQZPJ6PTFYTBRAZGGIZWJAJHYPSTIKYCHGMOK3NV562QQDX4A, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.539546860 (566h58m39.892331958s) [noise=true , address=145.79.227.27:4717 , piece_id=BJYH4RBBMPRDAB7I3S64JA2RKDSZWEW5WZESL4UBGMHIJ3DJZOFA, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.539973170 (566h58m39.892758267s) [noise=true , address=77.90.31.18:4831 , piece_id=6YYF7O7WASB7L4BUMO6FRX3NGH3QPEB2EDMGZ52RUZYPEXI2D5CQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.540146776 (566h58m39.892931913s) [noise=true , address=145.79.227.33:4892 , piece_id=IRPSKGA5QTCEYH3H22ZGWUB4PSLWSKDOUGMXH7LAGRTZGO6NEYMQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.540291638 (566h58m39.893076746s) [noise=true , address=145.79.227.29:4973 , piece_id=7EWN3F2YPAAAMXRUZHQ7FPYME3PCS7YABMIWY75JXHY2E4PN52FQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.540795884 (566h58m39.893581022s) [noise=true , address=145.79.227.52:4474 , piece_id=AJ55FCPIVDMXVKKZ4VEX5DSJDHENFIWPYEXBRXZUAFD4FH2ERM3Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.544155669 (566h58m39.896940767s) [noise=true , address=145.79.227.25:4629 , piece_id=FE4IVKMTA2UCEVM3IFR6CBPRXIRK7CFJMV7UPO4NULLDPEMHI5GQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.552098143 (566h58m39.904883281s) [noise=true , address=145.79.227.46:4624 , piece_id=RLMCJZCLQM62QP3XQLDDQ22CLWHRASVOLU5CDXQVDPQ7ABHESU5Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.552115576 (566h58m39.904900674s) [noise=true , address=145.79.227.22:4518 , piece_id=QH2EP26EVUZVNQ4U3CJKZD5HLJ4OTLMDPZEVOW7SWA3RGRMZPVJA, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:05.041097924 (566h58m40.393883022s) [noise=true , address=66.23.193.175:4553 , piece_id=CUWCYLLGC2OZTEVGQTZH4H5DQWPRNZSNGW7LMZNM6U5KJI7ZCCIA, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:05.506063937 (566h58m40.858849035s) [noise=true , address=145.79.227.11:4736 , piece_id=DCW7GQ2BVMIED4W5FNS33XEDUEIT232O5NHZHGFPGGEFRL6IK3YQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1ejnWsitdrh68vSJvjR2QnRg4kva8DFRzqvvUuDkXM6zKUDWNC, address:145.79.227.11:4736): protocol: rpc: dial tcp 145.79.227.11:4736: connect: no route to host; manager closed: conn closed: op Sep 22 05:08:04.401016602 (566h59m39.75380173s) [noise=true , address=145.79.227.10:4419 , piece_id=JB2SSRHP2V2URKBPHPPLPML5SFLEUSF3WBA3HVLX3T5M7DK6TP5Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1YnhzSepDNJ6FEFq6ifLdmaGm7BZhMYs7JWbGmShbi38gSxxXL, address:145.79.227.10:4419): protocol: rpc: dial tcp 145.79.227.10:4419: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401091332 (566h59m39.753876461s) [noise=true , address=145.79.227.12:4782 , piece_id=Q2WT5KUQ4UWHYNV5SW6XOJ4AMNPDLGIFWR2BVNAQGDJJ3ECNHAJQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:17C7Wx6yE15jDtqqsQwWVj444YkvHBUWkkXjoCxfXPiErwyGKQ, address:145.79.227.12:4782): protocol: rpc: dial tcp 145.79.227.12:4782: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401101101 (566h59m39.753886229s) [noise=true , address=145.79.227.15:4890 , piece_id=SXSKTDJ6WKYGYLIHY7JPJU4CCIB57Y73COOERWFTPOVJDBAMHVAQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1gakF2Cctzc6EhFScfLfBHJdcDHqMBcey4mNoToEwbtk8Pwix5, address:145.79.227.15:4890): protocol: rpc: dial tcp 145.79.227.15:4890: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401148540 (566h59m39.753933678s) [noise=true , address=145.79.227.14:4866 , piece_id=NRUKXI3FQCGQI5WSURFOD5MWY5L5OJUV3B7RZLX33CAN5TXBCK4Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1zUcYfJE8xRW2Tow7bGB3PeNrVBUzVWR82JADkVwPdSr4CTPyr, address:145.79.227.14:4866): protocol: rpc: dial tcp 145.79.227.14:4866: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401183265 (566h59m39.753968403s) [noise=true , address=145.79.227.13:4815 , piece_id=FKNQGYM6WHIOTFUJOGQPTVBUCCMKIJKM5634ORIXIRIKXGDLAX7Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa, address:145.79.227.13:4815): protocol: rpc: dial tcp 145.79.227.13:4815: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401203854 (566h59m39.753988992s) [noise=true , address=145.79.227.2:4118 , piece_id=UMZVCTVPRDDERUTNRCRLPVCHJL6MSGHIGLEIXO66FQC7NP7RNCUQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:12ty5LHXwLmHC7nRPmVfj2wVEif6JQAQQ5Z5218vv1fKK5sD3zE, address:145.79.227.2:4118): protocol: rpc: dial tcp 145.79.227.2:4118: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401243117 (566h59m39.754028245s) [noise=true , address=145.79.227.8:4355 , piece_id=3VMN7GJIJ4DSSRBC3EXPJLXGAO2KIFJ3HUZXPBN4GC7CXOYNSXRA, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:12mRuEpX7CMxWXVdHrTi3zF3v9t3LcqE6mJKzocajEvYHM52a7T, address:145.79.227.8:4355): protocol: rpc: dial tcp 145.79.227.8:4355: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401288963 (566h59m39.754074102s) [seg_pos={0 0}, upload=498993]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Sep 22 05:08:04.415054225 (566h59m39.767839353s) [upload=498993]: Done uploading segments... Sep 22 05:08:04.415080705 (566h59m39.767865833s) [upload=498993]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 572.091275ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 4.896347588s FAIL (2025-09-22 05:13:28 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.89638063s core uplink ap1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [......XXX.XXXXX.........X........X..................X...X...] duration: 420.585938ms FAIL (2025-09-22 05:13:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 420.605064ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [.........X........................X...X.......X.X.......XXX.] duration: 402.648198ms FAIL (2025-09-22 05:13:03 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== Sep 22 05:11:57.112073114 (567h3m32.464858222s) [upload=499063]: Starting upload Sep 22 05:11:57.112127937 (567h3m32.464913045s) [upload=499063]: Done starting upload Sep 22 05:11:57.112228756 (567h3m32.465013864s) [upload=499063]: Uploading segments... Sep 22 05:11:57.112362668 (567h3m32.465147776s) [upload=499063]: Got next segment. Inline: false Sep 22 05:11:57.112406640 (567h3m32.465191748s) [upload=499063]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 05:11:57.112410588 (567h3m32.465195696s) [upload=499063]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 05:11:57.134405856 (567h3m32.487190964s) [seg_pos={0 0}, upload=499063]: Begin upload segment... Sep 22 05:11:57.134433548 (567h3m32.487218656s) [seg_pos={0 0}, upload=499063]: Done begin upload segment. Sep 22 05:11:57.134457292 (567h3m32.48724239s) [noise=true , address=145.79.227.17:4969 , piece_id=EGO5HLAX4B2DYEPI2PATJOABP7IPAP2IOE5TEREZWFJGWOTMW4TA, seg_pos={0 0}, upload=499063]: Uploading piece... Sep 22 05:11:57.134524087 (567h3m32.487309195s) [noise=true , address=77.90.31.19:4843 , piece_id=VQYZPNXBDZFSMBL3BWKZOMKYBQWZ4AHSUWQDWPKGYOD63Z6I73QQ, seg_pos={0 0}, upload=499063]: Uploading piece... Sep 22 05:11:57.134742867 (567h3m32.487527975s) [noise=true , address=145.79.227.16:4909 , piece_id=LGMTGCERC2EXNTLJOIRUKU5YAKO7REBXFT2222INHJYKQGNEASCQ, seg_pos={0 0}, upload=499063]: Uploading piece... Sep 22 05:11:57.134939737 (567h3m32.487724834s) [noise=true , address=145.79.227.19:4077 , piece_id=HIHNHTURC45W2R475XVPTLNJT5AW25EZG2JGSHMRWQP4LCQTOH2A, seg_pos={0 0}, upload=499063]: Uploading piece... Sep 22 05:11:57.135046597 (567h3m32.487831695s) [noise=true , address=77.90.31.13:4626 , piece_id=QDGDDO7N4IJGW5BZ3A7NETCYPKSNLM2ZVZPUP3ASWRKGLG67K4TA, seg_pos={0 0}, upload=499063]: Uploading piece... Sep 22 05:11:57.135167674 (567h3m32.487952772s) [noise=true , address=145.79.227.7:4294 , piece_id=WZ7MEFOHVM4O7KGNNEPCZV3NFK2VFEYUIJHTQ6WXU7SMRBTWNNJQ, seg_pos={0 0}, upload=499063]: Uploading piece... Sep 22 05:11:57.135287470 (567h3m32.488072578s) [noise=true , address=77.90.31.17:4772 , piece_id=R7NVJKGB6LAV2MASND23HWQF4WXXLSF5KRS5FJSBOWBBX3U6HIDA, seg_pos={0 0}, upload=499063]: Uploading piece... Sep 22 05:11:57.135418846 (567h3m32.488203945s) [noise=true , address=45.91.116.4:4939 , piece_id=5TBDO3W6A5LSMJJ75YLO5JCYMVQY5USFB6Y353JUG473MYBV6N6A, seg_pos={0 0}, upload=499063]: Uploading piece... Sep 22 05:11:57.135538891 (567h3m32.488323999s) [noise=true , address=77.90.31.15:4697 , piece_id=EUCFCFABS34G4RK36CEXSSTHN4LPB7ZDFMW5LFNVNBDI4TGFURKA, seg_pos={0 0}, upload=499063]: Uploading piece... Sep 22 05:11:57.135642426 (567h3m32.488427534s) [noise=true , address=145.79.227.14:4840 , piece_id=XPXL4LPVDZRPFDKQXQKXZ3WKUXVLLFZ2E7ZGETPYVL6P4ZVC6JTA, seg_pos={0 0}, upload=499063]: Uploading piece... Sep 22 05:11:57.135799511 (567h3m32.488584608s) [noise=true , address=45.91.116.7:4010 , piece_id=W4HQVFBNUJ4FCH3W56PG7FVENX666P5Y2KXNCY5W3VXKJS7YHB5A, seg_pos={0 0}, upload=499063]: Uploading piece... Sep 22 05:11:57.135878348 (567h3m32.488663456s) [noise=true , address=45.91.116.13:4153 , piece_id=MSENMIUQNO33WADWKUZ2GWKGAQNB3Q7IP4GJFO2D7MO3AX7UIOMA, seg_pos={0 0}, upload=499063]: Uploading piece... Sep 22 05:11:57.136131763 (567h3m32.488916861s) [noise=true , address=145.79.227.18:4005 , piece_id=G7DI6VKS6SOMGDIKLNPQZAQCNS2ETLR4A2Y42UCNJ3MIKGW4FERA, seg_pos={0 0}, upload=499063]: Uploading piece... Sep 22 05:11:57.136161469 (567h3m32.488946567s) [noise=true , address=45.91.116.6:4974 , piece_id=HDINQT7G5BLNUXMHK35VUBBNPDYHEYDVDXAQNNUNM7AI4KNB54KA, seg_pos={0 0}, upload=499063]: Uploading piece... Sep 22 05:11:57.136385841 (567h3m32.489170949s) [noise=true , address=145.79.227.5:4223 , piece_id=YAPRITWBMVCDXLXXMKYH5YMF7KE7T4RTZXP5MPG23MQPKJJUPVYQ, seg_pos={0 0}, upload=499063]: Uploading piece... Sep 22 05:11:57.136771975 (567h3m32.489557083s) [noise=true , address=45.91.116.14:4191 , piece_id=VTL6GZCVIAXQDKHEGFBFNGGDQR43SRZK5KBRMKZXGZAVXJLAMVXQ, seg_pos={0 0}, upload=499063]: Uploading piece... Sep 22 05:11:57.216252066 (567h3m32.569037174s) [upload=499063]: Next returned nil segment Sep 22 05:11:57.216265030 (567h3m32.569050138s) [upload=499063]: Waiting for error group managing segments... Sep 22 05:11:57.224707783 (567h3m32.577492872s) [noise=true , address=45.91.116.13:4153 , piece_id=MSENMIUQNO33WADWKUZ2GWKGAQNB3Q7IP4GJFO2D7MO3AX7UIOMA, seg_pos={0 0}, upload=499063]: Done uploading piece. err: <nil> Sep 22 05:11:57.224954578 (567h3m32.577739686s) [noise=true , address=45.91.116.14:4191 , piece_id=VTL6GZCVIAXQDKHEGFBFNGGDQR43SRZK5KBRMKZXGZAVXJLAMVXQ, seg_pos={0 0}, upload=499063]: Done uploading piece. err: <nil> Sep 22 05:11:57.225470746 (567h3m32.578255843s) [noise=true , address=77.90.31.17:4772 , piece_id=R7NVJKGB6LAV2MASND23HWQF4WXXLSF5KRS5FJSBOWBBX3U6HIDA, seg_pos={0 0}, upload=499063]: Done uploading piece. err: <nil> Sep 22 05:11:57.225617992 (567h3m32.5784031s) [noise=true , address=45.91.116.4:4939 , piece_id=5TBDO3W6A5LSMJJ75YLO5JCYMVQY5USFB6Y353JUG473MYBV6N6A, seg_pos={0 0}, upload=499063]: Done uploading piece. err: <nil> Sep 22 05:11:57.226075150 (567h3m32.578860248s) [noise=true , address=45.91.116.7:4010 , piece_id=W4HQVFBNUJ4FCH3W56PG7FVENX666P5Y2KXNCY5W3VXKJS7YHB5A, seg_pos={0 0}, upload=499063]: Done uploading piece. err: <nil> Sep 22 05:11:57.226401312 (567h3m32.57918642s) [noise=true , address=77.90.31.19:4843 , piece_id=VQYZPNXBDZFSMBL3BWKZOMKYBQWZ4AHSUWQDWPKGYOD63Z6I73QQ, seg_pos={0 0}, upload=499063]: Done uploading piece. err: <nil> Sep 22 05:11:57.226712867 (567h3m32.579497965s) [noise=true , address=45.91.116.6:4974 , piece_id=HDINQT7G5BLNUXMHK35VUBBNPDYHEYDVDXAQNNUNM7AI4KNB54KA, seg_pos={0 0}, upload=499063]: Done uploading piece. err: <nil> Sep 22 05:11:57.227507177 (567h3m32.580292275s) [noise=true , address=77.90.31.13:4626 , piece_id=QDGDDO7N4IJGW5BZ3A7NETCYPKSNLM2ZVZPUP3ASWRKGLG67K4TA, seg_pos={0 0}, upload=499063]: Done uploading piece. err: <nil> Sep 22 05:11:57.228017004 (567h3m32.580802112s) [noise=true , address=77.90.31.15:4697 , piece_id=EUCFCFABS34G4RK36CEXSSTHN4LPB7ZDFMW5LFNVNBDI4TGFURKA, seg_pos={0 0}, upload=499063]: Done uploading piece. err: <nil> Sep 22 05:11:59.713761469 (567h3m35.066546597s) [noise=true , address=145.79.227.16:4909 , piece_id=LGMTGCERC2EXNTLJOIRUKU5YAKO7REBXFT2222INHJYKQGNEASCQ, seg_pos={0 0}, upload=499063]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: rpc: dial tcp 145.79.227.16:4909: connect: no route to host; manager closed: conn closed: op Sep 22 05:12:01.733738038 (567h3m37.086523165s) [noise=true , address=145.79.227.14:4840 , piece_id=XPXL4LPVDZRPFDKQXQKXZ3WKUXVLLFZ2E7ZGETPYVL6P4ZVC6JTA, seg_pos={0 0}, upload=499063]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: rpc: dial tcp 145.79.227.14:4840: connect: no route to host; conn closed: op Sep 22 05:12:27.097143123 (567h4m2.449928231s) [noise=true , address=145.79.227.18:4005 , piece_id=G7DI6VKS6SOMGDIKLNPQZAQCNS2ETLR4A2Y42UCNJ3MIKGW4FERA, seg_pos={0 0}, upload=499063]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:12:27.097261665 (567h4m2.450046762s) [noise=true , address=145.79.227.17:4969 , piece_id=EGO5HLAX4B2DYEPI2PATJOABP7IPAP2IOE5TEREZWFJGWOTMW4TA, seg_pos={0 0}, upload=499063]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:12:27.097314384 (567h4m2.450099483s) [noise=true , address=145.79.227.19:4077 , piece_id=HIHNHTURC45W2R475XVPTLNJT5AW25EZG2JGSHMRWQP4LCQTOH2A, seg_pos={0 0}, upload=499063]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:12:27.097326657 (567h4m2.450111765s) [noise=true , address=145.79.227.7:4294 , piece_id=WZ7MEFOHVM4O7KGNNEPCZV3NFK2VFEYUIJHTQ6WXU7SMRBTWNNJQ, seg_pos={0 0}, upload=499063]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: rpc: dial tcp 145.79.227.7:4294: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:12:27.097348128 (567h4m2.450133226s) [noise=true , address=145.79.227.5:4223 , piece_id=YAPRITWBMVCDXLXXMKYH5YMF7KE7T4RTZXP5MPG23MQPKJJUPVYQ, seg_pos={0 0}, upload=499063]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: rpc: dial tcp 145.79.227.5:4223: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:12:27.097367845 (567h4m2.450152953s) [seg_pos={0 0}, upload=499063]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Sep 22 05:12:27.109025271 (567h4m2.461810369s) [upload=499063]: Done uploading segments... Sep 22 05:12:27.109036942 (567h4m2.46182204s) [upload=499063]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 402.667814ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.......XXX.XXXXX.........X........X..................X...X..] duration: 390.260872ms FAIL (2025-09-22 05:12:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 390.409982ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 3 out of 60 is failed (threshold=3) [...............................................X.X..X.......] duration: 348.498809ms FAIL (2025-09-22 05:12:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== .79.227.27:4717 , piece_id=BJYH4RBBMPRDAB7I3S64JA2RKDSZWEW5WZESL4UBGMHIJ3DJZOFA, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.443356010 (566h58m39.796141139s) [noise=true , address=145.79.227.15:4890 , piece_id=SXSKTDJ6WKYGYLIHY7JPJU4CCIB57Y73COOERWFTPOVJDBAMHVAQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.443765328 (566h58m39.796550456s) [noise=true , address=145.79.227.33:4892 , piece_id=IRPSKGA5QTCEYH3H22ZGWUB4PSLWSKDOUGMXH7LAGRTZGO6NEYMQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444090558 (566h58m39.796875686s) [noise=true , address=145.79.227.29:4973 , piece_id=7EWN3F2YPAAAMXRUZHQ7FPYME3PCS7YABMIWY75JXHY2E4PN52FQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444188903 (566h58m39.79697403s) [noise=true , address=145.79.227.10:4419 , piece_id=JB2SSRHP2V2URKBPHPPLPML5SFLEUSF3WBA3HVLX3T5M7DK6TP5Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444577773 (566h58m39.797362901s) [noise=true , address=145.79.227.52:4474 , piece_id=AJ55FCPIVDMXVKKZ4VEX5DSJDHENFIWPYEXBRXZUAFD4FH2ERM3Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444677179 (566h58m39.797462307s) [noise=true , address=145.79.227.25:4629 , piece_id=FE4IVKMTA2UCEVM3IFR6CBPRXIRK7CFJMV7UPO4NULLDPEMHI5GQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444962344 (566h58m39.797747472s) [noise=true , address=145.79.227.22:4518 , piece_id=QH2EP26EVUZVNQ4U3CJKZD5HLJ4OTLMDPZEVOW7SWA3RGRMZPVJA, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.445216612 (566h58m39.79800174s) [noise=true , address=145.79.227.13:4815 , piece_id=FKNQGYM6WHIOTFUJOGQPTVBUCCMKIJKM5634ORIXIRIKXGDLAX7Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.445329904 (566h58m39.798115033s) [noise=true , address=145.79.227.30:4790 , piece_id=NFLSQZPJ6PTFYTBRAZGGIZWJAJHYPSTIKYCHGMOK3NV562QQDX4A, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.445688447 (566h58m39.798473585s) [noise=true , address=145.79.227.46:4624 , piece_id=RLMCJZCLQM62QP3XQLDDQ22CLWHRASVOLU5CDXQVDPQ7ABHESU5Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.445754561 (566h58m39.798539689s) [noise=true , address=145.79.227.14:4866 , piece_id=NRUKXI3FQCGQI5WSURFOD5MWY5L5OJUV3B7RZLX33CAN5TXBCK4Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.446085091 (566h58m39.79887022s) [noise=true , address=77.90.31.18:4831 , piece_id=6YYF7O7WASB7L4BUMO6FRX3NGH3QPEB2EDMGZ52RUZYPEXI2D5CQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.446552749 (566h58m39.799337917s) [noise=true , address=66.23.193.175:4553 , piece_id=CUWCYLLGC2OZTEVGQTZH4H5DQWPRNZSNGW7LMZNM6U5KJI7ZCCIA, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.447022330 (566h58m39.799807459s) [noise=true , address=145.79.227.8:4355 , piece_id=3VMN7GJIJ4DSSRBC3EXPJLXGAO2KIFJ3HUZXPBN4GC7CXOYNSXRA, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.447446877 (566h58m39.800232005s) [noise=true , address=145.79.227.2:4118 , piece_id=UMZVCTVPRDDERUTNRCRLPVCHJL6MSGHIGLEIXO66FQC7NP7RNCUQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.447878927 (566h58m39.800664056s) [noise=true , address=145.79.227.12:4782 , piece_id=Q2WT5KUQ4UWHYNV5SW6XOJ4AMNPDLGIFWR2BVNAQGDJJ3ECNHAJQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.448061300 (566h58m39.800846428s) [noise=true , address=145.79.227.11:4736 , piece_id=DCW7GQ2BVMIED4W5FNS33XEDUEIT232O5NHZHGFPGGEFRL6IK3YQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.528619474 (566h58m39.881404572s) [upload=498993]: Next returned nil segment Sep 22 05:07:04.528630534 (566h58m39.881415643s) [upload=498993]: Waiting for error group managing segments... Sep 22 05:07:04.538575067 (566h58m39.891360164s) [noise=true , address=145.79.227.30:4790 , piece_id=NFLSQZPJ6PTFYTBRAZGGIZWJAJHYPSTIKYCHGMOK3NV562QQDX4A, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.539546860 (566h58m39.892331958s) [noise=true , address=145.79.227.27:4717 , piece_id=BJYH4RBBMPRDAB7I3S64JA2RKDSZWEW5WZESL4UBGMHIJ3DJZOFA, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.539973170 (566h58m39.892758267s) [noise=true , address=77.90.31.18:4831 , piece_id=6YYF7O7WASB7L4BUMO6FRX3NGH3QPEB2EDMGZ52RUZYPEXI2D5CQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.540146776 (566h58m39.892931913s) [noise=true , address=145.79.227.33:4892 , piece_id=IRPSKGA5QTCEYH3H22ZGWUB4PSLWSKDOUGMXH7LAGRTZGO6NEYMQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.540291638 (566h58m39.893076746s) [noise=true , address=145.79.227.29:4973 , piece_id=7EWN3F2YPAAAMXRUZHQ7FPYME3PCS7YABMIWY75JXHY2E4PN52FQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.540795884 (566h58m39.893581022s) [noise=true , address=145.79.227.52:4474 , piece_id=AJ55FCPIVDMXVKKZ4VEX5DSJDHENFIWPYEXBRXZUAFD4FH2ERM3Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.544155669 (566h58m39.896940767s) [noise=true , address=145.79.227.25:4629 , piece_id=FE4IVKMTA2UCEVM3IFR6CBPRXIRK7CFJMV7UPO4NULLDPEMHI5GQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.552098143 (566h58m39.904883281s) [noise=true , address=145.79.227.46:4624 , piece_id=RLMCJZCLQM62QP3XQLDDQ22CLWHRASVOLU5CDXQVDPQ7ABHESU5Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.552115576 (566h58m39.904900674s) [noise=true , address=145.79.227.22:4518 , piece_id=QH2EP26EVUZVNQ4U3CJKZD5HLJ4OTLMDPZEVOW7SWA3RGRMZPVJA, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:05.041097924 (566h58m40.393883022s) [noise=true , address=66.23.193.175:4553 , piece_id=CUWCYLLGC2OZTEVGQTZH4H5DQWPRNZSNGW7LMZNM6U5KJI7ZCCIA, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:05.506063937 (566h58m40.858849035s) [noise=true , address=145.79.227.11:4736 , piece_id=DCW7GQ2BVMIED4W5FNS33XEDUEIT232O5NHZHGFPGGEFRL6IK3YQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1ejnWsitdrh68vSJvjR2QnRg4kva8DFRzqvvUuDkXM6zKUDWNC, address:145.79.227.11:4736): protocol: rpc: dial tcp 145.79.227.11:4736: connect: no route to host; manager closed: conn closed: op Sep 22 05:08:04.401016602 (566h59m39.75380173s) [noise=true , address=145.79.227.10:4419 , piece_id=JB2SSRHP2V2URKBPHPPLPML5SFLEUSF3WBA3HVLX3T5M7DK6TP5Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1YnhzSepDNJ6FEFq6ifLdmaGm7BZhMYs7JWbGmShbi38gSxxXL, address:145.79.227.10:4419): protocol: rpc: dial tcp 145.79.227.10:4419: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401091332 (566h59m39.753876461s) [noise=true , address=145.79.227.12:4782 , piece_id=Q2WT5KUQ4UWHYNV5SW6XOJ4AMNPDLGIFWR2BVNAQGDJJ3ECNHAJQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:17C7Wx6yE15jDtqqsQwWVj444YkvHBUWkkXjoCxfXPiErwyGKQ, address:145.79.227.12:4782): protocol: rpc: dial tcp 145.79.227.12:4782: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401101101 (566h59m39.753886229s) [noise=true , address=145.79.227.15:4890 , piece_id=SXSKTDJ6WKYGYLIHY7JPJU4CCIB57Y73COOERWFTPOVJDBAMHVAQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1gakF2Cctzc6EhFScfLfBHJdcDHqMBcey4mNoToEwbtk8Pwix5, address:145.79.227.15:4890): protocol: rpc: dial tcp 145.79.227.15:4890: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401148540 (566h59m39.753933678s) [noise=true , address=145.79.227.14:4866 , piece_id=NRUKXI3FQCGQI5WSURFOD5MWY5L5OJUV3B7RZLX33CAN5TXBCK4Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1zUcYfJE8xRW2Tow7bGB3PeNrVBUzVWR82JADkVwPdSr4CTPyr, address:145.79.227.14:4866): protocol: rpc: dial tcp 145.79.227.14:4866: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401183265 (566h59m39.753968403s) [noise=true , address=145.79.227.13:4815 , piece_id=FKNQGYM6WHIOTFUJOGQPTVBUCCMKIJKM5634ORIXIRIKXGDLAX7Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa, address:145.79.227.13:4815): protocol: rpc: dial tcp 145.79.227.13:4815: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401203854 (566h59m39.753988992s) [noise=true , address=145.79.227.2:4118 , piece_id=UMZVCTVPRDDERUTNRCRLPVCHJL6MSGHIGLEIXO66FQC7NP7RNCUQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:12ty5LHXwLmHC7nRPmVfj2wVEif6JQAQQ5Z5218vv1fKK5sD3zE, address:145.79.227.2:4118): protocol: rpc: dial tcp 145.79.227.2:4118: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401243117 (566h59m39.754028245s) [noise=true , address=145.79.227.8:4355 , piece_id=3VMN7GJIJ4DSSRBC3EXPJLXGAO2KIFJ3HUZXPBN4GC7CXOYNSXRA, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:12mRuEpX7CMxWXVdHrTi3zF3v9t3LcqE6mJKzocajEvYHM52a7T, address:145.79.227.8:4355): protocol: rpc: dial tcp 145.79.227.8:4355: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401288963 (566h59m39.754074102s) [seg_pos={0 0}, upload=498993]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Sep 22 05:08:04.415054225 (566h59m39.767839353s) [upload=498993]: Done uploading segments... Sep 22 05:08:04.415080705 (566h59m39.767865833s) [upload=498993]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 348.521711ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [..........X........................X...X.......X.X.......XXX] duration: 30.013023215s FAIL (2025-09-22 05:12:27 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== Sep 22 05:11:57.112073114 (567h3m32.464858222s) [upload=499063]: Starting upload Sep 22 05:11:57.112127937 (567h3m32.464913045s) [upload=499063]: Done starting upload Sep 22 05:11:57.112228756 (567h3m32.465013864s) [upload=499063]: Uploading segments... Sep 22 05:11:57.112362668 (567h3m32.465147776s) [upload=499063]: Got next segment. Inline: false Sep 22 05:11:57.112406640 (567h3m32.465191748s) [upload=499063]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 05:11:57.112410588 (567h3m32.465195696s) [upload=499063]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 05:11:57.134405856 (567h3m32.487190964s) [seg_pos={0 0}, upload=499063]: Begin upload segment... Sep 22 05:11:57.134433548 (567h3m32.487218656s) [seg_pos={0 0}, upload=499063]: Done begin upload segment. Sep 22 05:11:57.134457292 (567h3m32.48724239s) [noise=true , address=145.79.227.17:4969 , piece_id=EGO5HLAX4B2DYEPI2PATJOABP7IPAP2IOE5TEREZWFJGWOTMW4TA, seg_pos={0 0}, upload=499063]: Uploading piece... Sep 22 05:11:57.134524087 (567h3m32.487309195s) [noise=true , address=77.90.31.19:4843 , piece_id=VQYZPNXBDZFSMBL3BWKZOMKYBQWZ4AHSUWQDWPKGYOD63Z6I73QQ, seg_pos={0 0}, upload=499063]: Uploading piece... Sep 22 05:11:57.134742867 (567h3m32.487527975s) [noise=true , address=145.79.227.16:4909 , piece_id=LGMTGCERC2EXNTLJOIRUKU5YAKO7REBXFT2222INHJYKQGNEASCQ, seg_pos={0 0}, upload=499063]: Uploading piece... Sep 22 05:11:57.134939737 (567h3m32.487724834s) [noise=true , address=145.79.227.19:4077 , piece_id=HIHNHTURC45W2R475XVPTLNJT5AW25EZG2JGSHMRWQP4LCQTOH2A, seg_pos={0 0}, upload=499063]: Uploading piece... Sep 22 05:11:57.135046597 (567h3m32.487831695s) [noise=true , address=77.90.31.13:4626 , piece_id=QDGDDO7N4IJGW5BZ3A7NETCYPKSNLM2ZVZPUP3ASWRKGLG67K4TA, seg_pos={0 0}, upload=499063]: Uploading piece... Sep 22 05:11:57.135167674 (567h3m32.487952772s) [noise=true , address=145.79.227.7:4294 , piece_id=WZ7MEFOHVM4O7KGNNEPCZV3NFK2VFEYUIJHTQ6WXU7SMRBTWNNJQ, seg_pos={0 0}, upload=499063]: Uploading piece... Sep 22 05:11:57.135287470 (567h3m32.488072578s) [noise=true , address=77.90.31.17:4772 , piece_id=R7NVJKGB6LAV2MASND23HWQF4WXXLSF5KRS5FJSBOWBBX3U6HIDA, seg_pos={0 0}, upload=499063]: Uploading piece... Sep 22 05:11:57.135418846 (567h3m32.488203945s) [noise=true , address=45.91.116.4:4939 , piece_id=5TBDO3W6A5LSMJJ75YLO5JCYMVQY5USFB6Y353JUG473MYBV6N6A, seg_pos={0 0}, upload=499063]: Uploading piece... Sep 22 05:11:57.135538891 (567h3m32.488323999s) [noise=true , address=77.90.31.15:4697 , piece_id=EUCFCFABS34G4RK36CEXSSTHN4LPB7ZDFMW5LFNVNBDI4TGFURKA, seg_pos={0 0}, upload=499063]: Uploading piece... Sep 22 05:11:57.135642426 (567h3m32.488427534s) [noise=true , address=145.79.227.14:4840 , piece_id=XPXL4LPVDZRPFDKQXQKXZ3WKUXVLLFZ2E7ZGETPYVL6P4ZVC6JTA, seg_pos={0 0}, upload=499063]: Uploading piece... Sep 22 05:11:57.135799511 (567h3m32.488584608s) [noise=true , address=45.91.116.7:4010 , piece_id=W4HQVFBNUJ4FCH3W56PG7FVENX666P5Y2KXNCY5W3VXKJS7YHB5A, seg_pos={0 0}, upload=499063]: Uploading piece... Sep 22 05:11:57.135878348 (567h3m32.488663456s) [noise=true , address=45.91.116.13:4153 , piece_id=MSENMIUQNO33WADWKUZ2GWKGAQNB3Q7IP4GJFO2D7MO3AX7UIOMA, seg_pos={0 0}, upload=499063]: Uploading piece... Sep 22 05:11:57.136131763 (567h3m32.488916861s) [noise=true , address=145.79.227.18:4005 , piece_id=G7DI6VKS6SOMGDIKLNPQZAQCNS2ETLR4A2Y42UCNJ3MIKGW4FERA, seg_pos={0 0}, upload=499063]: Uploading piece... Sep 22 05:11:57.136161469 (567h3m32.488946567s) [noise=true , address=45.91.116.6:4974 , piece_id=HDINQT7G5BLNUXMHK35VUBBNPDYHEYDVDXAQNNUNM7AI4KNB54KA, seg_pos={0 0}, upload=499063]: Uploading piece... Sep 22 05:11:57.136385841 (567h3m32.489170949s) [noise=true , address=145.79.227.5:4223 , piece_id=YAPRITWBMVCDXLXXMKYH5YMF7KE7T4RTZXP5MPG23MQPKJJUPVYQ, seg_pos={0 0}, upload=499063]: Uploading piece... Sep 22 05:11:57.136771975 (567h3m32.489557083s) [noise=true , address=45.91.116.14:4191 , piece_id=VTL6GZCVIAXQDKHEGFBFNGGDQR43SRZK5KBRMKZXGZAVXJLAMVXQ, seg_pos={0 0}, upload=499063]: Uploading piece... Sep 22 05:11:57.216252066 (567h3m32.569037174s) [upload=499063]: Next returned nil segment Sep 22 05:11:57.216265030 (567h3m32.569050138s) [upload=499063]: Waiting for error group managing segments... Sep 22 05:11:57.224707783 (567h3m32.577492872s) [noise=true , address=45.91.116.13:4153 , piece_id=MSENMIUQNO33WADWKUZ2GWKGAQNB3Q7IP4GJFO2D7MO3AX7UIOMA, seg_pos={0 0}, upload=499063]: Done uploading piece. err: <nil> Sep 22 05:11:57.224954578 (567h3m32.577739686s) [noise=true , address=45.91.116.14:4191 , piece_id=VTL6GZCVIAXQDKHEGFBFNGGDQR43SRZK5KBRMKZXGZAVXJLAMVXQ, seg_pos={0 0}, upload=499063]: Done uploading piece. err: <nil> Sep 22 05:11:57.225470746 (567h3m32.578255843s) [noise=true , address=77.90.31.17:4772 , piece_id=R7NVJKGB6LAV2MASND23HWQF4WXXLSF5KRS5FJSBOWBBX3U6HIDA, seg_pos={0 0}, upload=499063]: Done uploading piece. err: <nil> Sep 22 05:11:57.225617992 (567h3m32.5784031s) [noise=true , address=45.91.116.4:4939 , piece_id=5TBDO3W6A5LSMJJ75YLO5JCYMVQY5USFB6Y353JUG473MYBV6N6A, seg_pos={0 0}, upload=499063]: Done uploading piece. err: <nil> Sep 22 05:11:57.226075150 (567h3m32.578860248s) [noise=true , address=45.91.116.7:4010 , piece_id=W4HQVFBNUJ4FCH3W56PG7FVENX666P5Y2KXNCY5W3VXKJS7YHB5A, seg_pos={0 0}, upload=499063]: Done uploading piece. err: <nil> Sep 22 05:11:57.226401312 (567h3m32.57918642s) [noise=true , address=77.90.31.19:4843 , piece_id=VQYZPNXBDZFSMBL3BWKZOMKYBQWZ4AHSUWQDWPKGYOD63Z6I73QQ, seg_pos={0 0}, upload=499063]: Done uploading piece. err: <nil> Sep 22 05:11:57.226712867 (567h3m32.579497965s) [noise=true , address=45.91.116.6:4974 , piece_id=HDINQT7G5BLNUXMHK35VUBBNPDYHEYDVDXAQNNUNM7AI4KNB54KA, seg_pos={0 0}, upload=499063]: Done uploading piece. err: <nil> Sep 22 05:11:57.227507177 (567h3m32.580292275s) [noise=true , address=77.90.31.13:4626 , piece_id=QDGDDO7N4IJGW5BZ3A7NETCYPKSNLM2ZVZPUP3ASWRKGLG67K4TA, seg_pos={0 0}, upload=499063]: Done uploading piece. err: <nil> Sep 22 05:11:57.228017004 (567h3m32.580802112s) [noise=true , address=77.90.31.15:4697 , piece_id=EUCFCFABS34G4RK36CEXSSTHN4LPB7ZDFMW5LFNVNBDI4TGFURKA, seg_pos={0 0}, upload=499063]: Done uploading piece. err: <nil> Sep 22 05:11:59.713761469 (567h3m35.066546597s) [noise=true , address=145.79.227.16:4909 , piece_id=LGMTGCERC2EXNTLJOIRUKU5YAKO7REBXFT2222INHJYKQGNEASCQ, seg_pos={0 0}, upload=499063]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: rpc: dial tcp 145.79.227.16:4909: connect: no route to host; manager closed: conn closed: op Sep 22 05:12:01.733738038 (567h3m37.086523165s) [noise=true , address=145.79.227.14:4840 , piece_id=XPXL4LPVDZRPFDKQXQKXZ3WKUXVLLFZ2E7ZGETPYVL6P4ZVC6JTA, seg_pos={0 0}, upload=499063]: Done uploading piece. err: ecclient: upload failed (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww, address:145.79.227.14:4840): protocol: rpc: dial tcp 145.79.227.14:4840: connect: no route to host; conn closed: op Sep 22 05:12:27.097143123 (567h4m2.449928231s) [noise=true , address=145.79.227.18:4005 , piece_id=G7DI6VKS6SOMGDIKLNPQZAQCNS2ETLR4A2Y42UCNJ3MIKGW4FERA, seg_pos={0 0}, upload=499063]: Done uploading piece. err: ecclient: upload failed (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ, address:145.79.227.18:4005): protocol: rpc: dial tcp 145.79.227.18:4005: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:12:27.097261665 (567h4m2.450046762s) [noise=true , address=145.79.227.17:4969 , piece_id=EGO5HLAX4B2DYEPI2PATJOABP7IPAP2IOE5TEREZWFJGWOTMW4TA, seg_pos={0 0}, upload=499063]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:12:27.097314384 (567h4m2.450099483s) [noise=true , address=145.79.227.19:4077 , piece_id=HIHNHTURC45W2R475XVPTLNJT5AW25EZG2JGSHMRWQP4LCQTOH2A, seg_pos={0 0}, upload=499063]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:12:27.097326657 (567h4m2.450111765s) [noise=true , address=145.79.227.7:4294 , piece_id=WZ7MEFOHVM4O7KGNNEPCZV3NFK2VFEYUIJHTQ6WXU7SMRBTWNNJQ, seg_pos={0 0}, upload=499063]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:145.79.227.7:4294): protocol: rpc: dial tcp 145.79.227.7:4294: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:12:27.097348128 (567h4m2.450133226s) [noise=true , address=145.79.227.5:4223 , piece_id=YAPRITWBMVCDXLXXMKYH5YMF7KE7T4RTZXP5MPG23MQPKJJUPVYQ, seg_pos={0 0}, upload=499063]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: rpc: dial tcp 145.79.227.5:4223: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:12:27.097367845 (567h4m2.450152953s) [seg_pos={0 0}, upload=499063]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Sep 22 05:12:27.109025271 (567h4m2.461810369s) [upload=499063]: Done uploading segments... Sep 22 05:12:27.109036942 (567h4m2.46182204s) [upload=499063]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 30.013050896s core uplink us-select-1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 5.069481861s FAIL (2025-09-22 05:12:16 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.069501689s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 3 out of 60 is failed (threshold=3) [................................................X.X..X......] duration: 460.066214ms FAIL (2025-09-22 05:12:10 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== .79.227.27:4717 , piece_id=BJYH4RBBMPRDAB7I3S64JA2RKDSZWEW5WZESL4UBGMHIJ3DJZOFA, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.443356010 (566h58m39.796141139s) [noise=true , address=145.79.227.15:4890 , piece_id=SXSKTDJ6WKYGYLIHY7JPJU4CCIB57Y73COOERWFTPOVJDBAMHVAQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.443765328 (566h58m39.796550456s) [noise=true , address=145.79.227.33:4892 , piece_id=IRPSKGA5QTCEYH3H22ZGWUB4PSLWSKDOUGMXH7LAGRTZGO6NEYMQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444090558 (566h58m39.796875686s) [noise=true , address=145.79.227.29:4973 , piece_id=7EWN3F2YPAAAMXRUZHQ7FPYME3PCS7YABMIWY75JXHY2E4PN52FQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444188903 (566h58m39.79697403s) [noise=true , address=145.79.227.10:4419 , piece_id=JB2SSRHP2V2URKBPHPPLPML5SFLEUSF3WBA3HVLX3T5M7DK6TP5Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444577773 (566h58m39.797362901s) [noise=true , address=145.79.227.52:4474 , piece_id=AJ55FCPIVDMXVKKZ4VEX5DSJDHENFIWPYEXBRXZUAFD4FH2ERM3Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444677179 (566h58m39.797462307s) [noise=true , address=145.79.227.25:4629 , piece_id=FE4IVKMTA2UCEVM3IFR6CBPRXIRK7CFJMV7UPO4NULLDPEMHI5GQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444962344 (566h58m39.797747472s) [noise=true , address=145.79.227.22:4518 , piece_id=QH2EP26EVUZVNQ4U3CJKZD5HLJ4OTLMDPZEVOW7SWA3RGRMZPVJA, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.445216612 (566h58m39.79800174s) [noise=true , address=145.79.227.13:4815 , piece_id=FKNQGYM6WHIOTFUJOGQPTVBUCCMKIJKM5634ORIXIRIKXGDLAX7Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.445329904 (566h58m39.798115033s) [noise=true , address=145.79.227.30:4790 , piece_id=NFLSQZPJ6PTFYTBRAZGGIZWJAJHYPSTIKYCHGMOK3NV562QQDX4A, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.445688447 (566h58m39.798473585s) [noise=true , address=145.79.227.46:4624 , piece_id=RLMCJZCLQM62QP3XQLDDQ22CLWHRASVOLU5CDXQVDPQ7ABHESU5Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.445754561 (566h58m39.798539689s) [noise=true , address=145.79.227.14:4866 , piece_id=NRUKXI3FQCGQI5WSURFOD5MWY5L5OJUV3B7RZLX33CAN5TXBCK4Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.446085091 (566h58m39.79887022s) [noise=true , address=77.90.31.18:4831 , piece_id=6YYF7O7WASB7L4BUMO6FRX3NGH3QPEB2EDMGZ52RUZYPEXI2D5CQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.446552749 (566h58m39.799337917s) [noise=true , address=66.23.193.175:4553 , piece_id=CUWCYLLGC2OZTEVGQTZH4H5DQWPRNZSNGW7LMZNM6U5KJI7ZCCIA, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.447022330 (566h58m39.799807459s) [noise=true , address=145.79.227.8:4355 , piece_id=3VMN7GJIJ4DSSRBC3EXPJLXGAO2KIFJ3HUZXPBN4GC7CXOYNSXRA, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.447446877 (566h58m39.800232005s) [noise=true , address=145.79.227.2:4118 , piece_id=UMZVCTVPRDDERUTNRCRLPVCHJL6MSGHIGLEIXO66FQC7NP7RNCUQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.447878927 (566h58m39.800664056s) [noise=true , address=145.79.227.12:4782 , piece_id=Q2WT5KUQ4UWHYNV5SW6XOJ4AMNPDLGIFWR2BVNAQGDJJ3ECNHAJQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.448061300 (566h58m39.800846428s) [noise=true , address=145.79.227.11:4736 , piece_id=DCW7GQ2BVMIED4W5FNS33XEDUEIT232O5NHZHGFPGGEFRL6IK3YQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.528619474 (566h58m39.881404572s) [upload=498993]: Next returned nil segment Sep 22 05:07:04.528630534 (566h58m39.881415643s) [upload=498993]: Waiting for error group managing segments... Sep 22 05:07:04.538575067 (566h58m39.891360164s) [noise=true , address=145.79.227.30:4790 , piece_id=NFLSQZPJ6PTFYTBRAZGGIZWJAJHYPSTIKYCHGMOK3NV562QQDX4A, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.539546860 (566h58m39.892331958s) [noise=true , address=145.79.227.27:4717 , piece_id=BJYH4RBBMPRDAB7I3S64JA2RKDSZWEW5WZESL4UBGMHIJ3DJZOFA, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.539973170 (566h58m39.892758267s) [noise=true , address=77.90.31.18:4831 , piece_id=6YYF7O7WASB7L4BUMO6FRX3NGH3QPEB2EDMGZ52RUZYPEXI2D5CQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.540146776 (566h58m39.892931913s) [noise=true , address=145.79.227.33:4892 , piece_id=IRPSKGA5QTCEYH3H22ZGWUB4PSLWSKDOUGMXH7LAGRTZGO6NEYMQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.540291638 (566h58m39.893076746s) [noise=true , address=145.79.227.29:4973 , piece_id=7EWN3F2YPAAAMXRUZHQ7FPYME3PCS7YABMIWY75JXHY2E4PN52FQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.540795884 (566h58m39.893581022s) [noise=true , address=145.79.227.52:4474 , piece_id=AJ55FCPIVDMXVKKZ4VEX5DSJDHENFIWPYEXBRXZUAFD4FH2ERM3Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.544155669 (566h58m39.896940767s) [noise=true , address=145.79.227.25:4629 , piece_id=FE4IVKMTA2UCEVM3IFR6CBPRXIRK7CFJMV7UPO4NULLDPEMHI5GQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.552098143 (566h58m39.904883281s) [noise=true , address=145.79.227.46:4624 , piece_id=RLMCJZCLQM62QP3XQLDDQ22CLWHRASVOLU5CDXQVDPQ7ABHESU5Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.552115576 (566h58m39.904900674s) [noise=true , address=145.79.227.22:4518 , piece_id=QH2EP26EVUZVNQ4U3CJKZD5HLJ4OTLMDPZEVOW7SWA3RGRMZPVJA, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:05.041097924 (566h58m40.393883022s) [noise=true , address=66.23.193.175:4553 , piece_id=CUWCYLLGC2OZTEVGQTZH4H5DQWPRNZSNGW7LMZNM6U5KJI7ZCCIA, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:05.506063937 (566h58m40.858849035s) [noise=true , address=145.79.227.11:4736 , piece_id=DCW7GQ2BVMIED4W5FNS33XEDUEIT232O5NHZHGFPGGEFRL6IK3YQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1ejnWsitdrh68vSJvjR2QnRg4kva8DFRzqvvUuDkXM6zKUDWNC, address:145.79.227.11:4736): protocol: rpc: dial tcp 145.79.227.11:4736: connect: no route to host; manager closed: conn closed: op Sep 22 05:08:04.401016602 (566h59m39.75380173s) [noise=true , address=145.79.227.10:4419 , piece_id=JB2SSRHP2V2URKBPHPPLPML5SFLEUSF3WBA3HVLX3T5M7DK6TP5Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1YnhzSepDNJ6FEFq6ifLdmaGm7BZhMYs7JWbGmShbi38gSxxXL, address:145.79.227.10:4419): protocol: rpc: dial tcp 145.79.227.10:4419: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401091332 (566h59m39.753876461s) [noise=true , address=145.79.227.12:4782 , piece_id=Q2WT5KUQ4UWHYNV5SW6XOJ4AMNPDLGIFWR2BVNAQGDJJ3ECNHAJQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:17C7Wx6yE15jDtqqsQwWVj444YkvHBUWkkXjoCxfXPiErwyGKQ, address:145.79.227.12:4782): protocol: rpc: dial tcp 145.79.227.12:4782: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401101101 (566h59m39.753886229s) [noise=true , address=145.79.227.15:4890 , piece_id=SXSKTDJ6WKYGYLIHY7JPJU4CCIB57Y73COOERWFTPOVJDBAMHVAQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1gakF2Cctzc6EhFScfLfBHJdcDHqMBcey4mNoToEwbtk8Pwix5, address:145.79.227.15:4890): protocol: rpc: dial tcp 145.79.227.15:4890: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401148540 (566h59m39.753933678s) [noise=true , address=145.79.227.14:4866 , piece_id=NRUKXI3FQCGQI5WSURFOD5MWY5L5OJUV3B7RZLX33CAN5TXBCK4Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1zUcYfJE8xRW2Tow7bGB3PeNrVBUzVWR82JADkVwPdSr4CTPyr, address:145.79.227.14:4866): protocol: rpc: dial tcp 145.79.227.14:4866: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401183265 (566h59m39.753968403s) [noise=true , address=145.79.227.13:4815 , piece_id=FKNQGYM6WHIOTFUJOGQPTVBUCCMKIJKM5634ORIXIRIKXGDLAX7Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa, address:145.79.227.13:4815): protocol: rpc: dial tcp 145.79.227.13:4815: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401203854 (566h59m39.753988992s) [noise=true , address=145.79.227.2:4118 , piece_id=UMZVCTVPRDDERUTNRCRLPVCHJL6MSGHIGLEIXO66FQC7NP7RNCUQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:12ty5LHXwLmHC7nRPmVfj2wVEif6JQAQQ5Z5218vv1fKK5sD3zE, address:145.79.227.2:4118): protocol: rpc: dial tcp 145.79.227.2:4118: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401243117 (566h59m39.754028245s) [noise=true , address=145.79.227.8:4355 , piece_id=3VMN7GJIJ4DSSRBC3EXPJLXGAO2KIFJ3HUZXPBN4GC7CXOYNSXRA, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:12mRuEpX7CMxWXVdHrTi3zF3v9t3LcqE6mJKzocajEvYHM52a7T, address:145.79.227.8:4355): protocol: rpc: dial tcp 145.79.227.8:4355: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401288963 (566h59m39.754074102s) [seg_pos={0 0}, upload=498993]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Sep 22 05:08:04.415054225 (566h59m39.767839353s) [upload=498993]: Done uploading segments... Sep 22 05:08:04.415080705 (566h59m39.767865833s) [upload=498993]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 460.092173ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [........XXX.XXXXX.........X........X..................X...X.] duration: 434.669093ms FAIL (2025-09-22 05:12:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 434.688049ms edge gateway us-select-1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 5.096062494s FAIL (2025-09-22 05:11:51 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.096077954s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 3 out of 60 is failed (threshold=3) [.................................................X.X..X.....] duration: 375.425048ms FAIL (2025-09-22 05:11:41 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== .79.227.27:4717 , piece_id=BJYH4RBBMPRDAB7I3S64JA2RKDSZWEW5WZESL4UBGMHIJ3DJZOFA, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.443356010 (566h58m39.796141139s) [noise=true , address=145.79.227.15:4890 , piece_id=SXSKTDJ6WKYGYLIHY7JPJU4CCIB57Y73COOERWFTPOVJDBAMHVAQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.443765328 (566h58m39.796550456s) [noise=true , address=145.79.227.33:4892 , piece_id=IRPSKGA5QTCEYH3H22ZGWUB4PSLWSKDOUGMXH7LAGRTZGO6NEYMQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444090558 (566h58m39.796875686s) [noise=true , address=145.79.227.29:4973 , piece_id=7EWN3F2YPAAAMXRUZHQ7FPYME3PCS7YABMIWY75JXHY2E4PN52FQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444188903 (566h58m39.79697403s) [noise=true , address=145.79.227.10:4419 , piece_id=JB2SSRHP2V2URKBPHPPLPML5SFLEUSF3WBA3HVLX3T5M7DK6TP5Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444577773 (566h58m39.797362901s) [noise=true , address=145.79.227.52:4474 , piece_id=AJ55FCPIVDMXVKKZ4VEX5DSJDHENFIWPYEXBRXZUAFD4FH2ERM3Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444677179 (566h58m39.797462307s) [noise=true , address=145.79.227.25:4629 , piece_id=FE4IVKMTA2UCEVM3IFR6CBPRXIRK7CFJMV7UPO4NULLDPEMHI5GQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444962344 (566h58m39.797747472s) [noise=true , address=145.79.227.22:4518 , piece_id=QH2EP26EVUZVNQ4U3CJKZD5HLJ4OTLMDPZEVOW7SWA3RGRMZPVJA, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.445216612 (566h58m39.79800174s) [noise=true , address=145.79.227.13:4815 , piece_id=FKNQGYM6WHIOTFUJOGQPTVBUCCMKIJKM5634ORIXIRIKXGDLAX7Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.445329904 (566h58m39.798115033s) [noise=true , address=145.79.227.30:4790 , piece_id=NFLSQZPJ6PTFYTBRAZGGIZWJAJHYPSTIKYCHGMOK3NV562QQDX4A, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.445688447 (566h58m39.798473585s) [noise=true , address=145.79.227.46:4624 , piece_id=RLMCJZCLQM62QP3XQLDDQ22CLWHRASVOLU5CDXQVDPQ7ABHESU5Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.445754561 (566h58m39.798539689s) [noise=true , address=145.79.227.14:4866 , piece_id=NRUKXI3FQCGQI5WSURFOD5MWY5L5OJUV3B7RZLX33CAN5TXBCK4Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.446085091 (566h58m39.79887022s) [noise=true , address=77.90.31.18:4831 , piece_id=6YYF7O7WASB7L4BUMO6FRX3NGH3QPEB2EDMGZ52RUZYPEXI2D5CQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.446552749 (566h58m39.799337917s) [noise=true , address=66.23.193.175:4553 , piece_id=CUWCYLLGC2OZTEVGQTZH4H5DQWPRNZSNGW7LMZNM6U5KJI7ZCCIA, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.447022330 (566h58m39.799807459s) [noise=true , address=145.79.227.8:4355 , piece_id=3VMN7GJIJ4DSSRBC3EXPJLXGAO2KIFJ3HUZXPBN4GC7CXOYNSXRA, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.447446877 (566h58m39.800232005s) [noise=true , address=145.79.227.2:4118 , piece_id=UMZVCTVPRDDERUTNRCRLPVCHJL6MSGHIGLEIXO66FQC7NP7RNCUQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.447878927 (566h58m39.800664056s) [noise=true , address=145.79.227.12:4782 , piece_id=Q2WT5KUQ4UWHYNV5SW6XOJ4AMNPDLGIFWR2BVNAQGDJJ3ECNHAJQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.448061300 (566h58m39.800846428s) [noise=true , address=145.79.227.11:4736 , piece_id=DCW7GQ2BVMIED4W5FNS33XEDUEIT232O5NHZHGFPGGEFRL6IK3YQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.528619474 (566h58m39.881404572s) [upload=498993]: Next returned nil segment Sep 22 05:07:04.528630534 (566h58m39.881415643s) [upload=498993]: Waiting for error group managing segments... Sep 22 05:07:04.538575067 (566h58m39.891360164s) [noise=true , address=145.79.227.30:4790 , piece_id=NFLSQZPJ6PTFYTBRAZGGIZWJAJHYPSTIKYCHGMOK3NV562QQDX4A, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.539546860 (566h58m39.892331958s) [noise=true , address=145.79.227.27:4717 , piece_id=BJYH4RBBMPRDAB7I3S64JA2RKDSZWEW5WZESL4UBGMHIJ3DJZOFA, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.539973170 (566h58m39.892758267s) [noise=true , address=77.90.31.18:4831 , piece_id=6YYF7O7WASB7L4BUMO6FRX3NGH3QPEB2EDMGZ52RUZYPEXI2D5CQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.540146776 (566h58m39.892931913s) [noise=true , address=145.79.227.33:4892 , piece_id=IRPSKGA5QTCEYH3H22ZGWUB4PSLWSKDOUGMXH7LAGRTZGO6NEYMQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.540291638 (566h58m39.893076746s) [noise=true , address=145.79.227.29:4973 , piece_id=7EWN3F2YPAAAMXRUZHQ7FPYME3PCS7YABMIWY75JXHY2E4PN52FQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.540795884 (566h58m39.893581022s) [noise=true , address=145.79.227.52:4474 , piece_id=AJ55FCPIVDMXVKKZ4VEX5DSJDHENFIWPYEXBRXZUAFD4FH2ERM3Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.544155669 (566h58m39.896940767s) [noise=true , address=145.79.227.25:4629 , piece_id=FE4IVKMTA2UCEVM3IFR6CBPRXIRK7CFJMV7UPO4NULLDPEMHI5GQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.552098143 (566h58m39.904883281s) [noise=true , address=145.79.227.46:4624 , piece_id=RLMCJZCLQM62QP3XQLDDQ22CLWHRASVOLU5CDXQVDPQ7ABHESU5Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.552115576 (566h58m39.904900674s) [noise=true , address=145.79.227.22:4518 , piece_id=QH2EP26EVUZVNQ4U3CJKZD5HLJ4OTLMDPZEVOW7SWA3RGRMZPVJA, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:05.041097924 (566h58m40.393883022s) [noise=true , address=66.23.193.175:4553 , piece_id=CUWCYLLGC2OZTEVGQTZH4H5DQWPRNZSNGW7LMZNM6U5KJI7ZCCIA, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:05.506063937 (566h58m40.858849035s) [noise=true , address=145.79.227.11:4736 , piece_id=DCW7GQ2BVMIED4W5FNS33XEDUEIT232O5NHZHGFPGGEFRL6IK3YQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1ejnWsitdrh68vSJvjR2QnRg4kva8DFRzqvvUuDkXM6zKUDWNC, address:145.79.227.11:4736): protocol: rpc: dial tcp 145.79.227.11:4736: connect: no route to host; manager closed: conn closed: op Sep 22 05:08:04.401016602 (566h59m39.75380173s) [noise=true , address=145.79.227.10:4419 , piece_id=JB2SSRHP2V2URKBPHPPLPML5SFLEUSF3WBA3HVLX3T5M7DK6TP5Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1YnhzSepDNJ6FEFq6ifLdmaGm7BZhMYs7JWbGmShbi38gSxxXL, address:145.79.227.10:4419): protocol: rpc: dial tcp 145.79.227.10:4419: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401091332 (566h59m39.753876461s) [noise=true , address=145.79.227.12:4782 , piece_id=Q2WT5KUQ4UWHYNV5SW6XOJ4AMNPDLGIFWR2BVNAQGDJJ3ECNHAJQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:17C7Wx6yE15jDtqqsQwWVj444YkvHBUWkkXjoCxfXPiErwyGKQ, address:145.79.227.12:4782): protocol: rpc: dial tcp 145.79.227.12:4782: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401101101 (566h59m39.753886229s) [noise=true , address=145.79.227.15:4890 , piece_id=SXSKTDJ6WKYGYLIHY7JPJU4CCIB57Y73COOERWFTPOVJDBAMHVAQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1gakF2Cctzc6EhFScfLfBHJdcDHqMBcey4mNoToEwbtk8Pwix5, address:145.79.227.15:4890): protocol: rpc: dial tcp 145.79.227.15:4890: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401148540 (566h59m39.753933678s) [noise=true , address=145.79.227.14:4866 , piece_id=NRUKXI3FQCGQI5WSURFOD5MWY5L5OJUV3B7RZLX33CAN5TXBCK4Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1zUcYfJE8xRW2Tow7bGB3PeNrVBUzVWR82JADkVwPdSr4CTPyr, address:145.79.227.14:4866): protocol: rpc: dial tcp 145.79.227.14:4866: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401183265 (566h59m39.753968403s) [noise=true , address=145.79.227.13:4815 , piece_id=FKNQGYM6WHIOTFUJOGQPTVBUCCMKIJKM5634ORIXIRIKXGDLAX7Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa, address:145.79.227.13:4815): protocol: rpc: dial tcp 145.79.227.13:4815: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401203854 (566h59m39.753988992s) [noise=true , address=145.79.227.2:4118 , piece_id=UMZVCTVPRDDERUTNRCRLPVCHJL6MSGHIGLEIXO66FQC7NP7RNCUQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:12ty5LHXwLmHC7nRPmVfj2wVEif6JQAQQ5Z5218vv1fKK5sD3zE, address:145.79.227.2:4118): protocol: rpc: dial tcp 145.79.227.2:4118: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401243117 (566h59m39.754028245s) [noise=true , address=145.79.227.8:4355 , piece_id=3VMN7GJIJ4DSSRBC3EXPJLXGAO2KIFJ3HUZXPBN4GC7CXOYNSXRA, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:12mRuEpX7CMxWXVdHrTi3zF3v9t3LcqE6mJKzocajEvYHM52a7T, address:145.79.227.8:4355): protocol: rpc: dial tcp 145.79.227.8:4355: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401288963 (566h59m39.754074102s) [seg_pos={0 0}, upload=498993]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Sep 22 05:08:04.415054225 (566h59m39.767839353s) [upload=498993]: Done uploading segments... Sep 22 05:08:04.415080705 (566h59m39.767865833s) [upload=498993]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 375.451949ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.........XXX.XXXXX.........X........X..................X...X] duration: 30.000544028s FAIL (2025-09-22 05:11:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.0005611s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 7 out of 60 is failed (threshold=3) [...........X........................X...X.......X.X.......XX] duration: 30.021563784s FAIL (2025-09-22 05:11:19 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 22 05:10:49.443139188 (567h2m24.795924296s) [upload=499050]: Starting upload Sep 22 05:10:49.443238504 (567h2m24.796023622s) [upload=499050]: Done starting upload Sep 22 05:10:49.443340136 (567h2m24.796125254s) [upload=499050]: Uploading segments... Sep 22 05:10:49.443616404 (567h2m24.796401543s) [upload=499050]: Got next segment. Inline: false Sep 22 05:10:49.443657201 (567h2m24.796442309s) [upload=499050]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 05:10:49.443661909 (567h2m24.796447017s) [upload=499050]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 05:10:49.541175602 (567h2m24.893960741s) [seg_pos={0 0}, upload=499050]: Begin upload segment... Sep 22 05:10:49.541235686 (567h2m24.894020824s) [seg_pos={0 0}, upload=499050]: Done begin upload segment. Sep 22 05:10:49.541268418 (567h2m24.894053545s) [noise=true , address=145.79.227.5:4223 , piece_id=URZEZHVVOHDWBQZPC3SE3NBZGU6O5ER5UWEMEQCE6RRG6LBFGMAA, seg_pos={0 0}, upload=499050]: Uploading piece... Sep 22 05:10:49.541315686 (567h2m24.894100824s) [noise=true , address=77.90.31.13:4628 , piece_id=KL5FMTEEHVPS2WIPDLNKKYJHU6QIQAQXE4NPJMJEV2AM4KPD2ZAQ, seg_pos={0 0}, upload=499050]: Uploading piece... Sep 22 05:10:49.541966056 (567h2m24.894751184s) [noise=true , address=77.90.31.11:4554 , piece_id=GJKVUEXCMSLXCRGQI7434K6MHSRXCPICUHSLOMDFXZ4NB2H46O2A, seg_pos={0 0}, upload=499050]: Uploading piece... Sep 22 05:10:49.542028503 (567h2m24.894813611s) [noise=true , address=45.91.116.11:4119 , piece_id=U3YUW7HU4QVY7GPODIRZLGZJBWHA55LCSIA7WTU7WRITUCF5JQMA, seg_pos={0 0}, upload=499050]: Uploading piece... Sep 22 05:10:49.542589737 (567h2m24.895374864s) [noise=true , address=77.90.31.14:4662 , piece_id=IAD5ABXQ3IHIFHDJOXQBVHCXLNNRR5APKS235AVM7VLRXNECNYVQ, seg_pos={0 0}, upload=499050]: Uploading piece... Sep 22 05:10:49.542712607 (567h2m24.895497745s) [noise=true , address=77.90.31.18:4805 , piece_id=HXCISWB2SLXYJEZNVD5QLM4PASPU4VMG57ZA7YMI37ENEHRXC3VA, seg_pos={0 0}, upload=499050]: Uploading piece... Sep 22 05:10:49.543042796 (567h2m24.895827925s) [noise=true , address=145.79.227.16:4912 , piece_id=BO56PTISN5IZSJSLBPP2246SB7CHII2BDYQL4Q7Z4THXTNWPKPYQ, seg_pos={0 0}, upload=499050]: Uploading piece... Sep 22 05:10:49.543346928 (567h2m24.896132036s) [noise=true , address=77.90.31.14:4661 , piece_id=2QN4S3EDASADK65IIMWUJUTWT5EZUVIWQSB64KLTN674FST3TN5A, seg_pos={0 0}, upload=499050]: Uploading piece... Sep 22 05:10:49.543427769 (567h2m24.896212897s) [noise=true , address=45.91.116.8:4045 , piece_id=OCKVZABU7WDOH6NCYEJ5H3A4R4LCRCMKGZCEVMIHUSZ4ZGVLE77Q, seg_pos={0 0}, upload=499050]: Uploading piece... Sep 22 05:10:49.543793586 (567h2m24.896578723s) [noise=true , address=145.79.227.4:4186 , piece_id=CLVOAC2TB454ZRZI2PFNQL6O3T5KMX75RUGTDQAU2ADGC66ZM57A, seg_pos={0 0}, upload=499050]: Uploading piece... Sep 22 05:10:49.543890608 (567h2m24.896675716s) [noise=true , address=77.90.31.10:4520 , piece_id=6NTWRRUBF3QPZGEYUC2LCAQQMNYDPLHIAHKFWGHLTF4KGME7IE3Q, seg_pos={0 0}, upload=499050]: Uploading piece... Sep 22 05:10:49.544455879 (567h2m24.897241017s) [noise=true , address=77.90.31.15:4699 , piece_id=TQU2JUSSYTDMELU6D375ZIXI4QJDORBFTGAJPJ7OSJOGSPXUKQJA, seg_pos={0 0}, upload=499050]: Uploading piece... Sep 22 05:10:49.544485464 (567h2m24.897270572s) [noise=true , address=45.91.116.9:4261 , piece_id=EI5DNIO77QK4GHD3DJIRYSZYOY6JZIWUJAIZ4DZG6VDFUYXW2OYQ, seg_pos={0 0}, upload=499050]: Uploading piece... Sep 22 05:10:49.544611741 (567h2m24.897396849s) [noise=true , address=45.91.116.8:4047 , piece_id=APFU7KC4BVY5542G7SGXOBESKS6KRS6I3VJ4MP4WRAXUCHQV5QKQ, seg_pos={0 0}, upload=499050]: Uploading piece... Sep 22 05:10:49.545154610 (567h2m24.897939738s) [noise=true , address=145.79.227.11:4732 , piece_id=TJ26LLNBBTDTDARMWYJ6V5YOAUYGUZZTSXY2LSVOQMJ7GGLW76IQ, seg_pos={0 0}, upload=499050]: Uploading piece... Sep 22 05:10:49.545181190 (567h2m24.897966288s) [noise=true , address=45.91.116.7:4009 , piece_id=HQCDBZRZIEI7KSLDZBHKBYIYXZYQY2VZEOT47ONEDRQ5RVVRGQ2A, seg_pos={0 0}, upload=499050]: Uploading piece... Sep 22 05:10:49.645353853 (567h2m24.99813895s) [upload=499050]: Next returned nil segment Sep 22 05:10:49.645362759 (567h2m24.998147858s) [upload=499050]: Waiting for error group managing segments... Sep 22 05:10:49.654980468 (567h2m25.007765566s) [noise=true , address=45.91.116.7:4009 , piece_id=HQCDBZRZIEI7KSLDZBHKBYIYXZYQY2VZEOT47ONEDRQ5RVVRGQ2A, seg_pos={0 0}, upload=499050]: Done uploading piece. err: <nil> Sep 22 05:10:49.655068894 (567h2m25.007854033s) [noise=true , address=45.91.116.11:4119 , piece_id=U3YUW7HU4QVY7GPODIRZLGZJBWHA55LCSIA7WTU7WRITUCF5JQMA, seg_pos={0 0}, upload=499050]: Done uploading piece. err: <nil> Sep 22 05:10:49.655486277 (567h2m25.008271375s) [noise=true , address=45.91.116.9:4261 , piece_id=EI5DNIO77QK4GHD3DJIRYSZYOY6JZIWUJAIZ4DZG6VDFUYXW2OYQ, seg_pos={0 0}, upload=499050]: Done uploading piece. err: <nil> Sep 22 05:10:49.655886527 (567h2m25.008671656s) [noise=true , address=45.91.116.8:4047 , piece_id=APFU7KC4BVY5542G7SGXOBESKS6KRS6I3VJ4MP4WRAXUCHQV5QKQ, seg_pos={0 0}, upload=499050]: Done uploading piece. err: <nil> Sep 22 05:10:49.656042090 (567h2m25.008827219s) [noise=true , address=45.91.116.8:4045 , piece_id=OCKVZABU7WDOH6NCYEJ5H3A4R4LCRCMKGZCEVMIHUSZ4ZGVLE77Q, seg_pos={0 0}, upload=499050]: Done uploading piece. err: <nil> Sep 22 05:10:49.656275669 (567h2m25.009060766s) [noise=true , address=77.90.31.10:4520 , piece_id=6NTWRRUBF3QPZGEYUC2LCAQQMNYDPLHIAHKFWGHLTF4KGME7IE3Q, seg_pos={0 0}, upload=499050]: Done uploading piece. err: <nil> Sep 22 05:10:49.656608713 (567h2m25.009393811s) [noise=true , address=77.90.31.14:4661 , piece_id=2QN4S3EDASADK65IIMWUJUTWT5EZUVIWQSB64KLTN674FST3TN5A, seg_pos={0 0}, upload=499050]: Done uploading piece. err: <nil> Sep 22 05:10:49.656855386 (567h2m25.009640515s) [noise=true , address=77.90.31.14:4662 , piece_id=IAD5ABXQ3IHIFHDJOXQBVHCXLNNRR5APKS235AVM7VLRXNECNYVQ, seg_pos={0 0}, upload=499050]: Done uploading piece. err: <nil> Sep 22 05:10:49.657064649 (567h2m25.009849738s) [noise=true , address=77.90.31.15:4699 , piece_id=TQU2JUSSYTDMELU6D375ZIXI4QJDORBFTGAJPJ7OSJOGSPXUKQJA, seg_pos={0 0}, upload=499050]: Done uploading piece. err: <nil> Sep 22 05:10:49.657452366 (567h2m25.010237465s) [noise=true , address=77.90.31.18:4805 , piece_id=HXCISWB2SLXYJEZNVD5QLM4PASPU4VMG57ZA7YMI37ENEHRXC3VA, seg_pos={0 0}, upload=499050]: Done uploading piece. err: <nil> Sep 22 05:10:49.658297001 (567h2m25.0110821s) [noise=true , address=77.90.31.11:4554 , piece_id=GJKVUEXCMSLXCRGQI7434K6MHSRXCPICUHSLOMDFXZ4NB2H46O2A, seg_pos={0 0}, upload=499050]: Done uploading piece. err: <nil> Sep 22 05:10:49.659043232 (567h2m25.01182833s) [noise=true , address=77.90.31.13:4628 , piece_id=KL5FMTEEHVPS2WIPDLNKKYJHU6QIQAQXE4NPJMJEV2AM4KPD2ZAQ, seg_pos={0 0}, upload=499050]: Done uploading piece. err: <nil> Sep 22 05:10:52.132784330 (567h2m27.485569438s) [noise=true , address=145.79.227.16:4912 , piece_id=BO56PTISN5IZSJSLBPP2246SB7CHII2BDYQL4Q7Z4THXTNWPKPYQ, seg_pos={0 0}, upload=499050]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:145.79.227.16:4912): protocol: rpc: dial tcp 145.79.227.16:4912: connect: no route to host; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:11:19.430458270 (567h2m54.783243378s) [noise=true , address=145.79.227.11:4732 , piece_id=TJ26LLNBBTDTDARMWYJ6V5YOAUYGUZZTSXY2LSVOQMJ7GGLW76IQ, seg_pos={0 0}, upload=499050]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:145.79.227.11:4732): protocol: rpc: dial tcp 145.79.227.11:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:11:19.430493275 (567h2m54.783278383s) [noise=true , address=145.79.227.5:4223 , piece_id=URZEZHVVOHDWBQZPC3SE3NBZGU6O5ER5UWEMEQCE6RRG6LBFGMAA, seg_pos={0 0}, upload=499050]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: rpc: dial tcp 145.79.227.5:4223: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:11:19.430533601 (567h2m54.783318699s) [noise=true , address=145.79.227.4:4186 , piece_id=CLVOAC2TB454ZRZI2PFNQL6O3T5KMX75RUGTDQAU2ADGC66ZM57A, seg_pos={0 0}, upload=499050]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:11:19.430565721 (567h2m54.783350829s) [seg_pos={0 0}, upload=499050]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 22 05:11:19.450696089 (567h2m54.803481197s) [upload=499050]: Done uploading segments... Sep 22 05:11:19.450711247 (567h2m54.803496355s) [upload=499050]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 30.021576078s core uplink us-select-1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 5.082419571s FAIL (2025-09-22 05:10:52 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.08244004s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 6 out of 60 is failed (threshold=3) [............X........................X...X.......X.X.......X] duration: 30.014399379s FAIL (2025-09-22 05:10:49 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== Sep 22 05:10:19.375527202 (567h1m54.7283123s) [upload=499039]: Starting upload Sep 22 05:10:19.375577957 (567h1m54.728363065s) [upload=499039]: Done starting upload Sep 22 05:10:19.375615878 (567h1m54.728400986s) [upload=499039]: Uploading segments... Sep 22 05:10:19.375843425 (567h1m54.728628523s) [upload=499039]: Got next segment. Inline: false Sep 22 05:10:19.375878711 (567h1m54.728663819s) [upload=499039]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 05:10:19.375882609 (567h1m54.728667717s) [upload=499039]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 05:10:19.444079797 (567h1m54.796864905s) [seg_pos={0 0}, upload=499039]: Begin upload segment... Sep 22 05:10:19.444110124 (567h1m54.796895232s) [seg_pos={0 0}, upload=499039]: Done begin upload segment. Sep 22 05:10:19.444136924 (567h1m54.796922022s) [noise=true , address=45.91.116.8:4048 , piece_id=QUDNVRUZ5D6JBH2XBXKSUGAQ475F7JWDUHZK2667TGDBRU65LGIA, seg_pos={0 0}, upload=499039]: Uploading piece... Sep 22 05:10:19.444147554 (567h1m54.796932662s) [noise=true , address=145.79.227.17:4971 , piece_id=LGJX2AOQJISIJKHVZLWTO3QTUHVAWKIEWSJASACRNLKIXISHBLXA, seg_pos={0 0}, upload=499039]: Uploading piece... Sep 22 05:10:19.444221081 (567h1m54.79700619s) [noise=true , address=145.79.227.16:4909 , piece_id=KOZYIHBKL3CNM2J2C6JO7L2AHODNZR2TKC57LQVVXKMGADEGJ6OA, seg_pos={0 0}, upload=499039]: Uploading piece... Sep 22 05:10:19.444435103 (567h1m54.797220211s) [noise=true , address=45.91.116.5:4297 , piece_id=S5EVWGO2ZDTR5SW7GIG3OQJUAUE4YJKGYDUJAQKFJCG673DFUOIA, seg_pos={0 0}, upload=499039]: Uploading piece... Sep 22 05:10:19.444448118 (567h1m54.797233215s) [noise=true , address=77.90.31.17:4770 , piece_id=35F467V7ZQ2NFOJLSY47Q2DAXUJ2AFHGEYASYSB3BA5ZZNZN55VQ, seg_pos={0 0}, upload=499039]: Uploading piece... Sep 22 05:10:19.444886279 (567h1m54.797671387s) [noise=true , address=77.90.31.15:4699 , piece_id=3BYRFFZT5FG2JX6C7MC33KSL3WARRBBLSSLKNVGEPFMKXIJ6IM2Q, seg_pos={0 0}, upload=499039]: Uploading piece... Sep 22 05:10:19.444962413 (567h1m54.797747512s) [noise=true , address=145.79.227.15:4874 , piece_id=SRYNCSL6OTD6RXWLD4IDAP5QRIE3WP4TTII6Y2FTQEGIMFNLEDEQ, seg_pos={0 0}, upload=499039]: Uploading piece... Sep 22 05:10:19.445238711 (567h1m54.798023819s) [noise=true , address=145.79.227.5:4221 , piece_id=GVTP6DSK6CNZVTVZ6SH4KHOSTYDSZ7NWRKWL6GIHNSAAKLBZIYAQ, seg_pos={0 0}, upload=499039]: Uploading piece... Sep 22 05:10:19.445389945 (567h1m54.798175053s) [noise=true , address=145.79.227.15:4876 , piece_id=MHJ3OQK2ZLGECSVXWLLV3TA2HNON7GVDFMGY3WQAOL27VUEJ7RNQ, seg_pos={0 0}, upload=499039]: Uploading piece... Sep 22 05:10:19.446140834 (567h1m54.798925982s) [noise=true , address=145.79.227.18:4007 , piece_id=KYUZWEOEFYY2C56MGSNBOBYDTAGLGO6DVSGE27S75GSO2WWVBHKA, seg_pos={0 0}, upload=499039]: Uploading piece... Sep 22 05:10:19.446861617 (567h1m54.799646715s) [noise=true , address=45.91.116.5:4299 , piece_id=IWUF2VHOVE62PYOJOFQJHZZUS2YKGOICL4DYW2XMTHU5KMI7RPWA, seg_pos={0 0}, upload=499039]: Uploading piece... Sep 22 05:10:19.447104653 (567h1m54.799889761s) [noise=true , address=145.79.227.3:4150 , piece_id=YIUU7DWJS35CWMET7QU2BFPGBF26ZK3D2AFT46Y2PRSBSFUYVRTA, seg_pos={0 0}, upload=499039]: Uploading piece... Sep 22 05:10:19.448439758 (567h1m54.801224856s) [noise=true , address=77.90.31.14:4661 , piece_id=SDE6THDY7TFDT2LCF5TU4JEL2CQSQFEL444J7ZZDHYJMUWIN53AA, seg_pos={0 0}, upload=499039]: Uploading piece... Sep 22 05:10:19.449168105 (567h1m54.801953213s) [noise=true , address=45.91.116.4:4939 , piece_id=YISFNX5YZ46RKUNTYYAFCJ3JPMNH2L6RUN2V2PLTI6PDKFSYGW7A, seg_pos={0 0}, upload=499039]: Uploading piece... Sep 22 05:10:19.449977224 (567h1m54.802762322s) [noise=true , address=45.91.116.10:4082 , piece_id=422QQCSOXGZ5R77VTRZJY43KU7NSTPGZZQKOQIZCK5AIFCUACLAQ, seg_pos={0 0}, upload=499039]: Uploading piece... Sep 22 05:10:19.450629238 (567h1m54.803414346s) [noise=true , address=77.90.31.18:4806 , piece_id=WFMVULIDGLVHZ7MYJDY7CI2T373YJM6IPTAX56GJX4CURQJMODYQ, seg_pos={0 0}, upload=499039]: Uploading piece... Sep 22 05:10:19.526358811 (567h1m54.879143919s) [upload=499039]: Next returned nil segment Sep 22 05:10:19.526371144 (567h1m54.879156252s) [upload=499039]: Waiting for error group managing segments... Sep 22 05:10:19.534391915 (567h1m54.887177023s) [noise=true , address=45.91.116.5:4297 , piece_id=S5EVWGO2ZDTR5SW7GIG3OQJUAUE4YJKGYDUJAQKFJCG673DFUOIA, seg_pos={0 0}, upload=499039]: Done uploading piece. err: <nil> Sep 22 05:10:19.535048347 (567h1m54.887833445s) [noise=true , address=45.91.116.5:4299 , piece_id=IWUF2VHOVE62PYOJOFQJHZZUS2YKGOICL4DYW2XMTHU5KMI7RPWA, seg_pos={0 0}, upload=499039]: Done uploading piece. err: <nil> Sep 22 05:10:19.535425996 (567h1m54.888211104s) [noise=true , address=77.90.31.14:4661 , piece_id=SDE6THDY7TFDT2LCF5TU4JEL2CQSQFEL444J7ZZDHYJMUWIN53AA, seg_pos={0 0}, upload=499039]: Done uploading piece. err: <nil> Sep 22 05:10:19.535777746 (567h1m54.888562854s) [noise=true , address=45.91.116.10:4082 , piece_id=422QQCSOXGZ5R77VTRZJY43KU7NSTPGZZQKOQIZCK5AIFCUACLAQ, seg_pos={0 0}, upload=499039]: Done uploading piece. err: <nil> Sep 22 05:10:19.536154693 (567h1m54.888939791s) [noise=true , address=45.91.116.8:4048 , piece_id=QUDNVRUZ5D6JBH2XBXKSUGAQ475F7JWDUHZK2667TGDBRU65LGIA, seg_pos={0 0}, upload=499039]: Done uploading piece. err: <nil> Sep 22 05:10:19.536495523 (567h1m54.889280631s) [noise=true , address=45.91.116.4:4939 , piece_id=YISFNX5YZ46RKUNTYYAFCJ3JPMNH2L6RUN2V2PLTI6PDKFSYGW7A, seg_pos={0 0}, upload=499039]: Done uploading piece. err: <nil> Sep 22 05:10:19.536834990 (567h1m54.889620088s) [noise=true , address=77.90.31.15:4699 , piece_id=3BYRFFZT5FG2JX6C7MC33KSL3WARRBBLSSLKNVGEPFMKXIJ6IM2Q, seg_pos={0 0}, upload=499039]: Done uploading piece. err: <nil> Sep 22 05:10:19.537585819 (567h1m54.890370927s) [noise=true , address=77.90.31.17:4770 , piece_id=35F467V7ZQ2NFOJLSY47Q2DAXUJ2AFHGEYASYSB3BA5ZZNZN55VQ, seg_pos={0 0}, upload=499039]: Done uploading piece. err: <nil> Sep 22 05:10:19.537710854 (567h1m54.890495951s) [noise=true , address=77.90.31.18:4806 , piece_id=WFMVULIDGLVHZ7MYJDY7CI2T373YJM6IPTAX56GJX4CURQJMODYQ, seg_pos={0 0}, upload=499039]: Done uploading piece. err: <nil> Sep 22 05:10:21.024521909 (567h1m56.377307017s) [noise=true , address=145.79.227.5:4221 , piece_id=GVTP6DSK6CNZVTVZ6SH4KHOSTYDSZ7NWRKWL6GIHNSAAKLBZIYAQ, seg_pos={0 0}, upload=499039]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: rpc: dial tcp 145.79.227.5:4221: connect: no route to host; conn closed: op; piecestore: piecestore close: manager closed: conn closed: op Sep 22 05:10:22.052353149 (567h1m57.405138257s) [noise=true , address=145.79.227.3:4150 , piece_id=YIUU7DWJS35CWMET7QU2BFPGBF26ZK3D2AFT46Y2PRSBSFUYVRTA, seg_pos={0 0}, upload=499039]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:145.79.227.3:4150): protocol: rpc: dial tcp 145.79.227.3:4150: connect: no route to host; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:10:49.362808672 (567h2m24.715593769s) [noise=true , address=145.79.227.15:4874 , piece_id=SRYNCSL6OTD6RXWLD4IDAP5QRIE3WP4TTII6Y2FTQEGIMFNLEDEQ, seg_pos={0 0}, upload=499039]: Done uploading piece. err: ecclient: upload failed (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71, address:145.79.227.15:4874): protocol: rpc: dial tcp 145.79.227.15:4874: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:10:49.362876018 (567h2m24.715661126s) [noise=true , address=145.79.227.15:4876 , piece_id=MHJ3OQK2ZLGECSVXWLLV3TA2HNON7GVDFMGY3WQAOL27VUEJ7RNQ, seg_pos={0 0}, upload=499039]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:145.79.227.15:4876): protocol: rpc: dial tcp 145.79.227.15:4876: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:10:49.362960807 (567h2m24.715745915s) [noise=true , address=145.79.227.17:4971 , piece_id=LGJX2AOQJISIJKHVZLWTO3QTUHVAWKIEWSJASACRNLKIXISHBLXA, seg_pos={0 0}, upload=499039]: Done uploading piece. err: ecclient: upload failed (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo, address:145.79.227.17:4971): protocol: rpc: dial tcp 145.79.227.17:4971: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:10:49.363047059 (567h2m24.715832157s) [noise=true , address=145.79.227.16:4909 , piece_id=KOZYIHBKL3CNM2J2C6JO7L2AHODNZR2TKC57LQVVXKMGADEGJ6OA, seg_pos={0 0}, upload=499039]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:145.79.227.16:4909): protocol: rpc: dial tcp 145.79.227.16:4909: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:10:49.363084850 (567h2m24.715869958s) [noise=true , address=145.79.227.18:4007 , piece_id=KYUZWEOEFYY2C56MGSNBOBYDTAGLGO6DVSGE27S75GSO2WWVBHKA, seg_pos={0 0}, upload=499039]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: rpc: dial tcp 145.79.227.18:4007: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:10:49.363117651 (567h2m24.71590276s) [seg_pos={0 0}, upload=499039]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Sep 22 05:10:49.376217504 (567h2m24.729002612s) [upload=499039]: Done uploading segments... Sep 22 05:10:49.376227533 (567h2m24.729012631s) [upload=499039]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 30.014414366s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 3 out of 60 is failed (threshold=3) [..................................................X.X..X....] duration: 392.278938ms FAIL (2025-09-22 05:10:33 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== .79.227.27:4717 , piece_id=BJYH4RBBMPRDAB7I3S64JA2RKDSZWEW5WZESL4UBGMHIJ3DJZOFA, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.443356010 (566h58m39.796141139s) [noise=true , address=145.79.227.15:4890 , piece_id=SXSKTDJ6WKYGYLIHY7JPJU4CCIB57Y73COOERWFTPOVJDBAMHVAQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.443765328 (566h58m39.796550456s) [noise=true , address=145.79.227.33:4892 , piece_id=IRPSKGA5QTCEYH3H22ZGWUB4PSLWSKDOUGMXH7LAGRTZGO6NEYMQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444090558 (566h58m39.796875686s) [noise=true , address=145.79.227.29:4973 , piece_id=7EWN3F2YPAAAMXRUZHQ7FPYME3PCS7YABMIWY75JXHY2E4PN52FQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444188903 (566h58m39.79697403s) [noise=true , address=145.79.227.10:4419 , piece_id=JB2SSRHP2V2URKBPHPPLPML5SFLEUSF3WBA3HVLX3T5M7DK6TP5Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444577773 (566h58m39.797362901s) [noise=true , address=145.79.227.52:4474 , piece_id=AJ55FCPIVDMXVKKZ4VEX5DSJDHENFIWPYEXBRXZUAFD4FH2ERM3Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444677179 (566h58m39.797462307s) [noise=true , address=145.79.227.25:4629 , piece_id=FE4IVKMTA2UCEVM3IFR6CBPRXIRK7CFJMV7UPO4NULLDPEMHI5GQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444962344 (566h58m39.797747472s) [noise=true , address=145.79.227.22:4518 , piece_id=QH2EP26EVUZVNQ4U3CJKZD5HLJ4OTLMDPZEVOW7SWA3RGRMZPVJA, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.445216612 (566h58m39.79800174s) [noise=true , address=145.79.227.13:4815 , piece_id=FKNQGYM6WHIOTFUJOGQPTVBUCCMKIJKM5634ORIXIRIKXGDLAX7Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.445329904 (566h58m39.798115033s) [noise=true , address=145.79.227.30:4790 , piece_id=NFLSQZPJ6PTFYTBRAZGGIZWJAJHYPSTIKYCHGMOK3NV562QQDX4A, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.445688447 (566h58m39.798473585s) [noise=true , address=145.79.227.46:4624 , piece_id=RLMCJZCLQM62QP3XQLDDQ22CLWHRASVOLU5CDXQVDPQ7ABHESU5Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.445754561 (566h58m39.798539689s) [noise=true , address=145.79.227.14:4866 , piece_id=NRUKXI3FQCGQI5WSURFOD5MWY5L5OJUV3B7RZLX33CAN5TXBCK4Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.446085091 (566h58m39.79887022s) [noise=true , address=77.90.31.18:4831 , piece_id=6YYF7O7WASB7L4BUMO6FRX3NGH3QPEB2EDMGZ52RUZYPEXI2D5CQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.446552749 (566h58m39.799337917s) [noise=true , address=66.23.193.175:4553 , piece_id=CUWCYLLGC2OZTEVGQTZH4H5DQWPRNZSNGW7LMZNM6U5KJI7ZCCIA, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.447022330 (566h58m39.799807459s) [noise=true , address=145.79.227.8:4355 , piece_id=3VMN7GJIJ4DSSRBC3EXPJLXGAO2KIFJ3HUZXPBN4GC7CXOYNSXRA, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.447446877 (566h58m39.800232005s) [noise=true , address=145.79.227.2:4118 , piece_id=UMZVCTVPRDDERUTNRCRLPVCHJL6MSGHIGLEIXO66FQC7NP7RNCUQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.447878927 (566h58m39.800664056s) [noise=true , address=145.79.227.12:4782 , piece_id=Q2WT5KUQ4UWHYNV5SW6XOJ4AMNPDLGIFWR2BVNAQGDJJ3ECNHAJQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.448061300 (566h58m39.800846428s) [noise=true , address=145.79.227.11:4736 , piece_id=DCW7GQ2BVMIED4W5FNS33XEDUEIT232O5NHZHGFPGGEFRL6IK3YQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.528619474 (566h58m39.881404572s) [upload=498993]: Next returned nil segment Sep 22 05:07:04.528630534 (566h58m39.881415643s) [upload=498993]: Waiting for error group managing segments... Sep 22 05:07:04.538575067 (566h58m39.891360164s) [noise=true , address=145.79.227.30:4790 , piece_id=NFLSQZPJ6PTFYTBRAZGGIZWJAJHYPSTIKYCHGMOK3NV562QQDX4A, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.539546860 (566h58m39.892331958s) [noise=true , address=145.79.227.27:4717 , piece_id=BJYH4RBBMPRDAB7I3S64JA2RKDSZWEW5WZESL4UBGMHIJ3DJZOFA, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.539973170 (566h58m39.892758267s) [noise=true , address=77.90.31.18:4831 , piece_id=6YYF7O7WASB7L4BUMO6FRX3NGH3QPEB2EDMGZ52RUZYPEXI2D5CQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.540146776 (566h58m39.892931913s) [noise=true , address=145.79.227.33:4892 , piece_id=IRPSKGA5QTCEYH3H22ZGWUB4PSLWSKDOUGMXH7LAGRTZGO6NEYMQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.540291638 (566h58m39.893076746s) [noise=true , address=145.79.227.29:4973 , piece_id=7EWN3F2YPAAAMXRUZHQ7FPYME3PCS7YABMIWY75JXHY2E4PN52FQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.540795884 (566h58m39.893581022s) [noise=true , address=145.79.227.52:4474 , piece_id=AJ55FCPIVDMXVKKZ4VEX5DSJDHENFIWPYEXBRXZUAFD4FH2ERM3Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.544155669 (566h58m39.896940767s) [noise=true , address=145.79.227.25:4629 , piece_id=FE4IVKMTA2UCEVM3IFR6CBPRXIRK7CFJMV7UPO4NULLDPEMHI5GQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.552098143 (566h58m39.904883281s) [noise=true , address=145.79.227.46:4624 , piece_id=RLMCJZCLQM62QP3XQLDDQ22CLWHRASVOLU5CDXQVDPQ7ABHESU5Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.552115576 (566h58m39.904900674s) [noise=true , address=145.79.227.22:4518 , piece_id=QH2EP26EVUZVNQ4U3CJKZD5HLJ4OTLMDPZEVOW7SWA3RGRMZPVJA, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:05.041097924 (566h58m40.393883022s) [noise=true , address=66.23.193.175:4553 , piece_id=CUWCYLLGC2OZTEVGQTZH4H5DQWPRNZSNGW7LMZNM6U5KJI7ZCCIA, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:05.506063937 (566h58m40.858849035s) [noise=true , address=145.79.227.11:4736 , piece_id=DCW7GQ2BVMIED4W5FNS33XEDUEIT232O5NHZHGFPGGEFRL6IK3YQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1ejnWsitdrh68vSJvjR2QnRg4kva8DFRzqvvUuDkXM6zKUDWNC, address:145.79.227.11:4736): protocol: rpc: dial tcp 145.79.227.11:4736: connect: no route to host; manager closed: conn closed: op Sep 22 05:08:04.401016602 (566h59m39.75380173s) [noise=true , address=145.79.227.10:4419 , piece_id=JB2SSRHP2V2URKBPHPPLPML5SFLEUSF3WBA3HVLX3T5M7DK6TP5Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1YnhzSepDNJ6FEFq6ifLdmaGm7BZhMYs7JWbGmShbi38gSxxXL, address:145.79.227.10:4419): protocol: rpc: dial tcp 145.79.227.10:4419: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401091332 (566h59m39.753876461s) [noise=true , address=145.79.227.12:4782 , piece_id=Q2WT5KUQ4UWHYNV5SW6XOJ4AMNPDLGIFWR2BVNAQGDJJ3ECNHAJQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:17C7Wx6yE15jDtqqsQwWVj444YkvHBUWkkXjoCxfXPiErwyGKQ, address:145.79.227.12:4782): protocol: rpc: dial tcp 145.79.227.12:4782: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401101101 (566h59m39.753886229s) [noise=true , address=145.79.227.15:4890 , piece_id=SXSKTDJ6WKYGYLIHY7JPJU4CCIB57Y73COOERWFTPOVJDBAMHVAQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1gakF2Cctzc6EhFScfLfBHJdcDHqMBcey4mNoToEwbtk8Pwix5, address:145.79.227.15:4890): protocol: rpc: dial tcp 145.79.227.15:4890: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401148540 (566h59m39.753933678s) [noise=true , address=145.79.227.14:4866 , piece_id=NRUKXI3FQCGQI5WSURFOD5MWY5L5OJUV3B7RZLX33CAN5TXBCK4Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1zUcYfJE8xRW2Tow7bGB3PeNrVBUzVWR82JADkVwPdSr4CTPyr, address:145.79.227.14:4866): protocol: rpc: dial tcp 145.79.227.14:4866: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401183265 (566h59m39.753968403s) [noise=true , address=145.79.227.13:4815 , piece_id=FKNQGYM6WHIOTFUJOGQPTVBUCCMKIJKM5634ORIXIRIKXGDLAX7Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa, address:145.79.227.13:4815): protocol: rpc: dial tcp 145.79.227.13:4815: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401203854 (566h59m39.753988992s) [noise=true , address=145.79.227.2:4118 , piece_id=UMZVCTVPRDDERUTNRCRLPVCHJL6MSGHIGLEIXO66FQC7NP7RNCUQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:12ty5LHXwLmHC7nRPmVfj2wVEif6JQAQQ5Z5218vv1fKK5sD3zE, address:145.79.227.2:4118): protocol: rpc: dial tcp 145.79.227.2:4118: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401243117 (566h59m39.754028245s) [noise=true , address=145.79.227.8:4355 , piece_id=3VMN7GJIJ4DSSRBC3EXPJLXGAO2KIFJ3HUZXPBN4GC7CXOYNSXRA, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:12mRuEpX7CMxWXVdHrTi3zF3v9t3LcqE6mJKzocajEvYHM52a7T, address:145.79.227.8:4355): protocol: rpc: dial tcp 145.79.227.8:4355: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401288963 (566h59m39.754074102s) [seg_pos={0 0}, upload=498993]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Sep 22 05:08:04.415054225 (566h59m39.767839353s) [upload=498993]: Done uploading segments... Sep 22 05:08:04.415080705 (566h59m39.767865833s) [upload=498993]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 392.303615ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [..........XXX.XXXXX.........X........X..................X...] duration: 393.348385ms FAIL (2025-09-22 05:10:26 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 393.370406ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 3 out of 60 is failed (threshold=3) [...................................................X.X..X...] duration: 457.152187ms FAIL (2025-09-22 05:10:07 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== .79.227.27:4717 , piece_id=BJYH4RBBMPRDAB7I3S64JA2RKDSZWEW5WZESL4UBGMHIJ3DJZOFA, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.443356010 (566h58m39.796141139s) [noise=true , address=145.79.227.15:4890 , piece_id=SXSKTDJ6WKYGYLIHY7JPJU4CCIB57Y73COOERWFTPOVJDBAMHVAQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.443765328 (566h58m39.796550456s) [noise=true , address=145.79.227.33:4892 , piece_id=IRPSKGA5QTCEYH3H22ZGWUB4PSLWSKDOUGMXH7LAGRTZGO6NEYMQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444090558 (566h58m39.796875686s) [noise=true , address=145.79.227.29:4973 , piece_id=7EWN3F2YPAAAMXRUZHQ7FPYME3PCS7YABMIWY75JXHY2E4PN52FQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444188903 (566h58m39.79697403s) [noise=true , address=145.79.227.10:4419 , piece_id=JB2SSRHP2V2URKBPHPPLPML5SFLEUSF3WBA3HVLX3T5M7DK6TP5Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444577773 (566h58m39.797362901s) [noise=true , address=145.79.227.52:4474 , piece_id=AJ55FCPIVDMXVKKZ4VEX5DSJDHENFIWPYEXBRXZUAFD4FH2ERM3Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444677179 (566h58m39.797462307s) [noise=true , address=145.79.227.25:4629 , piece_id=FE4IVKMTA2UCEVM3IFR6CBPRXIRK7CFJMV7UPO4NULLDPEMHI5GQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444962344 (566h58m39.797747472s) [noise=true , address=145.79.227.22:4518 , piece_id=QH2EP26EVUZVNQ4U3CJKZD5HLJ4OTLMDPZEVOW7SWA3RGRMZPVJA, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.445216612 (566h58m39.79800174s) [noise=true , address=145.79.227.13:4815 , piece_id=FKNQGYM6WHIOTFUJOGQPTVBUCCMKIJKM5634ORIXIRIKXGDLAX7Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.445329904 (566h58m39.798115033s) [noise=true , address=145.79.227.30:4790 , piece_id=NFLSQZPJ6PTFYTBRAZGGIZWJAJHYPSTIKYCHGMOK3NV562QQDX4A, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.445688447 (566h58m39.798473585s) [noise=true , address=145.79.227.46:4624 , piece_id=RLMCJZCLQM62QP3XQLDDQ22CLWHRASVOLU5CDXQVDPQ7ABHESU5Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.445754561 (566h58m39.798539689s) [noise=true , address=145.79.227.14:4866 , piece_id=NRUKXI3FQCGQI5WSURFOD5MWY5L5OJUV3B7RZLX33CAN5TXBCK4Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.446085091 (566h58m39.79887022s) [noise=true , address=77.90.31.18:4831 , piece_id=6YYF7O7WASB7L4BUMO6FRX3NGH3QPEB2EDMGZ52RUZYPEXI2D5CQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.446552749 (566h58m39.799337917s) [noise=true , address=66.23.193.175:4553 , piece_id=CUWCYLLGC2OZTEVGQTZH4H5DQWPRNZSNGW7LMZNM6U5KJI7ZCCIA, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.447022330 (566h58m39.799807459s) [noise=true , address=145.79.227.8:4355 , piece_id=3VMN7GJIJ4DSSRBC3EXPJLXGAO2KIFJ3HUZXPBN4GC7CXOYNSXRA, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.447446877 (566h58m39.800232005s) [noise=true , address=145.79.227.2:4118 , piece_id=UMZVCTVPRDDERUTNRCRLPVCHJL6MSGHIGLEIXO66FQC7NP7RNCUQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.447878927 (566h58m39.800664056s) [noise=true , address=145.79.227.12:4782 , piece_id=Q2WT5KUQ4UWHYNV5SW6XOJ4AMNPDLGIFWR2BVNAQGDJJ3ECNHAJQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.448061300 (566h58m39.800846428s) [noise=true , address=145.79.227.11:4736 , piece_id=DCW7GQ2BVMIED4W5FNS33XEDUEIT232O5NHZHGFPGGEFRL6IK3YQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.528619474 (566h58m39.881404572s) [upload=498993]: Next returned nil segment Sep 22 05:07:04.528630534 (566h58m39.881415643s) [upload=498993]: Waiting for error group managing segments... Sep 22 05:07:04.538575067 (566h58m39.891360164s) [noise=true , address=145.79.227.30:4790 , piece_id=NFLSQZPJ6PTFYTBRAZGGIZWJAJHYPSTIKYCHGMOK3NV562QQDX4A, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.539546860 (566h58m39.892331958s) [noise=true , address=145.79.227.27:4717 , piece_id=BJYH4RBBMPRDAB7I3S64JA2RKDSZWEW5WZESL4UBGMHIJ3DJZOFA, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.539973170 (566h58m39.892758267s) [noise=true , address=77.90.31.18:4831 , piece_id=6YYF7O7WASB7L4BUMO6FRX3NGH3QPEB2EDMGZ52RUZYPEXI2D5CQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.540146776 (566h58m39.892931913s) [noise=true , address=145.79.227.33:4892 , piece_id=IRPSKGA5QTCEYH3H22ZGWUB4PSLWSKDOUGMXH7LAGRTZGO6NEYMQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.540291638 (566h58m39.893076746s) [noise=true , address=145.79.227.29:4973 , piece_id=7EWN3F2YPAAAMXRUZHQ7FPYME3PCS7YABMIWY75JXHY2E4PN52FQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.540795884 (566h58m39.893581022s) [noise=true , address=145.79.227.52:4474 , piece_id=AJ55FCPIVDMXVKKZ4VEX5DSJDHENFIWPYEXBRXZUAFD4FH2ERM3Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.544155669 (566h58m39.896940767s) [noise=true , address=145.79.227.25:4629 , piece_id=FE4IVKMTA2UCEVM3IFR6CBPRXIRK7CFJMV7UPO4NULLDPEMHI5GQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.552098143 (566h58m39.904883281s) [noise=true , address=145.79.227.46:4624 , piece_id=RLMCJZCLQM62QP3XQLDDQ22CLWHRASVOLU5CDXQVDPQ7ABHESU5Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.552115576 (566h58m39.904900674s) [noise=true , address=145.79.227.22:4518 , piece_id=QH2EP26EVUZVNQ4U3CJKZD5HLJ4OTLMDPZEVOW7SWA3RGRMZPVJA, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:05.041097924 (566h58m40.393883022s) [noise=true , address=66.23.193.175:4553 , piece_id=CUWCYLLGC2OZTEVGQTZH4H5DQWPRNZSNGW7LMZNM6U5KJI7ZCCIA, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:05.506063937 (566h58m40.858849035s) [noise=true , address=145.79.227.11:4736 , piece_id=DCW7GQ2BVMIED4W5FNS33XEDUEIT232O5NHZHGFPGGEFRL6IK3YQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1ejnWsitdrh68vSJvjR2QnRg4kva8DFRzqvvUuDkXM6zKUDWNC, address:145.79.227.11:4736): protocol: rpc: dial tcp 145.79.227.11:4736: connect: no route to host; manager closed: conn closed: op Sep 22 05:08:04.401016602 (566h59m39.75380173s) [noise=true , address=145.79.227.10:4419 , piece_id=JB2SSRHP2V2URKBPHPPLPML5SFLEUSF3WBA3HVLX3T5M7DK6TP5Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1YnhzSepDNJ6FEFq6ifLdmaGm7BZhMYs7JWbGmShbi38gSxxXL, address:145.79.227.10:4419): protocol: rpc: dial tcp 145.79.227.10:4419: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401091332 (566h59m39.753876461s) [noise=true , address=145.79.227.12:4782 , piece_id=Q2WT5KUQ4UWHYNV5SW6XOJ4AMNPDLGIFWR2BVNAQGDJJ3ECNHAJQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:17C7Wx6yE15jDtqqsQwWVj444YkvHBUWkkXjoCxfXPiErwyGKQ, address:145.79.227.12:4782): protocol: rpc: dial tcp 145.79.227.12:4782: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401101101 (566h59m39.753886229s) [noise=true , address=145.79.227.15:4890 , piece_id=SXSKTDJ6WKYGYLIHY7JPJU4CCIB57Y73COOERWFTPOVJDBAMHVAQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1gakF2Cctzc6EhFScfLfBHJdcDHqMBcey4mNoToEwbtk8Pwix5, address:145.79.227.15:4890): protocol: rpc: dial tcp 145.79.227.15:4890: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401148540 (566h59m39.753933678s) [noise=true , address=145.79.227.14:4866 , piece_id=NRUKXI3FQCGQI5WSURFOD5MWY5L5OJUV3B7RZLX33CAN5TXBCK4Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1zUcYfJE8xRW2Tow7bGB3PeNrVBUzVWR82JADkVwPdSr4CTPyr, address:145.79.227.14:4866): protocol: rpc: dial tcp 145.79.227.14:4866: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401183265 (566h59m39.753968403s) [noise=true , address=145.79.227.13:4815 , piece_id=FKNQGYM6WHIOTFUJOGQPTVBUCCMKIJKM5634ORIXIRIKXGDLAX7Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa, address:145.79.227.13:4815): protocol: rpc: dial tcp 145.79.227.13:4815: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401203854 (566h59m39.753988992s) [noise=true , address=145.79.227.2:4118 , piece_id=UMZVCTVPRDDERUTNRCRLPVCHJL6MSGHIGLEIXO66FQC7NP7RNCUQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:12ty5LHXwLmHC7nRPmVfj2wVEif6JQAQQ5Z5218vv1fKK5sD3zE, address:145.79.227.2:4118): protocol: rpc: dial tcp 145.79.227.2:4118: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401243117 (566h59m39.754028245s) [noise=true , address=145.79.227.8:4355 , piece_id=3VMN7GJIJ4DSSRBC3EXPJLXGAO2KIFJ3HUZXPBN4GC7CXOYNSXRA, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:12mRuEpX7CMxWXVdHrTi3zF3v9t3LcqE6mJKzocajEvYHM52a7T, address:145.79.227.8:4355): protocol: rpc: dial tcp 145.79.227.8:4355: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401288963 (566h59m39.754074102s) [seg_pos={0 0}, upload=498993]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Sep 22 05:08:04.415054225 (566h59m39.767839353s) [upload=498993]: Done uploading segments... Sep 22 05:08:04.415080705 (566h59m39.767865833s) [upload=498993]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 457.176332ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 5.341297697s FAIL (2025-09-22 05:09:51 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.341319127s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [.............X........................X...X.......X.X.......] duration: 491.752669ms FAIL (2025-09-22 05:09:47 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== Sep 22 05:05:08.574466427 (566h56m43.927251524s) [upload=498965]: Starting upload Sep 22 05:05:08.574523162 (566h56m43.92730827s) [upload=498965]: Done starting upload Sep 22 05:05:08.574642196 (566h56m43.927427294s) [upload=498965]: Uploading segments... Sep 22 05:05:08.574912313 (566h56m43.927697421s) [upload=498965]: Got next segment. Inline: false Sep 22 05:05:08.574948090 (566h56m43.927733187s) [upload=498965]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 05:05:08.574952448 (566h56m43.927737556s) [upload=498965]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 05:05:08.644515890 (566h56m43.997301028s) [seg_pos={0 0}, upload=498965]: Begin upload segment... Sep 22 05:05:08.644592704 (566h56m43.997377801s) [noise=true , address=145.79.227.18:4007 , piece_id=DIWSY6S65ZEF235LV3ANA65XYPVWJLSZYNVML3RV6QOGH2LXXJ4A, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.644626578 (566h56m43.997411706s) [noise=true , address=145.79.227.14:4839 , piece_id=DE722RRCPXDTJEQPTIMVUFGDDPGVRNYORANSV4WOCR3SKGC7YBZA, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.645098874 (566h56m43.997883982s) [seg_pos={0 0}, upload=498965]: Done begin upload segment. Sep 22 05:05:08.645214411 (566h56m43.997999528s) [noise=true , address=45.91.116.14:4191 , piece_id=X6KDLA4ZF2CFF44WJIO3ORZICXK3W46DAZMV4MRAGFO6IXLFUL5Q, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.645622547 (566h56m43.998407666s) [noise=true , address=145.79.227.15:4875 , piece_id=KZDX6UKDTF6ERAZJAKQ47XN2Q3K5YT4SNY2F4HGU5PIVNFRSQU6Q, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.646012358 (566h56m43.998797477s) [noise=true , address=45.91.116.5:4297 , piece_id=3YJCUHSJ2AEWQDJHGJH5IBGQONIZXACVEKGSUIOYSHGW6KMYVSYA, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.646338189 (566h56m43.999123298s) [noise=true , address=77.90.31.13:4627 , piece_id=DJJB62N27TX2O4QXRSDEW4LGQXXHWN37HGYPSNI3OZXNKY7527NQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.646705058 (566h56m43.999490177s) [noise=true , address=45.91.116.6:4974 , piece_id=JIXDZMVZFMQ6MCFUIYGACMSVAJWPNMM6PPWC4T55DJNI37LMGYEA, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.647049044 (566h56m43.999834162s) [noise=true , address=45.91.116.11:4117 , piece_id=NJL2INBDHQSESA2YIRI76SIU2D2EBP4NEHLXXW7IX6AYS7R4665Q, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.647493989 (566h56m44.000279097s) [noise=true , address=145.79.227.4:4187 , piece_id=TXSRDL6SK2JRYPX7LP46W2VBCN6SMNO64Y4WBYWU6HEGGDMWN6SQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.647754598 (566h56m44.000539696s) [noise=true , address=77.90.31.14:4661 , piece_id=3AFKH4DA5VJJOVZN6IMOQJ62KZALC3QXCLDMUUDE4R2LWCYHHLPQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.648005689 (566h56m44.000790787s) [noise=true , address=145.79.227.12:4767 , piece_id=YTBCLTU4FHQHXERZ57FFKH5XKIE5ZSTPOLFRE3WFLNAYWFCHX6MQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.648226032 (566h56m44.00101114s) [noise=true , address=145.79.227.5:4223 , piece_id=CXQJ2PJEBEH5PE2WZRUP37GWQZJNCN5HMIWRMU4KQ3TC7OTBX5WQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.648450123 (566h56m44.001235241s) [noise=true , address=145.79.227.6:4257 , piece_id=WTA3NAGKQXDF6IY4TP54HSFNFRQUZWJLP7674KNO6AGYK2UDYKSA, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.648730349 (566h56m44.001515467s) [noise=true , address=45.91.116.9:4263 , piece_id=ETQVRACTG64MKQHG63TMCFNI6EFVDE44AIW4E6KEWUGM36LLOYLA, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.649071609 (566h56m44.001856727s) [noise=true , address=77.90.31.16:4733 , piece_id=24WRVCBDI75ONQYNKYRMHLVK54FD3YOW5N63SBOMAB7N6IC2MTGQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.649399946 (566h56m44.002185054s) [noise=true , address=145.79.227.6:4258 , piece_id=Y3CIKI73MOVCJQJ2BYZY3V2233N53PHNXBPBKY5WNTRELUAVM6WQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.764765349 (566h56m44.117550466s) [upload=498965]: Next returned nil segment Sep 22 05:05:08.764780957 (566h56m44.117566076s) [upload=498965]: Waiting for error group managing segments... Sep 22 05:05:08.773009771 (566h56m44.125794889s) [noise=true , address=45.91.116.5:4297 , piece_id=3YJCUHSJ2AEWQDJHGJH5IBGQONIZXACVEKGSUIOYSHGW6KMYVSYA, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.774817473 (566h56m44.127602592s) [noise=true , address=45.91.116.9:4263 , piece_id=ETQVRACTG64MKQHG63TMCFNI6EFVDE44AIW4E6KEWUGM36LLOYLA, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.774938290 (566h56m44.127723408s) [noise=true , address=45.91.116.11:4117 , piece_id=NJL2INBDHQSESA2YIRI76SIU2D2EBP4NEHLXXW7IX6AYS7R4665Q, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.775807842 (566h56m44.12859296s) [noise=true , address=77.90.31.16:4733 , piece_id=24WRVCBDI75ONQYNKYRMHLVK54FD3YOW5N63SBOMAB7N6IC2MTGQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.776957419 (566h56m44.129742527s) [noise=true , address=45.91.116.6:4974 , piece_id=JIXDZMVZFMQ6MCFUIYGACMSVAJWPNMM6PPWC4T55DJNI37LMGYEA, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.777595076 (566h56m44.130380194s) [noise=true , address=45.91.116.14:4191 , piece_id=X6KDLA4ZF2CFF44WJIO3ORZICXK3W46DAZMV4MRAGFO6IXLFUL5Q, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.778067712 (566h56m44.13085282s) [noise=true , address=77.90.31.13:4627 , piece_id=DJJB62N27TX2O4QXRSDEW4LGQXXHWN37HGYPSNI3OZXNKY7527NQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.778273538 (566h56m44.131058656s) [noise=true , address=77.90.31.14:4661 , piece_id=3AFKH4DA5VJJOVZN6IMOQJ62KZALC3QXCLDMUUDE4R2LWCYHHLPQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:10.689057441 (566h56m46.041842549s) [noise=true , address=145.79.227.5:4223 , piece_id=CXQJ2PJEBEH5PE2WZRUP37GWQZJNCN5HMIWRMU4KQ3TC7OTBX5WQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: rpc: dial tcp 145.79.227.5:4223: connect: no route to host; manager closed: conn closed: op Sep 22 05:05:38.562528284 (566h57m13.915313392s) [noise=true , address=145.79.227.4:4187 , piece_id=TXSRDL6SK2JRYPX7LP46W2VBCN6SMNO64Y4WBYWU6HEGGDMWN6SQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: rpc: dial tcp 145.79.227.4:4187: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.562994859 (566h57m13.915779967s) [noise=true , address=145.79.227.6:4258 , piece_id=Y3CIKI73MOVCJQJ2BYZY3V2233N53PHNXBPBKY5WNTRELUAVM6WQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: rpc: dial tcp 145.79.227.6:4258: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.563028923 (566h57m13.91581402s) [noise=true , address=145.79.227.18:4007 , piece_id=DIWSY6S65ZEF235LV3ANA65XYPVWJLSZYNVML3RV6QOGH2LXXJ4A, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: rpc: dial tcp 145.79.227.18:4007: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.563059770 (566h57m13.915844869s) [noise=true , address=145.79.227.6:4257 , piece_id=WTA3NAGKQXDF6IY4TP54HSFNFRQUZWJLP7674KNO6AGYK2UDYKSA, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: rpc: dial tcp 145.79.227.6:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.563091261 (566h57m13.915876359s) [noise=true , address=145.79.227.14:4839 , piece_id=DE722RRCPXDTJEQPTIMVUFGDDPGVRNYORANSV4WOCR3SKGC7YBZA, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: rpc: dial tcp 145.79.227.14:4839: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.563119774 (566h57m13.915904872s) [noise=true , address=145.79.227.12:4767 , piece_id=YTBCLTU4FHQHXERZ57FFKH5XKIE5ZSTPOLFRE3WFLNAYWFCHX6MQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: rpc: dial tcp 145.79.227.12:4767: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.563246872 (566h57m13.91603198s) [noise=true , address=145.79.227.15:4875 , piece_id=KZDX6UKDTF6ERAZJAKQ47XN2Q3K5YT4SNY2F4HGU5PIVNFRSQU6Q, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: context deadline exceeded; context deadline exceeded Sep 22 05:05:38.563268573 (566h57m13.916053682s) [seg_pos={0 0}, upload=498965]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Sep 22 05:05:38.575632204 (566h57m13.928417312s) [upload=498965]: Done uploading segments... Sep 22 05:05:38.575647703 (566h57m13.928432811s) [upload=498965]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 491.771403ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [...........XXX.XXXXX.........X........X..................X..] duration: 405.144479ms FAIL (2025-09-22 05:09:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 405.162544ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [..............X........................X...X.......X.X......] duration: 963.545643ms FAIL (2025-09-22 05:09:29 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== Sep 22 05:05:08.574466427 (566h56m43.927251524s) [upload=498965]: Starting upload Sep 22 05:05:08.574523162 (566h56m43.92730827s) [upload=498965]: Done starting upload Sep 22 05:05:08.574642196 (566h56m43.927427294s) [upload=498965]: Uploading segments... Sep 22 05:05:08.574912313 (566h56m43.927697421s) [upload=498965]: Got next segment. Inline: false Sep 22 05:05:08.574948090 (566h56m43.927733187s) [upload=498965]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 05:05:08.574952448 (566h56m43.927737556s) [upload=498965]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 05:05:08.644515890 (566h56m43.997301028s) [seg_pos={0 0}, upload=498965]: Begin upload segment... Sep 22 05:05:08.644592704 (566h56m43.997377801s) [noise=true , address=145.79.227.18:4007 , piece_id=DIWSY6S65ZEF235LV3ANA65XYPVWJLSZYNVML3RV6QOGH2LXXJ4A, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.644626578 (566h56m43.997411706s) [noise=true , address=145.79.227.14:4839 , piece_id=DE722RRCPXDTJEQPTIMVUFGDDPGVRNYORANSV4WOCR3SKGC7YBZA, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.645098874 (566h56m43.997883982s) [seg_pos={0 0}, upload=498965]: Done begin upload segment. Sep 22 05:05:08.645214411 (566h56m43.997999528s) [noise=true , address=45.91.116.14:4191 , piece_id=X6KDLA4ZF2CFF44WJIO3ORZICXK3W46DAZMV4MRAGFO6IXLFUL5Q, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.645622547 (566h56m43.998407666s) [noise=true , address=145.79.227.15:4875 , piece_id=KZDX6UKDTF6ERAZJAKQ47XN2Q3K5YT4SNY2F4HGU5PIVNFRSQU6Q, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.646012358 (566h56m43.998797477s) [noise=true , address=45.91.116.5:4297 , piece_id=3YJCUHSJ2AEWQDJHGJH5IBGQONIZXACVEKGSUIOYSHGW6KMYVSYA, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.646338189 (566h56m43.999123298s) [noise=true , address=77.90.31.13:4627 , piece_id=DJJB62N27TX2O4QXRSDEW4LGQXXHWN37HGYPSNI3OZXNKY7527NQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.646705058 (566h56m43.999490177s) [noise=true , address=45.91.116.6:4974 , piece_id=JIXDZMVZFMQ6MCFUIYGACMSVAJWPNMM6PPWC4T55DJNI37LMGYEA, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.647049044 (566h56m43.999834162s) [noise=true , address=45.91.116.11:4117 , piece_id=NJL2INBDHQSESA2YIRI76SIU2D2EBP4NEHLXXW7IX6AYS7R4665Q, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.647493989 (566h56m44.000279097s) [noise=true , address=145.79.227.4:4187 , piece_id=TXSRDL6SK2JRYPX7LP46W2VBCN6SMNO64Y4WBYWU6HEGGDMWN6SQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.647754598 (566h56m44.000539696s) [noise=true , address=77.90.31.14:4661 , piece_id=3AFKH4DA5VJJOVZN6IMOQJ62KZALC3QXCLDMUUDE4R2LWCYHHLPQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.648005689 (566h56m44.000790787s) [noise=true , address=145.79.227.12:4767 , piece_id=YTBCLTU4FHQHXERZ57FFKH5XKIE5ZSTPOLFRE3WFLNAYWFCHX6MQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.648226032 (566h56m44.00101114s) [noise=true , address=145.79.227.5:4223 , piece_id=CXQJ2PJEBEH5PE2WZRUP37GWQZJNCN5HMIWRMU4KQ3TC7OTBX5WQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.648450123 (566h56m44.001235241s) [noise=true , address=145.79.227.6:4257 , piece_id=WTA3NAGKQXDF6IY4TP54HSFNFRQUZWJLP7674KNO6AGYK2UDYKSA, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.648730349 (566h56m44.001515467s) [noise=true , address=45.91.116.9:4263 , piece_id=ETQVRACTG64MKQHG63TMCFNI6EFVDE44AIW4E6KEWUGM36LLOYLA, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.649071609 (566h56m44.001856727s) [noise=true , address=77.90.31.16:4733 , piece_id=24WRVCBDI75ONQYNKYRMHLVK54FD3YOW5N63SBOMAB7N6IC2MTGQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.649399946 (566h56m44.002185054s) [noise=true , address=145.79.227.6:4258 , piece_id=Y3CIKI73MOVCJQJ2BYZY3V2233N53PHNXBPBKY5WNTRELUAVM6WQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.764765349 (566h56m44.117550466s) [upload=498965]: Next returned nil segment Sep 22 05:05:08.764780957 (566h56m44.117566076s) [upload=498965]: Waiting for error group managing segments... Sep 22 05:05:08.773009771 (566h56m44.125794889s) [noise=true , address=45.91.116.5:4297 , piece_id=3YJCUHSJ2AEWQDJHGJH5IBGQONIZXACVEKGSUIOYSHGW6KMYVSYA, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.774817473 (566h56m44.127602592s) [noise=true , address=45.91.116.9:4263 , piece_id=ETQVRACTG64MKQHG63TMCFNI6EFVDE44AIW4E6KEWUGM36LLOYLA, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.774938290 (566h56m44.127723408s) [noise=true , address=45.91.116.11:4117 , piece_id=NJL2INBDHQSESA2YIRI76SIU2D2EBP4NEHLXXW7IX6AYS7R4665Q, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.775807842 (566h56m44.12859296s) [noise=true , address=77.90.31.16:4733 , piece_id=24WRVCBDI75ONQYNKYRMHLVK54FD3YOW5N63SBOMAB7N6IC2MTGQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.776957419 (566h56m44.129742527s) [noise=true , address=45.91.116.6:4974 , piece_id=JIXDZMVZFMQ6MCFUIYGACMSVAJWPNMM6PPWC4T55DJNI37LMGYEA, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.777595076 (566h56m44.130380194s) [noise=true , address=45.91.116.14:4191 , piece_id=X6KDLA4ZF2CFF44WJIO3ORZICXK3W46DAZMV4MRAGFO6IXLFUL5Q, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.778067712 (566h56m44.13085282s) [noise=true , address=77.90.31.13:4627 , piece_id=DJJB62N27TX2O4QXRSDEW4LGQXXHWN37HGYPSNI3OZXNKY7527NQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.778273538 (566h56m44.131058656s) [noise=true , address=77.90.31.14:4661 , piece_id=3AFKH4DA5VJJOVZN6IMOQJ62KZALC3QXCLDMUUDE4R2LWCYHHLPQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:10.689057441 (566h56m46.041842549s) [noise=true , address=145.79.227.5:4223 , piece_id=CXQJ2PJEBEH5PE2WZRUP37GWQZJNCN5HMIWRMU4KQ3TC7OTBX5WQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: rpc: dial tcp 145.79.227.5:4223: connect: no route to host; manager closed: conn closed: op Sep 22 05:05:38.562528284 (566h57m13.915313392s) [noise=true , address=145.79.227.4:4187 , piece_id=TXSRDL6SK2JRYPX7LP46W2VBCN6SMNO64Y4WBYWU6HEGGDMWN6SQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: rpc: dial tcp 145.79.227.4:4187: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.562994859 (566h57m13.915779967s) [noise=true , address=145.79.227.6:4258 , piece_id=Y3CIKI73MOVCJQJ2BYZY3V2233N53PHNXBPBKY5WNTRELUAVM6WQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: rpc: dial tcp 145.79.227.6:4258: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.563028923 (566h57m13.91581402s) [noise=true , address=145.79.227.18:4007 , piece_id=DIWSY6S65ZEF235LV3ANA65XYPVWJLSZYNVML3RV6QOGH2LXXJ4A, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: rpc: dial tcp 145.79.227.18:4007: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.563059770 (566h57m13.915844869s) [noise=true , address=145.79.227.6:4257 , piece_id=WTA3NAGKQXDF6IY4TP54HSFNFRQUZWJLP7674KNO6AGYK2UDYKSA, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: rpc: dial tcp 145.79.227.6:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.563091261 (566h57m13.915876359s) [noise=true , address=145.79.227.14:4839 , piece_id=DE722RRCPXDTJEQPTIMVUFGDDPGVRNYORANSV4WOCR3SKGC7YBZA, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: rpc: dial tcp 145.79.227.14:4839: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.563119774 (566h57m13.915904872s) [noise=true , address=145.79.227.12:4767 , piece_id=YTBCLTU4FHQHXERZ57FFKH5XKIE5ZSTPOLFRE3WFLNAYWFCHX6MQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: rpc: dial tcp 145.79.227.12:4767: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.563246872 (566h57m13.91603198s) [noise=true , address=145.79.227.15:4875 , piece_id=KZDX6UKDTF6ERAZJAKQ47XN2Q3K5YT4SNY2F4HGU5PIVNFRSQU6Q, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: context deadline exceeded; context deadline exceeded Sep 22 05:05:38.563268573 (566h57m13.916053682s) [seg_pos={0 0}, upload=498965]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Sep 22 05:05:38.575632204 (566h57m13.928417312s) [upload=498965]: Done uploading segments... Sep 22 05:05:38.575647703 (566h57m13.928432811s) [upload=498965]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 963.565749ms core uplink us-select-1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 5.278559359s FAIL (2025-09-22 05:08:57 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.278581261s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [...............X........................X...X.......X.X.....] duration: 442.008685ms FAIL (2025-09-22 05:08:53 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== Sep 22 05:05:08.574466427 (566h56m43.927251524s) [upload=498965]: Starting upload Sep 22 05:05:08.574523162 (566h56m43.92730827s) [upload=498965]: Done starting upload Sep 22 05:05:08.574642196 (566h56m43.927427294s) [upload=498965]: Uploading segments... Sep 22 05:05:08.574912313 (566h56m43.927697421s) [upload=498965]: Got next segment. Inline: false Sep 22 05:05:08.574948090 (566h56m43.927733187s) [upload=498965]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 05:05:08.574952448 (566h56m43.927737556s) [upload=498965]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 05:05:08.644515890 (566h56m43.997301028s) [seg_pos={0 0}, upload=498965]: Begin upload segment... Sep 22 05:05:08.644592704 (566h56m43.997377801s) [noise=true , address=145.79.227.18:4007 , piece_id=DIWSY6S65ZEF235LV3ANA65XYPVWJLSZYNVML3RV6QOGH2LXXJ4A, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.644626578 (566h56m43.997411706s) [noise=true , address=145.79.227.14:4839 , piece_id=DE722RRCPXDTJEQPTIMVUFGDDPGVRNYORANSV4WOCR3SKGC7YBZA, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.645098874 (566h56m43.997883982s) [seg_pos={0 0}, upload=498965]: Done begin upload segment. Sep 22 05:05:08.645214411 (566h56m43.997999528s) [noise=true , address=45.91.116.14:4191 , piece_id=X6KDLA4ZF2CFF44WJIO3ORZICXK3W46DAZMV4MRAGFO6IXLFUL5Q, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.645622547 (566h56m43.998407666s) [noise=true , address=145.79.227.15:4875 , piece_id=KZDX6UKDTF6ERAZJAKQ47XN2Q3K5YT4SNY2F4HGU5PIVNFRSQU6Q, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.646012358 (566h56m43.998797477s) [noise=true , address=45.91.116.5:4297 , piece_id=3YJCUHSJ2AEWQDJHGJH5IBGQONIZXACVEKGSUIOYSHGW6KMYVSYA, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.646338189 (566h56m43.999123298s) [noise=true , address=77.90.31.13:4627 , piece_id=DJJB62N27TX2O4QXRSDEW4LGQXXHWN37HGYPSNI3OZXNKY7527NQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.646705058 (566h56m43.999490177s) [noise=true , address=45.91.116.6:4974 , piece_id=JIXDZMVZFMQ6MCFUIYGACMSVAJWPNMM6PPWC4T55DJNI37LMGYEA, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.647049044 (566h56m43.999834162s) [noise=true , address=45.91.116.11:4117 , piece_id=NJL2INBDHQSESA2YIRI76SIU2D2EBP4NEHLXXW7IX6AYS7R4665Q, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.647493989 (566h56m44.000279097s) [noise=true , address=145.79.227.4:4187 , piece_id=TXSRDL6SK2JRYPX7LP46W2VBCN6SMNO64Y4WBYWU6HEGGDMWN6SQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.647754598 (566h56m44.000539696s) [noise=true , address=77.90.31.14:4661 , piece_id=3AFKH4DA5VJJOVZN6IMOQJ62KZALC3QXCLDMUUDE4R2LWCYHHLPQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.648005689 (566h56m44.000790787s) [noise=true , address=145.79.227.12:4767 , piece_id=YTBCLTU4FHQHXERZ57FFKH5XKIE5ZSTPOLFRE3WFLNAYWFCHX6MQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.648226032 (566h56m44.00101114s) [noise=true , address=145.79.227.5:4223 , piece_id=CXQJ2PJEBEH5PE2WZRUP37GWQZJNCN5HMIWRMU4KQ3TC7OTBX5WQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.648450123 (566h56m44.001235241s) [noise=true , address=145.79.227.6:4257 , piece_id=WTA3NAGKQXDF6IY4TP54HSFNFRQUZWJLP7674KNO6AGYK2UDYKSA, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.648730349 (566h56m44.001515467s) [noise=true , address=45.91.116.9:4263 , piece_id=ETQVRACTG64MKQHG63TMCFNI6EFVDE44AIW4E6KEWUGM36LLOYLA, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.649071609 (566h56m44.001856727s) [noise=true , address=77.90.31.16:4733 , piece_id=24WRVCBDI75ONQYNKYRMHLVK54FD3YOW5N63SBOMAB7N6IC2MTGQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.649399946 (566h56m44.002185054s) [noise=true , address=145.79.227.6:4258 , piece_id=Y3CIKI73MOVCJQJ2BYZY3V2233N53PHNXBPBKY5WNTRELUAVM6WQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.764765349 (566h56m44.117550466s) [upload=498965]: Next returned nil segment Sep 22 05:05:08.764780957 (566h56m44.117566076s) [upload=498965]: Waiting for error group managing segments... Sep 22 05:05:08.773009771 (566h56m44.125794889s) [noise=true , address=45.91.116.5:4297 , piece_id=3YJCUHSJ2AEWQDJHGJH5IBGQONIZXACVEKGSUIOYSHGW6KMYVSYA, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.774817473 (566h56m44.127602592s) [noise=true , address=45.91.116.9:4263 , piece_id=ETQVRACTG64MKQHG63TMCFNI6EFVDE44AIW4E6KEWUGM36LLOYLA, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.774938290 (566h56m44.127723408s) [noise=true , address=45.91.116.11:4117 , piece_id=NJL2INBDHQSESA2YIRI76SIU2D2EBP4NEHLXXW7IX6AYS7R4665Q, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.775807842 (566h56m44.12859296s) [noise=true , address=77.90.31.16:4733 , piece_id=24WRVCBDI75ONQYNKYRMHLVK54FD3YOW5N63SBOMAB7N6IC2MTGQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.776957419 (566h56m44.129742527s) [noise=true , address=45.91.116.6:4974 , piece_id=JIXDZMVZFMQ6MCFUIYGACMSVAJWPNMM6PPWC4T55DJNI37LMGYEA, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.777595076 (566h56m44.130380194s) [noise=true , address=45.91.116.14:4191 , piece_id=X6KDLA4ZF2CFF44WJIO3ORZICXK3W46DAZMV4MRAGFO6IXLFUL5Q, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.778067712 (566h56m44.13085282s) [noise=true , address=77.90.31.13:4627 , piece_id=DJJB62N27TX2O4QXRSDEW4LGQXXHWN37HGYPSNI3OZXNKY7527NQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.778273538 (566h56m44.131058656s) [noise=true , address=77.90.31.14:4661 , piece_id=3AFKH4DA5VJJOVZN6IMOQJ62KZALC3QXCLDMUUDE4R2LWCYHHLPQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:10.689057441 (566h56m46.041842549s) [noise=true , address=145.79.227.5:4223 , piece_id=CXQJ2PJEBEH5PE2WZRUP37GWQZJNCN5HMIWRMU4KQ3TC7OTBX5WQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: rpc: dial tcp 145.79.227.5:4223: connect: no route to host; manager closed: conn closed: op Sep 22 05:05:38.562528284 (566h57m13.915313392s) [noise=true , address=145.79.227.4:4187 , piece_id=TXSRDL6SK2JRYPX7LP46W2VBCN6SMNO64Y4WBYWU6HEGGDMWN6SQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: rpc: dial tcp 145.79.227.4:4187: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.562994859 (566h57m13.915779967s) [noise=true , address=145.79.227.6:4258 , piece_id=Y3CIKI73MOVCJQJ2BYZY3V2233N53PHNXBPBKY5WNTRELUAVM6WQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: rpc: dial tcp 145.79.227.6:4258: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.563028923 (566h57m13.91581402s) [noise=true , address=145.79.227.18:4007 , piece_id=DIWSY6S65ZEF235LV3ANA65XYPVWJLSZYNVML3RV6QOGH2LXXJ4A, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: rpc: dial tcp 145.79.227.18:4007: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.563059770 (566h57m13.915844869s) [noise=true , address=145.79.227.6:4257 , piece_id=WTA3NAGKQXDF6IY4TP54HSFNFRQUZWJLP7674KNO6AGYK2UDYKSA, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: rpc: dial tcp 145.79.227.6:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.563091261 (566h57m13.915876359s) [noise=true , address=145.79.227.14:4839 , piece_id=DE722RRCPXDTJEQPTIMVUFGDDPGVRNYORANSV4WOCR3SKGC7YBZA, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: rpc: dial tcp 145.79.227.14:4839: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.563119774 (566h57m13.915904872s) [noise=true , address=145.79.227.12:4767 , piece_id=YTBCLTU4FHQHXERZ57FFKH5XKIE5ZSTPOLFRE3WFLNAYWFCHX6MQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: rpc: dial tcp 145.79.227.12:4767: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.563246872 (566h57m13.91603198s) [noise=true , address=145.79.227.15:4875 , piece_id=KZDX6UKDTF6ERAZJAKQ47XN2Q3K5YT4SNY2F4HGU5PIVNFRSQU6Q, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: context deadline exceeded; context deadline exceeded Sep 22 05:05:38.563268573 (566h57m13.916053682s) [seg_pos={0 0}, upload=498965]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Sep 22 05:05:38.575632204 (566h57m13.928417312s) [upload=498965]: Done uploading segments... Sep 22 05:05:38.575647703 (566h57m13.928432811s) [upload=498965]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 442.035695ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 3 out of 60 is failed (threshold=3) [....................................................X.X..X..] duration: 530.762291ms FAIL (2025-09-22 05:08:53 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== .79.227.27:4717 , piece_id=BJYH4RBBMPRDAB7I3S64JA2RKDSZWEW5WZESL4UBGMHIJ3DJZOFA, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.443356010 (566h58m39.796141139s) [noise=true , address=145.79.227.15:4890 , piece_id=SXSKTDJ6WKYGYLIHY7JPJU4CCIB57Y73COOERWFTPOVJDBAMHVAQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.443765328 (566h58m39.796550456s) [noise=true , address=145.79.227.33:4892 , piece_id=IRPSKGA5QTCEYH3H22ZGWUB4PSLWSKDOUGMXH7LAGRTZGO6NEYMQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444090558 (566h58m39.796875686s) [noise=true , address=145.79.227.29:4973 , piece_id=7EWN3F2YPAAAMXRUZHQ7FPYME3PCS7YABMIWY75JXHY2E4PN52FQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444188903 (566h58m39.79697403s) [noise=true , address=145.79.227.10:4419 , piece_id=JB2SSRHP2V2URKBPHPPLPML5SFLEUSF3WBA3HVLX3T5M7DK6TP5Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444577773 (566h58m39.797362901s) [noise=true , address=145.79.227.52:4474 , piece_id=AJ55FCPIVDMXVKKZ4VEX5DSJDHENFIWPYEXBRXZUAFD4FH2ERM3Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444677179 (566h58m39.797462307s) [noise=true , address=145.79.227.25:4629 , piece_id=FE4IVKMTA2UCEVM3IFR6CBPRXIRK7CFJMV7UPO4NULLDPEMHI5GQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444962344 (566h58m39.797747472s) [noise=true , address=145.79.227.22:4518 , piece_id=QH2EP26EVUZVNQ4U3CJKZD5HLJ4OTLMDPZEVOW7SWA3RGRMZPVJA, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.445216612 (566h58m39.79800174s) [noise=true , address=145.79.227.13:4815 , piece_id=FKNQGYM6WHIOTFUJOGQPTVBUCCMKIJKM5634ORIXIRIKXGDLAX7Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.445329904 (566h58m39.798115033s) [noise=true , address=145.79.227.30:4790 , piece_id=NFLSQZPJ6PTFYTBRAZGGIZWJAJHYPSTIKYCHGMOK3NV562QQDX4A, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.445688447 (566h58m39.798473585s) [noise=true , address=145.79.227.46:4624 , piece_id=RLMCJZCLQM62QP3XQLDDQ22CLWHRASVOLU5CDXQVDPQ7ABHESU5Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.445754561 (566h58m39.798539689s) [noise=true , address=145.79.227.14:4866 , piece_id=NRUKXI3FQCGQI5WSURFOD5MWY5L5OJUV3B7RZLX33CAN5TXBCK4Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.446085091 (566h58m39.79887022s) [noise=true , address=77.90.31.18:4831 , piece_id=6YYF7O7WASB7L4BUMO6FRX3NGH3QPEB2EDMGZ52RUZYPEXI2D5CQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.446552749 (566h58m39.799337917s) [noise=true , address=66.23.193.175:4553 , piece_id=CUWCYLLGC2OZTEVGQTZH4H5DQWPRNZSNGW7LMZNM6U5KJI7ZCCIA, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.447022330 (566h58m39.799807459s) [noise=true , address=145.79.227.8:4355 , piece_id=3VMN7GJIJ4DSSRBC3EXPJLXGAO2KIFJ3HUZXPBN4GC7CXOYNSXRA, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.447446877 (566h58m39.800232005s) [noise=true , address=145.79.227.2:4118 , piece_id=UMZVCTVPRDDERUTNRCRLPVCHJL6MSGHIGLEIXO66FQC7NP7RNCUQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.447878927 (566h58m39.800664056s) [noise=true , address=145.79.227.12:4782 , piece_id=Q2WT5KUQ4UWHYNV5SW6XOJ4AMNPDLGIFWR2BVNAQGDJJ3ECNHAJQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.448061300 (566h58m39.800846428s) [noise=true , address=145.79.227.11:4736 , piece_id=DCW7GQ2BVMIED4W5FNS33XEDUEIT232O5NHZHGFPGGEFRL6IK3YQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.528619474 (566h58m39.881404572s) [upload=498993]: Next returned nil segment Sep 22 05:07:04.528630534 (566h58m39.881415643s) [upload=498993]: Waiting for error group managing segments... Sep 22 05:07:04.538575067 (566h58m39.891360164s) [noise=true , address=145.79.227.30:4790 , piece_id=NFLSQZPJ6PTFYTBRAZGGIZWJAJHYPSTIKYCHGMOK3NV562QQDX4A, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.539546860 (566h58m39.892331958s) [noise=true , address=145.79.227.27:4717 , piece_id=BJYH4RBBMPRDAB7I3S64JA2RKDSZWEW5WZESL4UBGMHIJ3DJZOFA, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.539973170 (566h58m39.892758267s) [noise=true , address=77.90.31.18:4831 , piece_id=6YYF7O7WASB7L4BUMO6FRX3NGH3QPEB2EDMGZ52RUZYPEXI2D5CQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.540146776 (566h58m39.892931913s) [noise=true , address=145.79.227.33:4892 , piece_id=IRPSKGA5QTCEYH3H22ZGWUB4PSLWSKDOUGMXH7LAGRTZGO6NEYMQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.540291638 (566h58m39.893076746s) [noise=true , address=145.79.227.29:4973 , piece_id=7EWN3F2YPAAAMXRUZHQ7FPYME3PCS7YABMIWY75JXHY2E4PN52FQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.540795884 (566h58m39.893581022s) [noise=true , address=145.79.227.52:4474 , piece_id=AJ55FCPIVDMXVKKZ4VEX5DSJDHENFIWPYEXBRXZUAFD4FH2ERM3Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.544155669 (566h58m39.896940767s) [noise=true , address=145.79.227.25:4629 , piece_id=FE4IVKMTA2UCEVM3IFR6CBPRXIRK7CFJMV7UPO4NULLDPEMHI5GQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.552098143 (566h58m39.904883281s) [noise=true , address=145.79.227.46:4624 , piece_id=RLMCJZCLQM62QP3XQLDDQ22CLWHRASVOLU5CDXQVDPQ7ABHESU5Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.552115576 (566h58m39.904900674s) [noise=true , address=145.79.227.22:4518 , piece_id=QH2EP26EVUZVNQ4U3CJKZD5HLJ4OTLMDPZEVOW7SWA3RGRMZPVJA, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:05.041097924 (566h58m40.393883022s) [noise=true , address=66.23.193.175:4553 , piece_id=CUWCYLLGC2OZTEVGQTZH4H5DQWPRNZSNGW7LMZNM6U5KJI7ZCCIA, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:05.506063937 (566h58m40.858849035s) [noise=true , address=145.79.227.11:4736 , piece_id=DCW7GQ2BVMIED4W5FNS33XEDUEIT232O5NHZHGFPGGEFRL6IK3YQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1ejnWsitdrh68vSJvjR2QnRg4kva8DFRzqvvUuDkXM6zKUDWNC, address:145.79.227.11:4736): protocol: rpc: dial tcp 145.79.227.11:4736: connect: no route to host; manager closed: conn closed: op Sep 22 05:08:04.401016602 (566h59m39.75380173s) [noise=true , address=145.79.227.10:4419 , piece_id=JB2SSRHP2V2URKBPHPPLPML5SFLEUSF3WBA3HVLX3T5M7DK6TP5Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1YnhzSepDNJ6FEFq6ifLdmaGm7BZhMYs7JWbGmShbi38gSxxXL, address:145.79.227.10:4419): protocol: rpc: dial tcp 145.79.227.10:4419: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401091332 (566h59m39.753876461s) [noise=true , address=145.79.227.12:4782 , piece_id=Q2WT5KUQ4UWHYNV5SW6XOJ4AMNPDLGIFWR2BVNAQGDJJ3ECNHAJQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:17C7Wx6yE15jDtqqsQwWVj444YkvHBUWkkXjoCxfXPiErwyGKQ, address:145.79.227.12:4782): protocol: rpc: dial tcp 145.79.227.12:4782: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401101101 (566h59m39.753886229s) [noise=true , address=145.79.227.15:4890 , piece_id=SXSKTDJ6WKYGYLIHY7JPJU4CCIB57Y73COOERWFTPOVJDBAMHVAQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1gakF2Cctzc6EhFScfLfBHJdcDHqMBcey4mNoToEwbtk8Pwix5, address:145.79.227.15:4890): protocol: rpc: dial tcp 145.79.227.15:4890: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401148540 (566h59m39.753933678s) [noise=true , address=145.79.227.14:4866 , piece_id=NRUKXI3FQCGQI5WSURFOD5MWY5L5OJUV3B7RZLX33CAN5TXBCK4Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1zUcYfJE8xRW2Tow7bGB3PeNrVBUzVWR82JADkVwPdSr4CTPyr, address:145.79.227.14:4866): protocol: rpc: dial tcp 145.79.227.14:4866: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401183265 (566h59m39.753968403s) [noise=true , address=145.79.227.13:4815 , piece_id=FKNQGYM6WHIOTFUJOGQPTVBUCCMKIJKM5634ORIXIRIKXGDLAX7Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa, address:145.79.227.13:4815): protocol: rpc: dial tcp 145.79.227.13:4815: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401203854 (566h59m39.753988992s) [noise=true , address=145.79.227.2:4118 , piece_id=UMZVCTVPRDDERUTNRCRLPVCHJL6MSGHIGLEIXO66FQC7NP7RNCUQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:12ty5LHXwLmHC7nRPmVfj2wVEif6JQAQQ5Z5218vv1fKK5sD3zE, address:145.79.227.2:4118): protocol: rpc: dial tcp 145.79.227.2:4118: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401243117 (566h59m39.754028245s) [noise=true , address=145.79.227.8:4355 , piece_id=3VMN7GJIJ4DSSRBC3EXPJLXGAO2KIFJ3HUZXPBN4GC7CXOYNSXRA, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:12mRuEpX7CMxWXVdHrTi3zF3v9t3LcqE6mJKzocajEvYHM52a7T, address:145.79.227.8:4355): protocol: rpc: dial tcp 145.79.227.8:4355: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401288963 (566h59m39.754074102s) [seg_pos={0 0}, upload=498993]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Sep 22 05:08:04.415054225 (566h59m39.767839353s) [upload=498993]: Done uploading segments... Sep 22 05:08:04.415080705 (566h59m39.767865833s) [upload=498993]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 530.779786ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [............XXX.XXXXX.........X........X..................X.] duration: 379.848099ms FAIL (2025-09-22 05:08:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 379.858459ms edge gateway us-select-1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 5.806346012s FAIL (2025-09-22 05:08:28 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.806366421s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [................X........................X...X.......X.X....] duration: 392.492959ms FAIL (2025-09-22 05:08:11 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== Sep 22 05:05:08.574466427 (566h56m43.927251524s) [upload=498965]: Starting upload Sep 22 05:05:08.574523162 (566h56m43.92730827s) [upload=498965]: Done starting upload Sep 22 05:05:08.574642196 (566h56m43.927427294s) [upload=498965]: Uploading segments... Sep 22 05:05:08.574912313 (566h56m43.927697421s) [upload=498965]: Got next segment. Inline: false Sep 22 05:05:08.574948090 (566h56m43.927733187s) [upload=498965]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 05:05:08.574952448 (566h56m43.927737556s) [upload=498965]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 05:05:08.644515890 (566h56m43.997301028s) [seg_pos={0 0}, upload=498965]: Begin upload segment... Sep 22 05:05:08.644592704 (566h56m43.997377801s) [noise=true , address=145.79.227.18:4007 , piece_id=DIWSY6S65ZEF235LV3ANA65XYPVWJLSZYNVML3RV6QOGH2LXXJ4A, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.644626578 (566h56m43.997411706s) [noise=true , address=145.79.227.14:4839 , piece_id=DE722RRCPXDTJEQPTIMVUFGDDPGVRNYORANSV4WOCR3SKGC7YBZA, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.645098874 (566h56m43.997883982s) [seg_pos={0 0}, upload=498965]: Done begin upload segment. Sep 22 05:05:08.645214411 (566h56m43.997999528s) [noise=true , address=45.91.116.14:4191 , piece_id=X6KDLA4ZF2CFF44WJIO3ORZICXK3W46DAZMV4MRAGFO6IXLFUL5Q, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.645622547 (566h56m43.998407666s) [noise=true , address=145.79.227.15:4875 , piece_id=KZDX6UKDTF6ERAZJAKQ47XN2Q3K5YT4SNY2F4HGU5PIVNFRSQU6Q, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.646012358 (566h56m43.998797477s) [noise=true , address=45.91.116.5:4297 , piece_id=3YJCUHSJ2AEWQDJHGJH5IBGQONIZXACVEKGSUIOYSHGW6KMYVSYA, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.646338189 (566h56m43.999123298s) [noise=true , address=77.90.31.13:4627 , piece_id=DJJB62N27TX2O4QXRSDEW4LGQXXHWN37HGYPSNI3OZXNKY7527NQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.646705058 (566h56m43.999490177s) [noise=true , address=45.91.116.6:4974 , piece_id=JIXDZMVZFMQ6MCFUIYGACMSVAJWPNMM6PPWC4T55DJNI37LMGYEA, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.647049044 (566h56m43.999834162s) [noise=true , address=45.91.116.11:4117 , piece_id=NJL2INBDHQSESA2YIRI76SIU2D2EBP4NEHLXXW7IX6AYS7R4665Q, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.647493989 (566h56m44.000279097s) [noise=true , address=145.79.227.4:4187 , piece_id=TXSRDL6SK2JRYPX7LP46W2VBCN6SMNO64Y4WBYWU6HEGGDMWN6SQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.647754598 (566h56m44.000539696s) [noise=true , address=77.90.31.14:4661 , piece_id=3AFKH4DA5VJJOVZN6IMOQJ62KZALC3QXCLDMUUDE4R2LWCYHHLPQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.648005689 (566h56m44.000790787s) [noise=true , address=145.79.227.12:4767 , piece_id=YTBCLTU4FHQHXERZ57FFKH5XKIE5ZSTPOLFRE3WFLNAYWFCHX6MQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.648226032 (566h56m44.00101114s) [noise=true , address=145.79.227.5:4223 , piece_id=CXQJ2PJEBEH5PE2WZRUP37GWQZJNCN5HMIWRMU4KQ3TC7OTBX5WQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.648450123 (566h56m44.001235241s) [noise=true , address=145.79.227.6:4257 , piece_id=WTA3NAGKQXDF6IY4TP54HSFNFRQUZWJLP7674KNO6AGYK2UDYKSA, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.648730349 (566h56m44.001515467s) [noise=true , address=45.91.116.9:4263 , piece_id=ETQVRACTG64MKQHG63TMCFNI6EFVDE44AIW4E6KEWUGM36LLOYLA, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.649071609 (566h56m44.001856727s) [noise=true , address=77.90.31.16:4733 , piece_id=24WRVCBDI75ONQYNKYRMHLVK54FD3YOW5N63SBOMAB7N6IC2MTGQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.649399946 (566h56m44.002185054s) [noise=true , address=145.79.227.6:4258 , piece_id=Y3CIKI73MOVCJQJ2BYZY3V2233N53PHNXBPBKY5WNTRELUAVM6WQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.764765349 (566h56m44.117550466s) [upload=498965]: Next returned nil segment Sep 22 05:05:08.764780957 (566h56m44.117566076s) [upload=498965]: Waiting for error group managing segments... Sep 22 05:05:08.773009771 (566h56m44.125794889s) [noise=true , address=45.91.116.5:4297 , piece_id=3YJCUHSJ2AEWQDJHGJH5IBGQONIZXACVEKGSUIOYSHGW6KMYVSYA, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.774817473 (566h56m44.127602592s) [noise=true , address=45.91.116.9:4263 , piece_id=ETQVRACTG64MKQHG63TMCFNI6EFVDE44AIW4E6KEWUGM36LLOYLA, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.774938290 (566h56m44.127723408s) [noise=true , address=45.91.116.11:4117 , piece_id=NJL2INBDHQSESA2YIRI76SIU2D2EBP4NEHLXXW7IX6AYS7R4665Q, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.775807842 (566h56m44.12859296s) [noise=true , address=77.90.31.16:4733 , piece_id=24WRVCBDI75ONQYNKYRMHLVK54FD3YOW5N63SBOMAB7N6IC2MTGQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.776957419 (566h56m44.129742527s) [noise=true , address=45.91.116.6:4974 , piece_id=JIXDZMVZFMQ6MCFUIYGACMSVAJWPNMM6PPWC4T55DJNI37LMGYEA, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.777595076 (566h56m44.130380194s) [noise=true , address=45.91.116.14:4191 , piece_id=X6KDLA4ZF2CFF44WJIO3ORZICXK3W46DAZMV4MRAGFO6IXLFUL5Q, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.778067712 (566h56m44.13085282s) [noise=true , address=77.90.31.13:4627 , piece_id=DJJB62N27TX2O4QXRSDEW4LGQXXHWN37HGYPSNI3OZXNKY7527NQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.778273538 (566h56m44.131058656s) [noise=true , address=77.90.31.14:4661 , piece_id=3AFKH4DA5VJJOVZN6IMOQJ62KZALC3QXCLDMUUDE4R2LWCYHHLPQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:10.689057441 (566h56m46.041842549s) [noise=true , address=145.79.227.5:4223 , piece_id=CXQJ2PJEBEH5PE2WZRUP37GWQZJNCN5HMIWRMU4KQ3TC7OTBX5WQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: rpc: dial tcp 145.79.227.5:4223: connect: no route to host; manager closed: conn closed: op Sep 22 05:05:38.562528284 (566h57m13.915313392s) [noise=true , address=145.79.227.4:4187 , piece_id=TXSRDL6SK2JRYPX7LP46W2VBCN6SMNO64Y4WBYWU6HEGGDMWN6SQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: rpc: dial tcp 145.79.227.4:4187: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.562994859 (566h57m13.915779967s) [noise=true , address=145.79.227.6:4258 , piece_id=Y3CIKI73MOVCJQJ2BYZY3V2233N53PHNXBPBKY5WNTRELUAVM6WQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: rpc: dial tcp 145.79.227.6:4258: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.563028923 (566h57m13.91581402s) [noise=true , address=145.79.227.18:4007 , piece_id=DIWSY6S65ZEF235LV3ANA65XYPVWJLSZYNVML3RV6QOGH2LXXJ4A, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: rpc: dial tcp 145.79.227.18:4007: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.563059770 (566h57m13.915844869s) [noise=true , address=145.79.227.6:4257 , piece_id=WTA3NAGKQXDF6IY4TP54HSFNFRQUZWJLP7674KNO6AGYK2UDYKSA, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: rpc: dial tcp 145.79.227.6:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.563091261 (566h57m13.915876359s) [noise=true , address=145.79.227.14:4839 , piece_id=DE722RRCPXDTJEQPTIMVUFGDDPGVRNYORANSV4WOCR3SKGC7YBZA, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: rpc: dial tcp 145.79.227.14:4839: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.563119774 (566h57m13.915904872s) [noise=true , address=145.79.227.12:4767 , piece_id=YTBCLTU4FHQHXERZ57FFKH5XKIE5ZSTPOLFRE3WFLNAYWFCHX6MQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: rpc: dial tcp 145.79.227.12:4767: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.563246872 (566h57m13.91603198s) [noise=true , address=145.79.227.15:4875 , piece_id=KZDX6UKDTF6ERAZJAKQ47XN2Q3K5YT4SNY2F4HGU5PIVNFRSQU6Q, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: context deadline exceeded; context deadline exceeded Sep 22 05:05:38.563268573 (566h57m13.916053682s) [seg_pos={0 0}, upload=498965]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Sep 22 05:05:38.575632204 (566h57m13.928417312s) [upload=498965]: Done uploading segments... Sep 22 05:05:38.575647703 (566h57m13.928432811s) [upload=498965]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 392.513418ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....................................................X.X..X.] duration: 524.67552ms FAIL (2025-09-22 05:08:04 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== .79.227.27:4717 , piece_id=BJYH4RBBMPRDAB7I3S64JA2RKDSZWEW5WZESL4UBGMHIJ3DJZOFA, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.443356010 (566h58m39.796141139s) [noise=true , address=145.79.227.15:4890 , piece_id=SXSKTDJ6WKYGYLIHY7JPJU4CCIB57Y73COOERWFTPOVJDBAMHVAQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.443765328 (566h58m39.796550456s) [noise=true , address=145.79.227.33:4892 , piece_id=IRPSKGA5QTCEYH3H22ZGWUB4PSLWSKDOUGMXH7LAGRTZGO6NEYMQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444090558 (566h58m39.796875686s) [noise=true , address=145.79.227.29:4973 , piece_id=7EWN3F2YPAAAMXRUZHQ7FPYME3PCS7YABMIWY75JXHY2E4PN52FQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444188903 (566h58m39.79697403s) [noise=true , address=145.79.227.10:4419 , piece_id=JB2SSRHP2V2URKBPHPPLPML5SFLEUSF3WBA3HVLX3T5M7DK6TP5Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444577773 (566h58m39.797362901s) [noise=true , address=145.79.227.52:4474 , piece_id=AJ55FCPIVDMXVKKZ4VEX5DSJDHENFIWPYEXBRXZUAFD4FH2ERM3Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444677179 (566h58m39.797462307s) [noise=true , address=145.79.227.25:4629 , piece_id=FE4IVKMTA2UCEVM3IFR6CBPRXIRK7CFJMV7UPO4NULLDPEMHI5GQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.444962344 (566h58m39.797747472s) [noise=true , address=145.79.227.22:4518 , piece_id=QH2EP26EVUZVNQ4U3CJKZD5HLJ4OTLMDPZEVOW7SWA3RGRMZPVJA, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.445216612 (566h58m39.79800174s) [noise=true , address=145.79.227.13:4815 , piece_id=FKNQGYM6WHIOTFUJOGQPTVBUCCMKIJKM5634ORIXIRIKXGDLAX7Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.445329904 (566h58m39.798115033s) [noise=true , address=145.79.227.30:4790 , piece_id=NFLSQZPJ6PTFYTBRAZGGIZWJAJHYPSTIKYCHGMOK3NV562QQDX4A, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.445688447 (566h58m39.798473585s) [noise=true , address=145.79.227.46:4624 , piece_id=RLMCJZCLQM62QP3XQLDDQ22CLWHRASVOLU5CDXQVDPQ7ABHESU5Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.445754561 (566h58m39.798539689s) [noise=true , address=145.79.227.14:4866 , piece_id=NRUKXI3FQCGQI5WSURFOD5MWY5L5OJUV3B7RZLX33CAN5TXBCK4Q, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.446085091 (566h58m39.79887022s) [noise=true , address=77.90.31.18:4831 , piece_id=6YYF7O7WASB7L4BUMO6FRX3NGH3QPEB2EDMGZ52RUZYPEXI2D5CQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.446552749 (566h58m39.799337917s) [noise=true , address=66.23.193.175:4553 , piece_id=CUWCYLLGC2OZTEVGQTZH4H5DQWPRNZSNGW7LMZNM6U5KJI7ZCCIA, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.447022330 (566h58m39.799807459s) [noise=true , address=145.79.227.8:4355 , piece_id=3VMN7GJIJ4DSSRBC3EXPJLXGAO2KIFJ3HUZXPBN4GC7CXOYNSXRA, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.447446877 (566h58m39.800232005s) [noise=true , address=145.79.227.2:4118 , piece_id=UMZVCTVPRDDERUTNRCRLPVCHJL6MSGHIGLEIXO66FQC7NP7RNCUQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.447878927 (566h58m39.800664056s) [noise=true , address=145.79.227.12:4782 , piece_id=Q2WT5KUQ4UWHYNV5SW6XOJ4AMNPDLGIFWR2BVNAQGDJJ3ECNHAJQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.448061300 (566h58m39.800846428s) [noise=true , address=145.79.227.11:4736 , piece_id=DCW7GQ2BVMIED4W5FNS33XEDUEIT232O5NHZHGFPGGEFRL6IK3YQ, seg_pos={0 0}, upload=498993]: Uploading piece... Sep 22 05:07:04.528619474 (566h58m39.881404572s) [upload=498993]: Next returned nil segment Sep 22 05:07:04.528630534 (566h58m39.881415643s) [upload=498993]: Waiting for error group managing segments... Sep 22 05:07:04.538575067 (566h58m39.891360164s) [noise=true , address=145.79.227.30:4790 , piece_id=NFLSQZPJ6PTFYTBRAZGGIZWJAJHYPSTIKYCHGMOK3NV562QQDX4A, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.539546860 (566h58m39.892331958s) [noise=true , address=145.79.227.27:4717 , piece_id=BJYH4RBBMPRDAB7I3S64JA2RKDSZWEW5WZESL4UBGMHIJ3DJZOFA, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.539973170 (566h58m39.892758267s) [noise=true , address=77.90.31.18:4831 , piece_id=6YYF7O7WASB7L4BUMO6FRX3NGH3QPEB2EDMGZ52RUZYPEXI2D5CQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.540146776 (566h58m39.892931913s) [noise=true , address=145.79.227.33:4892 , piece_id=IRPSKGA5QTCEYH3H22ZGWUB4PSLWSKDOUGMXH7LAGRTZGO6NEYMQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.540291638 (566h58m39.893076746s) [noise=true , address=145.79.227.29:4973 , piece_id=7EWN3F2YPAAAMXRUZHQ7FPYME3PCS7YABMIWY75JXHY2E4PN52FQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.540795884 (566h58m39.893581022s) [noise=true , address=145.79.227.52:4474 , piece_id=AJ55FCPIVDMXVKKZ4VEX5DSJDHENFIWPYEXBRXZUAFD4FH2ERM3Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.544155669 (566h58m39.896940767s) [noise=true , address=145.79.227.25:4629 , piece_id=FE4IVKMTA2UCEVM3IFR6CBPRXIRK7CFJMV7UPO4NULLDPEMHI5GQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.552098143 (566h58m39.904883281s) [noise=true , address=145.79.227.46:4624 , piece_id=RLMCJZCLQM62QP3XQLDDQ22CLWHRASVOLU5CDXQVDPQ7ABHESU5Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:04.552115576 (566h58m39.904900674s) [noise=true , address=145.79.227.22:4518 , piece_id=QH2EP26EVUZVNQ4U3CJKZD5HLJ4OTLMDPZEVOW7SWA3RGRMZPVJA, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:05.041097924 (566h58m40.393883022s) [noise=true , address=66.23.193.175:4553 , piece_id=CUWCYLLGC2OZTEVGQTZH4H5DQWPRNZSNGW7LMZNM6U5KJI7ZCCIA, seg_pos={0 0}, upload=498993]: Done uploading piece. err: <nil> Sep 22 05:07:05.506063937 (566h58m40.858849035s) [noise=true , address=145.79.227.11:4736 , piece_id=DCW7GQ2BVMIED4W5FNS33XEDUEIT232O5NHZHGFPGGEFRL6IK3YQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1ejnWsitdrh68vSJvjR2QnRg4kva8DFRzqvvUuDkXM6zKUDWNC, address:145.79.227.11:4736): protocol: rpc: dial tcp 145.79.227.11:4736: connect: no route to host; manager closed: conn closed: op Sep 22 05:08:04.401016602 (566h59m39.75380173s) [noise=true , address=145.79.227.10:4419 , piece_id=JB2SSRHP2V2URKBPHPPLPML5SFLEUSF3WBA3HVLX3T5M7DK6TP5Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1YnhzSepDNJ6FEFq6ifLdmaGm7BZhMYs7JWbGmShbi38gSxxXL, address:145.79.227.10:4419): protocol: rpc: dial tcp 145.79.227.10:4419: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401091332 (566h59m39.753876461s) [noise=true , address=145.79.227.12:4782 , piece_id=Q2WT5KUQ4UWHYNV5SW6XOJ4AMNPDLGIFWR2BVNAQGDJJ3ECNHAJQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:17C7Wx6yE15jDtqqsQwWVj444YkvHBUWkkXjoCxfXPiErwyGKQ, address:145.79.227.12:4782): protocol: rpc: dial tcp 145.79.227.12:4782: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401101101 (566h59m39.753886229s) [noise=true , address=145.79.227.15:4890 , piece_id=SXSKTDJ6WKYGYLIHY7JPJU4CCIB57Y73COOERWFTPOVJDBAMHVAQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1gakF2Cctzc6EhFScfLfBHJdcDHqMBcey4mNoToEwbtk8Pwix5, address:145.79.227.15:4890): protocol: rpc: dial tcp 145.79.227.15:4890: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401148540 (566h59m39.753933678s) [noise=true , address=145.79.227.14:4866 , piece_id=NRUKXI3FQCGQI5WSURFOD5MWY5L5OJUV3B7RZLX33CAN5TXBCK4Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1zUcYfJE8xRW2Tow7bGB3PeNrVBUzVWR82JADkVwPdSr4CTPyr, address:145.79.227.14:4866): protocol: rpc: dial tcp 145.79.227.14:4866: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401183265 (566h59m39.753968403s) [noise=true , address=145.79.227.13:4815 , piece_id=FKNQGYM6WHIOTFUJOGQPTVBUCCMKIJKM5634ORIXIRIKXGDLAX7Q, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:1D4gdLHtXGAiLFhppWTVvqXjmiU6r5KJPyW1HG8zzyZ3EC6eYa, address:145.79.227.13:4815): protocol: rpc: dial tcp 145.79.227.13:4815: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401203854 (566h59m39.753988992s) [noise=true , address=145.79.227.2:4118 , piece_id=UMZVCTVPRDDERUTNRCRLPVCHJL6MSGHIGLEIXO66FQC7NP7RNCUQ, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:12ty5LHXwLmHC7nRPmVfj2wVEif6JQAQQ5Z5218vv1fKK5sD3zE, address:145.79.227.2:4118): protocol: rpc: dial tcp 145.79.227.2:4118: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401243117 (566h59m39.754028245s) [noise=true , address=145.79.227.8:4355 , piece_id=3VMN7GJIJ4DSSRBC3EXPJLXGAO2KIFJ3HUZXPBN4GC7CXOYNSXRA, seg_pos={0 0}, upload=498993]: Done uploading piece. err: ecclient: upload failed (node:12mRuEpX7CMxWXVdHrTi3zF3v9t3LcqE6mJKzocajEvYHM52a7T, address:145.79.227.8:4355): protocol: rpc: dial tcp 145.79.227.8:4355: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:08:04.401288963 (566h59m39.754074102s) [seg_pos={0 0}, upload=498993]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Sep 22 05:08:04.415054225 (566h59m39.767839353s) [upload=498993]: Done uploading segments... Sep 22 05:08:04.415080705 (566h59m39.767865833s) [upload=498993]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 524.692812ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [.................X........................X...X.......X.X...] duration: 375.533593ms FAIL (2025-09-22 05:07:48 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== Sep 22 05:05:08.574466427 (566h56m43.927251524s) [upload=498965]: Starting upload Sep 22 05:05:08.574523162 (566h56m43.92730827s) [upload=498965]: Done starting upload Sep 22 05:05:08.574642196 (566h56m43.927427294s) [upload=498965]: Uploading segments... Sep 22 05:05:08.574912313 (566h56m43.927697421s) [upload=498965]: Got next segment. Inline: false Sep 22 05:05:08.574948090 (566h56m43.927733187s) [upload=498965]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 05:05:08.574952448 (566h56m43.927737556s) [upload=498965]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 05:05:08.644515890 (566h56m43.997301028s) [seg_pos={0 0}, upload=498965]: Begin upload segment... Sep 22 05:05:08.644592704 (566h56m43.997377801s) [noise=true , address=145.79.227.18:4007 , piece_id=DIWSY6S65ZEF235LV3ANA65XYPVWJLSZYNVML3RV6QOGH2LXXJ4A, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.644626578 (566h56m43.997411706s) [noise=true , address=145.79.227.14:4839 , piece_id=DE722RRCPXDTJEQPTIMVUFGDDPGVRNYORANSV4WOCR3SKGC7YBZA, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.645098874 (566h56m43.997883982s) [seg_pos={0 0}, upload=498965]: Done begin upload segment. Sep 22 05:05:08.645214411 (566h56m43.997999528s) [noise=true , address=45.91.116.14:4191 , piece_id=X6KDLA4ZF2CFF44WJIO3ORZICXK3W46DAZMV4MRAGFO6IXLFUL5Q, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.645622547 (566h56m43.998407666s) [noise=true , address=145.79.227.15:4875 , piece_id=KZDX6UKDTF6ERAZJAKQ47XN2Q3K5YT4SNY2F4HGU5PIVNFRSQU6Q, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.646012358 (566h56m43.998797477s) [noise=true , address=45.91.116.5:4297 , piece_id=3YJCUHSJ2AEWQDJHGJH5IBGQONIZXACVEKGSUIOYSHGW6KMYVSYA, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.646338189 (566h56m43.999123298s) [noise=true , address=77.90.31.13:4627 , piece_id=DJJB62N27TX2O4QXRSDEW4LGQXXHWN37HGYPSNI3OZXNKY7527NQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.646705058 (566h56m43.999490177s) [noise=true , address=45.91.116.6:4974 , piece_id=JIXDZMVZFMQ6MCFUIYGACMSVAJWPNMM6PPWC4T55DJNI37LMGYEA, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.647049044 (566h56m43.999834162s) [noise=true , address=45.91.116.11:4117 , piece_id=NJL2INBDHQSESA2YIRI76SIU2D2EBP4NEHLXXW7IX6AYS7R4665Q, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.647493989 (566h56m44.000279097s) [noise=true , address=145.79.227.4:4187 , piece_id=TXSRDL6SK2JRYPX7LP46W2VBCN6SMNO64Y4WBYWU6HEGGDMWN6SQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.647754598 (566h56m44.000539696s) [noise=true , address=77.90.31.14:4661 , piece_id=3AFKH4DA5VJJOVZN6IMOQJ62KZALC3QXCLDMUUDE4R2LWCYHHLPQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.648005689 (566h56m44.000790787s) [noise=true , address=145.79.227.12:4767 , piece_id=YTBCLTU4FHQHXERZ57FFKH5XKIE5ZSTPOLFRE3WFLNAYWFCHX6MQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.648226032 (566h56m44.00101114s) [noise=true , address=145.79.227.5:4223 , piece_id=CXQJ2PJEBEH5PE2WZRUP37GWQZJNCN5HMIWRMU4KQ3TC7OTBX5WQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.648450123 (566h56m44.001235241s) [noise=true , address=145.79.227.6:4257 , piece_id=WTA3NAGKQXDF6IY4TP54HSFNFRQUZWJLP7674KNO6AGYK2UDYKSA, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.648730349 (566h56m44.001515467s) [noise=true , address=45.91.116.9:4263 , piece_id=ETQVRACTG64MKQHG63TMCFNI6EFVDE44AIW4E6KEWUGM36LLOYLA, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.649071609 (566h56m44.001856727s) [noise=true , address=77.90.31.16:4733 , piece_id=24WRVCBDI75ONQYNKYRMHLVK54FD3YOW5N63SBOMAB7N6IC2MTGQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.649399946 (566h56m44.002185054s) [noise=true , address=145.79.227.6:4258 , piece_id=Y3CIKI73MOVCJQJ2BYZY3V2233N53PHNXBPBKY5WNTRELUAVM6WQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.764765349 (566h56m44.117550466s) [upload=498965]: Next returned nil segment Sep 22 05:05:08.764780957 (566h56m44.117566076s) [upload=498965]: Waiting for error group managing segments... Sep 22 05:05:08.773009771 (566h56m44.125794889s) [noise=true , address=45.91.116.5:4297 , piece_id=3YJCUHSJ2AEWQDJHGJH5IBGQONIZXACVEKGSUIOYSHGW6KMYVSYA, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.774817473 (566h56m44.127602592s) [noise=true , address=45.91.116.9:4263 , piece_id=ETQVRACTG64MKQHG63TMCFNI6EFVDE44AIW4E6KEWUGM36LLOYLA, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.774938290 (566h56m44.127723408s) [noise=true , address=45.91.116.11:4117 , piece_id=NJL2INBDHQSESA2YIRI76SIU2D2EBP4NEHLXXW7IX6AYS7R4665Q, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.775807842 (566h56m44.12859296s) [noise=true , address=77.90.31.16:4733 , piece_id=24WRVCBDI75ONQYNKYRMHLVK54FD3YOW5N63SBOMAB7N6IC2MTGQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.776957419 (566h56m44.129742527s) [noise=true , address=45.91.116.6:4974 , piece_id=JIXDZMVZFMQ6MCFUIYGACMSVAJWPNMM6PPWC4T55DJNI37LMGYEA, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.777595076 (566h56m44.130380194s) [noise=true , address=45.91.116.14:4191 , piece_id=X6KDLA4ZF2CFF44WJIO3ORZICXK3W46DAZMV4MRAGFO6IXLFUL5Q, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.778067712 (566h56m44.13085282s) [noise=true , address=77.90.31.13:4627 , piece_id=DJJB62N27TX2O4QXRSDEW4LGQXXHWN37HGYPSNI3OZXNKY7527NQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.778273538 (566h56m44.131058656s) [noise=true , address=77.90.31.14:4661 , piece_id=3AFKH4DA5VJJOVZN6IMOQJ62KZALC3QXCLDMUUDE4R2LWCYHHLPQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:10.689057441 (566h56m46.041842549s) [noise=true , address=145.79.227.5:4223 , piece_id=CXQJ2PJEBEH5PE2WZRUP37GWQZJNCN5HMIWRMU4KQ3TC7OTBX5WQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: rpc: dial tcp 145.79.227.5:4223: connect: no route to host; manager closed: conn closed: op Sep 22 05:05:38.562528284 (566h57m13.915313392s) [noise=true , address=145.79.227.4:4187 , piece_id=TXSRDL6SK2JRYPX7LP46W2VBCN6SMNO64Y4WBYWU6HEGGDMWN6SQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: rpc: dial tcp 145.79.227.4:4187: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.562994859 (566h57m13.915779967s) [noise=true , address=145.79.227.6:4258 , piece_id=Y3CIKI73MOVCJQJ2BYZY3V2233N53PHNXBPBKY5WNTRELUAVM6WQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: rpc: dial tcp 145.79.227.6:4258: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.563028923 (566h57m13.91581402s) [noise=true , address=145.79.227.18:4007 , piece_id=DIWSY6S65ZEF235LV3ANA65XYPVWJLSZYNVML3RV6QOGH2LXXJ4A, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: rpc: dial tcp 145.79.227.18:4007: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.563059770 (566h57m13.915844869s) [noise=true , address=145.79.227.6:4257 , piece_id=WTA3NAGKQXDF6IY4TP54HSFNFRQUZWJLP7674KNO6AGYK2UDYKSA, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: rpc: dial tcp 145.79.227.6:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.563091261 (566h57m13.915876359s) [noise=true , address=145.79.227.14:4839 , piece_id=DE722RRCPXDTJEQPTIMVUFGDDPGVRNYORANSV4WOCR3SKGC7YBZA, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: rpc: dial tcp 145.79.227.14:4839: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.563119774 (566h57m13.915904872s) [noise=true , address=145.79.227.12:4767 , piece_id=YTBCLTU4FHQHXERZ57FFKH5XKIE5ZSTPOLFRE3WFLNAYWFCHX6MQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: rpc: dial tcp 145.79.227.12:4767: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.563246872 (566h57m13.91603198s) [noise=true , address=145.79.227.15:4875 , piece_id=KZDX6UKDTF6ERAZJAKQ47XN2Q3K5YT4SNY2F4HGU5PIVNFRSQU6Q, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: context deadline exceeded; context deadline exceeded Sep 22 05:05:38.563268573 (566h57m13.916053682s) [seg_pos={0 0}, upload=498965]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Sep 22 05:05:38.575632204 (566h57m13.928417312s) [upload=498965]: Done uploading segments... Sep 22 05:05:38.575647703 (566h57m13.928432811s) [upload=498965]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 375.555373ms core uplink us-select-1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 5.969932451s FAIL (2025-09-22 05:07:24 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.969956928s core uplink ap1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 10 out of 60 is failed (threshold=3) [..............XXX.XXXXX.........X........X..................] duration: 644.275061ms FAIL (2025-09-22 05:07:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 644.326908ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [..................X........................X...X.......X.X..] duration: 400.125912ms FAIL (2025-09-22 05:06:57 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== Sep 22 05:05:08.574466427 (566h56m43.927251524s) [upload=498965]: Starting upload Sep 22 05:05:08.574523162 (566h56m43.92730827s) [upload=498965]: Done starting upload Sep 22 05:05:08.574642196 (566h56m43.927427294s) [upload=498965]: Uploading segments... Sep 22 05:05:08.574912313 (566h56m43.927697421s) [upload=498965]: Got next segment. Inline: false Sep 22 05:05:08.574948090 (566h56m43.927733187s) [upload=498965]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 05:05:08.574952448 (566h56m43.927737556s) [upload=498965]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 05:05:08.644515890 (566h56m43.997301028s) [seg_pos={0 0}, upload=498965]: Begin upload segment... Sep 22 05:05:08.644592704 (566h56m43.997377801s) [noise=true , address=145.79.227.18:4007 , piece_id=DIWSY6S65ZEF235LV3ANA65XYPVWJLSZYNVML3RV6QOGH2LXXJ4A, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.644626578 (566h56m43.997411706s) [noise=true , address=145.79.227.14:4839 , piece_id=DE722RRCPXDTJEQPTIMVUFGDDPGVRNYORANSV4WOCR3SKGC7YBZA, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.645098874 (566h56m43.997883982s) [seg_pos={0 0}, upload=498965]: Done begin upload segment. Sep 22 05:05:08.645214411 (566h56m43.997999528s) [noise=true , address=45.91.116.14:4191 , piece_id=X6KDLA4ZF2CFF44WJIO3ORZICXK3W46DAZMV4MRAGFO6IXLFUL5Q, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.645622547 (566h56m43.998407666s) [noise=true , address=145.79.227.15:4875 , piece_id=KZDX6UKDTF6ERAZJAKQ47XN2Q3K5YT4SNY2F4HGU5PIVNFRSQU6Q, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.646012358 (566h56m43.998797477s) [noise=true , address=45.91.116.5:4297 , piece_id=3YJCUHSJ2AEWQDJHGJH5IBGQONIZXACVEKGSUIOYSHGW6KMYVSYA, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.646338189 (566h56m43.999123298s) [noise=true , address=77.90.31.13:4627 , piece_id=DJJB62N27TX2O4QXRSDEW4LGQXXHWN37HGYPSNI3OZXNKY7527NQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.646705058 (566h56m43.999490177s) [noise=true , address=45.91.116.6:4974 , piece_id=JIXDZMVZFMQ6MCFUIYGACMSVAJWPNMM6PPWC4T55DJNI37LMGYEA, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.647049044 (566h56m43.999834162s) [noise=true , address=45.91.116.11:4117 , piece_id=NJL2INBDHQSESA2YIRI76SIU2D2EBP4NEHLXXW7IX6AYS7R4665Q, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.647493989 (566h56m44.000279097s) [noise=true , address=145.79.227.4:4187 , piece_id=TXSRDL6SK2JRYPX7LP46W2VBCN6SMNO64Y4WBYWU6HEGGDMWN6SQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.647754598 (566h56m44.000539696s) [noise=true , address=77.90.31.14:4661 , piece_id=3AFKH4DA5VJJOVZN6IMOQJ62KZALC3QXCLDMUUDE4R2LWCYHHLPQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.648005689 (566h56m44.000790787s) [noise=true , address=145.79.227.12:4767 , piece_id=YTBCLTU4FHQHXERZ57FFKH5XKIE5ZSTPOLFRE3WFLNAYWFCHX6MQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.648226032 (566h56m44.00101114s) [noise=true , address=145.79.227.5:4223 , piece_id=CXQJ2PJEBEH5PE2WZRUP37GWQZJNCN5HMIWRMU4KQ3TC7OTBX5WQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.648450123 (566h56m44.001235241s) [noise=true , address=145.79.227.6:4257 , piece_id=WTA3NAGKQXDF6IY4TP54HSFNFRQUZWJLP7674KNO6AGYK2UDYKSA, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.648730349 (566h56m44.001515467s) [noise=true , address=45.91.116.9:4263 , piece_id=ETQVRACTG64MKQHG63TMCFNI6EFVDE44AIW4E6KEWUGM36LLOYLA, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.649071609 (566h56m44.001856727s) [noise=true , address=77.90.31.16:4733 , piece_id=24WRVCBDI75ONQYNKYRMHLVK54FD3YOW5N63SBOMAB7N6IC2MTGQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.649399946 (566h56m44.002185054s) [noise=true , address=145.79.227.6:4258 , piece_id=Y3CIKI73MOVCJQJ2BYZY3V2233N53PHNXBPBKY5WNTRELUAVM6WQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.764765349 (566h56m44.117550466s) [upload=498965]: Next returned nil segment Sep 22 05:05:08.764780957 (566h56m44.117566076s) [upload=498965]: Waiting for error group managing segments... Sep 22 05:05:08.773009771 (566h56m44.125794889s) [noise=true , address=45.91.116.5:4297 , piece_id=3YJCUHSJ2AEWQDJHGJH5IBGQONIZXACVEKGSUIOYSHGW6KMYVSYA, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.774817473 (566h56m44.127602592s) [noise=true , address=45.91.116.9:4263 , piece_id=ETQVRACTG64MKQHG63TMCFNI6EFVDE44AIW4E6KEWUGM36LLOYLA, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.774938290 (566h56m44.127723408s) [noise=true , address=45.91.116.11:4117 , piece_id=NJL2INBDHQSESA2YIRI76SIU2D2EBP4NEHLXXW7IX6AYS7R4665Q, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.775807842 (566h56m44.12859296s) [noise=true , address=77.90.31.16:4733 , piece_id=24WRVCBDI75ONQYNKYRMHLVK54FD3YOW5N63SBOMAB7N6IC2MTGQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.776957419 (566h56m44.129742527s) [noise=true , address=45.91.116.6:4974 , piece_id=JIXDZMVZFMQ6MCFUIYGACMSVAJWPNMM6PPWC4T55DJNI37LMGYEA, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.777595076 (566h56m44.130380194s) [noise=true , address=45.91.116.14:4191 , piece_id=X6KDLA4ZF2CFF44WJIO3ORZICXK3W46DAZMV4MRAGFO6IXLFUL5Q, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.778067712 (566h56m44.13085282s) [noise=true , address=77.90.31.13:4627 , piece_id=DJJB62N27TX2O4QXRSDEW4LGQXXHWN37HGYPSNI3OZXNKY7527NQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.778273538 (566h56m44.131058656s) [noise=true , address=77.90.31.14:4661 , piece_id=3AFKH4DA5VJJOVZN6IMOQJ62KZALC3QXCLDMUUDE4R2LWCYHHLPQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:10.689057441 (566h56m46.041842549s) [noise=true , address=145.79.227.5:4223 , piece_id=CXQJ2PJEBEH5PE2WZRUP37GWQZJNCN5HMIWRMU4KQ3TC7OTBX5WQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: rpc: dial tcp 145.79.227.5:4223: connect: no route to host; manager closed: conn closed: op Sep 22 05:05:38.562528284 (566h57m13.915313392s) [noise=true , address=145.79.227.4:4187 , piece_id=TXSRDL6SK2JRYPX7LP46W2VBCN6SMNO64Y4WBYWU6HEGGDMWN6SQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: rpc: dial tcp 145.79.227.4:4187: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.562994859 (566h57m13.915779967s) [noise=true , address=145.79.227.6:4258 , piece_id=Y3CIKI73MOVCJQJ2BYZY3V2233N53PHNXBPBKY5WNTRELUAVM6WQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: rpc: dial tcp 145.79.227.6:4258: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.563028923 (566h57m13.91581402s) [noise=true , address=145.79.227.18:4007 , piece_id=DIWSY6S65ZEF235LV3ANA65XYPVWJLSZYNVML3RV6QOGH2LXXJ4A, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: rpc: dial tcp 145.79.227.18:4007: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.563059770 (566h57m13.915844869s) [noise=true , address=145.79.227.6:4257 , piece_id=WTA3NAGKQXDF6IY4TP54HSFNFRQUZWJLP7674KNO6AGYK2UDYKSA, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: rpc: dial tcp 145.79.227.6:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.563091261 (566h57m13.915876359s) [noise=true , address=145.79.227.14:4839 , piece_id=DE722RRCPXDTJEQPTIMVUFGDDPGVRNYORANSV4WOCR3SKGC7YBZA, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: rpc: dial tcp 145.79.227.14:4839: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.563119774 (566h57m13.915904872s) [noise=true , address=145.79.227.12:4767 , piece_id=YTBCLTU4FHQHXERZ57FFKH5XKIE5ZSTPOLFRE3WFLNAYWFCHX6MQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: rpc: dial tcp 145.79.227.12:4767: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.563246872 (566h57m13.91603198s) [noise=true , address=145.79.227.15:4875 , piece_id=KZDX6UKDTF6ERAZJAKQ47XN2Q3K5YT4SNY2F4HGU5PIVNFRSQU6Q, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: context deadline exceeded; context deadline exceeded Sep 22 05:05:38.563268573 (566h57m13.916053682s) [seg_pos={0 0}, upload=498965]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Sep 22 05:05:38.575632204 (566h57m13.928417312s) [upload=498965]: Done uploading segments... Sep 22 05:05:38.575647703 (566h57m13.928432811s) [upload=498965]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 400.150026ms core uplink us-select-1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 5.941224703s FAIL (2025-09-22 05:06:50 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.941248929s core uplink ap1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 10 out of 60 is failed (threshold=3) [...............XXX.XXXXX.........X........X.................] duration: 472.255088ms FAIL (2025-09-22 05:06:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 472.274825ms edge gateway us-select-1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 6.570507234s FAIL (2025-09-22 05:05:53 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 6.57053188s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................................................X.X..] duration: 447.164965ms FAIL (2025-09-22 05:05:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 9) ======LOGS====== oise=true , address=145.79.227.30:4775 , piece_id=6Y5W2DO3TNAYW4UYCM7W5D56F57JLE5WSTQQT4WPMPAJE7ZQKIUA, seg_pos={0 0}, upload=498957]: Uploading piece... Sep 22 05:04:32.869236202 (566h56m8.22202133s) [noise=true , address=145.79.227.39:4013 , piece_id=OISIFQIDVNAG6G77B2EOUYM7WC2NENG3DGS64K5WEPUN5EQISC2Q, seg_pos={0 0}, upload=498957]: Uploading piece... Sep 22 05:04:32.869380733 (566h56m8.222165862s) [noise=true , address=145.79.227.38:4980 , piece_id=TT7VT2MZW2TMOYSU325BB2MFQH7BIQQ75GT6M56JWSZBPGBVAJAA, seg_pos={0 0}, upload=498957]: Uploading piece... Sep 22 05:04:32.869618289 (566h56m8.222403427s) [noise=true , address=145.79.227.17:4977 , piece_id=QW6HIOFGC47BVNYUMZTNWUN7GCQSWZKRCMKG6BNM3GLVLQ66UCWA, seg_pos={0 0}, upload=498957]: Uploading piece... Sep 22 05:04:32.869937808 (566h56m8.222722946s) [noise=true , address=145.79.227.12:4794 , piece_id=TX3XR7UNCENTL3C4A5O2ACH2ST6BSQEAD2R7Y4W5EXIHZQF6IBXA, seg_pos={0 0}, upload=498957]: Uploading piece... Sep 22 05:04:32.869996529 (566h56m8.222781658s) [noise=true , address=145.79.227.41:4088 , piece_id=YQ33LISFICOHVI37GJOWRYEGKE3YIXOBNEARYHUFWJFVT377OV4A, seg_pos={0 0}, upload=498957]: Uploading piece... Sep 22 05:04:32.870352486 (566h56m8.223137625s) [noise=true , address=77.90.31.15:4705 , piece_id=YNII3RGVISQN5FBTHCGJRANX7S3JBJIWQ7DRYCFJQWYL7KHDLL4Q, seg_pos={0 0}, upload=498957]: Uploading piece... Sep 22 05:04:32.870447775 (566h56m8.223232904s) [noise=true , address=145.79.227.6:4291 , piece_id=C2WV6SUTWERDVJFLR5C7MARPLUFZDOD4QIEP5BYZZ5QGMMRWD36A, seg_pos={0 0}, upload=498957]: Uploading piece... Sep 22 05:04:32.870728131 (566h56m8.22351327s) [noise=true , address=145.79.227.2:4142 , piece_id=3VMCECSE6AHD5CQ3XNMLB5OWGCQ2Y5TOU2KT3U3ZYBNU32UXAXEA, seg_pos={0 0}, upload=498957]: Uploading piece... Sep 22 05:04:32.871095151 (566h56m8.223880279s) [noise=true , address=145.79.227.23:4554 , piece_id=I24ISPJY5NVYO5NZEECJTGKYRXIZBA3PSG2XCNAYCAJUOCV7AY6A, seg_pos={0 0}, upload=498957]: Uploading piece... Sep 22 05:04:32.871460155 (566h56m8.224245284s) [noise=true , address=145.79.227.14:4849 , piece_id=EJM6IRSKW7ODLA7CN7RFVNJKAG7RMOBKRPGLMT4XQTDPYELVPYEQ, seg_pos={0 0}, upload=498957]: Uploading piece... Sep 22 05:04:32.871858163 (566h56m8.2246433s) [noise=true , address=145.79.227.16:4923 , piece_id=VZFQUIA44MHDJ2DBGCXX3M3RDPEXTVQH7NDBOCQQMNP3JACRRXHQ, seg_pos={0 0}, upload=498957]: Uploading piece... Sep 22 05:04:32.872170248 (566h56m8.224955386s) [noise=true , address=145.79.227.28:4757 , piece_id=7L64UR364ZCJYG4FXSJ4C7MKHR33VWAHGSSJZ26LGAGLPWY6FPRA, seg_pos={0 0}, upload=498957]: Uploading piece... Sep 22 05:04:32.872560089 (566h56m8.225345217s) [noise=true , address=145.79.227.4:4194 , piece_id=54FCM3DO55SH7GFEWH7QXL2TW5FMPPHCJCBQYEVZPEE7ZDYGU4LA, seg_pos={0 0}, upload=498957]: Uploading piece... Sep 22 05:04:32.872950993 (566h56m8.225736122s) [noise=true , address=145.79.227.18:4034 , piece_id=MY2SIGVQE4FFETRO37ULKLIXNGEL4IJSNQIYVKN3T6JCXAZ2PWFQ, seg_pos={0 0}, upload=498957]: Uploading piece... Sep 22 05:04:32.873309075 (566h56m8.226094203s) [noise=true , address=145.79.227.24:4612 , piece_id=NE5QKM62C2VO4P77XXIX2GQ46WSMJE3JRSUMTCAIKDJCFCPDVXNQ, seg_pos={0 0}, upload=498957]: Uploading piece... Sep 22 05:04:32.873498290 (566h56m8.226283418s) [noise=true , address=145.79.227.26:4656 , piece_id=5K3BFPPGLXVZZ3KF2R64TZD6GLFEOLE32ALH3JLSHQRHL6GJ4YTQ, seg_pos={0 0}, upload=498957]: Uploading piece... Sep 22 05:04:32.964399004 (566h56m8.317184132s) [upload=498957]: Next returned nil segment Sep 22 05:04:32.964414894 (566h56m8.317200022s) [upload=498957]: Waiting for error group managing segments... Sep 22 05:04:32.973347836 (566h56m8.326132965s) [noise=true , address=145.79.227.26:4656 , piece_id=5K3BFPPGLXVZZ3KF2R64TZD6GLFEOLE32ALH3JLSHQRHL6GJ4YTQ, seg_pos={0 0}, upload=498957]: Done uploading piece. err: <nil> Sep 22 05:04:32.974027452 (566h56m8.32681258s) [noise=true , address=145.79.227.30:4775 , piece_id=6Y5W2DO3TNAYW4UYCM7W5D56F57JLE5WSTQQT4WPMPAJE7ZQKIUA, seg_pos={0 0}, upload=498957]: Done uploading piece. err: <nil> Sep 22 05:04:32.974372609 (566h56m8.327157747s) [noise=true , address=145.79.227.28:4757 , piece_id=7L64UR364ZCJYG4FXSJ4C7MKHR33VWAHGSSJZ26LGAGLPWY6FPRA, seg_pos={0 0}, upload=498957]: Done uploading piece. err: <nil> Sep 22 05:04:32.974976603 (566h56m8.327761731s) [noise=true , address=145.79.227.24:4612 , piece_id=NE5QKM62C2VO4P77XXIX2GQ46WSMJE3JRSUMTCAIKDJCFCPDVXNQ, seg_pos={0 0}, upload=498957]: Done uploading piece. err: <nil> Sep 22 05:04:32.975003984 (566h56m8.327789123s) [noise=true , address=145.79.227.38:4980 , piece_id=TT7VT2MZW2TMOYSU325BB2MFQH7BIQQ75GT6M56JWSZBPGBVAJAA, seg_pos={0 0}, upload=498957]: Done uploading piece. err: <nil> Sep 22 05:04:32.975556542 (566h56m8.32834167s) [noise=true , address=77.90.31.15:4705 , piece_id=YNII3RGVISQN5FBTHCGJRANX7S3JBJIWQ7DRYCFJQWYL7KHDLL4Q, seg_pos={0 0}, upload=498957]: Done uploading piece. err: <nil> Sep 22 05:04:32.975661399 (566h56m8.328446526s) [noise=true , address=145.79.227.41:4088 , piece_id=YQ33LISFICOHVI37GJOWRYEGKE3YIXOBNEARYHUFWJFVT377OV4A, seg_pos={0 0}, upload=498957]: Done uploading piece. err: <nil> Sep 22 05:04:32.976217391 (566h56m8.329002519s) [noise=true , address=145.79.227.39:4013 , piece_id=OISIFQIDVNAG6G77B2EOUYM7WC2NENG3DGS64K5WEPUN5EQISC2Q, seg_pos={0 0}, upload=498957]: Done uploading piece. err: <nil> Sep 22 05:04:32.976274820 (566h56m8.329059948s) [noise=true , address=145.79.227.23:4554 , piece_id=I24ISPJY5NVYO5NZEECJTGKYRXIZBA3PSG2XCNAYCAJUOCV7AY6A, seg_pos={0 0}, upload=498957]: Done uploading piece. err: <nil> Sep 22 05:04:34.588452708 (566h56m9.941237805s) [noise=true , address=145.79.227.4:4194 , piece_id=54FCM3DO55SH7GFEWH7QXL2TW5FMPPHCJCBQYEVZPEE7ZDYGU4LA, seg_pos={0 0}, upload=498957]: Done uploading piece. err: ecclient: upload failed (node:1u6tGwzk56SwgUqzpyRFLNTTysUtk6C2Ls77UkjFryeuF9D8pV, address:145.79.227.4:4194): protocol: rpc: dial tcp 145.79.227.4:4194: connect: no route to host; manager closed: conn closed: op Sep 22 05:05:32.833224105 (566h57m8.186009232s) [noise=true , address=145.79.227.12:4794 , piece_id=TX3XR7UNCENTL3C4A5O2ACH2ST6BSQEAD2R7Y4W5EXIHZQF6IBXA, seg_pos={0 0}, upload=498957]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:32.833501003 (566h57m8.186286132s) [noise=true , address=145.79.227.2:4142 , piece_id=3VMCECSE6AHD5CQ3XNMLB5OWGCQ2Y5TOU2KT3U3ZYBNU32UXAXEA, seg_pos={0 0}, upload=498957]: Done uploading piece. err: ecclient: upload failed (node:12JR1vFqWgTH1qwvxH4DEk4eKT7TfxWC2Re6QEWmqxWXctytfa7, address:145.79.227.2:4142): protocol: rpc: dial tcp 145.79.227.2:4142: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:32.833572338 (566h57m8.186357467s) [noise=true , address=145.79.227.13:4809 , piece_id=NYNY3JSUNABLAIUIMVGJ5BFBIQAX23XQUXWV6I7G2KLSLDQSF3ZQ, seg_pos={0 0}, upload=498957]: Done uploading piece. err: ecclient: upload failed (node:17LrYeCkrPWdiL9gGZ568PvfFct6cLVRQE4Qa92ykLgqXSfBL9, address:145.79.227.13:4809): protocol: rpc: dial tcp 145.79.227.13:4809: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:32.833623324 (566h57m8.186408452s) [noise=true , address=145.79.227.18:4034 , piece_id=MY2SIGVQE4FFETRO37ULKLIXNGEL4IJSNQIYVKN3T6JCXAZ2PWFQ, seg_pos={0 0}, upload=498957]: Done uploading piece. err: ecclient: upload failed (node:12jHHvRhcKfV1ufn7PRfnPHJ3ZxWJ8JUutf772G7YcKQjbpE3ZY, address:145.79.227.18:4034): protocol: rpc: dial tcp 145.79.227.18:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:32.833716739 (566h57m8.186501867s) [noise=true , address=145.79.227.17:4977 , piece_id=QW6HIOFGC47BVNYUMZTNWUN7GCQSWZKRCMKG6BNM3GLVLQ66UCWA, seg_pos={0 0}, upload=498957]: Done uploading piece. err: ecclient: upload failed (node:12WCAm12tXwimFSPqz7Seh6A4oxWqQVxqsF459xux4a5CqjpbAT, address:145.79.227.17:4977): protocol: rpc: dial tcp 145.79.227.17:4977: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:32.833859096 (566h57m8.186644224s) [noise=true , address=145.79.227.6:4291 , piece_id=C2WV6SUTWERDVJFLR5C7MARPLUFZDOD4QIEP5BYZZ5QGMMRWD36A, seg_pos={0 0}, upload=498957]: Done uploading piece. err: ecclient: upload failed (node:125JwnPDmKBNm3TybPWrzRbpzo5pnLei38joZeetvDG3wU32ZNb, address:145.79.227.6:4291): protocol: rpc: dial tcp 145.79.227.6:4291: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:32.833980744 (566h57m8.186765873s) [noise=true , address=145.79.227.14:4849 , piece_id=EJM6IRSKW7ODLA7CN7RFVNJKAG7RMOBKRPGLMT4XQTDPYELVPYEQ, seg_pos={0 0}, upload=498957]: Done uploading piece. err: ecclient: upload failed (node:1n2gSzVmNCEZcfVsFKibjXHs2jMr82D3SWQEykFQQ4uyhhnrj1, address:145.79.227.14:4849): protocol: rpc: dial tcp 145.79.227.14:4849: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:32.833988539 (566h57m8.186773667s) [noise=true , address=145.79.227.16:4923 , piece_id=VZFQUIA44MHDJ2DBGCXX3M3RDPEXTVQH7NDBOCQQMNP3JACRRXHQ, seg_pos={0 0}, upload=498957]: Done uploading piece. err: ecclient: upload failed (node:12Ee9ZfH81oy4SAUxozjQNWJ7ALmWDXQZYPLFwuAiJ8V6E7jT6r, address:145.79.227.16:4923): protocol: rpc: dial tcp 145.79.227.16:4923: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:32.834038853 (566h57m8.186823982s) [seg_pos={0 0}, upload=498957]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil> Sep 22 05:05:32.847776423 (566h57m8.200561541s) [upload=498957]: Done uploading segments... Sep 22 05:05:32.847795129 (566h57m8.200580256s) [upload=498957]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9) Duration: 447.227051ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [...................X........................X...X.......X.X.] duration: 771.619844ms FAIL (2025-09-22 05:05:44 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== Sep 22 05:05:08.574466427 (566h56m43.927251524s) [upload=498965]: Starting upload Sep 22 05:05:08.574523162 (566h56m43.92730827s) [upload=498965]: Done starting upload Sep 22 05:05:08.574642196 (566h56m43.927427294s) [upload=498965]: Uploading segments... Sep 22 05:05:08.574912313 (566h56m43.927697421s) [upload=498965]: Got next segment. Inline: false Sep 22 05:05:08.574948090 (566h56m43.927733187s) [upload=498965]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 05:05:08.574952448 (566h56m43.927737556s) [upload=498965]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 05:05:08.644515890 (566h56m43.997301028s) [seg_pos={0 0}, upload=498965]: Begin upload segment... Sep 22 05:05:08.644592704 (566h56m43.997377801s) [noise=true , address=145.79.227.18:4007 , piece_id=DIWSY6S65ZEF235LV3ANA65XYPVWJLSZYNVML3RV6QOGH2LXXJ4A, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.644626578 (566h56m43.997411706s) [noise=true , address=145.79.227.14:4839 , piece_id=DE722RRCPXDTJEQPTIMVUFGDDPGVRNYORANSV4WOCR3SKGC7YBZA, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.645098874 (566h56m43.997883982s) [seg_pos={0 0}, upload=498965]: Done begin upload segment. Sep 22 05:05:08.645214411 (566h56m43.997999528s) [noise=true , address=45.91.116.14:4191 , piece_id=X6KDLA4ZF2CFF44WJIO3ORZICXK3W46DAZMV4MRAGFO6IXLFUL5Q, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.645622547 (566h56m43.998407666s) [noise=true , address=145.79.227.15:4875 , piece_id=KZDX6UKDTF6ERAZJAKQ47XN2Q3K5YT4SNY2F4HGU5PIVNFRSQU6Q, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.646012358 (566h56m43.998797477s) [noise=true , address=45.91.116.5:4297 , piece_id=3YJCUHSJ2AEWQDJHGJH5IBGQONIZXACVEKGSUIOYSHGW6KMYVSYA, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.646338189 (566h56m43.999123298s) [noise=true , address=77.90.31.13:4627 , piece_id=DJJB62N27TX2O4QXRSDEW4LGQXXHWN37HGYPSNI3OZXNKY7527NQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.646705058 (566h56m43.999490177s) [noise=true , address=45.91.116.6:4974 , piece_id=JIXDZMVZFMQ6MCFUIYGACMSVAJWPNMM6PPWC4T55DJNI37LMGYEA, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.647049044 (566h56m43.999834162s) [noise=true , address=45.91.116.11:4117 , piece_id=NJL2INBDHQSESA2YIRI76SIU2D2EBP4NEHLXXW7IX6AYS7R4665Q, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.647493989 (566h56m44.000279097s) [noise=true , address=145.79.227.4:4187 , piece_id=TXSRDL6SK2JRYPX7LP46W2VBCN6SMNO64Y4WBYWU6HEGGDMWN6SQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.647754598 (566h56m44.000539696s) [noise=true , address=77.90.31.14:4661 , piece_id=3AFKH4DA5VJJOVZN6IMOQJ62KZALC3QXCLDMUUDE4R2LWCYHHLPQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.648005689 (566h56m44.000790787s) [noise=true , address=145.79.227.12:4767 , piece_id=YTBCLTU4FHQHXERZ57FFKH5XKIE5ZSTPOLFRE3WFLNAYWFCHX6MQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.648226032 (566h56m44.00101114s) [noise=true , address=145.79.227.5:4223 , piece_id=CXQJ2PJEBEH5PE2WZRUP37GWQZJNCN5HMIWRMU4KQ3TC7OTBX5WQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.648450123 (566h56m44.001235241s) [noise=true , address=145.79.227.6:4257 , piece_id=WTA3NAGKQXDF6IY4TP54HSFNFRQUZWJLP7674KNO6AGYK2UDYKSA, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.648730349 (566h56m44.001515467s) [noise=true , address=45.91.116.9:4263 , piece_id=ETQVRACTG64MKQHG63TMCFNI6EFVDE44AIW4E6KEWUGM36LLOYLA, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.649071609 (566h56m44.001856727s) [noise=true , address=77.90.31.16:4733 , piece_id=24WRVCBDI75ONQYNKYRMHLVK54FD3YOW5N63SBOMAB7N6IC2MTGQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.649399946 (566h56m44.002185054s) [noise=true , address=145.79.227.6:4258 , piece_id=Y3CIKI73MOVCJQJ2BYZY3V2233N53PHNXBPBKY5WNTRELUAVM6WQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.764765349 (566h56m44.117550466s) [upload=498965]: Next returned nil segment Sep 22 05:05:08.764780957 (566h56m44.117566076s) [upload=498965]: Waiting for error group managing segments... Sep 22 05:05:08.773009771 (566h56m44.125794889s) [noise=true , address=45.91.116.5:4297 , piece_id=3YJCUHSJ2AEWQDJHGJH5IBGQONIZXACVEKGSUIOYSHGW6KMYVSYA, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.774817473 (566h56m44.127602592s) [noise=true , address=45.91.116.9:4263 , piece_id=ETQVRACTG64MKQHG63TMCFNI6EFVDE44AIW4E6KEWUGM36LLOYLA, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.774938290 (566h56m44.127723408s) [noise=true , address=45.91.116.11:4117 , piece_id=NJL2INBDHQSESA2YIRI76SIU2D2EBP4NEHLXXW7IX6AYS7R4665Q, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.775807842 (566h56m44.12859296s) [noise=true , address=77.90.31.16:4733 , piece_id=24WRVCBDI75ONQYNKYRMHLVK54FD3YOW5N63SBOMAB7N6IC2MTGQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.776957419 (566h56m44.129742527s) [noise=true , address=45.91.116.6:4974 , piece_id=JIXDZMVZFMQ6MCFUIYGACMSVAJWPNMM6PPWC4T55DJNI37LMGYEA, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.777595076 (566h56m44.130380194s) [noise=true , address=45.91.116.14:4191 , piece_id=X6KDLA4ZF2CFF44WJIO3ORZICXK3W46DAZMV4MRAGFO6IXLFUL5Q, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.778067712 (566h56m44.13085282s) [noise=true , address=77.90.31.13:4627 , piece_id=DJJB62N27TX2O4QXRSDEW4LGQXXHWN37HGYPSNI3OZXNKY7527NQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.778273538 (566h56m44.131058656s) [noise=true , address=77.90.31.14:4661 , piece_id=3AFKH4DA5VJJOVZN6IMOQJ62KZALC3QXCLDMUUDE4R2LWCYHHLPQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:10.689057441 (566h56m46.041842549s) [noise=true , address=145.79.227.5:4223 , piece_id=CXQJ2PJEBEH5PE2WZRUP37GWQZJNCN5HMIWRMU4KQ3TC7OTBX5WQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: rpc: dial tcp 145.79.227.5:4223: connect: no route to host; manager closed: conn closed: op Sep 22 05:05:38.562528284 (566h57m13.915313392s) [noise=true , address=145.79.227.4:4187 , piece_id=TXSRDL6SK2JRYPX7LP46W2VBCN6SMNO64Y4WBYWU6HEGGDMWN6SQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: rpc: dial tcp 145.79.227.4:4187: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.562994859 (566h57m13.915779967s) [noise=true , address=145.79.227.6:4258 , piece_id=Y3CIKI73MOVCJQJ2BYZY3V2233N53PHNXBPBKY5WNTRELUAVM6WQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: rpc: dial tcp 145.79.227.6:4258: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.563028923 (566h57m13.91581402s) [noise=true , address=145.79.227.18:4007 , piece_id=DIWSY6S65ZEF235LV3ANA65XYPVWJLSZYNVML3RV6QOGH2LXXJ4A, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: rpc: dial tcp 145.79.227.18:4007: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.563059770 (566h57m13.915844869s) [noise=true , address=145.79.227.6:4257 , piece_id=WTA3NAGKQXDF6IY4TP54HSFNFRQUZWJLP7674KNO6AGYK2UDYKSA, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: rpc: dial tcp 145.79.227.6:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.563091261 (566h57m13.915876359s) [noise=true , address=145.79.227.14:4839 , piece_id=DE722RRCPXDTJEQPTIMVUFGDDPGVRNYORANSV4WOCR3SKGC7YBZA, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: rpc: dial tcp 145.79.227.14:4839: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.563119774 (566h57m13.915904872s) [noise=true , address=145.79.227.12:4767 , piece_id=YTBCLTU4FHQHXERZ57FFKH5XKIE5ZSTPOLFRE3WFLNAYWFCHX6MQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: rpc: dial tcp 145.79.227.12:4767: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.563246872 (566h57m13.91603198s) [noise=true , address=145.79.227.15:4875 , piece_id=KZDX6UKDTF6ERAZJAKQ47XN2Q3K5YT4SNY2F4HGU5PIVNFRSQU6Q, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: context deadline exceeded; context deadline exceeded Sep 22 05:05:38.563268573 (566h57m13.916053682s) [seg_pos={0 0}, upload=498965]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Sep 22 05:05:38.575632204 (566h57m13.928417312s) [upload=498965]: Done uploading segments... Sep 22 05:05:38.575647703 (566h57m13.928432811s) [upload=498965]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 771.650059ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [....................X........................X...X.......X.X] duration: 30.01416388s FAIL (2025-09-22 05:05:38 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== Sep 22 05:05:08.574466427 (566h56m43.927251524s) [upload=498965]: Starting upload Sep 22 05:05:08.574523162 (566h56m43.92730827s) [upload=498965]: Done starting upload Sep 22 05:05:08.574642196 (566h56m43.927427294s) [upload=498965]: Uploading segments... Sep 22 05:05:08.574912313 (566h56m43.927697421s) [upload=498965]: Got next segment. Inline: false Sep 22 05:05:08.574948090 (566h56m43.927733187s) [upload=498965]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 22 05:05:08.574952448 (566h56m43.927737556s) [upload=498965]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 22 05:05:08.644515890 (566h56m43.997301028s) [seg_pos={0 0}, upload=498965]: Begin upload segment... Sep 22 05:05:08.644592704 (566h56m43.997377801s) [noise=true , address=145.79.227.18:4007 , piece_id=DIWSY6S65ZEF235LV3ANA65XYPVWJLSZYNVML3RV6QOGH2LXXJ4A, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.644626578 (566h56m43.997411706s) [noise=true , address=145.79.227.14:4839 , piece_id=DE722RRCPXDTJEQPTIMVUFGDDPGVRNYORANSV4WOCR3SKGC7YBZA, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.645098874 (566h56m43.997883982s) [seg_pos={0 0}, upload=498965]: Done begin upload segment. Sep 22 05:05:08.645214411 (566h56m43.997999528s) [noise=true , address=45.91.116.14:4191 , piece_id=X6KDLA4ZF2CFF44WJIO3ORZICXK3W46DAZMV4MRAGFO6IXLFUL5Q, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.645622547 (566h56m43.998407666s) [noise=true , address=145.79.227.15:4875 , piece_id=KZDX6UKDTF6ERAZJAKQ47XN2Q3K5YT4SNY2F4HGU5PIVNFRSQU6Q, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.646012358 (566h56m43.998797477s) [noise=true , address=45.91.116.5:4297 , piece_id=3YJCUHSJ2AEWQDJHGJH5IBGQONIZXACVEKGSUIOYSHGW6KMYVSYA, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.646338189 (566h56m43.999123298s) [noise=true , address=77.90.31.13:4627 , piece_id=DJJB62N27TX2O4QXRSDEW4LGQXXHWN37HGYPSNI3OZXNKY7527NQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.646705058 (566h56m43.999490177s) [noise=true , address=45.91.116.6:4974 , piece_id=JIXDZMVZFMQ6MCFUIYGACMSVAJWPNMM6PPWC4T55DJNI37LMGYEA, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.647049044 (566h56m43.999834162s) [noise=true , address=45.91.116.11:4117 , piece_id=NJL2INBDHQSESA2YIRI76SIU2D2EBP4NEHLXXW7IX6AYS7R4665Q, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.647493989 (566h56m44.000279097s) [noise=true , address=145.79.227.4:4187 , piece_id=TXSRDL6SK2JRYPX7LP46W2VBCN6SMNO64Y4WBYWU6HEGGDMWN6SQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.647754598 (566h56m44.000539696s) [noise=true , address=77.90.31.14:4661 , piece_id=3AFKH4DA5VJJOVZN6IMOQJ62KZALC3QXCLDMUUDE4R2LWCYHHLPQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.648005689 (566h56m44.000790787s) [noise=true , address=145.79.227.12:4767 , piece_id=YTBCLTU4FHQHXERZ57FFKH5XKIE5ZSTPOLFRE3WFLNAYWFCHX6MQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.648226032 (566h56m44.00101114s) [noise=true , address=145.79.227.5:4223 , piece_id=CXQJ2PJEBEH5PE2WZRUP37GWQZJNCN5HMIWRMU4KQ3TC7OTBX5WQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.648450123 (566h56m44.001235241s) [noise=true , address=145.79.227.6:4257 , piece_id=WTA3NAGKQXDF6IY4TP54HSFNFRQUZWJLP7674KNO6AGYK2UDYKSA, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.648730349 (566h56m44.001515467s) [noise=true , address=45.91.116.9:4263 , piece_id=ETQVRACTG64MKQHG63TMCFNI6EFVDE44AIW4E6KEWUGM36LLOYLA, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.649071609 (566h56m44.001856727s) [noise=true , address=77.90.31.16:4733 , piece_id=24WRVCBDI75ONQYNKYRMHLVK54FD3YOW5N63SBOMAB7N6IC2MTGQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.649399946 (566h56m44.002185054s) [noise=true , address=145.79.227.6:4258 , piece_id=Y3CIKI73MOVCJQJ2BYZY3V2233N53PHNXBPBKY5WNTRELUAVM6WQ, seg_pos={0 0}, upload=498965]: Uploading piece... Sep 22 05:05:08.764765349 (566h56m44.117550466s) [upload=498965]: Next returned nil segment Sep 22 05:05:08.764780957 (566h56m44.117566076s) [upload=498965]: Waiting for error group managing segments... Sep 22 05:05:08.773009771 (566h56m44.125794889s) [noise=true , address=45.91.116.5:4297 , piece_id=3YJCUHSJ2AEWQDJHGJH5IBGQONIZXACVEKGSUIOYSHGW6KMYVSYA, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.774817473 (566h56m44.127602592s) [noise=true , address=45.91.116.9:4263 , piece_id=ETQVRACTG64MKQHG63TMCFNI6EFVDE44AIW4E6KEWUGM36LLOYLA, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.774938290 (566h56m44.127723408s) [noise=true , address=45.91.116.11:4117 , piece_id=NJL2INBDHQSESA2YIRI76SIU2D2EBP4NEHLXXW7IX6AYS7R4665Q, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.775807842 (566h56m44.12859296s) [noise=true , address=77.90.31.16:4733 , piece_id=24WRVCBDI75ONQYNKYRMHLVK54FD3YOW5N63SBOMAB7N6IC2MTGQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.776957419 (566h56m44.129742527s) [noise=true , address=45.91.116.6:4974 , piece_id=JIXDZMVZFMQ6MCFUIYGACMSVAJWPNMM6PPWC4T55DJNI37LMGYEA, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.777595076 (566h56m44.130380194s) [noise=true , address=45.91.116.14:4191 , piece_id=X6KDLA4ZF2CFF44WJIO3ORZICXK3W46DAZMV4MRAGFO6IXLFUL5Q, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.778067712 (566h56m44.13085282s) [noise=true , address=77.90.31.13:4627 , piece_id=DJJB62N27TX2O4QXRSDEW4LGQXXHWN37HGYPSNI3OZXNKY7527NQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:08.778273538 (566h56m44.131058656s) [noise=true , address=77.90.31.14:4661 , piece_id=3AFKH4DA5VJJOVZN6IMOQJ62KZALC3QXCLDMUUDE4R2LWCYHHLPQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: <nil> Sep 22 05:05:10.689057441 (566h56m46.041842549s) [noise=true , address=145.79.227.5:4223 , piece_id=CXQJ2PJEBEH5PE2WZRUP37GWQZJNCN5HMIWRMU4KQ3TC7OTBX5WQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:145.79.227.5:4223): protocol: rpc: dial tcp 145.79.227.5:4223: connect: no route to host; manager closed: conn closed: op Sep 22 05:05:38.562528284 (566h57m13.915313392s) [noise=true , address=145.79.227.4:4187 , piece_id=TXSRDL6SK2JRYPX7LP46W2VBCN6SMNO64Y4WBYWU6HEGGDMWN6SQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:145.79.227.4:4187): protocol: rpc: dial tcp 145.79.227.4:4187: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.562994859 (566h57m13.915779967s) [noise=true , address=145.79.227.6:4258 , piece_id=Y3CIKI73MOVCJQJ2BYZY3V2233N53PHNXBPBKY5WNTRELUAVM6WQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:145.79.227.6:4258): protocol: rpc: dial tcp 145.79.227.6:4258: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.563028923 (566h57m13.91581402s) [noise=true , address=145.79.227.18:4007 , piece_id=DIWSY6S65ZEF235LV3ANA65XYPVWJLSZYNVML3RV6QOGH2LXXJ4A, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:145.79.227.18:4007): protocol: rpc: dial tcp 145.79.227.18:4007: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.563059770 (566h57m13.915844869s) [noise=true , address=145.79.227.6:4257 , piece_id=WTA3NAGKQXDF6IY4TP54HSFNFRQUZWJLP7674KNO6AGYK2UDYKSA, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:12shbJLfcGs27jH9tFC4L5bQCSNnkatQSXEUyVvDBCJ6oPLLeMK, address:145.79.227.6:4257): protocol: rpc: dial tcp 145.79.227.6:4257: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.563091261 (566h57m13.915876359s) [noise=true , address=145.79.227.14:4839 , piece_id=DE722RRCPXDTJEQPTIMVUFGDDPGVRNYORANSV4WOCR3SKGC7YBZA, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv, address:145.79.227.14:4839): protocol: rpc: dial tcp 145.79.227.14:4839: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.563119774 (566h57m13.915904872s) [noise=true , address=145.79.227.12:4767 , piece_id=YTBCLTU4FHQHXERZ57FFKH5XKIE5ZSTPOLFRE3WFLNAYWFCHX6MQ, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:145.79.227.12:4767): protocol: rpc: dial tcp 145.79.227.12:4767: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:38.563246872 (566h57m13.91603198s) [noise=true , address=145.79.227.15:4875 , piece_id=KZDX6UKDTF6ERAZJAKQ47XN2Q3K5YT4SNY2F4HGU5PIVNFRSQU6Q, seg_pos={0 0}, upload=498965]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: context deadline exceeded; context deadline exceeded Sep 22 05:05:38.563268573 (566h57m13.916053682s) [seg_pos={0 0}, upload=498965]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Sep 22 05:05:38.575632204 (566h57m13.928417312s) [upload=498965]: Done uploading segments... Sep 22 05:05:38.575647703 (566h57m13.928432811s) [upload=498965]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 30.014178668s core uplink us-select-1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 5.465114143s FAIL (2025-09-22 05:05:37 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.465135773s core uplink ap1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 10 out of 60 is failed (threshold=3) [................XXX.XXXXX.........X........X................] duration: 514.265685ms FAIL (2025-09-22 05:05:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 514.304278ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................................................X.X.] duration: 391.127146ms FAIL (2025-09-22 05:05:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 9) ======LOGS====== oise=true , address=145.79.227.30:4775 , piece_id=6Y5W2DO3TNAYW4UYCM7W5D56F57JLE5WSTQQT4WPMPAJE7ZQKIUA, seg_pos={0 0}, upload=498957]: Uploading piece... Sep 22 05:04:32.869236202 (566h56m8.22202133s) [noise=true , address=145.79.227.39:4013 , piece_id=OISIFQIDVNAG6G77B2EOUYM7WC2NENG3DGS64K5WEPUN5EQISC2Q, seg_pos={0 0}, upload=498957]: Uploading piece... Sep 22 05:04:32.869380733 (566h56m8.222165862s) [noise=true , address=145.79.227.38:4980 , piece_id=TT7VT2MZW2TMOYSU325BB2MFQH7BIQQ75GT6M56JWSZBPGBVAJAA, seg_pos={0 0}, upload=498957]: Uploading piece... Sep 22 05:04:32.869618289 (566h56m8.222403427s) [noise=true , address=145.79.227.17:4977 , piece_id=QW6HIOFGC47BVNYUMZTNWUN7GCQSWZKRCMKG6BNM3GLVLQ66UCWA, seg_pos={0 0}, upload=498957]: Uploading piece... Sep 22 05:04:32.869937808 (566h56m8.222722946s) [noise=true , address=145.79.227.12:4794 , piece_id=TX3XR7UNCENTL3C4A5O2ACH2ST6BSQEAD2R7Y4W5EXIHZQF6IBXA, seg_pos={0 0}, upload=498957]: Uploading piece... Sep 22 05:04:32.869996529 (566h56m8.222781658s) [noise=true , address=145.79.227.41:4088 , piece_id=YQ33LISFICOHVI37GJOWRYEGKE3YIXOBNEARYHUFWJFVT377OV4A, seg_pos={0 0}, upload=498957]: Uploading piece... Sep 22 05:04:32.870352486 (566h56m8.223137625s) [noise=true , address=77.90.31.15:4705 , piece_id=YNII3RGVISQN5FBTHCGJRANX7S3JBJIWQ7DRYCFJQWYL7KHDLL4Q, seg_pos={0 0}, upload=498957]: Uploading piece... Sep 22 05:04:32.870447775 (566h56m8.223232904s) [noise=true , address=145.79.227.6:4291 , piece_id=C2WV6SUTWERDVJFLR5C7MARPLUFZDOD4QIEP5BYZZ5QGMMRWD36A, seg_pos={0 0}, upload=498957]: Uploading piece... Sep 22 05:04:32.870728131 (566h56m8.22351327s) [noise=true , address=145.79.227.2:4142 , piece_id=3VMCECSE6AHD5CQ3XNMLB5OWGCQ2Y5TOU2KT3U3ZYBNU32UXAXEA, seg_pos={0 0}, upload=498957]: Uploading piece... Sep 22 05:04:32.871095151 (566h56m8.223880279s) [noise=true , address=145.79.227.23:4554 , piece_id=I24ISPJY5NVYO5NZEECJTGKYRXIZBA3PSG2XCNAYCAJUOCV7AY6A, seg_pos={0 0}, upload=498957]: Uploading piece... Sep 22 05:04:32.871460155 (566h56m8.224245284s) [noise=true , address=145.79.227.14:4849 , piece_id=EJM6IRSKW7ODLA7CN7RFVNJKAG7RMOBKRPGLMT4XQTDPYELVPYEQ, seg_pos={0 0}, upload=498957]: Uploading piece... Sep 22 05:04:32.871858163 (566h56m8.2246433s) [noise=true , address=145.79.227.16:4923 , piece_id=VZFQUIA44MHDJ2DBGCXX3M3RDPEXTVQH7NDBOCQQMNP3JACRRXHQ, seg_pos={0 0}, upload=498957]: Uploading piece... Sep 22 05:04:32.872170248 (566h56m8.224955386s) [noise=true , address=145.79.227.28:4757 , piece_id=7L64UR364ZCJYG4FXSJ4C7MKHR33VWAHGSSJZ26LGAGLPWY6FPRA, seg_pos={0 0}, upload=498957]: Uploading piece... Sep 22 05:04:32.872560089 (566h56m8.225345217s) [noise=true , address=145.79.227.4:4194 , piece_id=54FCM3DO55SH7GFEWH7QXL2TW5FMPPHCJCBQYEVZPEE7ZDYGU4LA, seg_pos={0 0}, upload=498957]: Uploading piece... Sep 22 05:04:32.872950993 (566h56m8.225736122s) [noise=true , address=145.79.227.18:4034 , piece_id=MY2SIGVQE4FFETRO37ULKLIXNGEL4IJSNQIYVKN3T6JCXAZ2PWFQ, seg_pos={0 0}, upload=498957]: Uploading piece... Sep 22 05:04:32.873309075 (566h56m8.226094203s) [noise=true , address=145.79.227.24:4612 , piece_id=NE5QKM62C2VO4P77XXIX2GQ46WSMJE3JRSUMTCAIKDJCFCPDVXNQ, seg_pos={0 0}, upload=498957]: Uploading piece... Sep 22 05:04:32.873498290 (566h56m8.226283418s) [noise=true , address=145.79.227.26:4656 , piece_id=5K3BFPPGLXVZZ3KF2R64TZD6GLFEOLE32ALH3JLSHQRHL6GJ4YTQ, seg_pos={0 0}, upload=498957]: Uploading piece... Sep 22 05:04:32.964399004 (566h56m8.317184132s) [upload=498957]: Next returned nil segment Sep 22 05:04:32.964414894 (566h56m8.317200022s) [upload=498957]: Waiting for error group managing segments... Sep 22 05:04:32.973347836 (566h56m8.326132965s) [noise=true , address=145.79.227.26:4656 , piece_id=5K3BFPPGLXVZZ3KF2R64TZD6GLFEOLE32ALH3JLSHQRHL6GJ4YTQ, seg_pos={0 0}, upload=498957]: Done uploading piece. err: <nil> Sep 22 05:04:32.974027452 (566h56m8.32681258s) [noise=true , address=145.79.227.30:4775 , piece_id=6Y5W2DO3TNAYW4UYCM7W5D56F57JLE5WSTQQT4WPMPAJE7ZQKIUA, seg_pos={0 0}, upload=498957]: Done uploading piece. err: <nil> Sep 22 05:04:32.974372609 (566h56m8.327157747s) [noise=true , address=145.79.227.28:4757 , piece_id=7L64UR364ZCJYG4FXSJ4C7MKHR33VWAHGSSJZ26LGAGLPWY6FPRA, seg_pos={0 0}, upload=498957]: Done uploading piece. err: <nil> Sep 22 05:04:32.974976603 (566h56m8.327761731s) [noise=true , address=145.79.227.24:4612 , piece_id=NE5QKM62C2VO4P77XXIX2GQ46WSMJE3JRSUMTCAIKDJCFCPDVXNQ, seg_pos={0 0}, upload=498957]: Done uploading piece. err: <nil> Sep 22 05:04:32.975003984 (566h56m8.327789123s) [noise=true , address=145.79.227.38:4980 , piece_id=TT7VT2MZW2TMOYSU325BB2MFQH7BIQQ75GT6M56JWSZBPGBVAJAA, seg_pos={0 0}, upload=498957]: Done uploading piece. err: <nil> Sep 22 05:04:32.975556542 (566h56m8.32834167s) [noise=true , address=77.90.31.15:4705 , piece_id=YNII3RGVISQN5FBTHCGJRANX7S3JBJIWQ7DRYCFJQWYL7KHDLL4Q, seg_pos={0 0}, upload=498957]: Done uploading piece. err: <nil> Sep 22 05:04:32.975661399 (566h56m8.328446526s) [noise=true , address=145.79.227.41:4088 , piece_id=YQ33LISFICOHVI37GJOWRYEGKE3YIXOBNEARYHUFWJFVT377OV4A, seg_pos={0 0}, upload=498957]: Done uploading piece. err: <nil> Sep 22 05:04:32.976217391 (566h56m8.329002519s) [noise=true , address=145.79.227.39:4013 , piece_id=OISIFQIDVNAG6G77B2EOUYM7WC2NENG3DGS64K5WEPUN5EQISC2Q, seg_pos={0 0}, upload=498957]: Done uploading piece. err: <nil> Sep 22 05:04:32.976274820 (566h56m8.329059948s) [noise=true , address=145.79.227.23:4554 , piece_id=I24ISPJY5NVYO5NZEECJTGKYRXIZBA3PSG2XCNAYCAJUOCV7AY6A, seg_pos={0 0}, upload=498957]: Done uploading piece. err: <nil> Sep 22 05:04:34.588452708 (566h56m9.941237805s) [noise=true , address=145.79.227.4:4194 , piece_id=54FCM3DO55SH7GFEWH7QXL2TW5FMPPHCJCBQYEVZPEE7ZDYGU4LA, seg_pos={0 0}, upload=498957]: Done uploading piece. err: ecclient: upload failed (node:1u6tGwzk56SwgUqzpyRFLNTTysUtk6C2Ls77UkjFryeuF9D8pV, address:145.79.227.4:4194): protocol: rpc: dial tcp 145.79.227.4:4194: connect: no route to host; manager closed: conn closed: op Sep 22 05:05:32.833224105 (566h57m8.186009232s) [noise=true , address=145.79.227.12:4794 , piece_id=TX3XR7UNCENTL3C4A5O2ACH2ST6BSQEAD2R7Y4W5EXIHZQF6IBXA, seg_pos={0 0}, upload=498957]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:32.833501003 (566h57m8.186286132s) [noise=true , address=145.79.227.2:4142 , piece_id=3VMCECSE6AHD5CQ3XNMLB5OWGCQ2Y5TOU2KT3U3ZYBNU32UXAXEA, seg_pos={0 0}, upload=498957]: Done uploading piece. err: ecclient: upload failed (node:12JR1vFqWgTH1qwvxH4DEk4eKT7TfxWC2Re6QEWmqxWXctytfa7, address:145.79.227.2:4142): protocol: rpc: dial tcp 145.79.227.2:4142: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:32.833572338 (566h57m8.186357467s) [noise=true , address=145.79.227.13:4809 , piece_id=NYNY3JSUNABLAIUIMVGJ5BFBIQAX23XQUXWV6I7G2KLSLDQSF3ZQ, seg_pos={0 0}, upload=498957]: Done uploading piece. err: ecclient: upload failed (node:17LrYeCkrPWdiL9gGZ568PvfFct6cLVRQE4Qa92ykLgqXSfBL9, address:145.79.227.13:4809): protocol: rpc: dial tcp 145.79.227.13:4809: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:32.833623324 (566h57m8.186408452s) [noise=true , address=145.79.227.18:4034 , piece_id=MY2SIGVQE4FFETRO37ULKLIXNGEL4IJSNQIYVKN3T6JCXAZ2PWFQ, seg_pos={0 0}, upload=498957]: Done uploading piece. err: ecclient: upload failed (node:12jHHvRhcKfV1ufn7PRfnPHJ3ZxWJ8JUutf772G7YcKQjbpE3ZY, address:145.79.227.18:4034): protocol: rpc: dial tcp 145.79.227.18:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:32.833716739 (566h57m8.186501867s) [noise=true , address=145.79.227.17:4977 , piece_id=QW6HIOFGC47BVNYUMZTNWUN7GCQSWZKRCMKG6BNM3GLVLQ66UCWA, seg_pos={0 0}, upload=498957]: Done uploading piece. err: ecclient: upload failed (node:12WCAm12tXwimFSPqz7Seh6A4oxWqQVxqsF459xux4a5CqjpbAT, address:145.79.227.17:4977): protocol: rpc: dial tcp 145.79.227.17:4977: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:32.833859096 (566h57m8.186644224s) [noise=true , address=145.79.227.6:4291 , piece_id=C2WV6SUTWERDVJFLR5C7MARPLUFZDOD4QIEP5BYZZ5QGMMRWD36A, seg_pos={0 0}, upload=498957]: Done uploading piece. err: ecclient: upload failed (node:125JwnPDmKBNm3TybPWrzRbpzo5pnLei38joZeetvDG3wU32ZNb, address:145.79.227.6:4291): protocol: rpc: dial tcp 145.79.227.6:4291: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:32.833980744 (566h57m8.186765873s) [noise=true , address=145.79.227.14:4849 , piece_id=EJM6IRSKW7ODLA7CN7RFVNJKAG7RMOBKRPGLMT4XQTDPYELVPYEQ, seg_pos={0 0}, upload=498957]: Done uploading piece. err: ecclient: upload failed (node:1n2gSzVmNCEZcfVsFKibjXHs2jMr82D3SWQEykFQQ4uyhhnrj1, address:145.79.227.14:4849): protocol: rpc: dial tcp 145.79.227.14:4849: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:32.833988539 (566h57m8.186773667s) [noise=true , address=145.79.227.16:4923 , piece_id=VZFQUIA44MHDJ2DBGCXX3M3RDPEXTVQH7NDBOCQQMNP3JACRRXHQ, seg_pos={0 0}, upload=498957]: Done uploading piece. err: ecclient: upload failed (node:12Ee9ZfH81oy4SAUxozjQNWJ7ALmWDXQZYPLFwuAiJ8V6E7jT6r, address:145.79.227.16:4923): protocol: rpc: dial tcp 145.79.227.16:4923: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 22 05:05:32.834038853 (566h57m8.186823982s) [seg_pos={0 0}, upload=498957]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil> Sep 22 05:05:32.847776423 (566h57m8.200561541s) [upload=498957]: Done uploading segments... Sep 22 05:05:32.847795129 (566h57m8.200580256s) [upload=498957]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9) Duration: 391.146662ms core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)