Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.X...........................................X..............] duration: 111.241158ms FAIL (2025-08-22 05:29:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 05:20:50.097930630 (323h54m30.82919828s) [upload=336808]: Starting upload Aug 22 05:20:50.097998158 (323h54m30.829265817s) [upload=336808]: Done starting upload Aug 22 05:20:50.098070042 (323h54m30.829337702s) [upload=336808]: Uploading segments... Aug 22 05:20:50.098107372 (323h54m30.829375022s) [upload=336808]: Got next segment. Inline: true Aug 22 05:20:50.098112542 (323h54m30.829380192s) [upload=336808]: Waiting for error group managing segments... Aug 22 05:20:50.098165492 (323h54m30.829433153s) [upload=336808]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 05:20:50.098174479 (323h54m30.829442129s) [upload=336808]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 05:20:50.098181131 (323h54m30.829448792s) [upload=336808]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 05:20:50.101149681 (323h54m30.832417331s) [upload=336808]: Done uploading segments... Aug 22 05:20:50.101161142 (323h54m30.832428793s) [upload=336808]: Upload finished. err: metaclient: Too Many Requests Duration:* 111.259223ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 1.723808656s FAIL (2025-08-22 05:29:13 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 22 04:56:52.108760398 (323h30m32.840028048s) [upload=336380]: Starting upload Aug 22 04:56:52.108905031 (323h30m32.840172682s) [upload=336380]: Done starting upload Aug 22 04:56:52.109003286 (323h30m32.840270946s) [upload=336380]: Uploading segments... Aug 22 04:56:52.109571796 (323h30m32.840839446s) [upload=336380]: Got next segment. Inline: false Aug 22 04:56:52.109630757 (323h30m32.840898408s) [upload=336380]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 04:56:52.109637339 (323h30m32.84090499s) [upload=336380]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 04:56:52.138484827 (323h30m32.869752477s) [seg_pos={0 0}, upload=336380]: Begin upload segment... Aug 22 04:56:52.138560400 (323h30m32.86982805s) [seg_pos={0 0}, upload=336380]: Done begin upload segment. Aug 22 04:56:52.138612417 (323h30m32.869880068s) [noise=true , address=45.91.116.10:4105 , piece_id=IUETLBNXRVIX5KZU22YM4N4COHYEWA6ANYOZ6OZANRBOX22HXQOA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.139205243 (323h30m32.870472944s) [noise=true , address=104.36.82.6:4892 , piece_id=JYTYGOJJRP3YAIDXDT5G5B5EO5AK24OT6F3TZV7P2TP36EUAY4XQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.139966056 (323h30m32.871233706s) [noise=true , address=104.36.82.50:4044 , piece_id=L3NJHGWUTLWDW26HUHIEQT2HW3A6GKSIZXYHDXK552QVTIFK3DIA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.140478040 (323h30m32.871745691s) [noise=true , address=77.90.31.12:4620 , piece_id=UIFT7PMLVENB3QC3JK63343C2SSTVYJ2ME5HAUZ7UDVAHI5DO52Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.140979465 (323h30m32.872247115s) [noise=true , address=45.91.116.11:4139 , piece_id=XXK64FDZN5ROM2JTYXXCF6DQBFMW4VRZIZT5PK6NGF7YLTOQ3PUA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.141547404 (323h30m32.872815054s) [noise=true , address=104.36.82.5:4851 , piece_id=XHDD77H42NATELJQIKPM2EMBI3WXXXHHEWDXQQJKS64KZJHTLW3A, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.142076150 (323h30m32.8733438s) [noise=true , address=77.90.31.18:4828 , piece_id=HLL25GXOKAZ7HVXV4NNTV6THA6YVXZGHSNMZPKM4XKMAWM52A2SQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.142639109 (323h30m32.87390676s) [noise=true , address=77.90.31.21:4906 , piece_id=UZY5ZFCBR7NPW4IN5WJPTGKSTVTMQ5IVSWKKVVXT6SN3R2U3FAPQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.143077495 (323h30m32.874345145s) [noise=true , address=104.36.82.9:4022 , piece_id=734PI3KYMOUSZNKRU4BWIEUECEKBZAOHXGL6FSTPCCKP6G6GSNWA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.143669991 (323h30m32.874937641s) [noise=true , address=77.90.31.10:4530 , piece_id=YNZ2IAHYCMLU7V4DFQGGRBC2HAJ36Z4FDTLAX7B72VBMBMPIINOQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.145875203 (323h30m32.877142883s) [noise=true , address=104.36.82.14:4243 , piece_id=PBAM3UFTBAJSBOFESCTKSDF4JR36GQB57NG7LL3Z7NGDJ4WDWG7Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.146491584 (323h30m32.877759234s) [noise=true , address=45.91.116.4:4964 , piece_id=CBGK4RIP6G75M4V7RCU3Z2QSRTHGX6HQXQVUXXJQUE3NGPT5IM6A, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.146979211 (323h30m32.878246862s) [noise=true , address=104.36.82.17:4363 , piece_id=CZF7DHCTNXJTL5PDSINBOSBQJAM7433ZAQIKHKNQVZGQPS7242AQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.147736838 (323h30m32.879004488s) [noise=true , address=104.36.82.60:4358 , piece_id=H32BEFSBI42XLRQF7YGVQKQGP63Y7XRECLOZPYLSOX2GBTR4355Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.148627205 (323h30m32.879894855s) [noise=true , address=104.36.82.14:4228 , piece_id=ECOK2QCLNBRD7725CU4BFFAO4FUJLIR3CTMY3WZFVHUU77X5G55Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.149206806 (323h30m32.880474466s) [noise=true , address=104.36.82.23:4474 , piece_id=IVROJIBKT3527BBWNO5ZYLGNMZRVFB4AMJK7G7KXWOARKGVGXC7Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.150129022 (323h30m32.881396673s) [noise=true , address=79.127.220.98:4415 , piece_id=ZHNY7FSQI2A2WAQ27ZAAUKDJYVHOXN3WY52LWZDYBY46E6WS7CAA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.151289868 (323h30m32.882557528s) [noise=true , address=104.36.82.11:4145 , piece_id=CUXENUONDG4VTNWJ2W2DV7IIP77YWFJAD5X25TCS2R777YLZOEXA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.300240501 (323h30m33.031508152s) [upload=336380]: Next returned nil segment Aug 22 04:56:52.300257313 (323h30m33.031524963s) [upload=336380]: Waiting for error group managing segments... Aug 22 04:56:52.311754692 (323h30m33.043022322s) [noise=true , address=45.91.116.4:4964 , piece_id=CBGK4RIP6G75M4V7RCU3Z2QSRTHGX6HQXQVUXXJQUE3NGPT5IM6A, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.312362526 (323h30m33.043630186s) [noise=true , address=77.90.31.18:4828 , piece_id=HLL25GXOKAZ7HVXV4NNTV6THA6YVXZGHSNMZPKM4XKMAWM52A2SQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.312505164 (323h30m33.043772785s) [noise=true , address=45.91.116.10:4105 , piece_id=IUETLBNXRVIX5KZU22YM4N4COHYEWA6ANYOZ6OZANRBOX22HXQOA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.313453540 (323h30m33.044721191s) [noise=true , address=45.91.116.11:4139 , piece_id=XXK64FDZN5ROM2JTYXXCF6DQBFMW4VRZIZT5PK6NGF7YLTOQ3PUA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.314229331 (323h30m33.045496961s) [noise=true , address=104.36.82.14:4243 , piece_id=PBAM3UFTBAJSBOFESCTKSDF4JR36GQB57NG7LL3Z7NGDJ4WDWG7Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.314832257 (323h30m33.046099887s) [noise=true , address=77.90.31.12:4620 , piece_id=UIFT7PMLVENB3QC3JK63343C2SSTVYJ2ME5HAUZ7UDVAHI5DO52Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.315510244 (323h30m33.046777864s) [noise=true , address=104.36.82.5:4851 , piece_id=XHDD77H42NATELJQIKPM2EMBI3WXXXHHEWDXQQJKS64KZJHTLW3A, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.316562384 (323h30m33.047830014s) [noise=true , address=104.36.82.50:4044 , piece_id=L3NJHGWUTLWDW26HUHIEQT2HW3A6GKSIZXYHDXK552QVTIFK3DIA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.316973228 (323h30m33.048240868s) [noise=true , address=104.36.82.17:4363 , piece_id=CZF7DHCTNXJTL5PDSINBOSBQJAM7433ZAQIKHKNQVZGQPS7242AQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.317706238 (323h30m33.048973888s) [noise=true , address=104.36.82.6:4892 , piece_id=JYTYGOJJRP3YAIDXDT5G5B5EO5AK24OT6F3TZV7P2TP36EUAY4XQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.318129285 (323h30m33.049396915s) [noise=true , address=104.36.82.11:4145 , piece_id=CUXENUONDG4VTNWJ2W2DV7IIP77YWFJAD5X25TCS2R777YLZOEXA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.320591320 (323h30m33.05185896s) [noise=true , address=77.90.31.10:4530 , piece_id=YNZ2IAHYCMLU7V4DFQGGRBC2HAJ36Z4FDTLAX7B72VBMBMPIINOQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.331756253 (323h30m33.063023883s) [noise=true , address=77.90.31.21:4906 , piece_id=UZY5ZFCBR7NPW4IN5WJPTGKSTVTMQ5IVSWKKVVXT6SN3R2U3FAPQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.332730648 (323h30m33.063998299s) [noise=true , address=104.36.82.9:4022 , piece_id=734PI3KYMOUSZNKRU4BWIEUECEKBZAOHXGL6FSTPCCKP6G6GSNWA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.332762158 (323h30m33.064029817s) [seg_pos={0 0}, upload=336380]: Segment reached optimal threshold of 14 pieces. Aug 22 04:56:52.332957295 (323h30m33.064224944s) [noise=true , address=104.36.82.60:4358 , piece_id=H32BEFSBI42XLRQF7YGVQKQGP63Y7XRECLOZPYLSOX2GBTR4355Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dwCNEcA9o51ZN3UaN3Frxdawwf8DXBj86iQMywjW8XP4ESmw1): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.332992812 (323h30m33.064260442s) [noise=true , address=104.36.82.23:4474 , piece_id=IVROJIBKT3527BBWNO5ZYLGNMZRVFB4AMJK7G7KXWOARKGVGXC7Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333074575 (323h30m33.064342235s) [noise=true , address=79.127.220.98:4415 , piece_id=ZHNY7FSQI2A2WAQ27ZAAUKDJYVHOXN3WY52LWZDYBY46E6WS7CAA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zEwYBHLdtVuQhypaivAt5k2AwMGEDvj4XsCBYHtoau2YXtH8e): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333209800 (323h30m33.06447743s) [noise=true , address=104.36.82.14:4228 , piece_id=ECOK2QCLNBRD7725CU4BFFAO4FUJLIR3CTMY3WZFVHUU77X5G55Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pkADNFaYa2SqFALQdxwf1CfR1ktUwshQkw7iBJzhdhaRYaszF): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333246088 (323h30m33.064513708s) [seg_pos={0 0}, upload=336380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 04:56:52.333351667 (323h30m33.064619298s) [upload=336380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 04:56:52.333357668 (323h30m33.064625298s) [upload=336380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 04:56:52.493730278 (323h30m33.224997929s) [upload=336380]: Done uploading segments... Aug 22 04:56:52.493749815 (323h30m33.225017465s) [upload=336380]: Upload finished. err: <nil> Duration: 1.723876674s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..X...........................................X.............] duration: 413.397076ms FAIL (2025-08-22 05:28:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 05:20:50.097930630 (323h54m30.82919828s) [upload=336808]: Starting upload Aug 22 05:20:50.097998158 (323h54m30.829265817s) [upload=336808]: Done starting upload Aug 22 05:20:50.098070042 (323h54m30.829337702s) [upload=336808]: Uploading segments... Aug 22 05:20:50.098107372 (323h54m30.829375022s) [upload=336808]: Got next segment. Inline: true Aug 22 05:20:50.098112542 (323h54m30.829380192s) [upload=336808]: Waiting for error group managing segments... Aug 22 05:20:50.098165492 (323h54m30.829433153s) [upload=336808]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 05:20:50.098174479 (323h54m30.829442129s) [upload=336808]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 05:20:50.098181131 (323h54m30.829448792s) [upload=336808]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 05:20:50.101149681 (323h54m30.832417331s) [upload=336808]: Done uploading segments... Aug 22 05:20:50.101161142 (323h54m30.832428793s) [upload=336808]: Upload finished. err: metaclient: Too Many Requests Duration:* 413.422084ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...X...........................................X............] duration: 150.569001ms FAIL (2025-08-22 05:28:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 05:20:50.097930630 (323h54m30.82919828s) [upload=336808]: Starting upload Aug 22 05:20:50.097998158 (323h54m30.829265817s) [upload=336808]: Done starting upload Aug 22 05:20:50.098070042 (323h54m30.829337702s) [upload=336808]: Uploading segments... Aug 22 05:20:50.098107372 (323h54m30.829375022s) [upload=336808]: Got next segment. Inline: true Aug 22 05:20:50.098112542 (323h54m30.829380192s) [upload=336808]: Waiting for error group managing segments... Aug 22 05:20:50.098165492 (323h54m30.829433153s) [upload=336808]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 05:20:50.098174479 (323h54m30.829442129s) [upload=336808]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 05:20:50.098181131 (323h54m30.829448792s) [upload=336808]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 05:20:50.101149681 (323h54m30.832417331s) [upload=336808]: Done uploading segments... Aug 22 05:20:50.101161142 (323h54m30.832428793s) [upload=336808]: Upload finished. err: metaclient: Too Many Requests Duration:* 150.595601ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 1.56334801s FAIL (2025-08-22 05:28:07 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 22 04:56:52.108760398 (323h30m32.840028048s) [upload=336380]: Starting upload Aug 22 04:56:52.108905031 (323h30m32.840172682s) [upload=336380]: Done starting upload Aug 22 04:56:52.109003286 (323h30m32.840270946s) [upload=336380]: Uploading segments... Aug 22 04:56:52.109571796 (323h30m32.840839446s) [upload=336380]: Got next segment. Inline: false Aug 22 04:56:52.109630757 (323h30m32.840898408s) [upload=336380]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 04:56:52.109637339 (323h30m32.84090499s) [upload=336380]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 04:56:52.138484827 (323h30m32.869752477s) [seg_pos={0 0}, upload=336380]: Begin upload segment... Aug 22 04:56:52.138560400 (323h30m32.86982805s) [seg_pos={0 0}, upload=336380]: Done begin upload segment. Aug 22 04:56:52.138612417 (323h30m32.869880068s) [noise=true , address=45.91.116.10:4105 , piece_id=IUETLBNXRVIX5KZU22YM4N4COHYEWA6ANYOZ6OZANRBOX22HXQOA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.139205243 (323h30m32.870472944s) [noise=true , address=104.36.82.6:4892 , piece_id=JYTYGOJJRP3YAIDXDT5G5B5EO5AK24OT6F3TZV7P2TP36EUAY4XQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.139966056 (323h30m32.871233706s) [noise=true , address=104.36.82.50:4044 , piece_id=L3NJHGWUTLWDW26HUHIEQT2HW3A6GKSIZXYHDXK552QVTIFK3DIA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.140478040 (323h30m32.871745691s) [noise=true , address=77.90.31.12:4620 , piece_id=UIFT7PMLVENB3QC3JK63343C2SSTVYJ2ME5HAUZ7UDVAHI5DO52Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.140979465 (323h30m32.872247115s) [noise=true , address=45.91.116.11:4139 , piece_id=XXK64FDZN5ROM2JTYXXCF6DQBFMW4VRZIZT5PK6NGF7YLTOQ3PUA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.141547404 (323h30m32.872815054s) [noise=true , address=104.36.82.5:4851 , piece_id=XHDD77H42NATELJQIKPM2EMBI3WXXXHHEWDXQQJKS64KZJHTLW3A, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.142076150 (323h30m32.8733438s) [noise=true , address=77.90.31.18:4828 , piece_id=HLL25GXOKAZ7HVXV4NNTV6THA6YVXZGHSNMZPKM4XKMAWM52A2SQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.142639109 (323h30m32.87390676s) [noise=true , address=77.90.31.21:4906 , piece_id=UZY5ZFCBR7NPW4IN5WJPTGKSTVTMQ5IVSWKKVVXT6SN3R2U3FAPQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.143077495 (323h30m32.874345145s) [noise=true , address=104.36.82.9:4022 , piece_id=734PI3KYMOUSZNKRU4BWIEUECEKBZAOHXGL6FSTPCCKP6G6GSNWA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.143669991 (323h30m32.874937641s) [noise=true , address=77.90.31.10:4530 , piece_id=YNZ2IAHYCMLU7V4DFQGGRBC2HAJ36Z4FDTLAX7B72VBMBMPIINOQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.145875203 (323h30m32.877142883s) [noise=true , address=104.36.82.14:4243 , piece_id=PBAM3UFTBAJSBOFESCTKSDF4JR36GQB57NG7LL3Z7NGDJ4WDWG7Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.146491584 (323h30m32.877759234s) [noise=true , address=45.91.116.4:4964 , piece_id=CBGK4RIP6G75M4V7RCU3Z2QSRTHGX6HQXQVUXXJQUE3NGPT5IM6A, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.146979211 (323h30m32.878246862s) [noise=true , address=104.36.82.17:4363 , piece_id=CZF7DHCTNXJTL5PDSINBOSBQJAM7433ZAQIKHKNQVZGQPS7242AQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.147736838 (323h30m32.879004488s) [noise=true , address=104.36.82.60:4358 , piece_id=H32BEFSBI42XLRQF7YGVQKQGP63Y7XRECLOZPYLSOX2GBTR4355Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.148627205 (323h30m32.879894855s) [noise=true , address=104.36.82.14:4228 , piece_id=ECOK2QCLNBRD7725CU4BFFAO4FUJLIR3CTMY3WZFVHUU77X5G55Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.149206806 (323h30m32.880474466s) [noise=true , address=104.36.82.23:4474 , piece_id=IVROJIBKT3527BBWNO5ZYLGNMZRVFB4AMJK7G7KXWOARKGVGXC7Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.150129022 (323h30m32.881396673s) [noise=true , address=79.127.220.98:4415 , piece_id=ZHNY7FSQI2A2WAQ27ZAAUKDJYVHOXN3WY52LWZDYBY46E6WS7CAA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.151289868 (323h30m32.882557528s) [noise=true , address=104.36.82.11:4145 , piece_id=CUXENUONDG4VTNWJ2W2DV7IIP77YWFJAD5X25TCS2R777YLZOEXA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.300240501 (323h30m33.031508152s) [upload=336380]: Next returned nil segment Aug 22 04:56:52.300257313 (323h30m33.031524963s) [upload=336380]: Waiting for error group managing segments... Aug 22 04:56:52.311754692 (323h30m33.043022322s) [noise=true , address=45.91.116.4:4964 , piece_id=CBGK4RIP6G75M4V7RCU3Z2QSRTHGX6HQXQVUXXJQUE3NGPT5IM6A, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.312362526 (323h30m33.043630186s) [noise=true , address=77.90.31.18:4828 , piece_id=HLL25GXOKAZ7HVXV4NNTV6THA6YVXZGHSNMZPKM4XKMAWM52A2SQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.312505164 (323h30m33.043772785s) [noise=true , address=45.91.116.10:4105 , piece_id=IUETLBNXRVIX5KZU22YM4N4COHYEWA6ANYOZ6OZANRBOX22HXQOA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.313453540 (323h30m33.044721191s) [noise=true , address=45.91.116.11:4139 , piece_id=XXK64FDZN5ROM2JTYXXCF6DQBFMW4VRZIZT5PK6NGF7YLTOQ3PUA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.314229331 (323h30m33.045496961s) [noise=true , address=104.36.82.14:4243 , piece_id=PBAM3UFTBAJSBOFESCTKSDF4JR36GQB57NG7LL3Z7NGDJ4WDWG7Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.314832257 (323h30m33.046099887s) [noise=true , address=77.90.31.12:4620 , piece_id=UIFT7PMLVENB3QC3JK63343C2SSTVYJ2ME5HAUZ7UDVAHI5DO52Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.315510244 (323h30m33.046777864s) [noise=true , address=104.36.82.5:4851 , piece_id=XHDD77H42NATELJQIKPM2EMBI3WXXXHHEWDXQQJKS64KZJHTLW3A, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.316562384 (323h30m33.047830014s) [noise=true , address=104.36.82.50:4044 , piece_id=L3NJHGWUTLWDW26HUHIEQT2HW3A6GKSIZXYHDXK552QVTIFK3DIA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.316973228 (323h30m33.048240868s) [noise=true , address=104.36.82.17:4363 , piece_id=CZF7DHCTNXJTL5PDSINBOSBQJAM7433ZAQIKHKNQVZGQPS7242AQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.317706238 (323h30m33.048973888s) [noise=true , address=104.36.82.6:4892 , piece_id=JYTYGOJJRP3YAIDXDT5G5B5EO5AK24OT6F3TZV7P2TP36EUAY4XQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.318129285 (323h30m33.049396915s) [noise=true , address=104.36.82.11:4145 , piece_id=CUXENUONDG4VTNWJ2W2DV7IIP77YWFJAD5X25TCS2R777YLZOEXA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.320591320 (323h30m33.05185896s) [noise=true , address=77.90.31.10:4530 , piece_id=YNZ2IAHYCMLU7V4DFQGGRBC2HAJ36Z4FDTLAX7B72VBMBMPIINOQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.331756253 (323h30m33.063023883s) [noise=true , address=77.90.31.21:4906 , piece_id=UZY5ZFCBR7NPW4IN5WJPTGKSTVTMQ5IVSWKKVVXT6SN3R2U3FAPQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.332730648 (323h30m33.063998299s) [noise=true , address=104.36.82.9:4022 , piece_id=734PI3KYMOUSZNKRU4BWIEUECEKBZAOHXGL6FSTPCCKP6G6GSNWA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.332762158 (323h30m33.064029817s) [seg_pos={0 0}, upload=336380]: Segment reached optimal threshold of 14 pieces. Aug 22 04:56:52.332957295 (323h30m33.064224944s) [noise=true , address=104.36.82.60:4358 , piece_id=H32BEFSBI42XLRQF7YGVQKQGP63Y7XRECLOZPYLSOX2GBTR4355Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dwCNEcA9o51ZN3UaN3Frxdawwf8DXBj86iQMywjW8XP4ESmw1): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.332992812 (323h30m33.064260442s) [noise=true , address=104.36.82.23:4474 , piece_id=IVROJIBKT3527BBWNO5ZYLGNMZRVFB4AMJK7G7KXWOARKGVGXC7Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333074575 (323h30m33.064342235s) [noise=true , address=79.127.220.98:4415 , piece_id=ZHNY7FSQI2A2WAQ27ZAAUKDJYVHOXN3WY52LWZDYBY46E6WS7CAA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zEwYBHLdtVuQhypaivAt5k2AwMGEDvj4XsCBYHtoau2YXtH8e): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333209800 (323h30m33.06447743s) [noise=true , address=104.36.82.14:4228 , piece_id=ECOK2QCLNBRD7725CU4BFFAO4FUJLIR3CTMY3WZFVHUU77X5G55Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pkADNFaYa2SqFALQdxwf1CfR1ktUwshQkw7iBJzhdhaRYaszF): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333246088 (323h30m33.064513708s) [seg_pos={0 0}, upload=336380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 04:56:52.333351667 (323h30m33.064619298s) [upload=336380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 04:56:52.333357668 (323h30m33.064625298s) [upload=336380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 04:56:52.493730278 (323h30m33.224997929s) [upload=336380]: Done uploading segments... Aug 22 04:56:52.493749815 (323h30m33.225017465s) [upload=336380]: Upload finished. err: <nil> Duration: 1.563364181s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 441.696694ms FAIL (2025-08-22 05:28:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 441.71043ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 1.289573332s FAIL (2025-08-22 05:27:44 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 22 04:56:52.108760398 (323h30m32.840028048s) [upload=336380]: Starting upload Aug 22 04:56:52.108905031 (323h30m32.840172682s) [upload=336380]: Done starting upload Aug 22 04:56:52.109003286 (323h30m32.840270946s) [upload=336380]: Uploading segments... Aug 22 04:56:52.109571796 (323h30m32.840839446s) [upload=336380]: Got next segment. Inline: false Aug 22 04:56:52.109630757 (323h30m32.840898408s) [upload=336380]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 04:56:52.109637339 (323h30m32.84090499s) [upload=336380]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 04:56:52.138484827 (323h30m32.869752477s) [seg_pos={0 0}, upload=336380]: Begin upload segment... Aug 22 04:56:52.138560400 (323h30m32.86982805s) [seg_pos={0 0}, upload=336380]: Done begin upload segment. Aug 22 04:56:52.138612417 (323h30m32.869880068s) [noise=true , address=45.91.116.10:4105 , piece_id=IUETLBNXRVIX5KZU22YM4N4COHYEWA6ANYOZ6OZANRBOX22HXQOA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.139205243 (323h30m32.870472944s) [noise=true , address=104.36.82.6:4892 , piece_id=JYTYGOJJRP3YAIDXDT5G5B5EO5AK24OT6F3TZV7P2TP36EUAY4XQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.139966056 (323h30m32.871233706s) [noise=true , address=104.36.82.50:4044 , piece_id=L3NJHGWUTLWDW26HUHIEQT2HW3A6GKSIZXYHDXK552QVTIFK3DIA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.140478040 (323h30m32.871745691s) [noise=true , address=77.90.31.12:4620 , piece_id=UIFT7PMLVENB3QC3JK63343C2SSTVYJ2ME5HAUZ7UDVAHI5DO52Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.140979465 (323h30m32.872247115s) [noise=true , address=45.91.116.11:4139 , piece_id=XXK64FDZN5ROM2JTYXXCF6DQBFMW4VRZIZT5PK6NGF7YLTOQ3PUA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.141547404 (323h30m32.872815054s) [noise=true , address=104.36.82.5:4851 , piece_id=XHDD77H42NATELJQIKPM2EMBI3WXXXHHEWDXQQJKS64KZJHTLW3A, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.142076150 (323h30m32.8733438s) [noise=true , address=77.90.31.18:4828 , piece_id=HLL25GXOKAZ7HVXV4NNTV6THA6YVXZGHSNMZPKM4XKMAWM52A2SQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.142639109 (323h30m32.87390676s) [noise=true , address=77.90.31.21:4906 , piece_id=UZY5ZFCBR7NPW4IN5WJPTGKSTVTMQ5IVSWKKVVXT6SN3R2U3FAPQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.143077495 (323h30m32.874345145s) [noise=true , address=104.36.82.9:4022 , piece_id=734PI3KYMOUSZNKRU4BWIEUECEKBZAOHXGL6FSTPCCKP6G6GSNWA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.143669991 (323h30m32.874937641s) [noise=true , address=77.90.31.10:4530 , piece_id=YNZ2IAHYCMLU7V4DFQGGRBC2HAJ36Z4FDTLAX7B72VBMBMPIINOQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.145875203 (323h30m32.877142883s) [noise=true , address=104.36.82.14:4243 , piece_id=PBAM3UFTBAJSBOFESCTKSDF4JR36GQB57NG7LL3Z7NGDJ4WDWG7Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.146491584 (323h30m32.877759234s) [noise=true , address=45.91.116.4:4964 , piece_id=CBGK4RIP6G75M4V7RCU3Z2QSRTHGX6HQXQVUXXJQUE3NGPT5IM6A, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.146979211 (323h30m32.878246862s) [noise=true , address=104.36.82.17:4363 , piece_id=CZF7DHCTNXJTL5PDSINBOSBQJAM7433ZAQIKHKNQVZGQPS7242AQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.147736838 (323h30m32.879004488s) [noise=true , address=104.36.82.60:4358 , piece_id=H32BEFSBI42XLRQF7YGVQKQGP63Y7XRECLOZPYLSOX2GBTR4355Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.148627205 (323h30m32.879894855s) [noise=true , address=104.36.82.14:4228 , piece_id=ECOK2QCLNBRD7725CU4BFFAO4FUJLIR3CTMY3WZFVHUU77X5G55Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.149206806 (323h30m32.880474466s) [noise=true , address=104.36.82.23:4474 , piece_id=IVROJIBKT3527BBWNO5ZYLGNMZRVFB4AMJK7G7KXWOARKGVGXC7Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.150129022 (323h30m32.881396673s) [noise=true , address=79.127.220.98:4415 , piece_id=ZHNY7FSQI2A2WAQ27ZAAUKDJYVHOXN3WY52LWZDYBY46E6WS7CAA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.151289868 (323h30m32.882557528s) [noise=true , address=104.36.82.11:4145 , piece_id=CUXENUONDG4VTNWJ2W2DV7IIP77YWFJAD5X25TCS2R777YLZOEXA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.300240501 (323h30m33.031508152s) [upload=336380]: Next returned nil segment Aug 22 04:56:52.300257313 (323h30m33.031524963s) [upload=336380]: Waiting for error group managing segments... Aug 22 04:56:52.311754692 (323h30m33.043022322s) [noise=true , address=45.91.116.4:4964 , piece_id=CBGK4RIP6G75M4V7RCU3Z2QSRTHGX6HQXQVUXXJQUE3NGPT5IM6A, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.312362526 (323h30m33.043630186s) [noise=true , address=77.90.31.18:4828 , piece_id=HLL25GXOKAZ7HVXV4NNTV6THA6YVXZGHSNMZPKM4XKMAWM52A2SQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.312505164 (323h30m33.043772785s) [noise=true , address=45.91.116.10:4105 , piece_id=IUETLBNXRVIX5KZU22YM4N4COHYEWA6ANYOZ6OZANRBOX22HXQOA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.313453540 (323h30m33.044721191s) [noise=true , address=45.91.116.11:4139 , piece_id=XXK64FDZN5ROM2JTYXXCF6DQBFMW4VRZIZT5PK6NGF7YLTOQ3PUA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.314229331 (323h30m33.045496961s) [noise=true , address=104.36.82.14:4243 , piece_id=PBAM3UFTBAJSBOFESCTKSDF4JR36GQB57NG7LL3Z7NGDJ4WDWG7Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.314832257 (323h30m33.046099887s) [noise=true , address=77.90.31.12:4620 , piece_id=UIFT7PMLVENB3QC3JK63343C2SSTVYJ2ME5HAUZ7UDVAHI5DO52Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.315510244 (323h30m33.046777864s) [noise=true , address=104.36.82.5:4851 , piece_id=XHDD77H42NATELJQIKPM2EMBI3WXXXHHEWDXQQJKS64KZJHTLW3A, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.316562384 (323h30m33.047830014s) [noise=true , address=104.36.82.50:4044 , piece_id=L3NJHGWUTLWDW26HUHIEQT2HW3A6GKSIZXYHDXK552QVTIFK3DIA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.316973228 (323h30m33.048240868s) [noise=true , address=104.36.82.17:4363 , piece_id=CZF7DHCTNXJTL5PDSINBOSBQJAM7433ZAQIKHKNQVZGQPS7242AQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.317706238 (323h30m33.048973888s) [noise=true , address=104.36.82.6:4892 , piece_id=JYTYGOJJRP3YAIDXDT5G5B5EO5AK24OT6F3TZV7P2TP36EUAY4XQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.318129285 (323h30m33.049396915s) [noise=true , address=104.36.82.11:4145 , piece_id=CUXENUONDG4VTNWJ2W2DV7IIP77YWFJAD5X25TCS2R777YLZOEXA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.320591320 (323h30m33.05185896s) [noise=true , address=77.90.31.10:4530 , piece_id=YNZ2IAHYCMLU7V4DFQGGRBC2HAJ36Z4FDTLAX7B72VBMBMPIINOQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.331756253 (323h30m33.063023883s) [noise=true , address=77.90.31.21:4906 , piece_id=UZY5ZFCBR7NPW4IN5WJPTGKSTVTMQ5IVSWKKVVXT6SN3R2U3FAPQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.332730648 (323h30m33.063998299s) [noise=true , address=104.36.82.9:4022 , piece_id=734PI3KYMOUSZNKRU4BWIEUECEKBZAOHXGL6FSTPCCKP6G6GSNWA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.332762158 (323h30m33.064029817s) [seg_pos={0 0}, upload=336380]: Segment reached optimal threshold of 14 pieces. Aug 22 04:56:52.332957295 (323h30m33.064224944s) [noise=true , address=104.36.82.60:4358 , piece_id=H32BEFSBI42XLRQF7YGVQKQGP63Y7XRECLOZPYLSOX2GBTR4355Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dwCNEcA9o51ZN3UaN3Frxdawwf8DXBj86iQMywjW8XP4ESmw1): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.332992812 (323h30m33.064260442s) [noise=true , address=104.36.82.23:4474 , piece_id=IVROJIBKT3527BBWNO5ZYLGNMZRVFB4AMJK7G7KXWOARKGVGXC7Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333074575 (323h30m33.064342235s) [noise=true , address=79.127.220.98:4415 , piece_id=ZHNY7FSQI2A2WAQ27ZAAUKDJYVHOXN3WY52LWZDYBY46E6WS7CAA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zEwYBHLdtVuQhypaivAt5k2AwMGEDvj4XsCBYHtoau2YXtH8e): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333209800 (323h30m33.06447743s) [noise=true , address=104.36.82.14:4228 , piece_id=ECOK2QCLNBRD7725CU4BFFAO4FUJLIR3CTMY3WZFVHUU77X5G55Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pkADNFaYa2SqFALQdxwf1CfR1ktUwshQkw7iBJzhdhaRYaszF): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333246088 (323h30m33.064513708s) [seg_pos={0 0}, upload=336380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 04:56:52.333351667 (323h30m33.064619298s) [upload=336380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 04:56:52.333357668 (323h30m33.064625298s) [upload=336380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 04:56:52.493730278 (323h30m33.224997929s) [upload=336380]: Done uploading segments... Aug 22 04:56:52.493749815 (323h30m33.225017465s) [upload=336380]: Upload finished. err: <nil> Duration: 1.289596465s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 384.786505ms FAIL (2025-08-22 05:27:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 384.80558ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [....X...........................................X...........] duration: 136.887981ms FAIL (2025-08-22 05:27:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 05:20:50.097930630 (323h54m30.82919828s) [upload=336808]: Starting upload Aug 22 05:20:50.097998158 (323h54m30.829265817s) [upload=336808]: Done starting upload Aug 22 05:20:50.098070042 (323h54m30.829337702s) [upload=336808]: Uploading segments... Aug 22 05:20:50.098107372 (323h54m30.829375022s) [upload=336808]: Got next segment. Inline: true Aug 22 05:20:50.098112542 (323h54m30.829380192s) [upload=336808]: Waiting for error group managing segments... Aug 22 05:20:50.098165492 (323h54m30.829433153s) [upload=336808]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 05:20:50.098174479 (323h54m30.829442129s) [upload=336808]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 05:20:50.098181131 (323h54m30.829448792s) [upload=336808]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 05:20:50.101149681 (323h54m30.832417331s) [upload=336808]: Done uploading segments... Aug 22 05:20:50.101161142 (323h54m30.832428793s) [upload=336808]: Upload finished. err: metaclient: Too Many Requests Duration:* 136.908811ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.326406626s FAIL (2025-08-22 05:26:58 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 22 04:56:52.108760398 (323h30m32.840028048s) [upload=336380]: Starting upload Aug 22 04:56:52.108905031 (323h30m32.840172682s) [upload=336380]: Done starting upload Aug 22 04:56:52.109003286 (323h30m32.840270946s) [upload=336380]: Uploading segments... Aug 22 04:56:52.109571796 (323h30m32.840839446s) [upload=336380]: Got next segment. Inline: false Aug 22 04:56:52.109630757 (323h30m32.840898408s) [upload=336380]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 04:56:52.109637339 (323h30m32.84090499s) [upload=336380]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 04:56:52.138484827 (323h30m32.869752477s) [seg_pos={0 0}, upload=336380]: Begin upload segment... Aug 22 04:56:52.138560400 (323h30m32.86982805s) [seg_pos={0 0}, upload=336380]: Done begin upload segment. Aug 22 04:56:52.138612417 (323h30m32.869880068s) [noise=true , address=45.91.116.10:4105 , piece_id=IUETLBNXRVIX5KZU22YM4N4COHYEWA6ANYOZ6OZANRBOX22HXQOA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.139205243 (323h30m32.870472944s) [noise=true , address=104.36.82.6:4892 , piece_id=JYTYGOJJRP3YAIDXDT5G5B5EO5AK24OT6F3TZV7P2TP36EUAY4XQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.139966056 (323h30m32.871233706s) [noise=true , address=104.36.82.50:4044 , piece_id=L3NJHGWUTLWDW26HUHIEQT2HW3A6GKSIZXYHDXK552QVTIFK3DIA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.140478040 (323h30m32.871745691s) [noise=true , address=77.90.31.12:4620 , piece_id=UIFT7PMLVENB3QC3JK63343C2SSTVYJ2ME5HAUZ7UDVAHI5DO52Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.140979465 (323h30m32.872247115s) [noise=true , address=45.91.116.11:4139 , piece_id=XXK64FDZN5ROM2JTYXXCF6DQBFMW4VRZIZT5PK6NGF7YLTOQ3PUA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.141547404 (323h30m32.872815054s) [noise=true , address=104.36.82.5:4851 , piece_id=XHDD77H42NATELJQIKPM2EMBI3WXXXHHEWDXQQJKS64KZJHTLW3A, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.142076150 (323h30m32.8733438s) [noise=true , address=77.90.31.18:4828 , piece_id=HLL25GXOKAZ7HVXV4NNTV6THA6YVXZGHSNMZPKM4XKMAWM52A2SQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.142639109 (323h30m32.87390676s) [noise=true , address=77.90.31.21:4906 , piece_id=UZY5ZFCBR7NPW4IN5WJPTGKSTVTMQ5IVSWKKVVXT6SN3R2U3FAPQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.143077495 (323h30m32.874345145s) [noise=true , address=104.36.82.9:4022 , piece_id=734PI3KYMOUSZNKRU4BWIEUECEKBZAOHXGL6FSTPCCKP6G6GSNWA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.143669991 (323h30m32.874937641s) [noise=true , address=77.90.31.10:4530 , piece_id=YNZ2IAHYCMLU7V4DFQGGRBC2HAJ36Z4FDTLAX7B72VBMBMPIINOQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.145875203 (323h30m32.877142883s) [noise=true , address=104.36.82.14:4243 , piece_id=PBAM3UFTBAJSBOFESCTKSDF4JR36GQB57NG7LL3Z7NGDJ4WDWG7Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.146491584 (323h30m32.877759234s) [noise=true , address=45.91.116.4:4964 , piece_id=CBGK4RIP6G75M4V7RCU3Z2QSRTHGX6HQXQVUXXJQUE3NGPT5IM6A, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.146979211 (323h30m32.878246862s) [noise=true , address=104.36.82.17:4363 , piece_id=CZF7DHCTNXJTL5PDSINBOSBQJAM7433ZAQIKHKNQVZGQPS7242AQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.147736838 (323h30m32.879004488s) [noise=true , address=104.36.82.60:4358 , piece_id=H32BEFSBI42XLRQF7YGVQKQGP63Y7XRECLOZPYLSOX2GBTR4355Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.148627205 (323h30m32.879894855s) [noise=true , address=104.36.82.14:4228 , piece_id=ECOK2QCLNBRD7725CU4BFFAO4FUJLIR3CTMY3WZFVHUU77X5G55Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.149206806 (323h30m32.880474466s) [noise=true , address=104.36.82.23:4474 , piece_id=IVROJIBKT3527BBWNO5ZYLGNMZRVFB4AMJK7G7KXWOARKGVGXC7Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.150129022 (323h30m32.881396673s) [noise=true , address=79.127.220.98:4415 , piece_id=ZHNY7FSQI2A2WAQ27ZAAUKDJYVHOXN3WY52LWZDYBY46E6WS7CAA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.151289868 (323h30m32.882557528s) [noise=true , address=104.36.82.11:4145 , piece_id=CUXENUONDG4VTNWJ2W2DV7IIP77YWFJAD5X25TCS2R777YLZOEXA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.300240501 (323h30m33.031508152s) [upload=336380]: Next returned nil segment Aug 22 04:56:52.300257313 (323h30m33.031524963s) [upload=336380]: Waiting for error group managing segments... Aug 22 04:56:52.311754692 (323h30m33.043022322s) [noise=true , address=45.91.116.4:4964 , piece_id=CBGK4RIP6G75M4V7RCU3Z2QSRTHGX6HQXQVUXXJQUE3NGPT5IM6A, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.312362526 (323h30m33.043630186s) [noise=true , address=77.90.31.18:4828 , piece_id=HLL25GXOKAZ7HVXV4NNTV6THA6YVXZGHSNMZPKM4XKMAWM52A2SQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.312505164 (323h30m33.043772785s) [noise=true , address=45.91.116.10:4105 , piece_id=IUETLBNXRVIX5KZU22YM4N4COHYEWA6ANYOZ6OZANRBOX22HXQOA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.313453540 (323h30m33.044721191s) [noise=true , address=45.91.116.11:4139 , piece_id=XXK64FDZN5ROM2JTYXXCF6DQBFMW4VRZIZT5PK6NGF7YLTOQ3PUA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.314229331 (323h30m33.045496961s) [noise=true , address=104.36.82.14:4243 , piece_id=PBAM3UFTBAJSBOFESCTKSDF4JR36GQB57NG7LL3Z7NGDJ4WDWG7Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.314832257 (323h30m33.046099887s) [noise=true , address=77.90.31.12:4620 , piece_id=UIFT7PMLVENB3QC3JK63343C2SSTVYJ2ME5HAUZ7UDVAHI5DO52Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.315510244 (323h30m33.046777864s) [noise=true , address=104.36.82.5:4851 , piece_id=XHDD77H42NATELJQIKPM2EMBI3WXXXHHEWDXQQJKS64KZJHTLW3A, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.316562384 (323h30m33.047830014s) [noise=true , address=104.36.82.50:4044 , piece_id=L3NJHGWUTLWDW26HUHIEQT2HW3A6GKSIZXYHDXK552QVTIFK3DIA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.316973228 (323h30m33.048240868s) [noise=true , address=104.36.82.17:4363 , piece_id=CZF7DHCTNXJTL5PDSINBOSBQJAM7433ZAQIKHKNQVZGQPS7242AQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.317706238 (323h30m33.048973888s) [noise=true , address=104.36.82.6:4892 , piece_id=JYTYGOJJRP3YAIDXDT5G5B5EO5AK24OT6F3TZV7P2TP36EUAY4XQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.318129285 (323h30m33.049396915s) [noise=true , address=104.36.82.11:4145 , piece_id=CUXENUONDG4VTNWJ2W2DV7IIP77YWFJAD5X25TCS2R777YLZOEXA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.320591320 (323h30m33.05185896s) [noise=true , address=77.90.31.10:4530 , piece_id=YNZ2IAHYCMLU7V4DFQGGRBC2HAJ36Z4FDTLAX7B72VBMBMPIINOQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.331756253 (323h30m33.063023883s) [noise=true , address=77.90.31.21:4906 , piece_id=UZY5ZFCBR7NPW4IN5WJPTGKSTVTMQ5IVSWKKVVXT6SN3R2U3FAPQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.332730648 (323h30m33.063998299s) [noise=true , address=104.36.82.9:4022 , piece_id=734PI3KYMOUSZNKRU4BWIEUECEKBZAOHXGL6FSTPCCKP6G6GSNWA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.332762158 (323h30m33.064029817s) [seg_pos={0 0}, upload=336380]: Segment reached optimal threshold of 14 pieces. Aug 22 04:56:52.332957295 (323h30m33.064224944s) [noise=true , address=104.36.82.60:4358 , piece_id=H32BEFSBI42XLRQF7YGVQKQGP63Y7XRECLOZPYLSOX2GBTR4355Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dwCNEcA9o51ZN3UaN3Frxdawwf8DXBj86iQMywjW8XP4ESmw1): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.332992812 (323h30m33.064260442s) [noise=true , address=104.36.82.23:4474 , piece_id=IVROJIBKT3527BBWNO5ZYLGNMZRVFB4AMJK7G7KXWOARKGVGXC7Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333074575 (323h30m33.064342235s) [noise=true , address=79.127.220.98:4415 , piece_id=ZHNY7FSQI2A2WAQ27ZAAUKDJYVHOXN3WY52LWZDYBY46E6WS7CAA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zEwYBHLdtVuQhypaivAt5k2AwMGEDvj4XsCBYHtoau2YXtH8e): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333209800 (323h30m33.06447743s) [noise=true , address=104.36.82.14:4228 , piece_id=ECOK2QCLNBRD7725CU4BFFAO4FUJLIR3CTMY3WZFVHUU77X5G55Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pkADNFaYa2SqFALQdxwf1CfR1ktUwshQkw7iBJzhdhaRYaszF): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333246088 (323h30m33.064513708s) [seg_pos={0 0}, upload=336380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 04:56:52.333351667 (323h30m33.064619298s) [upload=336380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 04:56:52.333357668 (323h30m33.064625298s) [upload=336380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 04:56:52.493730278 (323h30m33.224997929s) [upload=336380]: Done uploading segments... Aug 22 04:56:52.493749815 (323h30m33.225017465s) [upload=336380]: Upload finished. err: <nil> Duration: 2.326431462s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 415.264223ms FAIL (2025-08-22 05:26:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 415.28336ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....X...........................................X..........] duration: 141.024539ms FAIL (2025-08-22 05:26:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 05:20:50.097930630 (323h54m30.82919828s) [upload=336808]: Starting upload Aug 22 05:20:50.097998158 (323h54m30.829265817s) [upload=336808]: Done starting upload Aug 22 05:20:50.098070042 (323h54m30.829337702s) [upload=336808]: Uploading segments... Aug 22 05:20:50.098107372 (323h54m30.829375022s) [upload=336808]: Got next segment. Inline: true Aug 22 05:20:50.098112542 (323h54m30.829380192s) [upload=336808]: Waiting for error group managing segments... Aug 22 05:20:50.098165492 (323h54m30.829433153s) [upload=336808]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 05:20:50.098174479 (323h54m30.829442129s) [upload=336808]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 05:20:50.098181131 (323h54m30.829448792s) [upload=336808]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 05:20:50.101149681 (323h54m30.832417331s) [upload=336808]: Done uploading segments... Aug 22 05:20:50.101161142 (323h54m30.832428793s) [upload=336808]: Upload finished. err: metaclient: Too Many Requests Duration:* 141.077488ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 370.724525ms FAIL (2025-08-22 05:26:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 370.743913ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [......X...........................................X.........] duration: 531.075282ms FAIL (2025-08-22 05:25:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 05:20:50.097930630 (323h54m30.82919828s) [upload=336808]: Starting upload Aug 22 05:20:50.097998158 (323h54m30.829265817s) [upload=336808]: Done starting upload Aug 22 05:20:50.098070042 (323h54m30.829337702s) [upload=336808]: Uploading segments... Aug 22 05:20:50.098107372 (323h54m30.829375022s) [upload=336808]: Got next segment. Inline: true Aug 22 05:20:50.098112542 (323h54m30.829380192s) [upload=336808]: Waiting for error group managing segments... Aug 22 05:20:50.098165492 (323h54m30.829433153s) [upload=336808]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 05:20:50.098174479 (323h54m30.829442129s) [upload=336808]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 05:20:50.098181131 (323h54m30.829448792s) [upload=336808]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 05:20:50.101149681 (323h54m30.832417331s) [upload=336808]: Done uploading segments... Aug 22 05:20:50.101161142 (323h54m30.832428793s) [upload=336808]: Upload finished. err: metaclient: Too Many Requests Duration:* 531.096882ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.358437258s FAIL (2025-08-22 05:25:51 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 22 04:56:52.108760398 (323h30m32.840028048s) [upload=336380]: Starting upload Aug 22 04:56:52.108905031 (323h30m32.840172682s) [upload=336380]: Done starting upload Aug 22 04:56:52.109003286 (323h30m32.840270946s) [upload=336380]: Uploading segments... Aug 22 04:56:52.109571796 (323h30m32.840839446s) [upload=336380]: Got next segment. Inline: false Aug 22 04:56:52.109630757 (323h30m32.840898408s) [upload=336380]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 04:56:52.109637339 (323h30m32.84090499s) [upload=336380]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 04:56:52.138484827 (323h30m32.869752477s) [seg_pos={0 0}, upload=336380]: Begin upload segment... Aug 22 04:56:52.138560400 (323h30m32.86982805s) [seg_pos={0 0}, upload=336380]: Done begin upload segment. Aug 22 04:56:52.138612417 (323h30m32.869880068s) [noise=true , address=45.91.116.10:4105 , piece_id=IUETLBNXRVIX5KZU22YM4N4COHYEWA6ANYOZ6OZANRBOX22HXQOA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.139205243 (323h30m32.870472944s) [noise=true , address=104.36.82.6:4892 , piece_id=JYTYGOJJRP3YAIDXDT5G5B5EO5AK24OT6F3TZV7P2TP36EUAY4XQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.139966056 (323h30m32.871233706s) [noise=true , address=104.36.82.50:4044 , piece_id=L3NJHGWUTLWDW26HUHIEQT2HW3A6GKSIZXYHDXK552QVTIFK3DIA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.140478040 (323h30m32.871745691s) [noise=true , address=77.90.31.12:4620 , piece_id=UIFT7PMLVENB3QC3JK63343C2SSTVYJ2ME5HAUZ7UDVAHI5DO52Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.140979465 (323h30m32.872247115s) [noise=true , address=45.91.116.11:4139 , piece_id=XXK64FDZN5ROM2JTYXXCF6DQBFMW4VRZIZT5PK6NGF7YLTOQ3PUA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.141547404 (323h30m32.872815054s) [noise=true , address=104.36.82.5:4851 , piece_id=XHDD77H42NATELJQIKPM2EMBI3WXXXHHEWDXQQJKS64KZJHTLW3A, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.142076150 (323h30m32.8733438s) [noise=true , address=77.90.31.18:4828 , piece_id=HLL25GXOKAZ7HVXV4NNTV6THA6YVXZGHSNMZPKM4XKMAWM52A2SQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.142639109 (323h30m32.87390676s) [noise=true , address=77.90.31.21:4906 , piece_id=UZY5ZFCBR7NPW4IN5WJPTGKSTVTMQ5IVSWKKVVXT6SN3R2U3FAPQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.143077495 (323h30m32.874345145s) [noise=true , address=104.36.82.9:4022 , piece_id=734PI3KYMOUSZNKRU4BWIEUECEKBZAOHXGL6FSTPCCKP6G6GSNWA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.143669991 (323h30m32.874937641s) [noise=true , address=77.90.31.10:4530 , piece_id=YNZ2IAHYCMLU7V4DFQGGRBC2HAJ36Z4FDTLAX7B72VBMBMPIINOQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.145875203 (323h30m32.877142883s) [noise=true , address=104.36.82.14:4243 , piece_id=PBAM3UFTBAJSBOFESCTKSDF4JR36GQB57NG7LL3Z7NGDJ4WDWG7Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.146491584 (323h30m32.877759234s) [noise=true , address=45.91.116.4:4964 , piece_id=CBGK4RIP6G75M4V7RCU3Z2QSRTHGX6HQXQVUXXJQUE3NGPT5IM6A, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.146979211 (323h30m32.878246862s) [noise=true , address=104.36.82.17:4363 , piece_id=CZF7DHCTNXJTL5PDSINBOSBQJAM7433ZAQIKHKNQVZGQPS7242AQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.147736838 (323h30m32.879004488s) [noise=true , address=104.36.82.60:4358 , piece_id=H32BEFSBI42XLRQF7YGVQKQGP63Y7XRECLOZPYLSOX2GBTR4355Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.148627205 (323h30m32.879894855s) [noise=true , address=104.36.82.14:4228 , piece_id=ECOK2QCLNBRD7725CU4BFFAO4FUJLIR3CTMY3WZFVHUU77X5G55Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.149206806 (323h30m32.880474466s) [noise=true , address=104.36.82.23:4474 , piece_id=IVROJIBKT3527BBWNO5ZYLGNMZRVFB4AMJK7G7KXWOARKGVGXC7Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.150129022 (323h30m32.881396673s) [noise=true , address=79.127.220.98:4415 , piece_id=ZHNY7FSQI2A2WAQ27ZAAUKDJYVHOXN3WY52LWZDYBY46E6WS7CAA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.151289868 (323h30m32.882557528s) [noise=true , address=104.36.82.11:4145 , piece_id=CUXENUONDG4VTNWJ2W2DV7IIP77YWFJAD5X25TCS2R777YLZOEXA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.300240501 (323h30m33.031508152s) [upload=336380]: Next returned nil segment Aug 22 04:56:52.300257313 (323h30m33.031524963s) [upload=336380]: Waiting for error group managing segments... Aug 22 04:56:52.311754692 (323h30m33.043022322s) [noise=true , address=45.91.116.4:4964 , piece_id=CBGK4RIP6G75M4V7RCU3Z2QSRTHGX6HQXQVUXXJQUE3NGPT5IM6A, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.312362526 (323h30m33.043630186s) [noise=true , address=77.90.31.18:4828 , piece_id=HLL25GXOKAZ7HVXV4NNTV6THA6YVXZGHSNMZPKM4XKMAWM52A2SQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.312505164 (323h30m33.043772785s) [noise=true , address=45.91.116.10:4105 , piece_id=IUETLBNXRVIX5KZU22YM4N4COHYEWA6ANYOZ6OZANRBOX22HXQOA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.313453540 (323h30m33.044721191s) [noise=true , address=45.91.116.11:4139 , piece_id=XXK64FDZN5ROM2JTYXXCF6DQBFMW4VRZIZT5PK6NGF7YLTOQ3PUA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.314229331 (323h30m33.045496961s) [noise=true , address=104.36.82.14:4243 , piece_id=PBAM3UFTBAJSBOFESCTKSDF4JR36GQB57NG7LL3Z7NGDJ4WDWG7Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.314832257 (323h30m33.046099887s) [noise=true , address=77.90.31.12:4620 , piece_id=UIFT7PMLVENB3QC3JK63343C2SSTVYJ2ME5HAUZ7UDVAHI5DO52Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.315510244 (323h30m33.046777864s) [noise=true , address=104.36.82.5:4851 , piece_id=XHDD77H42NATELJQIKPM2EMBI3WXXXHHEWDXQQJKS64KZJHTLW3A, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.316562384 (323h30m33.047830014s) [noise=true , address=104.36.82.50:4044 , piece_id=L3NJHGWUTLWDW26HUHIEQT2HW3A6GKSIZXYHDXK552QVTIFK3DIA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.316973228 (323h30m33.048240868s) [noise=true , address=104.36.82.17:4363 , piece_id=CZF7DHCTNXJTL5PDSINBOSBQJAM7433ZAQIKHKNQVZGQPS7242AQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.317706238 (323h30m33.048973888s) [noise=true , address=104.36.82.6:4892 , piece_id=JYTYGOJJRP3YAIDXDT5G5B5EO5AK24OT6F3TZV7P2TP36EUAY4XQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.318129285 (323h30m33.049396915s) [noise=true , address=104.36.82.11:4145 , piece_id=CUXENUONDG4VTNWJ2W2DV7IIP77YWFJAD5X25TCS2R777YLZOEXA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.320591320 (323h30m33.05185896s) [noise=true , address=77.90.31.10:4530 , piece_id=YNZ2IAHYCMLU7V4DFQGGRBC2HAJ36Z4FDTLAX7B72VBMBMPIINOQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.331756253 (323h30m33.063023883s) [noise=true , address=77.90.31.21:4906 , piece_id=UZY5ZFCBR7NPW4IN5WJPTGKSTVTMQ5IVSWKKVVXT6SN3R2U3FAPQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.332730648 (323h30m33.063998299s) [noise=true , address=104.36.82.9:4022 , piece_id=734PI3KYMOUSZNKRU4BWIEUECEKBZAOHXGL6FSTPCCKP6G6GSNWA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.332762158 (323h30m33.064029817s) [seg_pos={0 0}, upload=336380]: Segment reached optimal threshold of 14 pieces. Aug 22 04:56:52.332957295 (323h30m33.064224944s) [noise=true , address=104.36.82.60:4358 , piece_id=H32BEFSBI42XLRQF7YGVQKQGP63Y7XRECLOZPYLSOX2GBTR4355Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dwCNEcA9o51ZN3UaN3Frxdawwf8DXBj86iQMywjW8XP4ESmw1): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.332992812 (323h30m33.064260442s) [noise=true , address=104.36.82.23:4474 , piece_id=IVROJIBKT3527BBWNO5ZYLGNMZRVFB4AMJK7G7KXWOARKGVGXC7Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333074575 (323h30m33.064342235s) [noise=true , address=79.127.220.98:4415 , piece_id=ZHNY7FSQI2A2WAQ27ZAAUKDJYVHOXN3WY52LWZDYBY46E6WS7CAA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zEwYBHLdtVuQhypaivAt5k2AwMGEDvj4XsCBYHtoau2YXtH8e): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333209800 (323h30m33.06447743s) [noise=true , address=104.36.82.14:4228 , piece_id=ECOK2QCLNBRD7725CU4BFFAO4FUJLIR3CTMY3WZFVHUU77X5G55Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pkADNFaYa2SqFALQdxwf1CfR1ktUwshQkw7iBJzhdhaRYaszF): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333246088 (323h30m33.064513708s) [seg_pos={0 0}, upload=336380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 04:56:52.333351667 (323h30m33.064619298s) [upload=336380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 04:56:52.333357668 (323h30m33.064625298s) [upload=336380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 04:56:52.493730278 (323h30m33.224997929s) [upload=336380]: Done uploading segments... Aug 22 04:56:52.493749815 (323h30m33.225017465s) [upload=336380]: Upload finished. err: <nil> Duration: 2.358458738s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 379.39822ms FAIL (2025-08-22 05:25:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 379.418668ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......X...........................................X........] duration: 116.811608ms FAIL (2025-08-22 05:25:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 05:20:50.097930630 (323h54m30.82919828s) [upload=336808]: Starting upload Aug 22 05:20:50.097998158 (323h54m30.829265817s) [upload=336808]: Done starting upload Aug 22 05:20:50.098070042 (323h54m30.829337702s) [upload=336808]: Uploading segments... Aug 22 05:20:50.098107372 (323h54m30.829375022s) [upload=336808]: Got next segment. Inline: true Aug 22 05:20:50.098112542 (323h54m30.829380192s) [upload=336808]: Waiting for error group managing segments... Aug 22 05:20:50.098165492 (323h54m30.829433153s) [upload=336808]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 05:20:50.098174479 (323h54m30.829442129s) [upload=336808]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 05:20:50.098181131 (323h54m30.829448792s) [upload=336808]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 05:20:50.101149681 (323h54m30.832417331s) [upload=336808]: Done uploading segments... Aug 22 05:20:50.101161142 (323h54m30.832428793s) [upload=336808]: Upload finished. err: metaclient: Too Many Requests Duration:* 116.830152ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 1.641192746s FAIL (2025-08-22 05:25:20 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 22 04:56:52.108760398 (323h30m32.840028048s) [upload=336380]: Starting upload Aug 22 04:56:52.108905031 (323h30m32.840172682s) [upload=336380]: Done starting upload Aug 22 04:56:52.109003286 (323h30m32.840270946s) [upload=336380]: Uploading segments... Aug 22 04:56:52.109571796 (323h30m32.840839446s) [upload=336380]: Got next segment. Inline: false Aug 22 04:56:52.109630757 (323h30m32.840898408s) [upload=336380]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 04:56:52.109637339 (323h30m32.84090499s) [upload=336380]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 04:56:52.138484827 (323h30m32.869752477s) [seg_pos={0 0}, upload=336380]: Begin upload segment... Aug 22 04:56:52.138560400 (323h30m32.86982805s) [seg_pos={0 0}, upload=336380]: Done begin upload segment. Aug 22 04:56:52.138612417 (323h30m32.869880068s) [noise=true , address=45.91.116.10:4105 , piece_id=IUETLBNXRVIX5KZU22YM4N4COHYEWA6ANYOZ6OZANRBOX22HXQOA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.139205243 (323h30m32.870472944s) [noise=true , address=104.36.82.6:4892 , piece_id=JYTYGOJJRP3YAIDXDT5G5B5EO5AK24OT6F3TZV7P2TP36EUAY4XQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.139966056 (323h30m32.871233706s) [noise=true , address=104.36.82.50:4044 , piece_id=L3NJHGWUTLWDW26HUHIEQT2HW3A6GKSIZXYHDXK552QVTIFK3DIA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.140478040 (323h30m32.871745691s) [noise=true , address=77.90.31.12:4620 , piece_id=UIFT7PMLVENB3QC3JK63343C2SSTVYJ2ME5HAUZ7UDVAHI5DO52Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.140979465 (323h30m32.872247115s) [noise=true , address=45.91.116.11:4139 , piece_id=XXK64FDZN5ROM2JTYXXCF6DQBFMW4VRZIZT5PK6NGF7YLTOQ3PUA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.141547404 (323h30m32.872815054s) [noise=true , address=104.36.82.5:4851 , piece_id=XHDD77H42NATELJQIKPM2EMBI3WXXXHHEWDXQQJKS64KZJHTLW3A, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.142076150 (323h30m32.8733438s) [noise=true , address=77.90.31.18:4828 , piece_id=HLL25GXOKAZ7HVXV4NNTV6THA6YVXZGHSNMZPKM4XKMAWM52A2SQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.142639109 (323h30m32.87390676s) [noise=true , address=77.90.31.21:4906 , piece_id=UZY5ZFCBR7NPW4IN5WJPTGKSTVTMQ5IVSWKKVVXT6SN3R2U3FAPQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.143077495 (323h30m32.874345145s) [noise=true , address=104.36.82.9:4022 , piece_id=734PI3KYMOUSZNKRU4BWIEUECEKBZAOHXGL6FSTPCCKP6G6GSNWA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.143669991 (323h30m32.874937641s) [noise=true , address=77.90.31.10:4530 , piece_id=YNZ2IAHYCMLU7V4DFQGGRBC2HAJ36Z4FDTLAX7B72VBMBMPIINOQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.145875203 (323h30m32.877142883s) [noise=true , address=104.36.82.14:4243 , piece_id=PBAM3UFTBAJSBOFESCTKSDF4JR36GQB57NG7LL3Z7NGDJ4WDWG7Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.146491584 (323h30m32.877759234s) [noise=true , address=45.91.116.4:4964 , piece_id=CBGK4RIP6G75M4V7RCU3Z2QSRTHGX6HQXQVUXXJQUE3NGPT5IM6A, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.146979211 (323h30m32.878246862s) [noise=true , address=104.36.82.17:4363 , piece_id=CZF7DHCTNXJTL5PDSINBOSBQJAM7433ZAQIKHKNQVZGQPS7242AQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.147736838 (323h30m32.879004488s) [noise=true , address=104.36.82.60:4358 , piece_id=H32BEFSBI42XLRQF7YGVQKQGP63Y7XRECLOZPYLSOX2GBTR4355Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.148627205 (323h30m32.879894855s) [noise=true , address=104.36.82.14:4228 , piece_id=ECOK2QCLNBRD7725CU4BFFAO4FUJLIR3CTMY3WZFVHUU77X5G55Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.149206806 (323h30m32.880474466s) [noise=true , address=104.36.82.23:4474 , piece_id=IVROJIBKT3527BBWNO5ZYLGNMZRVFB4AMJK7G7KXWOARKGVGXC7Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.150129022 (323h30m32.881396673s) [noise=true , address=79.127.220.98:4415 , piece_id=ZHNY7FSQI2A2WAQ27ZAAUKDJYVHOXN3WY52LWZDYBY46E6WS7CAA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.151289868 (323h30m32.882557528s) [noise=true , address=104.36.82.11:4145 , piece_id=CUXENUONDG4VTNWJ2W2DV7IIP77YWFJAD5X25TCS2R777YLZOEXA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.300240501 (323h30m33.031508152s) [upload=336380]: Next returned nil segment Aug 22 04:56:52.300257313 (323h30m33.031524963s) [upload=336380]: Waiting for error group managing segments... Aug 22 04:56:52.311754692 (323h30m33.043022322s) [noise=true , address=45.91.116.4:4964 , piece_id=CBGK4RIP6G75M4V7RCU3Z2QSRTHGX6HQXQVUXXJQUE3NGPT5IM6A, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.312362526 (323h30m33.043630186s) [noise=true , address=77.90.31.18:4828 , piece_id=HLL25GXOKAZ7HVXV4NNTV6THA6YVXZGHSNMZPKM4XKMAWM52A2SQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.312505164 (323h30m33.043772785s) [noise=true , address=45.91.116.10:4105 , piece_id=IUETLBNXRVIX5KZU22YM4N4COHYEWA6ANYOZ6OZANRBOX22HXQOA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.313453540 (323h30m33.044721191s) [noise=true , address=45.91.116.11:4139 , piece_id=XXK64FDZN5ROM2JTYXXCF6DQBFMW4VRZIZT5PK6NGF7YLTOQ3PUA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.314229331 (323h30m33.045496961s) [noise=true , address=104.36.82.14:4243 , piece_id=PBAM3UFTBAJSBOFESCTKSDF4JR36GQB57NG7LL3Z7NGDJ4WDWG7Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.314832257 (323h30m33.046099887s) [noise=true , address=77.90.31.12:4620 , piece_id=UIFT7PMLVENB3QC3JK63343C2SSTVYJ2ME5HAUZ7UDVAHI5DO52Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.315510244 (323h30m33.046777864s) [noise=true , address=104.36.82.5:4851 , piece_id=XHDD77H42NATELJQIKPM2EMBI3WXXXHHEWDXQQJKS64KZJHTLW3A, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.316562384 (323h30m33.047830014s) [noise=true , address=104.36.82.50:4044 , piece_id=L3NJHGWUTLWDW26HUHIEQT2HW3A6GKSIZXYHDXK552QVTIFK3DIA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.316973228 (323h30m33.048240868s) [noise=true , address=104.36.82.17:4363 , piece_id=CZF7DHCTNXJTL5PDSINBOSBQJAM7433ZAQIKHKNQVZGQPS7242AQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.317706238 (323h30m33.048973888s) [noise=true , address=104.36.82.6:4892 , piece_id=JYTYGOJJRP3YAIDXDT5G5B5EO5AK24OT6F3TZV7P2TP36EUAY4XQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.318129285 (323h30m33.049396915s) [noise=true , address=104.36.82.11:4145 , piece_id=CUXENUONDG4VTNWJ2W2DV7IIP77YWFJAD5X25TCS2R777YLZOEXA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.320591320 (323h30m33.05185896s) [noise=true , address=77.90.31.10:4530 , piece_id=YNZ2IAHYCMLU7V4DFQGGRBC2HAJ36Z4FDTLAX7B72VBMBMPIINOQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.331756253 (323h30m33.063023883s) [noise=true , address=77.90.31.21:4906 , piece_id=UZY5ZFCBR7NPW4IN5WJPTGKSTVTMQ5IVSWKKVVXT6SN3R2U3FAPQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.332730648 (323h30m33.063998299s) [noise=true , address=104.36.82.9:4022 , piece_id=734PI3KYMOUSZNKRU4BWIEUECEKBZAOHXGL6FSTPCCKP6G6GSNWA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.332762158 (323h30m33.064029817s) [seg_pos={0 0}, upload=336380]: Segment reached optimal threshold of 14 pieces. Aug 22 04:56:52.332957295 (323h30m33.064224944s) [noise=true , address=104.36.82.60:4358 , piece_id=H32BEFSBI42XLRQF7YGVQKQGP63Y7XRECLOZPYLSOX2GBTR4355Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dwCNEcA9o51ZN3UaN3Frxdawwf8DXBj86iQMywjW8XP4ESmw1): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.332992812 (323h30m33.064260442s) [noise=true , address=104.36.82.23:4474 , piece_id=IVROJIBKT3527BBWNO5ZYLGNMZRVFB4AMJK7G7KXWOARKGVGXC7Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333074575 (323h30m33.064342235s) [noise=true , address=79.127.220.98:4415 , piece_id=ZHNY7FSQI2A2WAQ27ZAAUKDJYVHOXN3WY52LWZDYBY46E6WS7CAA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zEwYBHLdtVuQhypaivAt5k2AwMGEDvj4XsCBYHtoau2YXtH8e): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333209800 (323h30m33.06447743s) [noise=true , address=104.36.82.14:4228 , piece_id=ECOK2QCLNBRD7725CU4BFFAO4FUJLIR3CTMY3WZFVHUU77X5G55Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pkADNFaYa2SqFALQdxwf1CfR1ktUwshQkw7iBJzhdhaRYaszF): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333246088 (323h30m33.064513708s) [seg_pos={0 0}, upload=336380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 04:56:52.333351667 (323h30m33.064619298s) [upload=336380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 04:56:52.333357668 (323h30m33.064625298s) [upload=336380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 04:56:52.493730278 (323h30m33.224997929s) [upload=336380]: Done uploading segments... Aug 22 04:56:52.493749815 (323h30m33.225017465s) [upload=336380]: Upload finished. err: <nil> Duration: 1.641226992s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 585.87963ms FAIL (2025-08-22 05:25:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 585.900969ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [........X...........................................X.......] duration: 390.672498ms FAIL (2025-08-22 05:24:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 05:20:50.097930630 (323h54m30.82919828s) [upload=336808]: Starting upload Aug 22 05:20:50.097998158 (323h54m30.829265817s) [upload=336808]: Done starting upload Aug 22 05:20:50.098070042 (323h54m30.829337702s) [upload=336808]: Uploading segments... Aug 22 05:20:50.098107372 (323h54m30.829375022s) [upload=336808]: Got next segment. Inline: true Aug 22 05:20:50.098112542 (323h54m30.829380192s) [upload=336808]: Waiting for error group managing segments... Aug 22 05:20:50.098165492 (323h54m30.829433153s) [upload=336808]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 05:20:50.098174479 (323h54m30.829442129s) [upload=336808]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 05:20:50.098181131 (323h54m30.829448792s) [upload=336808]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 05:20:50.101149681 (323h54m30.832417331s) [upload=336808]: Done uploading segments... Aug 22 05:20:50.101161142 (323h54m30.832428793s) [upload=336808]: Upload finished. err: metaclient: Too Many Requests Duration:* 390.695231ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 894.116414ms FAIL (2025-08-22 05:24:25 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 22 04:56:52.108760398 (323h30m32.840028048s) [upload=336380]: Starting upload Aug 22 04:56:52.108905031 (323h30m32.840172682s) [upload=336380]: Done starting upload Aug 22 04:56:52.109003286 (323h30m32.840270946s) [upload=336380]: Uploading segments... Aug 22 04:56:52.109571796 (323h30m32.840839446s) [upload=336380]: Got next segment. Inline: false Aug 22 04:56:52.109630757 (323h30m32.840898408s) [upload=336380]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 04:56:52.109637339 (323h30m32.84090499s) [upload=336380]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 04:56:52.138484827 (323h30m32.869752477s) [seg_pos={0 0}, upload=336380]: Begin upload segment... Aug 22 04:56:52.138560400 (323h30m32.86982805s) [seg_pos={0 0}, upload=336380]: Done begin upload segment. Aug 22 04:56:52.138612417 (323h30m32.869880068s) [noise=true , address=45.91.116.10:4105 , piece_id=IUETLBNXRVIX5KZU22YM4N4COHYEWA6ANYOZ6OZANRBOX22HXQOA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.139205243 (323h30m32.870472944s) [noise=true , address=104.36.82.6:4892 , piece_id=JYTYGOJJRP3YAIDXDT5G5B5EO5AK24OT6F3TZV7P2TP36EUAY4XQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.139966056 (323h30m32.871233706s) [noise=true , address=104.36.82.50:4044 , piece_id=L3NJHGWUTLWDW26HUHIEQT2HW3A6GKSIZXYHDXK552QVTIFK3DIA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.140478040 (323h30m32.871745691s) [noise=true , address=77.90.31.12:4620 , piece_id=UIFT7PMLVENB3QC3JK63343C2SSTVYJ2ME5HAUZ7UDVAHI5DO52Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.140979465 (323h30m32.872247115s) [noise=true , address=45.91.116.11:4139 , piece_id=XXK64FDZN5ROM2JTYXXCF6DQBFMW4VRZIZT5PK6NGF7YLTOQ3PUA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.141547404 (323h30m32.872815054s) [noise=true , address=104.36.82.5:4851 , piece_id=XHDD77H42NATELJQIKPM2EMBI3WXXXHHEWDXQQJKS64KZJHTLW3A, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.142076150 (323h30m32.8733438s) [noise=true , address=77.90.31.18:4828 , piece_id=HLL25GXOKAZ7HVXV4NNTV6THA6YVXZGHSNMZPKM4XKMAWM52A2SQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.142639109 (323h30m32.87390676s) [noise=true , address=77.90.31.21:4906 , piece_id=UZY5ZFCBR7NPW4IN5WJPTGKSTVTMQ5IVSWKKVVXT6SN3R2U3FAPQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.143077495 (323h30m32.874345145s) [noise=true , address=104.36.82.9:4022 , piece_id=734PI3KYMOUSZNKRU4BWIEUECEKBZAOHXGL6FSTPCCKP6G6GSNWA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.143669991 (323h30m32.874937641s) [noise=true , address=77.90.31.10:4530 , piece_id=YNZ2IAHYCMLU7V4DFQGGRBC2HAJ36Z4FDTLAX7B72VBMBMPIINOQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.145875203 (323h30m32.877142883s) [noise=true , address=104.36.82.14:4243 , piece_id=PBAM3UFTBAJSBOFESCTKSDF4JR36GQB57NG7LL3Z7NGDJ4WDWG7Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.146491584 (323h30m32.877759234s) [noise=true , address=45.91.116.4:4964 , piece_id=CBGK4RIP6G75M4V7RCU3Z2QSRTHGX6HQXQVUXXJQUE3NGPT5IM6A, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.146979211 (323h30m32.878246862s) [noise=true , address=104.36.82.17:4363 , piece_id=CZF7DHCTNXJTL5PDSINBOSBQJAM7433ZAQIKHKNQVZGQPS7242AQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.147736838 (323h30m32.879004488s) [noise=true , address=104.36.82.60:4358 , piece_id=H32BEFSBI42XLRQF7YGVQKQGP63Y7XRECLOZPYLSOX2GBTR4355Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.148627205 (323h30m32.879894855s) [noise=true , address=104.36.82.14:4228 , piece_id=ECOK2QCLNBRD7725CU4BFFAO4FUJLIR3CTMY3WZFVHUU77X5G55Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.149206806 (323h30m32.880474466s) [noise=true , address=104.36.82.23:4474 , piece_id=IVROJIBKT3527BBWNO5ZYLGNMZRVFB4AMJK7G7KXWOARKGVGXC7Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.150129022 (323h30m32.881396673s) [noise=true , address=79.127.220.98:4415 , piece_id=ZHNY7FSQI2A2WAQ27ZAAUKDJYVHOXN3WY52LWZDYBY46E6WS7CAA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.151289868 (323h30m32.882557528s) [noise=true , address=104.36.82.11:4145 , piece_id=CUXENUONDG4VTNWJ2W2DV7IIP77YWFJAD5X25TCS2R777YLZOEXA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.300240501 (323h30m33.031508152s) [upload=336380]: Next returned nil segment Aug 22 04:56:52.300257313 (323h30m33.031524963s) [upload=336380]: Waiting for error group managing segments... Aug 22 04:56:52.311754692 (323h30m33.043022322s) [noise=true , address=45.91.116.4:4964 , piece_id=CBGK4RIP6G75M4V7RCU3Z2QSRTHGX6HQXQVUXXJQUE3NGPT5IM6A, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.312362526 (323h30m33.043630186s) [noise=true , address=77.90.31.18:4828 , piece_id=HLL25GXOKAZ7HVXV4NNTV6THA6YVXZGHSNMZPKM4XKMAWM52A2SQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.312505164 (323h30m33.043772785s) [noise=true , address=45.91.116.10:4105 , piece_id=IUETLBNXRVIX5KZU22YM4N4COHYEWA6ANYOZ6OZANRBOX22HXQOA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.313453540 (323h30m33.044721191s) [noise=true , address=45.91.116.11:4139 , piece_id=XXK64FDZN5ROM2JTYXXCF6DQBFMW4VRZIZT5PK6NGF7YLTOQ3PUA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.314229331 (323h30m33.045496961s) [noise=true , address=104.36.82.14:4243 , piece_id=PBAM3UFTBAJSBOFESCTKSDF4JR36GQB57NG7LL3Z7NGDJ4WDWG7Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.314832257 (323h30m33.046099887s) [noise=true , address=77.90.31.12:4620 , piece_id=UIFT7PMLVENB3QC3JK63343C2SSTVYJ2ME5HAUZ7UDVAHI5DO52Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.315510244 (323h30m33.046777864s) [noise=true , address=104.36.82.5:4851 , piece_id=XHDD77H42NATELJQIKPM2EMBI3WXXXHHEWDXQQJKS64KZJHTLW3A, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.316562384 (323h30m33.047830014s) [noise=true , address=104.36.82.50:4044 , piece_id=L3NJHGWUTLWDW26HUHIEQT2HW3A6GKSIZXYHDXK552QVTIFK3DIA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.316973228 (323h30m33.048240868s) [noise=true , address=104.36.82.17:4363 , piece_id=CZF7DHCTNXJTL5PDSINBOSBQJAM7433ZAQIKHKNQVZGQPS7242AQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.317706238 (323h30m33.048973888s) [noise=true , address=104.36.82.6:4892 , piece_id=JYTYGOJJRP3YAIDXDT5G5B5EO5AK24OT6F3TZV7P2TP36EUAY4XQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.318129285 (323h30m33.049396915s) [noise=true , address=104.36.82.11:4145 , piece_id=CUXENUONDG4VTNWJ2W2DV7IIP77YWFJAD5X25TCS2R777YLZOEXA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.320591320 (323h30m33.05185896s) [noise=true , address=77.90.31.10:4530 , piece_id=YNZ2IAHYCMLU7V4DFQGGRBC2HAJ36Z4FDTLAX7B72VBMBMPIINOQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.331756253 (323h30m33.063023883s) [noise=true , address=77.90.31.21:4906 , piece_id=UZY5ZFCBR7NPW4IN5WJPTGKSTVTMQ5IVSWKKVVXT6SN3R2U3FAPQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.332730648 (323h30m33.063998299s) [noise=true , address=104.36.82.9:4022 , piece_id=734PI3KYMOUSZNKRU4BWIEUECEKBZAOHXGL6FSTPCCKP6G6GSNWA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.332762158 (323h30m33.064029817s) [seg_pos={0 0}, upload=336380]: Segment reached optimal threshold of 14 pieces. Aug 22 04:56:52.332957295 (323h30m33.064224944s) [noise=true , address=104.36.82.60:4358 , piece_id=H32BEFSBI42XLRQF7YGVQKQGP63Y7XRECLOZPYLSOX2GBTR4355Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dwCNEcA9o51ZN3UaN3Frxdawwf8DXBj86iQMywjW8XP4ESmw1): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.332992812 (323h30m33.064260442s) [noise=true , address=104.36.82.23:4474 , piece_id=IVROJIBKT3527BBWNO5ZYLGNMZRVFB4AMJK7G7KXWOARKGVGXC7Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333074575 (323h30m33.064342235s) [noise=true , address=79.127.220.98:4415 , piece_id=ZHNY7FSQI2A2WAQ27ZAAUKDJYVHOXN3WY52LWZDYBY46E6WS7CAA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zEwYBHLdtVuQhypaivAt5k2AwMGEDvj4XsCBYHtoau2YXtH8e): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333209800 (323h30m33.06447743s) [noise=true , address=104.36.82.14:4228 , piece_id=ECOK2QCLNBRD7725CU4BFFAO4FUJLIR3CTMY3WZFVHUU77X5G55Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pkADNFaYa2SqFALQdxwf1CfR1ktUwshQkw7iBJzhdhaRYaszF): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333246088 (323h30m33.064513708s) [seg_pos={0 0}, upload=336380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 04:56:52.333351667 (323h30m33.064619298s) [upload=336380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 04:56:52.333357668 (323h30m33.064625298s) [upload=336380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 04:56:52.493730278 (323h30m33.224997929s) [upload=336380]: Done uploading segments... Aug 22 04:56:52.493749815 (323h30m33.225017465s) [upload=336380]: Upload finished. err: <nil> Duration: 894.137804ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 507.336277ms FAIL (2025-08-22 05:24:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 507.364741ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........X...........................................X......] duration: 119.258904ms FAIL (2025-08-22 05:24:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 05:20:50.097930630 (323h54m30.82919828s) [upload=336808]: Starting upload Aug 22 05:20:50.097998158 (323h54m30.829265817s) [upload=336808]: Done starting upload Aug 22 05:20:50.098070042 (323h54m30.829337702s) [upload=336808]: Uploading segments... Aug 22 05:20:50.098107372 (323h54m30.829375022s) [upload=336808]: Got next segment. Inline: true Aug 22 05:20:50.098112542 (323h54m30.829380192s) [upload=336808]: Waiting for error group managing segments... Aug 22 05:20:50.098165492 (323h54m30.829433153s) [upload=336808]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 05:20:50.098174479 (323h54m30.829442129s) [upload=336808]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 05:20:50.098181131 (323h54m30.829448792s) [upload=336808]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 05:20:50.101149681 (323h54m30.832417331s) [upload=336808]: Done uploading segments... Aug 22 05:20:50.101161142 (323h54m30.832428793s) [upload=336808]: Upload finished. err: metaclient: Too Many Requests Duration:* 119.290614ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 1.837170228s FAIL (2025-08-22 05:23:44 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 22 04:56:52.108760398 (323h30m32.840028048s) [upload=336380]: Starting upload Aug 22 04:56:52.108905031 (323h30m32.840172682s) [upload=336380]: Done starting upload Aug 22 04:56:52.109003286 (323h30m32.840270946s) [upload=336380]: Uploading segments... Aug 22 04:56:52.109571796 (323h30m32.840839446s) [upload=336380]: Got next segment. Inline: false Aug 22 04:56:52.109630757 (323h30m32.840898408s) [upload=336380]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 04:56:52.109637339 (323h30m32.84090499s) [upload=336380]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 04:56:52.138484827 (323h30m32.869752477s) [seg_pos={0 0}, upload=336380]: Begin upload segment... Aug 22 04:56:52.138560400 (323h30m32.86982805s) [seg_pos={0 0}, upload=336380]: Done begin upload segment. Aug 22 04:56:52.138612417 (323h30m32.869880068s) [noise=true , address=45.91.116.10:4105 , piece_id=IUETLBNXRVIX5KZU22YM4N4COHYEWA6ANYOZ6OZANRBOX22HXQOA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.139205243 (323h30m32.870472944s) [noise=true , address=104.36.82.6:4892 , piece_id=JYTYGOJJRP3YAIDXDT5G5B5EO5AK24OT6F3TZV7P2TP36EUAY4XQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.139966056 (323h30m32.871233706s) [noise=true , address=104.36.82.50:4044 , piece_id=L3NJHGWUTLWDW26HUHIEQT2HW3A6GKSIZXYHDXK552QVTIFK3DIA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.140478040 (323h30m32.871745691s) [noise=true , address=77.90.31.12:4620 , piece_id=UIFT7PMLVENB3QC3JK63343C2SSTVYJ2ME5HAUZ7UDVAHI5DO52Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.140979465 (323h30m32.872247115s) [noise=true , address=45.91.116.11:4139 , piece_id=XXK64FDZN5ROM2JTYXXCF6DQBFMW4VRZIZT5PK6NGF7YLTOQ3PUA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.141547404 (323h30m32.872815054s) [noise=true , address=104.36.82.5:4851 , piece_id=XHDD77H42NATELJQIKPM2EMBI3WXXXHHEWDXQQJKS64KZJHTLW3A, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.142076150 (323h30m32.8733438s) [noise=true , address=77.90.31.18:4828 , piece_id=HLL25GXOKAZ7HVXV4NNTV6THA6YVXZGHSNMZPKM4XKMAWM52A2SQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.142639109 (323h30m32.87390676s) [noise=true , address=77.90.31.21:4906 , piece_id=UZY5ZFCBR7NPW4IN5WJPTGKSTVTMQ5IVSWKKVVXT6SN3R2U3FAPQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.143077495 (323h30m32.874345145s) [noise=true , address=104.36.82.9:4022 , piece_id=734PI3KYMOUSZNKRU4BWIEUECEKBZAOHXGL6FSTPCCKP6G6GSNWA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.143669991 (323h30m32.874937641s) [noise=true , address=77.90.31.10:4530 , piece_id=YNZ2IAHYCMLU7V4DFQGGRBC2HAJ36Z4FDTLAX7B72VBMBMPIINOQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.145875203 (323h30m32.877142883s) [noise=true , address=104.36.82.14:4243 , piece_id=PBAM3UFTBAJSBOFESCTKSDF4JR36GQB57NG7LL3Z7NGDJ4WDWG7Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.146491584 (323h30m32.877759234s) [noise=true , address=45.91.116.4:4964 , piece_id=CBGK4RIP6G75M4V7RCU3Z2QSRTHGX6HQXQVUXXJQUE3NGPT5IM6A, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.146979211 (323h30m32.878246862s) [noise=true , address=104.36.82.17:4363 , piece_id=CZF7DHCTNXJTL5PDSINBOSBQJAM7433ZAQIKHKNQVZGQPS7242AQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.147736838 (323h30m32.879004488s) [noise=true , address=104.36.82.60:4358 , piece_id=H32BEFSBI42XLRQF7YGVQKQGP63Y7XRECLOZPYLSOX2GBTR4355Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.148627205 (323h30m32.879894855s) [noise=true , address=104.36.82.14:4228 , piece_id=ECOK2QCLNBRD7725CU4BFFAO4FUJLIR3CTMY3WZFVHUU77X5G55Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.149206806 (323h30m32.880474466s) [noise=true , address=104.36.82.23:4474 , piece_id=IVROJIBKT3527BBWNO5ZYLGNMZRVFB4AMJK7G7KXWOARKGVGXC7Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.150129022 (323h30m32.881396673s) [noise=true , address=79.127.220.98:4415 , piece_id=ZHNY7FSQI2A2WAQ27ZAAUKDJYVHOXN3WY52LWZDYBY46E6WS7CAA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.151289868 (323h30m32.882557528s) [noise=true , address=104.36.82.11:4145 , piece_id=CUXENUONDG4VTNWJ2W2DV7IIP77YWFJAD5X25TCS2R777YLZOEXA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.300240501 (323h30m33.031508152s) [upload=336380]: Next returned nil segment Aug 22 04:56:52.300257313 (323h30m33.031524963s) [upload=336380]: Waiting for error group managing segments... Aug 22 04:56:52.311754692 (323h30m33.043022322s) [noise=true , address=45.91.116.4:4964 , piece_id=CBGK4RIP6G75M4V7RCU3Z2QSRTHGX6HQXQVUXXJQUE3NGPT5IM6A, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.312362526 (323h30m33.043630186s) [noise=true , address=77.90.31.18:4828 , piece_id=HLL25GXOKAZ7HVXV4NNTV6THA6YVXZGHSNMZPKM4XKMAWM52A2SQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.312505164 (323h30m33.043772785s) [noise=true , address=45.91.116.10:4105 , piece_id=IUETLBNXRVIX5KZU22YM4N4COHYEWA6ANYOZ6OZANRBOX22HXQOA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.313453540 (323h30m33.044721191s) [noise=true , address=45.91.116.11:4139 , piece_id=XXK64FDZN5ROM2JTYXXCF6DQBFMW4VRZIZT5PK6NGF7YLTOQ3PUA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.314229331 (323h30m33.045496961s) [noise=true , address=104.36.82.14:4243 , piece_id=PBAM3UFTBAJSBOFESCTKSDF4JR36GQB57NG7LL3Z7NGDJ4WDWG7Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.314832257 (323h30m33.046099887s) [noise=true , address=77.90.31.12:4620 , piece_id=UIFT7PMLVENB3QC3JK63343C2SSTVYJ2ME5HAUZ7UDVAHI5DO52Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.315510244 (323h30m33.046777864s) [noise=true , address=104.36.82.5:4851 , piece_id=XHDD77H42NATELJQIKPM2EMBI3WXXXHHEWDXQQJKS64KZJHTLW3A, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.316562384 (323h30m33.047830014s) [noise=true , address=104.36.82.50:4044 , piece_id=L3NJHGWUTLWDW26HUHIEQT2HW3A6GKSIZXYHDXK552QVTIFK3DIA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.316973228 (323h30m33.048240868s) [noise=true , address=104.36.82.17:4363 , piece_id=CZF7DHCTNXJTL5PDSINBOSBQJAM7433ZAQIKHKNQVZGQPS7242AQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.317706238 (323h30m33.048973888s) [noise=true , address=104.36.82.6:4892 , piece_id=JYTYGOJJRP3YAIDXDT5G5B5EO5AK24OT6F3TZV7P2TP36EUAY4XQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.318129285 (323h30m33.049396915s) [noise=true , address=104.36.82.11:4145 , piece_id=CUXENUONDG4VTNWJ2W2DV7IIP77YWFJAD5X25TCS2R777YLZOEXA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.320591320 (323h30m33.05185896s) [noise=true , address=77.90.31.10:4530 , piece_id=YNZ2IAHYCMLU7V4DFQGGRBC2HAJ36Z4FDTLAX7B72VBMBMPIINOQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.331756253 (323h30m33.063023883s) [noise=true , address=77.90.31.21:4906 , piece_id=UZY5ZFCBR7NPW4IN5WJPTGKSTVTMQ5IVSWKKVVXT6SN3R2U3FAPQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.332730648 (323h30m33.063998299s) [noise=true , address=104.36.82.9:4022 , piece_id=734PI3KYMOUSZNKRU4BWIEUECEKBZAOHXGL6FSTPCCKP6G6GSNWA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.332762158 (323h30m33.064029817s) [seg_pos={0 0}, upload=336380]: Segment reached optimal threshold of 14 pieces. Aug 22 04:56:52.332957295 (323h30m33.064224944s) [noise=true , address=104.36.82.60:4358 , piece_id=H32BEFSBI42XLRQF7YGVQKQGP63Y7XRECLOZPYLSOX2GBTR4355Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dwCNEcA9o51ZN3UaN3Frxdawwf8DXBj86iQMywjW8XP4ESmw1): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.332992812 (323h30m33.064260442s) [noise=true , address=104.36.82.23:4474 , piece_id=IVROJIBKT3527BBWNO5ZYLGNMZRVFB4AMJK7G7KXWOARKGVGXC7Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333074575 (323h30m33.064342235s) [noise=true , address=79.127.220.98:4415 , piece_id=ZHNY7FSQI2A2WAQ27ZAAUKDJYVHOXN3WY52LWZDYBY46E6WS7CAA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zEwYBHLdtVuQhypaivAt5k2AwMGEDvj4XsCBYHtoau2YXtH8e): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333209800 (323h30m33.06447743s) [noise=true , address=104.36.82.14:4228 , piece_id=ECOK2QCLNBRD7725CU4BFFAO4FUJLIR3CTMY3WZFVHUU77X5G55Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pkADNFaYa2SqFALQdxwf1CfR1ktUwshQkw7iBJzhdhaRYaszF): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333246088 (323h30m33.064513708s) [seg_pos={0 0}, upload=336380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 04:56:52.333351667 (323h30m33.064619298s) [upload=336380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 04:56:52.333357668 (323h30m33.064625298s) [upload=336380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 04:56:52.493730278 (323h30m33.224997929s) [upload=336380]: Done uploading segments... Aug 22 04:56:52.493749815 (323h30m33.225017465s) [upload=336380]: Upload finished. err: <nil> Duration: 1.837188872s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........X...........................................X.....] duration: 114.615322ms FAIL (2025-08-22 05:23:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 05:20:50.097930630 (323h54m30.82919828s) [upload=336808]: Starting upload Aug 22 05:20:50.097998158 (323h54m30.829265817s) [upload=336808]: Done starting upload Aug 22 05:20:50.098070042 (323h54m30.829337702s) [upload=336808]: Uploading segments... Aug 22 05:20:50.098107372 (323h54m30.829375022s) [upload=336808]: Got next segment. Inline: true Aug 22 05:20:50.098112542 (323h54m30.829380192s) [upload=336808]: Waiting for error group managing segments... Aug 22 05:20:50.098165492 (323h54m30.829433153s) [upload=336808]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 05:20:50.098174479 (323h54m30.829442129s) [upload=336808]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 05:20:50.098181131 (323h54m30.829448792s) [upload=336808]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 05:20:50.101149681 (323h54m30.832417331s) [upload=336808]: Done uploading segments... Aug 22 05:20:50.101161142 (323h54m30.832428793s) [upload=336808]: Upload finished. err: metaclient: Too Many Requests Duration:* 114.660879ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 357.208117ms FAIL (2025-08-22 05:23:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 357.223114ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........X...........................................X....] duration: 266.695288ms FAIL (2025-08-22 05:23:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 05:20:50.097930630 (323h54m30.82919828s) [upload=336808]: Starting upload Aug 22 05:20:50.097998158 (323h54m30.829265817s) [upload=336808]: Done starting upload Aug 22 05:20:50.098070042 (323h54m30.829337702s) [upload=336808]: Uploading segments... Aug 22 05:20:50.098107372 (323h54m30.829375022s) [upload=336808]: Got next segment. Inline: true Aug 22 05:20:50.098112542 (323h54m30.829380192s) [upload=336808]: Waiting for error group managing segments... Aug 22 05:20:50.098165492 (323h54m30.829433153s) [upload=336808]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 05:20:50.098174479 (323h54m30.829442129s) [upload=336808]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 05:20:50.098181131 (323h54m30.829448792s) [upload=336808]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 05:20:50.101149681 (323h54m30.832417331s) [upload=336808]: Done uploading segments... Aug 22 05:20:50.101161142 (323h54m30.832428793s) [upload=336808]: Upload finished. err: metaclient: Too Many Requests Duration:* 266.723541ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 466.811402ms FAIL (2025-08-22 05:22:52 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 22 04:56:52.108760398 (323h30m32.840028048s) [upload=336380]: Starting upload Aug 22 04:56:52.108905031 (323h30m32.840172682s) [upload=336380]: Done starting upload Aug 22 04:56:52.109003286 (323h30m32.840270946s) [upload=336380]: Uploading segments... Aug 22 04:56:52.109571796 (323h30m32.840839446s) [upload=336380]: Got next segment. Inline: false Aug 22 04:56:52.109630757 (323h30m32.840898408s) [upload=336380]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 04:56:52.109637339 (323h30m32.84090499s) [upload=336380]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 04:56:52.138484827 (323h30m32.869752477s) [seg_pos={0 0}, upload=336380]: Begin upload segment... Aug 22 04:56:52.138560400 (323h30m32.86982805s) [seg_pos={0 0}, upload=336380]: Done begin upload segment. Aug 22 04:56:52.138612417 (323h30m32.869880068s) [noise=true , address=45.91.116.10:4105 , piece_id=IUETLBNXRVIX5KZU22YM4N4COHYEWA6ANYOZ6OZANRBOX22HXQOA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.139205243 (323h30m32.870472944s) [noise=true , address=104.36.82.6:4892 , piece_id=JYTYGOJJRP3YAIDXDT5G5B5EO5AK24OT6F3TZV7P2TP36EUAY4XQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.139966056 (323h30m32.871233706s) [noise=true , address=104.36.82.50:4044 , piece_id=L3NJHGWUTLWDW26HUHIEQT2HW3A6GKSIZXYHDXK552QVTIFK3DIA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.140478040 (323h30m32.871745691s) [noise=true , address=77.90.31.12:4620 , piece_id=UIFT7PMLVENB3QC3JK63343C2SSTVYJ2ME5HAUZ7UDVAHI5DO52Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.140979465 (323h30m32.872247115s) [noise=true , address=45.91.116.11:4139 , piece_id=XXK64FDZN5ROM2JTYXXCF6DQBFMW4VRZIZT5PK6NGF7YLTOQ3PUA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.141547404 (323h30m32.872815054s) [noise=true , address=104.36.82.5:4851 , piece_id=XHDD77H42NATELJQIKPM2EMBI3WXXXHHEWDXQQJKS64KZJHTLW3A, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.142076150 (323h30m32.8733438s) [noise=true , address=77.90.31.18:4828 , piece_id=HLL25GXOKAZ7HVXV4NNTV6THA6YVXZGHSNMZPKM4XKMAWM52A2SQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.142639109 (323h30m32.87390676s) [noise=true , address=77.90.31.21:4906 , piece_id=UZY5ZFCBR7NPW4IN5WJPTGKSTVTMQ5IVSWKKVVXT6SN3R2U3FAPQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.143077495 (323h30m32.874345145s) [noise=true , address=104.36.82.9:4022 , piece_id=734PI3KYMOUSZNKRU4BWIEUECEKBZAOHXGL6FSTPCCKP6G6GSNWA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.143669991 (323h30m32.874937641s) [noise=true , address=77.90.31.10:4530 , piece_id=YNZ2IAHYCMLU7V4DFQGGRBC2HAJ36Z4FDTLAX7B72VBMBMPIINOQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.145875203 (323h30m32.877142883s) [noise=true , address=104.36.82.14:4243 , piece_id=PBAM3UFTBAJSBOFESCTKSDF4JR36GQB57NG7LL3Z7NGDJ4WDWG7Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.146491584 (323h30m32.877759234s) [noise=true , address=45.91.116.4:4964 , piece_id=CBGK4RIP6G75M4V7RCU3Z2QSRTHGX6HQXQVUXXJQUE3NGPT5IM6A, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.146979211 (323h30m32.878246862s) [noise=true , address=104.36.82.17:4363 , piece_id=CZF7DHCTNXJTL5PDSINBOSBQJAM7433ZAQIKHKNQVZGQPS7242AQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.147736838 (323h30m32.879004488s) [noise=true , address=104.36.82.60:4358 , piece_id=H32BEFSBI42XLRQF7YGVQKQGP63Y7XRECLOZPYLSOX2GBTR4355Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.148627205 (323h30m32.879894855s) [noise=true , address=104.36.82.14:4228 , piece_id=ECOK2QCLNBRD7725CU4BFFAO4FUJLIR3CTMY3WZFVHUU77X5G55Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.149206806 (323h30m32.880474466s) [noise=true , address=104.36.82.23:4474 , piece_id=IVROJIBKT3527BBWNO5ZYLGNMZRVFB4AMJK7G7KXWOARKGVGXC7Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.150129022 (323h30m32.881396673s) [noise=true , address=79.127.220.98:4415 , piece_id=ZHNY7FSQI2A2WAQ27ZAAUKDJYVHOXN3WY52LWZDYBY46E6WS7CAA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.151289868 (323h30m32.882557528s) [noise=true , address=104.36.82.11:4145 , piece_id=CUXENUONDG4VTNWJ2W2DV7IIP77YWFJAD5X25TCS2R777YLZOEXA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.300240501 (323h30m33.031508152s) [upload=336380]: Next returned nil segment Aug 22 04:56:52.300257313 (323h30m33.031524963s) [upload=336380]: Waiting for error group managing segments... Aug 22 04:56:52.311754692 (323h30m33.043022322s) [noise=true , address=45.91.116.4:4964 , piece_id=CBGK4RIP6G75M4V7RCU3Z2QSRTHGX6HQXQVUXXJQUE3NGPT5IM6A, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.312362526 (323h30m33.043630186s) [noise=true , address=77.90.31.18:4828 , piece_id=HLL25GXOKAZ7HVXV4NNTV6THA6YVXZGHSNMZPKM4XKMAWM52A2SQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.312505164 (323h30m33.043772785s) [noise=true , address=45.91.116.10:4105 , piece_id=IUETLBNXRVIX5KZU22YM4N4COHYEWA6ANYOZ6OZANRBOX22HXQOA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.313453540 (323h30m33.044721191s) [noise=true , address=45.91.116.11:4139 , piece_id=XXK64FDZN5ROM2JTYXXCF6DQBFMW4VRZIZT5PK6NGF7YLTOQ3PUA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.314229331 (323h30m33.045496961s) [noise=true , address=104.36.82.14:4243 , piece_id=PBAM3UFTBAJSBOFESCTKSDF4JR36GQB57NG7LL3Z7NGDJ4WDWG7Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.314832257 (323h30m33.046099887s) [noise=true , address=77.90.31.12:4620 , piece_id=UIFT7PMLVENB3QC3JK63343C2SSTVYJ2ME5HAUZ7UDVAHI5DO52Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.315510244 (323h30m33.046777864s) [noise=true , address=104.36.82.5:4851 , piece_id=XHDD77H42NATELJQIKPM2EMBI3WXXXHHEWDXQQJKS64KZJHTLW3A, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.316562384 (323h30m33.047830014s) [noise=true , address=104.36.82.50:4044 , piece_id=L3NJHGWUTLWDW26HUHIEQT2HW3A6GKSIZXYHDXK552QVTIFK3DIA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.316973228 (323h30m33.048240868s) [noise=true , address=104.36.82.17:4363 , piece_id=CZF7DHCTNXJTL5PDSINBOSBQJAM7433ZAQIKHKNQVZGQPS7242AQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.317706238 (323h30m33.048973888s) [noise=true , address=104.36.82.6:4892 , piece_id=JYTYGOJJRP3YAIDXDT5G5B5EO5AK24OT6F3TZV7P2TP36EUAY4XQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.318129285 (323h30m33.049396915s) [noise=true , address=104.36.82.11:4145 , piece_id=CUXENUONDG4VTNWJ2W2DV7IIP77YWFJAD5X25TCS2R777YLZOEXA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.320591320 (323h30m33.05185896s) [noise=true , address=77.90.31.10:4530 , piece_id=YNZ2IAHYCMLU7V4DFQGGRBC2HAJ36Z4FDTLAX7B72VBMBMPIINOQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.331756253 (323h30m33.063023883s) [noise=true , address=77.90.31.21:4906 , piece_id=UZY5ZFCBR7NPW4IN5WJPTGKSTVTMQ5IVSWKKVVXT6SN3R2U3FAPQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.332730648 (323h30m33.063998299s) [noise=true , address=104.36.82.9:4022 , piece_id=734PI3KYMOUSZNKRU4BWIEUECEKBZAOHXGL6FSTPCCKP6G6GSNWA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.332762158 (323h30m33.064029817s) [seg_pos={0 0}, upload=336380]: Segment reached optimal threshold of 14 pieces. Aug 22 04:56:52.332957295 (323h30m33.064224944s) [noise=true , address=104.36.82.60:4358 , piece_id=H32BEFSBI42XLRQF7YGVQKQGP63Y7XRECLOZPYLSOX2GBTR4355Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dwCNEcA9o51ZN3UaN3Frxdawwf8DXBj86iQMywjW8XP4ESmw1): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.332992812 (323h30m33.064260442s) [noise=true , address=104.36.82.23:4474 , piece_id=IVROJIBKT3527BBWNO5ZYLGNMZRVFB4AMJK7G7KXWOARKGVGXC7Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333074575 (323h30m33.064342235s) [noise=true , address=79.127.220.98:4415 , piece_id=ZHNY7FSQI2A2WAQ27ZAAUKDJYVHOXN3WY52LWZDYBY46E6WS7CAA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zEwYBHLdtVuQhypaivAt5k2AwMGEDvj4XsCBYHtoau2YXtH8e): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333209800 (323h30m33.06447743s) [noise=true , address=104.36.82.14:4228 , piece_id=ECOK2QCLNBRD7725CU4BFFAO4FUJLIR3CTMY3WZFVHUU77X5G55Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pkADNFaYa2SqFALQdxwf1CfR1ktUwshQkw7iBJzhdhaRYaszF): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333246088 (323h30m33.064513708s) [seg_pos={0 0}, upload=336380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 04:56:52.333351667 (323h30m33.064619298s) [upload=336380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 04:56:52.333357668 (323h30m33.064625298s) [upload=336380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 04:56:52.493730278 (323h30m33.224997929s) [upload=336380]: Done uploading segments... Aug 22 04:56:52.493749815 (323h30m33.225017465s) [upload=336380]: Upload finished. err: <nil> Duration: 466.827963ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 393.706943ms FAIL (2025-08-22 05:22:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 393.740676ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [............X...........................................X...] duration: 121.538797ms FAIL (2025-08-22 05:22:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 05:20:50.097930630 (323h54m30.82919828s) [upload=336808]: Starting upload Aug 22 05:20:50.097998158 (323h54m30.829265817s) [upload=336808]: Done starting upload Aug 22 05:20:50.098070042 (323h54m30.829337702s) [upload=336808]: Uploading segments... Aug 22 05:20:50.098107372 (323h54m30.829375022s) [upload=336808]: Got next segment. Inline: true Aug 22 05:20:50.098112542 (323h54m30.829380192s) [upload=336808]: Waiting for error group managing segments... Aug 22 05:20:50.098165492 (323h54m30.829433153s) [upload=336808]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 05:20:50.098174479 (323h54m30.829442129s) [upload=336808]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 05:20:50.098181131 (323h54m30.829448792s) [upload=336808]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 05:20:50.101149681 (323h54m30.832417331s) [upload=336808]: Done uploading segments... Aug 22 05:20:50.101161142 (323h54m30.832428793s) [upload=336808]: Upload finished. err: metaclient: Too Many Requests Duration:* 121.562964ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 334.111577ms FAIL (2025-08-22 05:21:53 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 22 04:56:52.108760398 (323h30m32.840028048s) [upload=336380]: Starting upload Aug 22 04:56:52.108905031 (323h30m32.840172682s) [upload=336380]: Done starting upload Aug 22 04:56:52.109003286 (323h30m32.840270946s) [upload=336380]: Uploading segments... Aug 22 04:56:52.109571796 (323h30m32.840839446s) [upload=336380]: Got next segment. Inline: false Aug 22 04:56:52.109630757 (323h30m32.840898408s) [upload=336380]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 04:56:52.109637339 (323h30m32.84090499s) [upload=336380]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 04:56:52.138484827 (323h30m32.869752477s) [seg_pos={0 0}, upload=336380]: Begin upload segment... Aug 22 04:56:52.138560400 (323h30m32.86982805s) [seg_pos={0 0}, upload=336380]: Done begin upload segment. Aug 22 04:56:52.138612417 (323h30m32.869880068s) [noise=true , address=45.91.116.10:4105 , piece_id=IUETLBNXRVIX5KZU22YM4N4COHYEWA6ANYOZ6OZANRBOX22HXQOA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.139205243 (323h30m32.870472944s) [noise=true , address=104.36.82.6:4892 , piece_id=JYTYGOJJRP3YAIDXDT5G5B5EO5AK24OT6F3TZV7P2TP36EUAY4XQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.139966056 (323h30m32.871233706s) [noise=true , address=104.36.82.50:4044 , piece_id=L3NJHGWUTLWDW26HUHIEQT2HW3A6GKSIZXYHDXK552QVTIFK3DIA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.140478040 (323h30m32.871745691s) [noise=true , address=77.90.31.12:4620 , piece_id=UIFT7PMLVENB3QC3JK63343C2SSTVYJ2ME5HAUZ7UDVAHI5DO52Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.140979465 (323h30m32.872247115s) [noise=true , address=45.91.116.11:4139 , piece_id=XXK64FDZN5ROM2JTYXXCF6DQBFMW4VRZIZT5PK6NGF7YLTOQ3PUA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.141547404 (323h30m32.872815054s) [noise=true , address=104.36.82.5:4851 , piece_id=XHDD77H42NATELJQIKPM2EMBI3WXXXHHEWDXQQJKS64KZJHTLW3A, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.142076150 (323h30m32.8733438s) [noise=true , address=77.90.31.18:4828 , piece_id=HLL25GXOKAZ7HVXV4NNTV6THA6YVXZGHSNMZPKM4XKMAWM52A2SQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.142639109 (323h30m32.87390676s) [noise=true , address=77.90.31.21:4906 , piece_id=UZY5ZFCBR7NPW4IN5WJPTGKSTVTMQ5IVSWKKVVXT6SN3R2U3FAPQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.143077495 (323h30m32.874345145s) [noise=true , address=104.36.82.9:4022 , piece_id=734PI3KYMOUSZNKRU4BWIEUECEKBZAOHXGL6FSTPCCKP6G6GSNWA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.143669991 (323h30m32.874937641s) [noise=true , address=77.90.31.10:4530 , piece_id=YNZ2IAHYCMLU7V4DFQGGRBC2HAJ36Z4FDTLAX7B72VBMBMPIINOQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.145875203 (323h30m32.877142883s) [noise=true , address=104.36.82.14:4243 , piece_id=PBAM3UFTBAJSBOFESCTKSDF4JR36GQB57NG7LL3Z7NGDJ4WDWG7Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.146491584 (323h30m32.877759234s) [noise=true , address=45.91.116.4:4964 , piece_id=CBGK4RIP6G75M4V7RCU3Z2QSRTHGX6HQXQVUXXJQUE3NGPT5IM6A, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.146979211 (323h30m32.878246862s) [noise=true , address=104.36.82.17:4363 , piece_id=CZF7DHCTNXJTL5PDSINBOSBQJAM7433ZAQIKHKNQVZGQPS7242AQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.147736838 (323h30m32.879004488s) [noise=true , address=104.36.82.60:4358 , piece_id=H32BEFSBI42XLRQF7YGVQKQGP63Y7XRECLOZPYLSOX2GBTR4355Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.148627205 (323h30m32.879894855s) [noise=true , address=104.36.82.14:4228 , piece_id=ECOK2QCLNBRD7725CU4BFFAO4FUJLIR3CTMY3WZFVHUU77X5G55Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.149206806 (323h30m32.880474466s) [noise=true , address=104.36.82.23:4474 , piece_id=IVROJIBKT3527BBWNO5ZYLGNMZRVFB4AMJK7G7KXWOARKGVGXC7Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.150129022 (323h30m32.881396673s) [noise=true , address=79.127.220.98:4415 , piece_id=ZHNY7FSQI2A2WAQ27ZAAUKDJYVHOXN3WY52LWZDYBY46E6WS7CAA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.151289868 (323h30m32.882557528s) [noise=true , address=104.36.82.11:4145 , piece_id=CUXENUONDG4VTNWJ2W2DV7IIP77YWFJAD5X25TCS2R777YLZOEXA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.300240501 (323h30m33.031508152s) [upload=336380]: Next returned nil segment Aug 22 04:56:52.300257313 (323h30m33.031524963s) [upload=336380]: Waiting for error group managing segments... Aug 22 04:56:52.311754692 (323h30m33.043022322s) [noise=true , address=45.91.116.4:4964 , piece_id=CBGK4RIP6G75M4V7RCU3Z2QSRTHGX6HQXQVUXXJQUE3NGPT5IM6A, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.312362526 (323h30m33.043630186s) [noise=true , address=77.90.31.18:4828 , piece_id=HLL25GXOKAZ7HVXV4NNTV6THA6YVXZGHSNMZPKM4XKMAWM52A2SQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.312505164 (323h30m33.043772785s) [noise=true , address=45.91.116.10:4105 , piece_id=IUETLBNXRVIX5KZU22YM4N4COHYEWA6ANYOZ6OZANRBOX22HXQOA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.313453540 (323h30m33.044721191s) [noise=true , address=45.91.116.11:4139 , piece_id=XXK64FDZN5ROM2JTYXXCF6DQBFMW4VRZIZT5PK6NGF7YLTOQ3PUA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.314229331 (323h30m33.045496961s) [noise=true , address=104.36.82.14:4243 , piece_id=PBAM3UFTBAJSBOFESCTKSDF4JR36GQB57NG7LL3Z7NGDJ4WDWG7Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.314832257 (323h30m33.046099887s) [noise=true , address=77.90.31.12:4620 , piece_id=UIFT7PMLVENB3QC3JK63343C2SSTVYJ2ME5HAUZ7UDVAHI5DO52Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.315510244 (323h30m33.046777864s) [noise=true , address=104.36.82.5:4851 , piece_id=XHDD77H42NATELJQIKPM2EMBI3WXXXHHEWDXQQJKS64KZJHTLW3A, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.316562384 (323h30m33.047830014s) [noise=true , address=104.36.82.50:4044 , piece_id=L3NJHGWUTLWDW26HUHIEQT2HW3A6GKSIZXYHDXK552QVTIFK3DIA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.316973228 (323h30m33.048240868s) [noise=true , address=104.36.82.17:4363 , piece_id=CZF7DHCTNXJTL5PDSINBOSBQJAM7433ZAQIKHKNQVZGQPS7242AQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.317706238 (323h30m33.048973888s) [noise=true , address=104.36.82.6:4892 , piece_id=JYTYGOJJRP3YAIDXDT5G5B5EO5AK24OT6F3TZV7P2TP36EUAY4XQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.318129285 (323h30m33.049396915s) [noise=true , address=104.36.82.11:4145 , piece_id=CUXENUONDG4VTNWJ2W2DV7IIP77YWFJAD5X25TCS2R777YLZOEXA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.320591320 (323h30m33.05185896s) [noise=true , address=77.90.31.10:4530 , piece_id=YNZ2IAHYCMLU7V4DFQGGRBC2HAJ36Z4FDTLAX7B72VBMBMPIINOQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.331756253 (323h30m33.063023883s) [noise=true , address=77.90.31.21:4906 , piece_id=UZY5ZFCBR7NPW4IN5WJPTGKSTVTMQ5IVSWKKVVXT6SN3R2U3FAPQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.332730648 (323h30m33.063998299s) [noise=true , address=104.36.82.9:4022 , piece_id=734PI3KYMOUSZNKRU4BWIEUECEKBZAOHXGL6FSTPCCKP6G6GSNWA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.332762158 (323h30m33.064029817s) [seg_pos={0 0}, upload=336380]: Segment reached optimal threshold of 14 pieces. Aug 22 04:56:52.332957295 (323h30m33.064224944s) [noise=true , address=104.36.82.60:4358 , piece_id=H32BEFSBI42XLRQF7YGVQKQGP63Y7XRECLOZPYLSOX2GBTR4355Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dwCNEcA9o51ZN3UaN3Frxdawwf8DXBj86iQMywjW8XP4ESmw1): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.332992812 (323h30m33.064260442s) [noise=true , address=104.36.82.23:4474 , piece_id=IVROJIBKT3527BBWNO5ZYLGNMZRVFB4AMJK7G7KXWOARKGVGXC7Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333074575 (323h30m33.064342235s) [noise=true , address=79.127.220.98:4415 , piece_id=ZHNY7FSQI2A2WAQ27ZAAUKDJYVHOXN3WY52LWZDYBY46E6WS7CAA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zEwYBHLdtVuQhypaivAt5k2AwMGEDvj4XsCBYHtoau2YXtH8e): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333209800 (323h30m33.06447743s) [noise=true , address=104.36.82.14:4228 , piece_id=ECOK2QCLNBRD7725CU4BFFAO4FUJLIR3CTMY3WZFVHUU77X5G55Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pkADNFaYa2SqFALQdxwf1CfR1ktUwshQkw7iBJzhdhaRYaszF): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333246088 (323h30m33.064513708s) [seg_pos={0 0}, upload=336380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 04:56:52.333351667 (323h30m33.064619298s) [upload=336380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 04:56:52.333357668 (323h30m33.064625298s) [upload=336380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 04:56:52.493730278 (323h30m33.224997929s) [upload=336380]: Done uploading segments... Aug 22 04:56:52.493749815 (323h30m33.225017465s) [upload=336380]: Upload finished. err: <nil> Duration: 334.129382ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............X...........................................X..] duration: 293.456177ms FAIL (2025-08-22 05:21:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 05:20:50.097930630 (323h54m30.82919828s) [upload=336808]: Starting upload Aug 22 05:20:50.097998158 (323h54m30.829265817s) [upload=336808]: Done starting upload Aug 22 05:20:50.098070042 (323h54m30.829337702s) [upload=336808]: Uploading segments... Aug 22 05:20:50.098107372 (323h54m30.829375022s) [upload=336808]: Got next segment. Inline: true Aug 22 05:20:50.098112542 (323h54m30.829380192s) [upload=336808]: Waiting for error group managing segments... Aug 22 05:20:50.098165492 (323h54m30.829433153s) [upload=336808]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 05:20:50.098174479 (323h54m30.829442129s) [upload=336808]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 05:20:50.098181131 (323h54m30.829448792s) [upload=336808]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 05:20:50.101149681 (323h54m30.832417331s) [upload=336808]: Done uploading segments... Aug 22 05:20:50.101161142 (323h54m30.832428793s) [upload=336808]: Upload finished. err: metaclient: Too Many Requests Duration:* 293.480443ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 379.089679ms FAIL (2025-08-22 05:21:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 379.107342ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............X...........................................X.] duration: 406.448854ms FAIL (2025-08-22 05:21:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 05:20:50.097930630 (323h54m30.82919828s) [upload=336808]: Starting upload Aug 22 05:20:50.097998158 (323h54m30.829265817s) [upload=336808]: Done starting upload Aug 22 05:20:50.098070042 (323h54m30.829337702s) [upload=336808]: Uploading segments... Aug 22 05:20:50.098107372 (323h54m30.829375022s) [upload=336808]: Got next segment. Inline: true Aug 22 05:20:50.098112542 (323h54m30.829380192s) [upload=336808]: Waiting for error group managing segments... Aug 22 05:20:50.098165492 (323h54m30.829433153s) [upload=336808]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 05:20:50.098174479 (323h54m30.829442129s) [upload=336808]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 05:20:50.098181131 (323h54m30.829448792s) [upload=336808]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 05:20:50.101149681 (323h54m30.832417331s) [upload=336808]: Done uploading segments... Aug 22 05:20:50.101161142 (323h54m30.832428793s) [upload=336808]: Upload finished. err: metaclient: Too Many Requests Duration:* 406.469763ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 1.844065491s FAIL (2025-08-22 05:21:02 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 22 04:56:52.108760398 (323h30m32.840028048s) [upload=336380]: Starting upload Aug 22 04:56:52.108905031 (323h30m32.840172682s) [upload=336380]: Done starting upload Aug 22 04:56:52.109003286 (323h30m32.840270946s) [upload=336380]: Uploading segments... Aug 22 04:56:52.109571796 (323h30m32.840839446s) [upload=336380]: Got next segment. Inline: false Aug 22 04:56:52.109630757 (323h30m32.840898408s) [upload=336380]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 04:56:52.109637339 (323h30m32.84090499s) [upload=336380]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 04:56:52.138484827 (323h30m32.869752477s) [seg_pos={0 0}, upload=336380]: Begin upload segment... Aug 22 04:56:52.138560400 (323h30m32.86982805s) [seg_pos={0 0}, upload=336380]: Done begin upload segment. Aug 22 04:56:52.138612417 (323h30m32.869880068s) [noise=true , address=45.91.116.10:4105 , piece_id=IUETLBNXRVIX5KZU22YM4N4COHYEWA6ANYOZ6OZANRBOX22HXQOA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.139205243 (323h30m32.870472944s) [noise=true , address=104.36.82.6:4892 , piece_id=JYTYGOJJRP3YAIDXDT5G5B5EO5AK24OT6F3TZV7P2TP36EUAY4XQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.139966056 (323h30m32.871233706s) [noise=true , address=104.36.82.50:4044 , piece_id=L3NJHGWUTLWDW26HUHIEQT2HW3A6GKSIZXYHDXK552QVTIFK3DIA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.140478040 (323h30m32.871745691s) [noise=true , address=77.90.31.12:4620 , piece_id=UIFT7PMLVENB3QC3JK63343C2SSTVYJ2ME5HAUZ7UDVAHI5DO52Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.140979465 (323h30m32.872247115s) [noise=true , address=45.91.116.11:4139 , piece_id=XXK64FDZN5ROM2JTYXXCF6DQBFMW4VRZIZT5PK6NGF7YLTOQ3PUA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.141547404 (323h30m32.872815054s) [noise=true , address=104.36.82.5:4851 , piece_id=XHDD77H42NATELJQIKPM2EMBI3WXXXHHEWDXQQJKS64KZJHTLW3A, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.142076150 (323h30m32.8733438s) [noise=true , address=77.90.31.18:4828 , piece_id=HLL25GXOKAZ7HVXV4NNTV6THA6YVXZGHSNMZPKM4XKMAWM52A2SQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.142639109 (323h30m32.87390676s) [noise=true , address=77.90.31.21:4906 , piece_id=UZY5ZFCBR7NPW4IN5WJPTGKSTVTMQ5IVSWKKVVXT6SN3R2U3FAPQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.143077495 (323h30m32.874345145s) [noise=true , address=104.36.82.9:4022 , piece_id=734PI3KYMOUSZNKRU4BWIEUECEKBZAOHXGL6FSTPCCKP6G6GSNWA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.143669991 (323h30m32.874937641s) [noise=true , address=77.90.31.10:4530 , piece_id=YNZ2IAHYCMLU7V4DFQGGRBC2HAJ36Z4FDTLAX7B72VBMBMPIINOQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.145875203 (323h30m32.877142883s) [noise=true , address=104.36.82.14:4243 , piece_id=PBAM3UFTBAJSBOFESCTKSDF4JR36GQB57NG7LL3Z7NGDJ4WDWG7Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.146491584 (323h30m32.877759234s) [noise=true , address=45.91.116.4:4964 , piece_id=CBGK4RIP6G75M4V7RCU3Z2QSRTHGX6HQXQVUXXJQUE3NGPT5IM6A, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.146979211 (323h30m32.878246862s) [noise=true , address=104.36.82.17:4363 , piece_id=CZF7DHCTNXJTL5PDSINBOSBQJAM7433ZAQIKHKNQVZGQPS7242AQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.147736838 (323h30m32.879004488s) [noise=true , address=104.36.82.60:4358 , piece_id=H32BEFSBI42XLRQF7YGVQKQGP63Y7XRECLOZPYLSOX2GBTR4355Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.148627205 (323h30m32.879894855s) [noise=true , address=104.36.82.14:4228 , piece_id=ECOK2QCLNBRD7725CU4BFFAO4FUJLIR3CTMY3WZFVHUU77X5G55Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.149206806 (323h30m32.880474466s) [noise=true , address=104.36.82.23:4474 , piece_id=IVROJIBKT3527BBWNO5ZYLGNMZRVFB4AMJK7G7KXWOARKGVGXC7Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.150129022 (323h30m32.881396673s) [noise=true , address=79.127.220.98:4415 , piece_id=ZHNY7FSQI2A2WAQ27ZAAUKDJYVHOXN3WY52LWZDYBY46E6WS7CAA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.151289868 (323h30m32.882557528s) [noise=true , address=104.36.82.11:4145 , piece_id=CUXENUONDG4VTNWJ2W2DV7IIP77YWFJAD5X25TCS2R777YLZOEXA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.300240501 (323h30m33.031508152s) [upload=336380]: Next returned nil segment Aug 22 04:56:52.300257313 (323h30m33.031524963s) [upload=336380]: Waiting for error group managing segments... Aug 22 04:56:52.311754692 (323h30m33.043022322s) [noise=true , address=45.91.116.4:4964 , piece_id=CBGK4RIP6G75M4V7RCU3Z2QSRTHGX6HQXQVUXXJQUE3NGPT5IM6A, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.312362526 (323h30m33.043630186s) [noise=true , address=77.90.31.18:4828 , piece_id=HLL25GXOKAZ7HVXV4NNTV6THA6YVXZGHSNMZPKM4XKMAWM52A2SQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.312505164 (323h30m33.043772785s) [noise=true , address=45.91.116.10:4105 , piece_id=IUETLBNXRVIX5KZU22YM4N4COHYEWA6ANYOZ6OZANRBOX22HXQOA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.313453540 (323h30m33.044721191s) [noise=true , address=45.91.116.11:4139 , piece_id=XXK64FDZN5ROM2JTYXXCF6DQBFMW4VRZIZT5PK6NGF7YLTOQ3PUA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.314229331 (323h30m33.045496961s) [noise=true , address=104.36.82.14:4243 , piece_id=PBAM3UFTBAJSBOFESCTKSDF4JR36GQB57NG7LL3Z7NGDJ4WDWG7Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.314832257 (323h30m33.046099887s) [noise=true , address=77.90.31.12:4620 , piece_id=UIFT7PMLVENB3QC3JK63343C2SSTVYJ2ME5HAUZ7UDVAHI5DO52Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.315510244 (323h30m33.046777864s) [noise=true , address=104.36.82.5:4851 , piece_id=XHDD77H42NATELJQIKPM2EMBI3WXXXHHEWDXQQJKS64KZJHTLW3A, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.316562384 (323h30m33.047830014s) [noise=true , address=104.36.82.50:4044 , piece_id=L3NJHGWUTLWDW26HUHIEQT2HW3A6GKSIZXYHDXK552QVTIFK3DIA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.316973228 (323h30m33.048240868s) [noise=true , address=104.36.82.17:4363 , piece_id=CZF7DHCTNXJTL5PDSINBOSBQJAM7433ZAQIKHKNQVZGQPS7242AQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.317706238 (323h30m33.048973888s) [noise=true , address=104.36.82.6:4892 , piece_id=JYTYGOJJRP3YAIDXDT5G5B5EO5AK24OT6F3TZV7P2TP36EUAY4XQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.318129285 (323h30m33.049396915s) [noise=true , address=104.36.82.11:4145 , piece_id=CUXENUONDG4VTNWJ2W2DV7IIP77YWFJAD5X25TCS2R777YLZOEXA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.320591320 (323h30m33.05185896s) [noise=true , address=77.90.31.10:4530 , piece_id=YNZ2IAHYCMLU7V4DFQGGRBC2HAJ36Z4FDTLAX7B72VBMBMPIINOQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.331756253 (323h30m33.063023883s) [noise=true , address=77.90.31.21:4906 , piece_id=UZY5ZFCBR7NPW4IN5WJPTGKSTVTMQ5IVSWKKVVXT6SN3R2U3FAPQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.332730648 (323h30m33.063998299s) [noise=true , address=104.36.82.9:4022 , piece_id=734PI3KYMOUSZNKRU4BWIEUECEKBZAOHXGL6FSTPCCKP6G6GSNWA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.332762158 (323h30m33.064029817s) [seg_pos={0 0}, upload=336380]: Segment reached optimal threshold of 14 pieces. Aug 22 04:56:52.332957295 (323h30m33.064224944s) [noise=true , address=104.36.82.60:4358 , piece_id=H32BEFSBI42XLRQF7YGVQKQGP63Y7XRECLOZPYLSOX2GBTR4355Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dwCNEcA9o51ZN3UaN3Frxdawwf8DXBj86iQMywjW8XP4ESmw1): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.332992812 (323h30m33.064260442s) [noise=true , address=104.36.82.23:4474 , piece_id=IVROJIBKT3527BBWNO5ZYLGNMZRVFB4AMJK7G7KXWOARKGVGXC7Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333074575 (323h30m33.064342235s) [noise=true , address=79.127.220.98:4415 , piece_id=ZHNY7FSQI2A2WAQ27ZAAUKDJYVHOXN3WY52LWZDYBY46E6WS7CAA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zEwYBHLdtVuQhypaivAt5k2AwMGEDvj4XsCBYHtoau2YXtH8e): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333209800 (323h30m33.06447743s) [noise=true , address=104.36.82.14:4228 , piece_id=ECOK2QCLNBRD7725CU4BFFAO4FUJLIR3CTMY3WZFVHUU77X5G55Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pkADNFaYa2SqFALQdxwf1CfR1ktUwshQkw7iBJzhdhaRYaszF): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333246088 (323h30m33.064513708s) [seg_pos={0 0}, upload=336380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 04:56:52.333351667 (323h30m33.064619298s) [upload=336380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 04:56:52.333357668 (323h30m33.064625298s) [upload=336380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 04:56:52.493730278 (323h30m33.224997929s) [upload=336380]: Done uploading segments... Aug 22 04:56:52.493749815 (323h30m33.225017465s) [upload=336380]: Upload finished. err: <nil> Duration: 1.844085768s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...............X...........................................X] duration: 20.641567ms FAIL (2025-08-22 05:20:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 05:20:50.097930630 (323h54m30.82919828s) [upload=336808]: Starting upload Aug 22 05:20:50.097998158 (323h54m30.829265817s) [upload=336808]: Done starting upload Aug 22 05:20:50.098070042 (323h54m30.829337702s) [upload=336808]: Uploading segments... Aug 22 05:20:50.098107372 (323h54m30.829375022s) [upload=336808]: Got next segment. Inline: true Aug 22 05:20:50.098112542 (323h54m30.829380192s) [upload=336808]: Waiting for error group managing segments... Aug 22 05:20:50.098165492 (323h54m30.829433153s) [upload=336808]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 05:20:50.098174479 (323h54m30.829442129s) [upload=336808]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 05:20:50.098181131 (323h54m30.829448792s) [upload=336808]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 05:20:50.101149681 (323h54m30.832417331s) [upload=336808]: Done uploading segments... Aug 22 05:20:50.101161142 (323h54m30.832428793s) [upload=336808]: Upload finished. err: metaclient: Too Many Requests Duration:* 20.661665ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 619.40358ms FAIL (2025-08-22 05:20:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 619.427033ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 447.228117ms FAIL (2025-08-22 05:20:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 22 04:46:40.583386657 (323h20m21.314654308s) [upload=336202]: Starting upload Aug 22 04:46:40.583444356 (323h20m21.314712005s) [upload=336202]: Done starting upload Aug 22 04:46:40.583509328 (323h20m21.314776979s) [upload=336202]: Uploading segments... Aug 22 04:46:40.583573990 (323h20m21.31484166s) [upload=336202]: Got next segment. Inline: true Aug 22 04:46:40.583580282 (323h20m21.314847931s) [upload=336202]: Waiting for error group managing segments... Aug 22 04:46:40.583657377 (323h20m21.314925027s) [upload=336202]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 04:46:40.583663078 (323h20m21.314930728s) [upload=336202]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 04:46:40.583666133 (323h20m21.314933783s) [upload=336202]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 04:46:40.895260936 (323h20m21.626528577s) [upload=336202]: Done uploading segments... Aug 22 04:46:40.895278780 (323h20m21.62654643s) [upload=336202]: Upload finished. err: <nil> Duration:* 447.252613ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 381.94851ms FAIL (2025-08-22 05:20:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 381.983959ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 1.726212645s FAIL (2025-08-22 05:20:06 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 22 04:56:52.108760398 (323h30m32.840028048s) [upload=336380]: Starting upload Aug 22 04:56:52.108905031 (323h30m32.840172682s) [upload=336380]: Done starting upload Aug 22 04:56:52.109003286 (323h30m32.840270946s) [upload=336380]: Uploading segments... Aug 22 04:56:52.109571796 (323h30m32.840839446s) [upload=336380]: Got next segment. Inline: false Aug 22 04:56:52.109630757 (323h30m32.840898408s) [upload=336380]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 04:56:52.109637339 (323h30m32.84090499s) [upload=336380]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 04:56:52.138484827 (323h30m32.869752477s) [seg_pos={0 0}, upload=336380]: Begin upload segment... Aug 22 04:56:52.138560400 (323h30m32.86982805s) [seg_pos={0 0}, upload=336380]: Done begin upload segment. Aug 22 04:56:52.138612417 (323h30m32.869880068s) [noise=true , address=45.91.116.10:4105 , piece_id=IUETLBNXRVIX5KZU22YM4N4COHYEWA6ANYOZ6OZANRBOX22HXQOA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.139205243 (323h30m32.870472944s) [noise=true , address=104.36.82.6:4892 , piece_id=JYTYGOJJRP3YAIDXDT5G5B5EO5AK24OT6F3TZV7P2TP36EUAY4XQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.139966056 (323h30m32.871233706s) [noise=true , address=104.36.82.50:4044 , piece_id=L3NJHGWUTLWDW26HUHIEQT2HW3A6GKSIZXYHDXK552QVTIFK3DIA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.140478040 (323h30m32.871745691s) [noise=true , address=77.90.31.12:4620 , piece_id=UIFT7PMLVENB3QC3JK63343C2SSTVYJ2ME5HAUZ7UDVAHI5DO52Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.140979465 (323h30m32.872247115s) [noise=true , address=45.91.116.11:4139 , piece_id=XXK64FDZN5ROM2JTYXXCF6DQBFMW4VRZIZT5PK6NGF7YLTOQ3PUA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.141547404 (323h30m32.872815054s) [noise=true , address=104.36.82.5:4851 , piece_id=XHDD77H42NATELJQIKPM2EMBI3WXXXHHEWDXQQJKS64KZJHTLW3A, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.142076150 (323h30m32.8733438s) [noise=true , address=77.90.31.18:4828 , piece_id=HLL25GXOKAZ7HVXV4NNTV6THA6YVXZGHSNMZPKM4XKMAWM52A2SQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.142639109 (323h30m32.87390676s) [noise=true , address=77.90.31.21:4906 , piece_id=UZY5ZFCBR7NPW4IN5WJPTGKSTVTMQ5IVSWKKVVXT6SN3R2U3FAPQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.143077495 (323h30m32.874345145s) [noise=true , address=104.36.82.9:4022 , piece_id=734PI3KYMOUSZNKRU4BWIEUECEKBZAOHXGL6FSTPCCKP6G6GSNWA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.143669991 (323h30m32.874937641s) [noise=true , address=77.90.31.10:4530 , piece_id=YNZ2IAHYCMLU7V4DFQGGRBC2HAJ36Z4FDTLAX7B72VBMBMPIINOQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.145875203 (323h30m32.877142883s) [noise=true , address=104.36.82.14:4243 , piece_id=PBAM3UFTBAJSBOFESCTKSDF4JR36GQB57NG7LL3Z7NGDJ4WDWG7Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.146491584 (323h30m32.877759234s) [noise=true , address=45.91.116.4:4964 , piece_id=CBGK4RIP6G75M4V7RCU3Z2QSRTHGX6HQXQVUXXJQUE3NGPT5IM6A, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.146979211 (323h30m32.878246862s) [noise=true , address=104.36.82.17:4363 , piece_id=CZF7DHCTNXJTL5PDSINBOSBQJAM7433ZAQIKHKNQVZGQPS7242AQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.147736838 (323h30m32.879004488s) [noise=true , address=104.36.82.60:4358 , piece_id=H32BEFSBI42XLRQF7YGVQKQGP63Y7XRECLOZPYLSOX2GBTR4355Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.148627205 (323h30m32.879894855s) [noise=true , address=104.36.82.14:4228 , piece_id=ECOK2QCLNBRD7725CU4BFFAO4FUJLIR3CTMY3WZFVHUU77X5G55Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.149206806 (323h30m32.880474466s) [noise=true , address=104.36.82.23:4474 , piece_id=IVROJIBKT3527BBWNO5ZYLGNMZRVFB4AMJK7G7KXWOARKGVGXC7Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.150129022 (323h30m32.881396673s) [noise=true , address=79.127.220.98:4415 , piece_id=ZHNY7FSQI2A2WAQ27ZAAUKDJYVHOXN3WY52LWZDYBY46E6WS7CAA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.151289868 (323h30m32.882557528s) [noise=true , address=104.36.82.11:4145 , piece_id=CUXENUONDG4VTNWJ2W2DV7IIP77YWFJAD5X25TCS2R777YLZOEXA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.300240501 (323h30m33.031508152s) [upload=336380]: Next returned nil segment Aug 22 04:56:52.300257313 (323h30m33.031524963s) [upload=336380]: Waiting for error group managing segments... Aug 22 04:56:52.311754692 (323h30m33.043022322s) [noise=true , address=45.91.116.4:4964 , piece_id=CBGK4RIP6G75M4V7RCU3Z2QSRTHGX6HQXQVUXXJQUE3NGPT5IM6A, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.312362526 (323h30m33.043630186s) [noise=true , address=77.90.31.18:4828 , piece_id=HLL25GXOKAZ7HVXV4NNTV6THA6YVXZGHSNMZPKM4XKMAWM52A2SQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.312505164 (323h30m33.043772785s) [noise=true , address=45.91.116.10:4105 , piece_id=IUETLBNXRVIX5KZU22YM4N4COHYEWA6ANYOZ6OZANRBOX22HXQOA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.313453540 (323h30m33.044721191s) [noise=true , address=45.91.116.11:4139 , piece_id=XXK64FDZN5ROM2JTYXXCF6DQBFMW4VRZIZT5PK6NGF7YLTOQ3PUA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.314229331 (323h30m33.045496961s) [noise=true , address=104.36.82.14:4243 , piece_id=PBAM3UFTBAJSBOFESCTKSDF4JR36GQB57NG7LL3Z7NGDJ4WDWG7Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.314832257 (323h30m33.046099887s) [noise=true , address=77.90.31.12:4620 , piece_id=UIFT7PMLVENB3QC3JK63343C2SSTVYJ2ME5HAUZ7UDVAHI5DO52Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.315510244 (323h30m33.046777864s) [noise=true , address=104.36.82.5:4851 , piece_id=XHDD77H42NATELJQIKPM2EMBI3WXXXHHEWDXQQJKS64KZJHTLW3A, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.316562384 (323h30m33.047830014s) [noise=true , address=104.36.82.50:4044 , piece_id=L3NJHGWUTLWDW26HUHIEQT2HW3A6GKSIZXYHDXK552QVTIFK3DIA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.316973228 (323h30m33.048240868s) [noise=true , address=104.36.82.17:4363 , piece_id=CZF7DHCTNXJTL5PDSINBOSBQJAM7433ZAQIKHKNQVZGQPS7242AQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.317706238 (323h30m33.048973888s) [noise=true , address=104.36.82.6:4892 , piece_id=JYTYGOJJRP3YAIDXDT5G5B5EO5AK24OT6F3TZV7P2TP36EUAY4XQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.318129285 (323h30m33.049396915s) [noise=true , address=104.36.82.11:4145 , piece_id=CUXENUONDG4VTNWJ2W2DV7IIP77YWFJAD5X25TCS2R777YLZOEXA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.320591320 (323h30m33.05185896s) [noise=true , address=77.90.31.10:4530 , piece_id=YNZ2IAHYCMLU7V4DFQGGRBC2HAJ36Z4FDTLAX7B72VBMBMPIINOQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.331756253 (323h30m33.063023883s) [noise=true , address=77.90.31.21:4906 , piece_id=UZY5ZFCBR7NPW4IN5WJPTGKSTVTMQ5IVSWKKVVXT6SN3R2U3FAPQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.332730648 (323h30m33.063998299s) [noise=true , address=104.36.82.9:4022 , piece_id=734PI3KYMOUSZNKRU4BWIEUECEKBZAOHXGL6FSTPCCKP6G6GSNWA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.332762158 (323h30m33.064029817s) [seg_pos={0 0}, upload=336380]: Segment reached optimal threshold of 14 pieces. Aug 22 04:56:52.332957295 (323h30m33.064224944s) [noise=true , address=104.36.82.60:4358 , piece_id=H32BEFSBI42XLRQF7YGVQKQGP63Y7XRECLOZPYLSOX2GBTR4355Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dwCNEcA9o51ZN3UaN3Frxdawwf8DXBj86iQMywjW8XP4ESmw1): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.332992812 (323h30m33.064260442s) [noise=true , address=104.36.82.23:4474 , piece_id=IVROJIBKT3527BBWNO5ZYLGNMZRVFB4AMJK7G7KXWOARKGVGXC7Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333074575 (323h30m33.064342235s) [noise=true , address=79.127.220.98:4415 , piece_id=ZHNY7FSQI2A2WAQ27ZAAUKDJYVHOXN3WY52LWZDYBY46E6WS7CAA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zEwYBHLdtVuQhypaivAt5k2AwMGEDvj4XsCBYHtoau2YXtH8e): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333209800 (323h30m33.06447743s) [noise=true , address=104.36.82.14:4228 , piece_id=ECOK2QCLNBRD7725CU4BFFAO4FUJLIR3CTMY3WZFVHUU77X5G55Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pkADNFaYa2SqFALQdxwf1CfR1ktUwshQkw7iBJzhdhaRYaszF): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333246088 (323h30m33.064513708s) [seg_pos={0 0}, upload=336380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 04:56:52.333351667 (323h30m33.064619298s) [upload=336380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 04:56:52.333357668 (323h30m33.064625298s) [upload=336380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 04:56:52.493730278 (323h30m33.224997929s) [upload=336380]: Done uploading segments... Aug 22 04:56:52.493749815 (323h30m33.225017465s) [upload=336380]: Upload finished. err: <nil> Duration: 1.726230669s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 493.59929ms FAIL (2025-08-22 05:19:38 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 22 04:56:52.108760398 (323h30m32.840028048s) [upload=336380]: Starting upload Aug 22 04:56:52.108905031 (323h30m32.840172682s) [upload=336380]: Done starting upload Aug 22 04:56:52.109003286 (323h30m32.840270946s) [upload=336380]: Uploading segments... Aug 22 04:56:52.109571796 (323h30m32.840839446s) [upload=336380]: Got next segment. Inline: false Aug 22 04:56:52.109630757 (323h30m32.840898408s) [upload=336380]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 04:56:52.109637339 (323h30m32.84090499s) [upload=336380]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 04:56:52.138484827 (323h30m32.869752477s) [seg_pos={0 0}, upload=336380]: Begin upload segment... Aug 22 04:56:52.138560400 (323h30m32.86982805s) [seg_pos={0 0}, upload=336380]: Done begin upload segment. Aug 22 04:56:52.138612417 (323h30m32.869880068s) [noise=true , address=45.91.116.10:4105 , piece_id=IUETLBNXRVIX5KZU22YM4N4COHYEWA6ANYOZ6OZANRBOX22HXQOA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.139205243 (323h30m32.870472944s) [noise=true , address=104.36.82.6:4892 , piece_id=JYTYGOJJRP3YAIDXDT5G5B5EO5AK24OT6F3TZV7P2TP36EUAY4XQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.139966056 (323h30m32.871233706s) [noise=true , address=104.36.82.50:4044 , piece_id=L3NJHGWUTLWDW26HUHIEQT2HW3A6GKSIZXYHDXK552QVTIFK3DIA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.140478040 (323h30m32.871745691s) [noise=true , address=77.90.31.12:4620 , piece_id=UIFT7PMLVENB3QC3JK63343C2SSTVYJ2ME5HAUZ7UDVAHI5DO52Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.140979465 (323h30m32.872247115s) [noise=true , address=45.91.116.11:4139 , piece_id=XXK64FDZN5ROM2JTYXXCF6DQBFMW4VRZIZT5PK6NGF7YLTOQ3PUA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.141547404 (323h30m32.872815054s) [noise=true , address=104.36.82.5:4851 , piece_id=XHDD77H42NATELJQIKPM2EMBI3WXXXHHEWDXQQJKS64KZJHTLW3A, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.142076150 (323h30m32.8733438s) [noise=true , address=77.90.31.18:4828 , piece_id=HLL25GXOKAZ7HVXV4NNTV6THA6YVXZGHSNMZPKM4XKMAWM52A2SQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.142639109 (323h30m32.87390676s) [noise=true , address=77.90.31.21:4906 , piece_id=UZY5ZFCBR7NPW4IN5WJPTGKSTVTMQ5IVSWKKVVXT6SN3R2U3FAPQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.143077495 (323h30m32.874345145s) [noise=true , address=104.36.82.9:4022 , piece_id=734PI3KYMOUSZNKRU4BWIEUECEKBZAOHXGL6FSTPCCKP6G6GSNWA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.143669991 (323h30m32.874937641s) [noise=true , address=77.90.31.10:4530 , piece_id=YNZ2IAHYCMLU7V4DFQGGRBC2HAJ36Z4FDTLAX7B72VBMBMPIINOQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.145875203 (323h30m32.877142883s) [noise=true , address=104.36.82.14:4243 , piece_id=PBAM3UFTBAJSBOFESCTKSDF4JR36GQB57NG7LL3Z7NGDJ4WDWG7Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.146491584 (323h30m32.877759234s) [noise=true , address=45.91.116.4:4964 , piece_id=CBGK4RIP6G75M4V7RCU3Z2QSRTHGX6HQXQVUXXJQUE3NGPT5IM6A, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.146979211 (323h30m32.878246862s) [noise=true , address=104.36.82.17:4363 , piece_id=CZF7DHCTNXJTL5PDSINBOSBQJAM7433ZAQIKHKNQVZGQPS7242AQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.147736838 (323h30m32.879004488s) [noise=true , address=104.36.82.60:4358 , piece_id=H32BEFSBI42XLRQF7YGVQKQGP63Y7XRECLOZPYLSOX2GBTR4355Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.148627205 (323h30m32.879894855s) [noise=true , address=104.36.82.14:4228 , piece_id=ECOK2QCLNBRD7725CU4BFFAO4FUJLIR3CTMY3WZFVHUU77X5G55Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.149206806 (323h30m32.880474466s) [noise=true , address=104.36.82.23:4474 , piece_id=IVROJIBKT3527BBWNO5ZYLGNMZRVFB4AMJK7G7KXWOARKGVGXC7Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.150129022 (323h30m32.881396673s) [noise=true , address=79.127.220.98:4415 , piece_id=ZHNY7FSQI2A2WAQ27ZAAUKDJYVHOXN3WY52LWZDYBY46E6WS7CAA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.151289868 (323h30m32.882557528s) [noise=true , address=104.36.82.11:4145 , piece_id=CUXENUONDG4VTNWJ2W2DV7IIP77YWFJAD5X25TCS2R777YLZOEXA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.300240501 (323h30m33.031508152s) [upload=336380]: Next returned nil segment Aug 22 04:56:52.300257313 (323h30m33.031524963s) [upload=336380]: Waiting for error group managing segments... Aug 22 04:56:52.311754692 (323h30m33.043022322s) [noise=true , address=45.91.116.4:4964 , piece_id=CBGK4RIP6G75M4V7RCU3Z2QSRTHGX6HQXQVUXXJQUE3NGPT5IM6A, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.312362526 (323h30m33.043630186s) [noise=true , address=77.90.31.18:4828 , piece_id=HLL25GXOKAZ7HVXV4NNTV6THA6YVXZGHSNMZPKM4XKMAWM52A2SQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.312505164 (323h30m33.043772785s) [noise=true , address=45.91.116.10:4105 , piece_id=IUETLBNXRVIX5KZU22YM4N4COHYEWA6ANYOZ6OZANRBOX22HXQOA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.313453540 (323h30m33.044721191s) [noise=true , address=45.91.116.11:4139 , piece_id=XXK64FDZN5ROM2JTYXXCF6DQBFMW4VRZIZT5PK6NGF7YLTOQ3PUA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.314229331 (323h30m33.045496961s) [noise=true , address=104.36.82.14:4243 , piece_id=PBAM3UFTBAJSBOFESCTKSDF4JR36GQB57NG7LL3Z7NGDJ4WDWG7Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.314832257 (323h30m33.046099887s) [noise=true , address=77.90.31.12:4620 , piece_id=UIFT7PMLVENB3QC3JK63343C2SSTVYJ2ME5HAUZ7UDVAHI5DO52Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.315510244 (323h30m33.046777864s) [noise=true , address=104.36.82.5:4851 , piece_id=XHDD77H42NATELJQIKPM2EMBI3WXXXHHEWDXQQJKS64KZJHTLW3A, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.316562384 (323h30m33.047830014s) [noise=true , address=104.36.82.50:4044 , piece_id=L3NJHGWUTLWDW26HUHIEQT2HW3A6GKSIZXYHDXK552QVTIFK3DIA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.316973228 (323h30m33.048240868s) [noise=true , address=104.36.82.17:4363 , piece_id=CZF7DHCTNXJTL5PDSINBOSBQJAM7433ZAQIKHKNQVZGQPS7242AQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.317706238 (323h30m33.048973888s) [noise=true , address=104.36.82.6:4892 , piece_id=JYTYGOJJRP3YAIDXDT5G5B5EO5AK24OT6F3TZV7P2TP36EUAY4XQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.318129285 (323h30m33.049396915s) [noise=true , address=104.36.82.11:4145 , piece_id=CUXENUONDG4VTNWJ2W2DV7IIP77YWFJAD5X25TCS2R777YLZOEXA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.320591320 (323h30m33.05185896s) [noise=true , address=77.90.31.10:4530 , piece_id=YNZ2IAHYCMLU7V4DFQGGRBC2HAJ36Z4FDTLAX7B72VBMBMPIINOQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.331756253 (323h30m33.063023883s) [noise=true , address=77.90.31.21:4906 , piece_id=UZY5ZFCBR7NPW4IN5WJPTGKSTVTMQ5IVSWKKVVXT6SN3R2U3FAPQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.332730648 (323h30m33.063998299s) [noise=true , address=104.36.82.9:4022 , piece_id=734PI3KYMOUSZNKRU4BWIEUECEKBZAOHXGL6FSTPCCKP6G6GSNWA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.332762158 (323h30m33.064029817s) [seg_pos={0 0}, upload=336380]: Segment reached optimal threshold of 14 pieces. Aug 22 04:56:52.332957295 (323h30m33.064224944s) [noise=true , address=104.36.82.60:4358 , piece_id=H32BEFSBI42XLRQF7YGVQKQGP63Y7XRECLOZPYLSOX2GBTR4355Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dwCNEcA9o51ZN3UaN3Frxdawwf8DXBj86iQMywjW8XP4ESmw1): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.332992812 (323h30m33.064260442s) [noise=true , address=104.36.82.23:4474 , piece_id=IVROJIBKT3527BBWNO5ZYLGNMZRVFB4AMJK7G7KXWOARKGVGXC7Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333074575 (323h30m33.064342235s) [noise=true , address=79.127.220.98:4415 , piece_id=ZHNY7FSQI2A2WAQ27ZAAUKDJYVHOXN3WY52LWZDYBY46E6WS7CAA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zEwYBHLdtVuQhypaivAt5k2AwMGEDvj4XsCBYHtoau2YXtH8e): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333209800 (323h30m33.06447743s) [noise=true , address=104.36.82.14:4228 , piece_id=ECOK2QCLNBRD7725CU4BFFAO4FUJLIR3CTMY3WZFVHUU77X5G55Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pkADNFaYa2SqFALQdxwf1CfR1ktUwshQkw7iBJzhdhaRYaszF): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333246088 (323h30m33.064513708s) [seg_pos={0 0}, upload=336380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 04:56:52.333351667 (323h30m33.064619298s) [upload=336380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 04:56:52.333357668 (323h30m33.064625298s) [upload=336380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 04:56:52.493730278 (323h30m33.224997929s) [upload=336380]: Done uploading segments... Aug 22 04:56:52.493749815 (323h30m33.225017465s) [upload=336380]: Upload finished. err: <nil> Duration: 493.622785ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 259.390444ms FAIL (2025-08-22 05:19:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 22 04:46:40.583386657 (323h20m21.314654308s) [upload=336202]: Starting upload Aug 22 04:46:40.583444356 (323h20m21.314712005s) [upload=336202]: Done starting upload Aug 22 04:46:40.583509328 (323h20m21.314776979s) [upload=336202]: Uploading segments... Aug 22 04:46:40.583573990 (323h20m21.31484166s) [upload=336202]: Got next segment. Inline: true Aug 22 04:46:40.583580282 (323h20m21.314847931s) [upload=336202]: Waiting for error group managing segments... Aug 22 04:46:40.583657377 (323h20m21.314925027s) [upload=336202]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 04:46:40.583663078 (323h20m21.314930728s) [upload=336202]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 04:46:40.583666133 (323h20m21.314933783s) [upload=336202]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 04:46:40.895260936 (323h20m21.626528577s) [upload=336202]: Done uploading segments... Aug 22 04:46:40.895278780 (323h20m21.62654643s) [upload=336202]: Upload finished. err: <nil> Duration:* 259.404089ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 520.037963ms FAIL (2025-08-22 05:19:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 520.05696ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 136.022459ms FAIL (2025-08-22 05:18:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 22 04:46:40.583386657 (323h20m21.314654308s) [upload=336202]: Starting upload Aug 22 04:46:40.583444356 (323h20m21.314712005s) [upload=336202]: Done starting upload Aug 22 04:46:40.583509328 (323h20m21.314776979s) [upload=336202]: Uploading segments... Aug 22 04:46:40.583573990 (323h20m21.31484166s) [upload=336202]: Got next segment. Inline: true Aug 22 04:46:40.583580282 (323h20m21.314847931s) [upload=336202]: Waiting for error group managing segments... Aug 22 04:46:40.583657377 (323h20m21.314925027s) [upload=336202]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 04:46:40.583663078 (323h20m21.314930728s) [upload=336202]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 04:46:40.583666133 (323h20m21.314933783s) [upload=336202]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 04:46:40.895260936 (323h20m21.626528577s) [upload=336202]: Done uploading segments... Aug 22 04:46:40.895278780 (323h20m21.62654643s) [upload=336202]: Upload finished. err: <nil> Duration:* 136.052427ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 499.56935ms FAIL (2025-08-22 05:18:31 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 499.58961ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 507.129285ms FAIL (2025-08-22 05:18:26 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 22 04:56:52.108760398 (323h30m32.840028048s) [upload=336380]: Starting upload Aug 22 04:56:52.108905031 (323h30m32.840172682s) [upload=336380]: Done starting upload Aug 22 04:56:52.109003286 (323h30m32.840270946s) [upload=336380]: Uploading segments... Aug 22 04:56:52.109571796 (323h30m32.840839446s) [upload=336380]: Got next segment. Inline: false Aug 22 04:56:52.109630757 (323h30m32.840898408s) [upload=336380]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 04:56:52.109637339 (323h30m32.84090499s) [upload=336380]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 04:56:52.138484827 (323h30m32.869752477s) [seg_pos={0 0}, upload=336380]: Begin upload segment... Aug 22 04:56:52.138560400 (323h30m32.86982805s) [seg_pos={0 0}, upload=336380]: Done begin upload segment. Aug 22 04:56:52.138612417 (323h30m32.869880068s) [noise=true , address=45.91.116.10:4105 , piece_id=IUETLBNXRVIX5KZU22YM4N4COHYEWA6ANYOZ6OZANRBOX22HXQOA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.139205243 (323h30m32.870472944s) [noise=true , address=104.36.82.6:4892 , piece_id=JYTYGOJJRP3YAIDXDT5G5B5EO5AK24OT6F3TZV7P2TP36EUAY4XQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.139966056 (323h30m32.871233706s) [noise=true , address=104.36.82.50:4044 , piece_id=L3NJHGWUTLWDW26HUHIEQT2HW3A6GKSIZXYHDXK552QVTIFK3DIA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.140478040 (323h30m32.871745691s) [noise=true , address=77.90.31.12:4620 , piece_id=UIFT7PMLVENB3QC3JK63343C2SSTVYJ2ME5HAUZ7UDVAHI5DO52Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.140979465 (323h30m32.872247115s) [noise=true , address=45.91.116.11:4139 , piece_id=XXK64FDZN5ROM2JTYXXCF6DQBFMW4VRZIZT5PK6NGF7YLTOQ3PUA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.141547404 (323h30m32.872815054s) [noise=true , address=104.36.82.5:4851 , piece_id=XHDD77H42NATELJQIKPM2EMBI3WXXXHHEWDXQQJKS64KZJHTLW3A, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.142076150 (323h30m32.8733438s) [noise=true , address=77.90.31.18:4828 , piece_id=HLL25GXOKAZ7HVXV4NNTV6THA6YVXZGHSNMZPKM4XKMAWM52A2SQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.142639109 (323h30m32.87390676s) [noise=true , address=77.90.31.21:4906 , piece_id=UZY5ZFCBR7NPW4IN5WJPTGKSTVTMQ5IVSWKKVVXT6SN3R2U3FAPQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.143077495 (323h30m32.874345145s) [noise=true , address=104.36.82.9:4022 , piece_id=734PI3KYMOUSZNKRU4BWIEUECEKBZAOHXGL6FSTPCCKP6G6GSNWA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.143669991 (323h30m32.874937641s) [noise=true , address=77.90.31.10:4530 , piece_id=YNZ2IAHYCMLU7V4DFQGGRBC2HAJ36Z4FDTLAX7B72VBMBMPIINOQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.145875203 (323h30m32.877142883s) [noise=true , address=104.36.82.14:4243 , piece_id=PBAM3UFTBAJSBOFESCTKSDF4JR36GQB57NG7LL3Z7NGDJ4WDWG7Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.146491584 (323h30m32.877759234s) [noise=true , address=45.91.116.4:4964 , piece_id=CBGK4RIP6G75M4V7RCU3Z2QSRTHGX6HQXQVUXXJQUE3NGPT5IM6A, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.146979211 (323h30m32.878246862s) [noise=true , address=104.36.82.17:4363 , piece_id=CZF7DHCTNXJTL5PDSINBOSBQJAM7433ZAQIKHKNQVZGQPS7242AQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.147736838 (323h30m32.879004488s) [noise=true , address=104.36.82.60:4358 , piece_id=H32BEFSBI42XLRQF7YGVQKQGP63Y7XRECLOZPYLSOX2GBTR4355Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.148627205 (323h30m32.879894855s) [noise=true , address=104.36.82.14:4228 , piece_id=ECOK2QCLNBRD7725CU4BFFAO4FUJLIR3CTMY3WZFVHUU77X5G55Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.149206806 (323h30m32.880474466s) [noise=true , address=104.36.82.23:4474 , piece_id=IVROJIBKT3527BBWNO5ZYLGNMZRVFB4AMJK7G7KXWOARKGVGXC7Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.150129022 (323h30m32.881396673s) [noise=true , address=79.127.220.98:4415 , piece_id=ZHNY7FSQI2A2WAQ27ZAAUKDJYVHOXN3WY52LWZDYBY46E6WS7CAA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.151289868 (323h30m32.882557528s) [noise=true , address=104.36.82.11:4145 , piece_id=CUXENUONDG4VTNWJ2W2DV7IIP77YWFJAD5X25TCS2R777YLZOEXA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.300240501 (323h30m33.031508152s) [upload=336380]: Next returned nil segment Aug 22 04:56:52.300257313 (323h30m33.031524963s) [upload=336380]: Waiting for error group managing segments... Aug 22 04:56:52.311754692 (323h30m33.043022322s) [noise=true , address=45.91.116.4:4964 , piece_id=CBGK4RIP6G75M4V7RCU3Z2QSRTHGX6HQXQVUXXJQUE3NGPT5IM6A, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.312362526 (323h30m33.043630186s) [noise=true , address=77.90.31.18:4828 , piece_id=HLL25GXOKAZ7HVXV4NNTV6THA6YVXZGHSNMZPKM4XKMAWM52A2SQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.312505164 (323h30m33.043772785s) [noise=true , address=45.91.116.10:4105 , piece_id=IUETLBNXRVIX5KZU22YM4N4COHYEWA6ANYOZ6OZANRBOX22HXQOA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.313453540 (323h30m33.044721191s) [noise=true , address=45.91.116.11:4139 , piece_id=XXK64FDZN5ROM2JTYXXCF6DQBFMW4VRZIZT5PK6NGF7YLTOQ3PUA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.314229331 (323h30m33.045496961s) [noise=true , address=104.36.82.14:4243 , piece_id=PBAM3UFTBAJSBOFESCTKSDF4JR36GQB57NG7LL3Z7NGDJ4WDWG7Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.314832257 (323h30m33.046099887s) [noise=true , address=77.90.31.12:4620 , piece_id=UIFT7PMLVENB3QC3JK63343C2SSTVYJ2ME5HAUZ7UDVAHI5DO52Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.315510244 (323h30m33.046777864s) [noise=true , address=104.36.82.5:4851 , piece_id=XHDD77H42NATELJQIKPM2EMBI3WXXXHHEWDXQQJKS64KZJHTLW3A, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.316562384 (323h30m33.047830014s) [noise=true , address=104.36.82.50:4044 , piece_id=L3NJHGWUTLWDW26HUHIEQT2HW3A6GKSIZXYHDXK552QVTIFK3DIA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.316973228 (323h30m33.048240868s) [noise=true , address=104.36.82.17:4363 , piece_id=CZF7DHCTNXJTL5PDSINBOSBQJAM7433ZAQIKHKNQVZGQPS7242AQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.317706238 (323h30m33.048973888s) [noise=true , address=104.36.82.6:4892 , piece_id=JYTYGOJJRP3YAIDXDT5G5B5EO5AK24OT6F3TZV7P2TP36EUAY4XQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.318129285 (323h30m33.049396915s) [noise=true , address=104.36.82.11:4145 , piece_id=CUXENUONDG4VTNWJ2W2DV7IIP77YWFJAD5X25TCS2R777YLZOEXA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.320591320 (323h30m33.05185896s) [noise=true , address=77.90.31.10:4530 , piece_id=YNZ2IAHYCMLU7V4DFQGGRBC2HAJ36Z4FDTLAX7B72VBMBMPIINOQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.331756253 (323h30m33.063023883s) [noise=true , address=77.90.31.21:4906 , piece_id=UZY5ZFCBR7NPW4IN5WJPTGKSTVTMQ5IVSWKKVVXT6SN3R2U3FAPQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.332730648 (323h30m33.063998299s) [noise=true , address=104.36.82.9:4022 , piece_id=734PI3KYMOUSZNKRU4BWIEUECEKBZAOHXGL6FSTPCCKP6G6GSNWA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.332762158 (323h30m33.064029817s) [seg_pos={0 0}, upload=336380]: Segment reached optimal threshold of 14 pieces. Aug 22 04:56:52.332957295 (323h30m33.064224944s) [noise=true , address=104.36.82.60:4358 , piece_id=H32BEFSBI42XLRQF7YGVQKQGP63Y7XRECLOZPYLSOX2GBTR4355Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dwCNEcA9o51ZN3UaN3Frxdawwf8DXBj86iQMywjW8XP4ESmw1): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.332992812 (323h30m33.064260442s) [noise=true , address=104.36.82.23:4474 , piece_id=IVROJIBKT3527BBWNO5ZYLGNMZRVFB4AMJK7G7KXWOARKGVGXC7Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333074575 (323h30m33.064342235s) [noise=true , address=79.127.220.98:4415 , piece_id=ZHNY7FSQI2A2WAQ27ZAAUKDJYVHOXN3WY52LWZDYBY46E6WS7CAA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zEwYBHLdtVuQhypaivAt5k2AwMGEDvj4XsCBYHtoau2YXtH8e): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333209800 (323h30m33.06447743s) [noise=true , address=104.36.82.14:4228 , piece_id=ECOK2QCLNBRD7725CU4BFFAO4FUJLIR3CTMY3WZFVHUU77X5G55Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pkADNFaYa2SqFALQdxwf1CfR1ktUwshQkw7iBJzhdhaRYaszF): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333246088 (323h30m33.064513708s) [seg_pos={0 0}, upload=336380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 04:56:52.333351667 (323h30m33.064619298s) [upload=336380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 04:56:52.333357668 (323h30m33.064625298s) [upload=336380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 04:56:52.493730278 (323h30m33.224997929s) [upload=336380]: Done uploading segments... Aug 22 04:56:52.493749815 (323h30m33.225017465s) [upload=336380]: Upload finished. err: <nil> Duration: 507.148642ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 458.827889ms FAIL (2025-08-22 05:18:08 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 458.860181ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 946.761263ms FAIL (2025-08-22 05:17:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 946.781112ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 130.525299ms FAIL (2025-08-22 05:17:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 22 04:46:40.583386657 (323h20m21.314654308s) [upload=336202]: Starting upload Aug 22 04:46:40.583444356 (323h20m21.314712005s) [upload=336202]: Done starting upload Aug 22 04:46:40.583509328 (323h20m21.314776979s) [upload=336202]: Uploading segments... Aug 22 04:46:40.583573990 (323h20m21.31484166s) [upload=336202]: Got next segment. Inline: true Aug 22 04:46:40.583580282 (323h20m21.314847931s) [upload=336202]: Waiting for error group managing segments... Aug 22 04:46:40.583657377 (323h20m21.314925027s) [upload=336202]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 04:46:40.583663078 (323h20m21.314930728s) [upload=336202]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 04:46:40.583666133 (323h20m21.314933783s) [upload=336202]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 04:46:40.895260936 (323h20m21.626528577s) [upload=336202]: Done uploading segments... Aug 22 04:46:40.895278780 (323h20m21.62654643s) [upload=336202]: Upload finished. err: <nil> Duration:* 130.556249ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 1.09990516s FAIL (2025-08-22 05:17:24 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 22 04:56:52.108760398 (323h30m32.840028048s) [upload=336380]: Starting upload Aug 22 04:56:52.108905031 (323h30m32.840172682s) [upload=336380]: Done starting upload Aug 22 04:56:52.109003286 (323h30m32.840270946s) [upload=336380]: Uploading segments... Aug 22 04:56:52.109571796 (323h30m32.840839446s) [upload=336380]: Got next segment. Inline: false Aug 22 04:56:52.109630757 (323h30m32.840898408s) [upload=336380]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 04:56:52.109637339 (323h30m32.84090499s) [upload=336380]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 04:56:52.138484827 (323h30m32.869752477s) [seg_pos={0 0}, upload=336380]: Begin upload segment... Aug 22 04:56:52.138560400 (323h30m32.86982805s) [seg_pos={0 0}, upload=336380]: Done begin upload segment. Aug 22 04:56:52.138612417 (323h30m32.869880068s) [noise=true , address=45.91.116.10:4105 , piece_id=IUETLBNXRVIX5KZU22YM4N4COHYEWA6ANYOZ6OZANRBOX22HXQOA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.139205243 (323h30m32.870472944s) [noise=true , address=104.36.82.6:4892 , piece_id=JYTYGOJJRP3YAIDXDT5G5B5EO5AK24OT6F3TZV7P2TP36EUAY4XQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.139966056 (323h30m32.871233706s) [noise=true , address=104.36.82.50:4044 , piece_id=L3NJHGWUTLWDW26HUHIEQT2HW3A6GKSIZXYHDXK552QVTIFK3DIA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.140478040 (323h30m32.871745691s) [noise=true , address=77.90.31.12:4620 , piece_id=UIFT7PMLVENB3QC3JK63343C2SSTVYJ2ME5HAUZ7UDVAHI5DO52Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.140979465 (323h30m32.872247115s) [noise=true , address=45.91.116.11:4139 , piece_id=XXK64FDZN5ROM2JTYXXCF6DQBFMW4VRZIZT5PK6NGF7YLTOQ3PUA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.141547404 (323h30m32.872815054s) [noise=true , address=104.36.82.5:4851 , piece_id=XHDD77H42NATELJQIKPM2EMBI3WXXXHHEWDXQQJKS64KZJHTLW3A, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.142076150 (323h30m32.8733438s) [noise=true , address=77.90.31.18:4828 , piece_id=HLL25GXOKAZ7HVXV4NNTV6THA6YVXZGHSNMZPKM4XKMAWM52A2SQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.142639109 (323h30m32.87390676s) [noise=true , address=77.90.31.21:4906 , piece_id=UZY5ZFCBR7NPW4IN5WJPTGKSTVTMQ5IVSWKKVVXT6SN3R2U3FAPQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.143077495 (323h30m32.874345145s) [noise=true , address=104.36.82.9:4022 , piece_id=734PI3KYMOUSZNKRU4BWIEUECEKBZAOHXGL6FSTPCCKP6G6GSNWA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.143669991 (323h30m32.874937641s) [noise=true , address=77.90.31.10:4530 , piece_id=YNZ2IAHYCMLU7V4DFQGGRBC2HAJ36Z4FDTLAX7B72VBMBMPIINOQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.145875203 (323h30m32.877142883s) [noise=true , address=104.36.82.14:4243 , piece_id=PBAM3UFTBAJSBOFESCTKSDF4JR36GQB57NG7LL3Z7NGDJ4WDWG7Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.146491584 (323h30m32.877759234s) [noise=true , address=45.91.116.4:4964 , piece_id=CBGK4RIP6G75M4V7RCU3Z2QSRTHGX6HQXQVUXXJQUE3NGPT5IM6A, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.146979211 (323h30m32.878246862s) [noise=true , address=104.36.82.17:4363 , piece_id=CZF7DHCTNXJTL5PDSINBOSBQJAM7433ZAQIKHKNQVZGQPS7242AQ, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.147736838 (323h30m32.879004488s) [noise=true , address=104.36.82.60:4358 , piece_id=H32BEFSBI42XLRQF7YGVQKQGP63Y7XRECLOZPYLSOX2GBTR4355Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.148627205 (323h30m32.879894855s) [noise=true , address=104.36.82.14:4228 , piece_id=ECOK2QCLNBRD7725CU4BFFAO4FUJLIR3CTMY3WZFVHUU77X5G55Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.149206806 (323h30m32.880474466s) [noise=true , address=104.36.82.23:4474 , piece_id=IVROJIBKT3527BBWNO5ZYLGNMZRVFB4AMJK7G7KXWOARKGVGXC7Q, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.150129022 (323h30m32.881396673s) [noise=true , address=79.127.220.98:4415 , piece_id=ZHNY7FSQI2A2WAQ27ZAAUKDJYVHOXN3WY52LWZDYBY46E6WS7CAA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.151289868 (323h30m32.882557528s) [noise=true , address=104.36.82.11:4145 , piece_id=CUXENUONDG4VTNWJ2W2DV7IIP77YWFJAD5X25TCS2R777YLZOEXA, seg_pos={0 0}, upload=336380]: Uploading piece... Aug 22 04:56:52.300240501 (323h30m33.031508152s) [upload=336380]: Next returned nil segment Aug 22 04:56:52.300257313 (323h30m33.031524963s) [upload=336380]: Waiting for error group managing segments... Aug 22 04:56:52.311754692 (323h30m33.043022322s) [noise=true , address=45.91.116.4:4964 , piece_id=CBGK4RIP6G75M4V7RCU3Z2QSRTHGX6HQXQVUXXJQUE3NGPT5IM6A, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.312362526 (323h30m33.043630186s) [noise=true , address=77.90.31.18:4828 , piece_id=HLL25GXOKAZ7HVXV4NNTV6THA6YVXZGHSNMZPKM4XKMAWM52A2SQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.312505164 (323h30m33.043772785s) [noise=true , address=45.91.116.10:4105 , piece_id=IUETLBNXRVIX5KZU22YM4N4COHYEWA6ANYOZ6OZANRBOX22HXQOA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.313453540 (323h30m33.044721191s) [noise=true , address=45.91.116.11:4139 , piece_id=XXK64FDZN5ROM2JTYXXCF6DQBFMW4VRZIZT5PK6NGF7YLTOQ3PUA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.314229331 (323h30m33.045496961s) [noise=true , address=104.36.82.14:4243 , piece_id=PBAM3UFTBAJSBOFESCTKSDF4JR36GQB57NG7LL3Z7NGDJ4WDWG7Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.314832257 (323h30m33.046099887s) [noise=true , address=77.90.31.12:4620 , piece_id=UIFT7PMLVENB3QC3JK63343C2SSTVYJ2ME5HAUZ7UDVAHI5DO52Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.315510244 (323h30m33.046777864s) [noise=true , address=104.36.82.5:4851 , piece_id=XHDD77H42NATELJQIKPM2EMBI3WXXXHHEWDXQQJKS64KZJHTLW3A, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.316562384 (323h30m33.047830014s) [noise=true , address=104.36.82.50:4044 , piece_id=L3NJHGWUTLWDW26HUHIEQT2HW3A6GKSIZXYHDXK552QVTIFK3DIA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.316973228 (323h30m33.048240868s) [noise=true , address=104.36.82.17:4363 , piece_id=CZF7DHCTNXJTL5PDSINBOSBQJAM7433ZAQIKHKNQVZGQPS7242AQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.317706238 (323h30m33.048973888s) [noise=true , address=104.36.82.6:4892 , piece_id=JYTYGOJJRP3YAIDXDT5G5B5EO5AK24OT6F3TZV7P2TP36EUAY4XQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.318129285 (323h30m33.049396915s) [noise=true , address=104.36.82.11:4145 , piece_id=CUXENUONDG4VTNWJ2W2DV7IIP77YWFJAD5X25TCS2R777YLZOEXA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.320591320 (323h30m33.05185896s) [noise=true , address=77.90.31.10:4530 , piece_id=YNZ2IAHYCMLU7V4DFQGGRBC2HAJ36Z4FDTLAX7B72VBMBMPIINOQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.331756253 (323h30m33.063023883s) [noise=true , address=77.90.31.21:4906 , piece_id=UZY5ZFCBR7NPW4IN5WJPTGKSTVTMQ5IVSWKKVVXT6SN3R2U3FAPQ, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.332730648 (323h30m33.063998299s) [noise=true , address=104.36.82.9:4022 , piece_id=734PI3KYMOUSZNKRU4BWIEUECEKBZAOHXGL6FSTPCCKP6G6GSNWA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: <nil> Aug 22 04:56:52.332762158 (323h30m33.064029817s) [seg_pos={0 0}, upload=336380]: Segment reached optimal threshold of 14 pieces. Aug 22 04:56:52.332957295 (323h30m33.064224944s) [noise=true , address=104.36.82.60:4358 , piece_id=H32BEFSBI42XLRQF7YGVQKQGP63Y7XRECLOZPYLSOX2GBTR4355Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dwCNEcA9o51ZN3UaN3Frxdawwf8DXBj86iQMywjW8XP4ESmw1): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.332992812 (323h30m33.064260442s) [noise=true , address=104.36.82.23:4474 , piece_id=IVROJIBKT3527BBWNO5ZYLGNMZRVFB4AMJK7G7KXWOARKGVGXC7Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333074575 (323h30m33.064342235s) [noise=true , address=79.127.220.98:4415 , piece_id=ZHNY7FSQI2A2WAQ27ZAAUKDJYVHOXN3WY52LWZDYBY46E6WS7CAA, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zEwYBHLdtVuQhypaivAt5k2AwMGEDvj4XsCBYHtoau2YXtH8e): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333209800 (323h30m33.06447743s) [noise=true , address=104.36.82.14:4228 , piece_id=ECOK2QCLNBRD7725CU4BFFAO4FUJLIR3CTMY3WZFVHUU77X5G55Q, seg_pos={0 0}, upload=336380]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pkADNFaYa2SqFALQdxwf1CfR1ktUwshQkw7iBJzhdhaRYaszF): protocol: expected piece hash; context canceled; EOF Aug 22 04:56:52.333246088 (323h30m33.064513708s) [seg_pos={0 0}, upload=336380]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 04:56:52.333351667 (323h30m33.064619298s) [upload=336380]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 04:56:52.333357668 (323h30m33.064625298s) [upload=336380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 04:56:52.493730278 (323h30m33.224997929s) [upload=336380]: Done uploading segments... Aug 22 04:56:52.493749815 (323h30m33.225017465s) [upload=336380]: Upload finished. err: <nil> Duration: 1.099923946s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)