Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................X......X....................] duration:
144.043338ms
FAIL (2025-08-15 06:39:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:23:13.158332703 (156h56m53.889600322s) [upload=163318]: Starting upload Aug 15 06:23:13.158381314 (156h56m53.889648933s) [upload=163318]: Done starting upload Aug 15 06:23:13.158431398 (156h56m53.889699018s) [upload=163318]: Uploading segments... Aug 15 06:23:13.158487664 (156h56m53.889755294s) [upload=163318]: Got next segment. Inline: true Aug 15 06:23:13.158492433 (156h56m53.889760053s) [upload=163318]: Waiting for error group managing segments... Aug 15 06:23:13.158525365 (156h56m53.889792995s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:23:13.158529061 (156h56m53.889796691s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:23:13.158531456 (156h56m53.889799086s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:23:13.160759987 (156h56m53.892027617s) [upload=163318]: Done uploading segments... Aug 15 06:23:13.160774924 (156h56m53.892042554s) [upload=163318]: Upload finished. err: metaclient: Too Many Requests
Duration: 144.065018ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
338.6263ms
FAIL (2025-08-15 06:38:47 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 06:33:36.516249777 (157h7m17.247517427s) [upload=163504]: Starting upload
Aug 15 06:33:36.516325700 (157h7m17.24759335s) [upload=163504]: Done starting upload
Aug 15 06:33:36.516415789 (157h7m17.247683439s) [upload=163504]: Uploading segments...
Aug 15 06:33:36.516666019 (157h7m17.24793366s) [upload=163504]: Got next segment. Inline: false
Aug 15 06:33:36.516707888 (157h7m17.247975538s) [upload=163504]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:33:36.516713138 (157h7m17.247980778s) [upload=163504]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:33:36.552416448 (157h7m17.283684108s) [seg_pos={0 0}, upload=163504]: Begin upload segment...
Aug 15 06:33:36.552473917 (157h7m17.283741577s) [seg_pos={0 0}, upload=163504]: Done begin upload segment.
Aug 15 06:33:36.552511588 (157h7m17.283779248s) [noise=true , address=104.36.82.13:4194 , piece_id=CDW55I44ELFZBFNCZPA3RXF3IWFLM72LNW4DHCM7RTVLHPXE3H3Q, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.552533159 (157h7m17.283800808s) [noise=true , address=66.23.193.175:4554 , piece_id=46LHPSSBFNJFXHCHMKJEQGLJVRCGECQ5OMXSPESEK2NSVQREYVOA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.552974057 (157h7m17.284241707s) [noise=true , address=104.36.82.59:4335 , piece_id=3WUBSCYSGNCEFBD7YGNTLBOZPMMNNSZ3ZMFNBMQEDA7M4ECTXRSQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.552996339 (157h7m17.284263999s) [noise=true , address=104.36.82.60:4370 , piece_id=NBJ2HKMDL4LIBQQSZWZTLMOG6UK6LGZQGYDLLQH2HL5VYN5P2GYQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.553375322 (157h7m17.284642972s) [noise=true , address=104.36.82.44:4874 , piece_id=IHQOLDNJVK62JZJNTSR4LVMBUQAA37N67SPDBLOQRP5KORA3IADQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.553509063 (157h7m17.284776714s) [noise=true , address=104.36.82.5:4855 , piece_id=Y7SDREJSKPZ5JEVWMI76HYUZAEBM5SIHIY7EXQ2TA6CYGV4UWMPQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.553736882 (157h7m17.285004532s) [noise=true , address=77.90.31.12:4602 , piece_id=NXXNJWP5CRGTSJ4YKZBGNSJMJDFOYCVDM7C7FYM2PBHAVL2ARTFA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.553922621 (157h7m17.285190271s) [noise=true , address=104.36.82.39:4730 , piece_id=JMLLOGZJQ5VTQNX45BCKJYYFQRUEZKWEILPKXPBN3QAY3CTHMSLA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.554092040 (157h7m17.2853597s) [noise=true , address=104.36.82.23:4472 , piece_id=U2GFGSBMQCAGLQICGWGUP4YMONIUKPQLP7YYBXHNMZYQONADPWKA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.554318536 (157h7m17.285586196s) [noise=true , address=79.127.220.97:4386 , piece_id=NZG46SVSN2YKOHVYBPIONXKZN7JQSO7E54I5ZX3OPTJ6ID2LUV2Q, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.554481192 (157h7m17.285748842s) [noise=true , address=77.90.31.13:4640 , piece_id=ERJ7JNUYPM2A4BWJUAN2O2CSPACDA5MEKJ2X3ITEPTU5UFF5OH2Q, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.554773531 (157h7m17.286041181s) [noise=true , address=77.90.31.10:4539 , piece_id=UP7X2AHNE4BT7LTM5UADL3SLA57SJD5CFVN6QX5F4UEJXYV4ZSXQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.554858801 (157h7m17.286126451s) [noise=true , address=77.90.31.16:4746 , piece_id=S4RIKDEJU7HYPJDV7UD2JHO42EPGAX4AGEDPCGQL6CP3ZI5EEZIA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.555150570 (157h7m17.28641822s) [noise=true , address=77.90.31.15:4706 , piece_id=DZKEHW2MYN7GTML5GPMHFNL6LU6HPYPJAHUEBOXMIOCCJFLOL27Q, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.555226873 (157h7m17.286494523s) [noise=true , address=104.36.82.36:4651 , piece_id=RSTYC6KI7OIX4RLJGKT4NBSBC7ZDNKH7L2PGCV7A5ACH6AFEVO2A, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.555545372 (157h7m17.286813023s) [noise=true , address=104.36.82.21:4474 , piece_id=YHCYIPHJUVKFMJYMBTSC6I4ECUSXXSR7FCOZNPHAIM57WN4KFLDQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.555612218 (157h7m17.286879868s) [noise=true , address=79.127.201.215:4355 , piece_id=OHRONBVUSBAL5XTKJ7TNQFGSIJDC7XKTL2IUKPECPM5VS3RDB7SQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.558465745 (157h7m17.289733395s) [noise=true , address=77.90.31.21:4885 , piece_id=OPMXMKLQRYIUW6IYQODE3RY4MFJD63Q36CQUCDCSWTXGF5DD5BZA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.687128406 (157h7m17.418396056s) [upload=163504]: Next returned nil segment
Aug 15 06:33:36.687143674 (157h7m17.418411325s) [upload=163504]: Waiting for error group managing segments...
Aug 15 06:33:36.698108274 (157h7m17.429375924s) [noise=true , address=77.90.31.21:4885 , piece_id=OPMXMKLQRYIUW6IYQODE3RY4MFJD63Q36CQUCDCSWTXGF5DD5BZA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.700065474 (157h7m17.431333133s) [noise=true , address=77.90.31.16:4746 , piece_id=S4RIKDEJU7HYPJDV7UD2JHO42EPGAX4AGEDPCGQL6CP3ZI5EEZIA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.700184548 (157h7m17.431452197s) [noise=true , address=77.90.31.15:4706 , piece_id=DZKEHW2MYN7GTML5GPMHFNL6LU6HPYPJAHUEBOXMIOCCJFLOL27Q, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.700939537 (157h7m17.432207188s) [noise=true , address=77.90.31.12:4602 , piece_id=NXXNJWP5CRGTSJ4YKZBGNSJMJDFOYCVDM7C7FYM2PBHAVL2ARTFA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.701136878 (157h7m17.432404529s) [noise=true , address=77.90.31.10:4539 , piece_id=UP7X2AHNE4BT7LTM5UADL3SLA57SJD5CFVN6QX5F4UEJXYV4ZSXQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.701917577 (157h7m17.433185227s) [noise=true , address=77.90.31.13:4640 , piece_id=ERJ7JNUYPM2A4BWJUAN2O2CSPACDA5MEKJ2X3ITEPTU5UFF5OH2Q, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.702410894 (157h7m17.433678544s) [noise=true , address=104.36.82.60:4370 , piece_id=NBJ2HKMDL4LIBQQSZWZTLMOG6UK6LGZQGYDLLQH2HL5VYN5P2GYQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.705035319 (157h7m17.43630297s) [noise=true , address=104.36.82.36:4651 , piece_id=RSTYC6KI7OIX4RLJGKT4NBSBC7ZDNKH7L2PGCV7A5ACH6AFEVO2A, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.705195951 (157h7m17.436463612s) [noise=true , address=104.36.82.39:4730 , piece_id=JMLLOGZJQ5VTQNX45BCKJYYFQRUEZKWEILPKXPBN3QAY3CTHMSLA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.707189931 (157h7m17.438457582s) [noise=true , address=104.36.82.44:4874 , piece_id=IHQOLDNJVK62JZJNTSR4LVMBUQAA37N67SPDBLOQRP5KORA3IADQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.707531894 (157h7m17.438799545s) [noise=true , address=104.36.82.13:4194 , piece_id=CDW55I44ELFZBFNCZPA3RXF3IWFLM72LNW4DHCM7RTVLHPXE3H3Q, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.716876097 (157h7m17.448143757s) [noise=true , address=104.36.82.59:4335 , piece_id=3WUBSCYSGNCEFBD7YGNTLBOZPMMNNSZ3ZMFNBMQEDA7M4ECTXRSQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.720591954 (157h7m17.451859614s) [noise=true , address=104.36.82.5:4855 , piece_id=Y7SDREJSKPZ5JEVWMI76HYUZAEBM5SIHIY7EXQ2TA6CYGV4UWMPQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.721439278 (157h7m17.452706928s) [noise=true , address=104.36.82.23:4472 , piece_id=U2GFGSBMQCAGLQICGWGUP4YMONIUKPQLP7YYBXHNMZYQONADPWKA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.721470266 (157h7m17.452737916s) [seg_pos={0 0}, upload=163504]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:33:36.721647930 (157h7m17.45291558s) [noise=true , address=79.127.220.97:4386 , piece_id=NZG46SVSN2YKOHVYBPIONXKZN7JQSO7E54I5ZX3OPTJ6ID2LUV2Q, seg_pos={0 0}, upload=163504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Jbx3fU6YtQjbYHz8zmeBricToeR3dLJBoS5N4gHPhJWgcpiu7): protocol: expected piece hash; context canceled; EOF
Aug 15 06:33:36.721809062 (157h7m17.453076713s) [noise=true , address=104.36.82.21:4474 , piece_id=YHCYIPHJUVKFMJYMBTSC6I4ECUSXXSR7FCOZNPHAIM57WN4KFLDQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH): protocol: expected piece hash; context canceled; EOF
Aug 15 06:33:36.721957362 (157h7m17.453225012s) [noise=true , address=66.23.193.175:4554 , piece_id=46LHPSSBFNJFXHCHMKJEQGLJVRCGECQ5OMXSPESEK2NSVQREYVOA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CraGuuckkbKe5PDLUvwF5G2ATUbgdR5g192YjkZgmP3JpqgXi): protocol: read tcp 5.161.89.252:24894->66.23.193.175:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 06:33:36.722054555 (157h7m17.453322205s) [noise=true , address=79.127.201.215:4355 , piece_id=OHRONBVUSBAL5XTKJ7TNQFGSIJDC7XKTL2IUKPECPM5VS3RDB7SQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: read tcp 5.161.89.252:40562->79.127.201.215:4355: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 06:33:36.722070524 (157h7m17.453338175s) [seg_pos={0 0}, upload=163504]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:33:36.722144995 (157h7m17.453412644s) [upload=163504]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:33:36.722150886 (157h7m17.453418545s) [upload=163504]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:33:36.862109570 (157h7m17.5933772s) [upload=163504]: Done uploading segments...
Aug 15 06:33:36.862123436 (157h7m17.593391066s) [upload=163504]: Upload finished. err: <nil>
Duration: 338.648342ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................................X......X...................] duration:
132.101077ms
FAIL (2025-08-15 06:38:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:23:13.158332703 (156h56m53.889600322s) [upload=163318]: Starting upload Aug 15 06:23:13.158381314 (156h56m53.889648933s) [upload=163318]: Done starting upload Aug 15 06:23:13.158431398 (156h56m53.889699018s) [upload=163318]: Uploading segments... Aug 15 06:23:13.158487664 (156h56m53.889755294s) [upload=163318]: Got next segment. Inline: true Aug 15 06:23:13.158492433 (156h56m53.889760053s) [upload=163318]: Waiting for error group managing segments... Aug 15 06:23:13.158525365 (156h56m53.889792995s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:23:13.158529061 (156h56m53.889796691s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:23:13.158531456 (156h56m53.889799086s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:23:13.160759987 (156h56m53.892027617s) [upload=163318]: Done uploading segments... Aug 15 06:23:13.160774924 (156h56m53.892042554s) [upload=163318]: Upload finished. err: metaclient: Too Many Requests
Duration: 132.121876ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
481.416852ms
FAIL (2025-08-15 06:38:14 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 06:33:36.516249777 (157h7m17.247517427s) [upload=163504]: Starting upload
Aug 15 06:33:36.516325700 (157h7m17.24759335s) [upload=163504]: Done starting upload
Aug 15 06:33:36.516415789 (157h7m17.247683439s) [upload=163504]: Uploading segments...
Aug 15 06:33:36.516666019 (157h7m17.24793366s) [upload=163504]: Got next segment. Inline: false
Aug 15 06:33:36.516707888 (157h7m17.247975538s) [upload=163504]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:33:36.516713138 (157h7m17.247980778s) [upload=163504]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:33:36.552416448 (157h7m17.283684108s) [seg_pos={0 0}, upload=163504]: Begin upload segment...
Aug 15 06:33:36.552473917 (157h7m17.283741577s) [seg_pos={0 0}, upload=163504]: Done begin upload segment.
Aug 15 06:33:36.552511588 (157h7m17.283779248s) [noise=true , address=104.36.82.13:4194 , piece_id=CDW55I44ELFZBFNCZPA3RXF3IWFLM72LNW4DHCM7RTVLHPXE3H3Q, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.552533159 (157h7m17.283800808s) [noise=true , address=66.23.193.175:4554 , piece_id=46LHPSSBFNJFXHCHMKJEQGLJVRCGECQ5OMXSPESEK2NSVQREYVOA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.552974057 (157h7m17.284241707s) [noise=true , address=104.36.82.59:4335 , piece_id=3WUBSCYSGNCEFBD7YGNTLBOZPMMNNSZ3ZMFNBMQEDA7M4ECTXRSQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.552996339 (157h7m17.284263999s) [noise=true , address=104.36.82.60:4370 , piece_id=NBJ2HKMDL4LIBQQSZWZTLMOG6UK6LGZQGYDLLQH2HL5VYN5P2GYQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.553375322 (157h7m17.284642972s) [noise=true , address=104.36.82.44:4874 , piece_id=IHQOLDNJVK62JZJNTSR4LVMBUQAA37N67SPDBLOQRP5KORA3IADQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.553509063 (157h7m17.284776714s) [noise=true , address=104.36.82.5:4855 , piece_id=Y7SDREJSKPZ5JEVWMI76HYUZAEBM5SIHIY7EXQ2TA6CYGV4UWMPQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.553736882 (157h7m17.285004532s) [noise=true , address=77.90.31.12:4602 , piece_id=NXXNJWP5CRGTSJ4YKZBGNSJMJDFOYCVDM7C7FYM2PBHAVL2ARTFA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.553922621 (157h7m17.285190271s) [noise=true , address=104.36.82.39:4730 , piece_id=JMLLOGZJQ5VTQNX45BCKJYYFQRUEZKWEILPKXPBN3QAY3CTHMSLA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.554092040 (157h7m17.2853597s) [noise=true , address=104.36.82.23:4472 , piece_id=U2GFGSBMQCAGLQICGWGUP4YMONIUKPQLP7YYBXHNMZYQONADPWKA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.554318536 (157h7m17.285586196s) [noise=true , address=79.127.220.97:4386 , piece_id=NZG46SVSN2YKOHVYBPIONXKZN7JQSO7E54I5ZX3OPTJ6ID2LUV2Q, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.554481192 (157h7m17.285748842s) [noise=true , address=77.90.31.13:4640 , piece_id=ERJ7JNUYPM2A4BWJUAN2O2CSPACDA5MEKJ2X3ITEPTU5UFF5OH2Q, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.554773531 (157h7m17.286041181s) [noise=true , address=77.90.31.10:4539 , piece_id=UP7X2AHNE4BT7LTM5UADL3SLA57SJD5CFVN6QX5F4UEJXYV4ZSXQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.554858801 (157h7m17.286126451s) [noise=true , address=77.90.31.16:4746 , piece_id=S4RIKDEJU7HYPJDV7UD2JHO42EPGAX4AGEDPCGQL6CP3ZI5EEZIA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.555150570 (157h7m17.28641822s) [noise=true , address=77.90.31.15:4706 , piece_id=DZKEHW2MYN7GTML5GPMHFNL6LU6HPYPJAHUEBOXMIOCCJFLOL27Q, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.555226873 (157h7m17.286494523s) [noise=true , address=104.36.82.36:4651 , piece_id=RSTYC6KI7OIX4RLJGKT4NBSBC7ZDNKH7L2PGCV7A5ACH6AFEVO2A, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.555545372 (157h7m17.286813023s) [noise=true , address=104.36.82.21:4474 , piece_id=YHCYIPHJUVKFMJYMBTSC6I4ECUSXXSR7FCOZNPHAIM57WN4KFLDQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.555612218 (157h7m17.286879868s) [noise=true , address=79.127.201.215:4355 , piece_id=OHRONBVUSBAL5XTKJ7TNQFGSIJDC7XKTL2IUKPECPM5VS3RDB7SQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.558465745 (157h7m17.289733395s) [noise=true , address=77.90.31.21:4885 , piece_id=OPMXMKLQRYIUW6IYQODE3RY4MFJD63Q36CQUCDCSWTXGF5DD5BZA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.687128406 (157h7m17.418396056s) [upload=163504]: Next returned nil segment
Aug 15 06:33:36.687143674 (157h7m17.418411325s) [upload=163504]: Waiting for error group managing segments...
Aug 15 06:33:36.698108274 (157h7m17.429375924s) [noise=true , address=77.90.31.21:4885 , piece_id=OPMXMKLQRYIUW6IYQODE3RY4MFJD63Q36CQUCDCSWTXGF5DD5BZA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.700065474 (157h7m17.431333133s) [noise=true , address=77.90.31.16:4746 , piece_id=S4RIKDEJU7HYPJDV7UD2JHO42EPGAX4AGEDPCGQL6CP3ZI5EEZIA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.700184548 (157h7m17.431452197s) [noise=true , address=77.90.31.15:4706 , piece_id=DZKEHW2MYN7GTML5GPMHFNL6LU6HPYPJAHUEBOXMIOCCJFLOL27Q, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.700939537 (157h7m17.432207188s) [noise=true , address=77.90.31.12:4602 , piece_id=NXXNJWP5CRGTSJ4YKZBGNSJMJDFOYCVDM7C7FYM2PBHAVL2ARTFA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.701136878 (157h7m17.432404529s) [noise=true , address=77.90.31.10:4539 , piece_id=UP7X2AHNE4BT7LTM5UADL3SLA57SJD5CFVN6QX5F4UEJXYV4ZSXQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.701917577 (157h7m17.433185227s) [noise=true , address=77.90.31.13:4640 , piece_id=ERJ7JNUYPM2A4BWJUAN2O2CSPACDA5MEKJ2X3ITEPTU5UFF5OH2Q, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.702410894 (157h7m17.433678544s) [noise=true , address=104.36.82.60:4370 , piece_id=NBJ2HKMDL4LIBQQSZWZTLMOG6UK6LGZQGYDLLQH2HL5VYN5P2GYQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.705035319 (157h7m17.43630297s) [noise=true , address=104.36.82.36:4651 , piece_id=RSTYC6KI7OIX4RLJGKT4NBSBC7ZDNKH7L2PGCV7A5ACH6AFEVO2A, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.705195951 (157h7m17.436463612s) [noise=true , address=104.36.82.39:4730 , piece_id=JMLLOGZJQ5VTQNX45BCKJYYFQRUEZKWEILPKXPBN3QAY3CTHMSLA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.707189931 (157h7m17.438457582s) [noise=true , address=104.36.82.44:4874 , piece_id=IHQOLDNJVK62JZJNTSR4LVMBUQAA37N67SPDBLOQRP5KORA3IADQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.707531894 (157h7m17.438799545s) [noise=true , address=104.36.82.13:4194 , piece_id=CDW55I44ELFZBFNCZPA3RXF3IWFLM72LNW4DHCM7RTVLHPXE3H3Q, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.716876097 (157h7m17.448143757s) [noise=true , address=104.36.82.59:4335 , piece_id=3WUBSCYSGNCEFBD7YGNTLBOZPMMNNSZ3ZMFNBMQEDA7M4ECTXRSQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.720591954 (157h7m17.451859614s) [noise=true , address=104.36.82.5:4855 , piece_id=Y7SDREJSKPZ5JEVWMI76HYUZAEBM5SIHIY7EXQ2TA6CYGV4UWMPQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.721439278 (157h7m17.452706928s) [noise=true , address=104.36.82.23:4472 , piece_id=U2GFGSBMQCAGLQICGWGUP4YMONIUKPQLP7YYBXHNMZYQONADPWKA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.721470266 (157h7m17.452737916s) [seg_pos={0 0}, upload=163504]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:33:36.721647930 (157h7m17.45291558s) [noise=true , address=79.127.220.97:4386 , piece_id=NZG46SVSN2YKOHVYBPIONXKZN7JQSO7E54I5ZX3OPTJ6ID2LUV2Q, seg_pos={0 0}, upload=163504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Jbx3fU6YtQjbYHz8zmeBricToeR3dLJBoS5N4gHPhJWgcpiu7): protocol: expected piece hash; context canceled; EOF
Aug 15 06:33:36.721809062 (157h7m17.453076713s) [noise=true , address=104.36.82.21:4474 , piece_id=YHCYIPHJUVKFMJYMBTSC6I4ECUSXXSR7FCOZNPHAIM57WN4KFLDQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH): protocol: expected piece hash; context canceled; EOF
Aug 15 06:33:36.721957362 (157h7m17.453225012s) [noise=true , address=66.23.193.175:4554 , piece_id=46LHPSSBFNJFXHCHMKJEQGLJVRCGECQ5OMXSPESEK2NSVQREYVOA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CraGuuckkbKe5PDLUvwF5G2ATUbgdR5g192YjkZgmP3JpqgXi): protocol: read tcp 5.161.89.252:24894->66.23.193.175:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 06:33:36.722054555 (157h7m17.453322205s) [noise=true , address=79.127.201.215:4355 , piece_id=OHRONBVUSBAL5XTKJ7TNQFGSIJDC7XKTL2IUKPECPM5VS3RDB7SQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: read tcp 5.161.89.252:40562->79.127.201.215:4355: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 06:33:36.722070524 (157h7m17.453338175s) [seg_pos={0 0}, upload=163504]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:33:36.722144995 (157h7m17.453412644s) [upload=163504]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:33:36.722150886 (157h7m17.453418545s) [upload=163504]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:33:36.862109570 (157h7m17.5933772s) [upload=163504]: Done uploading segments...
Aug 15 06:33:36.862123436 (157h7m17.593391066s) [upload=163504]: Upload finished. err: <nil>
Duration: 481.443562ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................................X......X..................] duration:
378.110681ms
FAIL (2025-08-15 06:37:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:23:13.158332703 (156h56m53.889600322s) [upload=163318]: Starting upload Aug 15 06:23:13.158381314 (156h56m53.889648933s) [upload=163318]: Done starting upload Aug 15 06:23:13.158431398 (156h56m53.889699018s) [upload=163318]: Uploading segments... Aug 15 06:23:13.158487664 (156h56m53.889755294s) [upload=163318]: Got next segment. Inline: true Aug 15 06:23:13.158492433 (156h56m53.889760053s) [upload=163318]: Waiting for error group managing segments... Aug 15 06:23:13.158525365 (156h56m53.889792995s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:23:13.158529061 (156h56m53.889796691s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:23:13.158531456 (156h56m53.889799086s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:23:13.160759987 (156h56m53.892027617s) [upload=163318]: Done uploading segments... Aug 15 06:23:13.160774924 (156h56m53.892042554s) [upload=163318]: Upload finished. err: metaclient: Too Many Requests
Duration: 378.175564ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
407.359016ms
FAIL (2025-08-15 06:37:12 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 06:33:36.516249777 (157h7m17.247517427s) [upload=163504]: Starting upload
Aug 15 06:33:36.516325700 (157h7m17.24759335s) [upload=163504]: Done starting upload
Aug 15 06:33:36.516415789 (157h7m17.247683439s) [upload=163504]: Uploading segments...
Aug 15 06:33:36.516666019 (157h7m17.24793366s) [upload=163504]: Got next segment. Inline: false
Aug 15 06:33:36.516707888 (157h7m17.247975538s) [upload=163504]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:33:36.516713138 (157h7m17.247980778s) [upload=163504]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:33:36.552416448 (157h7m17.283684108s) [seg_pos={0 0}, upload=163504]: Begin upload segment...
Aug 15 06:33:36.552473917 (157h7m17.283741577s) [seg_pos={0 0}, upload=163504]: Done begin upload segment.
Aug 15 06:33:36.552511588 (157h7m17.283779248s) [noise=true , address=104.36.82.13:4194 , piece_id=CDW55I44ELFZBFNCZPA3RXF3IWFLM72LNW4DHCM7RTVLHPXE3H3Q, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.552533159 (157h7m17.283800808s) [noise=true , address=66.23.193.175:4554 , piece_id=46LHPSSBFNJFXHCHMKJEQGLJVRCGECQ5OMXSPESEK2NSVQREYVOA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.552974057 (157h7m17.284241707s) [noise=true , address=104.36.82.59:4335 , piece_id=3WUBSCYSGNCEFBD7YGNTLBOZPMMNNSZ3ZMFNBMQEDA7M4ECTXRSQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.552996339 (157h7m17.284263999s) [noise=true , address=104.36.82.60:4370 , piece_id=NBJ2HKMDL4LIBQQSZWZTLMOG6UK6LGZQGYDLLQH2HL5VYN5P2GYQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.553375322 (157h7m17.284642972s) [noise=true , address=104.36.82.44:4874 , piece_id=IHQOLDNJVK62JZJNTSR4LVMBUQAA37N67SPDBLOQRP5KORA3IADQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.553509063 (157h7m17.284776714s) [noise=true , address=104.36.82.5:4855 , piece_id=Y7SDREJSKPZ5JEVWMI76HYUZAEBM5SIHIY7EXQ2TA6CYGV4UWMPQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.553736882 (157h7m17.285004532s) [noise=true , address=77.90.31.12:4602 , piece_id=NXXNJWP5CRGTSJ4YKZBGNSJMJDFOYCVDM7C7FYM2PBHAVL2ARTFA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.553922621 (157h7m17.285190271s) [noise=true , address=104.36.82.39:4730 , piece_id=JMLLOGZJQ5VTQNX45BCKJYYFQRUEZKWEILPKXPBN3QAY3CTHMSLA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.554092040 (157h7m17.2853597s) [noise=true , address=104.36.82.23:4472 , piece_id=U2GFGSBMQCAGLQICGWGUP4YMONIUKPQLP7YYBXHNMZYQONADPWKA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.554318536 (157h7m17.285586196s) [noise=true , address=79.127.220.97:4386 , piece_id=NZG46SVSN2YKOHVYBPIONXKZN7JQSO7E54I5ZX3OPTJ6ID2LUV2Q, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.554481192 (157h7m17.285748842s) [noise=true , address=77.90.31.13:4640 , piece_id=ERJ7JNUYPM2A4BWJUAN2O2CSPACDA5MEKJ2X3ITEPTU5UFF5OH2Q, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.554773531 (157h7m17.286041181s) [noise=true , address=77.90.31.10:4539 , piece_id=UP7X2AHNE4BT7LTM5UADL3SLA57SJD5CFVN6QX5F4UEJXYV4ZSXQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.554858801 (157h7m17.286126451s) [noise=true , address=77.90.31.16:4746 , piece_id=S4RIKDEJU7HYPJDV7UD2JHO42EPGAX4AGEDPCGQL6CP3ZI5EEZIA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.555150570 (157h7m17.28641822s) [noise=true , address=77.90.31.15:4706 , piece_id=DZKEHW2MYN7GTML5GPMHFNL6LU6HPYPJAHUEBOXMIOCCJFLOL27Q, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.555226873 (157h7m17.286494523s) [noise=true , address=104.36.82.36:4651 , piece_id=RSTYC6KI7OIX4RLJGKT4NBSBC7ZDNKH7L2PGCV7A5ACH6AFEVO2A, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.555545372 (157h7m17.286813023s) [noise=true , address=104.36.82.21:4474 , piece_id=YHCYIPHJUVKFMJYMBTSC6I4ECUSXXSR7FCOZNPHAIM57WN4KFLDQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.555612218 (157h7m17.286879868s) [noise=true , address=79.127.201.215:4355 , piece_id=OHRONBVUSBAL5XTKJ7TNQFGSIJDC7XKTL2IUKPECPM5VS3RDB7SQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.558465745 (157h7m17.289733395s) [noise=true , address=77.90.31.21:4885 , piece_id=OPMXMKLQRYIUW6IYQODE3RY4MFJD63Q36CQUCDCSWTXGF5DD5BZA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.687128406 (157h7m17.418396056s) [upload=163504]: Next returned nil segment
Aug 15 06:33:36.687143674 (157h7m17.418411325s) [upload=163504]: Waiting for error group managing segments...
Aug 15 06:33:36.698108274 (157h7m17.429375924s) [noise=true , address=77.90.31.21:4885 , piece_id=OPMXMKLQRYIUW6IYQODE3RY4MFJD63Q36CQUCDCSWTXGF5DD5BZA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.700065474 (157h7m17.431333133s) [noise=true , address=77.90.31.16:4746 , piece_id=S4RIKDEJU7HYPJDV7UD2JHO42EPGAX4AGEDPCGQL6CP3ZI5EEZIA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.700184548 (157h7m17.431452197s) [noise=true , address=77.90.31.15:4706 , piece_id=DZKEHW2MYN7GTML5GPMHFNL6LU6HPYPJAHUEBOXMIOCCJFLOL27Q, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.700939537 (157h7m17.432207188s) [noise=true , address=77.90.31.12:4602 , piece_id=NXXNJWP5CRGTSJ4YKZBGNSJMJDFOYCVDM7C7FYM2PBHAVL2ARTFA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.701136878 (157h7m17.432404529s) [noise=true , address=77.90.31.10:4539 , piece_id=UP7X2AHNE4BT7LTM5UADL3SLA57SJD5CFVN6QX5F4UEJXYV4ZSXQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.701917577 (157h7m17.433185227s) [noise=true , address=77.90.31.13:4640 , piece_id=ERJ7JNUYPM2A4BWJUAN2O2CSPACDA5MEKJ2X3ITEPTU5UFF5OH2Q, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.702410894 (157h7m17.433678544s) [noise=true , address=104.36.82.60:4370 , piece_id=NBJ2HKMDL4LIBQQSZWZTLMOG6UK6LGZQGYDLLQH2HL5VYN5P2GYQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.705035319 (157h7m17.43630297s) [noise=true , address=104.36.82.36:4651 , piece_id=RSTYC6KI7OIX4RLJGKT4NBSBC7ZDNKH7L2PGCV7A5ACH6AFEVO2A, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.705195951 (157h7m17.436463612s) [noise=true , address=104.36.82.39:4730 , piece_id=JMLLOGZJQ5VTQNX45BCKJYYFQRUEZKWEILPKXPBN3QAY3CTHMSLA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.707189931 (157h7m17.438457582s) [noise=true , address=104.36.82.44:4874 , piece_id=IHQOLDNJVK62JZJNTSR4LVMBUQAA37N67SPDBLOQRP5KORA3IADQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.707531894 (157h7m17.438799545s) [noise=true , address=104.36.82.13:4194 , piece_id=CDW55I44ELFZBFNCZPA3RXF3IWFLM72LNW4DHCM7RTVLHPXE3H3Q, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.716876097 (157h7m17.448143757s) [noise=true , address=104.36.82.59:4335 , piece_id=3WUBSCYSGNCEFBD7YGNTLBOZPMMNNSZ3ZMFNBMQEDA7M4ECTXRSQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.720591954 (157h7m17.451859614s) [noise=true , address=104.36.82.5:4855 , piece_id=Y7SDREJSKPZ5JEVWMI76HYUZAEBM5SIHIY7EXQ2TA6CYGV4UWMPQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.721439278 (157h7m17.452706928s) [noise=true , address=104.36.82.23:4472 , piece_id=U2GFGSBMQCAGLQICGWGUP4YMONIUKPQLP7YYBXHNMZYQONADPWKA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.721470266 (157h7m17.452737916s) [seg_pos={0 0}, upload=163504]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:33:36.721647930 (157h7m17.45291558s) [noise=true , address=79.127.220.97:4386 , piece_id=NZG46SVSN2YKOHVYBPIONXKZN7JQSO7E54I5ZX3OPTJ6ID2LUV2Q, seg_pos={0 0}, upload=163504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Jbx3fU6YtQjbYHz8zmeBricToeR3dLJBoS5N4gHPhJWgcpiu7): protocol: expected piece hash; context canceled; EOF
Aug 15 06:33:36.721809062 (157h7m17.453076713s) [noise=true , address=104.36.82.21:4474 , piece_id=YHCYIPHJUVKFMJYMBTSC6I4ECUSXXSR7FCOZNPHAIM57WN4KFLDQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH): protocol: expected piece hash; context canceled; EOF
Aug 15 06:33:36.721957362 (157h7m17.453225012s) [noise=true , address=66.23.193.175:4554 , piece_id=46LHPSSBFNJFXHCHMKJEQGLJVRCGECQ5OMXSPESEK2NSVQREYVOA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CraGuuckkbKe5PDLUvwF5G2ATUbgdR5g192YjkZgmP3JpqgXi): protocol: read tcp 5.161.89.252:24894->66.23.193.175:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 06:33:36.722054555 (157h7m17.453322205s) [noise=true , address=79.127.201.215:4355 , piece_id=OHRONBVUSBAL5XTKJ7TNQFGSIJDC7XKTL2IUKPECPM5VS3RDB7SQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: read tcp 5.161.89.252:40562->79.127.201.215:4355: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 06:33:36.722070524 (157h7m17.453338175s) [seg_pos={0 0}, upload=163504]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:33:36.722144995 (157h7m17.453412644s) [upload=163504]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:33:36.722150886 (157h7m17.453418545s) [upload=163504]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:33:36.862109570 (157h7m17.5933772s) [upload=163504]: Done uploading segments...
Aug 15 06:33:36.862123436 (157h7m17.593391066s) [upload=163504]: Upload finished. err: <nil>
Duration: 407.373823ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................................X......X.................] duration:
135.682493ms
FAIL (2025-08-15 06:36:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:23:13.158332703 (156h56m53.889600322s) [upload=163318]: Starting upload Aug 15 06:23:13.158381314 (156h56m53.889648933s) [upload=163318]: Done starting upload Aug 15 06:23:13.158431398 (156h56m53.889699018s) [upload=163318]: Uploading segments... Aug 15 06:23:13.158487664 (156h56m53.889755294s) [upload=163318]: Got next segment. Inline: true Aug 15 06:23:13.158492433 (156h56m53.889760053s) [upload=163318]: Waiting for error group managing segments... Aug 15 06:23:13.158525365 (156h56m53.889792995s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:23:13.158529061 (156h56m53.889796691s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:23:13.158531456 (156h56m53.889799086s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:23:13.160759987 (156h56m53.892027617s) [upload=163318]: Done uploading segments... Aug 15 06:23:13.160774924 (156h56m53.892042554s) [upload=163318]: Upload finished. err: metaclient: Too Many Requests
Duration: 135.700415ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
320.823422ms
FAIL (2025-08-15 06:36:14 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 06:33:36.516249777 (157h7m17.247517427s) [upload=163504]: Starting upload
Aug 15 06:33:36.516325700 (157h7m17.24759335s) [upload=163504]: Done starting upload
Aug 15 06:33:36.516415789 (157h7m17.247683439s) [upload=163504]: Uploading segments...
Aug 15 06:33:36.516666019 (157h7m17.24793366s) [upload=163504]: Got next segment. Inline: false
Aug 15 06:33:36.516707888 (157h7m17.247975538s) [upload=163504]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:33:36.516713138 (157h7m17.247980778s) [upload=163504]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:33:36.552416448 (157h7m17.283684108s) [seg_pos={0 0}, upload=163504]: Begin upload segment...
Aug 15 06:33:36.552473917 (157h7m17.283741577s) [seg_pos={0 0}, upload=163504]: Done begin upload segment.
Aug 15 06:33:36.552511588 (157h7m17.283779248s) [noise=true , address=104.36.82.13:4194 , piece_id=CDW55I44ELFZBFNCZPA3RXF3IWFLM72LNW4DHCM7RTVLHPXE3H3Q, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.552533159 (157h7m17.283800808s) [noise=true , address=66.23.193.175:4554 , piece_id=46LHPSSBFNJFXHCHMKJEQGLJVRCGECQ5OMXSPESEK2NSVQREYVOA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.552974057 (157h7m17.284241707s) [noise=true , address=104.36.82.59:4335 , piece_id=3WUBSCYSGNCEFBD7YGNTLBOZPMMNNSZ3ZMFNBMQEDA7M4ECTXRSQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.552996339 (157h7m17.284263999s) [noise=true , address=104.36.82.60:4370 , piece_id=NBJ2HKMDL4LIBQQSZWZTLMOG6UK6LGZQGYDLLQH2HL5VYN5P2GYQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.553375322 (157h7m17.284642972s) [noise=true , address=104.36.82.44:4874 , piece_id=IHQOLDNJVK62JZJNTSR4LVMBUQAA37N67SPDBLOQRP5KORA3IADQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.553509063 (157h7m17.284776714s) [noise=true , address=104.36.82.5:4855 , piece_id=Y7SDREJSKPZ5JEVWMI76HYUZAEBM5SIHIY7EXQ2TA6CYGV4UWMPQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.553736882 (157h7m17.285004532s) [noise=true , address=77.90.31.12:4602 , piece_id=NXXNJWP5CRGTSJ4YKZBGNSJMJDFOYCVDM7C7FYM2PBHAVL2ARTFA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.553922621 (157h7m17.285190271s) [noise=true , address=104.36.82.39:4730 , piece_id=JMLLOGZJQ5VTQNX45BCKJYYFQRUEZKWEILPKXPBN3QAY3CTHMSLA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.554092040 (157h7m17.2853597s) [noise=true , address=104.36.82.23:4472 , piece_id=U2GFGSBMQCAGLQICGWGUP4YMONIUKPQLP7YYBXHNMZYQONADPWKA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.554318536 (157h7m17.285586196s) [noise=true , address=79.127.220.97:4386 , piece_id=NZG46SVSN2YKOHVYBPIONXKZN7JQSO7E54I5ZX3OPTJ6ID2LUV2Q, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.554481192 (157h7m17.285748842s) [noise=true , address=77.90.31.13:4640 , piece_id=ERJ7JNUYPM2A4BWJUAN2O2CSPACDA5MEKJ2X3ITEPTU5UFF5OH2Q, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.554773531 (157h7m17.286041181s) [noise=true , address=77.90.31.10:4539 , piece_id=UP7X2AHNE4BT7LTM5UADL3SLA57SJD5CFVN6QX5F4UEJXYV4ZSXQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.554858801 (157h7m17.286126451s) [noise=true , address=77.90.31.16:4746 , piece_id=S4RIKDEJU7HYPJDV7UD2JHO42EPGAX4AGEDPCGQL6CP3ZI5EEZIA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.555150570 (157h7m17.28641822s) [noise=true , address=77.90.31.15:4706 , piece_id=DZKEHW2MYN7GTML5GPMHFNL6LU6HPYPJAHUEBOXMIOCCJFLOL27Q, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.555226873 (157h7m17.286494523s) [noise=true , address=104.36.82.36:4651 , piece_id=RSTYC6KI7OIX4RLJGKT4NBSBC7ZDNKH7L2PGCV7A5ACH6AFEVO2A, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.555545372 (157h7m17.286813023s) [noise=true , address=104.36.82.21:4474 , piece_id=YHCYIPHJUVKFMJYMBTSC6I4ECUSXXSR7FCOZNPHAIM57WN4KFLDQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.555612218 (157h7m17.286879868s) [noise=true , address=79.127.201.215:4355 , piece_id=OHRONBVUSBAL5XTKJ7TNQFGSIJDC7XKTL2IUKPECPM5VS3RDB7SQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.558465745 (157h7m17.289733395s) [noise=true , address=77.90.31.21:4885 , piece_id=OPMXMKLQRYIUW6IYQODE3RY4MFJD63Q36CQUCDCSWTXGF5DD5BZA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.687128406 (157h7m17.418396056s) [upload=163504]: Next returned nil segment
Aug 15 06:33:36.687143674 (157h7m17.418411325s) [upload=163504]: Waiting for error group managing segments...
Aug 15 06:33:36.698108274 (157h7m17.429375924s) [noise=true , address=77.90.31.21:4885 , piece_id=OPMXMKLQRYIUW6IYQODE3RY4MFJD63Q36CQUCDCSWTXGF5DD5BZA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.700065474 (157h7m17.431333133s) [noise=true , address=77.90.31.16:4746 , piece_id=S4RIKDEJU7HYPJDV7UD2JHO42EPGAX4AGEDPCGQL6CP3ZI5EEZIA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.700184548 (157h7m17.431452197s) [noise=true , address=77.90.31.15:4706 , piece_id=DZKEHW2MYN7GTML5GPMHFNL6LU6HPYPJAHUEBOXMIOCCJFLOL27Q, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.700939537 (157h7m17.432207188s) [noise=true , address=77.90.31.12:4602 , piece_id=NXXNJWP5CRGTSJ4YKZBGNSJMJDFOYCVDM7C7FYM2PBHAVL2ARTFA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.701136878 (157h7m17.432404529s) [noise=true , address=77.90.31.10:4539 , piece_id=UP7X2AHNE4BT7LTM5UADL3SLA57SJD5CFVN6QX5F4UEJXYV4ZSXQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.701917577 (157h7m17.433185227s) [noise=true , address=77.90.31.13:4640 , piece_id=ERJ7JNUYPM2A4BWJUAN2O2CSPACDA5MEKJ2X3ITEPTU5UFF5OH2Q, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.702410894 (157h7m17.433678544s) [noise=true , address=104.36.82.60:4370 , piece_id=NBJ2HKMDL4LIBQQSZWZTLMOG6UK6LGZQGYDLLQH2HL5VYN5P2GYQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.705035319 (157h7m17.43630297s) [noise=true , address=104.36.82.36:4651 , piece_id=RSTYC6KI7OIX4RLJGKT4NBSBC7ZDNKH7L2PGCV7A5ACH6AFEVO2A, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.705195951 (157h7m17.436463612s) [noise=true , address=104.36.82.39:4730 , piece_id=JMLLOGZJQ5VTQNX45BCKJYYFQRUEZKWEILPKXPBN3QAY3CTHMSLA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.707189931 (157h7m17.438457582s) [noise=true , address=104.36.82.44:4874 , piece_id=IHQOLDNJVK62JZJNTSR4LVMBUQAA37N67SPDBLOQRP5KORA3IADQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.707531894 (157h7m17.438799545s) [noise=true , address=104.36.82.13:4194 , piece_id=CDW55I44ELFZBFNCZPA3RXF3IWFLM72LNW4DHCM7RTVLHPXE3H3Q, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.716876097 (157h7m17.448143757s) [noise=true , address=104.36.82.59:4335 , piece_id=3WUBSCYSGNCEFBD7YGNTLBOZPMMNNSZ3ZMFNBMQEDA7M4ECTXRSQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.720591954 (157h7m17.451859614s) [noise=true , address=104.36.82.5:4855 , piece_id=Y7SDREJSKPZ5JEVWMI76HYUZAEBM5SIHIY7EXQ2TA6CYGV4UWMPQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.721439278 (157h7m17.452706928s) [noise=true , address=104.36.82.23:4472 , piece_id=U2GFGSBMQCAGLQICGWGUP4YMONIUKPQLP7YYBXHNMZYQONADPWKA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.721470266 (157h7m17.452737916s) [seg_pos={0 0}, upload=163504]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:33:36.721647930 (157h7m17.45291558s) [noise=true , address=79.127.220.97:4386 , piece_id=NZG46SVSN2YKOHVYBPIONXKZN7JQSO7E54I5ZX3OPTJ6ID2LUV2Q, seg_pos={0 0}, upload=163504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Jbx3fU6YtQjbYHz8zmeBricToeR3dLJBoS5N4gHPhJWgcpiu7): protocol: expected piece hash; context canceled; EOF
Aug 15 06:33:36.721809062 (157h7m17.453076713s) [noise=true , address=104.36.82.21:4474 , piece_id=YHCYIPHJUVKFMJYMBTSC6I4ECUSXXSR7FCOZNPHAIM57WN4KFLDQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH): protocol: expected piece hash; context canceled; EOF
Aug 15 06:33:36.721957362 (157h7m17.453225012s) [noise=true , address=66.23.193.175:4554 , piece_id=46LHPSSBFNJFXHCHMKJEQGLJVRCGECQ5OMXSPESEK2NSVQREYVOA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CraGuuckkbKe5PDLUvwF5G2ATUbgdR5g192YjkZgmP3JpqgXi): protocol: read tcp 5.161.89.252:24894->66.23.193.175:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 06:33:36.722054555 (157h7m17.453322205s) [noise=true , address=79.127.201.215:4355 , piece_id=OHRONBVUSBAL5XTKJ7TNQFGSIJDC7XKTL2IUKPECPM5VS3RDB7SQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: read tcp 5.161.89.252:40562->79.127.201.215:4355: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 06:33:36.722070524 (157h7m17.453338175s) [seg_pos={0 0}, upload=163504]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:33:36.722144995 (157h7m17.453412644s) [upload=163504]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:33:36.722150886 (157h7m17.453418545s) [upload=163504]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:33:36.862109570 (157h7m17.5933772s) [upload=163504]: Done uploading segments...
Aug 15 06:33:36.862123436 (157h7m17.593391066s) [upload=163504]: Upload finished. err: <nil>
Duration: 320.846376ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................................X......X................] duration:
162.382753ms
FAIL (2025-08-15 06:35:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:23:13.158332703 (156h56m53.889600322s) [upload=163318]: Starting upload Aug 15 06:23:13.158381314 (156h56m53.889648933s) [upload=163318]: Done starting upload Aug 15 06:23:13.158431398 (156h56m53.889699018s) [upload=163318]: Uploading segments... Aug 15 06:23:13.158487664 (156h56m53.889755294s) [upload=163318]: Got next segment. Inline: true Aug 15 06:23:13.158492433 (156h56m53.889760053s) [upload=163318]: Waiting for error group managing segments... Aug 15 06:23:13.158525365 (156h56m53.889792995s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:23:13.158529061 (156h56m53.889796691s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:23:13.158531456 (156h56m53.889799086s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:23:13.160759987 (156h56m53.892027617s) [upload=163318]: Done uploading segments... Aug 15 06:23:13.160774924 (156h56m53.892042554s) [upload=163318]: Upload finished. err: metaclient: Too Many Requests
Duration: 162.403281ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
401.581949ms
FAIL (2025-08-15 06:35:43 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 06:33:36.516249777 (157h7m17.247517427s) [upload=163504]: Starting upload
Aug 15 06:33:36.516325700 (157h7m17.24759335s) [upload=163504]: Done starting upload
Aug 15 06:33:36.516415789 (157h7m17.247683439s) [upload=163504]: Uploading segments...
Aug 15 06:33:36.516666019 (157h7m17.24793366s) [upload=163504]: Got next segment. Inline: false
Aug 15 06:33:36.516707888 (157h7m17.247975538s) [upload=163504]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:33:36.516713138 (157h7m17.247980778s) [upload=163504]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:33:36.552416448 (157h7m17.283684108s) [seg_pos={0 0}, upload=163504]: Begin upload segment...
Aug 15 06:33:36.552473917 (157h7m17.283741577s) [seg_pos={0 0}, upload=163504]: Done begin upload segment.
Aug 15 06:33:36.552511588 (157h7m17.283779248s) [noise=true , address=104.36.82.13:4194 , piece_id=CDW55I44ELFZBFNCZPA3RXF3IWFLM72LNW4DHCM7RTVLHPXE3H3Q, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.552533159 (157h7m17.283800808s) [noise=true , address=66.23.193.175:4554 , piece_id=46LHPSSBFNJFXHCHMKJEQGLJVRCGECQ5OMXSPESEK2NSVQREYVOA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.552974057 (157h7m17.284241707s) [noise=true , address=104.36.82.59:4335 , piece_id=3WUBSCYSGNCEFBD7YGNTLBOZPMMNNSZ3ZMFNBMQEDA7M4ECTXRSQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.552996339 (157h7m17.284263999s) [noise=true , address=104.36.82.60:4370 , piece_id=NBJ2HKMDL4LIBQQSZWZTLMOG6UK6LGZQGYDLLQH2HL5VYN5P2GYQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.553375322 (157h7m17.284642972s) [noise=true , address=104.36.82.44:4874 , piece_id=IHQOLDNJVK62JZJNTSR4LVMBUQAA37N67SPDBLOQRP5KORA3IADQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.553509063 (157h7m17.284776714s) [noise=true , address=104.36.82.5:4855 , piece_id=Y7SDREJSKPZ5JEVWMI76HYUZAEBM5SIHIY7EXQ2TA6CYGV4UWMPQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.553736882 (157h7m17.285004532s) [noise=true , address=77.90.31.12:4602 , piece_id=NXXNJWP5CRGTSJ4YKZBGNSJMJDFOYCVDM7C7FYM2PBHAVL2ARTFA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.553922621 (157h7m17.285190271s) [noise=true , address=104.36.82.39:4730 , piece_id=JMLLOGZJQ5VTQNX45BCKJYYFQRUEZKWEILPKXPBN3QAY3CTHMSLA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.554092040 (157h7m17.2853597s) [noise=true , address=104.36.82.23:4472 , piece_id=U2GFGSBMQCAGLQICGWGUP4YMONIUKPQLP7YYBXHNMZYQONADPWKA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.554318536 (157h7m17.285586196s) [noise=true , address=79.127.220.97:4386 , piece_id=NZG46SVSN2YKOHVYBPIONXKZN7JQSO7E54I5ZX3OPTJ6ID2LUV2Q, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.554481192 (157h7m17.285748842s) [noise=true , address=77.90.31.13:4640 , piece_id=ERJ7JNUYPM2A4BWJUAN2O2CSPACDA5MEKJ2X3ITEPTU5UFF5OH2Q, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.554773531 (157h7m17.286041181s) [noise=true , address=77.90.31.10:4539 , piece_id=UP7X2AHNE4BT7LTM5UADL3SLA57SJD5CFVN6QX5F4UEJXYV4ZSXQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.554858801 (157h7m17.286126451s) [noise=true , address=77.90.31.16:4746 , piece_id=S4RIKDEJU7HYPJDV7UD2JHO42EPGAX4AGEDPCGQL6CP3ZI5EEZIA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.555150570 (157h7m17.28641822s) [noise=true , address=77.90.31.15:4706 , piece_id=DZKEHW2MYN7GTML5GPMHFNL6LU6HPYPJAHUEBOXMIOCCJFLOL27Q, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.555226873 (157h7m17.286494523s) [noise=true , address=104.36.82.36:4651 , piece_id=RSTYC6KI7OIX4RLJGKT4NBSBC7ZDNKH7L2PGCV7A5ACH6AFEVO2A, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.555545372 (157h7m17.286813023s) [noise=true , address=104.36.82.21:4474 , piece_id=YHCYIPHJUVKFMJYMBTSC6I4ECUSXXSR7FCOZNPHAIM57WN4KFLDQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.555612218 (157h7m17.286879868s) [noise=true , address=79.127.201.215:4355 , piece_id=OHRONBVUSBAL5XTKJ7TNQFGSIJDC7XKTL2IUKPECPM5VS3RDB7SQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.558465745 (157h7m17.289733395s) [noise=true , address=77.90.31.21:4885 , piece_id=OPMXMKLQRYIUW6IYQODE3RY4MFJD63Q36CQUCDCSWTXGF5DD5BZA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.687128406 (157h7m17.418396056s) [upload=163504]: Next returned nil segment
Aug 15 06:33:36.687143674 (157h7m17.418411325s) [upload=163504]: Waiting for error group managing segments...
Aug 15 06:33:36.698108274 (157h7m17.429375924s) [noise=true , address=77.90.31.21:4885 , piece_id=OPMXMKLQRYIUW6IYQODE3RY4MFJD63Q36CQUCDCSWTXGF5DD5BZA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.700065474 (157h7m17.431333133s) [noise=true , address=77.90.31.16:4746 , piece_id=S4RIKDEJU7HYPJDV7UD2JHO42EPGAX4AGEDPCGQL6CP3ZI5EEZIA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.700184548 (157h7m17.431452197s) [noise=true , address=77.90.31.15:4706 , piece_id=DZKEHW2MYN7GTML5GPMHFNL6LU6HPYPJAHUEBOXMIOCCJFLOL27Q, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.700939537 (157h7m17.432207188s) [noise=true , address=77.90.31.12:4602 , piece_id=NXXNJWP5CRGTSJ4YKZBGNSJMJDFOYCVDM7C7FYM2PBHAVL2ARTFA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.701136878 (157h7m17.432404529s) [noise=true , address=77.90.31.10:4539 , piece_id=UP7X2AHNE4BT7LTM5UADL3SLA57SJD5CFVN6QX5F4UEJXYV4ZSXQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.701917577 (157h7m17.433185227s) [noise=true , address=77.90.31.13:4640 , piece_id=ERJ7JNUYPM2A4BWJUAN2O2CSPACDA5MEKJ2X3ITEPTU5UFF5OH2Q, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.702410894 (157h7m17.433678544s) [noise=true , address=104.36.82.60:4370 , piece_id=NBJ2HKMDL4LIBQQSZWZTLMOG6UK6LGZQGYDLLQH2HL5VYN5P2GYQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.705035319 (157h7m17.43630297s) [noise=true , address=104.36.82.36:4651 , piece_id=RSTYC6KI7OIX4RLJGKT4NBSBC7ZDNKH7L2PGCV7A5ACH6AFEVO2A, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.705195951 (157h7m17.436463612s) [noise=true , address=104.36.82.39:4730 , piece_id=JMLLOGZJQ5VTQNX45BCKJYYFQRUEZKWEILPKXPBN3QAY3CTHMSLA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.707189931 (157h7m17.438457582s) [noise=true , address=104.36.82.44:4874 , piece_id=IHQOLDNJVK62JZJNTSR4LVMBUQAA37N67SPDBLOQRP5KORA3IADQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.707531894 (157h7m17.438799545s) [noise=true , address=104.36.82.13:4194 , piece_id=CDW55I44ELFZBFNCZPA3RXF3IWFLM72LNW4DHCM7RTVLHPXE3H3Q, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.716876097 (157h7m17.448143757s) [noise=true , address=104.36.82.59:4335 , piece_id=3WUBSCYSGNCEFBD7YGNTLBOZPMMNNSZ3ZMFNBMQEDA7M4ECTXRSQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.720591954 (157h7m17.451859614s) [noise=true , address=104.36.82.5:4855 , piece_id=Y7SDREJSKPZ5JEVWMI76HYUZAEBM5SIHIY7EXQ2TA6CYGV4UWMPQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.721439278 (157h7m17.452706928s) [noise=true , address=104.36.82.23:4472 , piece_id=U2GFGSBMQCAGLQICGWGUP4YMONIUKPQLP7YYBXHNMZYQONADPWKA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.721470266 (157h7m17.452737916s) [seg_pos={0 0}, upload=163504]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:33:36.721647930 (157h7m17.45291558s) [noise=true , address=79.127.220.97:4386 , piece_id=NZG46SVSN2YKOHVYBPIONXKZN7JQSO7E54I5ZX3OPTJ6ID2LUV2Q, seg_pos={0 0}, upload=163504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Jbx3fU6YtQjbYHz8zmeBricToeR3dLJBoS5N4gHPhJWgcpiu7): protocol: expected piece hash; context canceled; EOF
Aug 15 06:33:36.721809062 (157h7m17.453076713s) [noise=true , address=104.36.82.21:4474 , piece_id=YHCYIPHJUVKFMJYMBTSC6I4ECUSXXSR7FCOZNPHAIM57WN4KFLDQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH): protocol: expected piece hash; context canceled; EOF
Aug 15 06:33:36.721957362 (157h7m17.453225012s) [noise=true , address=66.23.193.175:4554 , piece_id=46LHPSSBFNJFXHCHMKJEQGLJVRCGECQ5OMXSPESEK2NSVQREYVOA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CraGuuckkbKe5PDLUvwF5G2ATUbgdR5g192YjkZgmP3JpqgXi): protocol: read tcp 5.161.89.252:24894->66.23.193.175:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 06:33:36.722054555 (157h7m17.453322205s) [noise=true , address=79.127.201.215:4355 , piece_id=OHRONBVUSBAL5XTKJ7TNQFGSIJDC7XKTL2IUKPECPM5VS3RDB7SQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: read tcp 5.161.89.252:40562->79.127.201.215:4355: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 06:33:36.722070524 (157h7m17.453338175s) [seg_pos={0 0}, upload=163504]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:33:36.722144995 (157h7m17.453412644s) [upload=163504]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:33:36.722150886 (157h7m17.453418545s) [upload=163504]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:33:36.862109570 (157h7m17.5933772s) [upload=163504]: Done uploading segments...
Aug 15 06:33:36.862123436 (157h7m17.593391066s) [upload=163504]: Upload finished. err: <nil>
Duration: 401.629568ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
552.363476ms
FAIL (2025-08-15 06:35:05 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 06:33:36.516249777 (157h7m17.247517427s) [upload=163504]: Starting upload
Aug 15 06:33:36.516325700 (157h7m17.24759335s) [upload=163504]: Done starting upload
Aug 15 06:33:36.516415789 (157h7m17.247683439s) [upload=163504]: Uploading segments...
Aug 15 06:33:36.516666019 (157h7m17.24793366s) [upload=163504]: Got next segment. Inline: false
Aug 15 06:33:36.516707888 (157h7m17.247975538s) [upload=163504]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:33:36.516713138 (157h7m17.247980778s) [upload=163504]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:33:36.552416448 (157h7m17.283684108s) [seg_pos={0 0}, upload=163504]: Begin upload segment...
Aug 15 06:33:36.552473917 (157h7m17.283741577s) [seg_pos={0 0}, upload=163504]: Done begin upload segment.
Aug 15 06:33:36.552511588 (157h7m17.283779248s) [noise=true , address=104.36.82.13:4194 , piece_id=CDW55I44ELFZBFNCZPA3RXF3IWFLM72LNW4DHCM7RTVLHPXE3H3Q, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.552533159 (157h7m17.283800808s) [noise=true , address=66.23.193.175:4554 , piece_id=46LHPSSBFNJFXHCHMKJEQGLJVRCGECQ5OMXSPESEK2NSVQREYVOA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.552974057 (157h7m17.284241707s) [noise=true , address=104.36.82.59:4335 , piece_id=3WUBSCYSGNCEFBD7YGNTLBOZPMMNNSZ3ZMFNBMQEDA7M4ECTXRSQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.552996339 (157h7m17.284263999s) [noise=true , address=104.36.82.60:4370 , piece_id=NBJ2HKMDL4LIBQQSZWZTLMOG6UK6LGZQGYDLLQH2HL5VYN5P2GYQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.553375322 (157h7m17.284642972s) [noise=true , address=104.36.82.44:4874 , piece_id=IHQOLDNJVK62JZJNTSR4LVMBUQAA37N67SPDBLOQRP5KORA3IADQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.553509063 (157h7m17.284776714s) [noise=true , address=104.36.82.5:4855 , piece_id=Y7SDREJSKPZ5JEVWMI76HYUZAEBM5SIHIY7EXQ2TA6CYGV4UWMPQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.553736882 (157h7m17.285004532s) [noise=true , address=77.90.31.12:4602 , piece_id=NXXNJWP5CRGTSJ4YKZBGNSJMJDFOYCVDM7C7FYM2PBHAVL2ARTFA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.553922621 (157h7m17.285190271s) [noise=true , address=104.36.82.39:4730 , piece_id=JMLLOGZJQ5VTQNX45BCKJYYFQRUEZKWEILPKXPBN3QAY3CTHMSLA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.554092040 (157h7m17.2853597s) [noise=true , address=104.36.82.23:4472 , piece_id=U2GFGSBMQCAGLQICGWGUP4YMONIUKPQLP7YYBXHNMZYQONADPWKA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.554318536 (157h7m17.285586196s) [noise=true , address=79.127.220.97:4386 , piece_id=NZG46SVSN2YKOHVYBPIONXKZN7JQSO7E54I5ZX3OPTJ6ID2LUV2Q, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.554481192 (157h7m17.285748842s) [noise=true , address=77.90.31.13:4640 , piece_id=ERJ7JNUYPM2A4BWJUAN2O2CSPACDA5MEKJ2X3ITEPTU5UFF5OH2Q, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.554773531 (157h7m17.286041181s) [noise=true , address=77.90.31.10:4539 , piece_id=UP7X2AHNE4BT7LTM5UADL3SLA57SJD5CFVN6QX5F4UEJXYV4ZSXQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.554858801 (157h7m17.286126451s) [noise=true , address=77.90.31.16:4746 , piece_id=S4RIKDEJU7HYPJDV7UD2JHO42EPGAX4AGEDPCGQL6CP3ZI5EEZIA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.555150570 (157h7m17.28641822s) [noise=true , address=77.90.31.15:4706 , piece_id=DZKEHW2MYN7GTML5GPMHFNL6LU6HPYPJAHUEBOXMIOCCJFLOL27Q, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.555226873 (157h7m17.286494523s) [noise=true , address=104.36.82.36:4651 , piece_id=RSTYC6KI7OIX4RLJGKT4NBSBC7ZDNKH7L2PGCV7A5ACH6AFEVO2A, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.555545372 (157h7m17.286813023s) [noise=true , address=104.36.82.21:4474 , piece_id=YHCYIPHJUVKFMJYMBTSC6I4ECUSXXSR7FCOZNPHAIM57WN4KFLDQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.555612218 (157h7m17.286879868s) [noise=true , address=79.127.201.215:4355 , piece_id=OHRONBVUSBAL5XTKJ7TNQFGSIJDC7XKTL2IUKPECPM5VS3RDB7SQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.558465745 (157h7m17.289733395s) [noise=true , address=77.90.31.21:4885 , piece_id=OPMXMKLQRYIUW6IYQODE3RY4MFJD63Q36CQUCDCSWTXGF5DD5BZA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.687128406 (157h7m17.418396056s) [upload=163504]: Next returned nil segment
Aug 15 06:33:36.687143674 (157h7m17.418411325s) [upload=163504]: Waiting for error group managing segments...
Aug 15 06:33:36.698108274 (157h7m17.429375924s) [noise=true , address=77.90.31.21:4885 , piece_id=OPMXMKLQRYIUW6IYQODE3RY4MFJD63Q36CQUCDCSWTXGF5DD5BZA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.700065474 (157h7m17.431333133s) [noise=true , address=77.90.31.16:4746 , piece_id=S4RIKDEJU7HYPJDV7UD2JHO42EPGAX4AGEDPCGQL6CP3ZI5EEZIA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.700184548 (157h7m17.431452197s) [noise=true , address=77.90.31.15:4706 , piece_id=DZKEHW2MYN7GTML5GPMHFNL6LU6HPYPJAHUEBOXMIOCCJFLOL27Q, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.700939537 (157h7m17.432207188s) [noise=true , address=77.90.31.12:4602 , piece_id=NXXNJWP5CRGTSJ4YKZBGNSJMJDFOYCVDM7C7FYM2PBHAVL2ARTFA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.701136878 (157h7m17.432404529s) [noise=true , address=77.90.31.10:4539 , piece_id=UP7X2AHNE4BT7LTM5UADL3SLA57SJD5CFVN6QX5F4UEJXYV4ZSXQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.701917577 (157h7m17.433185227s) [noise=true , address=77.90.31.13:4640 , piece_id=ERJ7JNUYPM2A4BWJUAN2O2CSPACDA5MEKJ2X3ITEPTU5UFF5OH2Q, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.702410894 (157h7m17.433678544s) [noise=true , address=104.36.82.60:4370 , piece_id=NBJ2HKMDL4LIBQQSZWZTLMOG6UK6LGZQGYDLLQH2HL5VYN5P2GYQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.705035319 (157h7m17.43630297s) [noise=true , address=104.36.82.36:4651 , piece_id=RSTYC6KI7OIX4RLJGKT4NBSBC7ZDNKH7L2PGCV7A5ACH6AFEVO2A, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.705195951 (157h7m17.436463612s) [noise=true , address=104.36.82.39:4730 , piece_id=JMLLOGZJQ5VTQNX45BCKJYYFQRUEZKWEILPKXPBN3QAY3CTHMSLA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.707189931 (157h7m17.438457582s) [noise=true , address=104.36.82.44:4874 , piece_id=IHQOLDNJVK62JZJNTSR4LVMBUQAA37N67SPDBLOQRP5KORA3IADQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.707531894 (157h7m17.438799545s) [noise=true , address=104.36.82.13:4194 , piece_id=CDW55I44ELFZBFNCZPA3RXF3IWFLM72LNW4DHCM7RTVLHPXE3H3Q, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.716876097 (157h7m17.448143757s) [noise=true , address=104.36.82.59:4335 , piece_id=3WUBSCYSGNCEFBD7YGNTLBOZPMMNNSZ3ZMFNBMQEDA7M4ECTXRSQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.720591954 (157h7m17.451859614s) [noise=true , address=104.36.82.5:4855 , piece_id=Y7SDREJSKPZ5JEVWMI76HYUZAEBM5SIHIY7EXQ2TA6CYGV4UWMPQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.721439278 (157h7m17.452706928s) [noise=true , address=104.36.82.23:4472 , piece_id=U2GFGSBMQCAGLQICGWGUP4YMONIUKPQLP7YYBXHNMZYQONADPWKA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.721470266 (157h7m17.452737916s) [seg_pos={0 0}, upload=163504]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:33:36.721647930 (157h7m17.45291558s) [noise=true , address=79.127.220.97:4386 , piece_id=NZG46SVSN2YKOHVYBPIONXKZN7JQSO7E54I5ZX3OPTJ6ID2LUV2Q, seg_pos={0 0}, upload=163504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Jbx3fU6YtQjbYHz8zmeBricToeR3dLJBoS5N4gHPhJWgcpiu7): protocol: expected piece hash; context canceled; EOF
Aug 15 06:33:36.721809062 (157h7m17.453076713s) [noise=true , address=104.36.82.21:4474 , piece_id=YHCYIPHJUVKFMJYMBTSC6I4ECUSXXSR7FCOZNPHAIM57WN4KFLDQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH): protocol: expected piece hash; context canceled; EOF
Aug 15 06:33:36.721957362 (157h7m17.453225012s) [noise=true , address=66.23.193.175:4554 , piece_id=46LHPSSBFNJFXHCHMKJEQGLJVRCGECQ5OMXSPESEK2NSVQREYVOA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CraGuuckkbKe5PDLUvwF5G2ATUbgdR5g192YjkZgmP3JpqgXi): protocol: read tcp 5.161.89.252:24894->66.23.193.175:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 06:33:36.722054555 (157h7m17.453322205s) [noise=true , address=79.127.201.215:4355 , piece_id=OHRONBVUSBAL5XTKJ7TNQFGSIJDC7XKTL2IUKPECPM5VS3RDB7SQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: read tcp 5.161.89.252:40562->79.127.201.215:4355: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 06:33:36.722070524 (157h7m17.453338175s) [seg_pos={0 0}, upload=163504]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:33:36.722144995 (157h7m17.453412644s) [upload=163504]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:33:36.722150886 (157h7m17.453418545s) [upload=163504]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:33:36.862109570 (157h7m17.5933772s) [upload=163504]: Done uploading segments...
Aug 15 06:33:36.862123436 (157h7m17.593391066s) [upload=163504]: Upload finished. err: <nil>
Duration: 552.388783ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X......X...............] duration:
120.95081ms
FAIL (2025-08-15 06:34:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:23:13.158332703 (156h56m53.889600322s) [upload=163318]: Starting upload Aug 15 06:23:13.158381314 (156h56m53.889648933s) [upload=163318]: Done starting upload Aug 15 06:23:13.158431398 (156h56m53.889699018s) [upload=163318]: Uploading segments... Aug 15 06:23:13.158487664 (156h56m53.889755294s) [upload=163318]: Got next segment. Inline: true Aug 15 06:23:13.158492433 (156h56m53.889760053s) [upload=163318]: Waiting for error group managing segments... Aug 15 06:23:13.158525365 (156h56m53.889792995s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:23:13.158529061 (156h56m53.889796691s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:23:13.158531456 (156h56m53.889799086s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:23:13.160759987 (156h56m53.892027617s) [upload=163318]: Done uploading segments... Aug 15 06:23:13.160774924 (156h56m53.892042554s) [upload=163318]: Upload finished. err: metaclient: Too Many Requests
Duration: 120.980165ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................................X......X..............] duration:
193.796037ms
FAIL (2025-08-15 06:34:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:23:13.158332703 (156h56m53.889600322s) [upload=163318]: Starting upload Aug 15 06:23:13.158381314 (156h56m53.889648933s) [upload=163318]: Done starting upload Aug 15 06:23:13.158431398 (156h56m53.889699018s) [upload=163318]: Uploading segments... Aug 15 06:23:13.158487664 (156h56m53.889755294s) [upload=163318]: Got next segment. Inline: true Aug 15 06:23:13.158492433 (156h56m53.889760053s) [upload=163318]: Waiting for error group managing segments... Aug 15 06:23:13.158525365 (156h56m53.889792995s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:23:13.158529061 (156h56m53.889796691s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:23:13.158531456 (156h56m53.889799086s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:23:13.160759987 (156h56m53.892027617s) [upload=163318]: Done uploading segments... Aug 15 06:23:13.160774924 (156h56m53.892042554s) [upload=163318]: Upload finished. err: metaclient: Too Many Requests
Duration: 193.815112ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
377.308724ms
FAIL (2025-08-15 06:34:19 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 06:33:36.516249777 (157h7m17.247517427s) [upload=163504]: Starting upload
Aug 15 06:33:36.516325700 (157h7m17.24759335s) [upload=163504]: Done starting upload
Aug 15 06:33:36.516415789 (157h7m17.247683439s) [upload=163504]: Uploading segments...
Aug 15 06:33:36.516666019 (157h7m17.24793366s) [upload=163504]: Got next segment. Inline: false
Aug 15 06:33:36.516707888 (157h7m17.247975538s) [upload=163504]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:33:36.516713138 (157h7m17.247980778s) [upload=163504]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:33:36.552416448 (157h7m17.283684108s) [seg_pos={0 0}, upload=163504]: Begin upload segment...
Aug 15 06:33:36.552473917 (157h7m17.283741577s) [seg_pos={0 0}, upload=163504]: Done begin upload segment.
Aug 15 06:33:36.552511588 (157h7m17.283779248s) [noise=true , address=104.36.82.13:4194 , piece_id=CDW55I44ELFZBFNCZPA3RXF3IWFLM72LNW4DHCM7RTVLHPXE3H3Q, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.552533159 (157h7m17.283800808s) [noise=true , address=66.23.193.175:4554 , piece_id=46LHPSSBFNJFXHCHMKJEQGLJVRCGECQ5OMXSPESEK2NSVQREYVOA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.552974057 (157h7m17.284241707s) [noise=true , address=104.36.82.59:4335 , piece_id=3WUBSCYSGNCEFBD7YGNTLBOZPMMNNSZ3ZMFNBMQEDA7M4ECTXRSQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.552996339 (157h7m17.284263999s) [noise=true , address=104.36.82.60:4370 , piece_id=NBJ2HKMDL4LIBQQSZWZTLMOG6UK6LGZQGYDLLQH2HL5VYN5P2GYQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.553375322 (157h7m17.284642972s) [noise=true , address=104.36.82.44:4874 , piece_id=IHQOLDNJVK62JZJNTSR4LVMBUQAA37N67SPDBLOQRP5KORA3IADQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.553509063 (157h7m17.284776714s) [noise=true , address=104.36.82.5:4855 , piece_id=Y7SDREJSKPZ5JEVWMI76HYUZAEBM5SIHIY7EXQ2TA6CYGV4UWMPQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.553736882 (157h7m17.285004532s) [noise=true , address=77.90.31.12:4602 , piece_id=NXXNJWP5CRGTSJ4YKZBGNSJMJDFOYCVDM7C7FYM2PBHAVL2ARTFA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.553922621 (157h7m17.285190271s) [noise=true , address=104.36.82.39:4730 , piece_id=JMLLOGZJQ5VTQNX45BCKJYYFQRUEZKWEILPKXPBN3QAY3CTHMSLA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.554092040 (157h7m17.2853597s) [noise=true , address=104.36.82.23:4472 , piece_id=U2GFGSBMQCAGLQICGWGUP4YMONIUKPQLP7YYBXHNMZYQONADPWKA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.554318536 (157h7m17.285586196s) [noise=true , address=79.127.220.97:4386 , piece_id=NZG46SVSN2YKOHVYBPIONXKZN7JQSO7E54I5ZX3OPTJ6ID2LUV2Q, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.554481192 (157h7m17.285748842s) [noise=true , address=77.90.31.13:4640 , piece_id=ERJ7JNUYPM2A4BWJUAN2O2CSPACDA5MEKJ2X3ITEPTU5UFF5OH2Q, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.554773531 (157h7m17.286041181s) [noise=true , address=77.90.31.10:4539 , piece_id=UP7X2AHNE4BT7LTM5UADL3SLA57SJD5CFVN6QX5F4UEJXYV4ZSXQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.554858801 (157h7m17.286126451s) [noise=true , address=77.90.31.16:4746 , piece_id=S4RIKDEJU7HYPJDV7UD2JHO42EPGAX4AGEDPCGQL6CP3ZI5EEZIA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.555150570 (157h7m17.28641822s) [noise=true , address=77.90.31.15:4706 , piece_id=DZKEHW2MYN7GTML5GPMHFNL6LU6HPYPJAHUEBOXMIOCCJFLOL27Q, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.555226873 (157h7m17.286494523s) [noise=true , address=104.36.82.36:4651 , piece_id=RSTYC6KI7OIX4RLJGKT4NBSBC7ZDNKH7L2PGCV7A5ACH6AFEVO2A, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.555545372 (157h7m17.286813023s) [noise=true , address=104.36.82.21:4474 , piece_id=YHCYIPHJUVKFMJYMBTSC6I4ECUSXXSR7FCOZNPHAIM57WN4KFLDQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.555612218 (157h7m17.286879868s) [noise=true , address=79.127.201.215:4355 , piece_id=OHRONBVUSBAL5XTKJ7TNQFGSIJDC7XKTL2IUKPECPM5VS3RDB7SQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.558465745 (157h7m17.289733395s) [noise=true , address=77.90.31.21:4885 , piece_id=OPMXMKLQRYIUW6IYQODE3RY4MFJD63Q36CQUCDCSWTXGF5DD5BZA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.687128406 (157h7m17.418396056s) [upload=163504]: Next returned nil segment
Aug 15 06:33:36.687143674 (157h7m17.418411325s) [upload=163504]: Waiting for error group managing segments...
Aug 15 06:33:36.698108274 (157h7m17.429375924s) [noise=true , address=77.90.31.21:4885 , piece_id=OPMXMKLQRYIUW6IYQODE3RY4MFJD63Q36CQUCDCSWTXGF5DD5BZA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.700065474 (157h7m17.431333133s) [noise=true , address=77.90.31.16:4746 , piece_id=S4RIKDEJU7HYPJDV7UD2JHO42EPGAX4AGEDPCGQL6CP3ZI5EEZIA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.700184548 (157h7m17.431452197s) [noise=true , address=77.90.31.15:4706 , piece_id=DZKEHW2MYN7GTML5GPMHFNL6LU6HPYPJAHUEBOXMIOCCJFLOL27Q, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.700939537 (157h7m17.432207188s) [noise=true , address=77.90.31.12:4602 , piece_id=NXXNJWP5CRGTSJ4YKZBGNSJMJDFOYCVDM7C7FYM2PBHAVL2ARTFA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.701136878 (157h7m17.432404529s) [noise=true , address=77.90.31.10:4539 , piece_id=UP7X2AHNE4BT7LTM5UADL3SLA57SJD5CFVN6QX5F4UEJXYV4ZSXQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.701917577 (157h7m17.433185227s) [noise=true , address=77.90.31.13:4640 , piece_id=ERJ7JNUYPM2A4BWJUAN2O2CSPACDA5MEKJ2X3ITEPTU5UFF5OH2Q, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.702410894 (157h7m17.433678544s) [noise=true , address=104.36.82.60:4370 , piece_id=NBJ2HKMDL4LIBQQSZWZTLMOG6UK6LGZQGYDLLQH2HL5VYN5P2GYQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.705035319 (157h7m17.43630297s) [noise=true , address=104.36.82.36:4651 , piece_id=RSTYC6KI7OIX4RLJGKT4NBSBC7ZDNKH7L2PGCV7A5ACH6AFEVO2A, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.705195951 (157h7m17.436463612s) [noise=true , address=104.36.82.39:4730 , piece_id=JMLLOGZJQ5VTQNX45BCKJYYFQRUEZKWEILPKXPBN3QAY3CTHMSLA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.707189931 (157h7m17.438457582s) [noise=true , address=104.36.82.44:4874 , piece_id=IHQOLDNJVK62JZJNTSR4LVMBUQAA37N67SPDBLOQRP5KORA3IADQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.707531894 (157h7m17.438799545s) [noise=true , address=104.36.82.13:4194 , piece_id=CDW55I44ELFZBFNCZPA3RXF3IWFLM72LNW4DHCM7RTVLHPXE3H3Q, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.716876097 (157h7m17.448143757s) [noise=true , address=104.36.82.59:4335 , piece_id=3WUBSCYSGNCEFBD7YGNTLBOZPMMNNSZ3ZMFNBMQEDA7M4ECTXRSQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.720591954 (157h7m17.451859614s) [noise=true , address=104.36.82.5:4855 , piece_id=Y7SDREJSKPZ5JEVWMI76HYUZAEBM5SIHIY7EXQ2TA6CYGV4UWMPQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.721439278 (157h7m17.452706928s) [noise=true , address=104.36.82.23:4472 , piece_id=U2GFGSBMQCAGLQICGWGUP4YMONIUKPQLP7YYBXHNMZYQONADPWKA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.721470266 (157h7m17.452737916s) [seg_pos={0 0}, upload=163504]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:33:36.721647930 (157h7m17.45291558s) [noise=true , address=79.127.220.97:4386 , piece_id=NZG46SVSN2YKOHVYBPIONXKZN7JQSO7E54I5ZX3OPTJ6ID2LUV2Q, seg_pos={0 0}, upload=163504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Jbx3fU6YtQjbYHz8zmeBricToeR3dLJBoS5N4gHPhJWgcpiu7): protocol: expected piece hash; context canceled; EOF
Aug 15 06:33:36.721809062 (157h7m17.453076713s) [noise=true , address=104.36.82.21:4474 , piece_id=YHCYIPHJUVKFMJYMBTSC6I4ECUSXXSR7FCOZNPHAIM57WN4KFLDQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH): protocol: expected piece hash; context canceled; EOF
Aug 15 06:33:36.721957362 (157h7m17.453225012s) [noise=true , address=66.23.193.175:4554 , piece_id=46LHPSSBFNJFXHCHMKJEQGLJVRCGECQ5OMXSPESEK2NSVQREYVOA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CraGuuckkbKe5PDLUvwF5G2ATUbgdR5g192YjkZgmP3JpqgXi): protocol: read tcp 5.161.89.252:24894->66.23.193.175:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 06:33:36.722054555 (157h7m17.453322205s) [noise=true , address=79.127.201.215:4355 , piece_id=OHRONBVUSBAL5XTKJ7TNQFGSIJDC7XKTL2IUKPECPM5VS3RDB7SQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: read tcp 5.161.89.252:40562->79.127.201.215:4355: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 06:33:36.722070524 (157h7m17.453338175s) [seg_pos={0 0}, upload=163504]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:33:36.722144995 (157h7m17.453412644s) [upload=163504]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:33:36.722150886 (157h7m17.453418545s) [upload=163504]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:33:36.862109570 (157h7m17.5933772s) [upload=163504]: Done uploading segments...
Aug 15 06:33:36.862123436 (157h7m17.593391066s) [upload=163504]: Upload finished. err: <nil>
Duration: 377.332909ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................................X......X.............] duration:
120.584942ms
FAIL (2025-08-15 06:33:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:23:13.158332703 (156h56m53.889600322s) [upload=163318]: Starting upload Aug 15 06:23:13.158381314 (156h56m53.889648933s) [upload=163318]: Done starting upload Aug 15 06:23:13.158431398 (156h56m53.889699018s) [upload=163318]: Uploading segments... Aug 15 06:23:13.158487664 (156h56m53.889755294s) [upload=163318]: Got next segment. Inline: true Aug 15 06:23:13.158492433 (156h56m53.889760053s) [upload=163318]: Waiting for error group managing segments... Aug 15 06:23:13.158525365 (156h56m53.889792995s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:23:13.158529061 (156h56m53.889796691s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:23:13.158531456 (156h56m53.889799086s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:23:13.160759987 (156h56m53.892027617s) [upload=163318]: Done uploading segments... Aug 15 06:23:13.160774924 (156h56m53.892042554s) [upload=163318]: Upload finished. err: metaclient: Too Many Requests
Duration: 120.604467ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
417.37037ms
FAIL (2025-08-15 06:33:36 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 15 06:33:36.516249777 (157h7m17.247517427s) [upload=163504]: Starting upload
Aug 15 06:33:36.516325700 (157h7m17.24759335s) [upload=163504]: Done starting upload
Aug 15 06:33:36.516415789 (157h7m17.247683439s) [upload=163504]: Uploading segments...
Aug 15 06:33:36.516666019 (157h7m17.24793366s) [upload=163504]: Got next segment. Inline: false
Aug 15 06:33:36.516707888 (157h7m17.247975538s) [upload=163504]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 06:33:36.516713138 (157h7m17.247980778s) [upload=163504]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 06:33:36.552416448 (157h7m17.283684108s) [seg_pos={0 0}, upload=163504]: Begin upload segment...
Aug 15 06:33:36.552473917 (157h7m17.283741577s) [seg_pos={0 0}, upload=163504]: Done begin upload segment.
Aug 15 06:33:36.552511588 (157h7m17.283779248s) [noise=true , address=104.36.82.13:4194 , piece_id=CDW55I44ELFZBFNCZPA3RXF3IWFLM72LNW4DHCM7RTVLHPXE3H3Q, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.552533159 (157h7m17.283800808s) [noise=true , address=66.23.193.175:4554 , piece_id=46LHPSSBFNJFXHCHMKJEQGLJVRCGECQ5OMXSPESEK2NSVQREYVOA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.552974057 (157h7m17.284241707s) [noise=true , address=104.36.82.59:4335 , piece_id=3WUBSCYSGNCEFBD7YGNTLBOZPMMNNSZ3ZMFNBMQEDA7M4ECTXRSQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.552996339 (157h7m17.284263999s) [noise=true , address=104.36.82.60:4370 , piece_id=NBJ2HKMDL4LIBQQSZWZTLMOG6UK6LGZQGYDLLQH2HL5VYN5P2GYQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.553375322 (157h7m17.284642972s) [noise=true , address=104.36.82.44:4874 , piece_id=IHQOLDNJVK62JZJNTSR4LVMBUQAA37N67SPDBLOQRP5KORA3IADQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.553509063 (157h7m17.284776714s) [noise=true , address=104.36.82.5:4855 , piece_id=Y7SDREJSKPZ5JEVWMI76HYUZAEBM5SIHIY7EXQ2TA6CYGV4UWMPQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.553736882 (157h7m17.285004532s) [noise=true , address=77.90.31.12:4602 , piece_id=NXXNJWP5CRGTSJ4YKZBGNSJMJDFOYCVDM7C7FYM2PBHAVL2ARTFA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.553922621 (157h7m17.285190271s) [noise=true , address=104.36.82.39:4730 , piece_id=JMLLOGZJQ5VTQNX45BCKJYYFQRUEZKWEILPKXPBN3QAY3CTHMSLA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.554092040 (157h7m17.2853597s) [noise=true , address=104.36.82.23:4472 , piece_id=U2GFGSBMQCAGLQICGWGUP4YMONIUKPQLP7YYBXHNMZYQONADPWKA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.554318536 (157h7m17.285586196s) [noise=true , address=79.127.220.97:4386 , piece_id=NZG46SVSN2YKOHVYBPIONXKZN7JQSO7E54I5ZX3OPTJ6ID2LUV2Q, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.554481192 (157h7m17.285748842s) [noise=true , address=77.90.31.13:4640 , piece_id=ERJ7JNUYPM2A4BWJUAN2O2CSPACDA5MEKJ2X3ITEPTU5UFF5OH2Q, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.554773531 (157h7m17.286041181s) [noise=true , address=77.90.31.10:4539 , piece_id=UP7X2AHNE4BT7LTM5UADL3SLA57SJD5CFVN6QX5F4UEJXYV4ZSXQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.554858801 (157h7m17.286126451s) [noise=true , address=77.90.31.16:4746 , piece_id=S4RIKDEJU7HYPJDV7UD2JHO42EPGAX4AGEDPCGQL6CP3ZI5EEZIA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.555150570 (157h7m17.28641822s) [noise=true , address=77.90.31.15:4706 , piece_id=DZKEHW2MYN7GTML5GPMHFNL6LU6HPYPJAHUEBOXMIOCCJFLOL27Q, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.555226873 (157h7m17.286494523s) [noise=true , address=104.36.82.36:4651 , piece_id=RSTYC6KI7OIX4RLJGKT4NBSBC7ZDNKH7L2PGCV7A5ACH6AFEVO2A, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.555545372 (157h7m17.286813023s) [noise=true , address=104.36.82.21:4474 , piece_id=YHCYIPHJUVKFMJYMBTSC6I4ECUSXXSR7FCOZNPHAIM57WN4KFLDQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.555612218 (157h7m17.286879868s) [noise=true , address=79.127.201.215:4355 , piece_id=OHRONBVUSBAL5XTKJ7TNQFGSIJDC7XKTL2IUKPECPM5VS3RDB7SQ, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.558465745 (157h7m17.289733395s) [noise=true , address=77.90.31.21:4885 , piece_id=OPMXMKLQRYIUW6IYQODE3RY4MFJD63Q36CQUCDCSWTXGF5DD5BZA, seg_pos={0 0}, upload=163504]: Uploading piece...
Aug 15 06:33:36.687128406 (157h7m17.418396056s) [upload=163504]: Next returned nil segment
Aug 15 06:33:36.687143674 (157h7m17.418411325s) [upload=163504]: Waiting for error group managing segments...
Aug 15 06:33:36.698108274 (157h7m17.429375924s) [noise=true , address=77.90.31.21:4885 , piece_id=OPMXMKLQRYIUW6IYQODE3RY4MFJD63Q36CQUCDCSWTXGF5DD5BZA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.700065474 (157h7m17.431333133s) [noise=true , address=77.90.31.16:4746 , piece_id=S4RIKDEJU7HYPJDV7UD2JHO42EPGAX4AGEDPCGQL6CP3ZI5EEZIA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.700184548 (157h7m17.431452197s) [noise=true , address=77.90.31.15:4706 , piece_id=DZKEHW2MYN7GTML5GPMHFNL6LU6HPYPJAHUEBOXMIOCCJFLOL27Q, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.700939537 (157h7m17.432207188s) [noise=true , address=77.90.31.12:4602 , piece_id=NXXNJWP5CRGTSJ4YKZBGNSJMJDFOYCVDM7C7FYM2PBHAVL2ARTFA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.701136878 (157h7m17.432404529s) [noise=true , address=77.90.31.10:4539 , piece_id=UP7X2AHNE4BT7LTM5UADL3SLA57SJD5CFVN6QX5F4UEJXYV4ZSXQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.701917577 (157h7m17.433185227s) [noise=true , address=77.90.31.13:4640 , piece_id=ERJ7JNUYPM2A4BWJUAN2O2CSPACDA5MEKJ2X3ITEPTU5UFF5OH2Q, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.702410894 (157h7m17.433678544s) [noise=true , address=104.36.82.60:4370 , piece_id=NBJ2HKMDL4LIBQQSZWZTLMOG6UK6LGZQGYDLLQH2HL5VYN5P2GYQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.705035319 (157h7m17.43630297s) [noise=true , address=104.36.82.36:4651 , piece_id=RSTYC6KI7OIX4RLJGKT4NBSBC7ZDNKH7L2PGCV7A5ACH6AFEVO2A, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.705195951 (157h7m17.436463612s) [noise=true , address=104.36.82.39:4730 , piece_id=JMLLOGZJQ5VTQNX45BCKJYYFQRUEZKWEILPKXPBN3QAY3CTHMSLA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.707189931 (157h7m17.438457582s) [noise=true , address=104.36.82.44:4874 , piece_id=IHQOLDNJVK62JZJNTSR4LVMBUQAA37N67SPDBLOQRP5KORA3IADQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.707531894 (157h7m17.438799545s) [noise=true , address=104.36.82.13:4194 , piece_id=CDW55I44ELFZBFNCZPA3RXF3IWFLM72LNW4DHCM7RTVLHPXE3H3Q, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.716876097 (157h7m17.448143757s) [noise=true , address=104.36.82.59:4335 , piece_id=3WUBSCYSGNCEFBD7YGNTLBOZPMMNNSZ3ZMFNBMQEDA7M4ECTXRSQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.720591954 (157h7m17.451859614s) [noise=true , address=104.36.82.5:4855 , piece_id=Y7SDREJSKPZ5JEVWMI76HYUZAEBM5SIHIY7EXQ2TA6CYGV4UWMPQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.721439278 (157h7m17.452706928s) [noise=true , address=104.36.82.23:4472 , piece_id=U2GFGSBMQCAGLQICGWGUP4YMONIUKPQLP7YYBXHNMZYQONADPWKA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: <nil>
Aug 15 06:33:36.721470266 (157h7m17.452737916s) [seg_pos={0 0}, upload=163504]: Segment reached optimal threshold of 14 pieces.
Aug 15 06:33:36.721647930 (157h7m17.45291558s) [noise=true , address=79.127.220.97:4386 , piece_id=NZG46SVSN2YKOHVYBPIONXKZN7JQSO7E54I5ZX3OPTJ6ID2LUV2Q, seg_pos={0 0}, upload=163504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Jbx3fU6YtQjbYHz8zmeBricToeR3dLJBoS5N4gHPhJWgcpiu7): protocol: expected piece hash; context canceled; EOF
Aug 15 06:33:36.721809062 (157h7m17.453076713s) [noise=true , address=104.36.82.21:4474 , piece_id=YHCYIPHJUVKFMJYMBTSC6I4ECUSXXSR7FCOZNPHAIM57WN4KFLDQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH): protocol: expected piece hash; context canceled; EOF
Aug 15 06:33:36.721957362 (157h7m17.453225012s) [noise=true , address=66.23.193.175:4554 , piece_id=46LHPSSBFNJFXHCHMKJEQGLJVRCGECQ5OMXSPESEK2NSVQREYVOA, seg_pos={0 0}, upload=163504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CraGuuckkbKe5PDLUvwF5G2ATUbgdR5g192YjkZgmP3JpqgXi): protocol: read tcp 5.161.89.252:24894->66.23.193.175:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 06:33:36.722054555 (157h7m17.453322205s) [noise=true , address=79.127.201.215:4355 , piece_id=OHRONBVUSBAL5XTKJ7TNQFGSIJDC7XKTL2IUKPECPM5VS3RDB7SQ, seg_pos={0 0}, upload=163504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TkfBtvxa5va3vd1NDoZv1vtyT8FbUPuJJvYyc41FUzXHZJ93D): protocol: read tcp 5.161.89.252:40562->79.127.201.215:4355: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 06:33:36.722070524 (157h7m17.453338175s) [seg_pos={0 0}, upload=163504]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 06:33:36.722144995 (157h7m17.453412644s) [upload=163504]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 06:33:36.722150886 (157h7m17.453418545s) [upload=163504]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 06:33:36.862109570 (157h7m17.5933772s) [upload=163504]: Done uploading segments...
Aug 15 06:33:36.862123436 (157h7m17.593391066s) [upload=163504]: Upload finished. err: <nil>
Duration: 417.397451ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................................X......X............] duration:
123.080894ms
FAIL (2025-08-15 06:32:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:23:13.158332703 (156h56m53.889600322s) [upload=163318]: Starting upload Aug 15 06:23:13.158381314 (156h56m53.889648933s) [upload=163318]: Done starting upload Aug 15 06:23:13.158431398 (156h56m53.889699018s) [upload=163318]: Uploading segments... Aug 15 06:23:13.158487664 (156h56m53.889755294s) [upload=163318]: Got next segment. Inline: true Aug 15 06:23:13.158492433 (156h56m53.889760053s) [upload=163318]: Waiting for error group managing segments... Aug 15 06:23:13.158525365 (156h56m53.889792995s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:23:13.158529061 (156h56m53.889796691s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:23:13.158531456 (156h56m53.889799086s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:23:13.160759987 (156h56m53.892027617s) [upload=163318]: Done uploading segments... Aug 15 06:23:13.160774924 (156h56m53.892042554s) [upload=163318]: Upload finished. err: metaclient: Too Many Requests
Duration: 123.099208ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................................X......X...........] duration:
139.335502ms
FAIL (2025-08-15 06:32:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:23:13.158332703 (156h56m53.889600322s) [upload=163318]: Starting upload Aug 15 06:23:13.158381314 (156h56m53.889648933s) [upload=163318]: Done starting upload Aug 15 06:23:13.158431398 (156h56m53.889699018s) [upload=163318]: Uploading segments... Aug 15 06:23:13.158487664 (156h56m53.889755294s) [upload=163318]: Got next segment. Inline: true Aug 15 06:23:13.158492433 (156h56m53.889760053s) [upload=163318]: Waiting for error group managing segments... Aug 15 06:23:13.158525365 (156h56m53.889792995s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:23:13.158529061 (156h56m53.889796691s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:23:13.158531456 (156h56m53.889799086s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:23:13.160759987 (156h56m53.892027617s) [upload=163318]: Done uploading segments... Aug 15 06:23:13.160774924 (156h56m53.892042554s) [upload=163318]: Upload finished. err: metaclient: Too Many Requests
Duration: 139.353005ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................................X......X..........] duration:
160.940522ms
FAIL (2025-08-15 06:31:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:23:13.158332703 (156h56m53.889600322s) [upload=163318]: Starting upload Aug 15 06:23:13.158381314 (156h56m53.889648933s) [upload=163318]: Done starting upload Aug 15 06:23:13.158431398 (156h56m53.889699018s) [upload=163318]: Uploading segments... Aug 15 06:23:13.158487664 (156h56m53.889755294s) [upload=163318]: Got next segment. Inline: true Aug 15 06:23:13.158492433 (156h56m53.889760053s) [upload=163318]: Waiting for error group managing segments... Aug 15 06:23:13.158525365 (156h56m53.889792995s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:23:13.158529061 (156h56m53.889796691s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:23:13.158531456 (156h56m53.889799086s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:23:13.160759987 (156h56m53.892027617s) [upload=163318]: Done uploading segments... Aug 15 06:23:13.160774924 (156h56m53.892042554s) [upload=163318]: Upload finished. err: metaclient: Too Many Requests
Duration: 160.965758ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................................X......X.........] duration:
130.607969ms
FAIL (2025-08-15 06:30:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:23:13.158332703 (156h56m53.889600322s) [upload=163318]: Starting upload Aug 15 06:23:13.158381314 (156h56m53.889648933s) [upload=163318]: Done starting upload Aug 15 06:23:13.158431398 (156h56m53.889699018s) [upload=163318]: Uploading segments... Aug 15 06:23:13.158487664 (156h56m53.889755294s) [upload=163318]: Got next segment. Inline: true Aug 15 06:23:13.158492433 (156h56m53.889760053s) [upload=163318]: Waiting for error group managing segments... Aug 15 06:23:13.158525365 (156h56m53.889792995s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:23:13.158529061 (156h56m53.889796691s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:23:13.158531456 (156h56m53.889799086s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:23:13.160759987 (156h56m53.892027617s) [upload=163318]: Done uploading segments... Aug 15 06:23:13.160774924 (156h56m53.892042554s) [upload=163318]: Upload finished. err: metaclient: Too Many Requests
Duration: 130.633728ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................................X......X........] duration:
224.21982ms
FAIL (2025-08-15 06:29:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:23:13.158332703 (156h56m53.889600322s) [upload=163318]: Starting upload Aug 15 06:23:13.158381314 (156h56m53.889648933s) [upload=163318]: Done starting upload Aug 15 06:23:13.158431398 (156h56m53.889699018s) [upload=163318]: Uploading segments... Aug 15 06:23:13.158487664 (156h56m53.889755294s) [upload=163318]: Got next segment. Inline: true Aug 15 06:23:13.158492433 (156h56m53.889760053s) [upload=163318]: Waiting for error group managing segments... Aug 15 06:23:13.158525365 (156h56m53.889792995s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:23:13.158529061 (156h56m53.889796691s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:23:13.158531456 (156h56m53.889799086s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:23:13.160759987 (156h56m53.892027617s) [upload=163318]: Done uploading segments... Aug 15 06:23:13.160774924 (156h56m53.892042554s) [upload=163318]: Upload finished. err: metaclient: Too Many Requests
Duration: 224.239896ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
395.691224ms
FAIL (2025-08-15 06:29:26 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 05:44:22.781048516 (156h18m3.512316206s) [upload=162649]: Starting upload
Aug 15 05:44:22.781143685 (156h18m3.512411345s) [upload=162649]: Done starting upload
Aug 15 05:44:22.781205261 (156h18m3.51247291s) [upload=162649]: Uploading segments...
Aug 15 05:44:22.781552763 (156h18m3.512820423s) [upload=162649]: Got next segment. Inline: false
Aug 15 05:44:22.781613949 (156h18m3.512881639s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 05:44:22.781623357 (156h18m3.512891007s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 05:44:22.853583217 (156h18m3.584850848s) [seg_pos={0 0}, upload=162649]: Begin upload segment...
Aug 15 05:44:22.853614857 (156h18m3.584882487s) [seg_pos={0 0}, upload=162649]: Done begin upload segment.
Aug 15 05:44:22.853622912 (156h18m3.584890532s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.853630877 (156h18m3.584898507s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.853960808 (156h18m3.585228438s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854221948 (156h18m3.585489578s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854487648 (156h18m3.585755278s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854706198 (156h18m3.585973818s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854916283 (156h18m3.586183903s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855122541 (156h18m3.586390161s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855323318 (156h18m3.586590939s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855572116 (156h18m3.586839736s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855783854 (156h18m3.587051484s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856043823 (156h18m3.587311442s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856221917 (156h18m3.587489547s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856474260 (156h18m3.587741891s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856684717 (156h18m3.587952347s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856890473 (156h18m3.588158103s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.857137107 (156h18m3.588404727s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.857407986 (156h18m3.588675616s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.931933679 (156h18m3.663201319s) [upload=162649]: Next returned nil segment
Aug 15 05:44:22.931946533 (156h18m3.663214163s) [upload=162649]: Waiting for error group managing segments...
Aug 15 05:44:22.941125163 (156h18m3.672392803s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.941816452 (156h18m3.673084082s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942102801 (156h18m3.673370441s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942329847 (156h18m3.673597477s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942519253 (156h18m3.673786883s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.944005966 (156h18m3.675273607s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.945343752 (156h18m3.676611392s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.948716731 (156h18m3.679984381s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.954674047 (156h18m3.685941687s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.956262041 (156h18m3.687529671s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.964011115 (156h18m3.695278766s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.973878009 (156h18m3.705145659s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.033905123 (156h18m3.765172773s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.039146835 (156h18m3.770414484s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.039177702 (156h18m3.770445353s) [seg_pos={0 0}, upload=162649]: Segment reached optimal threshold of 14 pieces.
Aug 15 05:44:23.039726664 (156h18m3.770994314s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: read tcp 5.161.89.252:55162->66.23.193.175:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.039827213 (156h18m3.771094874s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: read tcp 5.161.89.252:18818->79.127.201.215:4352: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.039977666 (156h18m3.771245316s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: read tcp 5.161.89.252:24186->64.49.13.169:4714: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.040119473 (156h18m3.771387133s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eqkG9kQB7wFYRNUY3P77MLwBrwXKuEXvJku3B63FZn6rK5y5d): protocol: context canceled; context canceled
Aug 15 05:44:23.040146273 (156h18m3.771413923s) [seg_pos={0 0}, upload=162649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 05:44:23.040241311 (156h18m3.771508962s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 05:44:23.040250929 (156h18m3.77151862s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 05:44:23.148699216 (156h18m3.879966877s) [upload=162649]: Done uploading segments...
Aug 15 05:44:23.148718513 (156h18m3.879986163s) [upload=162649]: Upload finished. err: <nil>
Duration: 395.716972ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................................X......X.......] duration:
347.621838ms
FAIL (2025-08-15 06:29:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:23:13.158332703 (156h56m53.889600322s) [upload=163318]: Starting upload Aug 15 06:23:13.158381314 (156h56m53.889648933s) [upload=163318]: Done starting upload Aug 15 06:23:13.158431398 (156h56m53.889699018s) [upload=163318]: Uploading segments... Aug 15 06:23:13.158487664 (156h56m53.889755294s) [upload=163318]: Got next segment. Inline: true Aug 15 06:23:13.158492433 (156h56m53.889760053s) [upload=163318]: Waiting for error group managing segments... Aug 15 06:23:13.158525365 (156h56m53.889792995s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:23:13.158529061 (156h56m53.889796691s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:23:13.158531456 (156h56m53.889799086s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:23:13.160759987 (156h56m53.892027617s) [upload=163318]: Done uploading segments... Aug 15 06:23:13.160774924 (156h56m53.892042554s) [upload=163318]: Upload finished. err: metaclient: Too Many Requests
Duration: 347.641725ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
352.656006ms
FAIL (2025-08-15 06:28:58 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 05:44:22.781048516 (156h18m3.512316206s) [upload=162649]: Starting upload
Aug 15 05:44:22.781143685 (156h18m3.512411345s) [upload=162649]: Done starting upload
Aug 15 05:44:22.781205261 (156h18m3.51247291s) [upload=162649]: Uploading segments...
Aug 15 05:44:22.781552763 (156h18m3.512820423s) [upload=162649]: Got next segment. Inline: false
Aug 15 05:44:22.781613949 (156h18m3.512881639s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 05:44:22.781623357 (156h18m3.512891007s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 05:44:22.853583217 (156h18m3.584850848s) [seg_pos={0 0}, upload=162649]: Begin upload segment...
Aug 15 05:44:22.853614857 (156h18m3.584882487s) [seg_pos={0 0}, upload=162649]: Done begin upload segment.
Aug 15 05:44:22.853622912 (156h18m3.584890532s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.853630877 (156h18m3.584898507s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.853960808 (156h18m3.585228438s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854221948 (156h18m3.585489578s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854487648 (156h18m3.585755278s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854706198 (156h18m3.585973818s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854916283 (156h18m3.586183903s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855122541 (156h18m3.586390161s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855323318 (156h18m3.586590939s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855572116 (156h18m3.586839736s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855783854 (156h18m3.587051484s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856043823 (156h18m3.587311442s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856221917 (156h18m3.587489547s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856474260 (156h18m3.587741891s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856684717 (156h18m3.587952347s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856890473 (156h18m3.588158103s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.857137107 (156h18m3.588404727s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.857407986 (156h18m3.588675616s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.931933679 (156h18m3.663201319s) [upload=162649]: Next returned nil segment
Aug 15 05:44:22.931946533 (156h18m3.663214163s) [upload=162649]: Waiting for error group managing segments...
Aug 15 05:44:22.941125163 (156h18m3.672392803s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.941816452 (156h18m3.673084082s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942102801 (156h18m3.673370441s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942329847 (156h18m3.673597477s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942519253 (156h18m3.673786883s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.944005966 (156h18m3.675273607s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.945343752 (156h18m3.676611392s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.948716731 (156h18m3.679984381s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.954674047 (156h18m3.685941687s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.956262041 (156h18m3.687529671s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.964011115 (156h18m3.695278766s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.973878009 (156h18m3.705145659s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.033905123 (156h18m3.765172773s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.039146835 (156h18m3.770414484s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.039177702 (156h18m3.770445353s) [seg_pos={0 0}, upload=162649]: Segment reached optimal threshold of 14 pieces.
Aug 15 05:44:23.039726664 (156h18m3.770994314s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: read tcp 5.161.89.252:55162->66.23.193.175:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.039827213 (156h18m3.771094874s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: read tcp 5.161.89.252:18818->79.127.201.215:4352: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.039977666 (156h18m3.771245316s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: read tcp 5.161.89.252:24186->64.49.13.169:4714: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.040119473 (156h18m3.771387133s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eqkG9kQB7wFYRNUY3P77MLwBrwXKuEXvJku3B63FZn6rK5y5d): protocol: context canceled; context canceled
Aug 15 05:44:23.040146273 (156h18m3.771413923s) [seg_pos={0 0}, upload=162649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 05:44:23.040241311 (156h18m3.771508962s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 05:44:23.040250929 (156h18m3.77151862s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 05:44:23.148699216 (156h18m3.879966877s) [upload=162649]: Done uploading segments...
Aug 15 05:44:23.148718513 (156h18m3.879986163s) [upload=162649]: Upload finished. err: <nil>
Duration: 352.676113ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
416.810641ms
FAIL (2025-08-15 06:28:19 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 05:44:22.781048516 (156h18m3.512316206s) [upload=162649]: Starting upload
Aug 15 05:44:22.781143685 (156h18m3.512411345s) [upload=162649]: Done starting upload
Aug 15 05:44:22.781205261 (156h18m3.51247291s) [upload=162649]: Uploading segments...
Aug 15 05:44:22.781552763 (156h18m3.512820423s) [upload=162649]: Got next segment. Inline: false
Aug 15 05:44:22.781613949 (156h18m3.512881639s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 05:44:22.781623357 (156h18m3.512891007s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 05:44:22.853583217 (156h18m3.584850848s) [seg_pos={0 0}, upload=162649]: Begin upload segment...
Aug 15 05:44:22.853614857 (156h18m3.584882487s) [seg_pos={0 0}, upload=162649]: Done begin upload segment.
Aug 15 05:44:22.853622912 (156h18m3.584890532s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.853630877 (156h18m3.584898507s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.853960808 (156h18m3.585228438s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854221948 (156h18m3.585489578s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854487648 (156h18m3.585755278s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854706198 (156h18m3.585973818s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854916283 (156h18m3.586183903s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855122541 (156h18m3.586390161s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855323318 (156h18m3.586590939s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855572116 (156h18m3.586839736s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855783854 (156h18m3.587051484s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856043823 (156h18m3.587311442s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856221917 (156h18m3.587489547s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856474260 (156h18m3.587741891s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856684717 (156h18m3.587952347s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856890473 (156h18m3.588158103s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.857137107 (156h18m3.588404727s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.857407986 (156h18m3.588675616s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.931933679 (156h18m3.663201319s) [upload=162649]: Next returned nil segment
Aug 15 05:44:22.931946533 (156h18m3.663214163s) [upload=162649]: Waiting for error group managing segments...
Aug 15 05:44:22.941125163 (156h18m3.672392803s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.941816452 (156h18m3.673084082s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942102801 (156h18m3.673370441s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942329847 (156h18m3.673597477s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942519253 (156h18m3.673786883s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.944005966 (156h18m3.675273607s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.945343752 (156h18m3.676611392s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.948716731 (156h18m3.679984381s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.954674047 (156h18m3.685941687s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.956262041 (156h18m3.687529671s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.964011115 (156h18m3.695278766s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.973878009 (156h18m3.705145659s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.033905123 (156h18m3.765172773s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.039146835 (156h18m3.770414484s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.039177702 (156h18m3.770445353s) [seg_pos={0 0}, upload=162649]: Segment reached optimal threshold of 14 pieces.
Aug 15 05:44:23.039726664 (156h18m3.770994314s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: read tcp 5.161.89.252:55162->66.23.193.175:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.039827213 (156h18m3.771094874s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: read tcp 5.161.89.252:18818->79.127.201.215:4352: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.039977666 (156h18m3.771245316s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: read tcp 5.161.89.252:24186->64.49.13.169:4714: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.040119473 (156h18m3.771387133s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eqkG9kQB7wFYRNUY3P77MLwBrwXKuEXvJku3B63FZn6rK5y5d): protocol: context canceled; context canceled
Aug 15 05:44:23.040146273 (156h18m3.771413923s) [seg_pos={0 0}, upload=162649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 05:44:23.040241311 (156h18m3.771508962s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 05:44:23.040250929 (156h18m3.77151862s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 05:44:23.148699216 (156h18m3.879966877s) [upload=162649]: Done uploading segments...
Aug 15 05:44:23.148718513 (156h18m3.879986163s) [upload=162649]: Upload finished. err: <nil>
Duration: 416.829737ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................................X......X......] duration:
793.180006ms
FAIL (2025-08-15 06:28:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:23:13.158332703 (156h56m53.889600322s) [upload=163318]: Starting upload Aug 15 06:23:13.158381314 (156h56m53.889648933s) [upload=163318]: Done starting upload Aug 15 06:23:13.158431398 (156h56m53.889699018s) [upload=163318]: Uploading segments... Aug 15 06:23:13.158487664 (156h56m53.889755294s) [upload=163318]: Got next segment. Inline: true Aug 15 06:23:13.158492433 (156h56m53.889760053s) [upload=163318]: Waiting for error group managing segments... Aug 15 06:23:13.158525365 (156h56m53.889792995s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:23:13.158529061 (156h56m53.889796691s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:23:13.158531456 (156h56m53.889799086s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:23:13.160759987 (156h56m53.892027617s) [upload=163318]: Done uploading segments... Aug 15 06:23:13.160774924 (156h56m53.892042554s) [upload=163318]: Upload finished. err: metaclient: Too Many Requests
Duration: 793.200084ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
389.685785ms
FAIL (2025-08-15 06:28:01 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 05:44:22.781048516 (156h18m3.512316206s) [upload=162649]: Starting upload
Aug 15 05:44:22.781143685 (156h18m3.512411345s) [upload=162649]: Done starting upload
Aug 15 05:44:22.781205261 (156h18m3.51247291s) [upload=162649]: Uploading segments...
Aug 15 05:44:22.781552763 (156h18m3.512820423s) [upload=162649]: Got next segment. Inline: false
Aug 15 05:44:22.781613949 (156h18m3.512881639s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 05:44:22.781623357 (156h18m3.512891007s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 05:44:22.853583217 (156h18m3.584850848s) [seg_pos={0 0}, upload=162649]: Begin upload segment...
Aug 15 05:44:22.853614857 (156h18m3.584882487s) [seg_pos={0 0}, upload=162649]: Done begin upload segment.
Aug 15 05:44:22.853622912 (156h18m3.584890532s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.853630877 (156h18m3.584898507s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.853960808 (156h18m3.585228438s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854221948 (156h18m3.585489578s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854487648 (156h18m3.585755278s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854706198 (156h18m3.585973818s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854916283 (156h18m3.586183903s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855122541 (156h18m3.586390161s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855323318 (156h18m3.586590939s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855572116 (156h18m3.586839736s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855783854 (156h18m3.587051484s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856043823 (156h18m3.587311442s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856221917 (156h18m3.587489547s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856474260 (156h18m3.587741891s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856684717 (156h18m3.587952347s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856890473 (156h18m3.588158103s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.857137107 (156h18m3.588404727s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.857407986 (156h18m3.588675616s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.931933679 (156h18m3.663201319s) [upload=162649]: Next returned nil segment
Aug 15 05:44:22.931946533 (156h18m3.663214163s) [upload=162649]: Waiting for error group managing segments...
Aug 15 05:44:22.941125163 (156h18m3.672392803s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.941816452 (156h18m3.673084082s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942102801 (156h18m3.673370441s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942329847 (156h18m3.673597477s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942519253 (156h18m3.673786883s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.944005966 (156h18m3.675273607s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.945343752 (156h18m3.676611392s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.948716731 (156h18m3.679984381s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.954674047 (156h18m3.685941687s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.956262041 (156h18m3.687529671s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.964011115 (156h18m3.695278766s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.973878009 (156h18m3.705145659s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.033905123 (156h18m3.765172773s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.039146835 (156h18m3.770414484s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.039177702 (156h18m3.770445353s) [seg_pos={0 0}, upload=162649]: Segment reached optimal threshold of 14 pieces.
Aug 15 05:44:23.039726664 (156h18m3.770994314s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: read tcp 5.161.89.252:55162->66.23.193.175:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.039827213 (156h18m3.771094874s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: read tcp 5.161.89.252:18818->79.127.201.215:4352: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.039977666 (156h18m3.771245316s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: read tcp 5.161.89.252:24186->64.49.13.169:4714: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.040119473 (156h18m3.771387133s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eqkG9kQB7wFYRNUY3P77MLwBrwXKuEXvJku3B63FZn6rK5y5d): protocol: context canceled; context canceled
Aug 15 05:44:23.040146273 (156h18m3.771413923s) [seg_pos={0 0}, upload=162649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 05:44:23.040241311 (156h18m3.771508962s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 05:44:23.040250929 (156h18m3.77151862s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 05:44:23.148699216 (156h18m3.879966877s) [upload=162649]: Done uploading segments...
Aug 15 05:44:23.148718513 (156h18m3.879986163s) [upload=162649]: Upload finished. err: <nil>
Duration: 389.705923ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............................................X......X.....] duration:
228.145841ms
FAIL (2025-08-15 06:27:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:23:13.158332703 (156h56m53.889600322s) [upload=163318]: Starting upload Aug 15 06:23:13.158381314 (156h56m53.889648933s) [upload=163318]: Done starting upload Aug 15 06:23:13.158431398 (156h56m53.889699018s) [upload=163318]: Uploading segments... Aug 15 06:23:13.158487664 (156h56m53.889755294s) [upload=163318]: Got next segment. Inline: true Aug 15 06:23:13.158492433 (156h56m53.889760053s) [upload=163318]: Waiting for error group managing segments... Aug 15 06:23:13.158525365 (156h56m53.889792995s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:23:13.158529061 (156h56m53.889796691s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:23:13.158531456 (156h56m53.889799086s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:23:13.160759987 (156h56m53.892027617s) [upload=163318]: Done uploading segments... Aug 15 06:23:13.160774924 (156h56m53.892042554s) [upload=163318]: Upload finished. err: metaclient: Too Many Requests
Duration: 228.168956ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
338.274ms
FAIL (2025-08-15 06:26:49 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 05:44:22.781048516 (156h18m3.512316206s) [upload=162649]: Starting upload
Aug 15 05:44:22.781143685 (156h18m3.512411345s) [upload=162649]: Done starting upload
Aug 15 05:44:22.781205261 (156h18m3.51247291s) [upload=162649]: Uploading segments...
Aug 15 05:44:22.781552763 (156h18m3.512820423s) [upload=162649]: Got next segment. Inline: false
Aug 15 05:44:22.781613949 (156h18m3.512881639s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 05:44:22.781623357 (156h18m3.512891007s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 05:44:22.853583217 (156h18m3.584850848s) [seg_pos={0 0}, upload=162649]: Begin upload segment...
Aug 15 05:44:22.853614857 (156h18m3.584882487s) [seg_pos={0 0}, upload=162649]: Done begin upload segment.
Aug 15 05:44:22.853622912 (156h18m3.584890532s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.853630877 (156h18m3.584898507s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.853960808 (156h18m3.585228438s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854221948 (156h18m3.585489578s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854487648 (156h18m3.585755278s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854706198 (156h18m3.585973818s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854916283 (156h18m3.586183903s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855122541 (156h18m3.586390161s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855323318 (156h18m3.586590939s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855572116 (156h18m3.586839736s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855783854 (156h18m3.587051484s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856043823 (156h18m3.587311442s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856221917 (156h18m3.587489547s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856474260 (156h18m3.587741891s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856684717 (156h18m3.587952347s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856890473 (156h18m3.588158103s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.857137107 (156h18m3.588404727s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.857407986 (156h18m3.588675616s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.931933679 (156h18m3.663201319s) [upload=162649]: Next returned nil segment
Aug 15 05:44:22.931946533 (156h18m3.663214163s) [upload=162649]: Waiting for error group managing segments...
Aug 15 05:44:22.941125163 (156h18m3.672392803s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.941816452 (156h18m3.673084082s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942102801 (156h18m3.673370441s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942329847 (156h18m3.673597477s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942519253 (156h18m3.673786883s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.944005966 (156h18m3.675273607s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.945343752 (156h18m3.676611392s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.948716731 (156h18m3.679984381s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.954674047 (156h18m3.685941687s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.956262041 (156h18m3.687529671s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.964011115 (156h18m3.695278766s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.973878009 (156h18m3.705145659s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.033905123 (156h18m3.765172773s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.039146835 (156h18m3.770414484s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.039177702 (156h18m3.770445353s) [seg_pos={0 0}, upload=162649]: Segment reached optimal threshold of 14 pieces.
Aug 15 05:44:23.039726664 (156h18m3.770994314s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: read tcp 5.161.89.252:55162->66.23.193.175:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.039827213 (156h18m3.771094874s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: read tcp 5.161.89.252:18818->79.127.201.215:4352: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.039977666 (156h18m3.771245316s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: read tcp 5.161.89.252:24186->64.49.13.169:4714: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.040119473 (156h18m3.771387133s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eqkG9kQB7wFYRNUY3P77MLwBrwXKuEXvJku3B63FZn6rK5y5d): protocol: context canceled; context canceled
Aug 15 05:44:23.040146273 (156h18m3.771413923s) [seg_pos={0 0}, upload=162649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 05:44:23.040241311 (156h18m3.771508962s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 05:44:23.040250929 (156h18m3.77151862s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 05:44:23.148699216 (156h18m3.879966877s) [upload=162649]: Done uploading segments...
Aug 15 05:44:23.148718513 (156h18m3.879986163s) [upload=162649]: Upload finished. err: <nil>
Duration: 338.293929ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................................X......X....] duration:
199.595285ms
FAIL (2025-08-15 06:26:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:23:13.158332703 (156h56m53.889600322s) [upload=163318]: Starting upload Aug 15 06:23:13.158381314 (156h56m53.889648933s) [upload=163318]: Done starting upload Aug 15 06:23:13.158431398 (156h56m53.889699018s) [upload=163318]: Uploading segments... Aug 15 06:23:13.158487664 (156h56m53.889755294s) [upload=163318]: Got next segment. Inline: true Aug 15 06:23:13.158492433 (156h56m53.889760053s) [upload=163318]: Waiting for error group managing segments... Aug 15 06:23:13.158525365 (156h56m53.889792995s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:23:13.158529061 (156h56m53.889796691s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:23:13.158531456 (156h56m53.889799086s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:23:13.160759987 (156h56m53.892027617s) [upload=163318]: Done uploading segments... Aug 15 06:23:13.160774924 (156h56m53.892042554s) [upload=163318]: Upload finished. err: metaclient: Too Many Requests
Duration: 199.614682ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
335.584073ms
FAIL (2025-08-15 06:26:12 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 05:44:22.781048516 (156h18m3.512316206s) [upload=162649]: Starting upload
Aug 15 05:44:22.781143685 (156h18m3.512411345s) [upload=162649]: Done starting upload
Aug 15 05:44:22.781205261 (156h18m3.51247291s) [upload=162649]: Uploading segments...
Aug 15 05:44:22.781552763 (156h18m3.512820423s) [upload=162649]: Got next segment. Inline: false
Aug 15 05:44:22.781613949 (156h18m3.512881639s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 05:44:22.781623357 (156h18m3.512891007s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 05:44:22.853583217 (156h18m3.584850848s) [seg_pos={0 0}, upload=162649]: Begin upload segment...
Aug 15 05:44:22.853614857 (156h18m3.584882487s) [seg_pos={0 0}, upload=162649]: Done begin upload segment.
Aug 15 05:44:22.853622912 (156h18m3.584890532s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.853630877 (156h18m3.584898507s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.853960808 (156h18m3.585228438s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854221948 (156h18m3.585489578s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854487648 (156h18m3.585755278s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854706198 (156h18m3.585973818s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854916283 (156h18m3.586183903s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855122541 (156h18m3.586390161s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855323318 (156h18m3.586590939s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855572116 (156h18m3.586839736s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855783854 (156h18m3.587051484s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856043823 (156h18m3.587311442s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856221917 (156h18m3.587489547s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856474260 (156h18m3.587741891s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856684717 (156h18m3.587952347s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856890473 (156h18m3.588158103s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.857137107 (156h18m3.588404727s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.857407986 (156h18m3.588675616s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.931933679 (156h18m3.663201319s) [upload=162649]: Next returned nil segment
Aug 15 05:44:22.931946533 (156h18m3.663214163s) [upload=162649]: Waiting for error group managing segments...
Aug 15 05:44:22.941125163 (156h18m3.672392803s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.941816452 (156h18m3.673084082s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942102801 (156h18m3.673370441s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942329847 (156h18m3.673597477s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942519253 (156h18m3.673786883s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.944005966 (156h18m3.675273607s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.945343752 (156h18m3.676611392s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.948716731 (156h18m3.679984381s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.954674047 (156h18m3.685941687s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.956262041 (156h18m3.687529671s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.964011115 (156h18m3.695278766s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.973878009 (156h18m3.705145659s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.033905123 (156h18m3.765172773s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.039146835 (156h18m3.770414484s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.039177702 (156h18m3.770445353s) [seg_pos={0 0}, upload=162649]: Segment reached optimal threshold of 14 pieces.
Aug 15 05:44:23.039726664 (156h18m3.770994314s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: read tcp 5.161.89.252:55162->66.23.193.175:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.039827213 (156h18m3.771094874s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: read tcp 5.161.89.252:18818->79.127.201.215:4352: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.039977666 (156h18m3.771245316s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: read tcp 5.161.89.252:24186->64.49.13.169:4714: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.040119473 (156h18m3.771387133s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eqkG9kQB7wFYRNUY3P77MLwBrwXKuEXvJku3B63FZn6rK5y5d): protocol: context canceled; context canceled
Aug 15 05:44:23.040146273 (156h18m3.771413923s) [seg_pos={0 0}, upload=162649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 05:44:23.040241311 (156h18m3.771508962s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 05:44:23.040250929 (156h18m3.77151862s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 05:44:23.148699216 (156h18m3.879966877s) [upload=162649]: Done uploading segments...
Aug 15 05:44:23.148718513 (156h18m3.879986163s) [upload=162649]: Upload finished. err: <nil>
Duration: 335.621043ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................................................X......X...] duration:
298.422509ms
FAIL (2025-08-15 06:25:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:23:13.158332703 (156h56m53.889600322s) [upload=163318]: Starting upload Aug 15 06:23:13.158381314 (156h56m53.889648933s) [upload=163318]: Done starting upload Aug 15 06:23:13.158431398 (156h56m53.889699018s) [upload=163318]: Uploading segments... Aug 15 06:23:13.158487664 (156h56m53.889755294s) [upload=163318]: Got next segment. Inline: true Aug 15 06:23:13.158492433 (156h56m53.889760053s) [upload=163318]: Waiting for error group managing segments... Aug 15 06:23:13.158525365 (156h56m53.889792995s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:23:13.158529061 (156h56m53.889796691s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:23:13.158531456 (156h56m53.889799086s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:23:13.160759987 (156h56m53.892027617s) [upload=163318]: Done uploading segments... Aug 15 06:23:13.160774924 (156h56m53.892042554s) [upload=163318]: Upload finished. err: metaclient: Too Many Requests
Duration: 298.444451ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
412.722312ms
FAIL (2025-08-15 06:25:00 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 05:44:22.781048516 (156h18m3.512316206s) [upload=162649]: Starting upload
Aug 15 05:44:22.781143685 (156h18m3.512411345s) [upload=162649]: Done starting upload
Aug 15 05:44:22.781205261 (156h18m3.51247291s) [upload=162649]: Uploading segments...
Aug 15 05:44:22.781552763 (156h18m3.512820423s) [upload=162649]: Got next segment. Inline: false
Aug 15 05:44:22.781613949 (156h18m3.512881639s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 05:44:22.781623357 (156h18m3.512891007s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 05:44:22.853583217 (156h18m3.584850848s) [seg_pos={0 0}, upload=162649]: Begin upload segment...
Aug 15 05:44:22.853614857 (156h18m3.584882487s) [seg_pos={0 0}, upload=162649]: Done begin upload segment.
Aug 15 05:44:22.853622912 (156h18m3.584890532s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.853630877 (156h18m3.584898507s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.853960808 (156h18m3.585228438s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854221948 (156h18m3.585489578s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854487648 (156h18m3.585755278s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854706198 (156h18m3.585973818s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854916283 (156h18m3.586183903s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855122541 (156h18m3.586390161s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855323318 (156h18m3.586590939s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855572116 (156h18m3.586839736s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855783854 (156h18m3.587051484s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856043823 (156h18m3.587311442s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856221917 (156h18m3.587489547s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856474260 (156h18m3.587741891s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856684717 (156h18m3.587952347s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856890473 (156h18m3.588158103s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.857137107 (156h18m3.588404727s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.857407986 (156h18m3.588675616s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.931933679 (156h18m3.663201319s) [upload=162649]: Next returned nil segment
Aug 15 05:44:22.931946533 (156h18m3.663214163s) [upload=162649]: Waiting for error group managing segments...
Aug 15 05:44:22.941125163 (156h18m3.672392803s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.941816452 (156h18m3.673084082s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942102801 (156h18m3.673370441s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942329847 (156h18m3.673597477s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942519253 (156h18m3.673786883s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.944005966 (156h18m3.675273607s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.945343752 (156h18m3.676611392s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.948716731 (156h18m3.679984381s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.954674047 (156h18m3.685941687s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.956262041 (156h18m3.687529671s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.964011115 (156h18m3.695278766s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.973878009 (156h18m3.705145659s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.033905123 (156h18m3.765172773s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.039146835 (156h18m3.770414484s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.039177702 (156h18m3.770445353s) [seg_pos={0 0}, upload=162649]: Segment reached optimal threshold of 14 pieces.
Aug 15 05:44:23.039726664 (156h18m3.770994314s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: read tcp 5.161.89.252:55162->66.23.193.175:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.039827213 (156h18m3.771094874s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: read tcp 5.161.89.252:18818->79.127.201.215:4352: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.039977666 (156h18m3.771245316s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: read tcp 5.161.89.252:24186->64.49.13.169:4714: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.040119473 (156h18m3.771387133s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eqkG9kQB7wFYRNUY3P77MLwBrwXKuEXvJku3B63FZn6rK5y5d): protocol: context canceled; context canceled
Aug 15 05:44:23.040146273 (156h18m3.771413923s) [seg_pos={0 0}, upload=162649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 05:44:23.040241311 (156h18m3.771508962s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 05:44:23.040250929 (156h18m3.77151862s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 05:44:23.148699216 (156h18m3.879966877s) [upload=162649]: Done uploading segments...
Aug 15 05:44:23.148718513 (156h18m3.879986163s) [upload=162649]: Upload finished. err: <nil>
Duration: 412.748881ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................................................X......X..] duration:
144.605208ms
FAIL (2025-08-15 06:24:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:23:13.158332703 (156h56m53.889600322s) [upload=163318]: Starting upload Aug 15 06:23:13.158381314 (156h56m53.889648933s) [upload=163318]: Done starting upload Aug 15 06:23:13.158431398 (156h56m53.889699018s) [upload=163318]: Uploading segments... Aug 15 06:23:13.158487664 (156h56m53.889755294s) [upload=163318]: Got next segment. Inline: true Aug 15 06:23:13.158492433 (156h56m53.889760053s) [upload=163318]: Waiting for error group managing segments... Aug 15 06:23:13.158525365 (156h56m53.889792995s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:23:13.158529061 (156h56m53.889796691s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:23:13.158531456 (156h56m53.889799086s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:23:13.160759987 (156h56m53.892027617s) [upload=163318]: Done uploading segments... Aug 15 06:23:13.160774924 (156h56m53.892042554s) [upload=163318]: Upload finished. err: metaclient: Too Many Requests
Duration: 144.625897ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................................................X......X.] duration:
140.058585ms
FAIL (2025-08-15 06:24:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:23:13.158332703 (156h56m53.889600322s) [upload=163318]: Starting upload Aug 15 06:23:13.158381314 (156h56m53.889648933s) [upload=163318]: Done starting upload Aug 15 06:23:13.158431398 (156h56m53.889699018s) [upload=163318]: Uploading segments... Aug 15 06:23:13.158487664 (156h56m53.889755294s) [upload=163318]: Got next segment. Inline: true Aug 15 06:23:13.158492433 (156h56m53.889760053s) [upload=163318]: Waiting for error group managing segments... Aug 15 06:23:13.158525365 (156h56m53.889792995s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:23:13.158529061 (156h56m53.889796691s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:23:13.158531456 (156h56m53.889799086s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:23:13.160759987 (156h56m53.892027617s) [upload=163318]: Done uploading segments... Aug 15 06:23:13.160774924 (156h56m53.892042554s) [upload=163318]: Upload finished. err: metaclient: Too Many Requests
Duration: 140.078032ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
324.530157ms
FAIL (2025-08-15 06:23:58 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 05:44:22.781048516 (156h18m3.512316206s) [upload=162649]: Starting upload
Aug 15 05:44:22.781143685 (156h18m3.512411345s) [upload=162649]: Done starting upload
Aug 15 05:44:22.781205261 (156h18m3.51247291s) [upload=162649]: Uploading segments...
Aug 15 05:44:22.781552763 (156h18m3.512820423s) [upload=162649]: Got next segment. Inline: false
Aug 15 05:44:22.781613949 (156h18m3.512881639s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 05:44:22.781623357 (156h18m3.512891007s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 05:44:22.853583217 (156h18m3.584850848s) [seg_pos={0 0}, upload=162649]: Begin upload segment...
Aug 15 05:44:22.853614857 (156h18m3.584882487s) [seg_pos={0 0}, upload=162649]: Done begin upload segment.
Aug 15 05:44:22.853622912 (156h18m3.584890532s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.853630877 (156h18m3.584898507s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.853960808 (156h18m3.585228438s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854221948 (156h18m3.585489578s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854487648 (156h18m3.585755278s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854706198 (156h18m3.585973818s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854916283 (156h18m3.586183903s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855122541 (156h18m3.586390161s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855323318 (156h18m3.586590939s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855572116 (156h18m3.586839736s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855783854 (156h18m3.587051484s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856043823 (156h18m3.587311442s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856221917 (156h18m3.587489547s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856474260 (156h18m3.587741891s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856684717 (156h18m3.587952347s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856890473 (156h18m3.588158103s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.857137107 (156h18m3.588404727s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.857407986 (156h18m3.588675616s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.931933679 (156h18m3.663201319s) [upload=162649]: Next returned nil segment
Aug 15 05:44:22.931946533 (156h18m3.663214163s) [upload=162649]: Waiting for error group managing segments...
Aug 15 05:44:22.941125163 (156h18m3.672392803s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.941816452 (156h18m3.673084082s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942102801 (156h18m3.673370441s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942329847 (156h18m3.673597477s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942519253 (156h18m3.673786883s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.944005966 (156h18m3.675273607s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.945343752 (156h18m3.676611392s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.948716731 (156h18m3.679984381s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.954674047 (156h18m3.685941687s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.956262041 (156h18m3.687529671s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.964011115 (156h18m3.695278766s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.973878009 (156h18m3.705145659s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.033905123 (156h18m3.765172773s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.039146835 (156h18m3.770414484s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.039177702 (156h18m3.770445353s) [seg_pos={0 0}, upload=162649]: Segment reached optimal threshold of 14 pieces.
Aug 15 05:44:23.039726664 (156h18m3.770994314s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: read tcp 5.161.89.252:55162->66.23.193.175:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.039827213 (156h18m3.771094874s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: read tcp 5.161.89.252:18818->79.127.201.215:4352: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.039977666 (156h18m3.771245316s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: read tcp 5.161.89.252:24186->64.49.13.169:4714: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.040119473 (156h18m3.771387133s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eqkG9kQB7wFYRNUY3P77MLwBrwXKuEXvJku3B63FZn6rK5y5d): protocol: context canceled; context canceled
Aug 15 05:44:23.040146273 (156h18m3.771413923s) [seg_pos={0 0}, upload=162649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 05:44:23.040241311 (156h18m3.771508962s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 05:44:23.040250929 (156h18m3.77151862s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 05:44:23.148699216 (156h18m3.879966877s) [upload=162649]: Done uploading segments...
Aug 15 05:44:23.148718513 (156h18m3.879986163s) [upload=162649]: Upload finished. err: <nil>
Duration: 324.56306ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................................................X......X] duration:
13.81147ms
FAIL (2025-08-15 06:23:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:23:13.158332703 (156h56m53.889600322s) [upload=163318]: Starting upload Aug 15 06:23:13.158381314 (156h56m53.889648933s) [upload=163318]: Done starting upload Aug 15 06:23:13.158431398 (156h56m53.889699018s) [upload=163318]: Uploading segments... Aug 15 06:23:13.158487664 (156h56m53.889755294s) [upload=163318]: Got next segment. Inline: true Aug 15 06:23:13.158492433 (156h56m53.889760053s) [upload=163318]: Waiting for error group managing segments... Aug 15 06:23:13.158525365 (156h56m53.889792995s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:23:13.158529061 (156h56m53.889796691s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:23:13.158531456 (156h56m53.889799086s) [upload=163318]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:23:13.160759987 (156h56m53.892027617s) [upload=163318]: Done uploading segments... Aug 15 06:23:13.160774924 (156h56m53.892042554s) [upload=163318]: Upload finished. err: metaclient: Too Many Requests
Duration: 13.829424ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
346.415262ms
FAIL (2025-08-15 06:23:03 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 05:44:22.781048516 (156h18m3.512316206s) [upload=162649]: Starting upload
Aug 15 05:44:22.781143685 (156h18m3.512411345s) [upload=162649]: Done starting upload
Aug 15 05:44:22.781205261 (156h18m3.51247291s) [upload=162649]: Uploading segments...
Aug 15 05:44:22.781552763 (156h18m3.512820423s) [upload=162649]: Got next segment. Inline: false
Aug 15 05:44:22.781613949 (156h18m3.512881639s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 05:44:22.781623357 (156h18m3.512891007s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 05:44:22.853583217 (156h18m3.584850848s) [seg_pos={0 0}, upload=162649]: Begin upload segment...
Aug 15 05:44:22.853614857 (156h18m3.584882487s) [seg_pos={0 0}, upload=162649]: Done begin upload segment.
Aug 15 05:44:22.853622912 (156h18m3.584890532s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.853630877 (156h18m3.584898507s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.853960808 (156h18m3.585228438s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854221948 (156h18m3.585489578s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854487648 (156h18m3.585755278s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854706198 (156h18m3.585973818s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854916283 (156h18m3.586183903s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855122541 (156h18m3.586390161s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855323318 (156h18m3.586590939s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855572116 (156h18m3.586839736s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855783854 (156h18m3.587051484s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856043823 (156h18m3.587311442s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856221917 (156h18m3.587489547s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856474260 (156h18m3.587741891s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856684717 (156h18m3.587952347s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856890473 (156h18m3.588158103s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.857137107 (156h18m3.588404727s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.857407986 (156h18m3.588675616s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.931933679 (156h18m3.663201319s) [upload=162649]: Next returned nil segment
Aug 15 05:44:22.931946533 (156h18m3.663214163s) [upload=162649]: Waiting for error group managing segments...
Aug 15 05:44:22.941125163 (156h18m3.672392803s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.941816452 (156h18m3.673084082s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942102801 (156h18m3.673370441s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942329847 (156h18m3.673597477s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942519253 (156h18m3.673786883s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.944005966 (156h18m3.675273607s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.945343752 (156h18m3.676611392s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.948716731 (156h18m3.679984381s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.954674047 (156h18m3.685941687s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.956262041 (156h18m3.687529671s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.964011115 (156h18m3.695278766s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.973878009 (156h18m3.705145659s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.033905123 (156h18m3.765172773s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.039146835 (156h18m3.770414484s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.039177702 (156h18m3.770445353s) [seg_pos={0 0}, upload=162649]: Segment reached optimal threshold of 14 pieces.
Aug 15 05:44:23.039726664 (156h18m3.770994314s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: read tcp 5.161.89.252:55162->66.23.193.175:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.039827213 (156h18m3.771094874s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: read tcp 5.161.89.252:18818->79.127.201.215:4352: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.039977666 (156h18m3.771245316s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: read tcp 5.161.89.252:24186->64.49.13.169:4714: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.040119473 (156h18m3.771387133s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eqkG9kQB7wFYRNUY3P77MLwBrwXKuEXvJku3B63FZn6rK5y5d): protocol: context canceled; context canceled
Aug 15 05:44:23.040146273 (156h18m3.771413923s) [seg_pos={0 0}, upload=162649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 05:44:23.040241311 (156h18m3.771508962s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 05:44:23.040250929 (156h18m3.77151862s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 05:44:23.148699216 (156h18m3.879966877s) [upload=162649]: Done uploading segments...
Aug 15 05:44:23.148718513 (156h18m3.879986163s) [upload=162649]: Upload finished. err: <nil>
Duration: 346.440469ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
506.814696ms
FAIL (2025-08-15 06:22:32 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 05:44:22.781048516 (156h18m3.512316206s) [upload=162649]: Starting upload
Aug 15 05:44:22.781143685 (156h18m3.512411345s) [upload=162649]: Done starting upload
Aug 15 05:44:22.781205261 (156h18m3.51247291s) [upload=162649]: Uploading segments...
Aug 15 05:44:22.781552763 (156h18m3.512820423s) [upload=162649]: Got next segment. Inline: false
Aug 15 05:44:22.781613949 (156h18m3.512881639s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 05:44:22.781623357 (156h18m3.512891007s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 05:44:22.853583217 (156h18m3.584850848s) [seg_pos={0 0}, upload=162649]: Begin upload segment...
Aug 15 05:44:22.853614857 (156h18m3.584882487s) [seg_pos={0 0}, upload=162649]: Done begin upload segment.
Aug 15 05:44:22.853622912 (156h18m3.584890532s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.853630877 (156h18m3.584898507s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.853960808 (156h18m3.585228438s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854221948 (156h18m3.585489578s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854487648 (156h18m3.585755278s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854706198 (156h18m3.585973818s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854916283 (156h18m3.586183903s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855122541 (156h18m3.586390161s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855323318 (156h18m3.586590939s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855572116 (156h18m3.586839736s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855783854 (156h18m3.587051484s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856043823 (156h18m3.587311442s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856221917 (156h18m3.587489547s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856474260 (156h18m3.587741891s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856684717 (156h18m3.587952347s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856890473 (156h18m3.588158103s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.857137107 (156h18m3.588404727s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.857407986 (156h18m3.588675616s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.931933679 (156h18m3.663201319s) [upload=162649]: Next returned nil segment
Aug 15 05:44:22.931946533 (156h18m3.663214163s) [upload=162649]: Waiting for error group managing segments...
Aug 15 05:44:22.941125163 (156h18m3.672392803s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.941816452 (156h18m3.673084082s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942102801 (156h18m3.673370441s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942329847 (156h18m3.673597477s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942519253 (156h18m3.673786883s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.944005966 (156h18m3.675273607s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.945343752 (156h18m3.676611392s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.948716731 (156h18m3.679984381s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.954674047 (156h18m3.685941687s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.956262041 (156h18m3.687529671s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.964011115 (156h18m3.695278766s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.973878009 (156h18m3.705145659s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.033905123 (156h18m3.765172773s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.039146835 (156h18m3.770414484s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.039177702 (156h18m3.770445353s) [seg_pos={0 0}, upload=162649]: Segment reached optimal threshold of 14 pieces.
Aug 15 05:44:23.039726664 (156h18m3.770994314s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: read tcp 5.161.89.252:55162->66.23.193.175:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.039827213 (156h18m3.771094874s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: read tcp 5.161.89.252:18818->79.127.201.215:4352: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.039977666 (156h18m3.771245316s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: read tcp 5.161.89.252:24186->64.49.13.169:4714: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.040119473 (156h18m3.771387133s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eqkG9kQB7wFYRNUY3P77MLwBrwXKuEXvJku3B63FZn6rK5y5d): protocol: context canceled; context canceled
Aug 15 05:44:23.040146273 (156h18m3.771413923s) [seg_pos={0 0}, upload=162649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 05:44:23.040241311 (156h18m3.771508962s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 05:44:23.040250929 (156h18m3.77151862s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 05:44:23.148699216 (156h18m3.879966877s) [upload=162649]: Done uploading segments...
Aug 15 05:44:23.148718513 (156h18m3.879986163s) [upload=162649]: Upload finished. err: <nil>
Duration: 506.834263ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
120.521613ms
FAIL (2025-08-15 06:22:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:17:46.487011506 (156h51m27.218279167s) [upload=163229]: Starting upload Aug 15 06:17:46.487080387 (156h51m27.218348037s) [upload=163229]: Done starting upload Aug 15 06:17:46.487149736 (156h51m27.218417387s) [upload=163229]: Uploading segments... Aug 15 06:17:46.487218095 (156h51m27.218485755s) [upload=163229]: Got next segment. Inline: true Aug 15 06:17:46.487225218 (156h51m27.218492868s) [upload=163229]: Waiting for error group managing segments... Aug 15 06:17:46.487270695 (156h51m27.218538345s) [upload=163229]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:17:46.487275964 (156h51m27.218543615s) [upload=163229]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:17:46.487279381 (156h51m27.218547031s) [upload=163229]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:17:46.490074687 (156h51m27.221342337s) [upload=163229]: Done uploading segments... Aug 15 06:17:46.490086849 (156h51m27.2213545s) [upload=163229]: Upload finished. err: metaclient: Too Many Requests
Duration: 120.560526ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
149.007033ms
FAIL (2025-08-15 06:21:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:17:46.487011506 (156h51m27.218279167s) [upload=163229]: Starting upload Aug 15 06:17:46.487080387 (156h51m27.218348037s) [upload=163229]: Done starting upload Aug 15 06:17:46.487149736 (156h51m27.218417387s) [upload=163229]: Uploading segments... Aug 15 06:17:46.487218095 (156h51m27.218485755s) [upload=163229]: Got next segment. Inline: true Aug 15 06:17:46.487225218 (156h51m27.218492868s) [upload=163229]: Waiting for error group managing segments... Aug 15 06:17:46.487270695 (156h51m27.218538345s) [upload=163229]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:17:46.487275964 (156h51m27.218543615s) [upload=163229]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:17:46.487279381 (156h51m27.218547031s) [upload=163229]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:17:46.490074687 (156h51m27.221342337s) [upload=163229]: Done uploading segments... Aug 15 06:17:46.490086849 (156h51m27.2213545s) [upload=163229]: Upload finished. err: metaclient: Too Many Requests
Duration: 149.028344ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
454.555441ms
FAIL (2025-08-15 06:21:23 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 05:44:22.781048516 (156h18m3.512316206s) [upload=162649]: Starting upload
Aug 15 05:44:22.781143685 (156h18m3.512411345s) [upload=162649]: Done starting upload
Aug 15 05:44:22.781205261 (156h18m3.51247291s) [upload=162649]: Uploading segments...
Aug 15 05:44:22.781552763 (156h18m3.512820423s) [upload=162649]: Got next segment. Inline: false
Aug 15 05:44:22.781613949 (156h18m3.512881639s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 05:44:22.781623357 (156h18m3.512891007s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 05:44:22.853583217 (156h18m3.584850848s) [seg_pos={0 0}, upload=162649]: Begin upload segment...
Aug 15 05:44:22.853614857 (156h18m3.584882487s) [seg_pos={0 0}, upload=162649]: Done begin upload segment.
Aug 15 05:44:22.853622912 (156h18m3.584890532s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.853630877 (156h18m3.584898507s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.853960808 (156h18m3.585228438s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854221948 (156h18m3.585489578s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854487648 (156h18m3.585755278s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854706198 (156h18m3.585973818s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854916283 (156h18m3.586183903s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855122541 (156h18m3.586390161s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855323318 (156h18m3.586590939s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855572116 (156h18m3.586839736s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855783854 (156h18m3.587051484s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856043823 (156h18m3.587311442s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856221917 (156h18m3.587489547s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856474260 (156h18m3.587741891s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856684717 (156h18m3.587952347s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856890473 (156h18m3.588158103s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.857137107 (156h18m3.588404727s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.857407986 (156h18m3.588675616s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.931933679 (156h18m3.663201319s) [upload=162649]: Next returned nil segment
Aug 15 05:44:22.931946533 (156h18m3.663214163s) [upload=162649]: Waiting for error group managing segments...
Aug 15 05:44:22.941125163 (156h18m3.672392803s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.941816452 (156h18m3.673084082s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942102801 (156h18m3.673370441s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942329847 (156h18m3.673597477s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942519253 (156h18m3.673786883s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.944005966 (156h18m3.675273607s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.945343752 (156h18m3.676611392s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.948716731 (156h18m3.679984381s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.954674047 (156h18m3.685941687s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.956262041 (156h18m3.687529671s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.964011115 (156h18m3.695278766s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.973878009 (156h18m3.705145659s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.033905123 (156h18m3.765172773s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.039146835 (156h18m3.770414484s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.039177702 (156h18m3.770445353s) [seg_pos={0 0}, upload=162649]: Segment reached optimal threshold of 14 pieces.
Aug 15 05:44:23.039726664 (156h18m3.770994314s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: read tcp 5.161.89.252:55162->66.23.193.175:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.039827213 (156h18m3.771094874s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: read tcp 5.161.89.252:18818->79.127.201.215:4352: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.039977666 (156h18m3.771245316s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: read tcp 5.161.89.252:24186->64.49.13.169:4714: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.040119473 (156h18m3.771387133s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eqkG9kQB7wFYRNUY3P77MLwBrwXKuEXvJku3B63FZn6rK5y5d): protocol: context canceled; context canceled
Aug 15 05:44:23.040146273 (156h18m3.771413923s) [seg_pos={0 0}, upload=162649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 05:44:23.040241311 (156h18m3.771508962s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 05:44:23.040250929 (156h18m3.77151862s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 05:44:23.148699216 (156h18m3.879966877s) [upload=162649]: Done uploading segments...
Aug 15 05:44:23.148718513 (156h18m3.879986163s) [upload=162649]: Upload finished. err: <nil>
Duration: 454.577572ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [X......................................................X....] duration:
120.90925ms
FAIL (2025-08-15 06:21:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:17:46.487011506 (156h51m27.218279167s) [upload=163229]: Starting upload Aug 15 06:17:46.487080387 (156h51m27.218348037s) [upload=163229]: Done starting upload Aug 15 06:17:46.487149736 (156h51m27.218417387s) [upload=163229]: Uploading segments... Aug 15 06:17:46.487218095 (156h51m27.218485755s) [upload=163229]: Got next segment. Inline: true Aug 15 06:17:46.487225218 (156h51m27.218492868s) [upload=163229]: Waiting for error group managing segments... Aug 15 06:17:46.487270695 (156h51m27.218538345s) [upload=163229]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:17:46.487275964 (156h51m27.218543615s) [upload=163229]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:17:46.487279381 (156h51m27.218547031s) [upload=163229]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:17:46.490074687 (156h51m27.221342337s) [upload=163229]: Done uploading segments... Aug 15 06:17:46.490086849 (156h51m27.2213545s) [upload=163229]: Upload finished. err: metaclient: Too Many Requests
Duration: 120.929018ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.X......................................................X...] duration:
394.267333ms
FAIL (2025-08-15 06:20:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:17:46.487011506 (156h51m27.218279167s) [upload=163229]: Starting upload Aug 15 06:17:46.487080387 (156h51m27.218348037s) [upload=163229]: Done starting upload Aug 15 06:17:46.487149736 (156h51m27.218417387s) [upload=163229]: Uploading segments... Aug 15 06:17:46.487218095 (156h51m27.218485755s) [upload=163229]: Got next segment. Inline: true Aug 15 06:17:46.487225218 (156h51m27.218492868s) [upload=163229]: Waiting for error group managing segments... Aug 15 06:17:46.487270695 (156h51m27.218538345s) [upload=163229]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:17:46.487275964 (156h51m27.218543615s) [upload=163229]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:17:46.487279381 (156h51m27.218547031s) [upload=163229]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:17:46.490074687 (156h51m27.221342337s) [upload=163229]: Done uploading segments... Aug 15 06:17:46.490086849 (156h51m27.2213545s) [upload=163229]: Upload finished. err: metaclient: Too Many Requests
Duration: 394.292519ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
585.569142ms
FAIL (2025-08-15 06:20:25 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 05:44:22.781048516 (156h18m3.512316206s) [upload=162649]: Starting upload
Aug 15 05:44:22.781143685 (156h18m3.512411345s) [upload=162649]: Done starting upload
Aug 15 05:44:22.781205261 (156h18m3.51247291s) [upload=162649]: Uploading segments...
Aug 15 05:44:22.781552763 (156h18m3.512820423s) [upload=162649]: Got next segment. Inline: false
Aug 15 05:44:22.781613949 (156h18m3.512881639s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 05:44:22.781623357 (156h18m3.512891007s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 05:44:22.853583217 (156h18m3.584850848s) [seg_pos={0 0}, upload=162649]: Begin upload segment...
Aug 15 05:44:22.853614857 (156h18m3.584882487s) [seg_pos={0 0}, upload=162649]: Done begin upload segment.
Aug 15 05:44:22.853622912 (156h18m3.584890532s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.853630877 (156h18m3.584898507s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.853960808 (156h18m3.585228438s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854221948 (156h18m3.585489578s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854487648 (156h18m3.585755278s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854706198 (156h18m3.585973818s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854916283 (156h18m3.586183903s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855122541 (156h18m3.586390161s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855323318 (156h18m3.586590939s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855572116 (156h18m3.586839736s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855783854 (156h18m3.587051484s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856043823 (156h18m3.587311442s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856221917 (156h18m3.587489547s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856474260 (156h18m3.587741891s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856684717 (156h18m3.587952347s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856890473 (156h18m3.588158103s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.857137107 (156h18m3.588404727s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.857407986 (156h18m3.588675616s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.931933679 (156h18m3.663201319s) [upload=162649]: Next returned nil segment
Aug 15 05:44:22.931946533 (156h18m3.663214163s) [upload=162649]: Waiting for error group managing segments...
Aug 15 05:44:22.941125163 (156h18m3.672392803s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.941816452 (156h18m3.673084082s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942102801 (156h18m3.673370441s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942329847 (156h18m3.673597477s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942519253 (156h18m3.673786883s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.944005966 (156h18m3.675273607s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.945343752 (156h18m3.676611392s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.948716731 (156h18m3.679984381s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.954674047 (156h18m3.685941687s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.956262041 (156h18m3.687529671s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.964011115 (156h18m3.695278766s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.973878009 (156h18m3.705145659s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.033905123 (156h18m3.765172773s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.039146835 (156h18m3.770414484s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.039177702 (156h18m3.770445353s) [seg_pos={0 0}, upload=162649]: Segment reached optimal threshold of 14 pieces.
Aug 15 05:44:23.039726664 (156h18m3.770994314s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: read tcp 5.161.89.252:55162->66.23.193.175:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.039827213 (156h18m3.771094874s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: read tcp 5.161.89.252:18818->79.127.201.215:4352: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.039977666 (156h18m3.771245316s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: read tcp 5.161.89.252:24186->64.49.13.169:4714: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.040119473 (156h18m3.771387133s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eqkG9kQB7wFYRNUY3P77MLwBrwXKuEXvJku3B63FZn6rK5y5d): protocol: context canceled; context canceled
Aug 15 05:44:23.040146273 (156h18m3.771413923s) [seg_pos={0 0}, upload=162649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 05:44:23.040241311 (156h18m3.771508962s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 05:44:23.040250929 (156h18m3.77151862s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 05:44:23.148699216 (156h18m3.879966877s) [upload=162649]: Done uploading segments...
Aug 15 05:44:23.148718513 (156h18m3.879986163s) [upload=162649]: Upload finished. err: <nil>
Duration: 585.585492ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
320.4297ms
FAIL (2025-08-15 06:19:52 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 05:44:22.781048516 (156h18m3.512316206s) [upload=162649]: Starting upload
Aug 15 05:44:22.781143685 (156h18m3.512411345s) [upload=162649]: Done starting upload
Aug 15 05:44:22.781205261 (156h18m3.51247291s) [upload=162649]: Uploading segments...
Aug 15 05:44:22.781552763 (156h18m3.512820423s) [upload=162649]: Got next segment. Inline: false
Aug 15 05:44:22.781613949 (156h18m3.512881639s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 05:44:22.781623357 (156h18m3.512891007s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 05:44:22.853583217 (156h18m3.584850848s) [seg_pos={0 0}, upload=162649]: Begin upload segment...
Aug 15 05:44:22.853614857 (156h18m3.584882487s) [seg_pos={0 0}, upload=162649]: Done begin upload segment.
Aug 15 05:44:22.853622912 (156h18m3.584890532s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.853630877 (156h18m3.584898507s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.853960808 (156h18m3.585228438s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854221948 (156h18m3.585489578s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854487648 (156h18m3.585755278s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854706198 (156h18m3.585973818s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854916283 (156h18m3.586183903s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855122541 (156h18m3.586390161s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855323318 (156h18m3.586590939s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855572116 (156h18m3.586839736s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855783854 (156h18m3.587051484s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856043823 (156h18m3.587311442s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856221917 (156h18m3.587489547s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856474260 (156h18m3.587741891s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856684717 (156h18m3.587952347s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856890473 (156h18m3.588158103s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.857137107 (156h18m3.588404727s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.857407986 (156h18m3.588675616s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.931933679 (156h18m3.663201319s) [upload=162649]: Next returned nil segment
Aug 15 05:44:22.931946533 (156h18m3.663214163s) [upload=162649]: Waiting for error group managing segments...
Aug 15 05:44:22.941125163 (156h18m3.672392803s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.941816452 (156h18m3.673084082s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942102801 (156h18m3.673370441s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942329847 (156h18m3.673597477s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942519253 (156h18m3.673786883s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.944005966 (156h18m3.675273607s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.945343752 (156h18m3.676611392s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.948716731 (156h18m3.679984381s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.954674047 (156h18m3.685941687s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.956262041 (156h18m3.687529671s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.964011115 (156h18m3.695278766s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.973878009 (156h18m3.705145659s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.033905123 (156h18m3.765172773s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.039146835 (156h18m3.770414484s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.039177702 (156h18m3.770445353s) [seg_pos={0 0}, upload=162649]: Segment reached optimal threshold of 14 pieces.
Aug 15 05:44:23.039726664 (156h18m3.770994314s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: read tcp 5.161.89.252:55162->66.23.193.175:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.039827213 (156h18m3.771094874s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: read tcp 5.161.89.252:18818->79.127.201.215:4352: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.039977666 (156h18m3.771245316s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: read tcp 5.161.89.252:24186->64.49.13.169:4714: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.040119473 (156h18m3.771387133s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eqkG9kQB7wFYRNUY3P77MLwBrwXKuEXvJku3B63FZn6rK5y5d): protocol: context canceled; context canceled
Aug 15 05:44:23.040146273 (156h18m3.771413923s) [seg_pos={0 0}, upload=162649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 05:44:23.040241311 (156h18m3.771508962s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 05:44:23.040250929 (156h18m3.77151862s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 05:44:23.148699216 (156h18m3.879966877s) [upload=162649]: Done uploading segments...
Aug 15 05:44:23.148718513 (156h18m3.879986163s) [upload=162649]: Upload finished. err: <nil>
Duration: 320.45125ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..X......................................................X..] duration:
132.116344ms
FAIL (2025-08-15 06:19:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:17:46.487011506 (156h51m27.218279167s) [upload=163229]: Starting upload Aug 15 06:17:46.487080387 (156h51m27.218348037s) [upload=163229]: Done starting upload Aug 15 06:17:46.487149736 (156h51m27.218417387s) [upload=163229]: Uploading segments... Aug 15 06:17:46.487218095 (156h51m27.218485755s) [upload=163229]: Got next segment. Inline: true Aug 15 06:17:46.487225218 (156h51m27.218492868s) [upload=163229]: Waiting for error group managing segments... Aug 15 06:17:46.487270695 (156h51m27.218538345s) [upload=163229]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:17:46.487275964 (156h51m27.218543615s) [upload=163229]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:17:46.487279381 (156h51m27.218547031s) [upload=163229]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:17:46.490074687 (156h51m27.221342337s) [upload=163229]: Done uploading segments... Aug 15 06:17:46.490086849 (156h51m27.2213545s) [upload=163229]: Upload finished. err: metaclient: Too Many Requests
Duration: 132.140409ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
401.427963ms
FAIL (2025-08-15 06:19:14 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 05:44:22.781048516 (156h18m3.512316206s) [upload=162649]: Starting upload
Aug 15 05:44:22.781143685 (156h18m3.512411345s) [upload=162649]: Done starting upload
Aug 15 05:44:22.781205261 (156h18m3.51247291s) [upload=162649]: Uploading segments...
Aug 15 05:44:22.781552763 (156h18m3.512820423s) [upload=162649]: Got next segment. Inline: false
Aug 15 05:44:22.781613949 (156h18m3.512881639s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 05:44:22.781623357 (156h18m3.512891007s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 05:44:22.853583217 (156h18m3.584850848s) [seg_pos={0 0}, upload=162649]: Begin upload segment...
Aug 15 05:44:22.853614857 (156h18m3.584882487s) [seg_pos={0 0}, upload=162649]: Done begin upload segment.
Aug 15 05:44:22.853622912 (156h18m3.584890532s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.853630877 (156h18m3.584898507s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.853960808 (156h18m3.585228438s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854221948 (156h18m3.585489578s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854487648 (156h18m3.585755278s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854706198 (156h18m3.585973818s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854916283 (156h18m3.586183903s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855122541 (156h18m3.586390161s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855323318 (156h18m3.586590939s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855572116 (156h18m3.586839736s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855783854 (156h18m3.587051484s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856043823 (156h18m3.587311442s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856221917 (156h18m3.587489547s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856474260 (156h18m3.587741891s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856684717 (156h18m3.587952347s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856890473 (156h18m3.588158103s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.857137107 (156h18m3.588404727s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.857407986 (156h18m3.588675616s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.931933679 (156h18m3.663201319s) [upload=162649]: Next returned nil segment
Aug 15 05:44:22.931946533 (156h18m3.663214163s) [upload=162649]: Waiting for error group managing segments...
Aug 15 05:44:22.941125163 (156h18m3.672392803s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.941816452 (156h18m3.673084082s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942102801 (156h18m3.673370441s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942329847 (156h18m3.673597477s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942519253 (156h18m3.673786883s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.944005966 (156h18m3.675273607s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.945343752 (156h18m3.676611392s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.948716731 (156h18m3.679984381s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.954674047 (156h18m3.685941687s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.956262041 (156h18m3.687529671s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.964011115 (156h18m3.695278766s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.973878009 (156h18m3.705145659s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.033905123 (156h18m3.765172773s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.039146835 (156h18m3.770414484s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.039177702 (156h18m3.770445353s) [seg_pos={0 0}, upload=162649]: Segment reached optimal threshold of 14 pieces.
Aug 15 05:44:23.039726664 (156h18m3.770994314s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: read tcp 5.161.89.252:55162->66.23.193.175:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.039827213 (156h18m3.771094874s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: read tcp 5.161.89.252:18818->79.127.201.215:4352: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.039977666 (156h18m3.771245316s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: read tcp 5.161.89.252:24186->64.49.13.169:4714: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.040119473 (156h18m3.771387133s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eqkG9kQB7wFYRNUY3P77MLwBrwXKuEXvJku3B63FZn6rK5y5d): protocol: context canceled; context canceled
Aug 15 05:44:23.040146273 (156h18m3.771413923s) [seg_pos={0 0}, upload=162649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 05:44:23.040241311 (156h18m3.771508962s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 05:44:23.040250929 (156h18m3.77151862s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 05:44:23.148699216 (156h18m3.879966877s) [upload=162649]: Done uploading segments...
Aug 15 05:44:23.148718513 (156h18m3.879986163s) [upload=162649]: Upload finished. err: <nil>
Duration: 401.450455ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...X......................................................X.] duration:
125.076296ms
FAIL (2025-08-15 06:18:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 15 06:17:46.487011506 (156h51m27.218279167s) [upload=163229]: Starting upload Aug 15 06:17:46.487080387 (156h51m27.218348037s) [upload=163229]: Done starting upload Aug 15 06:17:46.487149736 (156h51m27.218417387s) [upload=163229]: Uploading segments... Aug 15 06:17:46.487218095 (156h51m27.218485755s) [upload=163229]: Got next segment. Inline: true Aug 15 06:17:46.487225218 (156h51m27.218492868s) [upload=163229]: Waiting for error group managing segments... Aug 15 06:17:46.487270695 (156h51m27.218538345s) [upload=163229]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 15 06:17:46.487275964 (156h51m27.218543615s) [upload=163229]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 15 06:17:46.487279381 (156h51m27.218547031s) [upload=163229]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 15 06:17:46.490074687 (156h51m27.221342337s) [upload=163229]: Done uploading segments... Aug 15 06:17:46.490086849 (156h51m27.2213545s) [upload=163229]: Upload finished. err: metaclient: Too Many Requests
Duration: 125.098667ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
369.669898ms
FAIL (2025-08-15 06:18:25 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 15 05:44:22.781048516 (156h18m3.512316206s) [upload=162649]: Starting upload
Aug 15 05:44:22.781143685 (156h18m3.512411345s) [upload=162649]: Done starting upload
Aug 15 05:44:22.781205261 (156h18m3.51247291s) [upload=162649]: Uploading segments...
Aug 15 05:44:22.781552763 (156h18m3.512820423s) [upload=162649]: Got next segment. Inline: false
Aug 15 05:44:22.781613949 (156h18m3.512881639s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 15 05:44:22.781623357 (156h18m3.512891007s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 15 05:44:22.853583217 (156h18m3.584850848s) [seg_pos={0 0}, upload=162649]: Begin upload segment...
Aug 15 05:44:22.853614857 (156h18m3.584882487s) [seg_pos={0 0}, upload=162649]: Done begin upload segment.
Aug 15 05:44:22.853622912 (156h18m3.584890532s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.853630877 (156h18m3.584898507s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.853960808 (156h18m3.585228438s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854221948 (156h18m3.585489578s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854487648 (156h18m3.585755278s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854706198 (156h18m3.585973818s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.854916283 (156h18m3.586183903s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855122541 (156h18m3.586390161s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855323318 (156h18m3.586590939s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855572116 (156h18m3.586839736s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.855783854 (156h18m3.587051484s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856043823 (156h18m3.587311442s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856221917 (156h18m3.587489547s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856474260 (156h18m3.587741891s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856684717 (156h18m3.587952347s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.856890473 (156h18m3.588158103s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.857137107 (156h18m3.588404727s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.857407986 (156h18m3.588675616s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Uploading piece...
Aug 15 05:44:22.931933679 (156h18m3.663201319s) [upload=162649]: Next returned nil segment
Aug 15 05:44:22.931946533 (156h18m3.663214163s) [upload=162649]: Waiting for error group managing segments...
Aug 15 05:44:22.941125163 (156h18m3.672392803s) [noise=true , address=79.127.219.48:4086 , piece_id=VKG6N5XZTR4AX2HXWXC57G2GNBUFITXGDQYM5E2625KKQQN33FEA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.941816452 (156h18m3.673084082s) [noise=true , address=77.90.31.16:4762 , piece_id=3BSD43Y2NPPCH5NNXCAISZHU6PHBJEMPXNPRGF3DJHA7RIBGFX5A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942102801 (156h18m3.673370441s) [noise=true , address=77.90.31.18:4824 , piece_id=H5WNXV4IOB567DYGTZGVHM2CQNEEJBZDALG6ZTCY5FGIBNGZSVVQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942329847 (156h18m3.673597477s) [noise=true , address=77.90.31.15:4706 , piece_id=5UAWSBNKIKQJAYLKUBRH475KL66UXN4JGPZTXEIZWPO7HKAUHWMA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.942519253 (156h18m3.673786883s) [noise=true , address=77.90.31.17:4773 , piece_id=P6M43KJPMP7BUC2AMIILM6WU33WDPSECP3IUKUCY6ZSQGCXCXVMQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.944005966 (156h18m3.675273607s) [noise=true , address=77.90.31.10:4524 , piece_id=ZW3IR22TKWSQ4MXJIDKFLULP7IE2ESI7YZD7WP4YIXAXNKSWJ5JA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.945343752 (156h18m3.676611392s) [noise=true , address=104.36.82.8:4998 , piece_id=ULREOZBR3QPLFMLBFHLWB23HFP3SGPLVNOZPTSOTCO5MLMUT5Z6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.948716731 (156h18m3.679984381s) [noise=true , address=45.91.116.10:4111 , piece_id=Z3MBGP7HZNNL7HZHCSH3BL3FNYO3IUZVB6JZSREWI276FGIKYKCA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.954674047 (156h18m3.685941687s) [noise=true , address=104.36.82.44:4901 , piece_id=WLH2MT3QCZ6DTK2V3WUUJMIISWGKEZ75ZLG7N2IH6GNY6AJZ52UA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.956262041 (156h18m3.687529671s) [noise=true , address=104.36.82.34:4564 , piece_id=KNQGA4CSDOEADMJL7PJ2R53U26ZBBF2AHFI7XP3Z5NOMSBHKWXPA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.964011115 (156h18m3.695278766s) [noise=true , address=104.36.82.58:4285 , piece_id=4M25B3SJLJTJZGDT4PN7QP3RFYD43AZOWFHLWZ32R6CICBTNXXOQ, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:22.973878009 (156h18m3.705145659s) [noise=true , address=104.36.82.5:4871 , piece_id=7QNZRRJLZPZV3XNGVOBNUVXIRGQ6P6TX6BAHWQ5S4HWZDE3KLY6A, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.033905123 (156h18m3.765172773s) [noise=true , address=104.36.82.19:4407 , piece_id=54EIO4D7MBXPAOJNOGAIVFDUBJ6CWMDDVXW3AONPKOZUNJNZ6F5Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.039146835 (156h18m3.770414484s) [noise=true , address=104.36.82.23:4452 , piece_id=TY55FDIBHHDRHBSAXOI7ULAHQYKWFLCJNNHH6XTBAKH5LWZJRRZA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: <nil>
Aug 15 05:44:23.039177702 (156h18m3.770445353s) [seg_pos={0 0}, upload=162649]: Segment reached optimal threshold of 14 pieces.
Aug 15 05:44:23.039726664 (156h18m3.770994314s) [noise=true , address=66.23.193.175:4556 , piece_id=AXN3RJB5JCKKXQGLBSQPWVRUYJUWF4NHJGDHQ5NXTZOJCM2RYXWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RHXPzzH8G9xGyABLH7hNnmkZuDdWpoiQkoTxNBzdzNvNQhN29): protocol: read tcp 5.161.89.252:55162->66.23.193.175:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.039827213 (156h18m3.771094874s) [noise=true , address=79.127.201.215:4352 , piece_id=OFKFZPWSSOUE6DL2LZ3V3RSNRJSROTYWTQH2ADIR7URJFO2QNZWA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KNKWRTR6pZfxWFcFwsEKaqGsUMBBSTBsxvmeKsV1GDfEBvQk7): protocol: read tcp 5.161.89.252:18818->79.127.201.215:4352: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.039977666 (156h18m3.771245316s) [noise=true , address=64.49.13.169:4714 , piece_id=VOVMCNYU7UVDMXN4QVLRQM5OOW6CBEKO2IFHFPMWEKCFNRFK2AVA, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: read tcp 5.161.89.252:24186->64.49.13.169:4714: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 15 05:44:23.040119473 (156h18m3.771387133s) [noise=true , address=156.146.43.225:4440 , piece_id=22Q2FKRAXNHKSOUEZV5CQLKYGYNZSWC2SQNEEFE2OM37II7JX45Q, seg_pos={0 0}, upload=162649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eqkG9kQB7wFYRNUY3P77MLwBrwXKuEXvJku3B63FZn6rK5y5d): protocol: context canceled; context canceled
Aug 15 05:44:23.040146273 (156h18m3.771413923s) [seg_pos={0 0}, upload=162649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 15 05:44:23.040241311 (156h18m3.771508962s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 15 05:44:23.040250929 (156h18m3.77151862s) [upload=162649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 15 05:44:23.148699216 (156h18m3.879966877s) [upload=162649]: Done uploading segments...
Aug 15 05:44:23.148718513 (156h18m3.879986163s) [upload=162649]: Upload finished. err: <nil>
Duration: 369.721234ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|