Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 185.868956ms FAIL (2025-10-08 09:08:22 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 185.900695ms core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 374.83054ms FAIL (2025-10-08 09:07:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 374.857601ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 169.654961ms FAIL (2025-10-08 09:07:35 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 169.671372ms core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 673.853383ms FAIL (2025-10-08 09:07:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 673.870766ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 431.440125ms FAIL (2025-10-08 09:07:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 8 08:29:42.207274015 (954h21m17.560059133s) [upload=839834]: Starting upload Oct 8 08:29:42.207370566 (954h21m17.560155695s) [upload=839834]: Done starting upload Oct 8 08:29:42.207439656 (954h21m17.560224784s) [upload=839834]: Uploading segments... Oct 8 08:29:42.207767773 (954h21m17.5605529s) [upload=839834]: Got next segment. Inline: false Oct 8 08:29:42.207812115 (954h21m17.560597254s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 08:29:42.207822906 (954h21m17.560608034s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 08:29:46.231440887 (954h21m21.584225984s) [seg_pos={0 0}, upload=839834]: Begin upload segment... Oct 8 08:29:46.231480260 (954h21m21.584265359s) [seg_pos={0 0}, upload=839834]: Done begin upload segment. Oct 8 08:29:46.231506099 (954h21m21.584291197s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231522400 (954h21m21.584307497s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231867997 (954h21m21.584653105s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231878217 (954h21m21.584663325s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232161820 (954h21m21.584946918s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232199901 (954h21m21.584984999s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232425575 (954h21m21.585210672s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232462444 (954h21m21.585247541s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232708044 (954h21m21.585493142s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232776564 (954h21m21.585561662s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233024619 (954h21m21.585809717s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233051609 (954h21m21.585836718s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233293123 (954h21m21.58607822s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233326044 (954h21m21.586111142s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233564892 (954h21m21.58634999s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233841642 (954h21m21.586626741s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.322099433 (954h21m21.674884531s) [upload=839834]: Next returned nil segment Oct 8 08:29:46.322132464 (954h21m21.674917563s) [upload=839834]: Waiting for error group managing segments... Oct 8 08:29:46.330063889 (954h21m21.682848997s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330383188 (954h21m21.683168296s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330611265 (954h21m21.683396373s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330845516 (954h21m21.683630614s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331046913 (954h21m21.683832012s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331359309 (954h21m21.684144407s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331399916 (954h21m21.684185024s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331768769 (954h21m21.684553877s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332110469 (954h21m21.684895577s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332180250 (954h21m21.684965358s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332506262 (954h21m21.685291361s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332716447 (954h21m21.685501555s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332845990 (954h21m21.685631087s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332852031 (954h21m21.685637129s) [seg_pos={0 0}, upload=839834]: Segment reached optimal threshold of 13 pieces. Oct 8 08:29:46.332950155 (954h21m21.685735263s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.332998957 (954h21m21.685784054s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.333249086 (954h21m21.686034194s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.333272700 (954h21m21.686057808s) [seg_pos={0 0}, upload=839834]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Oct 8 08:29:46.333344115 (954h21m21.686129223s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 08:29:46.333349395 (954h21m21.686134503s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 08:30:13.602630613 (954h21m48.955415712s) [upload=839834]: Done uploading segments... Oct 8 08:30:13.602650050 (954h21m48.955435158s) [upload=839834]: Upload finished. err: metaclient: context deadline exceeded Duration: 431.457197ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 180.874053ms FAIL (2025-10-08 09:06:41 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 180.895583ms core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 470.635959ms FAIL (2025-10-08 09:06:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 470.655104ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 536.062917ms FAIL (2025-10-08 09:06:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 8 08:29:42.207274015 (954h21m17.560059133s) [upload=839834]: Starting upload Oct 8 08:29:42.207370566 (954h21m17.560155695s) [upload=839834]: Done starting upload Oct 8 08:29:42.207439656 (954h21m17.560224784s) [upload=839834]: Uploading segments... Oct 8 08:29:42.207767773 (954h21m17.5605529s) [upload=839834]: Got next segment. Inline: false Oct 8 08:29:42.207812115 (954h21m17.560597254s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 08:29:42.207822906 (954h21m17.560608034s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 08:29:46.231440887 (954h21m21.584225984s) [seg_pos={0 0}, upload=839834]: Begin upload segment... Oct 8 08:29:46.231480260 (954h21m21.584265359s) [seg_pos={0 0}, upload=839834]: Done begin upload segment. Oct 8 08:29:46.231506099 (954h21m21.584291197s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231522400 (954h21m21.584307497s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231867997 (954h21m21.584653105s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231878217 (954h21m21.584663325s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232161820 (954h21m21.584946918s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232199901 (954h21m21.584984999s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232425575 (954h21m21.585210672s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232462444 (954h21m21.585247541s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232708044 (954h21m21.585493142s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232776564 (954h21m21.585561662s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233024619 (954h21m21.585809717s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233051609 (954h21m21.585836718s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233293123 (954h21m21.58607822s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233326044 (954h21m21.586111142s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233564892 (954h21m21.58634999s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233841642 (954h21m21.586626741s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.322099433 (954h21m21.674884531s) [upload=839834]: Next returned nil segment Oct 8 08:29:46.322132464 (954h21m21.674917563s) [upload=839834]: Waiting for error group managing segments... Oct 8 08:29:46.330063889 (954h21m21.682848997s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330383188 (954h21m21.683168296s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330611265 (954h21m21.683396373s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330845516 (954h21m21.683630614s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331046913 (954h21m21.683832012s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331359309 (954h21m21.684144407s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331399916 (954h21m21.684185024s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331768769 (954h21m21.684553877s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332110469 (954h21m21.684895577s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332180250 (954h21m21.684965358s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332506262 (954h21m21.685291361s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332716447 (954h21m21.685501555s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332845990 (954h21m21.685631087s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332852031 (954h21m21.685637129s) [seg_pos={0 0}, upload=839834]: Segment reached optimal threshold of 13 pieces. Oct 8 08:29:46.332950155 (954h21m21.685735263s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.332998957 (954h21m21.685784054s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.333249086 (954h21m21.686034194s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.333272700 (954h21m21.686057808s) [seg_pos={0 0}, upload=839834]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Oct 8 08:29:46.333344115 (954h21m21.686129223s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 08:29:46.333349395 (954h21m21.686134503s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 08:30:13.602630613 (954h21m48.955415712s) [upload=839834]: Done uploading segments... Oct 8 08:30:13.602650050 (954h21m48.955435158s) [upload=839834]: Upload finished. err: metaclient: context deadline exceeded Duration: 536.085198ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 600.034865ms FAIL (2025-10-08 09:05:28 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 600.05888ms core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 404.666249ms FAIL (2025-10-08 09:05:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 404.684643ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 473.692117ms FAIL (2025-10-08 09:05:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 8 08:29:42.207274015 (954h21m17.560059133s) [upload=839834]: Starting upload Oct 8 08:29:42.207370566 (954h21m17.560155695s) [upload=839834]: Done starting upload Oct 8 08:29:42.207439656 (954h21m17.560224784s) [upload=839834]: Uploading segments... Oct 8 08:29:42.207767773 (954h21m17.5605529s) [upload=839834]: Got next segment. Inline: false Oct 8 08:29:42.207812115 (954h21m17.560597254s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 08:29:42.207822906 (954h21m17.560608034s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 08:29:46.231440887 (954h21m21.584225984s) [seg_pos={0 0}, upload=839834]: Begin upload segment... Oct 8 08:29:46.231480260 (954h21m21.584265359s) [seg_pos={0 0}, upload=839834]: Done begin upload segment. Oct 8 08:29:46.231506099 (954h21m21.584291197s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231522400 (954h21m21.584307497s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231867997 (954h21m21.584653105s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231878217 (954h21m21.584663325s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232161820 (954h21m21.584946918s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232199901 (954h21m21.584984999s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232425575 (954h21m21.585210672s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232462444 (954h21m21.585247541s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232708044 (954h21m21.585493142s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232776564 (954h21m21.585561662s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233024619 (954h21m21.585809717s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233051609 (954h21m21.585836718s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233293123 (954h21m21.58607822s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233326044 (954h21m21.586111142s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233564892 (954h21m21.58634999s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233841642 (954h21m21.586626741s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.322099433 (954h21m21.674884531s) [upload=839834]: Next returned nil segment Oct 8 08:29:46.322132464 (954h21m21.674917563s) [upload=839834]: Waiting for error group managing segments... Oct 8 08:29:46.330063889 (954h21m21.682848997s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330383188 (954h21m21.683168296s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330611265 (954h21m21.683396373s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330845516 (954h21m21.683630614s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331046913 (954h21m21.683832012s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331359309 (954h21m21.684144407s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331399916 (954h21m21.684185024s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331768769 (954h21m21.684553877s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332110469 (954h21m21.684895577s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332180250 (954h21m21.684965358s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332506262 (954h21m21.685291361s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332716447 (954h21m21.685501555s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332845990 (954h21m21.685631087s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332852031 (954h21m21.685637129s) [seg_pos={0 0}, upload=839834]: Segment reached optimal threshold of 13 pieces. Oct 8 08:29:46.332950155 (954h21m21.685735263s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.332998957 (954h21m21.685784054s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.333249086 (954h21m21.686034194s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.333272700 (954h21m21.686057808s) [seg_pos={0 0}, upload=839834]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Oct 8 08:29:46.333344115 (954h21m21.686129223s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 08:29:46.333349395 (954h21m21.686134503s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 08:30:13.602630613 (954h21m48.955415712s) [upload=839834]: Done uploading segments... Oct 8 08:30:13.602650050 (954h21m48.955435158s) [upload=839834]: Upload finished. err: metaclient: context deadline exceeded Duration: 473.706224ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 409.782951ms FAIL (2025-10-08 09:04:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 409.800765ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 302.628495ms FAIL (2025-10-08 09:04:47 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 302.661507ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 500.708207ms FAIL (2025-10-08 09:04:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 8 08:29:42.207274015 (954h21m17.560059133s) [upload=839834]: Starting upload Oct 8 08:29:42.207370566 (954h21m17.560155695s) [upload=839834]: Done starting upload Oct 8 08:29:42.207439656 (954h21m17.560224784s) [upload=839834]: Uploading segments... Oct 8 08:29:42.207767773 (954h21m17.5605529s) [upload=839834]: Got next segment. Inline: false Oct 8 08:29:42.207812115 (954h21m17.560597254s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 08:29:42.207822906 (954h21m17.560608034s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 08:29:46.231440887 (954h21m21.584225984s) [seg_pos={0 0}, upload=839834]: Begin upload segment... Oct 8 08:29:46.231480260 (954h21m21.584265359s) [seg_pos={0 0}, upload=839834]: Done begin upload segment. Oct 8 08:29:46.231506099 (954h21m21.584291197s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231522400 (954h21m21.584307497s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231867997 (954h21m21.584653105s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231878217 (954h21m21.584663325s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232161820 (954h21m21.584946918s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232199901 (954h21m21.584984999s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232425575 (954h21m21.585210672s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232462444 (954h21m21.585247541s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232708044 (954h21m21.585493142s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232776564 (954h21m21.585561662s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233024619 (954h21m21.585809717s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233051609 (954h21m21.585836718s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233293123 (954h21m21.58607822s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233326044 (954h21m21.586111142s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233564892 (954h21m21.58634999s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233841642 (954h21m21.586626741s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.322099433 (954h21m21.674884531s) [upload=839834]: Next returned nil segment Oct 8 08:29:46.322132464 (954h21m21.674917563s) [upload=839834]: Waiting for error group managing segments... Oct 8 08:29:46.330063889 (954h21m21.682848997s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330383188 (954h21m21.683168296s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330611265 (954h21m21.683396373s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330845516 (954h21m21.683630614s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331046913 (954h21m21.683832012s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331359309 (954h21m21.684144407s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331399916 (954h21m21.684185024s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331768769 (954h21m21.684553877s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332110469 (954h21m21.684895577s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332180250 (954h21m21.684965358s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332506262 (954h21m21.685291361s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332716447 (954h21m21.685501555s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332845990 (954h21m21.685631087s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332852031 (954h21m21.685637129s) [seg_pos={0 0}, upload=839834]: Segment reached optimal threshold of 13 pieces. Oct 8 08:29:46.332950155 (954h21m21.685735263s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.332998957 (954h21m21.685784054s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.333249086 (954h21m21.686034194s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.333272700 (954h21m21.686057808s) [seg_pos={0 0}, upload=839834]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Oct 8 08:29:46.333344115 (954h21m21.686129223s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 08:29:46.333349395 (954h21m21.686134503s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 08:30:13.602630613 (954h21m48.955415712s) [upload=839834]: Done uploading segments... Oct 8 08:30:13.602650050 (954h21m48.955435158s) [upload=839834]: Upload finished. err: metaclient: context deadline exceeded Duration: 500.747041ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 166.007385ms FAIL (2025-10-08 09:04:16 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 166.03146ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 340.305388ms FAIL (2025-10-08 09:04:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 8 08:29:42.207274015 (954h21m17.560059133s) [upload=839834]: Starting upload Oct 8 08:29:42.207370566 (954h21m17.560155695s) [upload=839834]: Done starting upload Oct 8 08:29:42.207439656 (954h21m17.560224784s) [upload=839834]: Uploading segments... Oct 8 08:29:42.207767773 (954h21m17.5605529s) [upload=839834]: Got next segment. Inline: false Oct 8 08:29:42.207812115 (954h21m17.560597254s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 08:29:42.207822906 (954h21m17.560608034s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 08:29:46.231440887 (954h21m21.584225984s) [seg_pos={0 0}, upload=839834]: Begin upload segment... Oct 8 08:29:46.231480260 (954h21m21.584265359s) [seg_pos={0 0}, upload=839834]: Done begin upload segment. Oct 8 08:29:46.231506099 (954h21m21.584291197s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231522400 (954h21m21.584307497s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231867997 (954h21m21.584653105s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231878217 (954h21m21.584663325s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232161820 (954h21m21.584946918s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232199901 (954h21m21.584984999s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232425575 (954h21m21.585210672s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232462444 (954h21m21.585247541s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232708044 (954h21m21.585493142s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232776564 (954h21m21.585561662s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233024619 (954h21m21.585809717s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233051609 (954h21m21.585836718s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233293123 (954h21m21.58607822s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233326044 (954h21m21.586111142s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233564892 (954h21m21.58634999s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233841642 (954h21m21.586626741s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.322099433 (954h21m21.674884531s) [upload=839834]: Next returned nil segment Oct 8 08:29:46.322132464 (954h21m21.674917563s) [upload=839834]: Waiting for error group managing segments... Oct 8 08:29:46.330063889 (954h21m21.682848997s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330383188 (954h21m21.683168296s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330611265 (954h21m21.683396373s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330845516 (954h21m21.683630614s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331046913 (954h21m21.683832012s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331359309 (954h21m21.684144407s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331399916 (954h21m21.684185024s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331768769 (954h21m21.684553877s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332110469 (954h21m21.684895577s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332180250 (954h21m21.684965358s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332506262 (954h21m21.685291361s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332716447 (954h21m21.685501555s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332845990 (954h21m21.685631087s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332852031 (954h21m21.685637129s) [seg_pos={0 0}, upload=839834]: Segment reached optimal threshold of 13 pieces. Oct 8 08:29:46.332950155 (954h21m21.685735263s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.332998957 (954h21m21.685784054s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.333249086 (954h21m21.686034194s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.333272700 (954h21m21.686057808s) [seg_pos={0 0}, upload=839834]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Oct 8 08:29:46.333344115 (954h21m21.686129223s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 08:29:46.333349395 (954h21m21.686134503s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 08:30:13.602630613 (954h21m48.955415712s) [upload=839834]: Done uploading segments... Oct 8 08:30:13.602650050 (954h21m48.955435158s) [upload=839834]: Upload finished. err: metaclient: context deadline exceeded Duration: 340.324484ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 456.568139ms FAIL (2025-10-08 09:04:01 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 456.589479ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 413.323154ms FAIL (2025-10-08 09:03:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 413.337821ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 517.407954ms FAIL (2025-10-08 09:03:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 8 08:29:42.207274015 (954h21m17.560059133s) [upload=839834]: Starting upload Oct 8 08:29:42.207370566 (954h21m17.560155695s) [upload=839834]: Done starting upload Oct 8 08:29:42.207439656 (954h21m17.560224784s) [upload=839834]: Uploading segments... Oct 8 08:29:42.207767773 (954h21m17.5605529s) [upload=839834]: Got next segment. Inline: false Oct 8 08:29:42.207812115 (954h21m17.560597254s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 08:29:42.207822906 (954h21m17.560608034s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 08:29:46.231440887 (954h21m21.584225984s) [seg_pos={0 0}, upload=839834]: Begin upload segment... Oct 8 08:29:46.231480260 (954h21m21.584265359s) [seg_pos={0 0}, upload=839834]: Done begin upload segment. Oct 8 08:29:46.231506099 (954h21m21.584291197s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231522400 (954h21m21.584307497s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231867997 (954h21m21.584653105s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231878217 (954h21m21.584663325s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232161820 (954h21m21.584946918s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232199901 (954h21m21.584984999s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232425575 (954h21m21.585210672s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232462444 (954h21m21.585247541s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232708044 (954h21m21.585493142s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232776564 (954h21m21.585561662s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233024619 (954h21m21.585809717s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233051609 (954h21m21.585836718s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233293123 (954h21m21.58607822s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233326044 (954h21m21.586111142s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233564892 (954h21m21.58634999s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233841642 (954h21m21.586626741s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.322099433 (954h21m21.674884531s) [upload=839834]: Next returned nil segment Oct 8 08:29:46.322132464 (954h21m21.674917563s) [upload=839834]: Waiting for error group managing segments... Oct 8 08:29:46.330063889 (954h21m21.682848997s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330383188 (954h21m21.683168296s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330611265 (954h21m21.683396373s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330845516 (954h21m21.683630614s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331046913 (954h21m21.683832012s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331359309 (954h21m21.684144407s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331399916 (954h21m21.684185024s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331768769 (954h21m21.684553877s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332110469 (954h21m21.684895577s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332180250 (954h21m21.684965358s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332506262 (954h21m21.685291361s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332716447 (954h21m21.685501555s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332845990 (954h21m21.685631087s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332852031 (954h21m21.685637129s) [seg_pos={0 0}, upload=839834]: Segment reached optimal threshold of 13 pieces. Oct 8 08:29:46.332950155 (954h21m21.685735263s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.332998957 (954h21m21.685784054s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.333249086 (954h21m21.686034194s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.333272700 (954h21m21.686057808s) [seg_pos={0 0}, upload=839834]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Oct 8 08:29:46.333344115 (954h21m21.686129223s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 08:29:46.333349395 (954h21m21.686134503s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 08:30:13.602630613 (954h21m48.955415712s) [upload=839834]: Done uploading segments... Oct 8 08:30:13.602650050 (954h21m48.955435158s) [upload=839834]: Upload finished. err: metaclient: context deadline exceeded Duration: 517.428943ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 259.382379ms FAIL (2025-10-08 09:03:09 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 259.442032ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 484.160692ms FAIL (2025-10-08 09:02:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 8 08:29:42.207274015 (954h21m17.560059133s) [upload=839834]: Starting upload Oct 8 08:29:42.207370566 (954h21m17.560155695s) [upload=839834]: Done starting upload Oct 8 08:29:42.207439656 (954h21m17.560224784s) [upload=839834]: Uploading segments... Oct 8 08:29:42.207767773 (954h21m17.5605529s) [upload=839834]: Got next segment. Inline: false Oct 8 08:29:42.207812115 (954h21m17.560597254s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 08:29:42.207822906 (954h21m17.560608034s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 08:29:46.231440887 (954h21m21.584225984s) [seg_pos={0 0}, upload=839834]: Begin upload segment... Oct 8 08:29:46.231480260 (954h21m21.584265359s) [seg_pos={0 0}, upload=839834]: Done begin upload segment. Oct 8 08:29:46.231506099 (954h21m21.584291197s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231522400 (954h21m21.584307497s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231867997 (954h21m21.584653105s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231878217 (954h21m21.584663325s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232161820 (954h21m21.584946918s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232199901 (954h21m21.584984999s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232425575 (954h21m21.585210672s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232462444 (954h21m21.585247541s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232708044 (954h21m21.585493142s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232776564 (954h21m21.585561662s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233024619 (954h21m21.585809717s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233051609 (954h21m21.585836718s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233293123 (954h21m21.58607822s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233326044 (954h21m21.586111142s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233564892 (954h21m21.58634999s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233841642 (954h21m21.586626741s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.322099433 (954h21m21.674884531s) [upload=839834]: Next returned nil segment Oct 8 08:29:46.322132464 (954h21m21.674917563s) [upload=839834]: Waiting for error group managing segments... Oct 8 08:29:46.330063889 (954h21m21.682848997s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330383188 (954h21m21.683168296s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330611265 (954h21m21.683396373s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330845516 (954h21m21.683630614s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331046913 (954h21m21.683832012s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331359309 (954h21m21.684144407s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331399916 (954h21m21.684185024s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331768769 (954h21m21.684553877s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332110469 (954h21m21.684895577s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332180250 (954h21m21.684965358s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332506262 (954h21m21.685291361s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332716447 (954h21m21.685501555s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332845990 (954h21m21.685631087s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332852031 (954h21m21.685637129s) [seg_pos={0 0}, upload=839834]: Segment reached optimal threshold of 13 pieces. Oct 8 08:29:46.332950155 (954h21m21.685735263s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.332998957 (954h21m21.685784054s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.333249086 (954h21m21.686034194s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.333272700 (954h21m21.686057808s) [seg_pos={0 0}, upload=839834]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Oct 8 08:29:46.333344115 (954h21m21.686129223s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 08:29:46.333349395 (954h21m21.686134503s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 08:30:13.602630613 (954h21m48.955415712s) [upload=839834]: Done uploading segments... Oct 8 08:30:13.602650050 (954h21m48.955435158s) [upload=839834]: Upload finished. err: metaclient: context deadline exceeded Duration: 484.20251ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 686.574205ms FAIL (2025-10-08 09:02:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 686.598502ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 474.117966ms FAIL (2025-10-08 09:02:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 474.140058ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 427.944536ms FAIL (2025-10-08 09:02:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 427.963201ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 556.569667ms FAIL (2025-10-08 09:02:02 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 556.600565ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 605.077409ms FAIL (2025-10-08 09:01:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 8 08:29:42.207274015 (954h21m17.560059133s) [upload=839834]: Starting upload Oct 8 08:29:42.207370566 (954h21m17.560155695s) [upload=839834]: Done starting upload Oct 8 08:29:42.207439656 (954h21m17.560224784s) [upload=839834]: Uploading segments... Oct 8 08:29:42.207767773 (954h21m17.5605529s) [upload=839834]: Got next segment. Inline: false Oct 8 08:29:42.207812115 (954h21m17.560597254s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 08:29:42.207822906 (954h21m17.560608034s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 08:29:46.231440887 (954h21m21.584225984s) [seg_pos={0 0}, upload=839834]: Begin upload segment... Oct 8 08:29:46.231480260 (954h21m21.584265359s) [seg_pos={0 0}, upload=839834]: Done begin upload segment. Oct 8 08:29:46.231506099 (954h21m21.584291197s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231522400 (954h21m21.584307497s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231867997 (954h21m21.584653105s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231878217 (954h21m21.584663325s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232161820 (954h21m21.584946918s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232199901 (954h21m21.584984999s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232425575 (954h21m21.585210672s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232462444 (954h21m21.585247541s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232708044 (954h21m21.585493142s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232776564 (954h21m21.585561662s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233024619 (954h21m21.585809717s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233051609 (954h21m21.585836718s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233293123 (954h21m21.58607822s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233326044 (954h21m21.586111142s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233564892 (954h21m21.58634999s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233841642 (954h21m21.586626741s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.322099433 (954h21m21.674884531s) [upload=839834]: Next returned nil segment Oct 8 08:29:46.322132464 (954h21m21.674917563s) [upload=839834]: Waiting for error group managing segments... Oct 8 08:29:46.330063889 (954h21m21.682848997s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330383188 (954h21m21.683168296s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330611265 (954h21m21.683396373s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330845516 (954h21m21.683630614s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331046913 (954h21m21.683832012s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331359309 (954h21m21.684144407s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331399916 (954h21m21.684185024s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331768769 (954h21m21.684553877s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332110469 (954h21m21.684895577s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332180250 (954h21m21.684965358s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332506262 (954h21m21.685291361s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332716447 (954h21m21.685501555s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332845990 (954h21m21.685631087s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332852031 (954h21m21.685637129s) [seg_pos={0 0}, upload=839834]: Segment reached optimal threshold of 13 pieces. Oct 8 08:29:46.332950155 (954h21m21.685735263s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.332998957 (954h21m21.685784054s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.333249086 (954h21m21.686034194s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.333272700 (954h21m21.686057808s) [seg_pos={0 0}, upload=839834]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Oct 8 08:29:46.333344115 (954h21m21.686129223s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 08:29:46.333349395 (954h21m21.686134503s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 08:30:13.602630613 (954h21m48.955415712s) [upload=839834]: Done uploading segments... Oct 8 08:30:13.602650050 (954h21m48.955435158s) [upload=839834]: Upload finished. err: metaclient: context deadline exceeded Duration: 605.102105ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 545.277405ms FAIL (2025-10-08 09:01:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 545.298104ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 264.757932ms FAIL (2025-10-08 09:00:54 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 264.774374ms core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 701.781487ms FAIL (2025-10-08 09:00:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 701.938261ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 510.123244ms FAIL (2025-10-08 09:00:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 8 08:29:42.207274015 (954h21m17.560059133s) [upload=839834]: Starting upload Oct 8 08:29:42.207370566 (954h21m17.560155695s) [upload=839834]: Done starting upload Oct 8 08:29:42.207439656 (954h21m17.560224784s) [upload=839834]: Uploading segments... Oct 8 08:29:42.207767773 (954h21m17.5605529s) [upload=839834]: Got next segment. Inline: false Oct 8 08:29:42.207812115 (954h21m17.560597254s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 08:29:42.207822906 (954h21m17.560608034s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 08:29:46.231440887 (954h21m21.584225984s) [seg_pos={0 0}, upload=839834]: Begin upload segment... Oct 8 08:29:46.231480260 (954h21m21.584265359s) [seg_pos={0 0}, upload=839834]: Done begin upload segment. Oct 8 08:29:46.231506099 (954h21m21.584291197s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231522400 (954h21m21.584307497s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231867997 (954h21m21.584653105s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231878217 (954h21m21.584663325s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232161820 (954h21m21.584946918s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232199901 (954h21m21.584984999s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232425575 (954h21m21.585210672s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232462444 (954h21m21.585247541s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232708044 (954h21m21.585493142s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232776564 (954h21m21.585561662s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233024619 (954h21m21.585809717s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233051609 (954h21m21.585836718s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233293123 (954h21m21.58607822s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233326044 (954h21m21.586111142s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233564892 (954h21m21.58634999s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233841642 (954h21m21.586626741s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.322099433 (954h21m21.674884531s) [upload=839834]: Next returned nil segment Oct 8 08:29:46.322132464 (954h21m21.674917563s) [upload=839834]: Waiting for error group managing segments... Oct 8 08:29:46.330063889 (954h21m21.682848997s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330383188 (954h21m21.683168296s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330611265 (954h21m21.683396373s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330845516 (954h21m21.683630614s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331046913 (954h21m21.683832012s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331359309 (954h21m21.684144407s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331399916 (954h21m21.684185024s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331768769 (954h21m21.684553877s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332110469 (954h21m21.684895577s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332180250 (954h21m21.684965358s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332506262 (954h21m21.685291361s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332716447 (954h21m21.685501555s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332845990 (954h21m21.685631087s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332852031 (954h21m21.685637129s) [seg_pos={0 0}, upload=839834]: Segment reached optimal threshold of 13 pieces. Oct 8 08:29:46.332950155 (954h21m21.685735263s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.332998957 (954h21m21.685784054s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.333249086 (954h21m21.686034194s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.333272700 (954h21m21.686057808s) [seg_pos={0 0}, upload=839834]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Oct 8 08:29:46.333344115 (954h21m21.686129223s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 08:29:46.333349395 (954h21m21.686134503s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 08:30:13.602630613 (954h21m48.955415712s) [upload=839834]: Done uploading segments... Oct 8 08:30:13.602650050 (954h21m48.955435158s) [upload=839834]: Upload finished. err: metaclient: context deadline exceeded Duration: 510.148662ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 186.67386ms FAIL (2025-10-08 09:00:30 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 186.693116ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 484.882607ms FAIL (2025-10-08 09:00:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 8 08:29:42.207274015 (954h21m17.560059133s) [upload=839834]: Starting upload Oct 8 08:29:42.207370566 (954h21m17.560155695s) [upload=839834]: Done starting upload Oct 8 08:29:42.207439656 (954h21m17.560224784s) [upload=839834]: Uploading segments... Oct 8 08:29:42.207767773 (954h21m17.5605529s) [upload=839834]: Got next segment. Inline: false Oct 8 08:29:42.207812115 (954h21m17.560597254s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 08:29:42.207822906 (954h21m17.560608034s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 08:29:46.231440887 (954h21m21.584225984s) [seg_pos={0 0}, upload=839834]: Begin upload segment... Oct 8 08:29:46.231480260 (954h21m21.584265359s) [seg_pos={0 0}, upload=839834]: Done begin upload segment. Oct 8 08:29:46.231506099 (954h21m21.584291197s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231522400 (954h21m21.584307497s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231867997 (954h21m21.584653105s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231878217 (954h21m21.584663325s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232161820 (954h21m21.584946918s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232199901 (954h21m21.584984999s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232425575 (954h21m21.585210672s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232462444 (954h21m21.585247541s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232708044 (954h21m21.585493142s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232776564 (954h21m21.585561662s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233024619 (954h21m21.585809717s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233051609 (954h21m21.585836718s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233293123 (954h21m21.58607822s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233326044 (954h21m21.586111142s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233564892 (954h21m21.58634999s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233841642 (954h21m21.586626741s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.322099433 (954h21m21.674884531s) [upload=839834]: Next returned nil segment Oct 8 08:29:46.322132464 (954h21m21.674917563s) [upload=839834]: Waiting for error group managing segments... Oct 8 08:29:46.330063889 (954h21m21.682848997s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330383188 (954h21m21.683168296s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330611265 (954h21m21.683396373s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330845516 (954h21m21.683630614s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331046913 (954h21m21.683832012s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331359309 (954h21m21.684144407s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331399916 (954h21m21.684185024s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331768769 (954h21m21.684553877s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332110469 (954h21m21.684895577s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332180250 (954h21m21.684965358s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332506262 (954h21m21.685291361s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332716447 (954h21m21.685501555s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332845990 (954h21m21.685631087s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332852031 (954h21m21.685637129s) [seg_pos={0 0}, upload=839834]: Segment reached optimal threshold of 13 pieces. Oct 8 08:29:46.332950155 (954h21m21.685735263s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.332998957 (954h21m21.685784054s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.333249086 (954h21m21.686034194s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.333272700 (954h21m21.686057808s) [seg_pos={0 0}, upload=839834]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Oct 8 08:29:46.333344115 (954h21m21.686129223s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 08:29:46.333349395 (954h21m21.686134503s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 08:30:13.602630613 (954h21m48.955415712s) [upload=839834]: Done uploading segments... Oct 8 08:30:13.602650050 (954h21m48.955435158s) [upload=839834]: Upload finished. err: metaclient: context deadline exceeded Duration: 484.904047ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 585.759646ms FAIL (2025-10-08 09:00:08 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 585.785113ms core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 594.961009ms FAIL (2025-10-08 08:59:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 594.981187ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 276.031539ms FAIL (2025-10-08 08:59:28 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 276.06406ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 336.289863ms FAIL (2025-10-08 08:59:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 8 08:29:42.207274015 (954h21m17.560059133s) [upload=839834]: Starting upload Oct 8 08:29:42.207370566 (954h21m17.560155695s) [upload=839834]: Done starting upload Oct 8 08:29:42.207439656 (954h21m17.560224784s) [upload=839834]: Uploading segments... Oct 8 08:29:42.207767773 (954h21m17.5605529s) [upload=839834]: Got next segment. Inline: false Oct 8 08:29:42.207812115 (954h21m17.560597254s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 08:29:42.207822906 (954h21m17.560608034s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 08:29:46.231440887 (954h21m21.584225984s) [seg_pos={0 0}, upload=839834]: Begin upload segment... Oct 8 08:29:46.231480260 (954h21m21.584265359s) [seg_pos={0 0}, upload=839834]: Done begin upload segment. Oct 8 08:29:46.231506099 (954h21m21.584291197s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231522400 (954h21m21.584307497s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231867997 (954h21m21.584653105s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231878217 (954h21m21.584663325s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232161820 (954h21m21.584946918s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232199901 (954h21m21.584984999s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232425575 (954h21m21.585210672s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232462444 (954h21m21.585247541s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232708044 (954h21m21.585493142s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232776564 (954h21m21.585561662s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233024619 (954h21m21.585809717s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233051609 (954h21m21.585836718s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233293123 (954h21m21.58607822s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233326044 (954h21m21.586111142s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233564892 (954h21m21.58634999s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233841642 (954h21m21.586626741s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.322099433 (954h21m21.674884531s) [upload=839834]: Next returned nil segment Oct 8 08:29:46.322132464 (954h21m21.674917563s) [upload=839834]: Waiting for error group managing segments... Oct 8 08:29:46.330063889 (954h21m21.682848997s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330383188 (954h21m21.683168296s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330611265 (954h21m21.683396373s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330845516 (954h21m21.683630614s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331046913 (954h21m21.683832012s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331359309 (954h21m21.684144407s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331399916 (954h21m21.684185024s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331768769 (954h21m21.684553877s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332110469 (954h21m21.684895577s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332180250 (954h21m21.684965358s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332506262 (954h21m21.685291361s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332716447 (954h21m21.685501555s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332845990 (954h21m21.685631087s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332852031 (954h21m21.685637129s) [seg_pos={0 0}, upload=839834]: Segment reached optimal threshold of 13 pieces. Oct 8 08:29:46.332950155 (954h21m21.685735263s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.332998957 (954h21m21.685784054s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.333249086 (954h21m21.686034194s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.333272700 (954h21m21.686057808s) [seg_pos={0 0}, upload=839834]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Oct 8 08:29:46.333344115 (954h21m21.686129223s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 08:29:46.333349395 (954h21m21.686134503s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 08:30:13.602630613 (954h21m48.955415712s) [upload=839834]: Done uploading segments... Oct 8 08:30:13.602650050 (954h21m48.955435158s) [upload=839834]: Upload finished. err: metaclient: context deadline exceeded Duration: 336.312334ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 436.993727ms FAIL (2025-10-08 08:59:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 437.02194ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 307.274638ms FAIL (2025-10-08 08:59:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 8 08:29:42.207274015 (954h21m17.560059133s) [upload=839834]: Starting upload Oct 8 08:29:42.207370566 (954h21m17.560155695s) [upload=839834]: Done starting upload Oct 8 08:29:42.207439656 (954h21m17.560224784s) [upload=839834]: Uploading segments... Oct 8 08:29:42.207767773 (954h21m17.5605529s) [upload=839834]: Got next segment. Inline: false Oct 8 08:29:42.207812115 (954h21m17.560597254s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 08:29:42.207822906 (954h21m17.560608034s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 08:29:46.231440887 (954h21m21.584225984s) [seg_pos={0 0}, upload=839834]: Begin upload segment... Oct 8 08:29:46.231480260 (954h21m21.584265359s) [seg_pos={0 0}, upload=839834]: Done begin upload segment. Oct 8 08:29:46.231506099 (954h21m21.584291197s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231522400 (954h21m21.584307497s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231867997 (954h21m21.584653105s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231878217 (954h21m21.584663325s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232161820 (954h21m21.584946918s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232199901 (954h21m21.584984999s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232425575 (954h21m21.585210672s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232462444 (954h21m21.585247541s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232708044 (954h21m21.585493142s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232776564 (954h21m21.585561662s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233024619 (954h21m21.585809717s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233051609 (954h21m21.585836718s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233293123 (954h21m21.58607822s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233326044 (954h21m21.586111142s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233564892 (954h21m21.58634999s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233841642 (954h21m21.586626741s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.322099433 (954h21m21.674884531s) [upload=839834]: Next returned nil segment Oct 8 08:29:46.322132464 (954h21m21.674917563s) [upload=839834]: Waiting for error group managing segments... Oct 8 08:29:46.330063889 (954h21m21.682848997s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330383188 (954h21m21.683168296s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330611265 (954h21m21.683396373s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330845516 (954h21m21.683630614s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331046913 (954h21m21.683832012s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331359309 (954h21m21.684144407s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331399916 (954h21m21.684185024s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331768769 (954h21m21.684553877s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332110469 (954h21m21.684895577s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332180250 (954h21m21.684965358s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332506262 (954h21m21.685291361s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332716447 (954h21m21.685501555s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332845990 (954h21m21.685631087s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332852031 (954h21m21.685637129s) [seg_pos={0 0}, upload=839834]: Segment reached optimal threshold of 13 pieces. Oct 8 08:29:46.332950155 (954h21m21.685735263s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.332998957 (954h21m21.685784054s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.333249086 (954h21m21.686034194s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.333272700 (954h21m21.686057808s) [seg_pos={0 0}, upload=839834]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Oct 8 08:29:46.333344115 (954h21m21.686129223s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 08:29:46.333349395 (954h21m21.686134503s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 08:30:13.602630613 (954h21m48.955415712s) [upload=839834]: Done uploading segments... Oct 8 08:30:13.602650050 (954h21m48.955435158s) [upload=839834]: Upload finished. err: metaclient: context deadline exceeded Duration: 307.295847ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 568.015925ms FAIL (2025-10-08 08:58:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 8 08:29:42.207274015 (954h21m17.560059133s) [upload=839834]: Starting upload Oct 8 08:29:42.207370566 (954h21m17.560155695s) [upload=839834]: Done starting upload Oct 8 08:29:42.207439656 (954h21m17.560224784s) [upload=839834]: Uploading segments... Oct 8 08:29:42.207767773 (954h21m17.5605529s) [upload=839834]: Got next segment. Inline: false Oct 8 08:29:42.207812115 (954h21m17.560597254s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 08:29:42.207822906 (954h21m17.560608034s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 08:29:46.231440887 (954h21m21.584225984s) [seg_pos={0 0}, upload=839834]: Begin upload segment... Oct 8 08:29:46.231480260 (954h21m21.584265359s) [seg_pos={0 0}, upload=839834]: Done begin upload segment. Oct 8 08:29:46.231506099 (954h21m21.584291197s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231522400 (954h21m21.584307497s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231867997 (954h21m21.584653105s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231878217 (954h21m21.584663325s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232161820 (954h21m21.584946918s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232199901 (954h21m21.584984999s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232425575 (954h21m21.585210672s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232462444 (954h21m21.585247541s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232708044 (954h21m21.585493142s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232776564 (954h21m21.585561662s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233024619 (954h21m21.585809717s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233051609 (954h21m21.585836718s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233293123 (954h21m21.58607822s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233326044 (954h21m21.586111142s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233564892 (954h21m21.58634999s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233841642 (954h21m21.586626741s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.322099433 (954h21m21.674884531s) [upload=839834]: Next returned nil segment Oct 8 08:29:46.322132464 (954h21m21.674917563s) [upload=839834]: Waiting for error group managing segments... Oct 8 08:29:46.330063889 (954h21m21.682848997s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330383188 (954h21m21.683168296s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330611265 (954h21m21.683396373s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330845516 (954h21m21.683630614s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331046913 (954h21m21.683832012s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331359309 (954h21m21.684144407s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331399916 (954h21m21.684185024s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331768769 (954h21m21.684553877s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332110469 (954h21m21.684895577s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332180250 (954h21m21.684965358s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332506262 (954h21m21.685291361s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332716447 (954h21m21.685501555s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332845990 (954h21m21.685631087s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332852031 (954h21m21.685637129s) [seg_pos={0 0}, upload=839834]: Segment reached optimal threshold of 13 pieces. Oct 8 08:29:46.332950155 (954h21m21.685735263s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.332998957 (954h21m21.685784054s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.333249086 (954h21m21.686034194s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.333272700 (954h21m21.686057808s) [seg_pos={0 0}, upload=839834]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Oct 8 08:29:46.333344115 (954h21m21.686129223s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 08:29:46.333349395 (954h21m21.686134503s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 08:30:13.602630613 (954h21m48.955415712s) [upload=839834]: Done uploading segments... Oct 8 08:30:13.602650050 (954h21m48.955435158s) [upload=839834]: Upload finished. err: metaclient: context deadline exceeded Duration: 568.037266ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 207.940226ms FAIL (2025-10-08 08:58:32 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 207.95785ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 166.609474ms FAIL (2025-10-08 08:58:01 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 166.628689ms core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 438.72787ms FAIL (2025-10-08 08:57:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 438.747648ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 445.13742ms FAIL (2025-10-08 08:57:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 8 08:29:42.207274015 (954h21m17.560059133s) [upload=839834]: Starting upload Oct 8 08:29:42.207370566 (954h21m17.560155695s) [upload=839834]: Done starting upload Oct 8 08:29:42.207439656 (954h21m17.560224784s) [upload=839834]: Uploading segments... Oct 8 08:29:42.207767773 (954h21m17.5605529s) [upload=839834]: Got next segment. Inline: false Oct 8 08:29:42.207812115 (954h21m17.560597254s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 08:29:42.207822906 (954h21m17.560608034s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 08:29:46.231440887 (954h21m21.584225984s) [seg_pos={0 0}, upload=839834]: Begin upload segment... Oct 8 08:29:46.231480260 (954h21m21.584265359s) [seg_pos={0 0}, upload=839834]: Done begin upload segment. Oct 8 08:29:46.231506099 (954h21m21.584291197s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231522400 (954h21m21.584307497s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231867997 (954h21m21.584653105s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231878217 (954h21m21.584663325s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232161820 (954h21m21.584946918s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232199901 (954h21m21.584984999s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232425575 (954h21m21.585210672s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232462444 (954h21m21.585247541s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232708044 (954h21m21.585493142s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232776564 (954h21m21.585561662s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233024619 (954h21m21.585809717s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233051609 (954h21m21.585836718s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233293123 (954h21m21.58607822s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233326044 (954h21m21.586111142s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233564892 (954h21m21.58634999s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233841642 (954h21m21.586626741s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.322099433 (954h21m21.674884531s) [upload=839834]: Next returned nil segment Oct 8 08:29:46.322132464 (954h21m21.674917563s) [upload=839834]: Waiting for error group managing segments... Oct 8 08:29:46.330063889 (954h21m21.682848997s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330383188 (954h21m21.683168296s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330611265 (954h21m21.683396373s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330845516 (954h21m21.683630614s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331046913 (954h21m21.683832012s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331359309 (954h21m21.684144407s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331399916 (954h21m21.684185024s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331768769 (954h21m21.684553877s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332110469 (954h21m21.684895577s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332180250 (954h21m21.684965358s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332506262 (954h21m21.685291361s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332716447 (954h21m21.685501555s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332845990 (954h21m21.685631087s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332852031 (954h21m21.685637129s) [seg_pos={0 0}, upload=839834]: Segment reached optimal threshold of 13 pieces. Oct 8 08:29:46.332950155 (954h21m21.685735263s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.332998957 (954h21m21.685784054s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.333249086 (954h21m21.686034194s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.333272700 (954h21m21.686057808s) [seg_pos={0 0}, upload=839834]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Oct 8 08:29:46.333344115 (954h21m21.686129223s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 08:29:46.333349395 (954h21m21.686134503s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 08:30:13.602630613 (954h21m48.955415712s) [upload=839834]: Done uploading segments... Oct 8 08:30:13.602650050 (954h21m48.955435158s) [upload=839834]: Upload finished. err: metaclient: context deadline exceeded Duration: 445.161355ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 600.747892ms FAIL (2025-10-08 08:57:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 600.761268ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 547.481401ms FAIL (2025-10-08 08:57:23 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 547.500918ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 414.186053ms FAIL (2025-10-08 08:56:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 8 08:29:42.207274015 (954h21m17.560059133s) [upload=839834]: Starting upload Oct 8 08:29:42.207370566 (954h21m17.560155695s) [upload=839834]: Done starting upload Oct 8 08:29:42.207439656 (954h21m17.560224784s) [upload=839834]: Uploading segments... Oct 8 08:29:42.207767773 (954h21m17.5605529s) [upload=839834]: Got next segment. Inline: false Oct 8 08:29:42.207812115 (954h21m17.560597254s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 08:29:42.207822906 (954h21m17.560608034s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 08:29:46.231440887 (954h21m21.584225984s) [seg_pos={0 0}, upload=839834]: Begin upload segment... Oct 8 08:29:46.231480260 (954h21m21.584265359s) [seg_pos={0 0}, upload=839834]: Done begin upload segment. Oct 8 08:29:46.231506099 (954h21m21.584291197s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231522400 (954h21m21.584307497s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231867997 (954h21m21.584653105s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231878217 (954h21m21.584663325s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232161820 (954h21m21.584946918s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232199901 (954h21m21.584984999s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232425575 (954h21m21.585210672s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232462444 (954h21m21.585247541s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232708044 (954h21m21.585493142s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232776564 (954h21m21.585561662s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233024619 (954h21m21.585809717s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233051609 (954h21m21.585836718s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233293123 (954h21m21.58607822s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233326044 (954h21m21.586111142s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233564892 (954h21m21.58634999s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233841642 (954h21m21.586626741s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.322099433 (954h21m21.674884531s) [upload=839834]: Next returned nil segment Oct 8 08:29:46.322132464 (954h21m21.674917563s) [upload=839834]: Waiting for error group managing segments... Oct 8 08:29:46.330063889 (954h21m21.682848997s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330383188 (954h21m21.683168296s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330611265 (954h21m21.683396373s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330845516 (954h21m21.683630614s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331046913 (954h21m21.683832012s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331359309 (954h21m21.684144407s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331399916 (954h21m21.684185024s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331768769 (954h21m21.684553877s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332110469 (954h21m21.684895577s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332180250 (954h21m21.684965358s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332506262 (954h21m21.685291361s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332716447 (954h21m21.685501555s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332845990 (954h21m21.685631087s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332852031 (954h21m21.685637129s) [seg_pos={0 0}, upload=839834]: Segment reached optimal threshold of 13 pieces. Oct 8 08:29:46.332950155 (954h21m21.685735263s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.332998957 (954h21m21.685784054s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.333249086 (954h21m21.686034194s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.333272700 (954h21m21.686057808s) [seg_pos={0 0}, upload=839834]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Oct 8 08:29:46.333344115 (954h21m21.686129223s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 08:29:46.333349395 (954h21m21.686134503s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 08:30:13.602630613 (954h21m48.955415712s) [upload=839834]: Done uploading segments... Oct 8 08:30:13.602650050 (954h21m48.955435158s) [upload=839834]: Upload finished. err: metaclient: context deadline exceeded Duration: 414.212624ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 555.032431ms FAIL (2025-10-08 08:56:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 555.053851ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 217.333215ms FAIL (2025-10-08 08:56:19 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 217.35239ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 349.040451ms FAIL (2025-10-08 08:55:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 8 08:29:42.207274015 (954h21m17.560059133s) [upload=839834]: Starting upload Oct 8 08:29:42.207370566 (954h21m17.560155695s) [upload=839834]: Done starting upload Oct 8 08:29:42.207439656 (954h21m17.560224784s) [upload=839834]: Uploading segments... Oct 8 08:29:42.207767773 (954h21m17.5605529s) [upload=839834]: Got next segment. Inline: false Oct 8 08:29:42.207812115 (954h21m17.560597254s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 08:29:42.207822906 (954h21m17.560608034s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 08:29:46.231440887 (954h21m21.584225984s) [seg_pos={0 0}, upload=839834]: Begin upload segment... Oct 8 08:29:46.231480260 (954h21m21.584265359s) [seg_pos={0 0}, upload=839834]: Done begin upload segment. Oct 8 08:29:46.231506099 (954h21m21.584291197s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231522400 (954h21m21.584307497s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231867997 (954h21m21.584653105s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231878217 (954h21m21.584663325s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232161820 (954h21m21.584946918s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232199901 (954h21m21.584984999s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232425575 (954h21m21.585210672s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232462444 (954h21m21.585247541s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232708044 (954h21m21.585493142s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232776564 (954h21m21.585561662s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233024619 (954h21m21.585809717s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233051609 (954h21m21.585836718s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233293123 (954h21m21.58607822s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233326044 (954h21m21.586111142s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233564892 (954h21m21.58634999s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233841642 (954h21m21.586626741s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.322099433 (954h21m21.674884531s) [upload=839834]: Next returned nil segment Oct 8 08:29:46.322132464 (954h21m21.674917563s) [upload=839834]: Waiting for error group managing segments... Oct 8 08:29:46.330063889 (954h21m21.682848997s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330383188 (954h21m21.683168296s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330611265 (954h21m21.683396373s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330845516 (954h21m21.683630614s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331046913 (954h21m21.683832012s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331359309 (954h21m21.684144407s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331399916 (954h21m21.684185024s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331768769 (954h21m21.684553877s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332110469 (954h21m21.684895577s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332180250 (954h21m21.684965358s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332506262 (954h21m21.685291361s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332716447 (954h21m21.685501555s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332845990 (954h21m21.685631087s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332852031 (954h21m21.685637129s) [seg_pos={0 0}, upload=839834]: Segment reached optimal threshold of 13 pieces. Oct 8 08:29:46.332950155 (954h21m21.685735263s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.332998957 (954h21m21.685784054s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.333249086 (954h21m21.686034194s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.333272700 (954h21m21.686057808s) [seg_pos={0 0}, upload=839834]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Oct 8 08:29:46.333344115 (954h21m21.686129223s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 08:29:46.333349395 (954h21m21.686134503s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 08:30:13.602630613 (954h21m48.955415712s) [upload=839834]: Done uploading segments... Oct 8 08:30:13.602650050 (954h21m48.955435158s) [upload=839834]: Upload finished. err: metaclient: context deadline exceeded Duration: 349.06199ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 503.458085ms FAIL (2025-10-08 08:55:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 503.487451ms edge gateway us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)