Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 308.034067ms FAIL (2025-10-08 08:55:38 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 308.059665ms core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 751.867767ms FAIL (2025-10-08 08:55:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 751.886083ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 349.5252ms FAIL (2025-10-08 08:54:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 8 08:29:42.207274015 (954h21m17.560059133s) [upload=839834]: Starting upload Oct 8 08:29:42.207370566 (954h21m17.560155695s) [upload=839834]: Done starting upload Oct 8 08:29:42.207439656 (954h21m17.560224784s) [upload=839834]: Uploading segments... Oct 8 08:29:42.207767773 (954h21m17.5605529s) [upload=839834]: Got next segment. Inline: false Oct 8 08:29:42.207812115 (954h21m17.560597254s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 08:29:42.207822906 (954h21m17.560608034s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 08:29:46.231440887 (954h21m21.584225984s) [seg_pos={0 0}, upload=839834]: Begin upload segment... Oct 8 08:29:46.231480260 (954h21m21.584265359s) [seg_pos={0 0}, upload=839834]: Done begin upload segment. Oct 8 08:29:46.231506099 (954h21m21.584291197s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231522400 (954h21m21.584307497s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231867997 (954h21m21.584653105s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231878217 (954h21m21.584663325s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232161820 (954h21m21.584946918s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232199901 (954h21m21.584984999s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232425575 (954h21m21.585210672s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232462444 (954h21m21.585247541s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232708044 (954h21m21.585493142s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232776564 (954h21m21.585561662s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233024619 (954h21m21.585809717s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233051609 (954h21m21.585836718s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233293123 (954h21m21.58607822s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233326044 (954h21m21.586111142s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233564892 (954h21m21.58634999s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233841642 (954h21m21.586626741s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.322099433 (954h21m21.674884531s) [upload=839834]: Next returned nil segment Oct 8 08:29:46.322132464 (954h21m21.674917563s) [upload=839834]: Waiting for error group managing segments... Oct 8 08:29:46.330063889 (954h21m21.682848997s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330383188 (954h21m21.683168296s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330611265 (954h21m21.683396373s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330845516 (954h21m21.683630614s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331046913 (954h21m21.683832012s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331359309 (954h21m21.684144407s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331399916 (954h21m21.684185024s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331768769 (954h21m21.684553877s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332110469 (954h21m21.684895577s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332180250 (954h21m21.684965358s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332506262 (954h21m21.685291361s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332716447 (954h21m21.685501555s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332845990 (954h21m21.685631087s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332852031 (954h21m21.685637129s) [seg_pos={0 0}, upload=839834]: Segment reached optimal threshold of 13 pieces. Oct 8 08:29:46.332950155 (954h21m21.685735263s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.332998957 (954h21m21.685784054s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.333249086 (954h21m21.686034194s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.333272700 (954h21m21.686057808s) [seg_pos={0 0}, upload=839834]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Oct 8 08:29:46.333344115 (954h21m21.686129223s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 08:29:46.333349395 (954h21m21.686134503s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 08:30:13.602630613 (954h21m48.955415712s) [upload=839834]: Done uploading segments... Oct 8 08:30:13.602650050 (954h21m48.955435158s) [upload=839834]: Upload finished. err: metaclient: context deadline exceeded Duration: 349.544867ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 398.936527ms FAIL (2025-10-08 08:54:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 398.950101ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 239.090988ms FAIL (2025-10-08 08:54:29 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 239.108993ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 516.31546ms FAIL (2025-10-08 08:53:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 8 08:29:42.207274015 (954h21m17.560059133s) [upload=839834]: Starting upload Oct 8 08:29:42.207370566 (954h21m17.560155695s) [upload=839834]: Done starting upload Oct 8 08:29:42.207439656 (954h21m17.560224784s) [upload=839834]: Uploading segments... Oct 8 08:29:42.207767773 (954h21m17.5605529s) [upload=839834]: Got next segment. Inline: false Oct 8 08:29:42.207812115 (954h21m17.560597254s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 08:29:42.207822906 (954h21m17.560608034s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 08:29:46.231440887 (954h21m21.584225984s) [seg_pos={0 0}, upload=839834]: Begin upload segment... Oct 8 08:29:46.231480260 (954h21m21.584265359s) [seg_pos={0 0}, upload=839834]: Done begin upload segment. Oct 8 08:29:46.231506099 (954h21m21.584291197s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231522400 (954h21m21.584307497s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231867997 (954h21m21.584653105s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231878217 (954h21m21.584663325s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232161820 (954h21m21.584946918s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232199901 (954h21m21.584984999s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232425575 (954h21m21.585210672s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232462444 (954h21m21.585247541s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232708044 (954h21m21.585493142s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232776564 (954h21m21.585561662s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233024619 (954h21m21.585809717s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233051609 (954h21m21.585836718s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233293123 (954h21m21.58607822s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233326044 (954h21m21.586111142s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233564892 (954h21m21.58634999s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233841642 (954h21m21.586626741s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.322099433 (954h21m21.674884531s) [upload=839834]: Next returned nil segment Oct 8 08:29:46.322132464 (954h21m21.674917563s) [upload=839834]: Waiting for error group managing segments... Oct 8 08:29:46.330063889 (954h21m21.682848997s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330383188 (954h21m21.683168296s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330611265 (954h21m21.683396373s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330845516 (954h21m21.683630614s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331046913 (954h21m21.683832012s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331359309 (954h21m21.684144407s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331399916 (954h21m21.684185024s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331768769 (954h21m21.684553877s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332110469 (954h21m21.684895577s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332180250 (954h21m21.684965358s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332506262 (954h21m21.685291361s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332716447 (954h21m21.685501555s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332845990 (954h21m21.685631087s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332852031 (954h21m21.685637129s) [seg_pos={0 0}, upload=839834]: Segment reached optimal threshold of 13 pieces. Oct 8 08:29:46.332950155 (954h21m21.685735263s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.332998957 (954h21m21.685784054s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.333249086 (954h21m21.686034194s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.333272700 (954h21m21.686057808s) [seg_pos={0 0}, upload=839834]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Oct 8 08:29:46.333344115 (954h21m21.686129223s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 08:29:46.333349395 (954h21m21.686134503s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 08:30:13.602630613 (954h21m48.955415712s) [upload=839834]: Done uploading segments... Oct 8 08:30:13.602650050 (954h21m48.955435158s) [upload=839834]: Upload finished. err: metaclient: context deadline exceeded Duration: 516.342851ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 420.12256ms FAIL (2025-10-08 08:53:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 8 08:29:42.207274015 (954h21m17.560059133s) [upload=839834]: Starting upload Oct 8 08:29:42.207370566 (954h21m17.560155695s) [upload=839834]: Done starting upload Oct 8 08:29:42.207439656 (954h21m17.560224784s) [upload=839834]: Uploading segments... Oct 8 08:29:42.207767773 (954h21m17.5605529s) [upload=839834]: Got next segment. Inline: false Oct 8 08:29:42.207812115 (954h21m17.560597254s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 08:29:42.207822906 (954h21m17.560608034s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 08:29:46.231440887 (954h21m21.584225984s) [seg_pos={0 0}, upload=839834]: Begin upload segment... Oct 8 08:29:46.231480260 (954h21m21.584265359s) [seg_pos={0 0}, upload=839834]: Done begin upload segment. Oct 8 08:29:46.231506099 (954h21m21.584291197s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231522400 (954h21m21.584307497s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231867997 (954h21m21.584653105s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231878217 (954h21m21.584663325s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232161820 (954h21m21.584946918s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232199901 (954h21m21.584984999s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232425575 (954h21m21.585210672s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232462444 (954h21m21.585247541s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232708044 (954h21m21.585493142s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232776564 (954h21m21.585561662s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233024619 (954h21m21.585809717s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233051609 (954h21m21.585836718s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233293123 (954h21m21.58607822s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233326044 (954h21m21.586111142s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233564892 (954h21m21.58634999s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233841642 (954h21m21.586626741s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.322099433 (954h21m21.674884531s) [upload=839834]: Next returned nil segment Oct 8 08:29:46.322132464 (954h21m21.674917563s) [upload=839834]: Waiting for error group managing segments... Oct 8 08:29:46.330063889 (954h21m21.682848997s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330383188 (954h21m21.683168296s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330611265 (954h21m21.683396373s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330845516 (954h21m21.683630614s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331046913 (954h21m21.683832012s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331359309 (954h21m21.684144407s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331399916 (954h21m21.684185024s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331768769 (954h21m21.684553877s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332110469 (954h21m21.684895577s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332180250 (954h21m21.684965358s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332506262 (954h21m21.685291361s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332716447 (954h21m21.685501555s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332845990 (954h21m21.685631087s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332852031 (954h21m21.685637129s) [seg_pos={0 0}, upload=839834]: Segment reached optimal threshold of 13 pieces. Oct 8 08:29:46.332950155 (954h21m21.685735263s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.332998957 (954h21m21.685784054s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.333249086 (954h21m21.686034194s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.333272700 (954h21m21.686057808s) [seg_pos={0 0}, upload=839834]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Oct 8 08:29:46.333344115 (954h21m21.686129223s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 08:29:46.333349395 (954h21m21.686134503s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 08:30:13.602630613 (954h21m48.955415712s) [upload=839834]: Done uploading segments... Oct 8 08:30:13.602650050 (954h21m48.955435158s) [upload=839834]: Upload finished. err: metaclient: context deadline exceeded Duration: 420.149039ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 155.772519ms FAIL (2025-10-08 08:53:25 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 155.797506ms core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 423.92201ms FAIL (2025-10-08 08:53:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 423.940225ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 646.704003ms FAIL (2025-10-08 08:53:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 8 08:29:42.207274015 (954h21m17.560059133s) [upload=839834]: Starting upload Oct 8 08:29:42.207370566 (954h21m17.560155695s) [upload=839834]: Done starting upload Oct 8 08:29:42.207439656 (954h21m17.560224784s) [upload=839834]: Uploading segments... Oct 8 08:29:42.207767773 (954h21m17.5605529s) [upload=839834]: Got next segment. Inline: false Oct 8 08:29:42.207812115 (954h21m17.560597254s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 08:29:42.207822906 (954h21m17.560608034s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 08:29:46.231440887 (954h21m21.584225984s) [seg_pos={0 0}, upload=839834]: Begin upload segment... Oct 8 08:29:46.231480260 (954h21m21.584265359s) [seg_pos={0 0}, upload=839834]: Done begin upload segment. Oct 8 08:29:46.231506099 (954h21m21.584291197s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231522400 (954h21m21.584307497s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231867997 (954h21m21.584653105s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231878217 (954h21m21.584663325s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232161820 (954h21m21.584946918s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232199901 (954h21m21.584984999s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232425575 (954h21m21.585210672s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232462444 (954h21m21.585247541s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232708044 (954h21m21.585493142s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232776564 (954h21m21.585561662s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233024619 (954h21m21.585809717s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233051609 (954h21m21.585836718s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233293123 (954h21m21.58607822s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233326044 (954h21m21.586111142s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233564892 (954h21m21.58634999s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233841642 (954h21m21.586626741s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.322099433 (954h21m21.674884531s) [upload=839834]: Next returned nil segment Oct 8 08:29:46.322132464 (954h21m21.674917563s) [upload=839834]: Waiting for error group managing segments... Oct 8 08:29:46.330063889 (954h21m21.682848997s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330383188 (954h21m21.683168296s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330611265 (954h21m21.683396373s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330845516 (954h21m21.683630614s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331046913 (954h21m21.683832012s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331359309 (954h21m21.684144407s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331399916 (954h21m21.684185024s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331768769 (954h21m21.684553877s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332110469 (954h21m21.684895577s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332180250 (954h21m21.684965358s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332506262 (954h21m21.685291361s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332716447 (954h21m21.685501555s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332845990 (954h21m21.685631087s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332852031 (954h21m21.685637129s) [seg_pos={0 0}, upload=839834]: Segment reached optimal threshold of 13 pieces. Oct 8 08:29:46.332950155 (954h21m21.685735263s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.332998957 (954h21m21.685784054s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.333249086 (954h21m21.686034194s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.333272700 (954h21m21.686057808s) [seg_pos={0 0}, upload=839834]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Oct 8 08:29:46.333344115 (954h21m21.686129223s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 08:29:46.333349395 (954h21m21.686134503s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 08:30:13.602630613 (954h21m48.955415712s) [upload=839834]: Done uploading segments... Oct 8 08:30:13.602650050 (954h21m48.955435158s) [upload=839834]: Upload finished. err: metaclient: context deadline exceeded Duration: 646.726125ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 192.086505ms FAIL (2025-10-08 08:52:45 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 192.10456ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 431.288975ms FAIL (2025-10-08 08:52:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 8 08:29:42.207274015 (954h21m17.560059133s) [upload=839834]: Starting upload Oct 8 08:29:42.207370566 (954h21m17.560155695s) [upload=839834]: Done starting upload Oct 8 08:29:42.207439656 (954h21m17.560224784s) [upload=839834]: Uploading segments... Oct 8 08:29:42.207767773 (954h21m17.5605529s) [upload=839834]: Got next segment. Inline: false Oct 8 08:29:42.207812115 (954h21m17.560597254s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 08:29:42.207822906 (954h21m17.560608034s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 08:29:46.231440887 (954h21m21.584225984s) [seg_pos={0 0}, upload=839834]: Begin upload segment... Oct 8 08:29:46.231480260 (954h21m21.584265359s) [seg_pos={0 0}, upload=839834]: Done begin upload segment. Oct 8 08:29:46.231506099 (954h21m21.584291197s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231522400 (954h21m21.584307497s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231867997 (954h21m21.584653105s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231878217 (954h21m21.584663325s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232161820 (954h21m21.584946918s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232199901 (954h21m21.584984999s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232425575 (954h21m21.585210672s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232462444 (954h21m21.585247541s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232708044 (954h21m21.585493142s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232776564 (954h21m21.585561662s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233024619 (954h21m21.585809717s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233051609 (954h21m21.585836718s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233293123 (954h21m21.58607822s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233326044 (954h21m21.586111142s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233564892 (954h21m21.58634999s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233841642 (954h21m21.586626741s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.322099433 (954h21m21.674884531s) [upload=839834]: Next returned nil segment Oct 8 08:29:46.322132464 (954h21m21.674917563s) [upload=839834]: Waiting for error group managing segments... Oct 8 08:29:46.330063889 (954h21m21.682848997s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330383188 (954h21m21.683168296s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330611265 (954h21m21.683396373s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330845516 (954h21m21.683630614s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331046913 (954h21m21.683832012s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331359309 (954h21m21.684144407s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331399916 (954h21m21.684185024s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331768769 (954h21m21.684553877s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332110469 (954h21m21.684895577s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332180250 (954h21m21.684965358s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332506262 (954h21m21.685291361s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332716447 (954h21m21.685501555s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332845990 (954h21m21.685631087s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332852031 (954h21m21.685637129s) [seg_pos={0 0}, upload=839834]: Segment reached optimal threshold of 13 pieces. Oct 8 08:29:46.332950155 (954h21m21.685735263s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.332998957 (954h21m21.685784054s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.333249086 (954h21m21.686034194s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.333272700 (954h21m21.686057808s) [seg_pos={0 0}, upload=839834]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Oct 8 08:29:46.333344115 (954h21m21.686129223s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 08:29:46.333349395 (954h21m21.686134503s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 08:30:13.602630613 (954h21m48.955415712s) [upload=839834]: Done uploading segments... Oct 8 08:30:13.602650050 (954h21m48.955435158s) [upload=839834]: Upload finished. err: metaclient: context deadline exceeded Duration: 431.442062ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 209.753143ms FAIL (2025-10-08 08:52:20 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 209.7835ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 402.231615ms FAIL (2025-10-08 08:52:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 8 08:29:42.207274015 (954h21m17.560059133s) [upload=839834]: Starting upload Oct 8 08:29:42.207370566 (954h21m17.560155695s) [upload=839834]: Done starting upload Oct 8 08:29:42.207439656 (954h21m17.560224784s) [upload=839834]: Uploading segments... Oct 8 08:29:42.207767773 (954h21m17.5605529s) [upload=839834]: Got next segment. Inline: false Oct 8 08:29:42.207812115 (954h21m17.560597254s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 08:29:42.207822906 (954h21m17.560608034s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 08:29:46.231440887 (954h21m21.584225984s) [seg_pos={0 0}, upload=839834]: Begin upload segment... Oct 8 08:29:46.231480260 (954h21m21.584265359s) [seg_pos={0 0}, upload=839834]: Done begin upload segment. Oct 8 08:29:46.231506099 (954h21m21.584291197s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231522400 (954h21m21.584307497s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231867997 (954h21m21.584653105s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231878217 (954h21m21.584663325s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232161820 (954h21m21.584946918s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232199901 (954h21m21.584984999s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232425575 (954h21m21.585210672s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232462444 (954h21m21.585247541s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232708044 (954h21m21.585493142s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232776564 (954h21m21.585561662s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233024619 (954h21m21.585809717s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233051609 (954h21m21.585836718s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233293123 (954h21m21.58607822s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233326044 (954h21m21.586111142s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233564892 (954h21m21.58634999s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233841642 (954h21m21.586626741s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.322099433 (954h21m21.674884531s) [upload=839834]: Next returned nil segment Oct 8 08:29:46.322132464 (954h21m21.674917563s) [upload=839834]: Waiting for error group managing segments... Oct 8 08:29:46.330063889 (954h21m21.682848997s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330383188 (954h21m21.683168296s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330611265 (954h21m21.683396373s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330845516 (954h21m21.683630614s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331046913 (954h21m21.683832012s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331359309 (954h21m21.684144407s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331399916 (954h21m21.684185024s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331768769 (954h21m21.684553877s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332110469 (954h21m21.684895577s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332180250 (954h21m21.684965358s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332506262 (954h21m21.685291361s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332716447 (954h21m21.685501555s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332845990 (954h21m21.685631087s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332852031 (954h21m21.685637129s) [seg_pos={0 0}, upload=839834]: Segment reached optimal threshold of 13 pieces. Oct 8 08:29:46.332950155 (954h21m21.685735263s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.332998957 (954h21m21.685784054s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.333249086 (954h21m21.686034194s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.333272700 (954h21m21.686057808s) [seg_pos={0 0}, upload=839834]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Oct 8 08:29:46.333344115 (954h21m21.686129223s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 08:29:46.333349395 (954h21m21.686134503s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 08:30:13.602630613 (954h21m48.955415712s) [upload=839834]: Done uploading segments... Oct 8 08:30:13.602650050 (954h21m48.955435158s) [upload=839834]: Upload finished. err: metaclient: context deadline exceeded Duration: 402.249188ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 410.892951ms FAIL (2025-10-08 08:52:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 410.915753ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 275.626794ms FAIL (2025-10-08 08:51:14 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 275.649947ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 579.061352ms FAIL (2025-10-08 08:51:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 8 08:29:42.207274015 (954h21m17.560059133s) [upload=839834]: Starting upload Oct 8 08:29:42.207370566 (954h21m17.560155695s) [upload=839834]: Done starting upload Oct 8 08:29:42.207439656 (954h21m17.560224784s) [upload=839834]: Uploading segments... Oct 8 08:29:42.207767773 (954h21m17.5605529s) [upload=839834]: Got next segment. Inline: false Oct 8 08:29:42.207812115 (954h21m17.560597254s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 08:29:42.207822906 (954h21m17.560608034s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 08:29:46.231440887 (954h21m21.584225984s) [seg_pos={0 0}, upload=839834]: Begin upload segment... Oct 8 08:29:46.231480260 (954h21m21.584265359s) [seg_pos={0 0}, upload=839834]: Done begin upload segment. Oct 8 08:29:46.231506099 (954h21m21.584291197s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231522400 (954h21m21.584307497s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231867997 (954h21m21.584653105s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231878217 (954h21m21.584663325s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232161820 (954h21m21.584946918s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232199901 (954h21m21.584984999s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232425575 (954h21m21.585210672s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232462444 (954h21m21.585247541s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232708044 (954h21m21.585493142s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232776564 (954h21m21.585561662s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233024619 (954h21m21.585809717s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233051609 (954h21m21.585836718s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233293123 (954h21m21.58607822s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233326044 (954h21m21.586111142s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233564892 (954h21m21.58634999s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233841642 (954h21m21.586626741s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.322099433 (954h21m21.674884531s) [upload=839834]: Next returned nil segment Oct 8 08:29:46.322132464 (954h21m21.674917563s) [upload=839834]: Waiting for error group managing segments... Oct 8 08:29:46.330063889 (954h21m21.682848997s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330383188 (954h21m21.683168296s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330611265 (954h21m21.683396373s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330845516 (954h21m21.683630614s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331046913 (954h21m21.683832012s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331359309 (954h21m21.684144407s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331399916 (954h21m21.684185024s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331768769 (954h21m21.684553877s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332110469 (954h21m21.684895577s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332180250 (954h21m21.684965358s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332506262 (954h21m21.685291361s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332716447 (954h21m21.685501555s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332845990 (954h21m21.685631087s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332852031 (954h21m21.685637129s) [seg_pos={0 0}, upload=839834]: Segment reached optimal threshold of 13 pieces. Oct 8 08:29:46.332950155 (954h21m21.685735263s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.332998957 (954h21m21.685784054s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.333249086 (954h21m21.686034194s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.333272700 (954h21m21.686057808s) [seg_pos={0 0}, upload=839834]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Oct 8 08:29:46.333344115 (954h21m21.686129223s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 08:29:46.333349395 (954h21m21.686134503s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 08:30:13.602630613 (954h21m48.955415712s) [upload=839834]: Done uploading segments... Oct 8 08:30:13.602650050 (954h21m48.955435158s) [upload=839834]: Upload finished. err: metaclient: context deadline exceeded Duration: 579.082451ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 373.973344ms FAIL (2025-10-08 08:50:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 373.989244ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 516.312534ms FAIL (2025-10-08 08:50:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 8 08:29:42.207274015 (954h21m17.560059133s) [upload=839834]: Starting upload Oct 8 08:29:42.207370566 (954h21m17.560155695s) [upload=839834]: Done starting upload Oct 8 08:29:42.207439656 (954h21m17.560224784s) [upload=839834]: Uploading segments... Oct 8 08:29:42.207767773 (954h21m17.5605529s) [upload=839834]: Got next segment. Inline: false Oct 8 08:29:42.207812115 (954h21m17.560597254s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 08:29:42.207822906 (954h21m17.560608034s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 08:29:46.231440887 (954h21m21.584225984s) [seg_pos={0 0}, upload=839834]: Begin upload segment... Oct 8 08:29:46.231480260 (954h21m21.584265359s) [seg_pos={0 0}, upload=839834]: Done begin upload segment. Oct 8 08:29:46.231506099 (954h21m21.584291197s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231522400 (954h21m21.584307497s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231867997 (954h21m21.584653105s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231878217 (954h21m21.584663325s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232161820 (954h21m21.584946918s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232199901 (954h21m21.584984999s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232425575 (954h21m21.585210672s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232462444 (954h21m21.585247541s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232708044 (954h21m21.585493142s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232776564 (954h21m21.585561662s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233024619 (954h21m21.585809717s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233051609 (954h21m21.585836718s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233293123 (954h21m21.58607822s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233326044 (954h21m21.586111142s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233564892 (954h21m21.58634999s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233841642 (954h21m21.586626741s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.322099433 (954h21m21.674884531s) [upload=839834]: Next returned nil segment Oct 8 08:29:46.322132464 (954h21m21.674917563s) [upload=839834]: Waiting for error group managing segments... Oct 8 08:29:46.330063889 (954h21m21.682848997s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330383188 (954h21m21.683168296s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330611265 (954h21m21.683396373s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330845516 (954h21m21.683630614s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331046913 (954h21m21.683832012s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331359309 (954h21m21.684144407s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331399916 (954h21m21.684185024s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331768769 (954h21m21.684553877s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332110469 (954h21m21.684895577s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332180250 (954h21m21.684965358s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332506262 (954h21m21.685291361s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332716447 (954h21m21.685501555s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332845990 (954h21m21.685631087s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332852031 (954h21m21.685637129s) [seg_pos={0 0}, upload=839834]: Segment reached optimal threshold of 13 pieces. Oct 8 08:29:46.332950155 (954h21m21.685735263s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.332998957 (954h21m21.685784054s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.333249086 (954h21m21.686034194s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.333272700 (954h21m21.686057808s) [seg_pos={0 0}, upload=839834]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Oct 8 08:29:46.333344115 (954h21m21.686129223s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 08:29:46.333349395 (954h21m21.686134503s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 08:30:13.602630613 (954h21m48.955415712s) [upload=839834]: Done uploading segments... Oct 8 08:30:13.602650050 (954h21m48.955435158s) [upload=839834]: Upload finished. err: metaclient: context deadline exceeded Duration: 516.338462ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 395.980292ms FAIL (2025-10-08 08:50:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 396.003466ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 252.895535ms FAIL (2025-10-08 08:50:10 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 252.923337ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 373.711253ms FAIL (2025-10-08 08:50:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 8 08:29:42.207274015 (954h21m17.560059133s) [upload=839834]: Starting upload Oct 8 08:29:42.207370566 (954h21m17.560155695s) [upload=839834]: Done starting upload Oct 8 08:29:42.207439656 (954h21m17.560224784s) [upload=839834]: Uploading segments... Oct 8 08:29:42.207767773 (954h21m17.5605529s) [upload=839834]: Got next segment. Inline: false Oct 8 08:29:42.207812115 (954h21m17.560597254s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 08:29:42.207822906 (954h21m17.560608034s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 08:29:46.231440887 (954h21m21.584225984s) [seg_pos={0 0}, upload=839834]: Begin upload segment... Oct 8 08:29:46.231480260 (954h21m21.584265359s) [seg_pos={0 0}, upload=839834]: Done begin upload segment. Oct 8 08:29:46.231506099 (954h21m21.584291197s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231522400 (954h21m21.584307497s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231867997 (954h21m21.584653105s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231878217 (954h21m21.584663325s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232161820 (954h21m21.584946918s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232199901 (954h21m21.584984999s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232425575 (954h21m21.585210672s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232462444 (954h21m21.585247541s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232708044 (954h21m21.585493142s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232776564 (954h21m21.585561662s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233024619 (954h21m21.585809717s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233051609 (954h21m21.585836718s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233293123 (954h21m21.58607822s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233326044 (954h21m21.586111142s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233564892 (954h21m21.58634999s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233841642 (954h21m21.586626741s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.322099433 (954h21m21.674884531s) [upload=839834]: Next returned nil segment Oct 8 08:29:46.322132464 (954h21m21.674917563s) [upload=839834]: Waiting for error group managing segments... Oct 8 08:29:46.330063889 (954h21m21.682848997s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330383188 (954h21m21.683168296s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330611265 (954h21m21.683396373s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330845516 (954h21m21.683630614s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331046913 (954h21m21.683832012s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331359309 (954h21m21.684144407s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331399916 (954h21m21.684185024s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331768769 (954h21m21.684553877s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332110469 (954h21m21.684895577s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332180250 (954h21m21.684965358s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332506262 (954h21m21.685291361s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332716447 (954h21m21.685501555s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332845990 (954h21m21.685631087s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332852031 (954h21m21.685637129s) [seg_pos={0 0}, upload=839834]: Segment reached optimal threshold of 13 pieces. Oct 8 08:29:46.332950155 (954h21m21.685735263s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.332998957 (954h21m21.685784054s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.333249086 (954h21m21.686034194s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.333272700 (954h21m21.686057808s) [seg_pos={0 0}, upload=839834]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Oct 8 08:29:46.333344115 (954h21m21.686129223s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 08:29:46.333349395 (954h21m21.686134503s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 08:30:13.602630613 (954h21m48.955415712s) [upload=839834]: Done uploading segments... Oct 8 08:30:13.602650050 (954h21m48.955435158s) [upload=839834]: Upload finished. err: metaclient: context deadline exceeded Duration: 373.733795ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 727.483466ms FAIL (2025-10-08 08:50:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 727.497082ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 341.639225ms FAIL (2025-10-08 08:49:48 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 341.664041ms core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 438.91225ms FAIL (2025-10-08 08:49:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 438.9332ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 408.217929ms FAIL (2025-10-08 08:49:23 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 408.238347ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 363.209274ms FAIL (2025-10-08 08:49:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 8 08:29:42.207274015 (954h21m17.560059133s) [upload=839834]: Starting upload Oct 8 08:29:42.207370566 (954h21m17.560155695s) [upload=839834]: Done starting upload Oct 8 08:29:42.207439656 (954h21m17.560224784s) [upload=839834]: Uploading segments... Oct 8 08:29:42.207767773 (954h21m17.5605529s) [upload=839834]: Got next segment. Inline: false Oct 8 08:29:42.207812115 (954h21m17.560597254s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 08:29:42.207822906 (954h21m17.560608034s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 08:29:46.231440887 (954h21m21.584225984s) [seg_pos={0 0}, upload=839834]: Begin upload segment... Oct 8 08:29:46.231480260 (954h21m21.584265359s) [seg_pos={0 0}, upload=839834]: Done begin upload segment. Oct 8 08:29:46.231506099 (954h21m21.584291197s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231522400 (954h21m21.584307497s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231867997 (954h21m21.584653105s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231878217 (954h21m21.584663325s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232161820 (954h21m21.584946918s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232199901 (954h21m21.584984999s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232425575 (954h21m21.585210672s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232462444 (954h21m21.585247541s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232708044 (954h21m21.585493142s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232776564 (954h21m21.585561662s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233024619 (954h21m21.585809717s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233051609 (954h21m21.585836718s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233293123 (954h21m21.58607822s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233326044 (954h21m21.586111142s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233564892 (954h21m21.58634999s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233841642 (954h21m21.586626741s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.322099433 (954h21m21.674884531s) [upload=839834]: Next returned nil segment Oct 8 08:29:46.322132464 (954h21m21.674917563s) [upload=839834]: Waiting for error group managing segments... Oct 8 08:29:46.330063889 (954h21m21.682848997s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330383188 (954h21m21.683168296s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330611265 (954h21m21.683396373s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330845516 (954h21m21.683630614s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331046913 (954h21m21.683832012s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331359309 (954h21m21.684144407s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331399916 (954h21m21.684185024s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331768769 (954h21m21.684553877s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332110469 (954h21m21.684895577s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332180250 (954h21m21.684965358s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332506262 (954h21m21.685291361s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332716447 (954h21m21.685501555s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332845990 (954h21m21.685631087s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332852031 (954h21m21.685637129s) [seg_pos={0 0}, upload=839834]: Segment reached optimal threshold of 13 pieces. Oct 8 08:29:46.332950155 (954h21m21.685735263s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.332998957 (954h21m21.685784054s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.333249086 (954h21m21.686034194s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.333272700 (954h21m21.686057808s) [seg_pos={0 0}, upload=839834]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Oct 8 08:29:46.333344115 (954h21m21.686129223s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 08:29:46.333349395 (954h21m21.686134503s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 08:30:13.602630613 (954h21m48.955415712s) [upload=839834]: Done uploading segments... Oct 8 08:30:13.602650050 (954h21m48.955435158s) [upload=839834]: Upload finished. err: metaclient: context deadline exceeded Duration: 363.237387ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 450.126605ms FAIL (2025-10-08 08:48:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 450.143246ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 284.575136ms FAIL (2025-10-08 08:48:30 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 284.595394ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 609.358125ms FAIL (2025-10-08 08:48:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 8 08:29:42.207274015 (954h21m17.560059133s) [upload=839834]: Starting upload Oct 8 08:29:42.207370566 (954h21m17.560155695s) [upload=839834]: Done starting upload Oct 8 08:29:42.207439656 (954h21m17.560224784s) [upload=839834]: Uploading segments... Oct 8 08:29:42.207767773 (954h21m17.5605529s) [upload=839834]: Got next segment. Inline: false Oct 8 08:29:42.207812115 (954h21m17.560597254s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 08:29:42.207822906 (954h21m17.560608034s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 08:29:46.231440887 (954h21m21.584225984s) [seg_pos={0 0}, upload=839834]: Begin upload segment... Oct 8 08:29:46.231480260 (954h21m21.584265359s) [seg_pos={0 0}, upload=839834]: Done begin upload segment. Oct 8 08:29:46.231506099 (954h21m21.584291197s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231522400 (954h21m21.584307497s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231867997 (954h21m21.584653105s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231878217 (954h21m21.584663325s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232161820 (954h21m21.584946918s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232199901 (954h21m21.584984999s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232425575 (954h21m21.585210672s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232462444 (954h21m21.585247541s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232708044 (954h21m21.585493142s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232776564 (954h21m21.585561662s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233024619 (954h21m21.585809717s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233051609 (954h21m21.585836718s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233293123 (954h21m21.58607822s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233326044 (954h21m21.586111142s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233564892 (954h21m21.58634999s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233841642 (954h21m21.586626741s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.322099433 (954h21m21.674884531s) [upload=839834]: Next returned nil segment Oct 8 08:29:46.322132464 (954h21m21.674917563s) [upload=839834]: Waiting for error group managing segments... Oct 8 08:29:46.330063889 (954h21m21.682848997s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330383188 (954h21m21.683168296s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330611265 (954h21m21.683396373s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330845516 (954h21m21.683630614s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331046913 (954h21m21.683832012s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331359309 (954h21m21.684144407s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331399916 (954h21m21.684185024s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331768769 (954h21m21.684553877s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332110469 (954h21m21.684895577s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332180250 (954h21m21.684965358s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332506262 (954h21m21.685291361s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332716447 (954h21m21.685501555s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332845990 (954h21m21.685631087s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332852031 (954h21m21.685637129s) [seg_pos={0 0}, upload=839834]: Segment reached optimal threshold of 13 pieces. Oct 8 08:29:46.332950155 (954h21m21.685735263s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.332998957 (954h21m21.685784054s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.333249086 (954h21m21.686034194s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.333272700 (954h21m21.686057808s) [seg_pos={0 0}, upload=839834]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Oct 8 08:29:46.333344115 (954h21m21.686129223s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 08:29:46.333349395 (954h21m21.686134503s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 08:30:13.602630613 (954h21m48.955415712s) [upload=839834]: Done uploading segments... Oct 8 08:30:13.602650050 (954h21m48.955435158s) [upload=839834]: Upload finished. err: metaclient: context deadline exceeded Duration: 609.400885ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 300.342887ms FAIL (2025-10-08 08:47:58 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 300.372922ms core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 420.454734ms FAIL (2025-10-08 08:47:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 420.470874ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 310.046958ms FAIL (2025-10-08 08:47:27 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 310.077123ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 456.990748ms FAIL (2025-10-08 08:47:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 8 08:29:42.207274015 (954h21m17.560059133s) [upload=839834]: Starting upload Oct 8 08:29:42.207370566 (954h21m17.560155695s) [upload=839834]: Done starting upload Oct 8 08:29:42.207439656 (954h21m17.560224784s) [upload=839834]: Uploading segments... Oct 8 08:29:42.207767773 (954h21m17.5605529s) [upload=839834]: Got next segment. Inline: false Oct 8 08:29:42.207812115 (954h21m17.560597254s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 08:29:42.207822906 (954h21m17.560608034s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 08:29:46.231440887 (954h21m21.584225984s) [seg_pos={0 0}, upload=839834]: Begin upload segment... Oct 8 08:29:46.231480260 (954h21m21.584265359s) [seg_pos={0 0}, upload=839834]: Done begin upload segment. Oct 8 08:29:46.231506099 (954h21m21.584291197s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231522400 (954h21m21.584307497s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231867997 (954h21m21.584653105s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231878217 (954h21m21.584663325s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232161820 (954h21m21.584946918s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232199901 (954h21m21.584984999s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232425575 (954h21m21.585210672s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232462444 (954h21m21.585247541s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232708044 (954h21m21.585493142s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232776564 (954h21m21.585561662s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233024619 (954h21m21.585809717s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233051609 (954h21m21.585836718s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233293123 (954h21m21.58607822s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233326044 (954h21m21.586111142s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233564892 (954h21m21.58634999s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233841642 (954h21m21.586626741s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.322099433 (954h21m21.674884531s) [upload=839834]: Next returned nil segment Oct 8 08:29:46.322132464 (954h21m21.674917563s) [upload=839834]: Waiting for error group managing segments... Oct 8 08:29:46.330063889 (954h21m21.682848997s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330383188 (954h21m21.683168296s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330611265 (954h21m21.683396373s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330845516 (954h21m21.683630614s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331046913 (954h21m21.683832012s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331359309 (954h21m21.684144407s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331399916 (954h21m21.684185024s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331768769 (954h21m21.684553877s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332110469 (954h21m21.684895577s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332180250 (954h21m21.684965358s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332506262 (954h21m21.685291361s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332716447 (954h21m21.685501555s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332845990 (954h21m21.685631087s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332852031 (954h21m21.685637129s) [seg_pos={0 0}, upload=839834]: Segment reached optimal threshold of 13 pieces. Oct 8 08:29:46.332950155 (954h21m21.685735263s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.332998957 (954h21m21.685784054s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.333249086 (954h21m21.686034194s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.333272700 (954h21m21.686057808s) [seg_pos={0 0}, upload=839834]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Oct 8 08:29:46.333344115 (954h21m21.686129223s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 08:29:46.333349395 (954h21m21.686134503s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 08:30:13.602630613 (954h21m48.955415712s) [upload=839834]: Done uploading segments... Oct 8 08:30:13.602650050 (954h21m48.955435158s) [upload=839834]: Upload finished. err: metaclient: context deadline exceeded Duration: 457.024811ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 401.735205ms FAIL (2025-10-08 08:47:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 401.755192ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 463.40185ms FAIL (2025-10-08 08:46:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 8 08:29:42.207274015 (954h21m17.560059133s) [upload=839834]: Starting upload Oct 8 08:29:42.207370566 (954h21m17.560155695s) [upload=839834]: Done starting upload Oct 8 08:29:42.207439656 (954h21m17.560224784s) [upload=839834]: Uploading segments... Oct 8 08:29:42.207767773 (954h21m17.5605529s) [upload=839834]: Got next segment. Inline: false Oct 8 08:29:42.207812115 (954h21m17.560597254s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 08:29:42.207822906 (954h21m17.560608034s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 08:29:46.231440887 (954h21m21.584225984s) [seg_pos={0 0}, upload=839834]: Begin upload segment... Oct 8 08:29:46.231480260 (954h21m21.584265359s) [seg_pos={0 0}, upload=839834]: Done begin upload segment. Oct 8 08:29:46.231506099 (954h21m21.584291197s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231522400 (954h21m21.584307497s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231867997 (954h21m21.584653105s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231878217 (954h21m21.584663325s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232161820 (954h21m21.584946918s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232199901 (954h21m21.584984999s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232425575 (954h21m21.585210672s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232462444 (954h21m21.585247541s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232708044 (954h21m21.585493142s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232776564 (954h21m21.585561662s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233024619 (954h21m21.585809717s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233051609 (954h21m21.585836718s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233293123 (954h21m21.58607822s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233326044 (954h21m21.586111142s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233564892 (954h21m21.58634999s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233841642 (954h21m21.586626741s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.322099433 (954h21m21.674884531s) [upload=839834]: Next returned nil segment Oct 8 08:29:46.322132464 (954h21m21.674917563s) [upload=839834]: Waiting for error group managing segments... Oct 8 08:29:46.330063889 (954h21m21.682848997s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330383188 (954h21m21.683168296s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330611265 (954h21m21.683396373s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330845516 (954h21m21.683630614s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331046913 (954h21m21.683832012s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331359309 (954h21m21.684144407s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331399916 (954h21m21.684185024s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331768769 (954h21m21.684553877s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332110469 (954h21m21.684895577s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332180250 (954h21m21.684965358s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332506262 (954h21m21.685291361s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332716447 (954h21m21.685501555s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332845990 (954h21m21.685631087s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332852031 (954h21m21.685637129s) [seg_pos={0 0}, upload=839834]: Segment reached optimal threshold of 13 pieces. Oct 8 08:29:46.332950155 (954h21m21.685735263s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.332998957 (954h21m21.685784054s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.333249086 (954h21m21.686034194s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.333272700 (954h21m21.686057808s) [seg_pos={0 0}, upload=839834]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Oct 8 08:29:46.333344115 (954h21m21.686129223s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 08:29:46.333349395 (954h21m21.686134503s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 08:30:13.602630613 (954h21m48.955415712s) [upload=839834]: Done uploading segments... Oct 8 08:30:13.602650050 (954h21m48.955435158s) [upload=839834]: Upload finished. err: metaclient: context deadline exceeded Duration: 463.42325ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 389.606242ms FAIL (2025-10-08 08:46:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 389.625728ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 249.997256ms FAIL (2025-10-08 08:46:43 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 250.038353ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 384.859763ms FAIL (2025-10-08 08:46:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 8 08:29:42.207274015 (954h21m17.560059133s) [upload=839834]: Starting upload Oct 8 08:29:42.207370566 (954h21m17.560155695s) [upload=839834]: Done starting upload Oct 8 08:29:42.207439656 (954h21m17.560224784s) [upload=839834]: Uploading segments... Oct 8 08:29:42.207767773 (954h21m17.5605529s) [upload=839834]: Got next segment. Inline: false Oct 8 08:29:42.207812115 (954h21m17.560597254s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 08:29:42.207822906 (954h21m17.560608034s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 08:29:46.231440887 (954h21m21.584225984s) [seg_pos={0 0}, upload=839834]: Begin upload segment... Oct 8 08:29:46.231480260 (954h21m21.584265359s) [seg_pos={0 0}, upload=839834]: Done begin upload segment. Oct 8 08:29:46.231506099 (954h21m21.584291197s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231522400 (954h21m21.584307497s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231867997 (954h21m21.584653105s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231878217 (954h21m21.584663325s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232161820 (954h21m21.584946918s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232199901 (954h21m21.584984999s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232425575 (954h21m21.585210672s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232462444 (954h21m21.585247541s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232708044 (954h21m21.585493142s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232776564 (954h21m21.585561662s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233024619 (954h21m21.585809717s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233051609 (954h21m21.585836718s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233293123 (954h21m21.58607822s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233326044 (954h21m21.586111142s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233564892 (954h21m21.58634999s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233841642 (954h21m21.586626741s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.322099433 (954h21m21.674884531s) [upload=839834]: Next returned nil segment Oct 8 08:29:46.322132464 (954h21m21.674917563s) [upload=839834]: Waiting for error group managing segments... Oct 8 08:29:46.330063889 (954h21m21.682848997s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330383188 (954h21m21.683168296s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330611265 (954h21m21.683396373s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330845516 (954h21m21.683630614s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331046913 (954h21m21.683832012s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331359309 (954h21m21.684144407s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331399916 (954h21m21.684185024s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331768769 (954h21m21.684553877s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332110469 (954h21m21.684895577s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332180250 (954h21m21.684965358s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332506262 (954h21m21.685291361s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332716447 (954h21m21.685501555s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332845990 (954h21m21.685631087s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332852031 (954h21m21.685637129s) [seg_pos={0 0}, upload=839834]: Segment reached optimal threshold of 13 pieces. Oct 8 08:29:46.332950155 (954h21m21.685735263s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.332998957 (954h21m21.685784054s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.333249086 (954h21m21.686034194s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.333272700 (954h21m21.686057808s) [seg_pos={0 0}, upload=839834]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Oct 8 08:29:46.333344115 (954h21m21.686129223s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 08:29:46.333349395 (954h21m21.686134503s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 08:30:13.602630613 (954h21m48.955415712s) [upload=839834]: Done uploading segments... Oct 8 08:30:13.602650050 (954h21m48.955435158s) [upload=839834]: Upload finished. err: metaclient: context deadline exceeded Duration: 384.88421ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 455.335953ms FAIL (2025-10-08 08:45:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 455.357773ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 333.791938ms FAIL (2025-10-08 08:45:48 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 333.823919ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 542.465032ms FAIL (2025-10-08 08:45:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 8 08:29:42.207274015 (954h21m17.560059133s) [upload=839834]: Starting upload Oct 8 08:29:42.207370566 (954h21m17.560155695s) [upload=839834]: Done starting upload Oct 8 08:29:42.207439656 (954h21m17.560224784s) [upload=839834]: Uploading segments... Oct 8 08:29:42.207767773 (954h21m17.5605529s) [upload=839834]: Got next segment. Inline: false Oct 8 08:29:42.207812115 (954h21m17.560597254s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 08:29:42.207822906 (954h21m17.560608034s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 08:29:46.231440887 (954h21m21.584225984s) [seg_pos={0 0}, upload=839834]: Begin upload segment... Oct 8 08:29:46.231480260 (954h21m21.584265359s) [seg_pos={0 0}, upload=839834]: Done begin upload segment. Oct 8 08:29:46.231506099 (954h21m21.584291197s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231522400 (954h21m21.584307497s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231867997 (954h21m21.584653105s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231878217 (954h21m21.584663325s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232161820 (954h21m21.584946918s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232199901 (954h21m21.584984999s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232425575 (954h21m21.585210672s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232462444 (954h21m21.585247541s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232708044 (954h21m21.585493142s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232776564 (954h21m21.585561662s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233024619 (954h21m21.585809717s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233051609 (954h21m21.585836718s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233293123 (954h21m21.58607822s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233326044 (954h21m21.586111142s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233564892 (954h21m21.58634999s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233841642 (954h21m21.586626741s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.322099433 (954h21m21.674884531s) [upload=839834]: Next returned nil segment Oct 8 08:29:46.322132464 (954h21m21.674917563s) [upload=839834]: Waiting for error group managing segments... Oct 8 08:29:46.330063889 (954h21m21.682848997s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330383188 (954h21m21.683168296s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330611265 (954h21m21.683396373s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330845516 (954h21m21.683630614s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331046913 (954h21m21.683832012s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331359309 (954h21m21.684144407s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331399916 (954h21m21.684185024s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331768769 (954h21m21.684553877s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332110469 (954h21m21.684895577s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332180250 (954h21m21.684965358s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332506262 (954h21m21.685291361s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332716447 (954h21m21.685501555s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332845990 (954h21m21.685631087s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332852031 (954h21m21.685637129s) [seg_pos={0 0}, upload=839834]: Segment reached optimal threshold of 13 pieces. Oct 8 08:29:46.332950155 (954h21m21.685735263s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.332998957 (954h21m21.685784054s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.333249086 (954h21m21.686034194s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.333272700 (954h21m21.686057808s) [seg_pos={0 0}, upload=839834]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Oct 8 08:29:46.333344115 (954h21m21.686129223s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 08:29:46.333349395 (954h21m21.686134503s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 08:30:13.602630613 (954h21m48.955415712s) [upload=839834]: Done uploading segments... Oct 8 08:30:13.602650050 (954h21m48.955435158s) [upload=839834]: Upload finished. err: metaclient: context deadline exceeded Duration: 542.485701ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 20.227741276s FAIL (2025-10-08 08:45:29 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 20.227759559s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 20.401592825s FAIL (2025-10-08 08:45:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 20.401609776s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 643.018336ms FAIL (2025-10-08 08:44:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 8 08:29:42.207274015 (954h21m17.560059133s) [upload=839834]: Starting upload Oct 8 08:29:42.207370566 (954h21m17.560155695s) [upload=839834]: Done starting upload Oct 8 08:29:42.207439656 (954h21m17.560224784s) [upload=839834]: Uploading segments... Oct 8 08:29:42.207767773 (954h21m17.5605529s) [upload=839834]: Got next segment. Inline: false Oct 8 08:29:42.207812115 (954h21m17.560597254s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 08:29:42.207822906 (954h21m17.560608034s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 08:29:46.231440887 (954h21m21.584225984s) [seg_pos={0 0}, upload=839834]: Begin upload segment... Oct 8 08:29:46.231480260 (954h21m21.584265359s) [seg_pos={0 0}, upload=839834]: Done begin upload segment. Oct 8 08:29:46.231506099 (954h21m21.584291197s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231522400 (954h21m21.584307497s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231867997 (954h21m21.584653105s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231878217 (954h21m21.584663325s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232161820 (954h21m21.584946918s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232199901 (954h21m21.584984999s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232425575 (954h21m21.585210672s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232462444 (954h21m21.585247541s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232708044 (954h21m21.585493142s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232776564 (954h21m21.585561662s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233024619 (954h21m21.585809717s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233051609 (954h21m21.585836718s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233293123 (954h21m21.58607822s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233326044 (954h21m21.586111142s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233564892 (954h21m21.58634999s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233841642 (954h21m21.586626741s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.322099433 (954h21m21.674884531s) [upload=839834]: Next returned nil segment Oct 8 08:29:46.322132464 (954h21m21.674917563s) [upload=839834]: Waiting for error group managing segments... Oct 8 08:29:46.330063889 (954h21m21.682848997s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330383188 (954h21m21.683168296s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330611265 (954h21m21.683396373s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330845516 (954h21m21.683630614s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331046913 (954h21m21.683832012s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331359309 (954h21m21.684144407s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331399916 (954h21m21.684185024s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331768769 (954h21m21.684553877s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332110469 (954h21m21.684895577s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332180250 (954h21m21.684965358s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332506262 (954h21m21.685291361s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332716447 (954h21m21.685501555s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332845990 (954h21m21.685631087s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332852031 (954h21m21.685637129s) [seg_pos={0 0}, upload=839834]: Segment reached optimal threshold of 13 pieces. Oct 8 08:29:46.332950155 (954h21m21.685735263s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.332998957 (954h21m21.685784054s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.333249086 (954h21m21.686034194s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.333272700 (954h21m21.686057808s) [seg_pos={0 0}, upload=839834]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Oct 8 08:29:46.333344115 (954h21m21.686129223s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 08:29:46.333349395 (954h21m21.686134503s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 08:30:13.602630613 (954h21m48.955415712s) [upload=839834]: Done uploading segments... Oct 8 08:30:13.602650050 (954h21m48.955435158s) [upload=839834]: Upload finished. err: metaclient: context deadline exceeded Duration: 643.042141ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 153.289067ms FAIL (2025-10-08 08:44:20 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 153.308743ms core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 410.71224ms FAIL (2025-10-08 08:43:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 410.729543ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 429.423544ms FAIL (2025-10-08 08:43:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 8 08:29:42.207274015 (954h21m17.560059133s) [upload=839834]: Starting upload Oct 8 08:29:42.207370566 (954h21m17.560155695s) [upload=839834]: Done starting upload Oct 8 08:29:42.207439656 (954h21m17.560224784s) [upload=839834]: Uploading segments... Oct 8 08:29:42.207767773 (954h21m17.5605529s) [upload=839834]: Got next segment. Inline: false Oct 8 08:29:42.207812115 (954h21m17.560597254s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 8 08:29:42.207822906 (954h21m17.560608034s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 8 08:29:46.231440887 (954h21m21.584225984s) [seg_pos={0 0}, upload=839834]: Begin upload segment... Oct 8 08:29:46.231480260 (954h21m21.584265359s) [seg_pos={0 0}, upload=839834]: Done begin upload segment. Oct 8 08:29:46.231506099 (954h21m21.584291197s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231522400 (954h21m21.584307497s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231867997 (954h21m21.584653105s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.231878217 (954h21m21.584663325s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232161820 (954h21m21.584946918s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232199901 (954h21m21.584984999s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232425575 (954h21m21.585210672s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232462444 (954h21m21.585247541s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232708044 (954h21m21.585493142s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.232776564 (954h21m21.585561662s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233024619 (954h21m21.585809717s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233051609 (954h21m21.585836718s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233293123 (954h21m21.58607822s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233326044 (954h21m21.586111142s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233564892 (954h21m21.58634999s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.233841642 (954h21m21.586626741s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Uploading piece... Oct 8 08:29:46.322099433 (954h21m21.674884531s) [upload=839834]: Next returned nil segment Oct 8 08:29:46.322132464 (954h21m21.674917563s) [upload=839834]: Waiting for error group managing segments... Oct 8 08:29:46.330063889 (954h21m21.682848997s) [noise=true , address=145.79.227.2:4114 , piece_id=DZ75UECSADKLQZEMPLPDT27D6EDRZAR6T62XNAXJG4ZCQP5JHWHQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330383188 (954h21m21.683168296s) [noise=true , address=45.91.116.4:4937 , piece_id=GL4DIIYVAFLXUAH4OWYTGCX5QHE4L2CAQX7MKMKEHDOSA4D5M2JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330611265 (954h21m21.683396373s) [noise=true , address=45.91.116.14:4191 , piece_id=KMZKBGXJVGSPU6EF6CZFSSKJ3VUNLLGWM42POZETIYBDDP4WN5LA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.330845516 (954h21m21.683630614s) [noise=true , address=145.79.227.5:4222 , piece_id=HE2DXOEG6KGCJWRNPPMWUOEJZPNRMNHDQIYOUTNEK2BRHDRXARRA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331046913 (954h21m21.683832012s) [noise=true , address=145.79.227.14:4840 , piece_id=RP3BMMUCCQZLM25ZTSUGC44EFSDEL6JVAHLUW3S6VS5EUD5ZM6JQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331359309 (954h21m21.684144407s) [noise=true , address=45.91.116.7:4009 , piece_id=O6SYAJVS2JV67UUTRG4TQUID5ITBGYWTK27RPKIBBOSYI6QSOG3Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331399916 (954h21m21.684185024s) [noise=true , address=45.91.116.10:4083 , piece_id=42I25WSIVFPKHWQKH6AFPTIWDQACMP4ZPOO4S22WAZ46MEQTG6TQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.331768769 (954h21m21.684553877s) [noise=true , address=77.90.31.18:4807 , piece_id=UFMMZDLPM4JFFZCIFVKNMOCPDQWUSOXQUEPAGJ6QLC5OGI42OUAA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332110469 (954h21m21.684895577s) [noise=true , address=145.79.227.16:4910 , piece_id=EQBZ4WQUU4G2JFABPMO3LNIZWWYHB54FTVQE525Y3P3XA5MPUTVQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332180250 (954h21m21.684965358s) [noise=true , address=77.90.31.18:4805 , piece_id=BVDACNLPY3W23GJPBWRSECEEU2TWI5TJVT2RVCLA365KZECUZH2A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332506262 (954h21m21.685291361s) [noise=true , address=45.91.116.12:4227 , piece_id=6TG2BIIA5NBLCGPQOK6PL5WZH4YEJ77BXZNYK6BINTOMVC6YJQQQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332716447 (954h21m21.685501555s) [noise=true , address=45.91.116.5:4298 , piece_id=2FQXUHYICLDQXM7EZ6WQN6UAG6DM6L4FWAGURAYUL7E7IYQVQVTQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332845990 (954h21m21.685631087s) [noise=true , address=145.79.227.13:4804 , piece_id=PXVFPKKZNPUZIO3QRRDROTZRWS6EIXXLLNTBQLE62I2VOA56F4UQ, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.332852031 (954h21m21.685637129s) [seg_pos={0 0}, upload=839834]: Segment reached optimal threshold of 13 pieces. Oct 8 08:29:46.332950155 (954h21m21.685735263s) [noise=true , address=77.90.31.12:4589 , piece_id=H2PVBAHF6K6CBOOWC6VMPGVAUFSSJI5P4QXDCJA4IMLDPD7ETF3A, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.332998957 (954h21m21.685784054s) [noise=true , address=145.79.227.15:4875 , piece_id=LYBOMERJ5CYMTBQRRXWQHOVW37NF6SP4JKY2QZZTH7ARFZZ76EPA, seg_pos={0 0}, upload=839834]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Oct 8 08:29:46.333249086 (954h21m21.686034194s) [noise=true , address=145.79.227.7:4293 , piece_id=IQGRN672RGJRTVLZ5PRNSVJHDNPC6QOIFEJRI7UXLVWWVK2OSO4Q, seg_pos={0 0}, upload=839834]: Done uploading piece. err: <nil> Oct 8 08:29:46.333272700 (954h21m21.686057808s) [seg_pos={0 0}, upload=839834]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Oct 8 08:29:46.333344115 (954h21m21.686129223s) [upload=839834]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 8 08:29:46.333349395 (954h21m21.686134503s) [upload=839834]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 8 08:30:13.602630613 (954h21m48.955415712s) [upload=839834]: Done uploading segments... Oct 8 08:30:13.602650050 (954h21m48.955435158s) [upload=839834]: Upload finished. err: metaclient: context deadline exceeded Duration: 429.449062ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 229.7722ms FAIL (2025-10-08 08:43:07 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 229.789093ms core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 448.852908ms FAIL (2025-10-08 08:43:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 448.868176ms edge gateway us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)