Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 19 out of 60 is failed (threshold=3) [...................................XXXXXXXXXXXXXXXXX.XX.....] duration: 991.080693ms FAIL (2025-08-07 21:46:02 UTC) operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== address=104.36.82.12:4172 , piece_id=2SN23SJESN46DLA25WJULJLVGE7QWLQW2QJFAUA3WUVICJ5CKLUA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.023027314 (5h13m59.610083535s) [noise=true , address=104.36.82.54:4183 , piece_id=ZOCQQFJKFATMPRR2PKHLTSWN2D3QXAMZ74K2A5KTKYQAHEGA2BUA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.023255801 (5h13m59.610312012s) [noise=true , address=104.36.82.37:4663 , piece_id=XOIJUGNOKJJVWQ4226IL67H73DVYH7VBSIKI4BQSMOIGYNY7MO7A, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.023462957 (5h13m59.610519169s) [noise=true , address=104.36.82.60:4367 , piece_id=IRTAFXB5WIGLKZE4HQE7UW7J5OSZSIQK7TGY447RFZD7FCIAYQVQ, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.023666096 (5h13m59.610722308s) [noise=true , address=64.49.13.140:4511 , piece_id=A7AQ3VPKYONSOWW2YUPGWAXTMA4JPGBG4CQVYCK6PFFIFFUGPMHA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.023880075 (5h13m59.610936287s) [noise=true , address=104.36.82.23:4474 , piece_id=TDLXCBP5IPHILGHJYQD4DXYRMLL2VS2ER3ECEBAXOBTUAMR67BBA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.024106408 (5h13m59.611162629s) [noise=true , address=104.36.82.58:4269 , piece_id=4I2ROAYRNHMC53OKVWWXCS4FULL2XZ6CG5WZUPOLQ4UNELQDHHOA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.024332290 (5h13m59.611388511s) [noise=true , address=104.36.82.16:4305 , piece_id=K5YI7X35EAPFSOANSPQERKCHUOO6GDZZWKAOFNYGM6R3PA6K2LWA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.024539145 (5h13m59.611595357s) [noise=true , address=104.36.82.36:4623 , piece_id=ONIDD2KMXGVLKCD5YFBVUMMF2ORGVLFDV4LG3TRKRSINURIDAAFA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.024749439 (5h13m59.61180566s) [noise=true , address=104.36.82.43:4850 , piece_id=XWPXP7HKO2ZH22MMIODDLHM3LPIIPQP3Y3FLZ54XMMWOIN7JIADA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.024973778 (5h13m59.612029999s) [noise=true , address=45.91.116.9:4266 , piece_id=VOPNPD4GIHS2VOYBWCCTR7LX3YKL4BCZLW4XMROMAWU4WYUJ52WA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.025220337 (5h13m59.612276558s) [noise=true , address=104.36.82.15:4275 , piece_id=HCH5IC5PTQ7NCSWPJJC5OOEPEIMA34ZL6E5QPQPCDB2P2FEO6JYA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.105422677 (5h13m59.692478898s) [upload=5382]: Next returned nil segment Aug 7 21:40:46.105438417 (5h13m59.692494638s) [upload=5382]: Waiting for error group managing segments... Aug 7 21:40:46.115255601 (5h13m59.702311812s) [noise=true , address=45.91.116.9:4266 , piece_id=VOPNPD4GIHS2VOYBWCCTR7LX3YKL4BCZLW4XMROMAWU4WYUJ52WA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.123052245 (5h13m59.710108455s) [noise=true , address=104.36.82.16:4305 , piece_id=K5YI7X35EAPFSOANSPQERKCHUOO6GDZZWKAOFNYGM6R3PA6K2LWA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.123065018 (5h13m59.710121239s) [noise=true , address=104.36.82.37:4663 , piece_id=XOIJUGNOKJJVWQ4226IL67H73DVYH7VBSIKI4BQSMOIGYNY7MO7A, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.135955971 (5h13m59.723012192s) [noise=true , address=104.36.82.58:4269 , piece_id=4I2ROAYRNHMC53OKVWWXCS4FULL2XZ6CG5WZUPOLQ4UNELQDHHOA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.139757077 (5h13m59.726813288s) [noise=true , address=104.36.82.44:4891 , piece_id=D33W4EHVQ26LIOJ2KG5RKUHRZSGXAIGS2PQSIURYKGMP63RBTBGA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.148928486 (5h13m59.735984697s) [noise=true , address=104.36.82.15:4275 , piece_id=HCH5IC5PTQ7NCSWPJJC5OOEPEIMA34ZL6E5QPQPCDB2P2FEO6JYA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.149227595 (5h13m59.736283816s) [noise=true , address=104.36.82.36:4623 , piece_id=ONIDD2KMXGVLKCD5YFBVUMMF2ORGVLFDV4LG3TRKRSINURIDAAFA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.157435446 (5h13m59.744491657s) [noise=true , address=104.36.82.54:4183 , piece_id=ZOCQQFJKFATMPRR2PKHLTSWN2D3QXAMZ74K2A5KTKYQAHEGA2BUA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.193659694 (5h13m59.780715905s) [noise=true , address=104.36.82.60:4367 , piece_id=IRTAFXB5WIGLKZE4HQE7UW7J5OSZSIQK7TGY447RFZD7FCIAYQVQ, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.198544171 (5h13m59.785600382s) [noise=true , address=104.36.82.12:4172 , piece_id=2SN23SJESN46DLA25WJULJLVGE7QWLQW2QJFAUA3WUVICJ5CKLUA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.200016058 (5h13m59.787072279s) [noise=true , address=104.36.82.14:4228 , piece_id=USWUBYJMTZKFFN3DZIKQQD7PW6QAKBRUHJZRCBO4DXTHR2PQDHRQ, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.224817695 (5h13m59.811873916s) [noise=true , address=104.36.82.43:4850 , piece_id=XWPXP7HKO2ZH22MMIODDLHM3LPIIPQP3Y3FLZ54XMMWOIN7JIADA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.225279788 (5h13m59.812336009s) [noise=true , address=104.36.82.61:4383 , piece_id=ELAHQPPPJCCLCQYXDEOS62V6TOMV5NOCMUU5XZFCQ23Y6SQUWG6Q, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.305784060 (5h13m59.892840282s) [noise=true , address=104.36.82.43:4863 , piece_id=PWAZUY75NQILRAVGRSMJSFKPOPLR3WQ5O3Q47GZ5U37KXPXJ3ORQ, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.305806102 (5h13m59.892862323s) [seg_pos={0 0}, upload=5382]: Segment reached optimal threshold of 14 pieces. Aug 7 21:40:46.305952956 (5h13m59.893009177s) [noise=true , address=104.36.82.56:4261 , piece_id=Z27LNZSXSYSUMQXEW2DI3C54ZJK26ALV653EINMYNU6COTMAMPBA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YNKaVEsXzHe6XGQuv6wR1qqbv6dbzg1xT5Aqkew2ZV3z3tMMf): protocol: expected piece hash; context canceled; EOF Aug 7 21:40:46.306110209 (5h13m59.89316642s) [noise=true , address=64.49.13.139:4471 , piece_id=2OSYONIOJUEZXMYFSTL7NRN7HG6KXJOHFUL7TIDW73C4VKYF3W3A, seg_pos={0 0}, upload=5382]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:26750->64.49.13.139:4471: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 21:40:46.306163639 (5h13m59.89321985s) [noise=true , address=104.36.82.23:4474 , piece_id=TDLXCBP5IPHILGHJYQD4DXYRMLL2VS2ER3ECEBAXOBTUAMR67BBA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: write tcp 5.161.89.252:22402->104.36.82.23:4474: use of closed network connection; write tcp 5.161.89.252:22402->104.36.82.23:4474: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:22402->104.36.82.23:4474: use of closed network connection Aug 7 21:40:46.306206098 (5h13m59.893262319s) [noise=true , address=64.49.13.140:4511 , piece_id=A7AQ3VPKYONSOWW2YUPGWAXTMA4JPGBG4CQVYCK6PFFIFFUGPMHA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: read tcp 5.161.89.252:31920->64.49.13.140:4511: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 21:40:46.306226506 (5h13m59.893282717s) [seg_pos={0 0}, upload=5382]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 21:40:46.306282762 (5h13m59.893338983s) [upload=5382]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 21:40:46.306286799 (5h13m59.89334301s) [upload=5382]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:40:57.774588980 (5h14m11.361645201s) [upload=5382]: Done uploading segments... Aug 7 21:40:57.774603057 (5h14m11.361659278s) [upload=5382]: Upload finished. err: <nil> Aug 7 21:41:10.210507562 (5h14m23.797563803s) [upload=5386]: Starting upload Aug 7 21:41:10.210589415 (5h14m23.797645655s) [upload=5386]: Done starting upload Aug 7 21:41:10.210669645 (5h14m23.797725856s) [upload=5386]: Uploading segments... Aug 7 21:41:10.210963293 (5h14m23.798019534s) [upload=5386]: Got next segment. Inline: false Aug 7 21:41:10.211025149 (5h14m23.79808139s) [upload=5386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:41:10.211035066 (5h14m23.798091308s) [upload=5386]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 21:42:10.197934627 (5h15m23.784990848s) [upload=5386]: Next segment err: context deadline exceeded Aug 7 21:42:10.198070280 (5h15m23.785126501s) [upload=5386]: Done uploading segments... Aug 7 21:42:10.198139409 (5h15m23.78519562s) [upload=5386]: Upload finished. err: context deadline exceeded Aug 7 21:42:14.127516635 (5h15m27.714572846s) [upload=5403]: Starting upload Aug 7 21:42:14.127582357 (5h15m27.714638569s) [upload=5403]: Done starting upload Aug 7 21:42:14.127692983 (5h15m27.714749204s) [upload=5403]: Uploading segments... Aug 7 21:42:14.127793461 (5h15m27.714849672s) [upload=5403]: Got next segment. Inline: false Aug 7 21:42:14.127840750 (5h15m27.714896961s) [upload=5403]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:42:14.127846281 (5h15m27.714902491s) [upload=5403]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 21:43:14.115648400 (5h16m27.702704611s) [upload=5403]: Next segment err: context deadline exceeded Aug 7 21:43:14.115816064 (5h16m27.702872275s) [upload=5403]: Done uploading segments... Aug 7 21:43:14.115831182 (5h16m27.702887403s) [upload=5403]: Upload finished. err: context deadline exceeded Duration: 991.10585ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 31 out of 60 is failed (threshold=3) [........................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.....] duration: 1.888591729s FAIL (2025-08-07 21:45:58 UTC) operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 1.888610383s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 38 out of 60 is failed (threshold=3) [.................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX...X..] duration: 179.783552ms FAIL (2025-08-07 21:45:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 179.796927ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 35 out of 60 is failed (threshold=3) [...................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX..X....] duration: 477.202718ms FAIL (2025-08-07 21:45:56 UTC) operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== 7 (5h14m28.062269058s) [upload=5388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:41:25.266685321 (5h14m38.853741562s) [upload=5388]: Done uploading segments... Aug 7 21:41:25.266706391 (5h14m38.853762631s) [upload=5388]: Upload finished. err: <nil> Aug 7 21:41:41.070176076 (5h14m54.657232316s) [upload=5396]: Starting upload Aug 7 21:41:41.070246557 (5h14m54.657302798s) [upload=5396]: Done starting upload Aug 7 21:41:41.070459143 (5h14m54.657515385s) [upload=5396]: Uploading segments... Aug 7 21:41:41.070697238 (5h14m54.657753479s) [upload=5396]: Got next segment. Inline: false Aug 7 21:41:41.070732264 (5h14m54.657788505s) [upload=5396]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:41:41.070737293 (5h14m54.657793524s) [upload=5396]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 21:41:41.825834701 (5h14m55.412890922s) [seg_pos={0 0}, upload=5396]: Begin upload segment... Aug 7 21:41:41.825865027 (5h14m55.412921237s) [seg_pos={0 0}, upload=5396]: Done begin upload segment. Aug 7 21:41:41.825886015 (5h14m55.412942237s) [noise=true , address=77.90.31.12:4592 , piece_id=75OFHQZRJKZYL3QJ37T6QLDED663WXIEFAHTH2BQZLZ46PY5YPLQ, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.825988818 (5h14m55.413045068s) [noise=true , address=45.91.116.5:4298 , piece_id=C3BQRSMSRSM4FJ7SWEBPHH7UKNUJWCDD5AEEBEAYN6OMCM2VRSWA, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.826203979 (5h14m55.413260201s) [noise=true , address=45.91.116.4:4937 , piece_id=BYNKX2DGOGITTOYV7IH73WDLAPXHXWG5V5WFIJDTM5RUJQYP6MLQ, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.826435742 (5h14m55.413491953s) [noise=true , address=77.90.31.13:4627 , piece_id=7MG24AD6AUVL6X66RZJ43OSAM7FLBB33KQY4ENE4Q3NR6PA63YQQ, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.826541530 (5h14m55.41359777s) [noise=true , address=45.91.116.5:4299 , piece_id=XY3RW62XNQVLM6NTAZTBF26HWTY5KR3ZEJGVYTSTENY2B77YLBMA, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.826653037 (5h14m55.413709248s) [noise=true , address=77.90.31.14:4661 , piece_id=U3YYDMWVGG4NEV5OSK4ATJ2RNTEYCIXKH3KXY7UR3RGJXEUA25IA, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.826875332 (5h14m55.413931543s) [noise=true , address=77.90.31.10:4519 , piece_id=OQZPQPV2NUVKLMSHONEMH2HUK52KXL2E6NXXSO2J6CP7IDTRVT7Q, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.826921499 (5h14m55.41397774s) [noise=true , address=104.36.82.11:4114 , piece_id=KB2SDFXXBJDEYUHUNIO3YSANNDXVREF46SGOSWQ3YBHRR42TFD4A, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.827091606 (5h14m55.414147827s) [noise=true , address=45.91.116.4:4940 , piece_id=ETERKOUZIHEOKPCAJPSUBGXFMDLKEELCVMIW34LR7G66FBFMUNTA, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.827323819 (5h14m55.41438003s) [noise=true , address=77.90.31.17:4771 , piece_id=IYUYS3YHOD44ZF2OGKQX7JCFVW2GBU5S2TVC3FZ2M3JNF67TP4CQ, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.827393500 (5h14m55.414449742s) [noise=true , address=104.36.82.6:4875 , piece_id=B263E3OQZQDAAYHN3YIPJ4RBLTNOFNOXAZWYTVEGGVRM2YES3PBQ, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.827542938 (5h14m55.414599159s) [noise=true , address=104.36.82.7:4911 , piece_id=GLWOEWKACQVRHXQ6EY45IYR5N7VCP75FUZIYT5WRQG2VXULRUIUA, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.827778078 (5h14m55.414834318s) [noise=true , address=104.36.82.10:4077 , piece_id=LZBNWOC4E35SX6FKBLATK2QFZDUWA7CBA5RY422YHVMMKO5XDSBQ, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.827801491 (5h14m55.414857712s) [noise=true , address=104.36.82.5:4837 , piece_id=32VX7X2CPAQKJGKQYNDUF2U6GPAWZKEWYALRTRSFC6TPIQJBBXCQ, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.828365735 (5h14m55.415421976s) [noise=true , address=45.91.116.8:4048 , piece_id=XZNUB5SDPWSYVGHGMFFQZ4BZMBP2GMKF76GXWQ2MXAGT42I6I4FQ, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.828913136 (5h14m55.415969378s) [noise=true , address=104.36.82.2:4732 , piece_id=2HK2G5XCNE6UN3COUOG6V4IVCLTRVEMNNCQMV5SZLXRFTO2FJUYQ, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.934607129 (5h14m55.52166334s) [upload=5396]: Next returned nil segment Aug 7 21:41:41.934619282 (5h14m55.521675503s) [upload=5396]: Waiting for error group managing segments... Aug 7 21:41:41.945118551 (5h14m55.532174772s) [noise=true , address=45.91.116.4:4940 , piece_id=ETERKOUZIHEOKPCAJPSUBGXFMDLKEELCVMIW34LR7G66FBFMUNTA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.945901252 (5h14m55.532957473s) [noise=true , address=45.91.116.8:4048 , piece_id=XZNUB5SDPWSYVGHGMFFQZ4BZMBP2GMKF76GXWQ2MXAGT42I6I4FQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.946161258 (5h14m55.533217498s) [noise=true , address=45.91.116.5:4298 , piece_id=C3BQRSMSRSM4FJ7SWEBPHH7UKNUJWCDD5AEEBEAYN6OMCM2VRSWA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.946386648 (5h14m55.533442869s) [noise=true , address=77.90.31.12:4592 , piece_id=75OFHQZRJKZYL3QJ37T6QLDED663WXIEFAHTH2BQZLZ46PY5YPLQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.949024992 (5h14m55.536081243s) [noise=true , address=45.91.116.5:4299 , piece_id=XY3RW62XNQVLM6NTAZTBF26HWTY5KR3ZEJGVYTSTENY2B77YLBMA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.949218724 (5h14m55.536274945s) [noise=true , address=45.91.116.4:4937 , piece_id=BYNKX2DGOGITTOYV7IH73WDLAPXHXWG5V5WFIJDTM5RUJQYP6MLQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.949657033 (5h14m55.536713244s) [noise=true , address=77.90.31.13:4627 , piece_id=7MG24AD6AUVL6X66RZJ43OSAM7FLBB33KQY4ENE4Q3NR6PA63YQQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.949683371 (5h14m55.536739612s) [noise=true , address=104.36.82.2:4732 , piece_id=2HK2G5XCNE6UN3COUOG6V4IVCLTRVEMNNCQMV5SZLXRFTO2FJUYQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.950070354 (5h14m55.537126575s) [noise=true , address=104.36.82.11:4114 , piece_id=KB2SDFXXBJDEYUHUNIO3YSANNDXVREF46SGOSWQ3YBHRR42TFD4A, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.953623165 (5h14m55.540679407s) [noise=true , address=104.36.82.6:4875 , piece_id=B263E3OQZQDAAYHN3YIPJ4RBLTNOFNOXAZWYTVEGGVRM2YES3PBQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.957708261 (5h14m55.544764482s) [noise=true , address=104.36.82.5:4837 , piece_id=32VX7X2CPAQKJGKQYNDUF2U6GPAWZKEWYALRTRSFC6TPIQJBBXCQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.964243811 (5h14m55.551300021s) [noise=true , address=77.90.31.10:4519 , piece_id=OQZPQPV2NUVKLMSHONEMH2HUK52KXL2E6NXXSO2J6CP7IDTRVT7Q, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.964842018 (5h14m55.551898239s) [noise=true , address=77.90.31.14:4661 , piece_id=U3YYDMWVGG4NEV5OSK4ATJ2RNTEYCIXKH3KXY7UR3RGJXEUA25IA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.964860783 (5h14m55.551917004s) [seg_pos={0 0}, upload=5396]: Segment reached optimal threshold of 13 pieces. Aug 7 21:41:41.964962292 (5h14m55.552018503s) [noise=true , address=77.90.31.17:4771 , piece_id=IYUYS3YHOD44ZF2OGKQX7JCFVW2GBU5S2TVC3FZ2M3JNF67TP4CQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2): protocol: expected piece hash; context canceled; EOF Aug 7 21:41:41.965019739 (5h14m55.55207595s) [noise=true , address=104.36.82.10:4077 , piece_id=LZBNWOC4E35SX6FKBLATK2QFZDUWA7CBA5RY422YHVMMKO5XDSBQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Aug 7 21:41:41.965087696 (5h14m55.552143947s) [noise=true , address=104.36.82.7:4911 , piece_id=GLWOEWKACQVRHXQ6EY45IYR5N7VCP75FUZIYT5WRQG2VXULRUIUA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF Aug 7 21:41:41.965118783 (5h14m55.552175005s) [seg_pos={0 0}, upload=5396]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 21:41:41.965239138 (5h14m55.552295349s) [upload=5396]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 21:41:41.965243687 (5h14m55.552299898s) [upload=5396]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:41:46.509965896 (5h15m0.097022118s) [upload=5396]: Done uploading segments... Aug 7 21:41:46.510002955 (5h15m0.097059167s) [upload=5396]: Upload finished. err: <nil> Aug 7 21:42:01.196715658 (5h15m14.783771899s) [upload=5401]: Starting upload Aug 7 21:42:01.196842946 (5h15m14.783899187s) [upload=5401]: Done starting upload Aug 7 21:42:01.196915852 (5h15m14.783972103s) [upload=5401]: Uploading segments... Aug 7 21:42:01.197283067 (5h15m14.784339309s) [upload=5401]: Got next segment. Inline: false Aug 7 21:42:01.197355652 (5h15m14.784411984s) [upload=5401]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:42:01.197365230 (5h15m14.784421472s) [upload=5401]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 21:42:31.170606605 (5h15m44.757662826s) [upload=5401]: Next segment err: context deadline exceeded Aug 7 21:42:31.170727651 (5h15m44.757783872s) [upload=5401]: Done uploading segments... Aug 7 21:42:31.170749551 (5h15m44.757805773s) [upload=5401]: Upload finished. err: context deadline exceeded Duration:* 477.226443ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 28 out of 60 is failed (threshold=3) [.........................XX.XXXXXXXXXXXXXXXXXXXXXXXXXX......] duration: 1.748003511s FAIL (2025-08-07 21:45:53 UTC) operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.748027297s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 4 out of 60 is failed (threshold=3) [...........................X........XX...X..................] duration: 22.08336ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-07 21:45:50 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 22.10479ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 41 out of 60 is failed (threshold=3) [..............XX..XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.X..] duration: 221.164565ms FAIL (2025-08-07 21:45:42 UTC) operation: Commit uplink: metaclient: context deadline exceeded Duration: 221.189572ms core uplink us1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 4 out of 60 is failed (threshold=3) [............................X........XX...X.................] duration: 25.509459ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-07 21:45:33 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 25.532893ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 28 out of 60 is failed (threshold=3) [..........................XX.XXXXXXXXXXXXXXXXXXXXXXXXXX.....] duration: 1.94804689s FAIL (2025-08-07 21:45:31 UTC) operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.948109717s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 31 out of 60 is failed (threshold=3) [.........................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX....] duration: 1.852886409s FAIL (2025-08-07 21:45:30 UTC) operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 1.852916105s core uplink us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 3 out of 60 is failed (threshold=3) [..........................................X...X...X.........] duration: 128.951034ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-07 21:45:23 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": context deadline exceeded Duration: 129.007721ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 35 out of 60 is failed (threshold=3) [....................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX..X...] duration: 566.735976ms FAIL (2025-08-07 21:45:20 UTC) operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== 7 (5h14m28.062269058s) [upload=5388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:41:25.266685321 (5h14m38.853741562s) [upload=5388]: Done uploading segments... Aug 7 21:41:25.266706391 (5h14m38.853762631s) [upload=5388]: Upload finished. err: <nil> Aug 7 21:41:41.070176076 (5h14m54.657232316s) [upload=5396]: Starting upload Aug 7 21:41:41.070246557 (5h14m54.657302798s) [upload=5396]: Done starting upload Aug 7 21:41:41.070459143 (5h14m54.657515385s) [upload=5396]: Uploading segments... Aug 7 21:41:41.070697238 (5h14m54.657753479s) [upload=5396]: Got next segment. Inline: false Aug 7 21:41:41.070732264 (5h14m54.657788505s) [upload=5396]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:41:41.070737293 (5h14m54.657793524s) [upload=5396]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 21:41:41.825834701 (5h14m55.412890922s) [seg_pos={0 0}, upload=5396]: Begin upload segment... Aug 7 21:41:41.825865027 (5h14m55.412921237s) [seg_pos={0 0}, upload=5396]: Done begin upload segment. Aug 7 21:41:41.825886015 (5h14m55.412942237s) [noise=true , address=77.90.31.12:4592 , piece_id=75OFHQZRJKZYL3QJ37T6QLDED663WXIEFAHTH2BQZLZ46PY5YPLQ, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.825988818 (5h14m55.413045068s) [noise=true , address=45.91.116.5:4298 , piece_id=C3BQRSMSRSM4FJ7SWEBPHH7UKNUJWCDD5AEEBEAYN6OMCM2VRSWA, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.826203979 (5h14m55.413260201s) [noise=true , address=45.91.116.4:4937 , piece_id=BYNKX2DGOGITTOYV7IH73WDLAPXHXWG5V5WFIJDTM5RUJQYP6MLQ, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.826435742 (5h14m55.413491953s) [noise=true , address=77.90.31.13:4627 , piece_id=7MG24AD6AUVL6X66RZJ43OSAM7FLBB33KQY4ENE4Q3NR6PA63YQQ, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.826541530 (5h14m55.41359777s) [noise=true , address=45.91.116.5:4299 , piece_id=XY3RW62XNQVLM6NTAZTBF26HWTY5KR3ZEJGVYTSTENY2B77YLBMA, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.826653037 (5h14m55.413709248s) [noise=true , address=77.90.31.14:4661 , piece_id=U3YYDMWVGG4NEV5OSK4ATJ2RNTEYCIXKH3KXY7UR3RGJXEUA25IA, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.826875332 (5h14m55.413931543s) [noise=true , address=77.90.31.10:4519 , piece_id=OQZPQPV2NUVKLMSHONEMH2HUK52KXL2E6NXXSO2J6CP7IDTRVT7Q, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.826921499 (5h14m55.41397774s) [noise=true , address=104.36.82.11:4114 , piece_id=KB2SDFXXBJDEYUHUNIO3YSANNDXVREF46SGOSWQ3YBHRR42TFD4A, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.827091606 (5h14m55.414147827s) [noise=true , address=45.91.116.4:4940 , piece_id=ETERKOUZIHEOKPCAJPSUBGXFMDLKEELCVMIW34LR7G66FBFMUNTA, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.827323819 (5h14m55.41438003s) [noise=true , address=77.90.31.17:4771 , piece_id=IYUYS3YHOD44ZF2OGKQX7JCFVW2GBU5S2TVC3FZ2M3JNF67TP4CQ, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.827393500 (5h14m55.414449742s) [noise=true , address=104.36.82.6:4875 , piece_id=B263E3OQZQDAAYHN3YIPJ4RBLTNOFNOXAZWYTVEGGVRM2YES3PBQ, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.827542938 (5h14m55.414599159s) [noise=true , address=104.36.82.7:4911 , piece_id=GLWOEWKACQVRHXQ6EY45IYR5N7VCP75FUZIYT5WRQG2VXULRUIUA, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.827778078 (5h14m55.414834318s) [noise=true , address=104.36.82.10:4077 , piece_id=LZBNWOC4E35SX6FKBLATK2QFZDUWA7CBA5RY422YHVMMKO5XDSBQ, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.827801491 (5h14m55.414857712s) [noise=true , address=104.36.82.5:4837 , piece_id=32VX7X2CPAQKJGKQYNDUF2U6GPAWZKEWYALRTRSFC6TPIQJBBXCQ, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.828365735 (5h14m55.415421976s) [noise=true , address=45.91.116.8:4048 , piece_id=XZNUB5SDPWSYVGHGMFFQZ4BZMBP2GMKF76GXWQ2MXAGT42I6I4FQ, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.828913136 (5h14m55.415969378s) [noise=true , address=104.36.82.2:4732 , piece_id=2HK2G5XCNE6UN3COUOG6V4IVCLTRVEMNNCQMV5SZLXRFTO2FJUYQ, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.934607129 (5h14m55.52166334s) [upload=5396]: Next returned nil segment Aug 7 21:41:41.934619282 (5h14m55.521675503s) [upload=5396]: Waiting for error group managing segments... Aug 7 21:41:41.945118551 (5h14m55.532174772s) [noise=true , address=45.91.116.4:4940 , piece_id=ETERKOUZIHEOKPCAJPSUBGXFMDLKEELCVMIW34LR7G66FBFMUNTA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.945901252 (5h14m55.532957473s) [noise=true , address=45.91.116.8:4048 , piece_id=XZNUB5SDPWSYVGHGMFFQZ4BZMBP2GMKF76GXWQ2MXAGT42I6I4FQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.946161258 (5h14m55.533217498s) [noise=true , address=45.91.116.5:4298 , piece_id=C3BQRSMSRSM4FJ7SWEBPHH7UKNUJWCDD5AEEBEAYN6OMCM2VRSWA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.946386648 (5h14m55.533442869s) [noise=true , address=77.90.31.12:4592 , piece_id=75OFHQZRJKZYL3QJ37T6QLDED663WXIEFAHTH2BQZLZ46PY5YPLQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.949024992 (5h14m55.536081243s) [noise=true , address=45.91.116.5:4299 , piece_id=XY3RW62XNQVLM6NTAZTBF26HWTY5KR3ZEJGVYTSTENY2B77YLBMA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.949218724 (5h14m55.536274945s) [noise=true , address=45.91.116.4:4937 , piece_id=BYNKX2DGOGITTOYV7IH73WDLAPXHXWG5V5WFIJDTM5RUJQYP6MLQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.949657033 (5h14m55.536713244s) [noise=true , address=77.90.31.13:4627 , piece_id=7MG24AD6AUVL6X66RZJ43OSAM7FLBB33KQY4ENE4Q3NR6PA63YQQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.949683371 (5h14m55.536739612s) [noise=true , address=104.36.82.2:4732 , piece_id=2HK2G5XCNE6UN3COUOG6V4IVCLTRVEMNNCQMV5SZLXRFTO2FJUYQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.950070354 (5h14m55.537126575s) [noise=true , address=104.36.82.11:4114 , piece_id=KB2SDFXXBJDEYUHUNIO3YSANNDXVREF46SGOSWQ3YBHRR42TFD4A, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.953623165 (5h14m55.540679407s) [noise=true , address=104.36.82.6:4875 , piece_id=B263E3OQZQDAAYHN3YIPJ4RBLTNOFNOXAZWYTVEGGVRM2YES3PBQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.957708261 (5h14m55.544764482s) [noise=true , address=104.36.82.5:4837 , piece_id=32VX7X2CPAQKJGKQYNDUF2U6GPAWZKEWYALRTRSFC6TPIQJBBXCQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.964243811 (5h14m55.551300021s) [noise=true , address=77.90.31.10:4519 , piece_id=OQZPQPV2NUVKLMSHONEMH2HUK52KXL2E6NXXSO2J6CP7IDTRVT7Q, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.964842018 (5h14m55.551898239s) [noise=true , address=77.90.31.14:4661 , piece_id=U3YYDMWVGG4NEV5OSK4ATJ2RNTEYCIXKH3KXY7UR3RGJXEUA25IA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.964860783 (5h14m55.551917004s) [seg_pos={0 0}, upload=5396]: Segment reached optimal threshold of 13 pieces. Aug 7 21:41:41.964962292 (5h14m55.552018503s) [noise=true , address=77.90.31.17:4771 , piece_id=IYUYS3YHOD44ZF2OGKQX7JCFVW2GBU5S2TVC3FZ2M3JNF67TP4CQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2): protocol: expected piece hash; context canceled; EOF Aug 7 21:41:41.965019739 (5h14m55.55207595s) [noise=true , address=104.36.82.10:4077 , piece_id=LZBNWOC4E35SX6FKBLATK2QFZDUWA7CBA5RY422YHVMMKO5XDSBQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Aug 7 21:41:41.965087696 (5h14m55.552143947s) [noise=true , address=104.36.82.7:4911 , piece_id=GLWOEWKACQVRHXQ6EY45IYR5N7VCP75FUZIYT5WRQG2VXULRUIUA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF Aug 7 21:41:41.965118783 (5h14m55.552175005s) [seg_pos={0 0}, upload=5396]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 21:41:41.965239138 (5h14m55.552295349s) [upload=5396]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 21:41:41.965243687 (5h14m55.552299898s) [upload=5396]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:41:46.509965896 (5h15m0.097022118s) [upload=5396]: Done uploading segments... Aug 7 21:41:46.510002955 (5h15m0.097059167s) [upload=5396]: Upload finished. err: <nil> Aug 7 21:42:01.196715658 (5h15m14.783771899s) [upload=5401]: Starting upload Aug 7 21:42:01.196842946 (5h15m14.783899187s) [upload=5401]: Done starting upload Aug 7 21:42:01.196915852 (5h15m14.783972103s) [upload=5401]: Uploading segments... Aug 7 21:42:01.197283067 (5h15m14.784339309s) [upload=5401]: Got next segment. Inline: false Aug 7 21:42:01.197355652 (5h15m14.784411984s) [upload=5401]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:42:01.197365230 (5h15m14.784421472s) [upload=5401]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 21:42:31.170606605 (5h15m44.757662826s) [upload=5401]: Next segment err: context deadline exceeded Aug 7 21:42:31.170727651 (5h15m44.757783872s) [upload=5401]: Done uploading segments... Aug 7 21:42:31.170749551 (5h15m44.757805773s) [upload=5401]: Upload finished. err: context deadline exceeded Duration:* 566.757385ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 42 out of 60 is failed (threshold=3) [.................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXX] duration: 30.001642925s FAIL (2025-08-07 21:45:20 UTC) operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== shed. err: metaclient: context deadline exceeded Aug 7 21:37:24.787968674 (5h10m38.375024885s) [upload=5327]: Starting upload Aug 7 21:37:24.788026372 (5h10m38.375082583s) [upload=5327]: Done starting upload Aug 7 21:37:24.788072297 (5h10m38.375128518s) [upload=5327]: Uploading segments... Aug 7 21:37:24.788129475 (5h10m38.375185696s) [upload=5327]: Got next segment. Inline: true Aug 7 21:37:24.788133472 (5h10m38.375189694s) [upload=5327]: Waiting for error group managing segments... Aug 7 21:37:24.788169800 (5h10m38.375226021s) [upload=5327]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:37:24.788173967 (5h10m38.375230188s) [upload=5327]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:37:24.788176171 (5h10m38.375232382s) [upload=5327]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:37:54.773685524 (5h11m8.360741775s) [upload=5327]: Done uploading segments... Aug 7 21:37:54.773706774 (5h11m8.360763025s) [upload=5327]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:37:56.437147115 (5h11m10.024203357s) [upload=5336]: Starting upload Aug 7 21:37:56.437251630 (5h11m10.024307872s) [upload=5336]: Done starting upload Aug 7 21:37:56.437342400 (5h11m10.024398641s) [upload=5336]: Uploading segments... Aug 7 21:37:56.437415256 (5h11m10.024471508s) [upload=5336]: Got next segment. Inline: true Aug 7 21:37:56.437425486 (5h11m10.024481767s) [upload=5336]: Waiting for error group managing segments... Aug 7 21:37:56.437531414 (5h11m10.024587665s) [upload=5336]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:37:56.437544558 (5h11m10.02460085s) [upload=5336]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:37:56.437551260 (5h11m10.024607511s) [upload=5336]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:38:26.422314839 (5h11m40.009371081s) [upload=5336]: Done uploading segments... Aug 7 21:38:26.422335869 (5h11m40.00939211s) [upload=5336]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:38:26.513648977 (5h11m40.100705218s) [upload=5344]: Starting upload Aug 7 21:38:26.513731310 (5h11m40.100787552s) [upload=5344]: Done starting upload Aug 7 21:38:26.513792245 (5h11m40.100848496s) [upload=5344]: Uploading segments... Aug 7 21:38:26.513834112 (5h11m40.100890354s) [upload=5344]: Got next segment. Inline: true Aug 7 21:38:26.513839653 (5h11m40.100895904s) [upload=5344]: Waiting for error group managing segments... Aug 7 21:38:26.513884006 (5h11m40.100940247s) [upload=5344]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:38:26.513889947 (5h11m40.100946188s) [upload=5344]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:38:26.513893434 (5h11m40.100949675s) [upload=5344]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:38:56.502052245 (5h12m10.089108537s) [upload=5344]: Done uploading segments... Aug 7 21:38:56.502102730 (5h12m10.089158972s) [upload=5344]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:39:24.008006172 (5h12m37.595062394s) [upload=5359]: Starting upload Aug 7 21:39:24.008059211 (5h12m37.595115422s) [upload=5359]: Done starting upload Aug 7 21:39:24.008103604 (5h12m37.595159835s) [upload=5359]: Uploading segments... Aug 7 21:39:24.008156191 (5h12m37.595212413s) [upload=5359]: Got next segment. Inline: true Aug 7 21:39:24.008162193 (5h12m37.595218414s) [upload=5359]: Waiting for error group managing segments... Aug 7 21:39:24.008207327 (5h12m37.595263548s) [upload=5359]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:39:24.008212668 (5h12m37.595268878s) [upload=5359]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:39:24.008216064 (5h12m37.595272285s) [upload=5359]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:39:53.997226503 (5h13m7.584282744s) [upload=5359]: Done uploading segments... Aug 7 21:39:53.997270334 (5h13m7.584326586s) [upload=5359]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:40:36.779619947 (5h13m50.366676188s) [upload=5383]: Starting upload Aug 7 21:40:36.779696139 (5h13m50.36675238s) [upload=5383]: Done starting upload Aug 7 21:40:36.779752775 (5h13m50.366809016s) [upload=5383]: Uploading segments... Aug 7 21:40:36.779788803 (5h13m50.366845044s) [upload=5383]: Got next segment. Inline: true Aug 7 21:40:36.779794423 (5h13m50.366850655s) [upload=5383]: Waiting for error group managing segments... Aug 7 21:40:36.779835950 (5h13m50.366892191s) [upload=5383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:40:36.779841010 (5h13m50.366897241s) [upload=5383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:40:36.779844195 (5h13m50.366900437s) [upload=5383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:41:06.765292852 (5h14m20.352349064s) [upload=5383]: Done uploading segments... Aug 7 21:41:06.765314052 (5h14m20.352370273s) [upload=5383]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:41:47.961322510 (5h15m1.548378802s) [upload=5399]: Starting upload Aug 7 21:41:47.961442915 (5h15m1.548499166s) [upload=5399]: Done starting upload Aug 7 21:41:47.961510201 (5h15m1.548566443s) [upload=5399]: Uploading segments... Aug 7 21:41:47.961591062 (5h15m1.548647313s) [upload=5399]: Got next segment. Inline: true Aug 7 21:41:47.961599218 (5h15m1.548655458s) [upload=5399]: Waiting for error group managing segments... Aug 7 21:41:47.961647759 (5h15m1.548703999s) [upload=5399]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:41:47.961653760 (5h15m1.548710001s) [upload=5399]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:41:47.961657546 (5h15m1.548713787s) [upload=5399]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:42:17.948677724 (5h15m31.535733945s) [upload=5399]: Done uploading segments... Aug 7 21:42:17.948691099 (5h15m31.53574731s) [upload=5399]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:42:18.081006705 (5h15m31.668062915s) [upload=5405]: Starting upload Aug 7 21:42:18.081065655 (5h15m31.668121866s) [upload=5405]: Done starting upload Aug 7 21:42:18.081113425 (5h15m31.668169635s) [upload=5405]: Uploading segments... Aug 7 21:42:18.081164870 (5h15m31.668221091s) [upload=5405]: Got next segment. Inline: true Aug 7 21:42:18.081169459 (5h15m31.66822568s) [upload=5405]: Waiting for error group managing segments... Aug 7 21:42:18.081201809 (5h15m31.66825803s) [upload=5405]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:42:18.081205546 (5h15m31.668261757s) [upload=5405]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:42:18.081208271 (5h15m31.668264483s) [upload=5405]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:42:18.161269758 (5h15m31.748325999s) [upload=5405]: Done uploading segments... Aug 7 21:42:18.161287411 (5h15m31.748343652s) [upload=5405]: Upload finished. err: <nil> Aug 7 21:43:12.878567983 (5h16m26.465624204s) [upload=5420]: Starting upload Aug 7 21:43:12.878678820 (5h16m26.465735041s) [upload=5420]: Done starting upload Aug 7 21:43:12.878731839 (5h16m26.46578806s) [upload=5420]: Uploading segments... Aug 7 21:43:12.878762908 (5h16m26.465819129s) [upload=5420]: Got next segment. Inline: true Aug 7 21:43:12.878766635 (5h16m26.465822856s) [upload=5420]: Waiting for error group managing segments... Aug 7 21:43:12.878799204 (5h16m26.465855425s) [upload=5420]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:43:12.878803332 (5h16m26.465859543s) [upload=5420]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:43:12.878805566 (5h16m26.465861787s) [upload=5420]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:43:42.863779226 (5h16m56.450835478s) [upload=5420]: Done uploading segments... Aug 7 21:43:42.863802450 (5h16m56.450858691s) [upload=5420]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:43:51.464096058 (5h17m5.051152299s) [upload=5431]: Starting upload Aug 7 21:43:51.464210432 (5h17m5.051266673s) [upload=5431]: Done starting upload Aug 7 21:43:51.464274041 (5h17m5.051330282s) [upload=5431]: Uploading segments... Aug 7 21:43:51.464330065 (5h17m5.051386366s) [upload=5431]: Got next segment. Inline: true Aug 7 21:43:51.464343630 (5h17m5.051399912s) [upload=5431]: Waiting for error group managing segments... Aug 7 21:43:51.464415315 (5h17m5.051471556s) [upload=5431]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:43:51.464424673 (5h17m5.051480923s) [upload=5431]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:43:51.464431204 (5h17m5.051487455s) [upload=5431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:44:21.448488824 (5h17m35.035545036s) [upload=5431]: Done uploading segments... Aug 7 21:44:21.448528209 (5h17m35.03558443s) [upload=5431]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:44:50.396194570 (5h18m3.983250782s) [upload=5444]: Starting upload Aug 7 21:44:50.396243653 (5h18m3.983299864s) [upload=5444]: Done starting upload Aug 7 21:44:50.396286463 (5h18m3.983342684s) [upload=5444]: Uploading segments... Aug 7 21:44:50.396309054 (5h18m3.983365266s) [upload=5444]: Got next segment. Inline: true Aug 7 21:44:50.396312381 (5h18m3.983368592s) [upload=5444]: Waiting for error group managing segments... Aug 7 21:44:50.396342687 (5h18m3.983398908s) [upload=5444]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:44:50.396346635 (5h18m3.983402856s) [upload=5444]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:44:50.396348889 (5h18m3.98340511s) [upload=5444]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:45:20.384461417 (5h18m33.971517668s) [upload=5444]: Done uploading segments... Aug 7 21:45:20.384482547 (5h18m33.971538788s) [upload=5444]: Upload finished. err: metaclient: context deadline exceeded Duration: 30.001687658s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 37 out of 60 is failed (threshold=3) [.................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XX.....] duration: 608.292255ms FAIL (2025-08-07 21:45:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 608.306432ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 38 out of 60 is failed (threshold=3) [..................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX...X.] duration: 357.436567ms FAIL (2025-08-07 21:45:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 357.451986ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 19 out of 60 is failed (threshold=3) [....................................XXXXXXXXXXXXXXXXX.XX....] duration: 1.105832403s FAIL (2025-08-07 21:45:17 UTC) operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== address=104.36.82.12:4172 , piece_id=2SN23SJESN46DLA25WJULJLVGE7QWLQW2QJFAUA3WUVICJ5CKLUA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.023027314 (5h13m59.610083535s) [noise=true , address=104.36.82.54:4183 , piece_id=ZOCQQFJKFATMPRR2PKHLTSWN2D3QXAMZ74K2A5KTKYQAHEGA2BUA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.023255801 (5h13m59.610312012s) [noise=true , address=104.36.82.37:4663 , piece_id=XOIJUGNOKJJVWQ4226IL67H73DVYH7VBSIKI4BQSMOIGYNY7MO7A, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.023462957 (5h13m59.610519169s) [noise=true , address=104.36.82.60:4367 , piece_id=IRTAFXB5WIGLKZE4HQE7UW7J5OSZSIQK7TGY447RFZD7FCIAYQVQ, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.023666096 (5h13m59.610722308s) [noise=true , address=64.49.13.140:4511 , piece_id=A7AQ3VPKYONSOWW2YUPGWAXTMA4JPGBG4CQVYCK6PFFIFFUGPMHA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.023880075 (5h13m59.610936287s) [noise=true , address=104.36.82.23:4474 , piece_id=TDLXCBP5IPHILGHJYQD4DXYRMLL2VS2ER3ECEBAXOBTUAMR67BBA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.024106408 (5h13m59.611162629s) [noise=true , address=104.36.82.58:4269 , piece_id=4I2ROAYRNHMC53OKVWWXCS4FULL2XZ6CG5WZUPOLQ4UNELQDHHOA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.024332290 (5h13m59.611388511s) [noise=true , address=104.36.82.16:4305 , piece_id=K5YI7X35EAPFSOANSPQERKCHUOO6GDZZWKAOFNYGM6R3PA6K2LWA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.024539145 (5h13m59.611595357s) [noise=true , address=104.36.82.36:4623 , piece_id=ONIDD2KMXGVLKCD5YFBVUMMF2ORGVLFDV4LG3TRKRSINURIDAAFA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.024749439 (5h13m59.61180566s) [noise=true , address=104.36.82.43:4850 , piece_id=XWPXP7HKO2ZH22MMIODDLHM3LPIIPQP3Y3FLZ54XMMWOIN7JIADA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.024973778 (5h13m59.612029999s) [noise=true , address=45.91.116.9:4266 , piece_id=VOPNPD4GIHS2VOYBWCCTR7LX3YKL4BCZLW4XMROMAWU4WYUJ52WA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.025220337 (5h13m59.612276558s) [noise=true , address=104.36.82.15:4275 , piece_id=HCH5IC5PTQ7NCSWPJJC5OOEPEIMA34ZL6E5QPQPCDB2P2FEO6JYA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.105422677 (5h13m59.692478898s) [upload=5382]: Next returned nil segment Aug 7 21:40:46.105438417 (5h13m59.692494638s) [upload=5382]: Waiting for error group managing segments... Aug 7 21:40:46.115255601 (5h13m59.702311812s) [noise=true , address=45.91.116.9:4266 , piece_id=VOPNPD4GIHS2VOYBWCCTR7LX3YKL4BCZLW4XMROMAWU4WYUJ52WA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.123052245 (5h13m59.710108455s) [noise=true , address=104.36.82.16:4305 , piece_id=K5YI7X35EAPFSOANSPQERKCHUOO6GDZZWKAOFNYGM6R3PA6K2LWA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.123065018 (5h13m59.710121239s) [noise=true , address=104.36.82.37:4663 , piece_id=XOIJUGNOKJJVWQ4226IL67H73DVYH7VBSIKI4BQSMOIGYNY7MO7A, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.135955971 (5h13m59.723012192s) [noise=true , address=104.36.82.58:4269 , piece_id=4I2ROAYRNHMC53OKVWWXCS4FULL2XZ6CG5WZUPOLQ4UNELQDHHOA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.139757077 (5h13m59.726813288s) [noise=true , address=104.36.82.44:4891 , piece_id=D33W4EHVQ26LIOJ2KG5RKUHRZSGXAIGS2PQSIURYKGMP63RBTBGA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.148928486 (5h13m59.735984697s) [noise=true , address=104.36.82.15:4275 , piece_id=HCH5IC5PTQ7NCSWPJJC5OOEPEIMA34ZL6E5QPQPCDB2P2FEO6JYA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.149227595 (5h13m59.736283816s) [noise=true , address=104.36.82.36:4623 , piece_id=ONIDD2KMXGVLKCD5YFBVUMMF2ORGVLFDV4LG3TRKRSINURIDAAFA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.157435446 (5h13m59.744491657s) [noise=true , address=104.36.82.54:4183 , piece_id=ZOCQQFJKFATMPRR2PKHLTSWN2D3QXAMZ74K2A5KTKYQAHEGA2BUA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.193659694 (5h13m59.780715905s) [noise=true , address=104.36.82.60:4367 , piece_id=IRTAFXB5WIGLKZE4HQE7UW7J5OSZSIQK7TGY447RFZD7FCIAYQVQ, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.198544171 (5h13m59.785600382s) [noise=true , address=104.36.82.12:4172 , piece_id=2SN23SJESN46DLA25WJULJLVGE7QWLQW2QJFAUA3WUVICJ5CKLUA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.200016058 (5h13m59.787072279s) [noise=true , address=104.36.82.14:4228 , piece_id=USWUBYJMTZKFFN3DZIKQQD7PW6QAKBRUHJZRCBO4DXTHR2PQDHRQ, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.224817695 (5h13m59.811873916s) [noise=true , address=104.36.82.43:4850 , piece_id=XWPXP7HKO2ZH22MMIODDLHM3LPIIPQP3Y3FLZ54XMMWOIN7JIADA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.225279788 (5h13m59.812336009s) [noise=true , address=104.36.82.61:4383 , piece_id=ELAHQPPPJCCLCQYXDEOS62V6TOMV5NOCMUU5XZFCQ23Y6SQUWG6Q, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.305784060 (5h13m59.892840282s) [noise=true , address=104.36.82.43:4863 , piece_id=PWAZUY75NQILRAVGRSMJSFKPOPLR3WQ5O3Q47GZ5U37KXPXJ3ORQ, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.305806102 (5h13m59.892862323s) [seg_pos={0 0}, upload=5382]: Segment reached optimal threshold of 14 pieces. Aug 7 21:40:46.305952956 (5h13m59.893009177s) [noise=true , address=104.36.82.56:4261 , piece_id=Z27LNZSXSYSUMQXEW2DI3C54ZJK26ALV653EINMYNU6COTMAMPBA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YNKaVEsXzHe6XGQuv6wR1qqbv6dbzg1xT5Aqkew2ZV3z3tMMf): protocol: expected piece hash; context canceled; EOF Aug 7 21:40:46.306110209 (5h13m59.89316642s) [noise=true , address=64.49.13.139:4471 , piece_id=2OSYONIOJUEZXMYFSTL7NRN7HG6KXJOHFUL7TIDW73C4VKYF3W3A, seg_pos={0 0}, upload=5382]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:26750->64.49.13.139:4471: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 21:40:46.306163639 (5h13m59.89321985s) [noise=true , address=104.36.82.23:4474 , piece_id=TDLXCBP5IPHILGHJYQD4DXYRMLL2VS2ER3ECEBAXOBTUAMR67BBA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: write tcp 5.161.89.252:22402->104.36.82.23:4474: use of closed network connection; write tcp 5.161.89.252:22402->104.36.82.23:4474: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:22402->104.36.82.23:4474: use of closed network connection Aug 7 21:40:46.306206098 (5h13m59.893262319s) [noise=true , address=64.49.13.140:4511 , piece_id=A7AQ3VPKYONSOWW2YUPGWAXTMA4JPGBG4CQVYCK6PFFIFFUGPMHA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: read tcp 5.161.89.252:31920->64.49.13.140:4511: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 21:40:46.306226506 (5h13m59.893282717s) [seg_pos={0 0}, upload=5382]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 21:40:46.306282762 (5h13m59.893338983s) [upload=5382]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 21:40:46.306286799 (5h13m59.89334301s) [upload=5382]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:40:57.774588980 (5h14m11.361645201s) [upload=5382]: Done uploading segments... Aug 7 21:40:57.774603057 (5h14m11.361659278s) [upload=5382]: Upload finished. err: <nil> Aug 7 21:41:10.210507562 (5h14m23.797563803s) [upload=5386]: Starting upload Aug 7 21:41:10.210589415 (5h14m23.797645655s) [upload=5386]: Done starting upload Aug 7 21:41:10.210669645 (5h14m23.797725856s) [upload=5386]: Uploading segments... Aug 7 21:41:10.210963293 (5h14m23.798019534s) [upload=5386]: Got next segment. Inline: false Aug 7 21:41:10.211025149 (5h14m23.79808139s) [upload=5386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:41:10.211035066 (5h14m23.798091308s) [upload=5386]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 21:42:10.197934627 (5h15m23.784990848s) [upload=5386]: Next segment err: context deadline exceeded Aug 7 21:42:10.198070280 (5h15m23.785126501s) [upload=5386]: Done uploading segments... Aug 7 21:42:10.198139409 (5h15m23.78519562s) [upload=5386]: Upload finished. err: context deadline exceeded Aug 7 21:42:14.127516635 (5h15m27.714572846s) [upload=5403]: Starting upload Aug 7 21:42:14.127582357 (5h15m27.714638569s) [upload=5403]: Done starting upload Aug 7 21:42:14.127692983 (5h15m27.714749204s) [upload=5403]: Uploading segments... Aug 7 21:42:14.127793461 (5h15m27.714849672s) [upload=5403]: Got next segment. Inline: false Aug 7 21:42:14.127840750 (5h15m27.714896961s) [upload=5403]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:42:14.127846281 (5h15m27.714902491s) [upload=5403]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 21:43:14.115648400 (5h16m27.702704611s) [upload=5403]: Next segment err: context deadline exceeded Aug 7 21:43:14.115816064 (5h16m27.702872275s) [upload=5403]: Done uploading segments... Aug 7 21:43:14.115831182 (5h16m27.702887403s) [upload=5403]: Upload finished. err: context deadline exceeded Duration: 1.105853113s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 29 out of 60 is failed (threshold=3) [.............................XXXXXXXXXXXXXXXXXXXXXXXXXXXX.X.] duration: 237.037794ms FAIL (2025-08-07 21:45:13 UTC) operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== oad=5272]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:35:15.032246862 (5h8m28.619303102s) [upload=5292]: Starting upload Aug 7 21:35:15.032327261 (5h8m28.619383502s) [upload=5292]: Done starting upload Aug 7 21:35:15.032391071 (5h8m28.619447312s) [upload=5292]: Uploading segments... Aug 7 21:35:15.032434000 (5h8m28.619490242s) [upload=5292]: Got next segment. Inline: true Aug 7 21:35:15.032439461 (5h8m28.619495711s) [upload=5292]: Waiting for error group managing segments... Aug 7 21:35:15.032484926 (5h8m28.619541167s) [upload=5292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:35:15.032491267 (5h8m28.619547509s) [upload=5292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:35:15.032494834 (5h8m28.619551085s) [upload=5292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:36:15.017690007 (5h9m28.604746248s) [upload=5292]: Done uploading segments... Aug 7 21:36:15.017709373 (5h9m28.604765615s) [upload=5292]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:36:15.108542356 (5h9m28.695598567s) [upload=5309]: Starting upload Aug 7 21:36:15.108597850 (5h9m28.695654061s) [upload=5309]: Done starting upload Aug 7 21:36:15.108645098 (5h9m28.695701319s) [upload=5309]: Uploading segments... Aug 7 21:36:15.108673942 (5h9m28.695730153s) [upload=5309]: Got next segment. Inline: true Aug 7 21:36:15.108677278 (5h9m28.695733499s) [upload=5309]: Waiting for error group managing segments... Aug 7 21:36:15.108708507 (5h9m28.695764728s) [upload=5309]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:36:15.108712334 (5h9m28.695768555s) [upload=5309]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:36:15.108714538 (5h9m28.695770759s) [upload=5309]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:37:15.091220957 (5h10m28.678277188s) [upload=5309]: Done uploading segments... Aug 7 21:37:15.091240674 (5h10m28.678296905s) [upload=5309]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:37:15.177436931 (5h10m28.764493172s) [upload=5324]: Starting upload Aug 7 21:37:15.177533852 (5h10m28.764590103s) [upload=5324]: Done starting upload Aug 7 21:37:15.177602810 (5h10m28.764659061s) [upload=5324]: Uploading segments... Aug 7 21:37:15.177645340 (5h10m28.764701581s) [upload=5324]: Got next segment. Inline: true Aug 7 21:37:15.177650961 (5h10m28.764707202s) [upload=5324]: Waiting for error group managing segments... Aug 7 21:37:15.177698649 (5h10m28.76475489s) [upload=5324]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:37:15.177704300 (5h10m28.764760541s) [upload=5324]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:37:15.177708177 (5h10m28.764764428s) [upload=5324]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:37:40.730185715 (5h10m54.317241957s) [upload=5324]: Done uploading segments... Aug 7 21:37:40.730203639 (5h10m54.31725988s) [upload=5324]: Upload finished. err: <nil> Aug 7 21:38:15.287715124 (5h11m28.874771365s) [upload=5341]: Starting upload Aug 7 21:38:15.287780276 (5h11m28.874836516s) [upload=5341]: Done starting upload Aug 7 21:38:15.287844856 (5h11m28.874901107s) [upload=5341]: Uploading segments... Aug 7 21:38:15.287889961 (5h11m28.874946201s) [upload=5341]: Got next segment. Inline: true Aug 7 21:38:15.287895600 (5h11m28.874951842s) [upload=5341]: Waiting for error group managing segments... Aug 7 21:38:15.287984066 (5h11m28.875040317s) [upload=5341]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:38:15.287990077 (5h11m28.875046318s) [upload=5341]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:38:15.287993564 (5h11m28.875049804s) [upload=5341]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:39:15.275679218 (5h12m28.862735459s) [upload=5341]: Done uploading segments... Aug 7 21:39:15.275708622 (5h12m28.862764883s) [upload=5341]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:39:15.358605080 (5h12m28.945661322s) [upload=5358]: Starting upload Aug 7 21:39:15.358690641 (5h12m28.945746882s) [upload=5358]: Done starting upload Aug 7 21:39:15.358748869 (5h12m28.945805111s) [upload=5358]: Uploading segments... Aug 7 21:39:15.358790938 (5h12m28.94584718s) [upload=5358]: Got next segment. Inline: true Aug 7 21:39:15.358796779 (5h12m28.94585302s) [upload=5358]: Waiting for error group managing segments... Aug 7 21:39:15.358840480 (5h12m28.945896721s) [upload=5358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:39:15.358846441 (5h12m28.945902683s) [upload=5358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:39:15.358849918 (5h12m28.945906159s) [upload=5358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:40:15.344303433 (5h13m28.931359654s) [upload=5358]: Done uploading segments... Aug 7 21:40:15.344323120 (5h13m28.931379331s) [upload=5358]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:40:15.438334176 (5h13m29.025390397s) [upload=5373]: Starting upload Aug 7 21:40:15.438379379 (5h13m29.025435601s) [upload=5373]: Done starting upload Aug 7 21:40:15.438418503 (5h13m29.025474714s) [upload=5373]: Uploading segments... Aug 7 21:40:15.438447206 (5h13m29.025503427s) [upload=5373]: Got next segment. Inline: true Aug 7 21:40:15.438450683 (5h13m29.025506894s) [upload=5373]: Waiting for error group managing segments... Aug 7 21:40:15.438481920 (5h13m29.025538141s) [upload=5373]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:40:15.438487511 (5h13m29.025543722s) [upload=5373]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:40:15.438489826 (5h13m29.025546047s) [upload=5373]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:41:15.423387101 (5h14m29.010443342s) [upload=5373]: Done uploading segments... Aug 7 21:41:15.423408011 (5h14m29.010464251s) [upload=5373]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:41:15.514709386 (5h14m29.101765628s) [upload=5390]: Starting upload Aug 7 21:41:15.514790870 (5h14m29.10184711s) [upload=5390]: Done starting upload Aug 7 21:41:15.514852845 (5h14m29.101909086s) [upload=5390]: Uploading segments... Aug 7 21:41:15.514892409 (5h14m29.10194865s) [upload=5390]: Got next segment. Inline: true Aug 7 21:41:15.514898240 (5h14m29.101954481s) [upload=5390]: Waiting for error group managing segments... Aug 7 21:41:15.514941951 (5h14m29.101998192s) [upload=5390]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:41:15.514947551 (5h14m29.102003793s) [upload=5390]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:41:15.514951138 (5h14m29.102007389s) [upload=5390]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:42:15.497042181 (5h15m29.084098402s) [upload=5390]: Done uploading segments... Aug 7 21:42:15.497058301 (5h15m29.084114512s) [upload=5390]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:42:15.596278951 (5h15m29.183335172s) [upload=5404]: Starting upload Aug 7 21:42:15.596337329 (5h15m29.183393541s) [upload=5404]: Done starting upload Aug 7 21:42:15.596382114 (5h15m29.183438324s) [upload=5404]: Uploading segments... Aug 7 21:42:15.596411919 (5h15m29.18346814s) [upload=5404]: Got next segment. Inline: true Aug 7 21:42:15.596415937 (5h15m29.183472158s) [upload=5404]: Waiting for error group managing segments... Aug 7 21:42:15.596447405 (5h15m29.183503626s) [upload=5404]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:42:15.596451042 (5h15m29.183507263s) [upload=5404]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:42:15.596453266 (5h15m29.183509487s) [upload=5404]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:43:15.584735444 (5h16m29.171791655s) [upload=5404]: Done uploading segments... Aug 7 21:43:15.584747787 (5h16m29.171804008s) [upload=5404]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:43:22.691047415 (5h16m36.278103646s) [upload=5423]: Starting upload Aug 7 21:43:22.691110724 (5h16m36.278166955s) [upload=5423]: Done starting upload Aug 7 21:43:22.691177108 (5h16m36.278233338s) [upload=5423]: Uploading segments... Aug 7 21:43:22.691210019 (5h16m36.27826625s) [upload=5423]: Got next segment. Inline: true Aug 7 21:43:22.691214187 (5h16m36.278270418s) [upload=5423]: Waiting for error group managing segments... Aug 7 21:43:22.691250704 (5h16m36.278306925s) [upload=5423]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:43:22.691255263 (5h16m36.278311494s) [upload=5423]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:43:22.691258188 (5h16m36.278314419s) [upload=5423]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:43:22.751511620 (5h16m36.338567872s) [upload=5423]: Done uploading segments... Aug 7 21:43:22.751530204 (5h16m36.338586455s) [upload=5423]: Upload finished. err: <nil> Aug 7 21:44:13.185700222 (5h17m26.772756433s) [upload=5437]: Starting upload Aug 7 21:44:13.185766515 (5h17m26.772822736s) [upload=5437]: Done starting upload Aug 7 21:44:13.185811771 (5h17m26.772867981s) [upload=5437]: Uploading segments... Aug 7 21:44:13.185877192 (5h17m26.772933443s) [upload=5437]: Got next segment. Inline: true Aug 7 21:44:13.185884005 (5h17m26.772940226s) [upload=5437]: Waiting for error group managing segments... Aug 7 21:44:13.185926104 (5h17m26.772982314s) [upload=5437]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:44:13.185931043 (5h17m26.772987254s) [upload=5437]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:44:13.185934560 (5h17m26.77299077s) [upload=5437]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:45:13.172887995 (5h18m26.759944236s) [upload=5437]: Done uploading segments... Aug 7 21:45:13.172908133 (5h18m26.759964374s) [upload=5437]: Upload finished. err: metaclient: context deadline exceeded Duration: 237.054836ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 31 out of 60 is failed (threshold=3) [..........................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX...] duration: 1.925653959s FAIL (2025-08-07 21:45:05 UTC) operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 1.92568168s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 41 out of 60 is failed (threshold=3) [...............XX..XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.X.] duration: 446.491911ms FAIL (2025-08-07 21:44:59 UTC) operation: Commit uplink: metaclient: context deadline exceeded Duration: 446.542605ms core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 37 out of 60 is failed (threshold=3) [..................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XX....] duration: 453.909588ms FAIL (2025-08-07 21:44:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 453.925758ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 38 out of 60 is failed (threshold=3) [...................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX...X] duration: 30.000814136s FAIL (2025-08-07 21:44:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000901239s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 35 out of 60 is failed (threshold=3) [.....................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX..X..] duration: 15.245716888s FAIL (2025-08-07 21:44:28 UTC) operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== 7 (5h14m28.062269058s) [upload=5388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:41:25.266685321 (5h14m38.853741562s) [upload=5388]: Done uploading segments... Aug 7 21:41:25.266706391 (5h14m38.853762631s) [upload=5388]: Upload finished. err: <nil> Aug 7 21:41:41.070176076 (5h14m54.657232316s) [upload=5396]: Starting upload Aug 7 21:41:41.070246557 (5h14m54.657302798s) [upload=5396]: Done starting upload Aug 7 21:41:41.070459143 (5h14m54.657515385s) [upload=5396]: Uploading segments... Aug 7 21:41:41.070697238 (5h14m54.657753479s) [upload=5396]: Got next segment. Inline: false Aug 7 21:41:41.070732264 (5h14m54.657788505s) [upload=5396]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:41:41.070737293 (5h14m54.657793524s) [upload=5396]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 21:41:41.825834701 (5h14m55.412890922s) [seg_pos={0 0}, upload=5396]: Begin upload segment... Aug 7 21:41:41.825865027 (5h14m55.412921237s) [seg_pos={0 0}, upload=5396]: Done begin upload segment. Aug 7 21:41:41.825886015 (5h14m55.412942237s) [noise=true , address=77.90.31.12:4592 , piece_id=75OFHQZRJKZYL3QJ37T6QLDED663WXIEFAHTH2BQZLZ46PY5YPLQ, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.825988818 (5h14m55.413045068s) [noise=true , address=45.91.116.5:4298 , piece_id=C3BQRSMSRSM4FJ7SWEBPHH7UKNUJWCDD5AEEBEAYN6OMCM2VRSWA, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.826203979 (5h14m55.413260201s) [noise=true , address=45.91.116.4:4937 , piece_id=BYNKX2DGOGITTOYV7IH73WDLAPXHXWG5V5WFIJDTM5RUJQYP6MLQ, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.826435742 (5h14m55.413491953s) [noise=true , address=77.90.31.13:4627 , piece_id=7MG24AD6AUVL6X66RZJ43OSAM7FLBB33KQY4ENE4Q3NR6PA63YQQ, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.826541530 (5h14m55.41359777s) [noise=true , address=45.91.116.5:4299 , piece_id=XY3RW62XNQVLM6NTAZTBF26HWTY5KR3ZEJGVYTSTENY2B77YLBMA, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.826653037 (5h14m55.413709248s) [noise=true , address=77.90.31.14:4661 , piece_id=U3YYDMWVGG4NEV5OSK4ATJ2RNTEYCIXKH3KXY7UR3RGJXEUA25IA, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.826875332 (5h14m55.413931543s) [noise=true , address=77.90.31.10:4519 , piece_id=OQZPQPV2NUVKLMSHONEMH2HUK52KXL2E6NXXSO2J6CP7IDTRVT7Q, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.826921499 (5h14m55.41397774s) [noise=true , address=104.36.82.11:4114 , piece_id=KB2SDFXXBJDEYUHUNIO3YSANNDXVREF46SGOSWQ3YBHRR42TFD4A, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.827091606 (5h14m55.414147827s) [noise=true , address=45.91.116.4:4940 , piece_id=ETERKOUZIHEOKPCAJPSUBGXFMDLKEELCVMIW34LR7G66FBFMUNTA, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.827323819 (5h14m55.41438003s) [noise=true , address=77.90.31.17:4771 , piece_id=IYUYS3YHOD44ZF2OGKQX7JCFVW2GBU5S2TVC3FZ2M3JNF67TP4CQ, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.827393500 (5h14m55.414449742s) [noise=true , address=104.36.82.6:4875 , piece_id=B263E3OQZQDAAYHN3YIPJ4RBLTNOFNOXAZWYTVEGGVRM2YES3PBQ, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.827542938 (5h14m55.414599159s) [noise=true , address=104.36.82.7:4911 , piece_id=GLWOEWKACQVRHXQ6EY45IYR5N7VCP75FUZIYT5WRQG2VXULRUIUA, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.827778078 (5h14m55.414834318s) [noise=true , address=104.36.82.10:4077 , piece_id=LZBNWOC4E35SX6FKBLATK2QFZDUWA7CBA5RY422YHVMMKO5XDSBQ, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.827801491 (5h14m55.414857712s) [noise=true , address=104.36.82.5:4837 , piece_id=32VX7X2CPAQKJGKQYNDUF2U6GPAWZKEWYALRTRSFC6TPIQJBBXCQ, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.828365735 (5h14m55.415421976s) [noise=true , address=45.91.116.8:4048 , piece_id=XZNUB5SDPWSYVGHGMFFQZ4BZMBP2GMKF76GXWQ2MXAGT42I6I4FQ, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.828913136 (5h14m55.415969378s) [noise=true , address=104.36.82.2:4732 , piece_id=2HK2G5XCNE6UN3COUOG6V4IVCLTRVEMNNCQMV5SZLXRFTO2FJUYQ, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.934607129 (5h14m55.52166334s) [upload=5396]: Next returned nil segment Aug 7 21:41:41.934619282 (5h14m55.521675503s) [upload=5396]: Waiting for error group managing segments... Aug 7 21:41:41.945118551 (5h14m55.532174772s) [noise=true , address=45.91.116.4:4940 , piece_id=ETERKOUZIHEOKPCAJPSUBGXFMDLKEELCVMIW34LR7G66FBFMUNTA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.945901252 (5h14m55.532957473s) [noise=true , address=45.91.116.8:4048 , piece_id=XZNUB5SDPWSYVGHGMFFQZ4BZMBP2GMKF76GXWQ2MXAGT42I6I4FQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.946161258 (5h14m55.533217498s) [noise=true , address=45.91.116.5:4298 , piece_id=C3BQRSMSRSM4FJ7SWEBPHH7UKNUJWCDD5AEEBEAYN6OMCM2VRSWA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.946386648 (5h14m55.533442869s) [noise=true , address=77.90.31.12:4592 , piece_id=75OFHQZRJKZYL3QJ37T6QLDED663WXIEFAHTH2BQZLZ46PY5YPLQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.949024992 (5h14m55.536081243s) [noise=true , address=45.91.116.5:4299 , piece_id=XY3RW62XNQVLM6NTAZTBF26HWTY5KR3ZEJGVYTSTENY2B77YLBMA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.949218724 (5h14m55.536274945s) [noise=true , address=45.91.116.4:4937 , piece_id=BYNKX2DGOGITTOYV7IH73WDLAPXHXWG5V5WFIJDTM5RUJQYP6MLQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.949657033 (5h14m55.536713244s) [noise=true , address=77.90.31.13:4627 , piece_id=7MG24AD6AUVL6X66RZJ43OSAM7FLBB33KQY4ENE4Q3NR6PA63YQQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.949683371 (5h14m55.536739612s) [noise=true , address=104.36.82.2:4732 , piece_id=2HK2G5XCNE6UN3COUOG6V4IVCLTRVEMNNCQMV5SZLXRFTO2FJUYQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.950070354 (5h14m55.537126575s) [noise=true , address=104.36.82.11:4114 , piece_id=KB2SDFXXBJDEYUHUNIO3YSANNDXVREF46SGOSWQ3YBHRR42TFD4A, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.953623165 (5h14m55.540679407s) [noise=true , address=104.36.82.6:4875 , piece_id=B263E3OQZQDAAYHN3YIPJ4RBLTNOFNOXAZWYTVEGGVRM2YES3PBQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.957708261 (5h14m55.544764482s) [noise=true , address=104.36.82.5:4837 , piece_id=32VX7X2CPAQKJGKQYNDUF2U6GPAWZKEWYALRTRSFC6TPIQJBBXCQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.964243811 (5h14m55.551300021s) [noise=true , address=77.90.31.10:4519 , piece_id=OQZPQPV2NUVKLMSHONEMH2HUK52KXL2E6NXXSO2J6CP7IDTRVT7Q, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.964842018 (5h14m55.551898239s) [noise=true , address=77.90.31.14:4661 , piece_id=U3YYDMWVGG4NEV5OSK4ATJ2RNTEYCIXKH3KXY7UR3RGJXEUA25IA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.964860783 (5h14m55.551917004s) [seg_pos={0 0}, upload=5396]: Segment reached optimal threshold of 13 pieces. Aug 7 21:41:41.964962292 (5h14m55.552018503s) [noise=true , address=77.90.31.17:4771 , piece_id=IYUYS3YHOD44ZF2OGKQX7JCFVW2GBU5S2TVC3FZ2M3JNF67TP4CQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2): protocol: expected piece hash; context canceled; EOF Aug 7 21:41:41.965019739 (5h14m55.55207595s) [noise=true , address=104.36.82.10:4077 , piece_id=LZBNWOC4E35SX6FKBLATK2QFZDUWA7CBA5RY422YHVMMKO5XDSBQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Aug 7 21:41:41.965087696 (5h14m55.552143947s) [noise=true , address=104.36.82.7:4911 , piece_id=GLWOEWKACQVRHXQ6EY45IYR5N7VCP75FUZIYT5WRQG2VXULRUIUA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF Aug 7 21:41:41.965118783 (5h14m55.552175005s) [seg_pos={0 0}, upload=5396]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 21:41:41.965239138 (5h14m55.552295349s) [upload=5396]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 21:41:41.965243687 (5h14m55.552299898s) [upload=5396]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:41:46.509965896 (5h15m0.097022118s) [upload=5396]: Done uploading segments... Aug 7 21:41:46.510002955 (5h15m0.097059167s) [upload=5396]: Upload finished. err: <nil> Aug 7 21:42:01.196715658 (5h15m14.783771899s) [upload=5401]: Starting upload Aug 7 21:42:01.196842946 (5h15m14.783899187s) [upload=5401]: Done starting upload Aug 7 21:42:01.196915852 (5h15m14.783972103s) [upload=5401]: Uploading segments... Aug 7 21:42:01.197283067 (5h15m14.784339309s) [upload=5401]: Got next segment. Inline: false Aug 7 21:42:01.197355652 (5h15m14.784411984s) [upload=5401]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:42:01.197365230 (5h15m14.784421472s) [upload=5401]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 21:42:31.170606605 (5h15m44.757662826s) [upload=5401]: Next segment err: context deadline exceeded Aug 7 21:42:31.170727651 (5h15m44.757783872s) [upload=5401]: Done uploading segments... Aug 7 21:42:31.170749551 (5h15m44.757805773s) [upload=5401]: Upload finished. err: context deadline exceeded Duration:* 15.245754869s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 28 out of 60 is failed (threshold=3) [...........................XX.XXXXXXXXXXXXXXXXXXXXXXXXXX....] duration: 1.554087329s FAIL (2025-08-07 21:44:28 UTC) operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.554100483s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 41 out of 60 is failed (threshold=3) [................XX..XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.X] duration: 30.000500506s FAIL (2025-08-07 21:44:26 UTC) operation: Commit uplink: metaclient: context deadline exceeded Duration: 30.000518049s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 19 out of 60 is failed (threshold=3) [.....................................XXXXXXXXXXXXXXXXX.XX...] duration: 1.27832706s FAIL (2025-08-07 21:44:25 UTC) operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== address=104.36.82.12:4172 , piece_id=2SN23SJESN46DLA25WJULJLVGE7QWLQW2QJFAUA3WUVICJ5CKLUA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.023027314 (5h13m59.610083535s) [noise=true , address=104.36.82.54:4183 , piece_id=ZOCQQFJKFATMPRR2PKHLTSWN2D3QXAMZ74K2A5KTKYQAHEGA2BUA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.023255801 (5h13m59.610312012s) [noise=true , address=104.36.82.37:4663 , piece_id=XOIJUGNOKJJVWQ4226IL67H73DVYH7VBSIKI4BQSMOIGYNY7MO7A, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.023462957 (5h13m59.610519169s) [noise=true , address=104.36.82.60:4367 , piece_id=IRTAFXB5WIGLKZE4HQE7UW7J5OSZSIQK7TGY447RFZD7FCIAYQVQ, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.023666096 (5h13m59.610722308s) [noise=true , address=64.49.13.140:4511 , piece_id=A7AQ3VPKYONSOWW2YUPGWAXTMA4JPGBG4CQVYCK6PFFIFFUGPMHA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.023880075 (5h13m59.610936287s) [noise=true , address=104.36.82.23:4474 , piece_id=TDLXCBP5IPHILGHJYQD4DXYRMLL2VS2ER3ECEBAXOBTUAMR67BBA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.024106408 (5h13m59.611162629s) [noise=true , address=104.36.82.58:4269 , piece_id=4I2ROAYRNHMC53OKVWWXCS4FULL2XZ6CG5WZUPOLQ4UNELQDHHOA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.024332290 (5h13m59.611388511s) [noise=true , address=104.36.82.16:4305 , piece_id=K5YI7X35EAPFSOANSPQERKCHUOO6GDZZWKAOFNYGM6R3PA6K2LWA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.024539145 (5h13m59.611595357s) [noise=true , address=104.36.82.36:4623 , piece_id=ONIDD2KMXGVLKCD5YFBVUMMF2ORGVLFDV4LG3TRKRSINURIDAAFA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.024749439 (5h13m59.61180566s) [noise=true , address=104.36.82.43:4850 , piece_id=XWPXP7HKO2ZH22MMIODDLHM3LPIIPQP3Y3FLZ54XMMWOIN7JIADA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.024973778 (5h13m59.612029999s) [noise=true , address=45.91.116.9:4266 , piece_id=VOPNPD4GIHS2VOYBWCCTR7LX3YKL4BCZLW4XMROMAWU4WYUJ52WA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.025220337 (5h13m59.612276558s) [noise=true , address=104.36.82.15:4275 , piece_id=HCH5IC5PTQ7NCSWPJJC5OOEPEIMA34ZL6E5QPQPCDB2P2FEO6JYA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.105422677 (5h13m59.692478898s) [upload=5382]: Next returned nil segment Aug 7 21:40:46.105438417 (5h13m59.692494638s) [upload=5382]: Waiting for error group managing segments... Aug 7 21:40:46.115255601 (5h13m59.702311812s) [noise=true , address=45.91.116.9:4266 , piece_id=VOPNPD4GIHS2VOYBWCCTR7LX3YKL4BCZLW4XMROMAWU4WYUJ52WA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.123052245 (5h13m59.710108455s) [noise=true , address=104.36.82.16:4305 , piece_id=K5YI7X35EAPFSOANSPQERKCHUOO6GDZZWKAOFNYGM6R3PA6K2LWA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.123065018 (5h13m59.710121239s) [noise=true , address=104.36.82.37:4663 , piece_id=XOIJUGNOKJJVWQ4226IL67H73DVYH7VBSIKI4BQSMOIGYNY7MO7A, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.135955971 (5h13m59.723012192s) [noise=true , address=104.36.82.58:4269 , piece_id=4I2ROAYRNHMC53OKVWWXCS4FULL2XZ6CG5WZUPOLQ4UNELQDHHOA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.139757077 (5h13m59.726813288s) [noise=true , address=104.36.82.44:4891 , piece_id=D33W4EHVQ26LIOJ2KG5RKUHRZSGXAIGS2PQSIURYKGMP63RBTBGA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.148928486 (5h13m59.735984697s) [noise=true , address=104.36.82.15:4275 , piece_id=HCH5IC5PTQ7NCSWPJJC5OOEPEIMA34ZL6E5QPQPCDB2P2FEO6JYA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.149227595 (5h13m59.736283816s) [noise=true , address=104.36.82.36:4623 , piece_id=ONIDD2KMXGVLKCD5YFBVUMMF2ORGVLFDV4LG3TRKRSINURIDAAFA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.157435446 (5h13m59.744491657s) [noise=true , address=104.36.82.54:4183 , piece_id=ZOCQQFJKFATMPRR2PKHLTSWN2D3QXAMZ74K2A5KTKYQAHEGA2BUA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.193659694 (5h13m59.780715905s) [noise=true , address=104.36.82.60:4367 , piece_id=IRTAFXB5WIGLKZE4HQE7UW7J5OSZSIQK7TGY447RFZD7FCIAYQVQ, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.198544171 (5h13m59.785600382s) [noise=true , address=104.36.82.12:4172 , piece_id=2SN23SJESN46DLA25WJULJLVGE7QWLQW2QJFAUA3WUVICJ5CKLUA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.200016058 (5h13m59.787072279s) [noise=true , address=104.36.82.14:4228 , piece_id=USWUBYJMTZKFFN3DZIKQQD7PW6QAKBRUHJZRCBO4DXTHR2PQDHRQ, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.224817695 (5h13m59.811873916s) [noise=true , address=104.36.82.43:4850 , piece_id=XWPXP7HKO2ZH22MMIODDLHM3LPIIPQP3Y3FLZ54XMMWOIN7JIADA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.225279788 (5h13m59.812336009s) [noise=true , address=104.36.82.61:4383 , piece_id=ELAHQPPPJCCLCQYXDEOS62V6TOMV5NOCMUU5XZFCQ23Y6SQUWG6Q, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.305784060 (5h13m59.892840282s) [noise=true , address=104.36.82.43:4863 , piece_id=PWAZUY75NQILRAVGRSMJSFKPOPLR3WQ5O3Q47GZ5U37KXPXJ3ORQ, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.305806102 (5h13m59.892862323s) [seg_pos={0 0}, upload=5382]: Segment reached optimal threshold of 14 pieces. Aug 7 21:40:46.305952956 (5h13m59.893009177s) [noise=true , address=104.36.82.56:4261 , piece_id=Z27LNZSXSYSUMQXEW2DI3C54ZJK26ALV653EINMYNU6COTMAMPBA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YNKaVEsXzHe6XGQuv6wR1qqbv6dbzg1xT5Aqkew2ZV3z3tMMf): protocol: expected piece hash; context canceled; EOF Aug 7 21:40:46.306110209 (5h13m59.89316642s) [noise=true , address=64.49.13.139:4471 , piece_id=2OSYONIOJUEZXMYFSTL7NRN7HG6KXJOHFUL7TIDW73C4VKYF3W3A, seg_pos={0 0}, upload=5382]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:26750->64.49.13.139:4471: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 21:40:46.306163639 (5h13m59.89321985s) [noise=true , address=104.36.82.23:4474 , piece_id=TDLXCBP5IPHILGHJYQD4DXYRMLL2VS2ER3ECEBAXOBTUAMR67BBA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: write tcp 5.161.89.252:22402->104.36.82.23:4474: use of closed network connection; write tcp 5.161.89.252:22402->104.36.82.23:4474: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:22402->104.36.82.23:4474: use of closed network connection Aug 7 21:40:46.306206098 (5h13m59.893262319s) [noise=true , address=64.49.13.140:4511 , piece_id=A7AQ3VPKYONSOWW2YUPGWAXTMA4JPGBG4CQVYCK6PFFIFFUGPMHA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: read tcp 5.161.89.252:31920->64.49.13.140:4511: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 21:40:46.306226506 (5h13m59.893282717s) [seg_pos={0 0}, upload=5382]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 21:40:46.306282762 (5h13m59.893338983s) [upload=5382]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 21:40:46.306286799 (5h13m59.89334301s) [upload=5382]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:40:57.774588980 (5h14m11.361645201s) [upload=5382]: Done uploading segments... Aug 7 21:40:57.774603057 (5h14m11.361659278s) [upload=5382]: Upload finished. err: <nil> Aug 7 21:41:10.210507562 (5h14m23.797563803s) [upload=5386]: Starting upload Aug 7 21:41:10.210589415 (5h14m23.797645655s) [upload=5386]: Done starting upload Aug 7 21:41:10.210669645 (5h14m23.797725856s) [upload=5386]: Uploading segments... Aug 7 21:41:10.210963293 (5h14m23.798019534s) [upload=5386]: Got next segment. Inline: false Aug 7 21:41:10.211025149 (5h14m23.79808139s) [upload=5386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:41:10.211035066 (5h14m23.798091308s) [upload=5386]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 21:42:10.197934627 (5h15m23.784990848s) [upload=5386]: Next segment err: context deadline exceeded Aug 7 21:42:10.198070280 (5h15m23.785126501s) [upload=5386]: Done uploading segments... Aug 7 21:42:10.198139409 (5h15m23.78519562s) [upload=5386]: Upload finished. err: context deadline exceeded Aug 7 21:42:14.127516635 (5h15m27.714572846s) [upload=5403]: Starting upload Aug 7 21:42:14.127582357 (5h15m27.714638569s) [upload=5403]: Done starting upload Aug 7 21:42:14.127692983 (5h15m27.714749204s) [upload=5403]: Uploading segments... Aug 7 21:42:14.127793461 (5h15m27.714849672s) [upload=5403]: Got next segment. Inline: false Aug 7 21:42:14.127840750 (5h15m27.714896961s) [upload=5403]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:42:14.127846281 (5h15m27.714902491s) [upload=5403]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 21:43:14.115648400 (5h16m27.702704611s) [upload=5403]: Next segment err: context deadline exceeded Aug 7 21:43:14.115816064 (5h16m27.702872275s) [upload=5403]: Done uploading segments... Aug 7 21:43:14.115831182 (5h16m27.702887403s) [upload=5403]: Upload finished. err: context deadline exceeded Duration: 1.278352498s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 41 out of 60 is failed (threshold=3) [..................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XX] duration: 30.000930546s FAIL (2025-08-07 21:44:21 UTC) operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== nished. err: metaclient: context deadline exceeded Aug 7 21:36:52.348809979 (5h10m5.9358662s) [upload=5319]: Starting upload Aug 7 21:36:52.348858119 (5h10m5.93591434s) [upload=5319]: Done starting upload Aug 7 21:36:52.348898024 (5h10m5.935954245s) [upload=5319]: Uploading segments... Aug 7 21:36:52.348925776 (5h10m5.935981997s) [upload=5319]: Got next segment. Inline: true Aug 7 21:36:52.348929652 (5h10m5.935985864s) [upload=5319]: Waiting for error group managing segments... Aug 7 21:36:52.348958357 (5h10m5.936014567s) [upload=5319]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:36:52.348963487 (5h10m5.936019697s) [upload=5319]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:36:52.348965901 (5h10m5.936022122s) [upload=5319]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:37:22.335555108 (5h10m35.922611329s) [upload=5319]: Done uploading segments... Aug 7 21:37:22.335570486 (5h10m35.922626707s) [upload=5319]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:37:24.787968674 (5h10m38.375024885s) [upload=5327]: Starting upload Aug 7 21:37:24.788026372 (5h10m38.375082583s) [upload=5327]: Done starting upload Aug 7 21:37:24.788072297 (5h10m38.375128518s) [upload=5327]: Uploading segments... Aug 7 21:37:24.788129475 (5h10m38.375185696s) [upload=5327]: Got next segment. Inline: true Aug 7 21:37:24.788133472 (5h10m38.375189694s) [upload=5327]: Waiting for error group managing segments... Aug 7 21:37:24.788169800 (5h10m38.375226021s) [upload=5327]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:37:24.788173967 (5h10m38.375230188s) [upload=5327]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:37:24.788176171 (5h10m38.375232382s) [upload=5327]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:37:54.773685524 (5h11m8.360741775s) [upload=5327]: Done uploading segments... Aug 7 21:37:54.773706774 (5h11m8.360763025s) [upload=5327]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:37:56.437147115 (5h11m10.024203357s) [upload=5336]: Starting upload Aug 7 21:37:56.437251630 (5h11m10.024307872s) [upload=5336]: Done starting upload Aug 7 21:37:56.437342400 (5h11m10.024398641s) [upload=5336]: Uploading segments... Aug 7 21:37:56.437415256 (5h11m10.024471508s) [upload=5336]: Got next segment. Inline: true Aug 7 21:37:56.437425486 (5h11m10.024481767s) [upload=5336]: Waiting for error group managing segments... Aug 7 21:37:56.437531414 (5h11m10.024587665s) [upload=5336]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:37:56.437544558 (5h11m10.02460085s) [upload=5336]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:37:56.437551260 (5h11m10.024607511s) [upload=5336]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:38:26.422314839 (5h11m40.009371081s) [upload=5336]: Done uploading segments... Aug 7 21:38:26.422335869 (5h11m40.00939211s) [upload=5336]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:38:26.513648977 (5h11m40.100705218s) [upload=5344]: Starting upload Aug 7 21:38:26.513731310 (5h11m40.100787552s) [upload=5344]: Done starting upload Aug 7 21:38:26.513792245 (5h11m40.100848496s) [upload=5344]: Uploading segments... Aug 7 21:38:26.513834112 (5h11m40.100890354s) [upload=5344]: Got next segment. Inline: true Aug 7 21:38:26.513839653 (5h11m40.100895904s) [upload=5344]: Waiting for error group managing segments... Aug 7 21:38:26.513884006 (5h11m40.100940247s) [upload=5344]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:38:26.513889947 (5h11m40.100946188s) [upload=5344]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:38:26.513893434 (5h11m40.100949675s) [upload=5344]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:38:56.502052245 (5h12m10.089108537s) [upload=5344]: Done uploading segments... Aug 7 21:38:56.502102730 (5h12m10.089158972s) [upload=5344]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:39:24.008006172 (5h12m37.595062394s) [upload=5359]: Starting upload Aug 7 21:39:24.008059211 (5h12m37.595115422s) [upload=5359]: Done starting upload Aug 7 21:39:24.008103604 (5h12m37.595159835s) [upload=5359]: Uploading segments... Aug 7 21:39:24.008156191 (5h12m37.595212413s) [upload=5359]: Got next segment. Inline: true Aug 7 21:39:24.008162193 (5h12m37.595218414s) [upload=5359]: Waiting for error group managing segments... Aug 7 21:39:24.008207327 (5h12m37.595263548s) [upload=5359]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:39:24.008212668 (5h12m37.595268878s) [upload=5359]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:39:24.008216064 (5h12m37.595272285s) [upload=5359]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:39:53.997226503 (5h13m7.584282744s) [upload=5359]: Done uploading segments... Aug 7 21:39:53.997270334 (5h13m7.584326586s) [upload=5359]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:40:36.779619947 (5h13m50.366676188s) [upload=5383]: Starting upload Aug 7 21:40:36.779696139 (5h13m50.36675238s) [upload=5383]: Done starting upload Aug 7 21:40:36.779752775 (5h13m50.366809016s) [upload=5383]: Uploading segments... Aug 7 21:40:36.779788803 (5h13m50.366845044s) [upload=5383]: Got next segment. Inline: true Aug 7 21:40:36.779794423 (5h13m50.366850655s) [upload=5383]: Waiting for error group managing segments... Aug 7 21:40:36.779835950 (5h13m50.366892191s) [upload=5383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:40:36.779841010 (5h13m50.366897241s) [upload=5383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:40:36.779844195 (5h13m50.366900437s) [upload=5383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:41:06.765292852 (5h14m20.352349064s) [upload=5383]: Done uploading segments... Aug 7 21:41:06.765314052 (5h14m20.352370273s) [upload=5383]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:41:47.961322510 (5h15m1.548378802s) [upload=5399]: Starting upload Aug 7 21:41:47.961442915 (5h15m1.548499166s) [upload=5399]: Done starting upload Aug 7 21:41:47.961510201 (5h15m1.548566443s) [upload=5399]: Uploading segments... Aug 7 21:41:47.961591062 (5h15m1.548647313s) [upload=5399]: Got next segment. Inline: true Aug 7 21:41:47.961599218 (5h15m1.548655458s) [upload=5399]: Waiting for error group managing segments... Aug 7 21:41:47.961647759 (5h15m1.548703999s) [upload=5399]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:41:47.961653760 (5h15m1.548710001s) [upload=5399]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:41:47.961657546 (5h15m1.548713787s) [upload=5399]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:42:17.948677724 (5h15m31.535733945s) [upload=5399]: Done uploading segments... Aug 7 21:42:17.948691099 (5h15m31.53574731s) [upload=5399]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:42:18.081006705 (5h15m31.668062915s) [upload=5405]: Starting upload Aug 7 21:42:18.081065655 (5h15m31.668121866s) [upload=5405]: Done starting upload Aug 7 21:42:18.081113425 (5h15m31.668169635s) [upload=5405]: Uploading segments... Aug 7 21:42:18.081164870 (5h15m31.668221091s) [upload=5405]: Got next segment. Inline: true Aug 7 21:42:18.081169459 (5h15m31.66822568s) [upload=5405]: Waiting for error group managing segments... Aug 7 21:42:18.081201809 (5h15m31.66825803s) [upload=5405]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:42:18.081205546 (5h15m31.668261757s) [upload=5405]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:42:18.081208271 (5h15m31.668264483s) [upload=5405]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:42:18.161269758 (5h15m31.748325999s) [upload=5405]: Done uploading segments... Aug 7 21:42:18.161287411 (5h15m31.748343652s) [upload=5405]: Upload finished. err: <nil> Aug 7 21:43:12.878567983 (5h16m26.465624204s) [upload=5420]: Starting upload Aug 7 21:43:12.878678820 (5h16m26.465735041s) [upload=5420]: Done starting upload Aug 7 21:43:12.878731839 (5h16m26.46578806s) [upload=5420]: Uploading segments... Aug 7 21:43:12.878762908 (5h16m26.465819129s) [upload=5420]: Got next segment. Inline: true Aug 7 21:43:12.878766635 (5h16m26.465822856s) [upload=5420]: Waiting for error group managing segments... Aug 7 21:43:12.878799204 (5h16m26.465855425s) [upload=5420]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:43:12.878803332 (5h16m26.465859543s) [upload=5420]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:43:12.878805566 (5h16m26.465861787s) [upload=5420]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:43:42.863779226 (5h16m56.450835478s) [upload=5420]: Done uploading segments... Aug 7 21:43:42.863802450 (5h16m56.450858691s) [upload=5420]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:43:51.464096058 (5h17m5.051152299s) [upload=5431]: Starting upload Aug 7 21:43:51.464210432 (5h17m5.051266673s) [upload=5431]: Done starting upload Aug 7 21:43:51.464274041 (5h17m5.051330282s) [upload=5431]: Uploading segments... Aug 7 21:43:51.464330065 (5h17m5.051386366s) [upload=5431]: Got next segment. Inline: true Aug 7 21:43:51.464343630 (5h17m5.051399912s) [upload=5431]: Waiting for error group managing segments... Aug 7 21:43:51.464415315 (5h17m5.051471556s) [upload=5431]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:43:51.464424673 (5h17m5.051480923s) [upload=5431]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:43:51.464431204 (5h17m5.051487455s) [upload=5431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:44:21.448488824 (5h17m35.035545036s) [upload=5431]: Done uploading segments... Aug 7 21:44:21.448528209 (5h17m35.03558443s) [upload=5431]: Upload finished. err: metaclient: context deadline exceeded Duration: 30.000950231s core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 4 out of 60 is failed (threshold=3) [.............................X........XX...X................] duration: 29.280456ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-07 21:44:21 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 29.313537ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 3 out of 60 is failed (threshold=3) [...........................................X...X...X........] duration: 116.452396ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-07 21:44:17 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": context deadline exceeded Duration: 116.497481ms edge gateway vhost bgp us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 28 out of 60 is failed (threshold=3) [............................XX.XXXXXXXXXXXXXXXXXXXXXXXXXX...] duration: 1.756295229s FAIL (2025-08-07 21:44:03 UTC) operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.756604948s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 31 out of 60 is failed (threshold=3) [...........................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX..] duration: 1.771268158s FAIL (2025-08-07 21:43:57 UTC) operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 1.771290449s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 37 out of 60 is failed (threshold=3) [...................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XX...] duration: 3.120324273s FAIL (2025-08-07 21:43:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.120348208s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 37 out of 60 is failed (threshold=3) [....................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX...] duration: 3.676232817s FAIL (2025-08-07 21:43:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.676373108s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 19 out of 60 is failed (threshold=3) [......................................XXXXXXXXXXXXXXXXX.XX..] duration: 718.655442ms FAIL (2025-08-07 21:43:44 UTC) operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== address=104.36.82.12:4172 , piece_id=2SN23SJESN46DLA25WJULJLVGE7QWLQW2QJFAUA3WUVICJ5CKLUA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.023027314 (5h13m59.610083535s) [noise=true , address=104.36.82.54:4183 , piece_id=ZOCQQFJKFATMPRR2PKHLTSWN2D3QXAMZ74K2A5KTKYQAHEGA2BUA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.023255801 (5h13m59.610312012s) [noise=true , address=104.36.82.37:4663 , piece_id=XOIJUGNOKJJVWQ4226IL67H73DVYH7VBSIKI4BQSMOIGYNY7MO7A, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.023462957 (5h13m59.610519169s) [noise=true , address=104.36.82.60:4367 , piece_id=IRTAFXB5WIGLKZE4HQE7UW7J5OSZSIQK7TGY447RFZD7FCIAYQVQ, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.023666096 (5h13m59.610722308s) [noise=true , address=64.49.13.140:4511 , piece_id=A7AQ3VPKYONSOWW2YUPGWAXTMA4JPGBG4CQVYCK6PFFIFFUGPMHA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.023880075 (5h13m59.610936287s) [noise=true , address=104.36.82.23:4474 , piece_id=TDLXCBP5IPHILGHJYQD4DXYRMLL2VS2ER3ECEBAXOBTUAMR67BBA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.024106408 (5h13m59.611162629s) [noise=true , address=104.36.82.58:4269 , piece_id=4I2ROAYRNHMC53OKVWWXCS4FULL2XZ6CG5WZUPOLQ4UNELQDHHOA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.024332290 (5h13m59.611388511s) [noise=true , address=104.36.82.16:4305 , piece_id=K5YI7X35EAPFSOANSPQERKCHUOO6GDZZWKAOFNYGM6R3PA6K2LWA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.024539145 (5h13m59.611595357s) [noise=true , address=104.36.82.36:4623 , piece_id=ONIDD2KMXGVLKCD5YFBVUMMF2ORGVLFDV4LG3TRKRSINURIDAAFA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.024749439 (5h13m59.61180566s) [noise=true , address=104.36.82.43:4850 , piece_id=XWPXP7HKO2ZH22MMIODDLHM3LPIIPQP3Y3FLZ54XMMWOIN7JIADA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.024973778 (5h13m59.612029999s) [noise=true , address=45.91.116.9:4266 , piece_id=VOPNPD4GIHS2VOYBWCCTR7LX3YKL4BCZLW4XMROMAWU4WYUJ52WA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.025220337 (5h13m59.612276558s) [noise=true , address=104.36.82.15:4275 , piece_id=HCH5IC5PTQ7NCSWPJJC5OOEPEIMA34ZL6E5QPQPCDB2P2FEO6JYA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.105422677 (5h13m59.692478898s) [upload=5382]: Next returned nil segment Aug 7 21:40:46.105438417 (5h13m59.692494638s) [upload=5382]: Waiting for error group managing segments... Aug 7 21:40:46.115255601 (5h13m59.702311812s) [noise=true , address=45.91.116.9:4266 , piece_id=VOPNPD4GIHS2VOYBWCCTR7LX3YKL4BCZLW4XMROMAWU4WYUJ52WA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.123052245 (5h13m59.710108455s) [noise=true , address=104.36.82.16:4305 , piece_id=K5YI7X35EAPFSOANSPQERKCHUOO6GDZZWKAOFNYGM6R3PA6K2LWA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.123065018 (5h13m59.710121239s) [noise=true , address=104.36.82.37:4663 , piece_id=XOIJUGNOKJJVWQ4226IL67H73DVYH7VBSIKI4BQSMOIGYNY7MO7A, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.135955971 (5h13m59.723012192s) [noise=true , address=104.36.82.58:4269 , piece_id=4I2ROAYRNHMC53OKVWWXCS4FULL2XZ6CG5WZUPOLQ4UNELQDHHOA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.139757077 (5h13m59.726813288s) [noise=true , address=104.36.82.44:4891 , piece_id=D33W4EHVQ26LIOJ2KG5RKUHRZSGXAIGS2PQSIURYKGMP63RBTBGA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.148928486 (5h13m59.735984697s) [noise=true , address=104.36.82.15:4275 , piece_id=HCH5IC5PTQ7NCSWPJJC5OOEPEIMA34ZL6E5QPQPCDB2P2FEO6JYA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.149227595 (5h13m59.736283816s) [noise=true , address=104.36.82.36:4623 , piece_id=ONIDD2KMXGVLKCD5YFBVUMMF2ORGVLFDV4LG3TRKRSINURIDAAFA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.157435446 (5h13m59.744491657s) [noise=true , address=104.36.82.54:4183 , piece_id=ZOCQQFJKFATMPRR2PKHLTSWN2D3QXAMZ74K2A5KTKYQAHEGA2BUA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.193659694 (5h13m59.780715905s) [noise=true , address=104.36.82.60:4367 , piece_id=IRTAFXB5WIGLKZE4HQE7UW7J5OSZSIQK7TGY447RFZD7FCIAYQVQ, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.198544171 (5h13m59.785600382s) [noise=true , address=104.36.82.12:4172 , piece_id=2SN23SJESN46DLA25WJULJLVGE7QWLQW2QJFAUA3WUVICJ5CKLUA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.200016058 (5h13m59.787072279s) [noise=true , address=104.36.82.14:4228 , piece_id=USWUBYJMTZKFFN3DZIKQQD7PW6QAKBRUHJZRCBO4DXTHR2PQDHRQ, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.224817695 (5h13m59.811873916s) [noise=true , address=104.36.82.43:4850 , piece_id=XWPXP7HKO2ZH22MMIODDLHM3LPIIPQP3Y3FLZ54XMMWOIN7JIADA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.225279788 (5h13m59.812336009s) [noise=true , address=104.36.82.61:4383 , piece_id=ELAHQPPPJCCLCQYXDEOS62V6TOMV5NOCMUU5XZFCQ23Y6SQUWG6Q, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.305784060 (5h13m59.892840282s) [noise=true , address=104.36.82.43:4863 , piece_id=PWAZUY75NQILRAVGRSMJSFKPOPLR3WQ5O3Q47GZ5U37KXPXJ3ORQ, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.305806102 (5h13m59.892862323s) [seg_pos={0 0}, upload=5382]: Segment reached optimal threshold of 14 pieces. Aug 7 21:40:46.305952956 (5h13m59.893009177s) [noise=true , address=104.36.82.56:4261 , piece_id=Z27LNZSXSYSUMQXEW2DI3C54ZJK26ALV653EINMYNU6COTMAMPBA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YNKaVEsXzHe6XGQuv6wR1qqbv6dbzg1xT5Aqkew2ZV3z3tMMf): protocol: expected piece hash; context canceled; EOF Aug 7 21:40:46.306110209 (5h13m59.89316642s) [noise=true , address=64.49.13.139:4471 , piece_id=2OSYONIOJUEZXMYFSTL7NRN7HG6KXJOHFUL7TIDW73C4VKYF3W3A, seg_pos={0 0}, upload=5382]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:26750->64.49.13.139:4471: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 21:40:46.306163639 (5h13m59.89321985s) [noise=true , address=104.36.82.23:4474 , piece_id=TDLXCBP5IPHILGHJYQD4DXYRMLL2VS2ER3ECEBAXOBTUAMR67BBA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: write tcp 5.161.89.252:22402->104.36.82.23:4474: use of closed network connection; write tcp 5.161.89.252:22402->104.36.82.23:4474: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:22402->104.36.82.23:4474: use of closed network connection Aug 7 21:40:46.306206098 (5h13m59.893262319s) [noise=true , address=64.49.13.140:4511 , piece_id=A7AQ3VPKYONSOWW2YUPGWAXTMA4JPGBG4CQVYCK6PFFIFFUGPMHA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: read tcp 5.161.89.252:31920->64.49.13.140:4511: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 21:40:46.306226506 (5h13m59.893282717s) [seg_pos={0 0}, upload=5382]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 21:40:46.306282762 (5h13m59.893338983s) [upload=5382]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 21:40:46.306286799 (5h13m59.89334301s) [upload=5382]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:40:57.774588980 (5h14m11.361645201s) [upload=5382]: Done uploading segments... Aug 7 21:40:57.774603057 (5h14m11.361659278s) [upload=5382]: Upload finished. err: <nil> Aug 7 21:41:10.210507562 (5h14m23.797563803s) [upload=5386]: Starting upload Aug 7 21:41:10.210589415 (5h14m23.797645655s) [upload=5386]: Done starting upload Aug 7 21:41:10.210669645 (5h14m23.797725856s) [upload=5386]: Uploading segments... Aug 7 21:41:10.210963293 (5h14m23.798019534s) [upload=5386]: Got next segment. Inline: false Aug 7 21:41:10.211025149 (5h14m23.79808139s) [upload=5386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:41:10.211035066 (5h14m23.798091308s) [upload=5386]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 21:42:10.197934627 (5h15m23.784990848s) [upload=5386]: Next segment err: context deadline exceeded Aug 7 21:42:10.198070280 (5h15m23.785126501s) [upload=5386]: Done uploading segments... Aug 7 21:42:10.198139409 (5h15m23.78519562s) [upload=5386]: Upload finished. err: context deadline exceeded Aug 7 21:42:14.127516635 (5h15m27.714572846s) [upload=5403]: Starting upload Aug 7 21:42:14.127582357 (5h15m27.714638569s) [upload=5403]: Done starting upload Aug 7 21:42:14.127692983 (5h15m27.714749204s) [upload=5403]: Uploading segments... Aug 7 21:42:14.127793461 (5h15m27.714849672s) [upload=5403]: Got next segment. Inline: false Aug 7 21:42:14.127840750 (5h15m27.714896961s) [upload=5403]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:42:14.127846281 (5h15m27.714902491s) [upload=5403]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 21:43:14.115648400 (5h16m27.702704611s) [upload=5403]: Next segment err: context deadline exceeded Aug 7 21:43:14.115816064 (5h16m27.702872275s) [upload=5403]: Done uploading segments... Aug 7 21:43:14.115831182 (5h16m27.702887403s) [upload=5403]: Upload finished. err: context deadline exceeded Duration: 718.694406ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 40 out of 60 is failed (threshold=3) [...................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.X] duration: 30.000624184s FAIL (2025-08-07 21:43:42 UTC) operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== pload finished. err: metaclient: context deadline exceeded Aug 7 21:36:04.978290179 (5h9m18.5653464s) [upload=5305]: Starting upload Aug 7 21:36:04.978343338 (5h9m18.565399559s) [upload=5305]: Done starting upload Aug 7 21:36:04.978386448 (5h9m18.565442659s) [upload=5305]: Uploading segments... Aug 7 21:36:04.978417035 (5h9m18.565473256s) [upload=5305]: Got next segment. Inline: true Aug 7 21:36:04.978420993 (5h9m18.565477214s) [upload=5305]: Waiting for error group managing segments... Aug 7 21:36:04.978450778 (5h9m18.565507s) [upload=5305]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:36:04.978454776 (5h9m18.565510997s) [upload=5305]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:36:04.978457190 (5h9m18.565513412s) [upload=5305]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:36:34.966368579 (5h9m48.5534248s) [upload=5305]: Done uploading segments... Aug 7 21:36:34.966387475 (5h9m48.553443696s) [upload=5305]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:36:52.348809979 (5h10m5.9358662s) [upload=5319]: Starting upload Aug 7 21:36:52.348858119 (5h10m5.93591434s) [upload=5319]: Done starting upload Aug 7 21:36:52.348898024 (5h10m5.935954245s) [upload=5319]: Uploading segments... Aug 7 21:36:52.348925776 (5h10m5.935981997s) [upload=5319]: Got next segment. Inline: true Aug 7 21:36:52.348929652 (5h10m5.935985864s) [upload=5319]: Waiting for error group managing segments... Aug 7 21:36:52.348958357 (5h10m5.936014567s) [upload=5319]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:36:52.348963487 (5h10m5.936019697s) [upload=5319]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:36:52.348965901 (5h10m5.936022122s) [upload=5319]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:37:22.335555108 (5h10m35.922611329s) [upload=5319]: Done uploading segments... Aug 7 21:37:22.335570486 (5h10m35.922626707s) [upload=5319]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:37:24.787968674 (5h10m38.375024885s) [upload=5327]: Starting upload Aug 7 21:37:24.788026372 (5h10m38.375082583s) [upload=5327]: Done starting upload Aug 7 21:37:24.788072297 (5h10m38.375128518s) [upload=5327]: Uploading segments... Aug 7 21:37:24.788129475 (5h10m38.375185696s) [upload=5327]: Got next segment. Inline: true Aug 7 21:37:24.788133472 (5h10m38.375189694s) [upload=5327]: Waiting for error group managing segments... Aug 7 21:37:24.788169800 (5h10m38.375226021s) [upload=5327]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:37:24.788173967 (5h10m38.375230188s) [upload=5327]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:37:24.788176171 (5h10m38.375232382s) [upload=5327]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:37:54.773685524 (5h11m8.360741775s) [upload=5327]: Done uploading segments... Aug 7 21:37:54.773706774 (5h11m8.360763025s) [upload=5327]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:37:56.437147115 (5h11m10.024203357s) [upload=5336]: Starting upload Aug 7 21:37:56.437251630 (5h11m10.024307872s) [upload=5336]: Done starting upload Aug 7 21:37:56.437342400 (5h11m10.024398641s) [upload=5336]: Uploading segments... Aug 7 21:37:56.437415256 (5h11m10.024471508s) [upload=5336]: Got next segment. Inline: true Aug 7 21:37:56.437425486 (5h11m10.024481767s) [upload=5336]: Waiting for error group managing segments... Aug 7 21:37:56.437531414 (5h11m10.024587665s) [upload=5336]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:37:56.437544558 (5h11m10.02460085s) [upload=5336]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:37:56.437551260 (5h11m10.024607511s) [upload=5336]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:38:26.422314839 (5h11m40.009371081s) [upload=5336]: Done uploading segments... Aug 7 21:38:26.422335869 (5h11m40.00939211s) [upload=5336]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:38:26.513648977 (5h11m40.100705218s) [upload=5344]: Starting upload Aug 7 21:38:26.513731310 (5h11m40.100787552s) [upload=5344]: Done starting upload Aug 7 21:38:26.513792245 (5h11m40.100848496s) [upload=5344]: Uploading segments... Aug 7 21:38:26.513834112 (5h11m40.100890354s) [upload=5344]: Got next segment. Inline: true Aug 7 21:38:26.513839653 (5h11m40.100895904s) [upload=5344]: Waiting for error group managing segments... Aug 7 21:38:26.513884006 (5h11m40.100940247s) [upload=5344]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:38:26.513889947 (5h11m40.100946188s) [upload=5344]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:38:26.513893434 (5h11m40.100949675s) [upload=5344]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:38:56.502052245 (5h12m10.089108537s) [upload=5344]: Done uploading segments... Aug 7 21:38:56.502102730 (5h12m10.089158972s) [upload=5344]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:39:24.008006172 (5h12m37.595062394s) [upload=5359]: Starting upload Aug 7 21:39:24.008059211 (5h12m37.595115422s) [upload=5359]: Done starting upload Aug 7 21:39:24.008103604 (5h12m37.595159835s) [upload=5359]: Uploading segments... Aug 7 21:39:24.008156191 (5h12m37.595212413s) [upload=5359]: Got next segment. Inline: true Aug 7 21:39:24.008162193 (5h12m37.595218414s) [upload=5359]: Waiting for error group managing segments... Aug 7 21:39:24.008207327 (5h12m37.595263548s) [upload=5359]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:39:24.008212668 (5h12m37.595268878s) [upload=5359]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:39:24.008216064 (5h12m37.595272285s) [upload=5359]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:39:53.997226503 (5h13m7.584282744s) [upload=5359]: Done uploading segments... Aug 7 21:39:53.997270334 (5h13m7.584326586s) [upload=5359]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:40:36.779619947 (5h13m50.366676188s) [upload=5383]: Starting upload Aug 7 21:40:36.779696139 (5h13m50.36675238s) [upload=5383]: Done starting upload Aug 7 21:40:36.779752775 (5h13m50.366809016s) [upload=5383]: Uploading segments... Aug 7 21:40:36.779788803 (5h13m50.366845044s) [upload=5383]: Got next segment. Inline: true Aug 7 21:40:36.779794423 (5h13m50.366850655s) [upload=5383]: Waiting for error group managing segments... Aug 7 21:40:36.779835950 (5h13m50.366892191s) [upload=5383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:40:36.779841010 (5h13m50.366897241s) [upload=5383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:40:36.779844195 (5h13m50.366900437s) [upload=5383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:41:06.765292852 (5h14m20.352349064s) [upload=5383]: Done uploading segments... Aug 7 21:41:06.765314052 (5h14m20.352370273s) [upload=5383]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:41:47.961322510 (5h15m1.548378802s) [upload=5399]: Starting upload Aug 7 21:41:47.961442915 (5h15m1.548499166s) [upload=5399]: Done starting upload Aug 7 21:41:47.961510201 (5h15m1.548566443s) [upload=5399]: Uploading segments... Aug 7 21:41:47.961591062 (5h15m1.548647313s) [upload=5399]: Got next segment. Inline: true Aug 7 21:41:47.961599218 (5h15m1.548655458s) [upload=5399]: Waiting for error group managing segments... Aug 7 21:41:47.961647759 (5h15m1.548703999s) [upload=5399]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:41:47.961653760 (5h15m1.548710001s) [upload=5399]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:41:47.961657546 (5h15m1.548713787s) [upload=5399]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:42:17.948677724 (5h15m31.535733945s) [upload=5399]: Done uploading segments... Aug 7 21:42:17.948691099 (5h15m31.53574731s) [upload=5399]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:42:18.081006705 (5h15m31.668062915s) [upload=5405]: Starting upload Aug 7 21:42:18.081065655 (5h15m31.668121866s) [upload=5405]: Done starting upload Aug 7 21:42:18.081113425 (5h15m31.668169635s) [upload=5405]: Uploading segments... Aug 7 21:42:18.081164870 (5h15m31.668221091s) [upload=5405]: Got next segment. Inline: true Aug 7 21:42:18.081169459 (5h15m31.66822568s) [upload=5405]: Waiting for error group managing segments... Aug 7 21:42:18.081201809 (5h15m31.66825803s) [upload=5405]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:42:18.081205546 (5h15m31.668261757s) [upload=5405]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:42:18.081208271 (5h15m31.668264483s) [upload=5405]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:42:18.161269758 (5h15m31.748325999s) [upload=5405]: Done uploading segments... Aug 7 21:42:18.161287411 (5h15m31.748343652s) [upload=5405]: Upload finished. err: <nil> Aug 7 21:43:12.878567983 (5h16m26.465624204s) [upload=5420]: Starting upload Aug 7 21:43:12.878678820 (5h16m26.465735041s) [upload=5420]: Done starting upload Aug 7 21:43:12.878731839 (5h16m26.46578806s) [upload=5420]: Uploading segments... Aug 7 21:43:12.878762908 (5h16m26.465819129s) [upload=5420]: Got next segment. Inline: true Aug 7 21:43:12.878766635 (5h16m26.465822856s) [upload=5420]: Waiting for error group managing segments... Aug 7 21:43:12.878799204 (5h16m26.465855425s) [upload=5420]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:43:12.878803332 (5h16m26.465859543s) [upload=5420]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:43:12.878805566 (5h16m26.465861787s) [upload=5420]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:43:42.863779226 (5h16m56.450835478s) [upload=5420]: Done uploading segments... Aug 7 21:43:42.863802450 (5h16m56.450858691s) [upload=5420]: Upload finished. err: metaclient: context deadline exceeded Duration: 30.000669069s core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 4 out of 60 is failed (threshold=3) [..............................X........XX...X...............] duration: 23.598259ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-07 21:43:37 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 23.631302ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 37 out of 60 is failed (threshold=3) [....................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XX..] duration: 8.887797992s FAIL (2025-08-07 21:43:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 8.887814453s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 19 out of 60 is failed (threshold=3) [.......................................XXXXXXXXXXXXXXXXX.XX.] duration: 22.452922236s FAIL (2025-08-07 21:43:36 UTC) operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== address=104.36.82.12:4172 , piece_id=2SN23SJESN46DLA25WJULJLVGE7QWLQW2QJFAUA3WUVICJ5CKLUA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.023027314 (5h13m59.610083535s) [noise=true , address=104.36.82.54:4183 , piece_id=ZOCQQFJKFATMPRR2PKHLTSWN2D3QXAMZ74K2A5KTKYQAHEGA2BUA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.023255801 (5h13m59.610312012s) [noise=true , address=104.36.82.37:4663 , piece_id=XOIJUGNOKJJVWQ4226IL67H73DVYH7VBSIKI4BQSMOIGYNY7MO7A, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.023462957 (5h13m59.610519169s) [noise=true , address=104.36.82.60:4367 , piece_id=IRTAFXB5WIGLKZE4HQE7UW7J5OSZSIQK7TGY447RFZD7FCIAYQVQ, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.023666096 (5h13m59.610722308s) [noise=true , address=64.49.13.140:4511 , piece_id=A7AQ3VPKYONSOWW2YUPGWAXTMA4JPGBG4CQVYCK6PFFIFFUGPMHA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.023880075 (5h13m59.610936287s) [noise=true , address=104.36.82.23:4474 , piece_id=TDLXCBP5IPHILGHJYQD4DXYRMLL2VS2ER3ECEBAXOBTUAMR67BBA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.024106408 (5h13m59.611162629s) [noise=true , address=104.36.82.58:4269 , piece_id=4I2ROAYRNHMC53OKVWWXCS4FULL2XZ6CG5WZUPOLQ4UNELQDHHOA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.024332290 (5h13m59.611388511s) [noise=true , address=104.36.82.16:4305 , piece_id=K5YI7X35EAPFSOANSPQERKCHUOO6GDZZWKAOFNYGM6R3PA6K2LWA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.024539145 (5h13m59.611595357s) [noise=true , address=104.36.82.36:4623 , piece_id=ONIDD2KMXGVLKCD5YFBVUMMF2ORGVLFDV4LG3TRKRSINURIDAAFA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.024749439 (5h13m59.61180566s) [noise=true , address=104.36.82.43:4850 , piece_id=XWPXP7HKO2ZH22MMIODDLHM3LPIIPQP3Y3FLZ54XMMWOIN7JIADA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.024973778 (5h13m59.612029999s) [noise=true , address=45.91.116.9:4266 , piece_id=VOPNPD4GIHS2VOYBWCCTR7LX3YKL4BCZLW4XMROMAWU4WYUJ52WA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.025220337 (5h13m59.612276558s) [noise=true , address=104.36.82.15:4275 , piece_id=HCH5IC5PTQ7NCSWPJJC5OOEPEIMA34ZL6E5QPQPCDB2P2FEO6JYA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.105422677 (5h13m59.692478898s) [upload=5382]: Next returned nil segment Aug 7 21:40:46.105438417 (5h13m59.692494638s) [upload=5382]: Waiting for error group managing segments... Aug 7 21:40:46.115255601 (5h13m59.702311812s) [noise=true , address=45.91.116.9:4266 , piece_id=VOPNPD4GIHS2VOYBWCCTR7LX3YKL4BCZLW4XMROMAWU4WYUJ52WA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.123052245 (5h13m59.710108455s) [noise=true , address=104.36.82.16:4305 , piece_id=K5YI7X35EAPFSOANSPQERKCHUOO6GDZZWKAOFNYGM6R3PA6K2LWA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.123065018 (5h13m59.710121239s) [noise=true , address=104.36.82.37:4663 , piece_id=XOIJUGNOKJJVWQ4226IL67H73DVYH7VBSIKI4BQSMOIGYNY7MO7A, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.135955971 (5h13m59.723012192s) [noise=true , address=104.36.82.58:4269 , piece_id=4I2ROAYRNHMC53OKVWWXCS4FULL2XZ6CG5WZUPOLQ4UNELQDHHOA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.139757077 (5h13m59.726813288s) [noise=true , address=104.36.82.44:4891 , piece_id=D33W4EHVQ26LIOJ2KG5RKUHRZSGXAIGS2PQSIURYKGMP63RBTBGA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.148928486 (5h13m59.735984697s) [noise=true , address=104.36.82.15:4275 , piece_id=HCH5IC5PTQ7NCSWPJJC5OOEPEIMA34ZL6E5QPQPCDB2P2FEO6JYA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.149227595 (5h13m59.736283816s) [noise=true , address=104.36.82.36:4623 , piece_id=ONIDD2KMXGVLKCD5YFBVUMMF2ORGVLFDV4LG3TRKRSINURIDAAFA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.157435446 (5h13m59.744491657s) [noise=true , address=104.36.82.54:4183 , piece_id=ZOCQQFJKFATMPRR2PKHLTSWN2D3QXAMZ74K2A5KTKYQAHEGA2BUA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.193659694 (5h13m59.780715905s) [noise=true , address=104.36.82.60:4367 , piece_id=IRTAFXB5WIGLKZE4HQE7UW7J5OSZSIQK7TGY447RFZD7FCIAYQVQ, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.198544171 (5h13m59.785600382s) [noise=true , address=104.36.82.12:4172 , piece_id=2SN23SJESN46DLA25WJULJLVGE7QWLQW2QJFAUA3WUVICJ5CKLUA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.200016058 (5h13m59.787072279s) [noise=true , address=104.36.82.14:4228 , piece_id=USWUBYJMTZKFFN3DZIKQQD7PW6QAKBRUHJZRCBO4DXTHR2PQDHRQ, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.224817695 (5h13m59.811873916s) [noise=true , address=104.36.82.43:4850 , piece_id=XWPXP7HKO2ZH22MMIODDLHM3LPIIPQP3Y3FLZ54XMMWOIN7JIADA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.225279788 (5h13m59.812336009s) [noise=true , address=104.36.82.61:4383 , piece_id=ELAHQPPPJCCLCQYXDEOS62V6TOMV5NOCMUU5XZFCQ23Y6SQUWG6Q, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.305784060 (5h13m59.892840282s) [noise=true , address=104.36.82.43:4863 , piece_id=PWAZUY75NQILRAVGRSMJSFKPOPLR3WQ5O3Q47GZ5U37KXPXJ3ORQ, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.305806102 (5h13m59.892862323s) [seg_pos={0 0}, upload=5382]: Segment reached optimal threshold of 14 pieces. Aug 7 21:40:46.305952956 (5h13m59.893009177s) [noise=true , address=104.36.82.56:4261 , piece_id=Z27LNZSXSYSUMQXEW2DI3C54ZJK26ALV653EINMYNU6COTMAMPBA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YNKaVEsXzHe6XGQuv6wR1qqbv6dbzg1xT5Aqkew2ZV3z3tMMf): protocol: expected piece hash; context canceled; EOF Aug 7 21:40:46.306110209 (5h13m59.89316642s) [noise=true , address=64.49.13.139:4471 , piece_id=2OSYONIOJUEZXMYFSTL7NRN7HG6KXJOHFUL7TIDW73C4VKYF3W3A, seg_pos={0 0}, upload=5382]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:26750->64.49.13.139:4471: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 21:40:46.306163639 (5h13m59.89321985s) [noise=true , address=104.36.82.23:4474 , piece_id=TDLXCBP5IPHILGHJYQD4DXYRMLL2VS2ER3ECEBAXOBTUAMR67BBA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: write tcp 5.161.89.252:22402->104.36.82.23:4474: use of closed network connection; write tcp 5.161.89.252:22402->104.36.82.23:4474: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:22402->104.36.82.23:4474: use of closed network connection Aug 7 21:40:46.306206098 (5h13m59.893262319s) [noise=true , address=64.49.13.140:4511 , piece_id=A7AQ3VPKYONSOWW2YUPGWAXTMA4JPGBG4CQVYCK6PFFIFFUGPMHA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: read tcp 5.161.89.252:31920->64.49.13.140:4511: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 21:40:46.306226506 (5h13m59.893282717s) [seg_pos={0 0}, upload=5382]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 21:40:46.306282762 (5h13m59.893338983s) [upload=5382]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 21:40:46.306286799 (5h13m59.89334301s) [upload=5382]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:40:57.774588980 (5h14m11.361645201s) [upload=5382]: Done uploading segments... Aug 7 21:40:57.774603057 (5h14m11.361659278s) [upload=5382]: Upload finished. err: <nil> Aug 7 21:41:10.210507562 (5h14m23.797563803s) [upload=5386]: Starting upload Aug 7 21:41:10.210589415 (5h14m23.797645655s) [upload=5386]: Done starting upload Aug 7 21:41:10.210669645 (5h14m23.797725856s) [upload=5386]: Uploading segments... Aug 7 21:41:10.210963293 (5h14m23.798019534s) [upload=5386]: Got next segment. Inline: false Aug 7 21:41:10.211025149 (5h14m23.79808139s) [upload=5386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:41:10.211035066 (5h14m23.798091308s) [upload=5386]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 21:42:10.197934627 (5h15m23.784990848s) [upload=5386]: Next segment err: context deadline exceeded Aug 7 21:42:10.198070280 (5h15m23.785126501s) [upload=5386]: Done uploading segments... Aug 7 21:42:10.198139409 (5h15m23.78519562s) [upload=5386]: Upload finished. err: context deadline exceeded Aug 7 21:42:14.127516635 (5h15m27.714572846s) [upload=5403]: Starting upload Aug 7 21:42:14.127582357 (5h15m27.714638569s) [upload=5403]: Done starting upload Aug 7 21:42:14.127692983 (5h15m27.714749204s) [upload=5403]: Uploading segments... Aug 7 21:42:14.127793461 (5h15m27.714849672s) [upload=5403]: Got next segment. Inline: false Aug 7 21:42:14.127840750 (5h15m27.714896961s) [upload=5403]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:42:14.127846281 (5h15m27.714902491s) [upload=5403]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 21:43:14.115648400 (5h16m27.702704611s) [upload=5403]: Next segment err: context deadline exceeded Aug 7 21:43:14.115816064 (5h16m27.702872275s) [upload=5403]: Done uploading segments... Aug 7 21:43:14.115831182 (5h16m27.702887403s) [upload=5403]: Upload finished. err: context deadline exceeded Duration: 22.452941222s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 40 out of 60 is failed (threshold=3) [.................XX..XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.] duration: 484.361399ms FAIL (2025-08-07 21:43:35 UTC) operation: Commit uplink: metaclient: context deadline exceeded Duration: 484.387778ms core uplink us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 3 out of 60 is failed (threshold=3) [............................................X...X...X.......] duration: 126.579259ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-07 21:43:31 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": context deadline exceeded Duration: 126.624993ms edge gateway vhost bgp us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 37 out of 60 is failed (threshold=3) [.....................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX..] duration: 208.983228ms FAIL (2025-08-07 21:43:26 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 209.004048ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 28 out of 60 is failed (threshold=3) [...............................XXXXXXXXXXXXXXXXXXXXXXXXXXXX.] duration: 197.736704ms FAIL (2025-08-07 21:43:22 UTC) operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:33:09.996864149 (5h6m23.58392037s) [upload=5253]: Starting upload Aug 7 21:33:09.996931725 (5h6m23.583987946s) [upload=5253]: Done starting upload Aug 7 21:33:09.996981849 (5h6m23.58403807s) [upload=5253]: Uploading segments... Aug 7 21:33:09.997031481 (5h6m23.584087702s) [upload=5253]: Got next segment. Inline: true Aug 7 21:33:09.997035519 (5h6m23.58409174s) [upload=5253]: Waiting for error group managing segments... Aug 7 21:33:09.997069202 (5h6m23.584125423s) [upload=5253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:33:09.997073270 (5h6m23.58412948s) [upload=5253]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:33:09.997075754 (5h6m23.584131965s) [upload=5253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:34:09.982031009 (5h7m23.56908725s) [upload=5253]: Done uploading segments... Aug 7 21:34:09.982059972 (5h7m23.569116213s) [upload=5253]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:34:10.069393604 (5h7m23.656449814s) [upload=5272]: Starting upload Aug 7 21:34:10.069444327 (5h7m23.656500539s) [upload=5272]: Done starting upload Aug 7 21:34:10.069485265 (5h7m23.656541486s) [upload=5272]: Uploading segments... Aug 7 21:34:10.069514979 (5h7m23.65657119s) [upload=5272]: Got next segment. Inline: true Aug 7 21:34:10.069518766 (5h7m23.656574978s) [upload=5272]: Waiting for error group managing segments... Aug 7 21:34:10.069549243 (5h7m23.656605464s) [upload=5272]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:34:10.069552840 (5h7m23.656609061s) [upload=5272]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:34:10.069555245 (5h7m23.656611456s) [upload=5272]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:35:10.049493169 (5h8m23.63654939s) [upload=5272]: Done uploading segments... Aug 7 21:35:10.049531101 (5h8m23.636587322s) [upload=5272]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:35:15.032246862 (5h8m28.619303102s) [upload=5292]: Starting upload Aug 7 21:35:15.032327261 (5h8m28.619383502s) [upload=5292]: Done starting upload Aug 7 21:35:15.032391071 (5h8m28.619447312s) [upload=5292]: Uploading segments... Aug 7 21:35:15.032434000 (5h8m28.619490242s) [upload=5292]: Got next segment. Inline: true Aug 7 21:35:15.032439461 (5h8m28.619495711s) [upload=5292]: Waiting for error group managing segments... Aug 7 21:35:15.032484926 (5h8m28.619541167s) [upload=5292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:35:15.032491267 (5h8m28.619547509s) [upload=5292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:35:15.032494834 (5h8m28.619551085s) [upload=5292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:36:15.017690007 (5h9m28.604746248s) [upload=5292]: Done uploading segments... Aug 7 21:36:15.017709373 (5h9m28.604765615s) [upload=5292]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:36:15.108542356 (5h9m28.695598567s) [upload=5309]: Starting upload Aug 7 21:36:15.108597850 (5h9m28.695654061s) [upload=5309]: Done starting upload Aug 7 21:36:15.108645098 (5h9m28.695701319s) [upload=5309]: Uploading segments... Aug 7 21:36:15.108673942 (5h9m28.695730153s) [upload=5309]: Got next segment. Inline: true Aug 7 21:36:15.108677278 (5h9m28.695733499s) [upload=5309]: Waiting for error group managing segments... Aug 7 21:36:15.108708507 (5h9m28.695764728s) [upload=5309]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:36:15.108712334 (5h9m28.695768555s) [upload=5309]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:36:15.108714538 (5h9m28.695770759s) [upload=5309]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:37:15.091220957 (5h10m28.678277188s) [upload=5309]: Done uploading segments... Aug 7 21:37:15.091240674 (5h10m28.678296905s) [upload=5309]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:37:15.177436931 (5h10m28.764493172s) [upload=5324]: Starting upload Aug 7 21:37:15.177533852 (5h10m28.764590103s) [upload=5324]: Done starting upload Aug 7 21:37:15.177602810 (5h10m28.764659061s) [upload=5324]: Uploading segments... Aug 7 21:37:15.177645340 (5h10m28.764701581s) [upload=5324]: Got next segment. Inline: true Aug 7 21:37:15.177650961 (5h10m28.764707202s) [upload=5324]: Waiting for error group managing segments... Aug 7 21:37:15.177698649 (5h10m28.76475489s) [upload=5324]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:37:15.177704300 (5h10m28.764760541s) [upload=5324]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:37:15.177708177 (5h10m28.764764428s) [upload=5324]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:37:40.730185715 (5h10m54.317241957s) [upload=5324]: Done uploading segments... Aug 7 21:37:40.730203639 (5h10m54.31725988s) [upload=5324]: Upload finished. err: <nil> Aug 7 21:38:15.287715124 (5h11m28.874771365s) [upload=5341]: Starting upload Aug 7 21:38:15.287780276 (5h11m28.874836516s) [upload=5341]: Done starting upload Aug 7 21:38:15.287844856 (5h11m28.874901107s) [upload=5341]: Uploading segments... Aug 7 21:38:15.287889961 (5h11m28.874946201s) [upload=5341]: Got next segment. Inline: true Aug 7 21:38:15.287895600 (5h11m28.874951842s) [upload=5341]: Waiting for error group managing segments... Aug 7 21:38:15.287984066 (5h11m28.875040317s) [upload=5341]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:38:15.287990077 (5h11m28.875046318s) [upload=5341]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:38:15.287993564 (5h11m28.875049804s) [upload=5341]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:39:15.275679218 (5h12m28.862735459s) [upload=5341]: Done uploading segments... Aug 7 21:39:15.275708622 (5h12m28.862764883s) [upload=5341]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:39:15.358605080 (5h12m28.945661322s) [upload=5358]: Starting upload Aug 7 21:39:15.358690641 (5h12m28.945746882s) [upload=5358]: Done starting upload Aug 7 21:39:15.358748869 (5h12m28.945805111s) [upload=5358]: Uploading segments... Aug 7 21:39:15.358790938 (5h12m28.94584718s) [upload=5358]: Got next segment. Inline: true Aug 7 21:39:15.358796779 (5h12m28.94585302s) [upload=5358]: Waiting for error group managing segments... Aug 7 21:39:15.358840480 (5h12m28.945896721s) [upload=5358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:39:15.358846441 (5h12m28.945902683s) [upload=5358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:39:15.358849918 (5h12m28.945906159s) [upload=5358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:40:15.344303433 (5h13m28.931359654s) [upload=5358]: Done uploading segments... Aug 7 21:40:15.344323120 (5h13m28.931379331s) [upload=5358]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:40:15.438334176 (5h13m29.025390397s) [upload=5373]: Starting upload Aug 7 21:40:15.438379379 (5h13m29.025435601s) [upload=5373]: Done starting upload Aug 7 21:40:15.438418503 (5h13m29.025474714s) [upload=5373]: Uploading segments... Aug 7 21:40:15.438447206 (5h13m29.025503427s) [upload=5373]: Got next segment. Inline: true Aug 7 21:40:15.438450683 (5h13m29.025506894s) [upload=5373]: Waiting for error group managing segments... Aug 7 21:40:15.438481920 (5h13m29.025538141s) [upload=5373]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:40:15.438487511 (5h13m29.025543722s) [upload=5373]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:40:15.438489826 (5h13m29.025546047s) [upload=5373]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:41:15.423387101 (5h14m29.010443342s) [upload=5373]: Done uploading segments... Aug 7 21:41:15.423408011 (5h14m29.010464251s) [upload=5373]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:41:15.514709386 (5h14m29.101765628s) [upload=5390]: Starting upload Aug 7 21:41:15.514790870 (5h14m29.10184711s) [upload=5390]: Done starting upload Aug 7 21:41:15.514852845 (5h14m29.101909086s) [upload=5390]: Uploading segments... Aug 7 21:41:15.514892409 (5h14m29.10194865s) [upload=5390]: Got next segment. Inline: true Aug 7 21:41:15.514898240 (5h14m29.101954481s) [upload=5390]: Waiting for error group managing segments... Aug 7 21:41:15.514941951 (5h14m29.101998192s) [upload=5390]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:41:15.514947551 (5h14m29.102003793s) [upload=5390]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:41:15.514951138 (5h14m29.102007389s) [upload=5390]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:42:15.497042181 (5h15m29.084098402s) [upload=5390]: Done uploading segments... Aug 7 21:42:15.497058301 (5h15m29.084114512s) [upload=5390]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:42:15.596278951 (5h15m29.183335172s) [upload=5404]: Starting upload Aug 7 21:42:15.596337329 (5h15m29.183393541s) [upload=5404]: Done starting upload Aug 7 21:42:15.596382114 (5h15m29.183438324s) [upload=5404]: Uploading segments... Aug 7 21:42:15.596411919 (5h15m29.18346814s) [upload=5404]: Got next segment. Inline: true Aug 7 21:42:15.596415937 (5h15m29.183472158s) [upload=5404]: Waiting for error group managing segments... Aug 7 21:42:15.596447405 (5h15m29.183503626s) [upload=5404]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:42:15.596451042 (5h15m29.183507263s) [upload=5404]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:42:15.596453266 (5h15m29.183509487s) [upload=5404]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:43:15.584735444 (5h16m29.171791655s) [upload=5404]: Done uploading segments... Aug 7 21:43:15.584747787 (5h16m29.171804008s) [upload=5404]: Upload finished. err: metaclient: context deadline exceeded Duration: 197.759046ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 35 out of 60 is failed (threshold=3) [......................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX..X.] duration: 3.776011906s FAIL (2025-08-07 21:43:19 UTC) operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== 7 (5h14m28.062269058s) [upload=5388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:41:25.266685321 (5h14m38.853741562s) [upload=5388]: Done uploading segments... Aug 7 21:41:25.266706391 (5h14m38.853762631s) [upload=5388]: Upload finished. err: <nil> Aug 7 21:41:41.070176076 (5h14m54.657232316s) [upload=5396]: Starting upload Aug 7 21:41:41.070246557 (5h14m54.657302798s) [upload=5396]: Done starting upload Aug 7 21:41:41.070459143 (5h14m54.657515385s) [upload=5396]: Uploading segments... Aug 7 21:41:41.070697238 (5h14m54.657753479s) [upload=5396]: Got next segment. Inline: false Aug 7 21:41:41.070732264 (5h14m54.657788505s) [upload=5396]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:41:41.070737293 (5h14m54.657793524s) [upload=5396]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 21:41:41.825834701 (5h14m55.412890922s) [seg_pos={0 0}, upload=5396]: Begin upload segment... Aug 7 21:41:41.825865027 (5h14m55.412921237s) [seg_pos={0 0}, upload=5396]: Done begin upload segment. Aug 7 21:41:41.825886015 (5h14m55.412942237s) [noise=true , address=77.90.31.12:4592 , piece_id=75OFHQZRJKZYL3QJ37T6QLDED663WXIEFAHTH2BQZLZ46PY5YPLQ, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.825988818 (5h14m55.413045068s) [noise=true , address=45.91.116.5:4298 , piece_id=C3BQRSMSRSM4FJ7SWEBPHH7UKNUJWCDD5AEEBEAYN6OMCM2VRSWA, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.826203979 (5h14m55.413260201s) [noise=true , address=45.91.116.4:4937 , piece_id=BYNKX2DGOGITTOYV7IH73WDLAPXHXWG5V5WFIJDTM5RUJQYP6MLQ, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.826435742 (5h14m55.413491953s) [noise=true , address=77.90.31.13:4627 , piece_id=7MG24AD6AUVL6X66RZJ43OSAM7FLBB33KQY4ENE4Q3NR6PA63YQQ, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.826541530 (5h14m55.41359777s) [noise=true , address=45.91.116.5:4299 , piece_id=XY3RW62XNQVLM6NTAZTBF26HWTY5KR3ZEJGVYTSTENY2B77YLBMA, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.826653037 (5h14m55.413709248s) [noise=true , address=77.90.31.14:4661 , piece_id=U3YYDMWVGG4NEV5OSK4ATJ2RNTEYCIXKH3KXY7UR3RGJXEUA25IA, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.826875332 (5h14m55.413931543s) [noise=true , address=77.90.31.10:4519 , piece_id=OQZPQPV2NUVKLMSHONEMH2HUK52KXL2E6NXXSO2J6CP7IDTRVT7Q, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.826921499 (5h14m55.41397774s) [noise=true , address=104.36.82.11:4114 , piece_id=KB2SDFXXBJDEYUHUNIO3YSANNDXVREF46SGOSWQ3YBHRR42TFD4A, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.827091606 (5h14m55.414147827s) [noise=true , address=45.91.116.4:4940 , piece_id=ETERKOUZIHEOKPCAJPSUBGXFMDLKEELCVMIW34LR7G66FBFMUNTA, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.827323819 (5h14m55.41438003s) [noise=true , address=77.90.31.17:4771 , piece_id=IYUYS3YHOD44ZF2OGKQX7JCFVW2GBU5S2TVC3FZ2M3JNF67TP4CQ, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.827393500 (5h14m55.414449742s) [noise=true , address=104.36.82.6:4875 , piece_id=B263E3OQZQDAAYHN3YIPJ4RBLTNOFNOXAZWYTVEGGVRM2YES3PBQ, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.827542938 (5h14m55.414599159s) [noise=true , address=104.36.82.7:4911 , piece_id=GLWOEWKACQVRHXQ6EY45IYR5N7VCP75FUZIYT5WRQG2VXULRUIUA, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.827778078 (5h14m55.414834318s) [noise=true , address=104.36.82.10:4077 , piece_id=LZBNWOC4E35SX6FKBLATK2QFZDUWA7CBA5RY422YHVMMKO5XDSBQ, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.827801491 (5h14m55.414857712s) [noise=true , address=104.36.82.5:4837 , piece_id=32VX7X2CPAQKJGKQYNDUF2U6GPAWZKEWYALRTRSFC6TPIQJBBXCQ, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.828365735 (5h14m55.415421976s) [noise=true , address=45.91.116.8:4048 , piece_id=XZNUB5SDPWSYVGHGMFFQZ4BZMBP2GMKF76GXWQ2MXAGT42I6I4FQ, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.828913136 (5h14m55.415969378s) [noise=true , address=104.36.82.2:4732 , piece_id=2HK2G5XCNE6UN3COUOG6V4IVCLTRVEMNNCQMV5SZLXRFTO2FJUYQ, seg_pos={0 0}, upload=5396]: Uploading piece... Aug 7 21:41:41.934607129 (5h14m55.52166334s) [upload=5396]: Next returned nil segment Aug 7 21:41:41.934619282 (5h14m55.521675503s) [upload=5396]: Waiting for error group managing segments... Aug 7 21:41:41.945118551 (5h14m55.532174772s) [noise=true , address=45.91.116.4:4940 , piece_id=ETERKOUZIHEOKPCAJPSUBGXFMDLKEELCVMIW34LR7G66FBFMUNTA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.945901252 (5h14m55.532957473s) [noise=true , address=45.91.116.8:4048 , piece_id=XZNUB5SDPWSYVGHGMFFQZ4BZMBP2GMKF76GXWQ2MXAGT42I6I4FQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.946161258 (5h14m55.533217498s) [noise=true , address=45.91.116.5:4298 , piece_id=C3BQRSMSRSM4FJ7SWEBPHH7UKNUJWCDD5AEEBEAYN6OMCM2VRSWA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.946386648 (5h14m55.533442869s) [noise=true , address=77.90.31.12:4592 , piece_id=75OFHQZRJKZYL3QJ37T6QLDED663WXIEFAHTH2BQZLZ46PY5YPLQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.949024992 (5h14m55.536081243s) [noise=true , address=45.91.116.5:4299 , piece_id=XY3RW62XNQVLM6NTAZTBF26HWTY5KR3ZEJGVYTSTENY2B77YLBMA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.949218724 (5h14m55.536274945s) [noise=true , address=45.91.116.4:4937 , piece_id=BYNKX2DGOGITTOYV7IH73WDLAPXHXWG5V5WFIJDTM5RUJQYP6MLQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.949657033 (5h14m55.536713244s) [noise=true , address=77.90.31.13:4627 , piece_id=7MG24AD6AUVL6X66RZJ43OSAM7FLBB33KQY4ENE4Q3NR6PA63YQQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.949683371 (5h14m55.536739612s) [noise=true , address=104.36.82.2:4732 , piece_id=2HK2G5XCNE6UN3COUOG6V4IVCLTRVEMNNCQMV5SZLXRFTO2FJUYQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.950070354 (5h14m55.537126575s) [noise=true , address=104.36.82.11:4114 , piece_id=KB2SDFXXBJDEYUHUNIO3YSANNDXVREF46SGOSWQ3YBHRR42TFD4A, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.953623165 (5h14m55.540679407s) [noise=true , address=104.36.82.6:4875 , piece_id=B263E3OQZQDAAYHN3YIPJ4RBLTNOFNOXAZWYTVEGGVRM2YES3PBQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.957708261 (5h14m55.544764482s) [noise=true , address=104.36.82.5:4837 , piece_id=32VX7X2CPAQKJGKQYNDUF2U6GPAWZKEWYALRTRSFC6TPIQJBBXCQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.964243811 (5h14m55.551300021s) [noise=true , address=77.90.31.10:4519 , piece_id=OQZPQPV2NUVKLMSHONEMH2HUK52KXL2E6NXXSO2J6CP7IDTRVT7Q, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.964842018 (5h14m55.551898239s) [noise=true , address=77.90.31.14:4661 , piece_id=U3YYDMWVGG4NEV5OSK4ATJ2RNTEYCIXKH3KXY7UR3RGJXEUA25IA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: <nil> Aug 7 21:41:41.964860783 (5h14m55.551917004s) [seg_pos={0 0}, upload=5396]: Segment reached optimal threshold of 13 pieces. Aug 7 21:41:41.964962292 (5h14m55.552018503s) [noise=true , address=77.90.31.17:4771 , piece_id=IYUYS3YHOD44ZF2OGKQX7JCFVW2GBU5S2TVC3FZ2M3JNF67TP4CQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2): protocol: expected piece hash; context canceled; EOF Aug 7 21:41:41.965019739 (5h14m55.55207595s) [noise=true , address=104.36.82.10:4077 , piece_id=LZBNWOC4E35SX6FKBLATK2QFZDUWA7CBA5RY422YHVMMKO5XDSBQ, seg_pos={0 0}, upload=5396]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk): protocol: expected piece hash; context canceled; EOF Aug 7 21:41:41.965087696 (5h14m55.552143947s) [noise=true , address=104.36.82.7:4911 , piece_id=GLWOEWKACQVRHXQ6EY45IYR5N7VCP75FUZIYT5WRQG2VXULRUIUA, seg_pos={0 0}, upload=5396]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu): protocol: expected piece hash; context canceled; EOF Aug 7 21:41:41.965118783 (5h14m55.552175005s) [seg_pos={0 0}, upload=5396]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 21:41:41.965239138 (5h14m55.552295349s) [upload=5396]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 21:41:41.965243687 (5h14m55.552299898s) [upload=5396]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:41:46.509965896 (5h15m0.097022118s) [upload=5396]: Done uploading segments... Aug 7 21:41:46.510002955 (5h15m0.097059167s) [upload=5396]: Upload finished. err: <nil> Aug 7 21:42:01.196715658 (5h15m14.783771899s) [upload=5401]: Starting upload Aug 7 21:42:01.196842946 (5h15m14.783899187s) [upload=5401]: Done starting upload Aug 7 21:42:01.196915852 (5h15m14.783972103s) [upload=5401]: Uploading segments... Aug 7 21:42:01.197283067 (5h15m14.784339309s) [upload=5401]: Got next segment. Inline: false Aug 7 21:42:01.197355652 (5h15m14.784411984s) [upload=5401]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:42:01.197365230 (5h15m14.784421472s) [upload=5401]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 21:42:31.170606605 (5h15m44.757662826s) [upload=5401]: Next segment err: context deadline exceeded Aug 7 21:42:31.170727651 (5h15m44.757783872s) [upload=5401]: Done uploading segments... Aug 7 21:42:31.170749551 (5h15m44.757805773s) [upload=5401]: Upload finished. err: context deadline exceeded Duration:* 3.77603552s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 37 out of 60 is failed (threshold=3) [.....................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XX.] duration: 20.271372254s FAIL (2025-08-07 21:43:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 20.271393504s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 4 out of 60 is failed (threshold=3) [...............................X........XX...X..............] duration: 31.761517ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-07 21:43:16 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 31.780072ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 28 out of 60 is failed (threshold=3) [................................XXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 1m0.000279672s FAIL (2025-08-07 21:43:15 UTC) operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:33:09.996864149 (5h6m23.58392037s) [upload=5253]: Starting upload Aug 7 21:33:09.996931725 (5h6m23.583987946s) [upload=5253]: Done starting upload Aug 7 21:33:09.996981849 (5h6m23.58403807s) [upload=5253]: Uploading segments... Aug 7 21:33:09.997031481 (5h6m23.584087702s) [upload=5253]: Got next segment. Inline: true Aug 7 21:33:09.997035519 (5h6m23.58409174s) [upload=5253]: Waiting for error group managing segments... Aug 7 21:33:09.997069202 (5h6m23.584125423s) [upload=5253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:33:09.997073270 (5h6m23.58412948s) [upload=5253]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:33:09.997075754 (5h6m23.584131965s) [upload=5253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:34:09.982031009 (5h7m23.56908725s) [upload=5253]: Done uploading segments... Aug 7 21:34:09.982059972 (5h7m23.569116213s) [upload=5253]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:34:10.069393604 (5h7m23.656449814s) [upload=5272]: Starting upload Aug 7 21:34:10.069444327 (5h7m23.656500539s) [upload=5272]: Done starting upload Aug 7 21:34:10.069485265 (5h7m23.656541486s) [upload=5272]: Uploading segments... Aug 7 21:34:10.069514979 (5h7m23.65657119s) [upload=5272]: Got next segment. Inline: true Aug 7 21:34:10.069518766 (5h7m23.656574978s) [upload=5272]: Waiting for error group managing segments... Aug 7 21:34:10.069549243 (5h7m23.656605464s) [upload=5272]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:34:10.069552840 (5h7m23.656609061s) [upload=5272]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:34:10.069555245 (5h7m23.656611456s) [upload=5272]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:35:10.049493169 (5h8m23.63654939s) [upload=5272]: Done uploading segments... Aug 7 21:35:10.049531101 (5h8m23.636587322s) [upload=5272]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:35:15.032246862 (5h8m28.619303102s) [upload=5292]: Starting upload Aug 7 21:35:15.032327261 (5h8m28.619383502s) [upload=5292]: Done starting upload Aug 7 21:35:15.032391071 (5h8m28.619447312s) [upload=5292]: Uploading segments... Aug 7 21:35:15.032434000 (5h8m28.619490242s) [upload=5292]: Got next segment. Inline: true Aug 7 21:35:15.032439461 (5h8m28.619495711s) [upload=5292]: Waiting for error group managing segments... Aug 7 21:35:15.032484926 (5h8m28.619541167s) [upload=5292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:35:15.032491267 (5h8m28.619547509s) [upload=5292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:35:15.032494834 (5h8m28.619551085s) [upload=5292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:36:15.017690007 (5h9m28.604746248s) [upload=5292]: Done uploading segments... Aug 7 21:36:15.017709373 (5h9m28.604765615s) [upload=5292]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:36:15.108542356 (5h9m28.695598567s) [upload=5309]: Starting upload Aug 7 21:36:15.108597850 (5h9m28.695654061s) [upload=5309]: Done starting upload Aug 7 21:36:15.108645098 (5h9m28.695701319s) [upload=5309]: Uploading segments... Aug 7 21:36:15.108673942 (5h9m28.695730153s) [upload=5309]: Got next segment. Inline: true Aug 7 21:36:15.108677278 (5h9m28.695733499s) [upload=5309]: Waiting for error group managing segments... Aug 7 21:36:15.108708507 (5h9m28.695764728s) [upload=5309]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:36:15.108712334 (5h9m28.695768555s) [upload=5309]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:36:15.108714538 (5h9m28.695770759s) [upload=5309]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:37:15.091220957 (5h10m28.678277188s) [upload=5309]: Done uploading segments... Aug 7 21:37:15.091240674 (5h10m28.678296905s) [upload=5309]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:37:15.177436931 (5h10m28.764493172s) [upload=5324]: Starting upload Aug 7 21:37:15.177533852 (5h10m28.764590103s) [upload=5324]: Done starting upload Aug 7 21:37:15.177602810 (5h10m28.764659061s) [upload=5324]: Uploading segments... Aug 7 21:37:15.177645340 (5h10m28.764701581s) [upload=5324]: Got next segment. Inline: true Aug 7 21:37:15.177650961 (5h10m28.764707202s) [upload=5324]: Waiting for error group managing segments... Aug 7 21:37:15.177698649 (5h10m28.76475489s) [upload=5324]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:37:15.177704300 (5h10m28.764760541s) [upload=5324]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:37:15.177708177 (5h10m28.764764428s) [upload=5324]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:37:40.730185715 (5h10m54.317241957s) [upload=5324]: Done uploading segments... Aug 7 21:37:40.730203639 (5h10m54.31725988s) [upload=5324]: Upload finished. err: <nil> Aug 7 21:38:15.287715124 (5h11m28.874771365s) [upload=5341]: Starting upload Aug 7 21:38:15.287780276 (5h11m28.874836516s) [upload=5341]: Done starting upload Aug 7 21:38:15.287844856 (5h11m28.874901107s) [upload=5341]: Uploading segments... Aug 7 21:38:15.287889961 (5h11m28.874946201s) [upload=5341]: Got next segment. Inline: true Aug 7 21:38:15.287895600 (5h11m28.874951842s) [upload=5341]: Waiting for error group managing segments... Aug 7 21:38:15.287984066 (5h11m28.875040317s) [upload=5341]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:38:15.287990077 (5h11m28.875046318s) [upload=5341]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:38:15.287993564 (5h11m28.875049804s) [upload=5341]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:39:15.275679218 (5h12m28.862735459s) [upload=5341]: Done uploading segments... Aug 7 21:39:15.275708622 (5h12m28.862764883s) [upload=5341]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:39:15.358605080 (5h12m28.945661322s) [upload=5358]: Starting upload Aug 7 21:39:15.358690641 (5h12m28.945746882s) [upload=5358]: Done starting upload Aug 7 21:39:15.358748869 (5h12m28.945805111s) [upload=5358]: Uploading segments... Aug 7 21:39:15.358790938 (5h12m28.94584718s) [upload=5358]: Got next segment. Inline: true Aug 7 21:39:15.358796779 (5h12m28.94585302s) [upload=5358]: Waiting for error group managing segments... Aug 7 21:39:15.358840480 (5h12m28.945896721s) [upload=5358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:39:15.358846441 (5h12m28.945902683s) [upload=5358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:39:15.358849918 (5h12m28.945906159s) [upload=5358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:40:15.344303433 (5h13m28.931359654s) [upload=5358]: Done uploading segments... Aug 7 21:40:15.344323120 (5h13m28.931379331s) [upload=5358]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:40:15.438334176 (5h13m29.025390397s) [upload=5373]: Starting upload Aug 7 21:40:15.438379379 (5h13m29.025435601s) [upload=5373]: Done starting upload Aug 7 21:40:15.438418503 (5h13m29.025474714s) [upload=5373]: Uploading segments... Aug 7 21:40:15.438447206 (5h13m29.025503427s) [upload=5373]: Got next segment. Inline: true Aug 7 21:40:15.438450683 (5h13m29.025506894s) [upload=5373]: Waiting for error group managing segments... Aug 7 21:40:15.438481920 (5h13m29.025538141s) [upload=5373]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:40:15.438487511 (5h13m29.025543722s) [upload=5373]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:40:15.438489826 (5h13m29.025546047s) [upload=5373]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:41:15.423387101 (5h14m29.010443342s) [upload=5373]: Done uploading segments... Aug 7 21:41:15.423408011 (5h14m29.010464251s) [upload=5373]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:41:15.514709386 (5h14m29.101765628s) [upload=5390]: Starting upload Aug 7 21:41:15.514790870 (5h14m29.10184711s) [upload=5390]: Done starting upload Aug 7 21:41:15.514852845 (5h14m29.101909086s) [upload=5390]: Uploading segments... Aug 7 21:41:15.514892409 (5h14m29.10194865s) [upload=5390]: Got next segment. Inline: true Aug 7 21:41:15.514898240 (5h14m29.101954481s) [upload=5390]: Waiting for error group managing segments... Aug 7 21:41:15.514941951 (5h14m29.101998192s) [upload=5390]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:41:15.514947551 (5h14m29.102003793s) [upload=5390]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:41:15.514951138 (5h14m29.102007389s) [upload=5390]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:42:15.497042181 (5h15m29.084098402s) [upload=5390]: Done uploading segments... Aug 7 21:42:15.497058301 (5h15m29.084114512s) [upload=5390]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:42:15.596278951 (5h15m29.183335172s) [upload=5404]: Starting upload Aug 7 21:42:15.596337329 (5h15m29.183393541s) [upload=5404]: Done starting upload Aug 7 21:42:15.596382114 (5h15m29.183438324s) [upload=5404]: Uploading segments... Aug 7 21:42:15.596411919 (5h15m29.18346814s) [upload=5404]: Got next segment. Inline: true Aug 7 21:42:15.596415937 (5h15m29.183472158s) [upload=5404]: Waiting for error group managing segments... Aug 7 21:42:15.596447405 (5h15m29.183503626s) [upload=5404]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:42:15.596451042 (5h15m29.183507263s) [upload=5404]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:42:15.596453266 (5h15m29.183509487s) [upload=5404]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:43:15.584735444 (5h16m29.171791655s) [upload=5404]: Done uploading segments... Aug 7 21:43:15.584747787 (5h16m29.171804008s) [upload=5404]: Upload finished. err: metaclient: context deadline exceeded Duration: 1m0.000290182s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 19 out of 60 is failed (threshold=3) [........................................XXXXXXXXXXXXXXXXX.XX] duration: 1m0.001149044s FAIL (2025-08-07 21:43:14 UTC) operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== address=104.36.82.12:4172 , piece_id=2SN23SJESN46DLA25WJULJLVGE7QWLQW2QJFAUA3WUVICJ5CKLUA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.023027314 (5h13m59.610083535s) [noise=true , address=104.36.82.54:4183 , piece_id=ZOCQQFJKFATMPRR2PKHLTSWN2D3QXAMZ74K2A5KTKYQAHEGA2BUA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.023255801 (5h13m59.610312012s) [noise=true , address=104.36.82.37:4663 , piece_id=XOIJUGNOKJJVWQ4226IL67H73DVYH7VBSIKI4BQSMOIGYNY7MO7A, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.023462957 (5h13m59.610519169s) [noise=true , address=104.36.82.60:4367 , piece_id=IRTAFXB5WIGLKZE4HQE7UW7J5OSZSIQK7TGY447RFZD7FCIAYQVQ, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.023666096 (5h13m59.610722308s) [noise=true , address=64.49.13.140:4511 , piece_id=A7AQ3VPKYONSOWW2YUPGWAXTMA4JPGBG4CQVYCK6PFFIFFUGPMHA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.023880075 (5h13m59.610936287s) [noise=true , address=104.36.82.23:4474 , piece_id=TDLXCBP5IPHILGHJYQD4DXYRMLL2VS2ER3ECEBAXOBTUAMR67BBA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.024106408 (5h13m59.611162629s) [noise=true , address=104.36.82.58:4269 , piece_id=4I2ROAYRNHMC53OKVWWXCS4FULL2XZ6CG5WZUPOLQ4UNELQDHHOA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.024332290 (5h13m59.611388511s) [noise=true , address=104.36.82.16:4305 , piece_id=K5YI7X35EAPFSOANSPQERKCHUOO6GDZZWKAOFNYGM6R3PA6K2LWA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.024539145 (5h13m59.611595357s) [noise=true , address=104.36.82.36:4623 , piece_id=ONIDD2KMXGVLKCD5YFBVUMMF2ORGVLFDV4LG3TRKRSINURIDAAFA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.024749439 (5h13m59.61180566s) [noise=true , address=104.36.82.43:4850 , piece_id=XWPXP7HKO2ZH22MMIODDLHM3LPIIPQP3Y3FLZ54XMMWOIN7JIADA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.024973778 (5h13m59.612029999s) [noise=true , address=45.91.116.9:4266 , piece_id=VOPNPD4GIHS2VOYBWCCTR7LX3YKL4BCZLW4XMROMAWU4WYUJ52WA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.025220337 (5h13m59.612276558s) [noise=true , address=104.36.82.15:4275 , piece_id=HCH5IC5PTQ7NCSWPJJC5OOEPEIMA34ZL6E5QPQPCDB2P2FEO6JYA, seg_pos={0 0}, upload=5382]: Uploading piece... Aug 7 21:40:46.105422677 (5h13m59.692478898s) [upload=5382]: Next returned nil segment Aug 7 21:40:46.105438417 (5h13m59.692494638s) [upload=5382]: Waiting for error group managing segments... Aug 7 21:40:46.115255601 (5h13m59.702311812s) [noise=true , address=45.91.116.9:4266 , piece_id=VOPNPD4GIHS2VOYBWCCTR7LX3YKL4BCZLW4XMROMAWU4WYUJ52WA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.123052245 (5h13m59.710108455s) [noise=true , address=104.36.82.16:4305 , piece_id=K5YI7X35EAPFSOANSPQERKCHUOO6GDZZWKAOFNYGM6R3PA6K2LWA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.123065018 (5h13m59.710121239s) [noise=true , address=104.36.82.37:4663 , piece_id=XOIJUGNOKJJVWQ4226IL67H73DVYH7VBSIKI4BQSMOIGYNY7MO7A, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.135955971 (5h13m59.723012192s) [noise=true , address=104.36.82.58:4269 , piece_id=4I2ROAYRNHMC53OKVWWXCS4FULL2XZ6CG5WZUPOLQ4UNELQDHHOA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.139757077 (5h13m59.726813288s) [noise=true , address=104.36.82.44:4891 , piece_id=D33W4EHVQ26LIOJ2KG5RKUHRZSGXAIGS2PQSIURYKGMP63RBTBGA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.148928486 (5h13m59.735984697s) [noise=true , address=104.36.82.15:4275 , piece_id=HCH5IC5PTQ7NCSWPJJC5OOEPEIMA34ZL6E5QPQPCDB2P2FEO6JYA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.149227595 (5h13m59.736283816s) [noise=true , address=104.36.82.36:4623 , piece_id=ONIDD2KMXGVLKCD5YFBVUMMF2ORGVLFDV4LG3TRKRSINURIDAAFA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.157435446 (5h13m59.744491657s) [noise=true , address=104.36.82.54:4183 , piece_id=ZOCQQFJKFATMPRR2PKHLTSWN2D3QXAMZ74K2A5KTKYQAHEGA2BUA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.193659694 (5h13m59.780715905s) [noise=true , address=104.36.82.60:4367 , piece_id=IRTAFXB5WIGLKZE4HQE7UW7J5OSZSIQK7TGY447RFZD7FCIAYQVQ, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.198544171 (5h13m59.785600382s) [noise=true , address=104.36.82.12:4172 , piece_id=2SN23SJESN46DLA25WJULJLVGE7QWLQW2QJFAUA3WUVICJ5CKLUA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.200016058 (5h13m59.787072279s) [noise=true , address=104.36.82.14:4228 , piece_id=USWUBYJMTZKFFN3DZIKQQD7PW6QAKBRUHJZRCBO4DXTHR2PQDHRQ, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.224817695 (5h13m59.811873916s) [noise=true , address=104.36.82.43:4850 , piece_id=XWPXP7HKO2ZH22MMIODDLHM3LPIIPQP3Y3FLZ54XMMWOIN7JIADA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.225279788 (5h13m59.812336009s) [noise=true , address=104.36.82.61:4383 , piece_id=ELAHQPPPJCCLCQYXDEOS62V6TOMV5NOCMUU5XZFCQ23Y6SQUWG6Q, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.305784060 (5h13m59.892840282s) [noise=true , address=104.36.82.43:4863 , piece_id=PWAZUY75NQILRAVGRSMJSFKPOPLR3WQ5O3Q47GZ5U37KXPXJ3ORQ, seg_pos={0 0}, upload=5382]: Done uploading piece. err: <nil> Aug 7 21:40:46.305806102 (5h13m59.892862323s) [seg_pos={0 0}, upload=5382]: Segment reached optimal threshold of 14 pieces. Aug 7 21:40:46.305952956 (5h13m59.893009177s) [noise=true , address=104.36.82.56:4261 , piece_id=Z27LNZSXSYSUMQXEW2DI3C54ZJK26ALV653EINMYNU6COTMAMPBA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YNKaVEsXzHe6XGQuv6wR1qqbv6dbzg1xT5Aqkew2ZV3z3tMMf): protocol: expected piece hash; context canceled; EOF Aug 7 21:40:46.306110209 (5h13m59.89316642s) [noise=true , address=64.49.13.139:4471 , piece_id=2OSYONIOJUEZXMYFSTL7NRN7HG6KXJOHFUL7TIDW73C4VKYF3W3A, seg_pos={0 0}, upload=5382]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129YkXH84aYSubinAC57swW24qCCEtvJTSMDGoxP9WdgpGcZxLr): protocol: read tcp 5.161.89.252:26750->64.49.13.139:4471: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 21:40:46.306163639 (5h13m59.89321985s) [noise=true , address=104.36.82.23:4474 , piece_id=TDLXCBP5IPHILGHJYQD4DXYRMLL2VS2ER3ECEBAXOBTUAMR67BBA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: write tcp 5.161.89.252:22402->104.36.82.23:4474: use of closed network connection; write tcp 5.161.89.252:22402->104.36.82.23:4474: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:22402->104.36.82.23:4474: use of closed network connection Aug 7 21:40:46.306206098 (5h13m59.893262319s) [noise=true , address=64.49.13.140:4511 , piece_id=A7AQ3VPKYONSOWW2YUPGWAXTMA4JPGBG4CQVYCK6PFFIFFUGPMHA, seg_pos={0 0}, upload=5382]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: read tcp 5.161.89.252:31920->64.49.13.140:4511: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 21:40:46.306226506 (5h13m59.893282717s) [seg_pos={0 0}, upload=5382]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 21:40:46.306282762 (5h13m59.893338983s) [upload=5382]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 21:40:46.306286799 (5h13m59.89334301s) [upload=5382]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:40:57.774588980 (5h14m11.361645201s) [upload=5382]: Done uploading segments... Aug 7 21:40:57.774603057 (5h14m11.361659278s) [upload=5382]: Upload finished. err: <nil> Aug 7 21:41:10.210507562 (5h14m23.797563803s) [upload=5386]: Starting upload Aug 7 21:41:10.210589415 (5h14m23.797645655s) [upload=5386]: Done starting upload Aug 7 21:41:10.210669645 (5h14m23.797725856s) [upload=5386]: Uploading segments... Aug 7 21:41:10.210963293 (5h14m23.798019534s) [upload=5386]: Got next segment. Inline: false Aug 7 21:41:10.211025149 (5h14m23.79808139s) [upload=5386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:41:10.211035066 (5h14m23.798091308s) [upload=5386]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 21:42:10.197934627 (5h15m23.784990848s) [upload=5386]: Next segment err: context deadline exceeded Aug 7 21:42:10.198070280 (5h15m23.785126501s) [upload=5386]: Done uploading segments... Aug 7 21:42:10.198139409 (5h15m23.78519562s) [upload=5386]: Upload finished. err: context deadline exceeded Aug 7 21:42:14.127516635 (5h15m27.714572846s) [upload=5403]: Starting upload Aug 7 21:42:14.127582357 (5h15m27.714638569s) [upload=5403]: Done starting upload Aug 7 21:42:14.127692983 (5h15m27.714749204s) [upload=5403]: Uploading segments... Aug 7 21:42:14.127793461 (5h15m27.714849672s) [upload=5403]: Got next segment. Inline: false Aug 7 21:42:14.127840750 (5h15m27.714896961s) [upload=5403]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:42:14.127846281 (5h15m27.714902491s) [upload=5403]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 21:43:14.115648400 (5h16m27.702704611s) [upload=5403]: Next segment err: context deadline exceeded Aug 7 21:43:14.115816064 (5h16m27.702872275s) [upload=5403]: Done uploading segments... Aug 7 21:43:14.115831182 (5h16m27.702887403s) [upload=5403]: Upload finished. err: context deadline exceeded Duration: 1m0.001164453s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 31 out of 60 is failed (threshold=3) [............................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.] duration: 1.90963568s FAIL (2025-08-07 21:43:11 UTC) operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 1.909664824s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 28 out of 60 is failed (threshold=3) [.............................XX.XXXXXXXXXXXXXXXXXXXXXXXXXX..] duration: 5.522915534s FAIL (2025-08-07 21:43:03 UTC) operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.523001998s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 40 out of 60 is failed (threshold=3) [..................XX..XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 30.001120562s FAIL (2025-08-07 21:42:56 UTC) operation: Commit uplink: metaclient: context deadline exceeded Duration: 30.001137975s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 31 out of 60 is failed (threshold=3) [.............................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 30.004640023s FAIL (2025-08-07 21:42:39 UTC) operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 30.004750592s core uplink us1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)