Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 17 out of 60 is failed (threshold=3) [.......X..........XX.X.X.XX....X..X...XX.XXX..........X..XX.] duration: 483.27801ms FAIL (2025-08-26 05:41:50 UTC) operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 26 05:40:50.174916229 (13h37m5.400099286s) [upload=11948]: Starting upload Aug 26 05:40:50.174950314 (13h37m5.400133371s) [upload=11948]: Done starting upload Aug 26 05:40:50.174991591 (13h37m5.400174638s) [upload=11948]: Uploading segments... Aug 26 05:40:50.175014524 (13h37m5.400197571s) [upload=11948]: Got next segment. Inline: true Aug 26 05:40:50.175017720 (13h37m5.400200767s) [upload=11948]: Waiting for error group managing segments... Aug 26 05:40:50.175043148 (13h37m5.400226195s) [upload=11948]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:40:50.175046144 (13h37m5.400229191s) [upload=11948]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:40:50.175048268 (13h37m5.400231315s) [upload=11948]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:41:09.312511333 (13h37m24.53769439s) [upload=11948]: Done uploading segments... Aug 26 05:41:09.312532192 (13h37m24.537715249s) [upload=11948]: Upload finished. err: <nil> Duration:* 483.300643ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 7 out of 60 is failed (threshold=3) [..................X.X..X.............XX...............XX....] duration: 3.518749449s FAIL (2025-08-26 05:41:48 UTC) operation error S3: GetObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 185F3A94FC6DD477, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled) Duration: 3.518769688s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 9 out of 60 is failed (threshold=3) [........X........XX.X.X.X.....X..X......................X...] duration: 2.103862151s FAIL (2025-08-26 05:41:46 UTC) operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== 052418s) [upload=11929]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:39:28.676874661 (13h35m43.902057738s) [upload=11929]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:39:29.326331158 (13h35m44.551514215s) [seg_pos={0 0}, upload=11929]: Begin upload segment... Aug 26 05:39:29.326362337 (13h35m44.551545394s) [seg_pos={0 0}, upload=11929]: Done begin upload segment. Aug 26 05:39:29.326382054 (13h35m44.551565111s) [noise=true , address=45.91.116.6:4987 , piece_id=LBYWFSBIE5SWEOLSGE3WT3FSU3KFIJMBPA5Z7MICPBL26TFATXNA, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.326415717 (13h35m44.551598764s) [noise=true , address=104.36.82.11:4127 , piece_id=TH3S4TVACWZG2ZPUV54PCX5PQX6IRSSZXQGMZTHVGBLVBFPEOKIA, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.326730449 (13h35m44.551913495s) [noise=true , address=104.36.82.50:4046 , piece_id=3K3LOWI7KWUM2OK45BH3BBNHQPXGASNNR563FJH7ZRHMDLGPWKDA, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.326771736 (13h35m44.551954793s) [noise=true , address=104.36.82.5:4841 , piece_id=HSC73TB4SBA6F252Y4QBBIDDWC5RY4KMJD3MUXW7HWHFZLOMSWTA, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.326960791 (13h35m44.552143838s) [noise=true , address=79.127.219.48:4101 , piece_id=LXXGPNYSENTL2O7ICZBG46KJH4VRURLOR7O7QK6OWVLCVUUI7PSA, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.326998272 (13h35m44.552181329s) [noise=true , address=104.36.82.23:4478 , piece_id=LX7NF63DGZE67C72F4OX4BYJ3IUHAXDTXP7JBDR45VW3L77ZW3IQ, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.327215450 (13h35m44.552398507s) [noise=true , address=45.91.116.14:4201 , piece_id=4DV2FIATGHBF3V3YNIOMSMCUOAPW4U3TTPSBOPHYBYGYHOD2ALUA, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.327219177 (13h35m44.552402224s) [noise=true , address=64.49.13.170:4728 , piece_id=FYPHYXDSZVKCB3Q625T2U6E6LRRKWT6XGXKQD2573RW5VMK6UREA, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.327429682 (13h35m44.552612739s) [noise=true , address=104.36.82.60:4347 , piece_id=C6NAKOGMLCLNTHQ3U4TW5DJBSYFRCNK2NDO36A3W6DU2DNX5V2YQ, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.327475117 (13h35m44.552658164s) [noise=true , address=64.49.13.137:4501 , piece_id=JXWASFQQDSQTGGSG63I64X4ZUQ5UK7DUDYS5WRH3ADQGJ7C373GQ, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.327663180 (13h35m44.552846228s) [noise=true , address=45.91.116.10:4089 , piece_id=6RLS7EUIFFWM72AGESBONGMA5PKBFJHIWVGNANEL7FA7YF6VVVGQ, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.327723022 (13h35m44.55290607s) [noise=true , address=104.36.82.7:4938 , piece_id=OTAS23KJ3CBKQKPIY5MGCBDLWSKS555T67BXL4SNFND3WWSVFXEA, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.327870390 (13h35m44.553053437s) [noise=true , address=79.127.219.51:4210 , piece_id=3HDPRE65Q4MK4N6LOQZGGIGLE6BV56EBVVTRYNQEIBU6M2EPGZYQ, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.327973243 (13h35m44.5531563s) [noise=true , address=104.36.82.10:4103 , piece_id=BZ4JWBSZWYXKF6VJETTLGT553UGKOIIPMH7UTGZ7BN2QQGOKOSYQ, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.328120580 (13h35m44.553303637s) [noise=true , address=79.127.205.246:4277 , piece_id=M3DRV3M4A5W7ZNULWX72RO5R2ZLPJRUPHC36D2VW76YP6WVTRP7Q, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.328208936 (13h35m44.553391983s) [noise=true , address=77.90.31.19:4857 , piece_id=DEY6O4I4FLFKFQOQV2X442KTOYVTRE2QQFSRQZYMDXFQOHMP3C2A, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.328438888 (13h35m44.553621945s) [noise=true , address=104.36.82.45:4924 , piece_id=4JSB6W26UI76LKC2PALXU7AAAI6TOJCEAKSCMTB3FQ7FCDXWESZA, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.328724915 (13h35m44.553907972s) [noise=true , address=104.36.82.20:4446 , piece_id=54IAAOGVHIP7UVM3KDFRZFS4HDJYNDYFFQEWDQMVJDE5AMUIDY5A, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.417823750 (13h35m44.643006807s) [upload=11929]: Next returned nil segment Aug 26 05:39:29.417836244 (13h35m44.64301929s) [upload=11929]: Waiting for error group managing segments... Aug 26 05:39:29.425732256 (13h35m44.650915314s) [noise=true , address=79.127.219.51:4210 , piece_id=3HDPRE65Q4MK4N6LOQZGGIGLE6BV56EBVVTRYNQEIBU6M2EPGZYQ, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.425863714 (13h35m44.651046771s) [noise=true , address=79.127.219.48:4101 , piece_id=LXXGPNYSENTL2O7ICZBG46KJH4VRURLOR7O7QK6OWVLCVUUI7PSA, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.426308560 (13h35m44.651491617s) [noise=true , address=45.91.116.10:4089 , piece_id=6RLS7EUIFFWM72AGESBONGMA5PKBFJHIWVGNANEL7FA7YF6VVVGQ, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.426425470 (13h35m44.651608527s) [noise=true , address=45.91.116.6:4987 , piece_id=LBYWFSBIE5SWEOLSGE3WT3FSU3KFIJMBPA5Z7MICPBL26TFATXNA, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.426987374 (13h35m44.652170422s) [noise=true , address=45.91.116.14:4201 , piece_id=4DV2FIATGHBF3V3YNIOMSMCUOAPW4U3TTPSBOPHYBYGYHOD2ALUA, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.428679974 (13h35m44.653863031s) [noise=true , address=77.90.31.19:4857 , piece_id=DEY6O4I4FLFKFQOQV2X442KTOYVTRE2QQFSRQZYMDXFQOHMP3C2A, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.429240227 (13h35m44.654423284s) [noise=true , address=104.36.82.7:4938 , piece_id=OTAS23KJ3CBKQKPIY5MGCBDLWSKS555T67BXL4SNFND3WWSVFXEA, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.430008872 (13h35m44.655191918s) [noise=true , address=104.36.82.11:4127 , piece_id=TH3S4TVACWZG2ZPUV54PCX5PQX6IRSSZXQGMZTHVGBLVBFPEOKIA, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.430535690 (13h35m44.655718758s) [noise=true , address=104.36.82.5:4841 , piece_id=HSC73TB4SBA6F252Y4QBBIDDWC5RY4KMJD3MUXW7HWHFZLOMSWTA, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.432211248 (13h35m44.657394325s) [noise=true , address=104.36.82.50:4046 , piece_id=3K3LOWI7KWUM2OK45BH3BBNHQPXGASNNR563FJH7ZRHMDLGPWKDA, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.432591613 (13h35m44.65777467s) [noise=true , address=104.36.82.45:4924 , piece_id=4JSB6W26UI76LKC2PALXU7AAAI6TOJCEAKSCMTB3FQ7FCDXWESZA, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.433747243 (13h35m44.658930291s) [noise=true , address=104.36.82.10:4103 , piece_id=BZ4JWBSZWYXKF6VJETTLGT553UGKOIIPMH7UTGZ7BN2QQGOKOSYQ, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.434911311 (13h35m44.660094358s) [noise=true , address=104.36.82.60:4347 , piece_id=C6NAKOGMLCLNTHQ3U4TW5DJBSYFRCNK2NDO36A3W6DU2DNX5V2YQ, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.435057024 (13h35m44.660240071s) [noise=true , address=104.36.82.20:4446 , piece_id=54IAAOGVHIP7UVM3KDFRZFS4HDJYNDYFFQEWDQMVJDE5AMUIDY5A, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.435079706 (13h35m44.660262763s) [seg_pos={0 0}, upload=11929]: Segment reached optimal threshold of 14 pieces. Aug 26 05:39:29.435277028 (13h35m44.660460085s) [noise=true , address=104.36.82.23:4478 , piece_id=LX7NF63DGZE67C72F4OX4BYJ3IUHAXDTXP7JBDR45VW3L77ZW3IQ, seg_pos={0 0}, upload=11929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF Aug 26 05:39:29.435347140 (13h35m44.660530197s) [noise=true , address=64.49.13.137:4501 , piece_id=JXWASFQQDSQTGGSG63I64X4ZUQ5UK7DUDYS5WRH3ADQGJ7C373GQ, seg_pos={0 0}, upload=11929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12D2MWhZKXEMUPBvMQVfzVJZNw4m857MYZ4BjLfEwVxS4fJLzj1): protocol: read tcp 5.161.89.252:49898->64.49.13.137:4501: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 26 05:39:29.435413644 (13h35m44.660596691s) [noise=true , address=64.49.13.170:4728 , piece_id=FYPHYXDSZVKCB3Q625T2U6E6LRRKWT6XGXKQD2573RW5VMK6UREA, seg_pos={0 0}, upload=11929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XmGcLqbv3ctCx52m42uKqwKpbWjgzEbvoJmdRLXt81qiGvY6M): protocol: read tcp 5.161.89.252:34974->64.49.13.170:4728: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 26 05:39:29.435480901 (13h35m44.660663958s) [noise=true , address=79.127.205.246:4277 , piece_id=M3DRV3M4A5W7ZNULWX72RO5R2ZLPJRUPHC36D2VW76YP6WVTRP7Q, seg_pos={0 0}, upload=11929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1psRaRsxoNbAZrcboMGMSEtBDXXsLqBs2C6GnyuYpY71N7jf6N): protocol: read tcp 5.161.89.252:63088->79.127.205.246:4277: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Aug 26 05:39:29.435506319 (13h35m44.660689366s) [seg_pos={0 0}, upload=11929]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 26 05:39:29.435566121 (13h35m44.660749168s) [upload=11929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:39:29.435570178 (13h35m44.660753236s) [upload=11929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:39:29.971207124 (13h35m45.196390181s) [upload=11929]: Done uploading segments... Aug 26 05:39:29.971246298 (13h35m45.196429355s) [upload=11929]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 2.103885475s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 19 out of 60 is failed (threshold=3) [.XX..........XX....X..X.XX....X..X..X..X.......XX.....XXXXX.] duration: 575.853023ms FAIL (2025-08-26 05:41:43 UTC) operation: DownloadObject uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 575.878651ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 6 out of 60 is failed (threshold=3) [......................X.X..XX.....X...................X.....] duration: 578.63406ms FAIL (2025-08-26 05:41:40 UTC) operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:38:05.410836105 (13h34m20.636019183s) [upload=11907]: Starting upload Aug 26 05:38:05.410992479 (13h34m20.636175566s) [upload=11907]: Done starting upload Aug 26 05:38:05.411061699 (13h34m20.636244776s) [upload=11907]: Uploading segments... Aug 26 05:38:05.411105602 (13h34m20.636288689s) [upload=11907]: Got next segment. Inline: true Aug 26 05:38:05.411111944 (13h34m20.636295021s) [upload=11907]: Waiting for error group managing segments... Aug 26 05:38:05.411158361 (13h34m20.636341438s) [upload=11907]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:38:05.411165264 (13h34m20.636348341s) [upload=11907]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:38:05.411169582 (13h34m20.636352669s) [upload=11907]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:38:14.626257964 (13h34m29.851441041s) [upload=11907]: Done uploading segments... Aug 26 05:38:14.626283822 (13h34m29.85146691s) [upload=11907]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration:* 578.655149ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 14 out of 60 is failed (threshold=3) [..................XXX....XXX......X....X...X......XX.X.XX...] duration: 962.756212ms FAIL (2025-08-26 05:41:40 UTC) orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 185F3A8D44118639, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled) Duration: 962.78203ms edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 7 out of 60 is failed (threshold=3) [........X..........X....X...............X..X.........XX.....] duration: 240.099093ms remote: "tcp:136.0.77.2:443" response headers: Date=Tue, 26 Aug 2025 05:38:10 GMT Content-Length=423 Vary=Origin X-Request-Id=arLvk5BmSZw Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=185F3A7D8D7F36BC X-Xss-Protection=1; mode=block target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-26 05:41:37 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F3A7D8D7F36BC</RequestId><HostId></HostId></Error>" Duration: 240.116305ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 28 out of 60 is failed (threshold=3) [..X..X.......XXXXXXXX.XX.......X..XX.XXXXXXX.....XX..X.XXX..] duration: 3.905370323s FAIL (2025-08-26 05:41:36 UTC) operation: Commit uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 3.905402033s core uplink us1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 10 out of 60 is failed (threshold=3) [................X.....XX.XX....XX.................X...XX....] duration: 7.421428317s remote: "tcp:45.38.24.2:443" response headers: Accept-Ranges=bytes Content-Length=433 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Request-Id=iiG2eRM4RKD X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:39:13 GMT Server=Storj Vary=Origin X-Amz-Request-Id=185F3A8C39AF2E49 target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-26 05:41:30 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F3A8C39AF2E49</RequestId><HostId></HostId></Error>" Duration: 7.421448535s edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 17 out of 60 is failed (threshold=3) [..X....XX.........XX.XX..XXX....XX......XX..XX....X.........] duration: 5.537319918s FAIL (2025-08-26 05:41:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.537341207s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 9 out of 60 is failed (threshold=3) [.........X........XX.X.X.X.....X..X......................X..] duration: 29.360962108s FAIL (2025-08-26 05:41:28 UTC) operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== 052418s) [upload=11929]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:39:28.676874661 (13h35m43.902057738s) [upload=11929]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:39:29.326331158 (13h35m44.551514215s) [seg_pos={0 0}, upload=11929]: Begin upload segment... Aug 26 05:39:29.326362337 (13h35m44.551545394s) [seg_pos={0 0}, upload=11929]: Done begin upload segment. Aug 26 05:39:29.326382054 (13h35m44.551565111s) [noise=true , address=45.91.116.6:4987 , piece_id=LBYWFSBIE5SWEOLSGE3WT3FSU3KFIJMBPA5Z7MICPBL26TFATXNA, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.326415717 (13h35m44.551598764s) [noise=true , address=104.36.82.11:4127 , piece_id=TH3S4TVACWZG2ZPUV54PCX5PQX6IRSSZXQGMZTHVGBLVBFPEOKIA, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.326730449 (13h35m44.551913495s) [noise=true , address=104.36.82.50:4046 , piece_id=3K3LOWI7KWUM2OK45BH3BBNHQPXGASNNR563FJH7ZRHMDLGPWKDA, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.326771736 (13h35m44.551954793s) [noise=true , address=104.36.82.5:4841 , piece_id=HSC73TB4SBA6F252Y4QBBIDDWC5RY4KMJD3MUXW7HWHFZLOMSWTA, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.326960791 (13h35m44.552143838s) [noise=true , address=79.127.219.48:4101 , piece_id=LXXGPNYSENTL2O7ICZBG46KJH4VRURLOR7O7QK6OWVLCVUUI7PSA, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.326998272 (13h35m44.552181329s) [noise=true , address=104.36.82.23:4478 , piece_id=LX7NF63DGZE67C72F4OX4BYJ3IUHAXDTXP7JBDR45VW3L77ZW3IQ, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.327215450 (13h35m44.552398507s) [noise=true , address=45.91.116.14:4201 , piece_id=4DV2FIATGHBF3V3YNIOMSMCUOAPW4U3TTPSBOPHYBYGYHOD2ALUA, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.327219177 (13h35m44.552402224s) [noise=true , address=64.49.13.170:4728 , piece_id=FYPHYXDSZVKCB3Q625T2U6E6LRRKWT6XGXKQD2573RW5VMK6UREA, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.327429682 (13h35m44.552612739s) [noise=true , address=104.36.82.60:4347 , piece_id=C6NAKOGMLCLNTHQ3U4TW5DJBSYFRCNK2NDO36A3W6DU2DNX5V2YQ, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.327475117 (13h35m44.552658164s) [noise=true , address=64.49.13.137:4501 , piece_id=JXWASFQQDSQTGGSG63I64X4ZUQ5UK7DUDYS5WRH3ADQGJ7C373GQ, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.327663180 (13h35m44.552846228s) [noise=true , address=45.91.116.10:4089 , piece_id=6RLS7EUIFFWM72AGESBONGMA5PKBFJHIWVGNANEL7FA7YF6VVVGQ, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.327723022 (13h35m44.55290607s) [noise=true , address=104.36.82.7:4938 , piece_id=OTAS23KJ3CBKQKPIY5MGCBDLWSKS555T67BXL4SNFND3WWSVFXEA, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.327870390 (13h35m44.553053437s) [noise=true , address=79.127.219.51:4210 , piece_id=3HDPRE65Q4MK4N6LOQZGGIGLE6BV56EBVVTRYNQEIBU6M2EPGZYQ, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.327973243 (13h35m44.5531563s) [noise=true , address=104.36.82.10:4103 , piece_id=BZ4JWBSZWYXKF6VJETTLGT553UGKOIIPMH7UTGZ7BN2QQGOKOSYQ, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.328120580 (13h35m44.553303637s) [noise=true , address=79.127.205.246:4277 , piece_id=M3DRV3M4A5W7ZNULWX72RO5R2ZLPJRUPHC36D2VW76YP6WVTRP7Q, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.328208936 (13h35m44.553391983s) [noise=true , address=77.90.31.19:4857 , piece_id=DEY6O4I4FLFKFQOQV2X442KTOYVTRE2QQFSRQZYMDXFQOHMP3C2A, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.328438888 (13h35m44.553621945s) [noise=true , address=104.36.82.45:4924 , piece_id=4JSB6W26UI76LKC2PALXU7AAAI6TOJCEAKSCMTB3FQ7FCDXWESZA, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.328724915 (13h35m44.553907972s) [noise=true , address=104.36.82.20:4446 , piece_id=54IAAOGVHIP7UVM3KDFRZFS4HDJYNDYFFQEWDQMVJDE5AMUIDY5A, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.417823750 (13h35m44.643006807s) [upload=11929]: Next returned nil segment Aug 26 05:39:29.417836244 (13h35m44.64301929s) [upload=11929]: Waiting for error group managing segments... Aug 26 05:39:29.425732256 (13h35m44.650915314s) [noise=true , address=79.127.219.51:4210 , piece_id=3HDPRE65Q4MK4N6LOQZGGIGLE6BV56EBVVTRYNQEIBU6M2EPGZYQ, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.425863714 (13h35m44.651046771s) [noise=true , address=79.127.219.48:4101 , piece_id=LXXGPNYSENTL2O7ICZBG46KJH4VRURLOR7O7QK6OWVLCVUUI7PSA, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.426308560 (13h35m44.651491617s) [noise=true , address=45.91.116.10:4089 , piece_id=6RLS7EUIFFWM72AGESBONGMA5PKBFJHIWVGNANEL7FA7YF6VVVGQ, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.426425470 (13h35m44.651608527s) [noise=true , address=45.91.116.6:4987 , piece_id=LBYWFSBIE5SWEOLSGE3WT3FSU3KFIJMBPA5Z7MICPBL26TFATXNA, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.426987374 (13h35m44.652170422s) [noise=true , address=45.91.116.14:4201 , piece_id=4DV2FIATGHBF3V3YNIOMSMCUOAPW4U3TTPSBOPHYBYGYHOD2ALUA, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.428679974 (13h35m44.653863031s) [noise=true , address=77.90.31.19:4857 , piece_id=DEY6O4I4FLFKFQOQV2X442KTOYVTRE2QQFSRQZYMDXFQOHMP3C2A, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.429240227 (13h35m44.654423284s) [noise=true , address=104.36.82.7:4938 , piece_id=OTAS23KJ3CBKQKPIY5MGCBDLWSKS555T67BXL4SNFND3WWSVFXEA, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.430008872 (13h35m44.655191918s) [noise=true , address=104.36.82.11:4127 , piece_id=TH3S4TVACWZG2ZPUV54PCX5PQX6IRSSZXQGMZTHVGBLVBFPEOKIA, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.430535690 (13h35m44.655718758s) [noise=true , address=104.36.82.5:4841 , piece_id=HSC73TB4SBA6F252Y4QBBIDDWC5RY4KMJD3MUXW7HWHFZLOMSWTA, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.432211248 (13h35m44.657394325s) [noise=true , address=104.36.82.50:4046 , piece_id=3K3LOWI7KWUM2OK45BH3BBNHQPXGASNNR563FJH7ZRHMDLGPWKDA, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.432591613 (13h35m44.65777467s) [noise=true , address=104.36.82.45:4924 , piece_id=4JSB6W26UI76LKC2PALXU7AAAI6TOJCEAKSCMTB3FQ7FCDXWESZA, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.433747243 (13h35m44.658930291s) [noise=true , address=104.36.82.10:4103 , piece_id=BZ4JWBSZWYXKF6VJETTLGT553UGKOIIPMH7UTGZ7BN2QQGOKOSYQ, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.434911311 (13h35m44.660094358s) [noise=true , address=104.36.82.60:4347 , piece_id=C6NAKOGMLCLNTHQ3U4TW5DJBSYFRCNK2NDO36A3W6DU2DNX5V2YQ, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.435057024 (13h35m44.660240071s) [noise=true , address=104.36.82.20:4446 , piece_id=54IAAOGVHIP7UVM3KDFRZFS4HDJYNDYFFQEWDQMVJDE5AMUIDY5A, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.435079706 (13h35m44.660262763s) [seg_pos={0 0}, upload=11929]: Segment reached optimal threshold of 14 pieces. Aug 26 05:39:29.435277028 (13h35m44.660460085s) [noise=true , address=104.36.82.23:4478 , piece_id=LX7NF63DGZE67C72F4OX4BYJ3IUHAXDTXP7JBDR45VW3L77ZW3IQ, seg_pos={0 0}, upload=11929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF Aug 26 05:39:29.435347140 (13h35m44.660530197s) [noise=true , address=64.49.13.137:4501 , piece_id=JXWASFQQDSQTGGSG63I64X4ZUQ5UK7DUDYS5WRH3ADQGJ7C373GQ, seg_pos={0 0}, upload=11929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12D2MWhZKXEMUPBvMQVfzVJZNw4m857MYZ4BjLfEwVxS4fJLzj1): protocol: read tcp 5.161.89.252:49898->64.49.13.137:4501: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 26 05:39:29.435413644 (13h35m44.660596691s) [noise=true , address=64.49.13.170:4728 , piece_id=FYPHYXDSZVKCB3Q625T2U6E6LRRKWT6XGXKQD2573RW5VMK6UREA, seg_pos={0 0}, upload=11929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XmGcLqbv3ctCx52m42uKqwKpbWjgzEbvoJmdRLXt81qiGvY6M): protocol: read tcp 5.161.89.252:34974->64.49.13.170:4728: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 26 05:39:29.435480901 (13h35m44.660663958s) [noise=true , address=79.127.205.246:4277 , piece_id=M3DRV3M4A5W7ZNULWX72RO5R2ZLPJRUPHC36D2VW76YP6WVTRP7Q, seg_pos={0 0}, upload=11929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1psRaRsxoNbAZrcboMGMSEtBDXXsLqBs2C6GnyuYpY71N7jf6N): protocol: read tcp 5.161.89.252:63088->79.127.205.246:4277: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Aug 26 05:39:29.435506319 (13h35m44.660689366s) [seg_pos={0 0}, upload=11929]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 26 05:39:29.435566121 (13h35m44.660749168s) [upload=11929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:39:29.435570178 (13h35m44.660753236s) [upload=11929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:39:29.971207124 (13h35m45.196390181s) [upload=11929]: Done uploading segments... Aug 26 05:39:29.971246298 (13h35m45.196429355s) [upload=11929]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 29.360982426s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 7 out of 60 is failed (threshold=3) [...................X.X..X.............XX...............XX...] duration: 5.404649097s FAIL (2025-08-26 05:41:28 UTC) operation error S3: GetObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 185F3A94FC6DD477, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled) Duration: 5.404693249s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 6 out of 60 is failed (threshold=6) [.X...............X..X....X....X.......................X.....] duration: 1.050531207s remote: "tcp:136.0.77.2:443" response headers: Access-Control-Allow-Methods=GET, HEAD X-Request-Id=ZFwx4y7eAxE Content-Type=text/html; charset=utf-8 Accept-Ranges=bytes Access-Control-Allow-Headers=* Access-Control-Allow-Origin=* Date=Tue, 26 Aug 2025 05:38:38 GMT target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt FAIL (2025-08-26 05:41:26 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error \| Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error \| Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error \| Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY" Duration: 1.050547597s edge linksharing bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 7 out of 60 is failed (threshold=3) [.........X..........X....X...............X..X.........XX....] duration: 7.648058807s remote: "tcp:136.0.77.2:443" response headers: Date=Tue, 26 Aug 2025 05:38:10 GMT Content-Length=423 Vary=Origin X-Request-Id=arLvk5BmSZw Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=185F3A7D8D7F36BC X-Xss-Protection=1; mode=block target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-26 05:41:22 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F3A7D8D7F36BC</RequestId><HostId></HostId></Error>" Duration: 7.648085457s edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 18 out of 60 is failed (threshold=3) [X.......X..........XX.X.X.XX....X..X...XX.XXX..........X..XX] duration: 30.000823607s FAIL (2025-08-26 05:41:20 UTC) operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 26 05:40:50.174916229 (13h37m5.400099286s) [upload=11948]: Starting upload Aug 26 05:40:50.174950314 (13h37m5.400133371s) [upload=11948]: Done starting upload Aug 26 05:40:50.174991591 (13h37m5.400174638s) [upload=11948]: Uploading segments... Aug 26 05:40:50.175014524 (13h37m5.400197571s) [upload=11948]: Got next segment. Inline: true Aug 26 05:40:50.175017720 (13h37m5.400200767s) [upload=11948]: Waiting for error group managing segments... Aug 26 05:40:50.175043148 (13h37m5.400226195s) [upload=11948]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:40:50.175046144 (13h37m5.400229191s) [upload=11948]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:40:50.175048268 (13h37m5.400231315s) [upload=11948]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:41:09.312511333 (13h37m24.53769439s) [upload=11948]: Done uploading segments... Aug 26 05:41:09.312532192 (13h37m24.537715249s) [upload=11948]: Upload finished. err: <nil> Duration:* 30.000922954s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 18 out of 60 is failed (threshold=3) [.....X...........X.X.XX.XXXXX....X..X...X...X......X..XX.X..] duration: 4.309935893s FAIL (2025-08-26 05:41:18 UTC) operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:40:27.747853598 (13h36m42.973036655s) [upload=11943]: Starting upload Aug 26 05:40:27.747896078 (13h36m42.973079135s) [upload=11943]: Done starting upload Aug 26 05:40:27.748075034 (13h36m42.973258121s) [upload=11943]: Uploading segments... Aug 26 05:40:27.748347887 (13h36m42.973531015s) [upload=11943]: Got next segment. Inline: false Aug 26 05:40:27.748507847 (13h36m42.973690934s) [upload=11943]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:40:27.748518086 (13h36m42.973701174s) [upload=11943]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:40:29.667667127 (13h36m44.892850204s) [seg_pos={0 0}, upload=11943]: Begin upload segment... Aug 26 05:40:29.667702052 (13h36m44.892885119s) [seg_pos={0 0}, upload=11943]: Done begin upload segment. Aug 26 05:40:29.667728642 (13h36m44.892911709s) [noise=true , address=45.91.116.5:4298 , piece_id=JJKOVSK2NRSLRSO35RB3QETSD2NM3M3NPY2M5OZN5T4JJVN2N4QA, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.667832979 (13h36m44.893016056s) [noise=true , address=45.91.116.14:4190 , piece_id=EEVTNWNSWK5TIRRUNZPCIEOEPJ67NFBD7XK5WIEJJFAZKROHKKLA, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.668226838 (13h36m44.893409916s) [noise=true , address=45.91.116.10:4082 , piece_id=TK6W7BUKCHI5ADFM4NW4IFWXJJT2UT4B7LPO3W2V5462H2RUCH4A, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.668436151 (13h36m44.893619218s) [noise=true , address=45.91.116.12:4227 , piece_id=B2A6LFA4MUVDIIWEJJGKTFXKBUADYK7Z677LY2X54RNTN5DLCKBQ, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.668620217 (13h36m44.893803295s) [noise=true , address=45.91.116.8:4048 , piece_id=FEU77YBJXIHDN7R7MBK3TALJAAY42AZL7G7WUMIDXZ2E7P6MLH3Q, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.668877741 (13h36m44.894060788s) [noise=true , address=77.90.31.16:4734 , piece_id=XMLNSARBFRCZ5VYQXKTLARBDPSIBWUXRQTUXLKN3AFOKNLZP6G4Q, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.668956779 (13h36m44.894139836s) [noise=true , address=45.91.116.6:4974 , piece_id=DYHZRPCONRPUBG7PGE5GEP2HCSUXW45RII3WCM7UE6DMGC344PQA, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.669081283 (13h36m44.89426433s) [noise=true , address=45.91.116.7:4011 , piece_id=OUVIXNNAUKRXT7CSJOBBRAP4D2ZM3KD2GXI75M4XXX4WIG3J4IVQ, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.669260660 (13h36m44.894443707s) [noise=true , address=77.90.31.15:4699 , piece_id=HBWZENLNYC4THZ7575SXFESKLKNUQCVNR6HSL5E3MQK4LD37AKEA, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.669291808 (13h36m44.894474856s) [noise=true , address=104.36.82.15:4259 , piece_id=CUBOK2YYGHARADL5RGEYTVFMWE2K5NBKKPLMRGFX5E6OGNEHGWFQ, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.669536228 (13h36m44.894719275s) [noise=true , address=77.90.31.14:4663 , piece_id=7XXSFQ6YKWHEA3CLZPRO7DX6BBY4YZKAFYCDKVICH2PM4CETF3GA, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.669633350 (13h36m44.894816398s) [noise=true , address=45.91.116.10:4081 , piece_id=DXDWD6XQWLN2Y3TAHXIA4FH7Q6VOJPU5Q6DWS3LNEVQZS3RWVMJQ, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.669773193 (13h36m44.89495624s) [noise=true , address=77.90.31.18:4805 , piece_id=SDPB3UCJ2MBOUZKESKFKXXEL7WJ72OEHX6J2F6IXFS4UOTAAMKWA, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.669953542 (13h36m44.895136589s) [noise=true , address=45.91.116.5:4297 , piece_id=QQ5PDHI4MUCE5ED4HMBTFJA5WUKMHJ5NYWMX46DIN5JHSWPZ57HQ, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.670289052 (13h36m44.895472109s) [noise=true , address=45.91.116.8:4045 , piece_id=4EPT4MSXTCHKESU7GC6XWRHYTAFGSLR4A6WZ6EUSSDEPCZHHT2XQ, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.670660590 (13h36m44.895843637s) [noise=true , address=45.91.116.9:4263 , piece_id=GVKHFWQEF2EDIMMUDKV3SG4NS53DIZXCYL32S44L3NYZ25Y4EEHA, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.803196645 (13h36m45.028379723s) [upload=11943]: Next returned nil segment Aug 26 05:40:29.803214310 (13h36m45.028397387s) [upload=11943]: Waiting for error group managing segments... Aug 26 05:40:29.812147903 (13h36m45.03733095s) [noise=true , address=77.90.31.14:4663 , piece_id=7XXSFQ6YKWHEA3CLZPRO7DX6BBY4YZKAFYCDKVICH2PM4CETF3GA, seg_pos={0 0}, upload=11943]: Done uploading piece. err: <nil> Aug 26 05:40:29.813014781 (13h36m45.038197828s) [noise=true , address=45.91.116.8:4045 , piece_id=4EPT4MSXTCHKESU7GC6XWRHYTAFGSLR4A6WZ6EUSSDEPCZHHT2XQ, seg_pos={0 0}, upload=11943]: Done uploading piece. err: <nil> Aug 26 05:40:29.813116974 (13h36m45.03830005s) [noise=true , address=45.91.116.10:4081 , piece_id=DXDWD6XQWLN2Y3TAHXIA4FH7Q6VOJPU5Q6DWS3LNEVQZS3RWVMJQ, seg_pos={0 0}, upload=11943]: Done uploading piece. err: <nil> Aug 26 05:40:29.813490254 (13h36m45.038673302s) [noise=true , address=45.91.116.10:4082 , piece_id=TK6W7BUKCHI5ADFM4NW4IFWXJJT2UT4B7LPO3W2V5462H2RUCH4A, seg_pos={0 0}, upload=11943]: Done uploading piece. err: <nil> Aug 26 05:40:29.813948725 (13h36m45.039131803s) [noise=true , address=45.91.116.5:4298 , piece_id=JJKOVSK2NRSLRSO35RB3QETSD2NM3M3NPY2M5OZN5T4JJVN2N4QA, seg_pos={0 0}, upload=11943]: Done uploading piece. err: <nil> Aug 26 05:40:29.814014610 (13h36m45.039197667s) [noise=true , address=45.91.116.6:4974 , piece_id=DYHZRPCONRPUBG7PGE5GEP2HCSUXW45RII3WCM7UE6DMGC344PQA, seg_pos={0 0}, upload=11943]: Done uploading piece. err: <nil> Aug 26 05:40:29.815611700 (13h36m45.040794776s) [noise=true , address=45.91.116.14:4190 , piece_id=EEVTNWNSWK5TIRRUNZPCIEOEPJ67NFBD7XK5WIEJJFAZKROHKKLA, seg_pos={0 0}, upload=11943]: Done uploading piece. err: <nil> Aug 26 05:40:29.815703452 (13h36m45.040886509s) [noise=true , address=45.91.116.9:4263 , piece_id=GVKHFWQEF2EDIMMUDKV3SG4NS53DIZXCYL32S44L3NYZ25Y4EEHA, seg_pos={0 0}, upload=11943]: Done uploading piece. err: <nil> Aug 26 05:40:29.816314690 (13h36m45.041497748s) [noise=true , address=45.91.116.7:4011 , piece_id=OUVIXNNAUKRXT7CSJOBBRAP4D2ZM3KD2GXI75M4XXX4WIG3J4IVQ, seg_pos={0 0}, upload=11943]: Done uploading piece. err: <nil> Aug 26 05:40:29.816353203 (13h36m45.04153629s) [noise=true , address=45.91.116.8:4048 , piece_id=FEU77YBJXIHDN7R7MBK3TALJAAY42AZL7G7WUMIDXZ2E7P6MLH3Q, seg_pos={0 0}, upload=11943]: Done uploading piece. err: <nil> Aug 26 05:40:29.816776868 (13h36m45.041959926s) [noise=true , address=77.90.31.15:4699 , piece_id=HBWZENLNYC4THZ7575SXFESKLKNUQCVNR6HSL5E3MQK4LD37AKEA, seg_pos={0 0}, upload=11943]: Done uploading piece. err: <nil> Aug 26 05:40:29.819440001 (13h36m45.044623078s) [noise=true , address=77.90.31.16:4734 , piece_id=XMLNSARBFRCZ5VYQXKTLARBDPSIBWUXRQTUXLKN3AFOKNLZP6G4Q, seg_pos={0 0}, upload=11943]: Done uploading piece. err: <nil> Aug 26 05:40:29.820192766 (13h36m45.045375844s) [noise=true , address=104.36.82.15:4259 , piece_id=CUBOK2YYGHARADL5RGEYTVFMWE2K5NBKKPLMRGFX5E6OGNEHGWFQ, seg_pos={0 0}, upload=11943]: Done uploading piece. err: <nil> Aug 26 05:40:29.820224766 (13h36m45.045407853s) [seg_pos={0 0}, upload=11943]: Segment reached optimal threshold of 13 pieces. Aug 26 05:40:29.820424341 (13h36m45.045607417s) [noise=true , address=45.91.116.5:4297 , piece_id=QQ5PDHI4MUCE5ED4HMBTFJA5WUKMHJ5NYWMX46DIN5JHSWPZ57HQ, seg_pos={0 0}, upload=11943]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Aug 26 05:40:29.820476089 (13h36m45.045659146s) [noise=true , address=45.91.116.12:4227 , piece_id=B2A6LFA4MUVDIIWEJJGKTFXKBUADYK7Z677LY2X54RNTN5DLCKBQ, seg_pos={0 0}, upload=11943]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH): protocol: write tcp 5.161.89.252:26884->45.91.116.12:4227: use of closed network connection; write tcp 5.161.89.252:26884->45.91.116.12:4227: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:26884->45.91.116.12:4227: use of closed network connection Aug 26 05:40:29.820579021 (13h36m45.045762099s) [noise=true , address=77.90.31.18:4805 , piece_id=SDPB3UCJ2MBOUZKESKFKXXEL7WJ72OEHX6J2F6IXFS4UOTAAMKWA, seg_pos={0 0}, upload=11943]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Aug 26 05:40:29.820619978 (13h36m45.045803056s) [seg_pos={0 0}, upload=11943]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 05:40:29.820711450 (13h36m45.045894527s) [upload=11943]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:40:29.820717381 (13h36m45.045900458s) [upload=11943]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:40:29.985995999 (13h36m45.211179056s) [upload=11943]: Done uploading segments... Aug 26 05:40:29.986019032 (13h36m45.211202089s) [upload=11943]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 4.309962262s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 6 out of 60 is failed (threshold=3) [.......................X.X..XX.....X...................X....] duration: 2.243272886s FAIL (2025-08-26 05:41:18 UTC) operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:38:05.410836105 (13h34m20.636019183s) [upload=11907]: Starting upload Aug 26 05:38:05.410992479 (13h34m20.636175566s) [upload=11907]: Done starting upload Aug 26 05:38:05.411061699 (13h34m20.636244776s) [upload=11907]: Uploading segments... Aug 26 05:38:05.411105602 (13h34m20.636288689s) [upload=11907]: Got next segment. Inline: true Aug 26 05:38:05.411111944 (13h34m20.636295021s) [upload=11907]: Waiting for error group managing segments... Aug 26 05:38:05.411158361 (13h34m20.636341438s) [upload=11907]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:38:05.411165264 (13h34m20.636348341s) [upload=11907]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:38:05.411169582 (13h34m20.636352669s) [upload=11907]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:38:14.626257964 (13h34m29.851441041s) [upload=11907]: Done uploading segments... Aug 26 05:38:14.626283822 (13h34m29.85146691s) [upload=11907]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration:* 2.243303684s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 19 out of 60 is failed (threshold=3) [..XX..........XX....X..X.XX....X..X..X..X.......XX.....XXXXX] duration: 19.733344875s FAIL (2025-08-26 05:41:12 UTC) operation: DownloadObject uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 19.733367448s core uplink us1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 6 out of 60 is failed (threshold=6) [..X...............X..X....X....X.......................X....] duration: 15.061922197s remote: "tcp:136.0.77.2:443" response headers: Access-Control-Allow-Methods=GET, HEAD X-Request-Id=ZFwx4y7eAxE Content-Type=text/html; charset=utf-8 Accept-Ranges=bytes Access-Control-Allow-Headers=* Access-Control-Allow-Origin=* Date=Tue, 26 Aug 2025 05:38:38 GMT target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt FAIL (2025-08-26 05:41:04 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error \| Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error \| Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error \| Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY" Duration: 15.061969928s edge linksharing bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 28 out of 60 is failed (threshold=3) [...X..X.......XXXXXXXX.XX.......X..XX.XXXXXXX.....XX..X.XXX.] duration: 15.685175853s FAIL (2025-08-26 05:40:59 UTC) operation: Commit uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 15.68519513s core uplink us1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 10 out of 60 is failed (threshold=3) [.................X.....XX.XX....XX.................X...XX...] duration: 8.127051636s remote: "tcp:45.38.24.2:443" response headers: Accept-Ranges=bytes Content-Length=433 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Request-Id=iiG2eRM4RKD X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:39:13 GMT Server=Storj Vary=Origin X-Amz-Request-Id=185F3A8C39AF2E49 target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-26 05:40:53 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F3A8C39AF2E49</RequestId><HostId></HostId></Error>" Duration: 8.127076593s edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 19 out of 60 is failed (threshold=3) [X.....X...........X.X.XX.XXXXX....X..X...X...X......X..XX.X.] duration: 3.820675571s FAIL (2025-08-26 05:40:47 UTC) operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:40:27.747853598 (13h36m42.973036655s) [upload=11943]: Starting upload Aug 26 05:40:27.747896078 (13h36m42.973079135s) [upload=11943]: Done starting upload Aug 26 05:40:27.748075034 (13h36m42.973258121s) [upload=11943]: Uploading segments... Aug 26 05:40:27.748347887 (13h36m42.973531015s) [upload=11943]: Got next segment. Inline: false Aug 26 05:40:27.748507847 (13h36m42.973690934s) [upload=11943]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:40:27.748518086 (13h36m42.973701174s) [upload=11943]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:40:29.667667127 (13h36m44.892850204s) [seg_pos={0 0}, upload=11943]: Begin upload segment... Aug 26 05:40:29.667702052 (13h36m44.892885119s) [seg_pos={0 0}, upload=11943]: Done begin upload segment. Aug 26 05:40:29.667728642 (13h36m44.892911709s) [noise=true , address=45.91.116.5:4298 , piece_id=JJKOVSK2NRSLRSO35RB3QETSD2NM3M3NPY2M5OZN5T4JJVN2N4QA, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.667832979 (13h36m44.893016056s) [noise=true , address=45.91.116.14:4190 , piece_id=EEVTNWNSWK5TIRRUNZPCIEOEPJ67NFBD7XK5WIEJJFAZKROHKKLA, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.668226838 (13h36m44.893409916s) [noise=true , address=45.91.116.10:4082 , piece_id=TK6W7BUKCHI5ADFM4NW4IFWXJJT2UT4B7LPO3W2V5462H2RUCH4A, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.668436151 (13h36m44.893619218s) [noise=true , address=45.91.116.12:4227 , piece_id=B2A6LFA4MUVDIIWEJJGKTFXKBUADYK7Z677LY2X54RNTN5DLCKBQ, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.668620217 (13h36m44.893803295s) [noise=true , address=45.91.116.8:4048 , piece_id=FEU77YBJXIHDN7R7MBK3TALJAAY42AZL7G7WUMIDXZ2E7P6MLH3Q, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.668877741 (13h36m44.894060788s) [noise=true , address=77.90.31.16:4734 , piece_id=XMLNSARBFRCZ5VYQXKTLARBDPSIBWUXRQTUXLKN3AFOKNLZP6G4Q, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.668956779 (13h36m44.894139836s) [noise=true , address=45.91.116.6:4974 , piece_id=DYHZRPCONRPUBG7PGE5GEP2HCSUXW45RII3WCM7UE6DMGC344PQA, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.669081283 (13h36m44.89426433s) [noise=true , address=45.91.116.7:4011 , piece_id=OUVIXNNAUKRXT7CSJOBBRAP4D2ZM3KD2GXI75M4XXX4WIG3J4IVQ, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.669260660 (13h36m44.894443707s) [noise=true , address=77.90.31.15:4699 , piece_id=HBWZENLNYC4THZ7575SXFESKLKNUQCVNR6HSL5E3MQK4LD37AKEA, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.669291808 (13h36m44.894474856s) [noise=true , address=104.36.82.15:4259 , piece_id=CUBOK2YYGHARADL5RGEYTVFMWE2K5NBKKPLMRGFX5E6OGNEHGWFQ, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.669536228 (13h36m44.894719275s) [noise=true , address=77.90.31.14:4663 , piece_id=7XXSFQ6YKWHEA3CLZPRO7DX6BBY4YZKAFYCDKVICH2PM4CETF3GA, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.669633350 (13h36m44.894816398s) [noise=true , address=45.91.116.10:4081 , piece_id=DXDWD6XQWLN2Y3TAHXIA4FH7Q6VOJPU5Q6DWS3LNEVQZS3RWVMJQ, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.669773193 (13h36m44.89495624s) [noise=true , address=77.90.31.18:4805 , piece_id=SDPB3UCJ2MBOUZKESKFKXXEL7WJ72OEHX6J2F6IXFS4UOTAAMKWA, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.669953542 (13h36m44.895136589s) [noise=true , address=45.91.116.5:4297 , piece_id=QQ5PDHI4MUCE5ED4HMBTFJA5WUKMHJ5NYWMX46DIN5JHSWPZ57HQ, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.670289052 (13h36m44.895472109s) [noise=true , address=45.91.116.8:4045 , piece_id=4EPT4MSXTCHKESU7GC6XWRHYTAFGSLR4A6WZ6EUSSDEPCZHHT2XQ, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.670660590 (13h36m44.895843637s) [noise=true , address=45.91.116.9:4263 , piece_id=GVKHFWQEF2EDIMMUDKV3SG4NS53DIZXCYL32S44L3NYZ25Y4EEHA, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.803196645 (13h36m45.028379723s) [upload=11943]: Next returned nil segment Aug 26 05:40:29.803214310 (13h36m45.028397387s) [upload=11943]: Waiting for error group managing segments... Aug 26 05:40:29.812147903 (13h36m45.03733095s) [noise=true , address=77.90.31.14:4663 , piece_id=7XXSFQ6YKWHEA3CLZPRO7DX6BBY4YZKAFYCDKVICH2PM4CETF3GA, seg_pos={0 0}, upload=11943]: Done uploading piece. err: <nil> Aug 26 05:40:29.813014781 (13h36m45.038197828s) [noise=true , address=45.91.116.8:4045 , piece_id=4EPT4MSXTCHKESU7GC6XWRHYTAFGSLR4A6WZ6EUSSDEPCZHHT2XQ, seg_pos={0 0}, upload=11943]: Done uploading piece. err: <nil> Aug 26 05:40:29.813116974 (13h36m45.03830005s) [noise=true , address=45.91.116.10:4081 , piece_id=DXDWD6XQWLN2Y3TAHXIA4FH7Q6VOJPU5Q6DWS3LNEVQZS3RWVMJQ, seg_pos={0 0}, upload=11943]: Done uploading piece. err: <nil> Aug 26 05:40:29.813490254 (13h36m45.038673302s) [noise=true , address=45.91.116.10:4082 , piece_id=TK6W7BUKCHI5ADFM4NW4IFWXJJT2UT4B7LPO3W2V5462H2RUCH4A, seg_pos={0 0}, upload=11943]: Done uploading piece. err: <nil> Aug 26 05:40:29.813948725 (13h36m45.039131803s) [noise=true , address=45.91.116.5:4298 , piece_id=JJKOVSK2NRSLRSO35RB3QETSD2NM3M3NPY2M5OZN5T4JJVN2N4QA, seg_pos={0 0}, upload=11943]: Done uploading piece. err: <nil> Aug 26 05:40:29.814014610 (13h36m45.039197667s) [noise=true , address=45.91.116.6:4974 , piece_id=DYHZRPCONRPUBG7PGE5GEP2HCSUXW45RII3WCM7UE6DMGC344PQA, seg_pos={0 0}, upload=11943]: Done uploading piece. err: <nil> Aug 26 05:40:29.815611700 (13h36m45.040794776s) [noise=true , address=45.91.116.14:4190 , piece_id=EEVTNWNSWK5TIRRUNZPCIEOEPJ67NFBD7XK5WIEJJFAZKROHKKLA, seg_pos={0 0}, upload=11943]: Done uploading piece. err: <nil> Aug 26 05:40:29.815703452 (13h36m45.040886509s) [noise=true , address=45.91.116.9:4263 , piece_id=GVKHFWQEF2EDIMMUDKV3SG4NS53DIZXCYL32S44L3NYZ25Y4EEHA, seg_pos={0 0}, upload=11943]: Done uploading piece. err: <nil> Aug 26 05:40:29.816314690 (13h36m45.041497748s) [noise=true , address=45.91.116.7:4011 , piece_id=OUVIXNNAUKRXT7CSJOBBRAP4D2ZM3KD2GXI75M4XXX4WIG3J4IVQ, seg_pos={0 0}, upload=11943]: Done uploading piece. err: <nil> Aug 26 05:40:29.816353203 (13h36m45.04153629s) [noise=true , address=45.91.116.8:4048 , piece_id=FEU77YBJXIHDN7R7MBK3TALJAAY42AZL7G7WUMIDXZ2E7P6MLH3Q, seg_pos={0 0}, upload=11943]: Done uploading piece. err: <nil> Aug 26 05:40:29.816776868 (13h36m45.041959926s) [noise=true , address=77.90.31.15:4699 , piece_id=HBWZENLNYC4THZ7575SXFESKLKNUQCVNR6HSL5E3MQK4LD37AKEA, seg_pos={0 0}, upload=11943]: Done uploading piece. err: <nil> Aug 26 05:40:29.819440001 (13h36m45.044623078s) [noise=true , address=77.90.31.16:4734 , piece_id=XMLNSARBFRCZ5VYQXKTLARBDPSIBWUXRQTUXLKN3AFOKNLZP6G4Q, seg_pos={0 0}, upload=11943]: Done uploading piece. err: <nil> Aug 26 05:40:29.820192766 (13h36m45.045375844s) [noise=true , address=104.36.82.15:4259 , piece_id=CUBOK2YYGHARADL5RGEYTVFMWE2K5NBKKPLMRGFX5E6OGNEHGWFQ, seg_pos={0 0}, upload=11943]: Done uploading piece. err: <nil> Aug 26 05:40:29.820224766 (13h36m45.045407853s) [seg_pos={0 0}, upload=11943]: Segment reached optimal threshold of 13 pieces. Aug 26 05:40:29.820424341 (13h36m45.045607417s) [noise=true , address=45.91.116.5:4297 , piece_id=QQ5PDHI4MUCE5ED4HMBTFJA5WUKMHJ5NYWMX46DIN5JHSWPZ57HQ, seg_pos={0 0}, upload=11943]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Aug 26 05:40:29.820476089 (13h36m45.045659146s) [noise=true , address=45.91.116.12:4227 , piece_id=B2A6LFA4MUVDIIWEJJGKTFXKBUADYK7Z677LY2X54RNTN5DLCKBQ, seg_pos={0 0}, upload=11943]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH): protocol: write tcp 5.161.89.252:26884->45.91.116.12:4227: use of closed network connection; write tcp 5.161.89.252:26884->45.91.116.12:4227: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:26884->45.91.116.12:4227: use of closed network connection Aug 26 05:40:29.820579021 (13h36m45.045762099s) [noise=true , address=77.90.31.18:4805 , piece_id=SDPB3UCJ2MBOUZKESKFKXXEL7WJ72OEHX6J2F6IXFS4UOTAAMKWA, seg_pos={0 0}, upload=11943]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Aug 26 05:40:29.820619978 (13h36m45.045803056s) [seg_pos={0 0}, upload=11943]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 05:40:29.820711450 (13h36m45.045894527s) [upload=11943]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:40:29.820717381 (13h36m45.045900458s) [upload=11943]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:40:29.985995999 (13h36m45.211179056s) [upload=11943]: Done uploading segments... Aug 26 05:40:29.986019032 (13h36m45.211202089s) [upload=11943]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 3.820712159s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 15 out of 60 is failed (threshold=3) [X..................XXX....XXX......X....X...X......XX.X.XX..] duration: 18.709477055s FAIL (2025-08-26 05:40:47 UTC) orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 185F3A8D44118639, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled) Duration: 18.709560813s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 7 out of 60 is failed (threshold=3) [....................X.X..X.............XX...............XX..] duration: 10.336869291s FAIL (2025-08-26 05:40:41 UTC) operation error S3: GetObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 185F3A94FC6DD477, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled) Duration: 10.336889731s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 6 out of 60 is failed (threshold=3) [........................X.X..XX.....X...................X...] duration: 20.160393431s FAIL (2025-08-26 05:40:35 UTC) operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:38:05.410836105 (13h34m20.636019183s) [upload=11907]: Starting upload Aug 26 05:38:05.410992479 (13h34m20.636175566s) [upload=11907]: Done starting upload Aug 26 05:38:05.411061699 (13h34m20.636244776s) [upload=11907]: Uploading segments... Aug 26 05:38:05.411105602 (13h34m20.636288689s) [upload=11907]: Got next segment. Inline: true Aug 26 05:38:05.411111944 (13h34m20.636295021s) [upload=11907]: Waiting for error group managing segments... Aug 26 05:38:05.411158361 (13h34m20.636341438s) [upload=11907]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:38:05.411165264 (13h34m20.636348341s) [upload=11907]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:38:05.411169582 (13h34m20.636352669s) [upload=11907]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:38:14.626257964 (13h34m29.851441041s) [upload=11907]: Done uploading segments... Aug 26 05:38:14.626283822 (13h34m29.85146691s) [upload=11907]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration:* 20.160425492s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 17 out of 60 is failed (threshold=3) [...X....XX.........XX.XX..XXX....XX......XX..XX....X........] duration: 7.128700142s FAIL (2025-08-26 05:40:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.128723396s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 10 out of 60 is failed (threshold=3) [..................X.....XX.XX....XX.................X...XX..] duration: 8.024586294s remote: "tcp:45.38.24.2:443" response headers: Accept-Ranges=bytes Content-Length=433 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Request-Id=iiG2eRM4RKD X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:39:13 GMT Server=Storj Vary=Origin X-Amz-Request-Id=185F3A8C39AF2E49 target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-26 05:40:32 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F3A8C39AF2E49</RequestId><HostId></HostId></Error>" Duration: 8.02461103s edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 18 out of 60 is failed (threshold=3) [...XX..........XX....X..X.XX....X..X..X..X.......XX.....XXXX] duration: 30.000893622s FAIL (2025-08-26 05:40:31 UTC) operation: Commit uplink: metaclient: context deadline exceeded Duration: 30.000912848s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 19 out of 60 is failed (threshold=3) [.X.....X...........X.X.XX.XXXXX....X..X...X...X......X..XX.X] duration: 2.252511265s FAIL (2025-08-26 05:40:29 UTC) operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:40:27.747853598 (13h36m42.973036655s) [upload=11943]: Starting upload Aug 26 05:40:27.747896078 (13h36m42.973079135s) [upload=11943]: Done starting upload Aug 26 05:40:27.748075034 (13h36m42.973258121s) [upload=11943]: Uploading segments... Aug 26 05:40:27.748347887 (13h36m42.973531015s) [upload=11943]: Got next segment. Inline: false Aug 26 05:40:27.748507847 (13h36m42.973690934s) [upload=11943]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:40:27.748518086 (13h36m42.973701174s) [upload=11943]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:40:29.667667127 (13h36m44.892850204s) [seg_pos={0 0}, upload=11943]: Begin upload segment... Aug 26 05:40:29.667702052 (13h36m44.892885119s) [seg_pos={0 0}, upload=11943]: Done begin upload segment. Aug 26 05:40:29.667728642 (13h36m44.892911709s) [noise=true , address=45.91.116.5:4298 , piece_id=JJKOVSK2NRSLRSO35RB3QETSD2NM3M3NPY2M5OZN5T4JJVN2N4QA, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.667832979 (13h36m44.893016056s) [noise=true , address=45.91.116.14:4190 , piece_id=EEVTNWNSWK5TIRRUNZPCIEOEPJ67NFBD7XK5WIEJJFAZKROHKKLA, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.668226838 (13h36m44.893409916s) [noise=true , address=45.91.116.10:4082 , piece_id=TK6W7BUKCHI5ADFM4NW4IFWXJJT2UT4B7LPO3W2V5462H2RUCH4A, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.668436151 (13h36m44.893619218s) [noise=true , address=45.91.116.12:4227 , piece_id=B2A6LFA4MUVDIIWEJJGKTFXKBUADYK7Z677LY2X54RNTN5DLCKBQ, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.668620217 (13h36m44.893803295s) [noise=true , address=45.91.116.8:4048 , piece_id=FEU77YBJXIHDN7R7MBK3TALJAAY42AZL7G7WUMIDXZ2E7P6MLH3Q, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.668877741 (13h36m44.894060788s) [noise=true , address=77.90.31.16:4734 , piece_id=XMLNSARBFRCZ5VYQXKTLARBDPSIBWUXRQTUXLKN3AFOKNLZP6G4Q, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.668956779 (13h36m44.894139836s) [noise=true , address=45.91.116.6:4974 , piece_id=DYHZRPCONRPUBG7PGE5GEP2HCSUXW45RII3WCM7UE6DMGC344PQA, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.669081283 (13h36m44.89426433s) [noise=true , address=45.91.116.7:4011 , piece_id=OUVIXNNAUKRXT7CSJOBBRAP4D2ZM3KD2GXI75M4XXX4WIG3J4IVQ, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.669260660 (13h36m44.894443707s) [noise=true , address=77.90.31.15:4699 , piece_id=HBWZENLNYC4THZ7575SXFESKLKNUQCVNR6HSL5E3MQK4LD37AKEA, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.669291808 (13h36m44.894474856s) [noise=true , address=104.36.82.15:4259 , piece_id=CUBOK2YYGHARADL5RGEYTVFMWE2K5NBKKPLMRGFX5E6OGNEHGWFQ, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.669536228 (13h36m44.894719275s) [noise=true , address=77.90.31.14:4663 , piece_id=7XXSFQ6YKWHEA3CLZPRO7DX6BBY4YZKAFYCDKVICH2PM4CETF3GA, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.669633350 (13h36m44.894816398s) [noise=true , address=45.91.116.10:4081 , piece_id=DXDWD6XQWLN2Y3TAHXIA4FH7Q6VOJPU5Q6DWS3LNEVQZS3RWVMJQ, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.669773193 (13h36m44.89495624s) [noise=true , address=77.90.31.18:4805 , piece_id=SDPB3UCJ2MBOUZKESKFKXXEL7WJ72OEHX6J2F6IXFS4UOTAAMKWA, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.669953542 (13h36m44.895136589s) [noise=true , address=45.91.116.5:4297 , piece_id=QQ5PDHI4MUCE5ED4HMBTFJA5WUKMHJ5NYWMX46DIN5JHSWPZ57HQ, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.670289052 (13h36m44.895472109s) [noise=true , address=45.91.116.8:4045 , piece_id=4EPT4MSXTCHKESU7GC6XWRHYTAFGSLR4A6WZ6EUSSDEPCZHHT2XQ, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.670660590 (13h36m44.895843637s) [noise=true , address=45.91.116.9:4263 , piece_id=GVKHFWQEF2EDIMMUDKV3SG4NS53DIZXCYL32S44L3NYZ25Y4EEHA, seg_pos={0 0}, upload=11943]: Uploading piece... Aug 26 05:40:29.803196645 (13h36m45.028379723s) [upload=11943]: Next returned nil segment Aug 26 05:40:29.803214310 (13h36m45.028397387s) [upload=11943]: Waiting for error group managing segments... Aug 26 05:40:29.812147903 (13h36m45.03733095s) [noise=true , address=77.90.31.14:4663 , piece_id=7XXSFQ6YKWHEA3CLZPRO7DX6BBY4YZKAFYCDKVICH2PM4CETF3GA, seg_pos={0 0}, upload=11943]: Done uploading piece. err: <nil> Aug 26 05:40:29.813014781 (13h36m45.038197828s) [noise=true , address=45.91.116.8:4045 , piece_id=4EPT4MSXTCHKESU7GC6XWRHYTAFGSLR4A6WZ6EUSSDEPCZHHT2XQ, seg_pos={0 0}, upload=11943]: Done uploading piece. err: <nil> Aug 26 05:40:29.813116974 (13h36m45.03830005s) [noise=true , address=45.91.116.10:4081 , piece_id=DXDWD6XQWLN2Y3TAHXIA4FH7Q6VOJPU5Q6DWS3LNEVQZS3RWVMJQ, seg_pos={0 0}, upload=11943]: Done uploading piece. err: <nil> Aug 26 05:40:29.813490254 (13h36m45.038673302s) [noise=true , address=45.91.116.10:4082 , piece_id=TK6W7BUKCHI5ADFM4NW4IFWXJJT2UT4B7LPO3W2V5462H2RUCH4A, seg_pos={0 0}, upload=11943]: Done uploading piece. err: <nil> Aug 26 05:40:29.813948725 (13h36m45.039131803s) [noise=true , address=45.91.116.5:4298 , piece_id=JJKOVSK2NRSLRSO35RB3QETSD2NM3M3NPY2M5OZN5T4JJVN2N4QA, seg_pos={0 0}, upload=11943]: Done uploading piece. err: <nil> Aug 26 05:40:29.814014610 (13h36m45.039197667s) [noise=true , address=45.91.116.6:4974 , piece_id=DYHZRPCONRPUBG7PGE5GEP2HCSUXW45RII3WCM7UE6DMGC344PQA, seg_pos={0 0}, upload=11943]: Done uploading piece. err: <nil> Aug 26 05:40:29.815611700 (13h36m45.040794776s) [noise=true , address=45.91.116.14:4190 , piece_id=EEVTNWNSWK5TIRRUNZPCIEOEPJ67NFBD7XK5WIEJJFAZKROHKKLA, seg_pos={0 0}, upload=11943]: Done uploading piece. err: <nil> Aug 26 05:40:29.815703452 (13h36m45.040886509s) [noise=true , address=45.91.116.9:4263 , piece_id=GVKHFWQEF2EDIMMUDKV3SG4NS53DIZXCYL32S44L3NYZ25Y4EEHA, seg_pos={0 0}, upload=11943]: Done uploading piece. err: <nil> Aug 26 05:40:29.816314690 (13h36m45.041497748s) [noise=true , address=45.91.116.7:4011 , piece_id=OUVIXNNAUKRXT7CSJOBBRAP4D2ZM3KD2GXI75M4XXX4WIG3J4IVQ, seg_pos={0 0}, upload=11943]: Done uploading piece. err: <nil> Aug 26 05:40:29.816353203 (13h36m45.04153629s) [noise=true , address=45.91.116.8:4048 , piece_id=FEU77YBJXIHDN7R7MBK3TALJAAY42AZL7G7WUMIDXZ2E7P6MLH3Q, seg_pos={0 0}, upload=11943]: Done uploading piece. err: <nil> Aug 26 05:40:29.816776868 (13h36m45.041959926s) [noise=true , address=77.90.31.15:4699 , piece_id=HBWZENLNYC4THZ7575SXFESKLKNUQCVNR6HSL5E3MQK4LD37AKEA, seg_pos={0 0}, upload=11943]: Done uploading piece. err: <nil> Aug 26 05:40:29.819440001 (13h36m45.044623078s) [noise=true , address=77.90.31.16:4734 , piece_id=XMLNSARBFRCZ5VYQXKTLARBDPSIBWUXRQTUXLKN3AFOKNLZP6G4Q, seg_pos={0 0}, upload=11943]: Done uploading piece. err: <nil> Aug 26 05:40:29.820192766 (13h36m45.045375844s) [noise=true , address=104.36.82.15:4259 , piece_id=CUBOK2YYGHARADL5RGEYTVFMWE2K5NBKKPLMRGFX5E6OGNEHGWFQ, seg_pos={0 0}, upload=11943]: Done uploading piece. err: <nil> Aug 26 05:40:29.820224766 (13h36m45.045407853s) [seg_pos={0 0}, upload=11943]: Segment reached optimal threshold of 13 pieces. Aug 26 05:40:29.820424341 (13h36m45.045607417s) [noise=true , address=45.91.116.5:4297 , piece_id=QQ5PDHI4MUCE5ED4HMBTFJA5WUKMHJ5NYWMX46DIN5JHSWPZ57HQ, seg_pos={0 0}, upload=11943]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Aug 26 05:40:29.820476089 (13h36m45.045659146s) [noise=true , address=45.91.116.12:4227 , piece_id=B2A6LFA4MUVDIIWEJJGKTFXKBUADYK7Z677LY2X54RNTN5DLCKBQ, seg_pos={0 0}, upload=11943]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH): protocol: write tcp 5.161.89.252:26884->45.91.116.12:4227: use of closed network connection; write tcp 5.161.89.252:26884->45.91.116.12:4227: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:26884->45.91.116.12:4227: use of closed network connection Aug 26 05:40:29.820579021 (13h36m45.045762099s) [noise=true , address=77.90.31.18:4805 , piece_id=SDPB3UCJ2MBOUZKESKFKXXEL7WJ72OEHX6J2F6IXFS4UOTAAMKWA, seg_pos={0 0}, upload=11943]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF Aug 26 05:40:29.820619978 (13h36m45.045803056s) [seg_pos={0 0}, upload=11943]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 26 05:40:29.820711450 (13h36m45.045894527s) [upload=11943]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:40:29.820717381 (13h36m45.045900458s) [upload=11943]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:40:29.985995999 (13h36m45.211179056s) [upload=11943]: Done uploading segments... Aug 26 05:40:29.986019032 (13h36m45.211202089s) [upload=11943]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 2.252531903s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 18 out of 60 is failed (threshold=3) [XX.......X..........XX.X.X.XX....X..X...XX.XXX..........X..X] duration: 7.973107224s FAIL (2025-08-26 05:40:29 UTC) operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:40:21.858557222 (13h36m37.083740299s) [upload=11942]: Starting upload Aug 26 05:40:21.858629227 (13h36m37.083812305s) [upload=11942]: Done starting upload Aug 26 05:40:21.858686685 (13h36m37.083869763s) [upload=11942]: Uploading segments... Aug 26 05:40:21.858721250 (13h36m37.083904327s) [upload=11942]: Got next segment. Inline: true Aug 26 05:40:21.858726109 (13h36m37.083909186s) [upload=11942]: Waiting for error group managing segments... Aug 26 05:40:21.858765834 (13h36m37.083948911s) [upload=11942]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:40:21.858772456 (13h36m37.083955533s) [upload=11942]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:40:21.858776734 (13h36m37.083959812s) [upload=11942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:40:29.817696797 (13h36m45.042879874s) [upload=11942]: Done uploading segments... Aug 26 05:40:29.817709842 (13h36m45.042892918s) [upload=11942]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration:* 7.973148943s core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 7 out of 60 is failed (threshold=3) [..........X..........X....X...............X..X.........XX...] duration: 8.040330251s remote: "tcp:136.0.77.2:443" response headers: Date=Tue, 26 Aug 2025 05:38:10 GMT Content-Length=423 Vary=Origin X-Request-Id=arLvk5BmSZw Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=185F3A7D8D7F36BC X-Xss-Protection=1; mode=block target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-26 05:40:28 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F3A7D8D7F36BC</RequestId><HostId></HostId></Error>" Duration: 8.040360048s edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 9 out of 60 is failed (threshold=3) [..........X........XX.X.X.X.....X..X......................X.] duration: 21.038932336s FAIL (2025-08-26 05:40:26 UTC) operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== 052418s) [upload=11929]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:39:28.676874661 (13h35m43.902057738s) [upload=11929]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:39:29.326331158 (13h35m44.551514215s) [seg_pos={0 0}, upload=11929]: Begin upload segment... Aug 26 05:39:29.326362337 (13h35m44.551545394s) [seg_pos={0 0}, upload=11929]: Done begin upload segment. Aug 26 05:39:29.326382054 (13h35m44.551565111s) [noise=true , address=45.91.116.6:4987 , piece_id=LBYWFSBIE5SWEOLSGE3WT3FSU3KFIJMBPA5Z7MICPBL26TFATXNA, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.326415717 (13h35m44.551598764s) [noise=true , address=104.36.82.11:4127 , piece_id=TH3S4TVACWZG2ZPUV54PCX5PQX6IRSSZXQGMZTHVGBLVBFPEOKIA, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.326730449 (13h35m44.551913495s) [noise=true , address=104.36.82.50:4046 , piece_id=3K3LOWI7KWUM2OK45BH3BBNHQPXGASNNR563FJH7ZRHMDLGPWKDA, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.326771736 (13h35m44.551954793s) [noise=true , address=104.36.82.5:4841 , piece_id=HSC73TB4SBA6F252Y4QBBIDDWC5RY4KMJD3MUXW7HWHFZLOMSWTA, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.326960791 (13h35m44.552143838s) [noise=true , address=79.127.219.48:4101 , piece_id=LXXGPNYSENTL2O7ICZBG46KJH4VRURLOR7O7QK6OWVLCVUUI7PSA, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.326998272 (13h35m44.552181329s) [noise=true , address=104.36.82.23:4478 , piece_id=LX7NF63DGZE67C72F4OX4BYJ3IUHAXDTXP7JBDR45VW3L77ZW3IQ, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.327215450 (13h35m44.552398507s) [noise=true , address=45.91.116.14:4201 , piece_id=4DV2FIATGHBF3V3YNIOMSMCUOAPW4U3TTPSBOPHYBYGYHOD2ALUA, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.327219177 (13h35m44.552402224s) [noise=true , address=64.49.13.170:4728 , piece_id=FYPHYXDSZVKCB3Q625T2U6E6LRRKWT6XGXKQD2573RW5VMK6UREA, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.327429682 (13h35m44.552612739s) [noise=true , address=104.36.82.60:4347 , piece_id=C6NAKOGMLCLNTHQ3U4TW5DJBSYFRCNK2NDO36A3W6DU2DNX5V2YQ, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.327475117 (13h35m44.552658164s) [noise=true , address=64.49.13.137:4501 , piece_id=JXWASFQQDSQTGGSG63I64X4ZUQ5UK7DUDYS5WRH3ADQGJ7C373GQ, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.327663180 (13h35m44.552846228s) [noise=true , address=45.91.116.10:4089 , piece_id=6RLS7EUIFFWM72AGESBONGMA5PKBFJHIWVGNANEL7FA7YF6VVVGQ, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.327723022 (13h35m44.55290607s) [noise=true , address=104.36.82.7:4938 , piece_id=OTAS23KJ3CBKQKPIY5MGCBDLWSKS555T67BXL4SNFND3WWSVFXEA, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.327870390 (13h35m44.553053437s) [noise=true , address=79.127.219.51:4210 , piece_id=3HDPRE65Q4MK4N6LOQZGGIGLE6BV56EBVVTRYNQEIBU6M2EPGZYQ, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.327973243 (13h35m44.5531563s) [noise=true , address=104.36.82.10:4103 , piece_id=BZ4JWBSZWYXKF6VJETTLGT553UGKOIIPMH7UTGZ7BN2QQGOKOSYQ, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.328120580 (13h35m44.553303637s) [noise=true , address=79.127.205.246:4277 , piece_id=M3DRV3M4A5W7ZNULWX72RO5R2ZLPJRUPHC36D2VW76YP6WVTRP7Q, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.328208936 (13h35m44.553391983s) [noise=true , address=77.90.31.19:4857 , piece_id=DEY6O4I4FLFKFQOQV2X442KTOYVTRE2QQFSRQZYMDXFQOHMP3C2A, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.328438888 (13h35m44.553621945s) [noise=true , address=104.36.82.45:4924 , piece_id=4JSB6W26UI76LKC2PALXU7AAAI6TOJCEAKSCMTB3FQ7FCDXWESZA, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.328724915 (13h35m44.553907972s) [noise=true , address=104.36.82.20:4446 , piece_id=54IAAOGVHIP7UVM3KDFRZFS4HDJYNDYFFQEWDQMVJDE5AMUIDY5A, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.417823750 (13h35m44.643006807s) [upload=11929]: Next returned nil segment Aug 26 05:39:29.417836244 (13h35m44.64301929s) [upload=11929]: Waiting for error group managing segments... Aug 26 05:39:29.425732256 (13h35m44.650915314s) [noise=true , address=79.127.219.51:4210 , piece_id=3HDPRE65Q4MK4N6LOQZGGIGLE6BV56EBVVTRYNQEIBU6M2EPGZYQ, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.425863714 (13h35m44.651046771s) [noise=true , address=79.127.219.48:4101 , piece_id=LXXGPNYSENTL2O7ICZBG46KJH4VRURLOR7O7QK6OWVLCVUUI7PSA, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.426308560 (13h35m44.651491617s) [noise=true , address=45.91.116.10:4089 , piece_id=6RLS7EUIFFWM72AGESBONGMA5PKBFJHIWVGNANEL7FA7YF6VVVGQ, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.426425470 (13h35m44.651608527s) [noise=true , address=45.91.116.6:4987 , piece_id=LBYWFSBIE5SWEOLSGE3WT3FSU3KFIJMBPA5Z7MICPBL26TFATXNA, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.426987374 (13h35m44.652170422s) [noise=true , address=45.91.116.14:4201 , piece_id=4DV2FIATGHBF3V3YNIOMSMCUOAPW4U3TTPSBOPHYBYGYHOD2ALUA, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.428679974 (13h35m44.653863031s) [noise=true , address=77.90.31.19:4857 , piece_id=DEY6O4I4FLFKFQOQV2X442KTOYVTRE2QQFSRQZYMDXFQOHMP3C2A, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.429240227 (13h35m44.654423284s) [noise=true , address=104.36.82.7:4938 , piece_id=OTAS23KJ3CBKQKPIY5MGCBDLWSKS555T67BXL4SNFND3WWSVFXEA, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.430008872 (13h35m44.655191918s) [noise=true , address=104.36.82.11:4127 , piece_id=TH3S4TVACWZG2ZPUV54PCX5PQX6IRSSZXQGMZTHVGBLVBFPEOKIA, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.430535690 (13h35m44.655718758s) [noise=true , address=104.36.82.5:4841 , piece_id=HSC73TB4SBA6F252Y4QBBIDDWC5RY4KMJD3MUXW7HWHFZLOMSWTA, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.432211248 (13h35m44.657394325s) [noise=true , address=104.36.82.50:4046 , piece_id=3K3LOWI7KWUM2OK45BH3BBNHQPXGASNNR563FJH7ZRHMDLGPWKDA, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.432591613 (13h35m44.65777467s) [noise=true , address=104.36.82.45:4924 , piece_id=4JSB6W26UI76LKC2PALXU7AAAI6TOJCEAKSCMTB3FQ7FCDXWESZA, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.433747243 (13h35m44.658930291s) [noise=true , address=104.36.82.10:4103 , piece_id=BZ4JWBSZWYXKF6VJETTLGT553UGKOIIPMH7UTGZ7BN2QQGOKOSYQ, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.434911311 (13h35m44.660094358s) [noise=true , address=104.36.82.60:4347 , piece_id=C6NAKOGMLCLNTHQ3U4TW5DJBSYFRCNK2NDO36A3W6DU2DNX5V2YQ, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.435057024 (13h35m44.660240071s) [noise=true , address=104.36.82.20:4446 , piece_id=54IAAOGVHIP7UVM3KDFRZFS4HDJYNDYFFQEWDQMVJDE5AMUIDY5A, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.435079706 (13h35m44.660262763s) [seg_pos={0 0}, upload=11929]: Segment reached optimal threshold of 14 pieces. Aug 26 05:39:29.435277028 (13h35m44.660460085s) [noise=true , address=104.36.82.23:4478 , piece_id=LX7NF63DGZE67C72F4OX4BYJ3IUHAXDTXP7JBDR45VW3L77ZW3IQ, seg_pos={0 0}, upload=11929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF Aug 26 05:39:29.435347140 (13h35m44.660530197s) [noise=true , address=64.49.13.137:4501 , piece_id=JXWASFQQDSQTGGSG63I64X4ZUQ5UK7DUDYS5WRH3ADQGJ7C373GQ, seg_pos={0 0}, upload=11929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12D2MWhZKXEMUPBvMQVfzVJZNw4m857MYZ4BjLfEwVxS4fJLzj1): protocol: read tcp 5.161.89.252:49898->64.49.13.137:4501: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 26 05:39:29.435413644 (13h35m44.660596691s) [noise=true , address=64.49.13.170:4728 , piece_id=FYPHYXDSZVKCB3Q625T2U6E6LRRKWT6XGXKQD2573RW5VMK6UREA, seg_pos={0 0}, upload=11929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XmGcLqbv3ctCx52m42uKqwKpbWjgzEbvoJmdRLXt81qiGvY6M): protocol: read tcp 5.161.89.252:34974->64.49.13.170:4728: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 26 05:39:29.435480901 (13h35m44.660663958s) [noise=true , address=79.127.205.246:4277 , piece_id=M3DRV3M4A5W7ZNULWX72RO5R2ZLPJRUPHC36D2VW76YP6WVTRP7Q, seg_pos={0 0}, upload=11929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1psRaRsxoNbAZrcboMGMSEtBDXXsLqBs2C6GnyuYpY71N7jf6N): protocol: read tcp 5.161.89.252:63088->79.127.205.246:4277: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Aug 26 05:39:29.435506319 (13h35m44.660689366s) [seg_pos={0 0}, upload=11929]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 26 05:39:29.435566121 (13h35m44.660749168s) [upload=11929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:39:29.435570178 (13h35m44.660753236s) [upload=11929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:39:29.971207124 (13h35m45.196390181s) [upload=11929]: Done uploading segments... Aug 26 05:39:29.971246298 (13h35m45.196429355s) [upload=11929]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 21.038957572s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 6 out of 60 is failed (threshold=6) [...X...............X..X....X....X.......................X...] duration: 7.943300852s remote: "tcp:136.0.77.2:443" response headers: Access-Control-Allow-Methods=GET, HEAD X-Request-Id=ZFwx4y7eAxE Content-Type=text/html; charset=utf-8 Accept-Ranges=bytes Access-Control-Allow-Headers=* Access-Control-Allow-Origin=* Date=Tue, 26 Aug 2025 05:38:38 GMT target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt FAIL (2025-08-26 05:40:24 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error \| Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error \| Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error \| Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY" Duration: 7.94332067s edge linksharing bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 17 out of 60 is failed (threshold=3) [.XX.......X..........XX.X.X.XX....X..X...XX.XXX..........X..] duration: 20.167743992s FAIL (2025-08-26 05:40:06 UTC) operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:38:15.750160158 (13h34m30.975343224s) [upload=11913]: Starting upload Aug 26 05:38:15.750221392 (13h34m30.975404469s) [upload=11913]: Done starting upload Aug 26 05:38:15.750994245 (13h34m30.976177322s) [upload=11913]: Uploading segments... Aug 26 05:38:15.751061951 (13h34m30.976245029s) [upload=11913]: Got next segment. Inline: true Aug 26 05:38:15.751069396 (13h34m30.976252472s) [upload=11913]: Waiting for error group managing segments... Aug 26 05:38:15.751136161 (13h34m30.976319238s) [upload=11913]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:38:15.751142493 (13h34m30.976325569s) [upload=11913]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:38:15.751145999 (13h34m30.976329076s) [upload=11913]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:38:15.980155354 (13h34m31.20533844s) [upload=11913]: Done uploading segments... Aug 26 05:38:15.980182394 (13h34m31.205365471s) [upload=11913]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration:* 20.167766475s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 15 out of 60 is failed (threshold=3) [.X..................XXX....XXX......X....X...X......XX.X.XX.] duration: 20.895915198s FAIL (2025-08-26 05:40:02 UTC) orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 185F3A8D44118639, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled) Duration: 20.895933793s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 7 out of 60 is failed (threshold=3) [.....................X.X..X.............XX...............XX.] duration: 9.56174654s FAIL (2025-08-26 05:40:01 UTC) operation error S3: GetObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 185F3A94FC6DD477, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled) Duration: 9.561759806s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 7 out of 60 is failed (threshold=3) [......................X.X..X.............XX...............XX] duration: 23.909700836s FAIL (2025-08-26 05:39:51 UTC) operation error S3: GetObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 185F3A94FC6DD477, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled) Duration: 23.909726394s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 10 out of 60 is failed (threshold=3) [...................X.....XX.XX....XX.................X...XX.] duration: 8.167600588s remote: "tcp:45.38.24.2:443" response headers: Accept-Ranges=bytes Content-Length=433 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Request-Id=iiG2eRM4RKD X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:39:13 GMT Server=Storj Vary=Origin X-Amz-Request-Id=185F3A8C39AF2E49 target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-26 05:39:49 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F3A8C39AF2E49</RequestId><HostId></HostId></Error>" Duration: 8.167625676s edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 28 out of 60 is failed (threshold=3) [....X..X.......XXXXXXXX.XX.......X..XX.XXXXXXX.....XX..X.XXX] duration: 9.087363431s FAIL (2025-08-26 05:39:46 UTC) operation: Commit uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 9.087380974s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 17 out of 60 is failed (threshold=3) [....XX..........XX....X..X.XX....X..X..X..X.......XX.....XXX] duration: 6.28134419s FAIL (2025-08-26 05:39:46 UTC) operation: Commit uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 6.281364148s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 17 out of 60 is failed (threshold=3) [....X....XX.........XX.XX..XXX....XX......XX..XX....X.......] duration: 21.581488777s FAIL (2025-08-26 05:39:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 21.581535704s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 6 out of 60 is failed (threshold=3) [.........................X.X..XX.....X...................X..] duration: 19.099720112s FAIL (2025-08-26 05:39:37 UTC) operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:38:05.410836105 (13h34m20.636019183s) [upload=11907]: Starting upload Aug 26 05:38:05.410992479 (13h34m20.636175566s) [upload=11907]: Done starting upload Aug 26 05:38:05.411061699 (13h34m20.636244776s) [upload=11907]: Uploading segments... Aug 26 05:38:05.411105602 (13h34m20.636288689s) [upload=11907]: Got next segment. Inline: true Aug 26 05:38:05.411111944 (13h34m20.636295021s) [upload=11907]: Waiting for error group managing segments... Aug 26 05:38:05.411158361 (13h34m20.636341438s) [upload=11907]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:38:05.411165264 (13h34m20.636348341s) [upload=11907]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:38:05.411169582 (13h34m20.636352669s) [upload=11907]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:38:14.626257964 (13h34m29.851441041s) [upload=11907]: Done uploading segments... Aug 26 05:38:14.626283822 (13h34m29.85146691s) [upload=11907]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration:* 19.09975626s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 27 out of 60 is failed (threshold=3) [.....X..X.......XXXXXXXX.XX.......X..XX.XXXXXXX.....XX..X.XX] duration: 30.022617321s FAIL (2025-08-26 05:39:35 UTC) operation: Commit uplink: metaclient: context deadline exceeded Duration: 30.022631707s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 18 out of 60 is failed (threshold=3) [..X.....X...........X.X.XX.XXXXX....X..X...X...X......X..XX.] duration: 11.045749192s FAIL (2025-08-26 05:39:34 UTC) operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Aug 26 05:38:13.962194942 (13h34m29.187377999s) [upload=11910]: Starting upload Aug 26 05:38:13.962245498 (13h34m29.187428545s) [upload=11910]: Done starting upload Aug 26 05:38:13.962306181 (13h34m29.187489238s) [upload=11910]: Uploading segments... Aug 26 05:38:13.962524251 (13h34m29.187707297s) [upload=11910]: Got next segment. Inline: false Aug 26 05:38:13.962557043 (13h34m29.18774009s) [upload=11910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:38:13.962561241 (13h34m29.187744288s) [upload=11910]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:38:43.950669061 (13h34m59.175852149s) [upload=11910]: Next segment err: context deadline exceeded Aug 26 05:38:43.950768309 (13h34m59.175951386s) [upload=11910]: Done uploading segments... Aug 26 05:38:43.950792464 (13h34m59.175975551s) [upload=11910]: Upload finished. err: context deadline exceeded Duration: 11.045775713s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 9 out of 60 is failed (threshold=3) [...........X........XX.X.X.X.....X..X......................X] duration: 1.546825945s FAIL (2025-08-26 05:39:29 UTC) operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== 052418s) [upload=11929]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:39:28.676874661 (13h35m43.902057738s) [upload=11929]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:39:29.326331158 (13h35m44.551514215s) [seg_pos={0 0}, upload=11929]: Begin upload segment... Aug 26 05:39:29.326362337 (13h35m44.551545394s) [seg_pos={0 0}, upload=11929]: Done begin upload segment. Aug 26 05:39:29.326382054 (13h35m44.551565111s) [noise=true , address=45.91.116.6:4987 , piece_id=LBYWFSBIE5SWEOLSGE3WT3FSU3KFIJMBPA5Z7MICPBL26TFATXNA, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.326415717 (13h35m44.551598764s) [noise=true , address=104.36.82.11:4127 , piece_id=TH3S4TVACWZG2ZPUV54PCX5PQX6IRSSZXQGMZTHVGBLVBFPEOKIA, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.326730449 (13h35m44.551913495s) [noise=true , address=104.36.82.50:4046 , piece_id=3K3LOWI7KWUM2OK45BH3BBNHQPXGASNNR563FJH7ZRHMDLGPWKDA, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.326771736 (13h35m44.551954793s) [noise=true , address=104.36.82.5:4841 , piece_id=HSC73TB4SBA6F252Y4QBBIDDWC5RY4KMJD3MUXW7HWHFZLOMSWTA, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.326960791 (13h35m44.552143838s) [noise=true , address=79.127.219.48:4101 , piece_id=LXXGPNYSENTL2O7ICZBG46KJH4VRURLOR7O7QK6OWVLCVUUI7PSA, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.326998272 (13h35m44.552181329s) [noise=true , address=104.36.82.23:4478 , piece_id=LX7NF63DGZE67C72F4OX4BYJ3IUHAXDTXP7JBDR45VW3L77ZW3IQ, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.327215450 (13h35m44.552398507s) [noise=true , address=45.91.116.14:4201 , piece_id=4DV2FIATGHBF3V3YNIOMSMCUOAPW4U3TTPSBOPHYBYGYHOD2ALUA, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.327219177 (13h35m44.552402224s) [noise=true , address=64.49.13.170:4728 , piece_id=FYPHYXDSZVKCB3Q625T2U6E6LRRKWT6XGXKQD2573RW5VMK6UREA, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.327429682 (13h35m44.552612739s) [noise=true , address=104.36.82.60:4347 , piece_id=C6NAKOGMLCLNTHQ3U4TW5DJBSYFRCNK2NDO36A3W6DU2DNX5V2YQ, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.327475117 (13h35m44.552658164s) [noise=true , address=64.49.13.137:4501 , piece_id=JXWASFQQDSQTGGSG63I64X4ZUQ5UK7DUDYS5WRH3ADQGJ7C373GQ, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.327663180 (13h35m44.552846228s) [noise=true , address=45.91.116.10:4089 , piece_id=6RLS7EUIFFWM72AGESBONGMA5PKBFJHIWVGNANEL7FA7YF6VVVGQ, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.327723022 (13h35m44.55290607s) [noise=true , address=104.36.82.7:4938 , piece_id=OTAS23KJ3CBKQKPIY5MGCBDLWSKS555T67BXL4SNFND3WWSVFXEA, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.327870390 (13h35m44.553053437s) [noise=true , address=79.127.219.51:4210 , piece_id=3HDPRE65Q4MK4N6LOQZGGIGLE6BV56EBVVTRYNQEIBU6M2EPGZYQ, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.327973243 (13h35m44.5531563s) [noise=true , address=104.36.82.10:4103 , piece_id=BZ4JWBSZWYXKF6VJETTLGT553UGKOIIPMH7UTGZ7BN2QQGOKOSYQ, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.328120580 (13h35m44.553303637s) [noise=true , address=79.127.205.246:4277 , piece_id=M3DRV3M4A5W7ZNULWX72RO5R2ZLPJRUPHC36D2VW76YP6WVTRP7Q, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.328208936 (13h35m44.553391983s) [noise=true , address=77.90.31.19:4857 , piece_id=DEY6O4I4FLFKFQOQV2X442KTOYVTRE2QQFSRQZYMDXFQOHMP3C2A, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.328438888 (13h35m44.553621945s) [noise=true , address=104.36.82.45:4924 , piece_id=4JSB6W26UI76LKC2PALXU7AAAI6TOJCEAKSCMTB3FQ7FCDXWESZA, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.328724915 (13h35m44.553907972s) [noise=true , address=104.36.82.20:4446 , piece_id=54IAAOGVHIP7UVM3KDFRZFS4HDJYNDYFFQEWDQMVJDE5AMUIDY5A, seg_pos={0 0}, upload=11929]: Uploading piece... Aug 26 05:39:29.417823750 (13h35m44.643006807s) [upload=11929]: Next returned nil segment Aug 26 05:39:29.417836244 (13h35m44.64301929s) [upload=11929]: Waiting for error group managing segments... Aug 26 05:39:29.425732256 (13h35m44.650915314s) [noise=true , address=79.127.219.51:4210 , piece_id=3HDPRE65Q4MK4N6LOQZGGIGLE6BV56EBVVTRYNQEIBU6M2EPGZYQ, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.425863714 (13h35m44.651046771s) [noise=true , address=79.127.219.48:4101 , piece_id=LXXGPNYSENTL2O7ICZBG46KJH4VRURLOR7O7QK6OWVLCVUUI7PSA, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.426308560 (13h35m44.651491617s) [noise=true , address=45.91.116.10:4089 , piece_id=6RLS7EUIFFWM72AGESBONGMA5PKBFJHIWVGNANEL7FA7YF6VVVGQ, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.426425470 (13h35m44.651608527s) [noise=true , address=45.91.116.6:4987 , piece_id=LBYWFSBIE5SWEOLSGE3WT3FSU3KFIJMBPA5Z7MICPBL26TFATXNA, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.426987374 (13h35m44.652170422s) [noise=true , address=45.91.116.14:4201 , piece_id=4DV2FIATGHBF3V3YNIOMSMCUOAPW4U3TTPSBOPHYBYGYHOD2ALUA, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.428679974 (13h35m44.653863031s) [noise=true , address=77.90.31.19:4857 , piece_id=DEY6O4I4FLFKFQOQV2X442KTOYVTRE2QQFSRQZYMDXFQOHMP3C2A, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.429240227 (13h35m44.654423284s) [noise=true , address=104.36.82.7:4938 , piece_id=OTAS23KJ3CBKQKPIY5MGCBDLWSKS555T67BXL4SNFND3WWSVFXEA, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.430008872 (13h35m44.655191918s) [noise=true , address=104.36.82.11:4127 , piece_id=TH3S4TVACWZG2ZPUV54PCX5PQX6IRSSZXQGMZTHVGBLVBFPEOKIA, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.430535690 (13h35m44.655718758s) [noise=true , address=104.36.82.5:4841 , piece_id=HSC73TB4SBA6F252Y4QBBIDDWC5RY4KMJD3MUXW7HWHFZLOMSWTA, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.432211248 (13h35m44.657394325s) [noise=true , address=104.36.82.50:4046 , piece_id=3K3LOWI7KWUM2OK45BH3BBNHQPXGASNNR563FJH7ZRHMDLGPWKDA, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.432591613 (13h35m44.65777467s) [noise=true , address=104.36.82.45:4924 , piece_id=4JSB6W26UI76LKC2PALXU7AAAI6TOJCEAKSCMTB3FQ7FCDXWESZA, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.433747243 (13h35m44.658930291s) [noise=true , address=104.36.82.10:4103 , piece_id=BZ4JWBSZWYXKF6VJETTLGT553UGKOIIPMH7UTGZ7BN2QQGOKOSYQ, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.434911311 (13h35m44.660094358s) [noise=true , address=104.36.82.60:4347 , piece_id=C6NAKOGMLCLNTHQ3U4TW5DJBSYFRCNK2NDO36A3W6DU2DNX5V2YQ, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.435057024 (13h35m44.660240071s) [noise=true , address=104.36.82.20:4446 , piece_id=54IAAOGVHIP7UVM3KDFRZFS4HDJYNDYFFQEWDQMVJDE5AMUIDY5A, seg_pos={0 0}, upload=11929]: Done uploading piece. err: <nil> Aug 26 05:39:29.435079706 (13h35m44.660262763s) [seg_pos={0 0}, upload=11929]: Segment reached optimal threshold of 14 pieces. Aug 26 05:39:29.435277028 (13h35m44.660460085s) [noise=true , address=104.36.82.23:4478 , piece_id=LX7NF63DGZE67C72F4OX4BYJ3IUHAXDTXP7JBDR45VW3L77ZW3IQ, seg_pos={0 0}, upload=11929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF Aug 26 05:39:29.435347140 (13h35m44.660530197s) [noise=true , address=64.49.13.137:4501 , piece_id=JXWASFQQDSQTGGSG63I64X4ZUQ5UK7DUDYS5WRH3ADQGJ7C373GQ, seg_pos={0 0}, upload=11929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12D2MWhZKXEMUPBvMQVfzVJZNw4m857MYZ4BjLfEwVxS4fJLzj1): protocol: read tcp 5.161.89.252:49898->64.49.13.137:4501: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 26 05:39:29.435413644 (13h35m44.660596691s) [noise=true , address=64.49.13.170:4728 , piece_id=FYPHYXDSZVKCB3Q625T2U6E6LRRKWT6XGXKQD2573RW5VMK6UREA, seg_pos={0 0}, upload=11929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XmGcLqbv3ctCx52m42uKqwKpbWjgzEbvoJmdRLXt81qiGvY6M): protocol: read tcp 5.161.89.252:34974->64.49.13.170:4728: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 26 05:39:29.435480901 (13h35m44.660663958s) [noise=true , address=79.127.205.246:4277 , piece_id=M3DRV3M4A5W7ZNULWX72RO5R2ZLPJRUPHC36D2VW76YP6WVTRP7Q, seg_pos={0 0}, upload=11929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1psRaRsxoNbAZrcboMGMSEtBDXXsLqBs2C6GnyuYpY71N7jf6N): protocol: read tcp 5.161.89.252:63088->79.127.205.246:4277: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Aug 26 05:39:29.435506319 (13h35m44.660689366s) [seg_pos={0 0}, upload=11929]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 26 05:39:29.435566121 (13h35m44.660749168s) [upload=11929]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:39:29.435570178 (13h35m44.660753236s) [upload=11929]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:39:29.971207124 (13h35m45.196390181s) [upload=11929]: Done uploading segments... Aug 26 05:39:29.971246298 (13h35m45.196429355s) [upload=11929]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 1.546849349s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 16 out of 60 is failed (threshold=3) [.....XX..........XX....X..X.XX....X..X..X..X.......XX.....XX] duration: 629.304128ms FAIL (2025-08-26 05:39:22 UTC) operation: Commit uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 629.328665ms core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 15 out of 60 is failed (threshold=3) [..X..................XXX....XXX......X....X...X......XX.X.XX] duration: 6.400955263s FAIL (2025-08-26 05:39:18 UTC) orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 185F3A8D44118639, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled) Duration: 6.400974859s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 7 out of 60 is failed (threshold=3) [...........X..........X....X...............X..X.........XX..] duration: 8.038445422s remote: "tcp:136.0.77.2:443" response headers: Date=Tue, 26 Aug 2025 05:38:10 GMT Content-Length=423 Vary=Origin X-Request-Id=arLvk5BmSZw Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=185F3A7D8D7F36BC X-Xss-Protection=1; mode=block target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-26 05:39:14 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F3A7D8D7F36BC</RequestId><HostId></HostId></Error>" Duration: 8.038467414s edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 10 out of 60 is failed (threshold=3) [....................X.....XX.XX....XX.................X...XX] duration: 293.975183ms remote: "tcp:45.38.24.2:443" response headers: Accept-Ranges=bytes Content-Length=433 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Request-Id=iiG2eRM4RKD X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:39:13 GMT Server=Storj Vary=Origin X-Amz-Request-Id=185F3A8C39AF2E49 target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-26 05:39:13 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F3A8C39AF2E49</RequestId><HostId></HostId></Error>" Duration: 293.993036ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 6 out of 60 is failed (threshold=6) [....X...............X..X....X....X.......................X..] duration: 8.041458091s remote: "tcp:136.0.77.2:443" response headers: Access-Control-Allow-Methods=GET, HEAD X-Request-Id=ZFwx4y7eAxE Content-Type=text/html; charset=utf-8 Accept-Ranges=bytes Access-Control-Allow-Headers=* Access-Control-Allow-Origin=* Date=Tue, 26 Aug 2025 05:38:38 GMT target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt FAIL (2025-08-26 05:39:12 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error \| Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error \| Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error \| Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY" Duration: 8.041481726s edge linksharing bgp us1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)