Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
22.648616ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Vary=Origin X-Request-Id=EqPNxNUNerd X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 21:00:01 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=189798FF7FD723D8 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/54e34f852a317c95
FAIL (2026-02-25 21:00:01 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189798FF7FD723D8</RequestId><HostId></HostId></Error>"
Duration: 22.665538ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
2.251263479s trace:
https://jaeger.dev.storj.io/trace/71e948d4eec91061
FAIL (2026-02-25 20:59:49 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, Piece ID: NK3OUHGIGJIFK3YNYTXVPCXUAOCHU7LW7OLY5BGZMQCEU2QTIXPQ) context deadline exceeded; piecestore: (Node ID: 1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, Piece ID: LVU6MKTZAAREY46FOMONJ4XISBDO6DIVGBHW6UQMT6AJSDRO7G5Q) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: 52UIJMG3NQWYNNZTSRZQVSJ3IY7CQR4VDS5N3PUJ3PXK7QPXI2NA) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: PXR53Y6CJCXU32KQLN2WUQONSLTBMSPNPJROBEGVXN4ZFXXIZD5Q) context deadline exceeded; piecestore: (Node ID: 12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, Piece ID: 2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ) context deadline exceeded; piecestore: (Node ID: 1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, Piece ID: E6RRIRNNSLE7FBICBBAQEXPUXIYTPT3L2Y53IFKDI7SALSHDP7GA) context deadline exceeded; piecestore: (Node ID: 12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, Piece ID: LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: KMV3U75ZXM4I6J4KQ6NE7S52L52PNCMV2P43WHIRLB5BSTMEWFBA) context deadline exceeded; piecestore: (Node ID: 1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, Piece ID: UQ2URRBL2ZPKHJSPQVYEBYLJM7QQZ5GY6BAMYLEALKNUEPMIUFWA) context deadline exceeded; piecestore: (Node ID: 12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, Piece ID: OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: FC2RYMVA5LYJYNPRQO5TCSAHU6MEPD5S6HA7IMMFJKGVRT6R5QXA) context deadline exceeded; piecestore: (Node ID: 12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, Piece ID: OSYYOFUYXTPY56HUMHLENNMCHRDPRRJ3CA4GY6PUHGJ622GQ6NWQ) context deadline exceeded; piecestore: (Node ID: 1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, Piece ID: NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA) context deadline exceeded; piecestore: (Node ID: 1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, Piece ID: OXJN4M3XCEOOWC3JB3KL637UCLZJ6Z5E3WVEUNEHF7WJ2ZE6F7HA) context deadline exceeded; piecestore: (Node ID: 12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, Piece ID: 4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA) context deadline exceeded; piecestore: (Node ID: 12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, Piece ID: ZM2HOVINDTXULCTGLTNWPFKI6I27XQZCOGNE22QFH3TNMHWH3NAA) context deadline exceeded; piecestore: (Node ID: 12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, Piece ID: KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ) context deadline exceeded
======LOGS======
0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714112751 (192h16m25.853096965s) [noise=true , address=81.171.14.70:4040 , piece_id=VTGJTWIOPXCRD7432PER7PZO5NZYRKVCTAXPLDX3UNH7Q4ORJU7A, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714411960 (192h16m25.853396174s) [noise=true , address=185.167.204.205:4029 , piece_id=KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714734373 (192h16m25.853718587s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714833107 (192h16m25.853817321s) [noise=true , address=81.171.14.70:4033 , piece_id=3ESV63AA2EPW4DGL764CDZULGADNKRI3Z2SSKOTXXBFQZIDALGKQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715325467 (192h16m25.854309681s) [noise=true , address=81.171.14.70:4042 , piece_id=OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715342008 (192h16m25.854326222s) [noise=true , address=81.171.14.70:4041 , piece_id=LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715792569 (192h16m25.854776783s) [noise=true , address=185.167.204.206:4065 , piece_id=2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715842372 (192h16m25.854826587s) [noise=true , address=81.171.14.70:4048 , piece_id=4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.716371520 (192h16m25.855355735s) [noise=true , address=81.171.14.70:4046 , piece_id=NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:07.176030143 (192h16m26.315014346s) [upload=169053]: Next returned nil segment
Feb 25 20:25:07.176040030 (192h16m26.315024225s) [upload=169053]: Waiting for error group managing segments...
Feb 25 20:25:07.355043614 (192h16m26.494027828s) [noise=true , address=81.171.14.70:4039 , piece_id=NK3OUHGIGJIFK3YNYTXVPCXUAOCHU7LW7OLY5BGZMQCEU2QTIXPQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.365274838 (192h16m26.504259023s) [noise=true , address=89.149.201.147:4014 , piece_id=E6RRIRNNSLE7FBICBBAQEXPUXIYTPT3L2Y53IFKDI7SALSHDP7GA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.367225362 (192h16m26.506209576s) [noise=true , address=185.167.204.206:4040 , piece_id=K3IFUMLBFWII6ZXWBAPEPYYBY4OC2C6R2PYLBJ6JYN35QDZC7NKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.371128434 (192h16m26.510112618s) [noise=true , address=81.171.14.70:4033 , piece_id=3ESV63AA2EPW4DGL764CDZULGADNKRI3Z2SSKOTXXBFQZIDALGKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.374437836 (192h16m26.513422051s) [noise=true , address=81.171.14.70:4042 , piece_id=OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.391548321 (192h16m26.530532506s) [noise=true , address=81.171.14.70:4029 , piece_id=KMV3U75ZXM4I6J4KQ6NE7S52L52PNCMV2P43WHIRLB5BSTMEWFBA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.392215328 (192h16m26.531199543s) [noise=true , address=185.167.204.205:4027 , piece_id=EMCAH2W4KVXJNA5VRYHKTW7QMVB5KDY6D22NXI6J7SZPIDILZQ3A, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.392961462 (192h16m26.531945647s) [noise=true , address=81.171.14.70:4048 , piece_id=4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.398831849 (192h16m26.537816033s) [noise=true , address=81.171.14.70:4041 , piece_id=LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.399403016 (192h16m26.5383872s) [noise=true , address=185.167.204.205:4008 , piece_id=FC2RYMVA5LYJYNPRQO5TCSAHU6MEPD5S6HA7IMMFJKGVRT6R5QXA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.399854239 (192h16m26.538838423s) [noise=true , address=81.171.14.70:4046 , piece_id=NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.404371869 (192h16m26.543356093s) [noise=true , address=185.167.204.206:4060 , piece_id=OSYYOFUYXTPY56HUMHLENNMCHRDPRRJ3CA4GY6PUHGJ622GQ6NWQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.405487152 (192h16m26.544471377s) [noise=true , address=81.171.14.70:4025 , piece_id=XK76EA2CGQHTYGUYBGMST6GWZUPHLU6ESLFZKVDIS4JUSBOZWBOA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.410629299 (192h16m26.549613522s) [noise=true , address=185.167.204.205:4029 , piece_id=KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.410670746 (192h16m26.54965496s) [noise=true , address=185.167.204.205:4031 , piece_id=ZCA7B4GAY6NLK5MMEP4TFIHZPTB4KE7MCKUADFCGV5MSJRR6DFKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.411374772 (192h16m26.550358985s) [noise=true , address=185.167.204.205:4003 , piece_id=PXR53Y6CJCXU32KQLN2WUQONSLTBMSPNPJROBEGVXN4ZFXXIZD5Q, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.414774614 (192h16m26.553758838s) [noise=true , address=185.167.204.206:4057 , piece_id=UQ2URRBL2ZPKHJSPQVYEBYLJM7QQZ5GY6BAMYLEALKNUEPMIUFWA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.426466867 (192h16m26.565451081s) [noise=true , address=89.149.201.147:4012 , piece_id=LVU6MKTZAAREY46FOMONJ4XISBDO6DIVGBHW6UQMT6AJSDRO7G5Q, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.427104278 (192h16m26.566088492s) [noise=true , address=185.167.204.206:4065 , piece_id=2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.428092193 (192h16m26.567076408s) [noise=true , address=81.171.14.70:4040 , piece_id=VTGJTWIOPXCRD7432PER7PZO5NZYRKVCTAXPLDX3UNH7Q4ORJU7A, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.436098991 (192h16m26.575083215s) [noise=true , address=89.149.201.147:4017 , piece_id=OXJN4M3XCEOOWC3JB3KL637UCLZJ6Z5E3WVEUNEHF7WJ2ZE6F7HA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.436464915 (192h16m26.575449139s) [noise=true , address=89.149.201.147:4007 , piece_id=6YTZB4PC5LWOBK2W2XVX76VY62GQSNCFEMOYMNKBLBE5LSEEB7FQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.442990667 (192h16m26.581974881s) [noise=true , address=89.149.201.147:4006 , piece_id=BGTO5Q4A3UVVDW6T2F4G722LMZK6MUWTQT3KKYMQWT52Z746G4RQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.444432951 (192h16m26.583417166s) [noise=true , address=185.167.204.206:4049 , piece_id=XEQCFEH3EZUXGS3IYI5XKC2DAQXXIQ2SJN534VPBPLQ4XL4YMMNA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.448326675 (192h16m26.5873109s) [noise=true , address=185.167.204.205:4011 , piece_id=52UIJMG3NQWYNNZTSRZQVSJ3IY7CQR4VDS5N3PUJ3PXK7QPXI2NA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:26:05.522252363 (192h17m24.661236577s) [noise=true , address=89.149.201.147:4020 , piece_id=ZM2HOVINDTXULCTGLTNWPFKI6I27XQZCOGNE22QFH3TNMHWH3NAA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:26:05.522272842 (192h17m24.661257046s) [seg_pos={0 0}, upload=169053]: Satisfied cohort requirements after 26 pieces
Feb 25 20:26:05.522610733 (192h17m24.661594948s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: read tcp 5.161.89.252:45110->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 25 20:26:05.522623126 (192h17m24.66160733s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Long tail cancellation due to optimal threshold
Feb 25 20:26:05.522763870 (192h17m24.661748084s) [noise=true , address=89.149.201.147:4009 , piece_id=OIIRKZOFH6IENR73SYNK63YW7QM6QP3G7EUATUII3FW3DKG33PGQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: read tcp 5.161.89.252:12596->89.149.201.147:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 25 20:26:05.522785930 (192h17m24.661770144s) [noise=true , address=89.149.201.147:4009 , piece_id=OIIRKZOFH6IENR73SYNK63YW7QM6QP3G7EUATUII3FW3DKG33PGQ, seg_pos={0 0}, upload=169053]: Long tail cancellation due to optimal threshold
Feb 25 20:26:05.522806408 (192h17m24.661790612s) [seg_pos={0 0}, upload=169053]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Feb 25 20:26:05.522996834 (192h17m24.661981048s) [upload=169053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 25 20:26:05.523003857 (192h17m24.661988072s) [upload=169053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 25 20:26:05.685962135 (192h17m24.824946349s) [upload=169053]: Done uploading segments...
Feb 25 20:26:05.685982203 (192h17m24.824966427s) [upload=169053]: Upload finished. err: <nil>
Duration: 2.251295371s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
896.914608ms trace:
https://jaeger.dev.storj.io/trace/129824382d277f1d
FAIL (2026-02-25 20:59:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 896.939926ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
25.454949ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Wed, 25 Feb 2026 20:59:44 GMT Accept-Ranges=bytes Content-Type=application/xml Vary=Origin Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=189798FB6DC0CFE2 X-Request-Id=aY3uzfkZGzW X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/430a8343cfa513f0
FAIL (2026-02-25 20:59:44 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189798FB6DC0CFE2</RequestId><HostId></HostId></Error>"
Duration: 25.476129ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.872818ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Type=application/xml X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=189798F983657E0F X-Request-Id=CcuVSnjf6gX Date=Wed, 25 Feb 2026 20:59:35 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/63512842f7aa9014
FAIL (2026-02-25 20:59:35 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189798F983657E0F</RequestId><HostId></HostId></Error>"
Duration: 11.980208ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
25.712109ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=189798F81959E988 X-Xss-Protection=1; mode=block Content-Length=274 X-Request-Id=84K6Lg35emT Date=Wed, 25 Feb 2026 20:59:29 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/267892874c075864
FAIL (2026-02-25 20:59:29 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189798F81959E988</RequestId><HostId></HostId></Error>"
Duration: 25.729753ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
26.205572ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=189798F7548CFB05 Accept-Ranges=bytes Vary=Origin X-Request-Id=P2MTTvYTyR7 X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 20:59:26 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/569b08b25ffb618b
FAIL (2026-02-25 20:59:26 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189798F7548CFB05</RequestId><HostId></HostId></Error>"
Duration: 26.229497ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
2.390866594s trace:
https://jaeger.dev.storj.io/trace/71e948d4eec91061
FAIL (2026-02-25 20:59:23 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, Piece ID: NK3OUHGIGJIFK3YNYTXVPCXUAOCHU7LW7OLY5BGZMQCEU2QTIXPQ) context deadline exceeded; piecestore: (Node ID: 1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, Piece ID: LVU6MKTZAAREY46FOMONJ4XISBDO6DIVGBHW6UQMT6AJSDRO7G5Q) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: 52UIJMG3NQWYNNZTSRZQVSJ3IY7CQR4VDS5N3PUJ3PXK7QPXI2NA) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: PXR53Y6CJCXU32KQLN2WUQONSLTBMSPNPJROBEGVXN4ZFXXIZD5Q) context deadline exceeded; piecestore: (Node ID: 12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, Piece ID: 2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ) context deadline exceeded; piecestore: (Node ID: 1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, Piece ID: E6RRIRNNSLE7FBICBBAQEXPUXIYTPT3L2Y53IFKDI7SALSHDP7GA) context deadline exceeded; piecestore: (Node ID: 12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, Piece ID: LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: KMV3U75ZXM4I6J4KQ6NE7S52L52PNCMV2P43WHIRLB5BSTMEWFBA) context deadline exceeded; piecestore: (Node ID: 1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, Piece ID: UQ2URRBL2ZPKHJSPQVYEBYLJM7QQZ5GY6BAMYLEALKNUEPMIUFWA) context deadline exceeded; piecestore: (Node ID: 12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, Piece ID: OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: FC2RYMVA5LYJYNPRQO5TCSAHU6MEPD5S6HA7IMMFJKGVRT6R5QXA) context deadline exceeded; piecestore: (Node ID: 12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, Piece ID: OSYYOFUYXTPY56HUMHLENNMCHRDPRRJ3CA4GY6PUHGJ622GQ6NWQ) context deadline exceeded; piecestore: (Node ID: 1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, Piece ID: NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA) context deadline exceeded; piecestore: (Node ID: 1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, Piece ID: OXJN4M3XCEOOWC3JB3KL637UCLZJ6Z5E3WVEUNEHF7WJ2ZE6F7HA) context deadline exceeded; piecestore: (Node ID: 12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, Piece ID: 4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA) context deadline exceeded; piecestore: (Node ID: 12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, Piece ID: ZM2HOVINDTXULCTGLTNWPFKI6I27XQZCOGNE22QFH3TNMHWH3NAA) context deadline exceeded; piecestore: (Node ID: 12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, Piece ID: KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ) context deadline exceeded
======LOGS======
0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714112751 (192h16m25.853096965s) [noise=true , address=81.171.14.70:4040 , piece_id=VTGJTWIOPXCRD7432PER7PZO5NZYRKVCTAXPLDX3UNH7Q4ORJU7A, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714411960 (192h16m25.853396174s) [noise=true , address=185.167.204.205:4029 , piece_id=KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714734373 (192h16m25.853718587s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714833107 (192h16m25.853817321s) [noise=true , address=81.171.14.70:4033 , piece_id=3ESV63AA2EPW4DGL764CDZULGADNKRI3Z2SSKOTXXBFQZIDALGKQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715325467 (192h16m25.854309681s) [noise=true , address=81.171.14.70:4042 , piece_id=OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715342008 (192h16m25.854326222s) [noise=true , address=81.171.14.70:4041 , piece_id=LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715792569 (192h16m25.854776783s) [noise=true , address=185.167.204.206:4065 , piece_id=2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715842372 (192h16m25.854826587s) [noise=true , address=81.171.14.70:4048 , piece_id=4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.716371520 (192h16m25.855355735s) [noise=true , address=81.171.14.70:4046 , piece_id=NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:07.176030143 (192h16m26.315014346s) [upload=169053]: Next returned nil segment
Feb 25 20:25:07.176040030 (192h16m26.315024225s) [upload=169053]: Waiting for error group managing segments...
Feb 25 20:25:07.355043614 (192h16m26.494027828s) [noise=true , address=81.171.14.70:4039 , piece_id=NK3OUHGIGJIFK3YNYTXVPCXUAOCHU7LW7OLY5BGZMQCEU2QTIXPQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.365274838 (192h16m26.504259023s) [noise=true , address=89.149.201.147:4014 , piece_id=E6RRIRNNSLE7FBICBBAQEXPUXIYTPT3L2Y53IFKDI7SALSHDP7GA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.367225362 (192h16m26.506209576s) [noise=true , address=185.167.204.206:4040 , piece_id=K3IFUMLBFWII6ZXWBAPEPYYBY4OC2C6R2PYLBJ6JYN35QDZC7NKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.371128434 (192h16m26.510112618s) [noise=true , address=81.171.14.70:4033 , piece_id=3ESV63AA2EPW4DGL764CDZULGADNKRI3Z2SSKOTXXBFQZIDALGKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.374437836 (192h16m26.513422051s) [noise=true , address=81.171.14.70:4042 , piece_id=OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.391548321 (192h16m26.530532506s) [noise=true , address=81.171.14.70:4029 , piece_id=KMV3U75ZXM4I6J4KQ6NE7S52L52PNCMV2P43WHIRLB5BSTMEWFBA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.392215328 (192h16m26.531199543s) [noise=true , address=185.167.204.205:4027 , piece_id=EMCAH2W4KVXJNA5VRYHKTW7QMVB5KDY6D22NXI6J7SZPIDILZQ3A, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.392961462 (192h16m26.531945647s) [noise=true , address=81.171.14.70:4048 , piece_id=4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.398831849 (192h16m26.537816033s) [noise=true , address=81.171.14.70:4041 , piece_id=LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.399403016 (192h16m26.5383872s) [noise=true , address=185.167.204.205:4008 , piece_id=FC2RYMVA5LYJYNPRQO5TCSAHU6MEPD5S6HA7IMMFJKGVRT6R5QXA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.399854239 (192h16m26.538838423s) [noise=true , address=81.171.14.70:4046 , piece_id=NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.404371869 (192h16m26.543356093s) [noise=true , address=185.167.204.206:4060 , piece_id=OSYYOFUYXTPY56HUMHLENNMCHRDPRRJ3CA4GY6PUHGJ622GQ6NWQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.405487152 (192h16m26.544471377s) [noise=true , address=81.171.14.70:4025 , piece_id=XK76EA2CGQHTYGUYBGMST6GWZUPHLU6ESLFZKVDIS4JUSBOZWBOA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.410629299 (192h16m26.549613522s) [noise=true , address=185.167.204.205:4029 , piece_id=KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.410670746 (192h16m26.54965496s) [noise=true , address=185.167.204.205:4031 , piece_id=ZCA7B4GAY6NLK5MMEP4TFIHZPTB4KE7MCKUADFCGV5MSJRR6DFKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.411374772 (192h16m26.550358985s) [noise=true , address=185.167.204.205:4003 , piece_id=PXR53Y6CJCXU32KQLN2WUQONSLTBMSPNPJROBEGVXN4ZFXXIZD5Q, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.414774614 (192h16m26.553758838s) [noise=true , address=185.167.204.206:4057 , piece_id=UQ2URRBL2ZPKHJSPQVYEBYLJM7QQZ5GY6BAMYLEALKNUEPMIUFWA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.426466867 (192h16m26.565451081s) [noise=true , address=89.149.201.147:4012 , piece_id=LVU6MKTZAAREY46FOMONJ4XISBDO6DIVGBHW6UQMT6AJSDRO7G5Q, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.427104278 (192h16m26.566088492s) [noise=true , address=185.167.204.206:4065 , piece_id=2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.428092193 (192h16m26.567076408s) [noise=true , address=81.171.14.70:4040 , piece_id=VTGJTWIOPXCRD7432PER7PZO5NZYRKVCTAXPLDX3UNH7Q4ORJU7A, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.436098991 (192h16m26.575083215s) [noise=true , address=89.149.201.147:4017 , piece_id=OXJN4M3XCEOOWC3JB3KL637UCLZJ6Z5E3WVEUNEHF7WJ2ZE6F7HA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.436464915 (192h16m26.575449139s) [noise=true , address=89.149.201.147:4007 , piece_id=6YTZB4PC5LWOBK2W2XVX76VY62GQSNCFEMOYMNKBLBE5LSEEB7FQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.442990667 (192h16m26.581974881s) [noise=true , address=89.149.201.147:4006 , piece_id=BGTO5Q4A3UVVDW6T2F4G722LMZK6MUWTQT3KKYMQWT52Z746G4RQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.444432951 (192h16m26.583417166s) [noise=true , address=185.167.204.206:4049 , piece_id=XEQCFEH3EZUXGS3IYI5XKC2DAQXXIQ2SJN534VPBPLQ4XL4YMMNA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.448326675 (192h16m26.5873109s) [noise=true , address=185.167.204.205:4011 , piece_id=52UIJMG3NQWYNNZTSRZQVSJ3IY7CQR4VDS5N3PUJ3PXK7QPXI2NA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:26:05.522252363 (192h17m24.661236577s) [noise=true , address=89.149.201.147:4020 , piece_id=ZM2HOVINDTXULCTGLTNWPFKI6I27XQZCOGNE22QFH3TNMHWH3NAA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:26:05.522272842 (192h17m24.661257046s) [seg_pos={0 0}, upload=169053]: Satisfied cohort requirements after 26 pieces
Feb 25 20:26:05.522610733 (192h17m24.661594948s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: read tcp 5.161.89.252:45110->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 25 20:26:05.522623126 (192h17m24.66160733s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Long tail cancellation due to optimal threshold
Feb 25 20:26:05.522763870 (192h17m24.661748084s) [noise=true , address=89.149.201.147:4009 , piece_id=OIIRKZOFH6IENR73SYNK63YW7QM6QP3G7EUATUII3FW3DKG33PGQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: read tcp 5.161.89.252:12596->89.149.201.147:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 25 20:26:05.522785930 (192h17m24.661770144s) [noise=true , address=89.149.201.147:4009 , piece_id=OIIRKZOFH6IENR73SYNK63YW7QM6QP3G7EUATUII3FW3DKG33PGQ, seg_pos={0 0}, upload=169053]: Long tail cancellation due to optimal threshold
Feb 25 20:26:05.522806408 (192h17m24.661790612s) [seg_pos={0 0}, upload=169053]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Feb 25 20:26:05.522996834 (192h17m24.661981048s) [upload=169053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 25 20:26:05.523003857 (192h17m24.661988072s) [upload=169053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 25 20:26:05.685962135 (192h17m24.824946349s) [upload=169053]: Done uploading segments...
Feb 25 20:26:05.685982203 (192h17m24.824966427s) [upload=169053]: Upload finished. err: <nil>
Duration: 2.390895317s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
45.34862ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 20:59:18 GMT Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=189798F5625DAC5F X-Request-Id=aDZiAdPtXUB target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/f438c2a29c4f510
FAIL (2026-02-25 20:59:18 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189798F5625DAC5F</RequestId><HostId></HostId></Error>"
Duration: 45.371643ms
edge
gateway
vhost
bgp
eu1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
857.921792ms trace:
https://jaeger.dev.storj.io/trace/129824382d277f1d
FAIL (2026-02-25 20:59:18 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 857.937802ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
19.133861ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 20:58:49 GMT Content-Length=284 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=189798EEC2BF32F1 X-Request-Id=bx7ehuznMCX target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/69c485095f3ba7a8
FAIL (2026-02-25 20:58:49 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189798EEC2BF32F1</RequestId><HostId></HostId></Error>"
Duration: 19.155773ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
718.382867ms trace:
https://jaeger.dev.storj.io/trace/129824382d277f1d
FAIL (2026-02-25 20:58:48 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 718.415598ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
24.03662ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj X-Amz-Request-Id=189798EE50C621F5 X-Request-Id=GGDspdCKBwY X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 20:58:47 GMT Content-Length=274 Content-Type=application/xml Vary=Origin Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/6caff8f614fce805
FAIL (2026-02-25 20:58:47 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189798EE50C621F5</RequestId><HostId></HostId></Error>"
Duration: 24.079619ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
2.372577282s trace:
https://jaeger.dev.storj.io/trace/71e948d4eec91061
FAIL (2026-02-25 20:58:22 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, Piece ID: NK3OUHGIGJIFK3YNYTXVPCXUAOCHU7LW7OLY5BGZMQCEU2QTIXPQ) context deadline exceeded; piecestore: (Node ID: 1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, Piece ID: LVU6MKTZAAREY46FOMONJ4XISBDO6DIVGBHW6UQMT6AJSDRO7G5Q) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: 52UIJMG3NQWYNNZTSRZQVSJ3IY7CQR4VDS5N3PUJ3PXK7QPXI2NA) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: PXR53Y6CJCXU32KQLN2WUQONSLTBMSPNPJROBEGVXN4ZFXXIZD5Q) context deadline exceeded; piecestore: (Node ID: 12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, Piece ID: 2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ) context deadline exceeded; piecestore: (Node ID: 1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, Piece ID: E6RRIRNNSLE7FBICBBAQEXPUXIYTPT3L2Y53IFKDI7SALSHDP7GA) context deadline exceeded; piecestore: (Node ID: 12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, Piece ID: LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: KMV3U75ZXM4I6J4KQ6NE7S52L52PNCMV2P43WHIRLB5BSTMEWFBA) context deadline exceeded; piecestore: (Node ID: 1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, Piece ID: UQ2URRBL2ZPKHJSPQVYEBYLJM7QQZ5GY6BAMYLEALKNUEPMIUFWA) context deadline exceeded; piecestore: (Node ID: 12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, Piece ID: OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: FC2RYMVA5LYJYNPRQO5TCSAHU6MEPD5S6HA7IMMFJKGVRT6R5QXA) context deadline exceeded; piecestore: (Node ID: 12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, Piece ID: OSYYOFUYXTPY56HUMHLENNMCHRDPRRJ3CA4GY6PUHGJ622GQ6NWQ) context deadline exceeded; piecestore: (Node ID: 1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, Piece ID: NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA) context deadline exceeded; piecestore: (Node ID: 1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, Piece ID: OXJN4M3XCEOOWC3JB3KL637UCLZJ6Z5E3WVEUNEHF7WJ2ZE6F7HA) context deadline exceeded; piecestore: (Node ID: 12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, Piece ID: 4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA) context deadline exceeded; piecestore: (Node ID: 12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, Piece ID: ZM2HOVINDTXULCTGLTNWPFKI6I27XQZCOGNE22QFH3TNMHWH3NAA) context deadline exceeded; piecestore: (Node ID: 12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, Piece ID: KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ) context deadline exceeded
======LOGS======
0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714112751 (192h16m25.853096965s) [noise=true , address=81.171.14.70:4040 , piece_id=VTGJTWIOPXCRD7432PER7PZO5NZYRKVCTAXPLDX3UNH7Q4ORJU7A, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714411960 (192h16m25.853396174s) [noise=true , address=185.167.204.205:4029 , piece_id=KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714734373 (192h16m25.853718587s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714833107 (192h16m25.853817321s) [noise=true , address=81.171.14.70:4033 , piece_id=3ESV63AA2EPW4DGL764CDZULGADNKRI3Z2SSKOTXXBFQZIDALGKQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715325467 (192h16m25.854309681s) [noise=true , address=81.171.14.70:4042 , piece_id=OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715342008 (192h16m25.854326222s) [noise=true , address=81.171.14.70:4041 , piece_id=LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715792569 (192h16m25.854776783s) [noise=true , address=185.167.204.206:4065 , piece_id=2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715842372 (192h16m25.854826587s) [noise=true , address=81.171.14.70:4048 , piece_id=4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.716371520 (192h16m25.855355735s) [noise=true , address=81.171.14.70:4046 , piece_id=NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:07.176030143 (192h16m26.315014346s) [upload=169053]: Next returned nil segment
Feb 25 20:25:07.176040030 (192h16m26.315024225s) [upload=169053]: Waiting for error group managing segments...
Feb 25 20:25:07.355043614 (192h16m26.494027828s) [noise=true , address=81.171.14.70:4039 , piece_id=NK3OUHGIGJIFK3YNYTXVPCXUAOCHU7LW7OLY5BGZMQCEU2QTIXPQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.365274838 (192h16m26.504259023s) [noise=true , address=89.149.201.147:4014 , piece_id=E6RRIRNNSLE7FBICBBAQEXPUXIYTPT3L2Y53IFKDI7SALSHDP7GA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.367225362 (192h16m26.506209576s) [noise=true , address=185.167.204.206:4040 , piece_id=K3IFUMLBFWII6ZXWBAPEPYYBY4OC2C6R2PYLBJ6JYN35QDZC7NKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.371128434 (192h16m26.510112618s) [noise=true , address=81.171.14.70:4033 , piece_id=3ESV63AA2EPW4DGL764CDZULGADNKRI3Z2SSKOTXXBFQZIDALGKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.374437836 (192h16m26.513422051s) [noise=true , address=81.171.14.70:4042 , piece_id=OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.391548321 (192h16m26.530532506s) [noise=true , address=81.171.14.70:4029 , piece_id=KMV3U75ZXM4I6J4KQ6NE7S52L52PNCMV2P43WHIRLB5BSTMEWFBA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.392215328 (192h16m26.531199543s) [noise=true , address=185.167.204.205:4027 , piece_id=EMCAH2W4KVXJNA5VRYHKTW7QMVB5KDY6D22NXI6J7SZPIDILZQ3A, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.392961462 (192h16m26.531945647s) [noise=true , address=81.171.14.70:4048 , piece_id=4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.398831849 (192h16m26.537816033s) [noise=true , address=81.171.14.70:4041 , piece_id=LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.399403016 (192h16m26.5383872s) [noise=true , address=185.167.204.205:4008 , piece_id=FC2RYMVA5LYJYNPRQO5TCSAHU6MEPD5S6HA7IMMFJKGVRT6R5QXA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.399854239 (192h16m26.538838423s) [noise=true , address=81.171.14.70:4046 , piece_id=NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.404371869 (192h16m26.543356093s) [noise=true , address=185.167.204.206:4060 , piece_id=OSYYOFUYXTPY56HUMHLENNMCHRDPRRJ3CA4GY6PUHGJ622GQ6NWQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.405487152 (192h16m26.544471377s) [noise=true , address=81.171.14.70:4025 , piece_id=XK76EA2CGQHTYGUYBGMST6GWZUPHLU6ESLFZKVDIS4JUSBOZWBOA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.410629299 (192h16m26.549613522s) [noise=true , address=185.167.204.205:4029 , piece_id=KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.410670746 (192h16m26.54965496s) [noise=true , address=185.167.204.205:4031 , piece_id=ZCA7B4GAY6NLK5MMEP4TFIHZPTB4KE7MCKUADFCGV5MSJRR6DFKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.411374772 (192h16m26.550358985s) [noise=true , address=185.167.204.205:4003 , piece_id=PXR53Y6CJCXU32KQLN2WUQONSLTBMSPNPJROBEGVXN4ZFXXIZD5Q, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.414774614 (192h16m26.553758838s) [noise=true , address=185.167.204.206:4057 , piece_id=UQ2URRBL2ZPKHJSPQVYEBYLJM7QQZ5GY6BAMYLEALKNUEPMIUFWA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.426466867 (192h16m26.565451081s) [noise=true , address=89.149.201.147:4012 , piece_id=LVU6MKTZAAREY46FOMONJ4XISBDO6DIVGBHW6UQMT6AJSDRO7G5Q, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.427104278 (192h16m26.566088492s) [noise=true , address=185.167.204.206:4065 , piece_id=2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.428092193 (192h16m26.567076408s) [noise=true , address=81.171.14.70:4040 , piece_id=VTGJTWIOPXCRD7432PER7PZO5NZYRKVCTAXPLDX3UNH7Q4ORJU7A, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.436098991 (192h16m26.575083215s) [noise=true , address=89.149.201.147:4017 , piece_id=OXJN4M3XCEOOWC3JB3KL637UCLZJ6Z5E3WVEUNEHF7WJ2ZE6F7HA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.436464915 (192h16m26.575449139s) [noise=true , address=89.149.201.147:4007 , piece_id=6YTZB4PC5LWOBK2W2XVX76VY62GQSNCFEMOYMNKBLBE5LSEEB7FQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.442990667 (192h16m26.581974881s) [noise=true , address=89.149.201.147:4006 , piece_id=BGTO5Q4A3UVVDW6T2F4G722LMZK6MUWTQT3KKYMQWT52Z746G4RQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.444432951 (192h16m26.583417166s) [noise=true , address=185.167.204.206:4049 , piece_id=XEQCFEH3EZUXGS3IYI5XKC2DAQXXIQ2SJN534VPBPLQ4XL4YMMNA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.448326675 (192h16m26.5873109s) [noise=true , address=185.167.204.205:4011 , piece_id=52UIJMG3NQWYNNZTSRZQVSJ3IY7CQR4VDS5N3PUJ3PXK7QPXI2NA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:26:05.522252363 (192h17m24.661236577s) [noise=true , address=89.149.201.147:4020 , piece_id=ZM2HOVINDTXULCTGLTNWPFKI6I27XQZCOGNE22QFH3TNMHWH3NAA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:26:05.522272842 (192h17m24.661257046s) [seg_pos={0 0}, upload=169053]: Satisfied cohort requirements after 26 pieces
Feb 25 20:26:05.522610733 (192h17m24.661594948s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: read tcp 5.161.89.252:45110->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 25 20:26:05.522623126 (192h17m24.66160733s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Long tail cancellation due to optimal threshold
Feb 25 20:26:05.522763870 (192h17m24.661748084s) [noise=true , address=89.149.201.147:4009 , piece_id=OIIRKZOFH6IENR73SYNK63YW7QM6QP3G7EUATUII3FW3DKG33PGQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: read tcp 5.161.89.252:12596->89.149.201.147:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 25 20:26:05.522785930 (192h17m24.661770144s) [noise=true , address=89.149.201.147:4009 , piece_id=OIIRKZOFH6IENR73SYNK63YW7QM6QP3G7EUATUII3FW3DKG33PGQ, seg_pos={0 0}, upload=169053]: Long tail cancellation due to optimal threshold
Feb 25 20:26:05.522806408 (192h17m24.661790612s) [seg_pos={0 0}, upload=169053]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Feb 25 20:26:05.522996834 (192h17m24.661981048s) [upload=169053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 25 20:26:05.523003857 (192h17m24.661988072s) [upload=169053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 25 20:26:05.685962135 (192h17m24.824946349s) [upload=169053]: Done uploading segments...
Feb 25 20:26:05.685982203 (192h17m24.824966427s) [upload=169053]: Upload finished. err: <nil>
Duration: 2.372612687s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
24.902828ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 20:58:12 GMT Accept-Ranges=bytes Content-Type=application/xml X-Amz-Request-Id=189798E60F2274D9 X-Request-Id=VUrm3PxZjXP target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/14eb97cfd5bf73cd
FAIL (2026-02-25 20:58:12 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189798E60F2274D9</RequestId><HostId></HostId></Error>"
Duration: 24.925019ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
25.764768ms remote:
"tcp:136.0.77.3:443" response headers:
X-Request-Id=e1SU5ge9Vng Content-Type=application/xml X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 20:58:09 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=189798E571DFC451 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/4b0e4feb47931361
FAIL (2026-02-25 20:58:09 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189798E571DFC451</RequestId><HostId></HostId></Error>"
Duration: 25.789424ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
40.673917ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=189798E537B1310A X-Request-Id=YXMBwN4nSaz Date=Wed, 25 Feb 2026 20:58:08 GMT Accept-Ranges=bytes Content-Type=application/xml Vary=Origin X-Xss-Protection=1; mode=block Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/1aae2abf94e61870
FAIL (2026-02-25 20:58:08 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189798E537B1310A</RequestId><HostId></HostId></Error>"
Duration: 40.692021ms
edge
gateway
vhost
bgp
ap1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
716.177288ms trace:
https://jaeger.dev.storj.io/trace/129824382d277f1d
FAIL (2026-02-25 20:57:47 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 716.198617ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.781865ms remote:
"tcp:45.38.24.2:443" response headers:
Server=Storj X-Amz-Request-Id=189798DE93DD6B53 Accept-Ranges=bytes Vary=Origin X-Request-Id=YgFtMUMko7Z X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 20:57:40 GMT Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/5316ee6bf306a191
FAIL (2026-02-25 20:57:40 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189798DE93DD6B53</RequestId><HostId></HostId></Error>"
Duration: 13.800018ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
25.394747ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Server=Storj X-Request-Id=Ww56CDGaXPc Vary=Origin X-Amz-Request-Id=189798DD3062CE6C X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 20:57:34 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/76fdf2c413180238
FAIL (2026-02-25 20:57:34 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189798DD3062CE6C</RequestId><HostId></HostId></Error>"
Duration: 25.431295ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
27.522842ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj X-Request-Id=YpqRmiH7pj7 Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=189798DCA7C0D644 X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 20:57:31 GMT Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/520f4ed1cc01d202
FAIL (2026-02-25 20:57:31 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189798DCA7C0D644</RequestId><HostId></HostId></Error>"
Duration: 27.548649ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
35.536241ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Type=application/xml X-Amz-Request-Id=189798DAF3B0F505 X-Request-Id=eFVuWtbnsCJ X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 20:57:24 GMT Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/be76b737be28fb8
FAIL (2026-02-25 20:57:24 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189798DAF3B0F505</RequestId><HostId></HostId></Error>"
Duration: 35.553142ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
590.236365ms trace:
https://jaeger.dev.storj.io/trace/129824382d277f1d
FAIL (2026-02-25 20:57:22 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 590.251643ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
2.290047117s trace:
https://jaeger.dev.storj.io/trace/71e948d4eec91061
FAIL (2026-02-25 20:57:20 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, Piece ID: NK3OUHGIGJIFK3YNYTXVPCXUAOCHU7LW7OLY5BGZMQCEU2QTIXPQ) context deadline exceeded; piecestore: (Node ID: 1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, Piece ID: LVU6MKTZAAREY46FOMONJ4XISBDO6DIVGBHW6UQMT6AJSDRO7G5Q) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: 52UIJMG3NQWYNNZTSRZQVSJ3IY7CQR4VDS5N3PUJ3PXK7QPXI2NA) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: PXR53Y6CJCXU32KQLN2WUQONSLTBMSPNPJROBEGVXN4ZFXXIZD5Q) context deadline exceeded; piecestore: (Node ID: 12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, Piece ID: 2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ) context deadline exceeded; piecestore: (Node ID: 1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, Piece ID: E6RRIRNNSLE7FBICBBAQEXPUXIYTPT3L2Y53IFKDI7SALSHDP7GA) context deadline exceeded; piecestore: (Node ID: 12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, Piece ID: LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: KMV3U75ZXM4I6J4KQ6NE7S52L52PNCMV2P43WHIRLB5BSTMEWFBA) context deadline exceeded; piecestore: (Node ID: 1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, Piece ID: UQ2URRBL2ZPKHJSPQVYEBYLJM7QQZ5GY6BAMYLEALKNUEPMIUFWA) context deadline exceeded; piecestore: (Node ID: 12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, Piece ID: OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: FC2RYMVA5LYJYNPRQO5TCSAHU6MEPD5S6HA7IMMFJKGVRT6R5QXA) context deadline exceeded; piecestore: (Node ID: 12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, Piece ID: OSYYOFUYXTPY56HUMHLENNMCHRDPRRJ3CA4GY6PUHGJ622GQ6NWQ) context deadline exceeded; piecestore: (Node ID: 1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, Piece ID: NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA) context deadline exceeded; piecestore: (Node ID: 1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, Piece ID: OXJN4M3XCEOOWC3JB3KL637UCLZJ6Z5E3WVEUNEHF7WJ2ZE6F7HA) context deadline exceeded; piecestore: (Node ID: 12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, Piece ID: 4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA) context deadline exceeded; piecestore: (Node ID: 12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, Piece ID: ZM2HOVINDTXULCTGLTNWPFKI6I27XQZCOGNE22QFH3TNMHWH3NAA) context deadline exceeded; piecestore: (Node ID: 12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, Piece ID: KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ) context deadline exceeded
======LOGS======
0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714112751 (192h16m25.853096965s) [noise=true , address=81.171.14.70:4040 , piece_id=VTGJTWIOPXCRD7432PER7PZO5NZYRKVCTAXPLDX3UNH7Q4ORJU7A, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714411960 (192h16m25.853396174s) [noise=true , address=185.167.204.205:4029 , piece_id=KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714734373 (192h16m25.853718587s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714833107 (192h16m25.853817321s) [noise=true , address=81.171.14.70:4033 , piece_id=3ESV63AA2EPW4DGL764CDZULGADNKRI3Z2SSKOTXXBFQZIDALGKQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715325467 (192h16m25.854309681s) [noise=true , address=81.171.14.70:4042 , piece_id=OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715342008 (192h16m25.854326222s) [noise=true , address=81.171.14.70:4041 , piece_id=LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715792569 (192h16m25.854776783s) [noise=true , address=185.167.204.206:4065 , piece_id=2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715842372 (192h16m25.854826587s) [noise=true , address=81.171.14.70:4048 , piece_id=4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.716371520 (192h16m25.855355735s) [noise=true , address=81.171.14.70:4046 , piece_id=NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:07.176030143 (192h16m26.315014346s) [upload=169053]: Next returned nil segment
Feb 25 20:25:07.176040030 (192h16m26.315024225s) [upload=169053]: Waiting for error group managing segments...
Feb 25 20:25:07.355043614 (192h16m26.494027828s) [noise=true , address=81.171.14.70:4039 , piece_id=NK3OUHGIGJIFK3YNYTXVPCXUAOCHU7LW7OLY5BGZMQCEU2QTIXPQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.365274838 (192h16m26.504259023s) [noise=true , address=89.149.201.147:4014 , piece_id=E6RRIRNNSLE7FBICBBAQEXPUXIYTPT3L2Y53IFKDI7SALSHDP7GA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.367225362 (192h16m26.506209576s) [noise=true , address=185.167.204.206:4040 , piece_id=K3IFUMLBFWII6ZXWBAPEPYYBY4OC2C6R2PYLBJ6JYN35QDZC7NKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.371128434 (192h16m26.510112618s) [noise=true , address=81.171.14.70:4033 , piece_id=3ESV63AA2EPW4DGL764CDZULGADNKRI3Z2SSKOTXXBFQZIDALGKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.374437836 (192h16m26.513422051s) [noise=true , address=81.171.14.70:4042 , piece_id=OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.391548321 (192h16m26.530532506s) [noise=true , address=81.171.14.70:4029 , piece_id=KMV3U75ZXM4I6J4KQ6NE7S52L52PNCMV2P43WHIRLB5BSTMEWFBA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.392215328 (192h16m26.531199543s) [noise=true , address=185.167.204.205:4027 , piece_id=EMCAH2W4KVXJNA5VRYHKTW7QMVB5KDY6D22NXI6J7SZPIDILZQ3A, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.392961462 (192h16m26.531945647s) [noise=true , address=81.171.14.70:4048 , piece_id=4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.398831849 (192h16m26.537816033s) [noise=true , address=81.171.14.70:4041 , piece_id=LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.399403016 (192h16m26.5383872s) [noise=true , address=185.167.204.205:4008 , piece_id=FC2RYMVA5LYJYNPRQO5TCSAHU6MEPD5S6HA7IMMFJKGVRT6R5QXA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.399854239 (192h16m26.538838423s) [noise=true , address=81.171.14.70:4046 , piece_id=NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.404371869 (192h16m26.543356093s) [noise=true , address=185.167.204.206:4060 , piece_id=OSYYOFUYXTPY56HUMHLENNMCHRDPRRJ3CA4GY6PUHGJ622GQ6NWQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.405487152 (192h16m26.544471377s) [noise=true , address=81.171.14.70:4025 , piece_id=XK76EA2CGQHTYGUYBGMST6GWZUPHLU6ESLFZKVDIS4JUSBOZWBOA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.410629299 (192h16m26.549613522s) [noise=true , address=185.167.204.205:4029 , piece_id=KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.410670746 (192h16m26.54965496s) [noise=true , address=185.167.204.205:4031 , piece_id=ZCA7B4GAY6NLK5MMEP4TFIHZPTB4KE7MCKUADFCGV5MSJRR6DFKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.411374772 (192h16m26.550358985s) [noise=true , address=185.167.204.205:4003 , piece_id=PXR53Y6CJCXU32KQLN2WUQONSLTBMSPNPJROBEGVXN4ZFXXIZD5Q, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.414774614 (192h16m26.553758838s) [noise=true , address=185.167.204.206:4057 , piece_id=UQ2URRBL2ZPKHJSPQVYEBYLJM7QQZ5GY6BAMYLEALKNUEPMIUFWA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.426466867 (192h16m26.565451081s) [noise=true , address=89.149.201.147:4012 , piece_id=LVU6MKTZAAREY46FOMONJ4XISBDO6DIVGBHW6UQMT6AJSDRO7G5Q, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.427104278 (192h16m26.566088492s) [noise=true , address=185.167.204.206:4065 , piece_id=2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.428092193 (192h16m26.567076408s) [noise=true , address=81.171.14.70:4040 , piece_id=VTGJTWIOPXCRD7432PER7PZO5NZYRKVCTAXPLDX3UNH7Q4ORJU7A, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.436098991 (192h16m26.575083215s) [noise=true , address=89.149.201.147:4017 , piece_id=OXJN4M3XCEOOWC3JB3KL637UCLZJ6Z5E3WVEUNEHF7WJ2ZE6F7HA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.436464915 (192h16m26.575449139s) [noise=true , address=89.149.201.147:4007 , piece_id=6YTZB4PC5LWOBK2W2XVX76VY62GQSNCFEMOYMNKBLBE5LSEEB7FQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.442990667 (192h16m26.581974881s) [noise=true , address=89.149.201.147:4006 , piece_id=BGTO5Q4A3UVVDW6T2F4G722LMZK6MUWTQT3KKYMQWT52Z746G4RQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.444432951 (192h16m26.583417166s) [noise=true , address=185.167.204.206:4049 , piece_id=XEQCFEH3EZUXGS3IYI5XKC2DAQXXIQ2SJN534VPBPLQ4XL4YMMNA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.448326675 (192h16m26.5873109s) [noise=true , address=185.167.204.205:4011 , piece_id=52UIJMG3NQWYNNZTSRZQVSJ3IY7CQR4VDS5N3PUJ3PXK7QPXI2NA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:26:05.522252363 (192h17m24.661236577s) [noise=true , address=89.149.201.147:4020 , piece_id=ZM2HOVINDTXULCTGLTNWPFKI6I27XQZCOGNE22QFH3TNMHWH3NAA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:26:05.522272842 (192h17m24.661257046s) [seg_pos={0 0}, upload=169053]: Satisfied cohort requirements after 26 pieces
Feb 25 20:26:05.522610733 (192h17m24.661594948s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: read tcp 5.161.89.252:45110->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 25 20:26:05.522623126 (192h17m24.66160733s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Long tail cancellation due to optimal threshold
Feb 25 20:26:05.522763870 (192h17m24.661748084s) [noise=true , address=89.149.201.147:4009 , piece_id=OIIRKZOFH6IENR73SYNK63YW7QM6QP3G7EUATUII3FW3DKG33PGQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: read tcp 5.161.89.252:12596->89.149.201.147:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 25 20:26:05.522785930 (192h17m24.661770144s) [noise=true , address=89.149.201.147:4009 , piece_id=OIIRKZOFH6IENR73SYNK63YW7QM6QP3G7EUATUII3FW3DKG33PGQ, seg_pos={0 0}, upload=169053]: Long tail cancellation due to optimal threshold
Feb 25 20:26:05.522806408 (192h17m24.661790612s) [seg_pos={0 0}, upload=169053]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Feb 25 20:26:05.522996834 (192h17m24.661981048s) [upload=169053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 25 20:26:05.523003857 (192h17m24.661988072s) [upload=169053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 25 20:26:05.685962135 (192h17m24.824946349s) [upload=169053]: Done uploading segments...
Feb 25 20:26:05.685982203 (192h17m24.824966427s) [upload=169053]: Upload finished. err: <nil>
Duration: 2.290065852s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.541196ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=189798D6C8EF146D Date=Wed, 25 Feb 2026 20:57:06 GMT Accept-Ranges=bytes Content-Length=284 Vary=Origin X-Request-Id=8ZCWmgJg7VQ X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/108bf9149ab8701c
FAIL (2026-02-25 20:57:06 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189798D6C8EF146D</RequestId><HostId></HostId></Error>"
Duration: 8.554271ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
24.249002ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=189798D64CBC7256 X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 20:57:04 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=ZbpiQCny8iM target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/11f68030b8f315f2
FAIL (2026-02-25 20:57:04 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189798D64CBC7256</RequestId><HostId></HostId></Error>"
Duration: 24.27487ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
51.97079ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Wed, 25 Feb 2026 20:56:56 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=189798D453BE1455 X-Request-Id=XGCGvGDia1e Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/7dae4e477fbcae0d
FAIL (2026-02-25 20:56:56 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189798D453BE1455</RequestId><HostId></HostId></Error>"
Duration: 51.993171ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
24.139286ms remote:
"tcp:136.0.77.3:443" response headers:
X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 20:56:36 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=189798CFBD55C685 Accept-Ranges=bytes Content-Length=274 Server=Storj X-Request-Id=g1LxogQXSGJ target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/1129ce88ca11c209
FAIL (2026-02-25 20:56:36 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189798CFBD55C685</RequestId><HostId></HostId></Error>"
Duration: 24.159263ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
2.763297649s trace:
https://jaeger.dev.storj.io/trace/71e948d4eec91061
FAIL (2026-02-25 20:56:35 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, Piece ID: NK3OUHGIGJIFK3YNYTXVPCXUAOCHU7LW7OLY5BGZMQCEU2QTIXPQ) context deadline exceeded; piecestore: (Node ID: 1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, Piece ID: LVU6MKTZAAREY46FOMONJ4XISBDO6DIVGBHW6UQMT6AJSDRO7G5Q) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: 52UIJMG3NQWYNNZTSRZQVSJ3IY7CQR4VDS5N3PUJ3PXK7QPXI2NA) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: PXR53Y6CJCXU32KQLN2WUQONSLTBMSPNPJROBEGVXN4ZFXXIZD5Q) context deadline exceeded; piecestore: (Node ID: 12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, Piece ID: 2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ) context deadline exceeded; piecestore: (Node ID: 1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, Piece ID: E6RRIRNNSLE7FBICBBAQEXPUXIYTPT3L2Y53IFKDI7SALSHDP7GA) context deadline exceeded; piecestore: (Node ID: 12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, Piece ID: LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: KMV3U75ZXM4I6J4KQ6NE7S52L52PNCMV2P43WHIRLB5BSTMEWFBA) context deadline exceeded; piecestore: (Node ID: 1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, Piece ID: UQ2URRBL2ZPKHJSPQVYEBYLJM7QQZ5GY6BAMYLEALKNUEPMIUFWA) context deadline exceeded; piecestore: (Node ID: 12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, Piece ID: OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: FC2RYMVA5LYJYNPRQO5TCSAHU6MEPD5S6HA7IMMFJKGVRT6R5QXA) context deadline exceeded; piecestore: (Node ID: 12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, Piece ID: OSYYOFUYXTPY56HUMHLENNMCHRDPRRJ3CA4GY6PUHGJ622GQ6NWQ) context deadline exceeded; piecestore: (Node ID: 1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, Piece ID: NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA) context deadline exceeded; piecestore: (Node ID: 1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, Piece ID: OXJN4M3XCEOOWC3JB3KL637UCLZJ6Z5E3WVEUNEHF7WJ2ZE6F7HA) context deadline exceeded; piecestore: (Node ID: 12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, Piece ID: 4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA) context deadline exceeded; piecestore: (Node ID: 12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, Piece ID: ZM2HOVINDTXULCTGLTNWPFKI6I27XQZCOGNE22QFH3TNMHWH3NAA) context deadline exceeded; piecestore: (Node ID: 12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, Piece ID: KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ) context deadline exceeded
======LOGS======
0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714112751 (192h16m25.853096965s) [noise=true , address=81.171.14.70:4040 , piece_id=VTGJTWIOPXCRD7432PER7PZO5NZYRKVCTAXPLDX3UNH7Q4ORJU7A, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714411960 (192h16m25.853396174s) [noise=true , address=185.167.204.205:4029 , piece_id=KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714734373 (192h16m25.853718587s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714833107 (192h16m25.853817321s) [noise=true , address=81.171.14.70:4033 , piece_id=3ESV63AA2EPW4DGL764CDZULGADNKRI3Z2SSKOTXXBFQZIDALGKQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715325467 (192h16m25.854309681s) [noise=true , address=81.171.14.70:4042 , piece_id=OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715342008 (192h16m25.854326222s) [noise=true , address=81.171.14.70:4041 , piece_id=LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715792569 (192h16m25.854776783s) [noise=true , address=185.167.204.206:4065 , piece_id=2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715842372 (192h16m25.854826587s) [noise=true , address=81.171.14.70:4048 , piece_id=4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.716371520 (192h16m25.855355735s) [noise=true , address=81.171.14.70:4046 , piece_id=NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:07.176030143 (192h16m26.315014346s) [upload=169053]: Next returned nil segment
Feb 25 20:25:07.176040030 (192h16m26.315024225s) [upload=169053]: Waiting for error group managing segments...
Feb 25 20:25:07.355043614 (192h16m26.494027828s) [noise=true , address=81.171.14.70:4039 , piece_id=NK3OUHGIGJIFK3YNYTXVPCXUAOCHU7LW7OLY5BGZMQCEU2QTIXPQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.365274838 (192h16m26.504259023s) [noise=true , address=89.149.201.147:4014 , piece_id=E6RRIRNNSLE7FBICBBAQEXPUXIYTPT3L2Y53IFKDI7SALSHDP7GA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.367225362 (192h16m26.506209576s) [noise=true , address=185.167.204.206:4040 , piece_id=K3IFUMLBFWII6ZXWBAPEPYYBY4OC2C6R2PYLBJ6JYN35QDZC7NKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.371128434 (192h16m26.510112618s) [noise=true , address=81.171.14.70:4033 , piece_id=3ESV63AA2EPW4DGL764CDZULGADNKRI3Z2SSKOTXXBFQZIDALGKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.374437836 (192h16m26.513422051s) [noise=true , address=81.171.14.70:4042 , piece_id=OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.391548321 (192h16m26.530532506s) [noise=true , address=81.171.14.70:4029 , piece_id=KMV3U75ZXM4I6J4KQ6NE7S52L52PNCMV2P43WHIRLB5BSTMEWFBA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.392215328 (192h16m26.531199543s) [noise=true , address=185.167.204.205:4027 , piece_id=EMCAH2W4KVXJNA5VRYHKTW7QMVB5KDY6D22NXI6J7SZPIDILZQ3A, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.392961462 (192h16m26.531945647s) [noise=true , address=81.171.14.70:4048 , piece_id=4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.398831849 (192h16m26.537816033s) [noise=true , address=81.171.14.70:4041 , piece_id=LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.399403016 (192h16m26.5383872s) [noise=true , address=185.167.204.205:4008 , piece_id=FC2RYMVA5LYJYNPRQO5TCSAHU6MEPD5S6HA7IMMFJKGVRT6R5QXA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.399854239 (192h16m26.538838423s) [noise=true , address=81.171.14.70:4046 , piece_id=NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.404371869 (192h16m26.543356093s) [noise=true , address=185.167.204.206:4060 , piece_id=OSYYOFUYXTPY56HUMHLENNMCHRDPRRJ3CA4GY6PUHGJ622GQ6NWQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.405487152 (192h16m26.544471377s) [noise=true , address=81.171.14.70:4025 , piece_id=XK76EA2CGQHTYGUYBGMST6GWZUPHLU6ESLFZKVDIS4JUSBOZWBOA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.410629299 (192h16m26.549613522s) [noise=true , address=185.167.204.205:4029 , piece_id=KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.410670746 (192h16m26.54965496s) [noise=true , address=185.167.204.205:4031 , piece_id=ZCA7B4GAY6NLK5MMEP4TFIHZPTB4KE7MCKUADFCGV5MSJRR6DFKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.411374772 (192h16m26.550358985s) [noise=true , address=185.167.204.205:4003 , piece_id=PXR53Y6CJCXU32KQLN2WUQONSLTBMSPNPJROBEGVXN4ZFXXIZD5Q, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.414774614 (192h16m26.553758838s) [noise=true , address=185.167.204.206:4057 , piece_id=UQ2URRBL2ZPKHJSPQVYEBYLJM7QQZ5GY6BAMYLEALKNUEPMIUFWA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.426466867 (192h16m26.565451081s) [noise=true , address=89.149.201.147:4012 , piece_id=LVU6MKTZAAREY46FOMONJ4XISBDO6DIVGBHW6UQMT6AJSDRO7G5Q, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.427104278 (192h16m26.566088492s) [noise=true , address=185.167.204.206:4065 , piece_id=2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.428092193 (192h16m26.567076408s) [noise=true , address=81.171.14.70:4040 , piece_id=VTGJTWIOPXCRD7432PER7PZO5NZYRKVCTAXPLDX3UNH7Q4ORJU7A, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.436098991 (192h16m26.575083215s) [noise=true , address=89.149.201.147:4017 , piece_id=OXJN4M3XCEOOWC3JB3KL637UCLZJ6Z5E3WVEUNEHF7WJ2ZE6F7HA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.436464915 (192h16m26.575449139s) [noise=true , address=89.149.201.147:4007 , piece_id=6YTZB4PC5LWOBK2W2XVX76VY62GQSNCFEMOYMNKBLBE5LSEEB7FQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.442990667 (192h16m26.581974881s) [noise=true , address=89.149.201.147:4006 , piece_id=BGTO5Q4A3UVVDW6T2F4G722LMZK6MUWTQT3KKYMQWT52Z746G4RQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.444432951 (192h16m26.583417166s) [noise=true , address=185.167.204.206:4049 , piece_id=XEQCFEH3EZUXGS3IYI5XKC2DAQXXIQ2SJN534VPBPLQ4XL4YMMNA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.448326675 (192h16m26.5873109s) [noise=true , address=185.167.204.205:4011 , piece_id=52UIJMG3NQWYNNZTSRZQVSJ3IY7CQR4VDS5N3PUJ3PXK7QPXI2NA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:26:05.522252363 (192h17m24.661236577s) [noise=true , address=89.149.201.147:4020 , piece_id=ZM2HOVINDTXULCTGLTNWPFKI6I27XQZCOGNE22QFH3TNMHWH3NAA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:26:05.522272842 (192h17m24.661257046s) [seg_pos={0 0}, upload=169053]: Satisfied cohort requirements after 26 pieces
Feb 25 20:26:05.522610733 (192h17m24.661594948s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: read tcp 5.161.89.252:45110->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 25 20:26:05.522623126 (192h17m24.66160733s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Long tail cancellation due to optimal threshold
Feb 25 20:26:05.522763870 (192h17m24.661748084s) [noise=true , address=89.149.201.147:4009 , piece_id=OIIRKZOFH6IENR73SYNK63YW7QM6QP3G7EUATUII3FW3DKG33PGQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: read tcp 5.161.89.252:12596->89.149.201.147:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 25 20:26:05.522785930 (192h17m24.661770144s) [noise=true , address=89.149.201.147:4009 , piece_id=OIIRKZOFH6IENR73SYNK63YW7QM6QP3G7EUATUII3FW3DKG33PGQ, seg_pos={0 0}, upload=169053]: Long tail cancellation due to optimal threshold
Feb 25 20:26:05.522806408 (192h17m24.661790612s) [seg_pos={0 0}, upload=169053]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Feb 25 20:26:05.522996834 (192h17m24.661981048s) [upload=169053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 25 20:26:05.523003857 (192h17m24.661988072s) [upload=169053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 25 20:26:05.685962135 (192h17m24.824946349s) [upload=169053]: Done uploading segments...
Feb 25 20:26:05.685982203 (192h17m24.824966427s) [upload=169053]: Upload finished. err: <nil>
Duration: 2.763323216s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
20.915333ms remote:
"tcp:45.38.24.2:443" response headers:
X-Request-Id=Xw7HvQ72igD Date=Wed, 25 Feb 2026 20:56:35 GMT Accept-Ranges=bytes Vary=Origin X-Xss-Protection=1; mode=block Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=189798CF7846B5D8 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/702cdd962c76e6ac
FAIL (2026-02-25 20:56:35 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189798CF7846B5D8</RequestId><HostId></HostId></Error>"
Duration: 20.932766ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
24.465104ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=189798CC607E1843 X-Request-Id=FD2XRaGMmGD Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 20:56:21 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/942f73776e044aa
FAIL (2026-02-25 20:56:21 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189798CC607E1843</RequestId><HostId></HostId></Error>"
Duration: 24.486645ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
24.879218ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Server=Storj Vary=Origin X-Amz-Request-Id=189798CB0253FECC X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 20:56:16 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Request-Id=AzHhkXdo5ys target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/6311157536fc6bb7
FAIL (2026-02-25 20:56:16 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189798CB0253FECC</RequestId><HostId></HostId></Error>"
Duration: 24.896621ms
edge
gateway
vhost
bgp
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
815.692337ms trace:
https://jaeger.dev.storj.io/trace/129824382d277f1d
FAIL (2026-02-25 20:56:15 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 815.713236ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.022888ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 20:56:09 GMT Content-Type=application/xml Server=Storj X-Amz-Request-Id=189798C98AEA96EC X-Request-Id=4EHBKhiCDc1 Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/49934278c1d7a8b3
FAIL (2026-02-25 20:56:09 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189798C98AEA96EC</RequestId><HostId></HostId></Error>"
Duration: 30.042485ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
2.363456516s trace:
https://jaeger.dev.storj.io/trace/71e948d4eec91061
FAIL (2026-02-25 20:56:02 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, Piece ID: NK3OUHGIGJIFK3YNYTXVPCXUAOCHU7LW7OLY5BGZMQCEU2QTIXPQ) context deadline exceeded; piecestore: (Node ID: 1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, Piece ID: LVU6MKTZAAREY46FOMONJ4XISBDO6DIVGBHW6UQMT6AJSDRO7G5Q) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: 52UIJMG3NQWYNNZTSRZQVSJ3IY7CQR4VDS5N3PUJ3PXK7QPXI2NA) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: PXR53Y6CJCXU32KQLN2WUQONSLTBMSPNPJROBEGVXN4ZFXXIZD5Q) context deadline exceeded; piecestore: (Node ID: 12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, Piece ID: 2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ) context deadline exceeded; piecestore: (Node ID: 1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, Piece ID: E6RRIRNNSLE7FBICBBAQEXPUXIYTPT3L2Y53IFKDI7SALSHDP7GA) context deadline exceeded; piecestore: (Node ID: 12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, Piece ID: LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: KMV3U75ZXM4I6J4KQ6NE7S52L52PNCMV2P43WHIRLB5BSTMEWFBA) context deadline exceeded; piecestore: (Node ID: 1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, Piece ID: UQ2URRBL2ZPKHJSPQVYEBYLJM7QQZ5GY6BAMYLEALKNUEPMIUFWA) context deadline exceeded; piecestore: (Node ID: 12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, Piece ID: OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: FC2RYMVA5LYJYNPRQO5TCSAHU6MEPD5S6HA7IMMFJKGVRT6R5QXA) context deadline exceeded; piecestore: (Node ID: 12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, Piece ID: OSYYOFUYXTPY56HUMHLENNMCHRDPRRJ3CA4GY6PUHGJ622GQ6NWQ) context deadline exceeded; piecestore: (Node ID: 1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, Piece ID: NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA) context deadline exceeded; piecestore: (Node ID: 1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, Piece ID: OXJN4M3XCEOOWC3JB3KL637UCLZJ6Z5E3WVEUNEHF7WJ2ZE6F7HA) context deadline exceeded; piecestore: (Node ID: 12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, Piece ID: 4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA) context deadline exceeded; piecestore: (Node ID: 12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, Piece ID: ZM2HOVINDTXULCTGLTNWPFKI6I27XQZCOGNE22QFH3TNMHWH3NAA) context deadline exceeded; piecestore: (Node ID: 12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, Piece ID: KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ) context deadline exceeded
======LOGS======
0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714112751 (192h16m25.853096965s) [noise=true , address=81.171.14.70:4040 , piece_id=VTGJTWIOPXCRD7432PER7PZO5NZYRKVCTAXPLDX3UNH7Q4ORJU7A, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714411960 (192h16m25.853396174s) [noise=true , address=185.167.204.205:4029 , piece_id=KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714734373 (192h16m25.853718587s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714833107 (192h16m25.853817321s) [noise=true , address=81.171.14.70:4033 , piece_id=3ESV63AA2EPW4DGL764CDZULGADNKRI3Z2SSKOTXXBFQZIDALGKQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715325467 (192h16m25.854309681s) [noise=true , address=81.171.14.70:4042 , piece_id=OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715342008 (192h16m25.854326222s) [noise=true , address=81.171.14.70:4041 , piece_id=LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715792569 (192h16m25.854776783s) [noise=true , address=185.167.204.206:4065 , piece_id=2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715842372 (192h16m25.854826587s) [noise=true , address=81.171.14.70:4048 , piece_id=4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.716371520 (192h16m25.855355735s) [noise=true , address=81.171.14.70:4046 , piece_id=NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:07.176030143 (192h16m26.315014346s) [upload=169053]: Next returned nil segment
Feb 25 20:25:07.176040030 (192h16m26.315024225s) [upload=169053]: Waiting for error group managing segments...
Feb 25 20:25:07.355043614 (192h16m26.494027828s) [noise=true , address=81.171.14.70:4039 , piece_id=NK3OUHGIGJIFK3YNYTXVPCXUAOCHU7LW7OLY5BGZMQCEU2QTIXPQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.365274838 (192h16m26.504259023s) [noise=true , address=89.149.201.147:4014 , piece_id=E6RRIRNNSLE7FBICBBAQEXPUXIYTPT3L2Y53IFKDI7SALSHDP7GA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.367225362 (192h16m26.506209576s) [noise=true , address=185.167.204.206:4040 , piece_id=K3IFUMLBFWII6ZXWBAPEPYYBY4OC2C6R2PYLBJ6JYN35QDZC7NKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.371128434 (192h16m26.510112618s) [noise=true , address=81.171.14.70:4033 , piece_id=3ESV63AA2EPW4DGL764CDZULGADNKRI3Z2SSKOTXXBFQZIDALGKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.374437836 (192h16m26.513422051s) [noise=true , address=81.171.14.70:4042 , piece_id=OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.391548321 (192h16m26.530532506s) [noise=true , address=81.171.14.70:4029 , piece_id=KMV3U75ZXM4I6J4KQ6NE7S52L52PNCMV2P43WHIRLB5BSTMEWFBA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.392215328 (192h16m26.531199543s) [noise=true , address=185.167.204.205:4027 , piece_id=EMCAH2W4KVXJNA5VRYHKTW7QMVB5KDY6D22NXI6J7SZPIDILZQ3A, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.392961462 (192h16m26.531945647s) [noise=true , address=81.171.14.70:4048 , piece_id=4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.398831849 (192h16m26.537816033s) [noise=true , address=81.171.14.70:4041 , piece_id=LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.399403016 (192h16m26.5383872s) [noise=true , address=185.167.204.205:4008 , piece_id=FC2RYMVA5LYJYNPRQO5TCSAHU6MEPD5S6HA7IMMFJKGVRT6R5QXA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.399854239 (192h16m26.538838423s) [noise=true , address=81.171.14.70:4046 , piece_id=NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.404371869 (192h16m26.543356093s) [noise=true , address=185.167.204.206:4060 , piece_id=OSYYOFUYXTPY56HUMHLENNMCHRDPRRJ3CA4GY6PUHGJ622GQ6NWQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.405487152 (192h16m26.544471377s) [noise=true , address=81.171.14.70:4025 , piece_id=XK76EA2CGQHTYGUYBGMST6GWZUPHLU6ESLFZKVDIS4JUSBOZWBOA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.410629299 (192h16m26.549613522s) [noise=true , address=185.167.204.205:4029 , piece_id=KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.410670746 (192h16m26.54965496s) [noise=true , address=185.167.204.205:4031 , piece_id=ZCA7B4GAY6NLK5MMEP4TFIHZPTB4KE7MCKUADFCGV5MSJRR6DFKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.411374772 (192h16m26.550358985s) [noise=true , address=185.167.204.205:4003 , piece_id=PXR53Y6CJCXU32KQLN2WUQONSLTBMSPNPJROBEGVXN4ZFXXIZD5Q, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.414774614 (192h16m26.553758838s) [noise=true , address=185.167.204.206:4057 , piece_id=UQ2URRBL2ZPKHJSPQVYEBYLJM7QQZ5GY6BAMYLEALKNUEPMIUFWA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.426466867 (192h16m26.565451081s) [noise=true , address=89.149.201.147:4012 , piece_id=LVU6MKTZAAREY46FOMONJ4XISBDO6DIVGBHW6UQMT6AJSDRO7G5Q, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.427104278 (192h16m26.566088492s) [noise=true , address=185.167.204.206:4065 , piece_id=2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.428092193 (192h16m26.567076408s) [noise=true , address=81.171.14.70:4040 , piece_id=VTGJTWIOPXCRD7432PER7PZO5NZYRKVCTAXPLDX3UNH7Q4ORJU7A, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.436098991 (192h16m26.575083215s) [noise=true , address=89.149.201.147:4017 , piece_id=OXJN4M3XCEOOWC3JB3KL637UCLZJ6Z5E3WVEUNEHF7WJ2ZE6F7HA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.436464915 (192h16m26.575449139s) [noise=true , address=89.149.201.147:4007 , piece_id=6YTZB4PC5LWOBK2W2XVX76VY62GQSNCFEMOYMNKBLBE5LSEEB7FQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.442990667 (192h16m26.581974881s) [noise=true , address=89.149.201.147:4006 , piece_id=BGTO5Q4A3UVVDW6T2F4G722LMZK6MUWTQT3KKYMQWT52Z746G4RQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.444432951 (192h16m26.583417166s) [noise=true , address=185.167.204.206:4049 , piece_id=XEQCFEH3EZUXGS3IYI5XKC2DAQXXIQ2SJN534VPBPLQ4XL4YMMNA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.448326675 (192h16m26.5873109s) [noise=true , address=185.167.204.205:4011 , piece_id=52UIJMG3NQWYNNZTSRZQVSJ3IY7CQR4VDS5N3PUJ3PXK7QPXI2NA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:26:05.522252363 (192h17m24.661236577s) [noise=true , address=89.149.201.147:4020 , piece_id=ZM2HOVINDTXULCTGLTNWPFKI6I27XQZCOGNE22QFH3TNMHWH3NAA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:26:05.522272842 (192h17m24.661257046s) [seg_pos={0 0}, upload=169053]: Satisfied cohort requirements after 26 pieces
Feb 25 20:26:05.522610733 (192h17m24.661594948s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: read tcp 5.161.89.252:45110->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 25 20:26:05.522623126 (192h17m24.66160733s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Long tail cancellation due to optimal threshold
Feb 25 20:26:05.522763870 (192h17m24.661748084s) [noise=true , address=89.149.201.147:4009 , piece_id=OIIRKZOFH6IENR73SYNK63YW7QM6QP3G7EUATUII3FW3DKG33PGQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: read tcp 5.161.89.252:12596->89.149.201.147:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 25 20:26:05.522785930 (192h17m24.661770144s) [noise=true , address=89.149.201.147:4009 , piece_id=OIIRKZOFH6IENR73SYNK63YW7QM6QP3G7EUATUII3FW3DKG33PGQ, seg_pos={0 0}, upload=169053]: Long tail cancellation due to optimal threshold
Feb 25 20:26:05.522806408 (192h17m24.661790612s) [seg_pos={0 0}, upload=169053]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Feb 25 20:26:05.522996834 (192h17m24.661981048s) [upload=169053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 25 20:26:05.523003857 (192h17m24.661988072s) [upload=169053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 25 20:26:05.685962135 (192h17m24.824946349s) [upload=169053]: Done uploading segments...
Feb 25 20:26:05.685982203 (192h17m24.824966427s) [upload=169053]: Upload finished. err: <nil>
Duration: 2.363483936s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
24.98217ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj Vary=Origin X-Request-Id=VKMZ4VyN7yt Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml X-Amz-Request-Id=189798C191F748C3 X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 20:55:35 GMT Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/3c4cbfb9a6b55cf8
FAIL (2026-02-25 20:55:35 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189798C191F748C3</RequestId><HostId></HostId></Error>"
Duration: 25.005044ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.502544ms remote:
"tcp:45.38.24.2:443" response headers:
X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 20:55:33 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content X-Request-Id=Yv8piLYna4o Content-Length=284 Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=189798C11BBBD5F6 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/678ae878302a7b56
FAIL (2026-02-25 20:55:33 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189798C11BBBD5F6</RequestId><HostId></HostId></Error>"
Duration: 8.523254ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
24.797906ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=189798C0CECAFD32 X-Request-Id=aoNYESt5bt1 X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Date=Wed, 25 Feb 2026 20:55:32 GMT Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/1dada093a1fe1aea
FAIL (2026-02-25 20:55:32 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189798C0CECAFD32</RequestId><HostId></HostId></Error>"
Duration: 24.818547ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.262097ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Server=Storj X-Request-Id=V5DAfGmWwBK Date=Wed, 25 Feb 2026 20:55:31 GMT Accept-Ranges=bytes Content-Length=274 Vary=Origin X-Amz-Request-Id=189798C092A3F7F7 X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/78befca15ae7eab4
FAIL (2026-02-25 20:55:31 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189798C092A3F7F7</RequestId><HostId></HostId></Error>"
Duration: 29.28457ms
edge
gateway
vhost
bgp
eu1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
690.111372ms trace:
https://jaeger.dev.storj.io/trace/129824382d277f1d
FAIL (2026-02-25 20:55:11 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 690.134785ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
2.274368635s trace:
https://jaeger.dev.storj.io/trace/71e948d4eec91061
FAIL (2026-02-25 20:55:08 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, Piece ID: NK3OUHGIGJIFK3YNYTXVPCXUAOCHU7LW7OLY5BGZMQCEU2QTIXPQ) context deadline exceeded; piecestore: (Node ID: 1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, Piece ID: LVU6MKTZAAREY46FOMONJ4XISBDO6DIVGBHW6UQMT6AJSDRO7G5Q) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: 52UIJMG3NQWYNNZTSRZQVSJ3IY7CQR4VDS5N3PUJ3PXK7QPXI2NA) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: PXR53Y6CJCXU32KQLN2WUQONSLTBMSPNPJROBEGVXN4ZFXXIZD5Q) context deadline exceeded; piecestore: (Node ID: 12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, Piece ID: 2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ) context deadline exceeded; piecestore: (Node ID: 1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, Piece ID: E6RRIRNNSLE7FBICBBAQEXPUXIYTPT3L2Y53IFKDI7SALSHDP7GA) context deadline exceeded; piecestore: (Node ID: 12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, Piece ID: LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: KMV3U75ZXM4I6J4KQ6NE7S52L52PNCMV2P43WHIRLB5BSTMEWFBA) context deadline exceeded; piecestore: (Node ID: 1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, Piece ID: UQ2URRBL2ZPKHJSPQVYEBYLJM7QQZ5GY6BAMYLEALKNUEPMIUFWA) context deadline exceeded; piecestore: (Node ID: 12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, Piece ID: OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: FC2RYMVA5LYJYNPRQO5TCSAHU6MEPD5S6HA7IMMFJKGVRT6R5QXA) context deadline exceeded; piecestore: (Node ID: 12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, Piece ID: OSYYOFUYXTPY56HUMHLENNMCHRDPRRJ3CA4GY6PUHGJ622GQ6NWQ) context deadline exceeded; piecestore: (Node ID: 1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, Piece ID: NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA) context deadline exceeded; piecestore: (Node ID: 1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, Piece ID: OXJN4M3XCEOOWC3JB3KL637UCLZJ6Z5E3WVEUNEHF7WJ2ZE6F7HA) context deadline exceeded; piecestore: (Node ID: 12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, Piece ID: 4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA) context deadline exceeded; piecestore: (Node ID: 12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, Piece ID: ZM2HOVINDTXULCTGLTNWPFKI6I27XQZCOGNE22QFH3TNMHWH3NAA) context deadline exceeded; piecestore: (Node ID: 12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, Piece ID: KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ) context deadline exceeded
======LOGS======
0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714112751 (192h16m25.853096965s) [noise=true , address=81.171.14.70:4040 , piece_id=VTGJTWIOPXCRD7432PER7PZO5NZYRKVCTAXPLDX3UNH7Q4ORJU7A, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714411960 (192h16m25.853396174s) [noise=true , address=185.167.204.205:4029 , piece_id=KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714734373 (192h16m25.853718587s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714833107 (192h16m25.853817321s) [noise=true , address=81.171.14.70:4033 , piece_id=3ESV63AA2EPW4DGL764CDZULGADNKRI3Z2SSKOTXXBFQZIDALGKQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715325467 (192h16m25.854309681s) [noise=true , address=81.171.14.70:4042 , piece_id=OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715342008 (192h16m25.854326222s) [noise=true , address=81.171.14.70:4041 , piece_id=LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715792569 (192h16m25.854776783s) [noise=true , address=185.167.204.206:4065 , piece_id=2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715842372 (192h16m25.854826587s) [noise=true , address=81.171.14.70:4048 , piece_id=4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.716371520 (192h16m25.855355735s) [noise=true , address=81.171.14.70:4046 , piece_id=NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:07.176030143 (192h16m26.315014346s) [upload=169053]: Next returned nil segment
Feb 25 20:25:07.176040030 (192h16m26.315024225s) [upload=169053]: Waiting for error group managing segments...
Feb 25 20:25:07.355043614 (192h16m26.494027828s) [noise=true , address=81.171.14.70:4039 , piece_id=NK3OUHGIGJIFK3YNYTXVPCXUAOCHU7LW7OLY5BGZMQCEU2QTIXPQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.365274838 (192h16m26.504259023s) [noise=true , address=89.149.201.147:4014 , piece_id=E6RRIRNNSLE7FBICBBAQEXPUXIYTPT3L2Y53IFKDI7SALSHDP7GA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.367225362 (192h16m26.506209576s) [noise=true , address=185.167.204.206:4040 , piece_id=K3IFUMLBFWII6ZXWBAPEPYYBY4OC2C6R2PYLBJ6JYN35QDZC7NKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.371128434 (192h16m26.510112618s) [noise=true , address=81.171.14.70:4033 , piece_id=3ESV63AA2EPW4DGL764CDZULGADNKRI3Z2SSKOTXXBFQZIDALGKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.374437836 (192h16m26.513422051s) [noise=true , address=81.171.14.70:4042 , piece_id=OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.391548321 (192h16m26.530532506s) [noise=true , address=81.171.14.70:4029 , piece_id=KMV3U75ZXM4I6J4KQ6NE7S52L52PNCMV2P43WHIRLB5BSTMEWFBA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.392215328 (192h16m26.531199543s) [noise=true , address=185.167.204.205:4027 , piece_id=EMCAH2W4KVXJNA5VRYHKTW7QMVB5KDY6D22NXI6J7SZPIDILZQ3A, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.392961462 (192h16m26.531945647s) [noise=true , address=81.171.14.70:4048 , piece_id=4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.398831849 (192h16m26.537816033s) [noise=true , address=81.171.14.70:4041 , piece_id=LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.399403016 (192h16m26.5383872s) [noise=true , address=185.167.204.205:4008 , piece_id=FC2RYMVA5LYJYNPRQO5TCSAHU6MEPD5S6HA7IMMFJKGVRT6R5QXA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.399854239 (192h16m26.538838423s) [noise=true , address=81.171.14.70:4046 , piece_id=NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.404371869 (192h16m26.543356093s) [noise=true , address=185.167.204.206:4060 , piece_id=OSYYOFUYXTPY56HUMHLENNMCHRDPRRJ3CA4GY6PUHGJ622GQ6NWQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.405487152 (192h16m26.544471377s) [noise=true , address=81.171.14.70:4025 , piece_id=XK76EA2CGQHTYGUYBGMST6GWZUPHLU6ESLFZKVDIS4JUSBOZWBOA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.410629299 (192h16m26.549613522s) [noise=true , address=185.167.204.205:4029 , piece_id=KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.410670746 (192h16m26.54965496s) [noise=true , address=185.167.204.205:4031 , piece_id=ZCA7B4GAY6NLK5MMEP4TFIHZPTB4KE7MCKUADFCGV5MSJRR6DFKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.411374772 (192h16m26.550358985s) [noise=true , address=185.167.204.205:4003 , piece_id=PXR53Y6CJCXU32KQLN2WUQONSLTBMSPNPJROBEGVXN4ZFXXIZD5Q, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.414774614 (192h16m26.553758838s) [noise=true , address=185.167.204.206:4057 , piece_id=UQ2URRBL2ZPKHJSPQVYEBYLJM7QQZ5GY6BAMYLEALKNUEPMIUFWA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.426466867 (192h16m26.565451081s) [noise=true , address=89.149.201.147:4012 , piece_id=LVU6MKTZAAREY46FOMONJ4XISBDO6DIVGBHW6UQMT6AJSDRO7G5Q, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.427104278 (192h16m26.566088492s) [noise=true , address=185.167.204.206:4065 , piece_id=2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.428092193 (192h16m26.567076408s) [noise=true , address=81.171.14.70:4040 , piece_id=VTGJTWIOPXCRD7432PER7PZO5NZYRKVCTAXPLDX3UNH7Q4ORJU7A, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.436098991 (192h16m26.575083215s) [noise=true , address=89.149.201.147:4017 , piece_id=OXJN4M3XCEOOWC3JB3KL637UCLZJ6Z5E3WVEUNEHF7WJ2ZE6F7HA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.436464915 (192h16m26.575449139s) [noise=true , address=89.149.201.147:4007 , piece_id=6YTZB4PC5LWOBK2W2XVX76VY62GQSNCFEMOYMNKBLBE5LSEEB7FQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.442990667 (192h16m26.581974881s) [noise=true , address=89.149.201.147:4006 , piece_id=BGTO5Q4A3UVVDW6T2F4G722LMZK6MUWTQT3KKYMQWT52Z746G4RQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.444432951 (192h16m26.583417166s) [noise=true , address=185.167.204.206:4049 , piece_id=XEQCFEH3EZUXGS3IYI5XKC2DAQXXIQ2SJN534VPBPLQ4XL4YMMNA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.448326675 (192h16m26.5873109s) [noise=true , address=185.167.204.205:4011 , piece_id=52UIJMG3NQWYNNZTSRZQVSJ3IY7CQR4VDS5N3PUJ3PXK7QPXI2NA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:26:05.522252363 (192h17m24.661236577s) [noise=true , address=89.149.201.147:4020 , piece_id=ZM2HOVINDTXULCTGLTNWPFKI6I27XQZCOGNE22QFH3TNMHWH3NAA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:26:05.522272842 (192h17m24.661257046s) [seg_pos={0 0}, upload=169053]: Satisfied cohort requirements after 26 pieces
Feb 25 20:26:05.522610733 (192h17m24.661594948s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: read tcp 5.161.89.252:45110->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 25 20:26:05.522623126 (192h17m24.66160733s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Long tail cancellation due to optimal threshold
Feb 25 20:26:05.522763870 (192h17m24.661748084s) [noise=true , address=89.149.201.147:4009 , piece_id=OIIRKZOFH6IENR73SYNK63YW7QM6QP3G7EUATUII3FW3DKG33PGQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: read tcp 5.161.89.252:12596->89.149.201.147:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 25 20:26:05.522785930 (192h17m24.661770144s) [noise=true , address=89.149.201.147:4009 , piece_id=OIIRKZOFH6IENR73SYNK63YW7QM6QP3G7EUATUII3FW3DKG33PGQ, seg_pos={0 0}, upload=169053]: Long tail cancellation due to optimal threshold
Feb 25 20:26:05.522806408 (192h17m24.661790612s) [seg_pos={0 0}, upload=169053]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Feb 25 20:26:05.522996834 (192h17m24.661981048s) [upload=169053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 25 20:26:05.523003857 (192h17m24.661988072s) [upload=169053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 25 20:26:05.685962135 (192h17m24.824946349s) [upload=169053]: Done uploading segments...
Feb 25 20:26:05.685982203 (192h17m24.824966427s) [upload=169053]: Upload finished. err: <nil>
Duration: 2.27439787s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
27.560697ms remote:
"tcp:45.38.24.2:443" response headers:
Vary=Origin X-Amz-Request-Id=189798BB337B612F X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content X-Request-Id=KFCmrHtA1h7 Date=Wed, 25 Feb 2026 20:55:08 GMT Accept-Ranges=bytes Content-Length=284 Content-Type=application/xml Server=Storj target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/6a37fd20ad8d6c60
FAIL (2026-02-25 20:55:08 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189798BB337B612F</RequestId><HostId></HostId></Error>"
Duration: 27.581406ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
26.881038ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=189798BAFE25D716 X-Request-Id=TJ9TN5EYYXd X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Type=application/xml Server=Storj Date=Wed, 25 Feb 2026 20:55:07 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/494f6117bc4e6d18
FAIL (2026-02-25 20:55:07 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189798BAFE25D716</RequestId><HostId></HostId></Error>"
Duration: 26.974815ms
edge
gateway
vhost
bgp
eu1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1m0.000602982s trace:
https://jaeger.dev.storj.io/trace/129824382d277f1d
FAIL (2026-02-25 20:55:03 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1m0.000644138s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
25.103367ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=189798B76E1D32E8 Date=Wed, 25 Feb 2026 20:54:51 GMT Content-Length=274 Server=Storj X-Request-Id=YuvpB6Me5Kc X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/35e4142a847503fb
FAIL (2026-02-25 20:54:51 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189798B76E1D32E8</RequestId><HostId></HostId></Error>"
Duration: 25.125498ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
24.631146ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj Vary=Origin Date=Wed, 25 Feb 2026 20:54:45 GMT Accept-Ranges=bytes Content-Type=application/xml X-Amz-Request-Id=189798B5D6FAFBE1 X-Request-Id=FfhUFUwtwbU X-Xss-Protection=1; mode=block Content-Length=274 Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/989f6e8279f39f9
FAIL (2026-02-25 20:54:45 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189798B5D6FAFBE1</RequestId><HostId></HostId></Error>"
Duration: 24.651975ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.542899ms remote:
"tcp:45.38.24.2:443" response headers:
Date=Wed, 25 Feb 2026 20:54:31 GMT Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=Bp4uZ6e7pty X-Xss-Protection=1; mode=block X-Amz-Request-Id=189798B2ACC7371B target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/4451ece851ee177b
FAIL (2026-02-25 20:54:31 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189798B2ACC7371B</RequestId><HostId></HostId></Error>"
Duration: 8.564861ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
27.844578ms remote:
"tcp:136.0.77.3:443" response headers:
X-Request-Id=gaL5AM6MRRN X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 20:54:25 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=189798B1488F96DA Accept-Ranges=bytes Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/6cb8f6a3d1fdd192
FAIL (2026-02-25 20:54:25 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189798B1488F96DA</RequestId><HostId></HostId></Error>"
Duration: 27.854887ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
25.359126ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=189798AEE2C5E9D2 X-Xss-Protection=1; mode=block Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=ZiP6L96fZv8 Date=Wed, 25 Feb 2026 20:54:15 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/6524d38063867f9b
FAIL (2026-02-25 20:54:15 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189798AEE2C5E9D2</RequestId><HostId></HostId></Error>"
Duration: 25.378822ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
24.5214ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Date=Wed, 25 Feb 2026 20:54:06 GMT Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=189798ACD203C572 X-Request-Id=G51rzr1B3so X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/47dd471403f8c25f
FAIL (2026-02-25 20:54:06 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189798ACD203C572</RequestId><HostId></HostId></Error>"
Duration: 24.541457ms
edge
gateway
vhost
bgp
ap1
|