Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [........X..........................................X........] duration:
2.769649711s trace:
https://jaeger.dev.storj.io/trace/71e948d4eec91061
FAIL (2026-02-25 20:30:53 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, Piece ID: NK3OUHGIGJIFK3YNYTXVPCXUAOCHU7LW7OLY5BGZMQCEU2QTIXPQ) context deadline exceeded; piecestore: (Node ID: 1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, Piece ID: LVU6MKTZAAREY46FOMONJ4XISBDO6DIVGBHW6UQMT6AJSDRO7G5Q) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: 52UIJMG3NQWYNNZTSRZQVSJ3IY7CQR4VDS5N3PUJ3PXK7QPXI2NA) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: PXR53Y6CJCXU32KQLN2WUQONSLTBMSPNPJROBEGVXN4ZFXXIZD5Q) context deadline exceeded; piecestore: (Node ID: 12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, Piece ID: 2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ) context deadline exceeded; piecestore: (Node ID: 1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, Piece ID: E6RRIRNNSLE7FBICBBAQEXPUXIYTPT3L2Y53IFKDI7SALSHDP7GA) context deadline exceeded; piecestore: (Node ID: 12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, Piece ID: LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: KMV3U75ZXM4I6J4KQ6NE7S52L52PNCMV2P43WHIRLB5BSTMEWFBA) context deadline exceeded; piecestore: (Node ID: 1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, Piece ID: UQ2URRBL2ZPKHJSPQVYEBYLJM7QQZ5GY6BAMYLEALKNUEPMIUFWA) context deadline exceeded; piecestore: (Node ID: 12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, Piece ID: OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: FC2RYMVA5LYJYNPRQO5TCSAHU6MEPD5S6HA7IMMFJKGVRT6R5QXA) context deadline exceeded; piecestore: (Node ID: 12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, Piece ID: OSYYOFUYXTPY56HUMHLENNMCHRDPRRJ3CA4GY6PUHGJ622GQ6NWQ) context deadline exceeded; piecestore: (Node ID: 1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, Piece ID: NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA) context deadline exceeded; piecestore: (Node ID: 1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, Piece ID: OXJN4M3XCEOOWC3JB3KL637UCLZJ6Z5E3WVEUNEHF7WJ2ZE6F7HA) context deadline exceeded; piecestore: (Node ID: 12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, Piece ID: 4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA) context deadline exceeded; piecestore: (Node ID: 12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, Piece ID: ZM2HOVINDTXULCTGLTNWPFKI6I27XQZCOGNE22QFH3TNMHWH3NAA) context deadline exceeded; piecestore: (Node ID: 12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, Piece ID: KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ) context deadline exceeded
======LOGS======
0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714112751 (192h16m25.853096965s) [noise=true , address=81.171.14.70:4040 , piece_id=VTGJTWIOPXCRD7432PER7PZO5NZYRKVCTAXPLDX3UNH7Q4ORJU7A, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714411960 (192h16m25.853396174s) [noise=true , address=185.167.204.205:4029 , piece_id=KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714734373 (192h16m25.853718587s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714833107 (192h16m25.853817321s) [noise=true , address=81.171.14.70:4033 , piece_id=3ESV63AA2EPW4DGL764CDZULGADNKRI3Z2SSKOTXXBFQZIDALGKQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715325467 (192h16m25.854309681s) [noise=true , address=81.171.14.70:4042 , piece_id=OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715342008 (192h16m25.854326222s) [noise=true , address=81.171.14.70:4041 , piece_id=LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715792569 (192h16m25.854776783s) [noise=true , address=185.167.204.206:4065 , piece_id=2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715842372 (192h16m25.854826587s) [noise=true , address=81.171.14.70:4048 , piece_id=4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.716371520 (192h16m25.855355735s) [noise=true , address=81.171.14.70:4046 , piece_id=NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:07.176030143 (192h16m26.315014346s) [upload=169053]: Next returned nil segment
Feb 25 20:25:07.176040030 (192h16m26.315024225s) [upload=169053]: Waiting for error group managing segments...
Feb 25 20:25:07.355043614 (192h16m26.494027828s) [noise=true , address=81.171.14.70:4039 , piece_id=NK3OUHGIGJIFK3YNYTXVPCXUAOCHU7LW7OLY5BGZMQCEU2QTIXPQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.365274838 (192h16m26.504259023s) [noise=true , address=89.149.201.147:4014 , piece_id=E6RRIRNNSLE7FBICBBAQEXPUXIYTPT3L2Y53IFKDI7SALSHDP7GA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.367225362 (192h16m26.506209576s) [noise=true , address=185.167.204.206:4040 , piece_id=K3IFUMLBFWII6ZXWBAPEPYYBY4OC2C6R2PYLBJ6JYN35QDZC7NKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.371128434 (192h16m26.510112618s) [noise=true , address=81.171.14.70:4033 , piece_id=3ESV63AA2EPW4DGL764CDZULGADNKRI3Z2SSKOTXXBFQZIDALGKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.374437836 (192h16m26.513422051s) [noise=true , address=81.171.14.70:4042 , piece_id=OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.391548321 (192h16m26.530532506s) [noise=true , address=81.171.14.70:4029 , piece_id=KMV3U75ZXM4I6J4KQ6NE7S52L52PNCMV2P43WHIRLB5BSTMEWFBA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.392215328 (192h16m26.531199543s) [noise=true , address=185.167.204.205:4027 , piece_id=EMCAH2W4KVXJNA5VRYHKTW7QMVB5KDY6D22NXI6J7SZPIDILZQ3A, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.392961462 (192h16m26.531945647s) [noise=true , address=81.171.14.70:4048 , piece_id=4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.398831849 (192h16m26.537816033s) [noise=true , address=81.171.14.70:4041 , piece_id=LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.399403016 (192h16m26.5383872s) [noise=true , address=185.167.204.205:4008 , piece_id=FC2RYMVA5LYJYNPRQO5TCSAHU6MEPD5S6HA7IMMFJKGVRT6R5QXA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.399854239 (192h16m26.538838423s) [noise=true , address=81.171.14.70:4046 , piece_id=NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.404371869 (192h16m26.543356093s) [noise=true , address=185.167.204.206:4060 , piece_id=OSYYOFUYXTPY56HUMHLENNMCHRDPRRJ3CA4GY6PUHGJ622GQ6NWQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.405487152 (192h16m26.544471377s) [noise=true , address=81.171.14.70:4025 , piece_id=XK76EA2CGQHTYGUYBGMST6GWZUPHLU6ESLFZKVDIS4JUSBOZWBOA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.410629299 (192h16m26.549613522s) [noise=true , address=185.167.204.205:4029 , piece_id=KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.410670746 (192h16m26.54965496s) [noise=true , address=185.167.204.205:4031 , piece_id=ZCA7B4GAY6NLK5MMEP4TFIHZPTB4KE7MCKUADFCGV5MSJRR6DFKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.411374772 (192h16m26.550358985s) [noise=true , address=185.167.204.205:4003 , piece_id=PXR53Y6CJCXU32KQLN2WUQONSLTBMSPNPJROBEGVXN4ZFXXIZD5Q, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.414774614 (192h16m26.553758838s) [noise=true , address=185.167.204.206:4057 , piece_id=UQ2URRBL2ZPKHJSPQVYEBYLJM7QQZ5GY6BAMYLEALKNUEPMIUFWA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.426466867 (192h16m26.565451081s) [noise=true , address=89.149.201.147:4012 , piece_id=LVU6MKTZAAREY46FOMONJ4XISBDO6DIVGBHW6UQMT6AJSDRO7G5Q, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.427104278 (192h16m26.566088492s) [noise=true , address=185.167.204.206:4065 , piece_id=2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.428092193 (192h16m26.567076408s) [noise=true , address=81.171.14.70:4040 , piece_id=VTGJTWIOPXCRD7432PER7PZO5NZYRKVCTAXPLDX3UNH7Q4ORJU7A, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.436098991 (192h16m26.575083215s) [noise=true , address=89.149.201.147:4017 , piece_id=OXJN4M3XCEOOWC3JB3KL637UCLZJ6Z5E3WVEUNEHF7WJ2ZE6F7HA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.436464915 (192h16m26.575449139s) [noise=true , address=89.149.201.147:4007 , piece_id=6YTZB4PC5LWOBK2W2XVX76VY62GQSNCFEMOYMNKBLBE5LSEEB7FQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.442990667 (192h16m26.581974881s) [noise=true , address=89.149.201.147:4006 , piece_id=BGTO5Q4A3UVVDW6T2F4G722LMZK6MUWTQT3KKYMQWT52Z746G4RQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.444432951 (192h16m26.583417166s) [noise=true , address=185.167.204.206:4049 , piece_id=XEQCFEH3EZUXGS3IYI5XKC2DAQXXIQ2SJN534VPBPLQ4XL4YMMNA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.448326675 (192h16m26.5873109s) [noise=true , address=185.167.204.205:4011 , piece_id=52UIJMG3NQWYNNZTSRZQVSJ3IY7CQR4VDS5N3PUJ3PXK7QPXI2NA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:26:05.522252363 (192h17m24.661236577s) [noise=true , address=89.149.201.147:4020 , piece_id=ZM2HOVINDTXULCTGLTNWPFKI6I27XQZCOGNE22QFH3TNMHWH3NAA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:26:05.522272842 (192h17m24.661257046s) [seg_pos={0 0}, upload=169053]: Satisfied cohort requirements after 26 pieces
Feb 25 20:26:05.522610733 (192h17m24.661594948s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: read tcp 5.161.89.252:45110->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 25 20:26:05.522623126 (192h17m24.66160733s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Long tail cancellation due to optimal threshold
Feb 25 20:26:05.522763870 (192h17m24.661748084s) [noise=true , address=89.149.201.147:4009 , piece_id=OIIRKZOFH6IENR73SYNK63YW7QM6QP3G7EUATUII3FW3DKG33PGQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: read tcp 5.161.89.252:12596->89.149.201.147:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 25 20:26:05.522785930 (192h17m24.661770144s) [noise=true , address=89.149.201.147:4009 , piece_id=OIIRKZOFH6IENR73SYNK63YW7QM6QP3G7EUATUII3FW3DKG33PGQ, seg_pos={0 0}, upload=169053]: Long tail cancellation due to optimal threshold
Feb 25 20:26:05.522806408 (192h17m24.661790612s) [seg_pos={0 0}, upload=169053]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Feb 25 20:26:05.522996834 (192h17m24.661981048s) [upload=169053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 25 20:26:05.523003857 (192h17m24.661988072s) [upload=169053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 25 20:26:05.685962135 (192h17m24.824946349s) [upload=169053]: Done uploading segments...
Feb 25 20:26:05.685982203 (192h17m24.824966427s) [upload=169053]: Upload finished. err: <nil>
Duration: 2.769667425s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
25.507994ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18979767C621042A X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 20:30:50 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj X-Request-Id=7ewaZ4V6sdu target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/6b5e1b93eb061f72
FAIL (2026-02-25 20:30:50 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18979767C621042A</RequestId><HostId></HostId></Error>"
Duration: 25.523733ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
25.502733ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Wed, 25 Feb 2026 20:30:48 GMT Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=1897976755FDC7D4 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml X-Request-Id=5cvdjhBvJ2C target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/5be5e22d8ff2c640
FAIL (2026-02-25 20:30:48 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897976755FDC7D4</RequestId><HostId></HostId></Error>"
Duration: 25.524003ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
16.735625ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=5e9fmMyzKQa X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 20:30:47 GMT Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=1897976715ACDEA8 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/595f668d9e5774c6
FAIL (2026-02-25 20:30:47 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897976715ACDEA8</RequestId><HostId></HostId></Error>"
Duration: 16.750352ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
22.680831ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=1897976061DA78CD X-Request-Id=Ppi9dQG4xc7 Date=Wed, 25 Feb 2026 20:30:18 GMT Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/113b385d793fb462
FAIL (2026-02-25 20:30:18 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897976061DA78CD</RequestId><HostId></HostId></Error>"
Duration: 22.702333ms
edge
gateway
vhost
bgp
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......XX...................................................] duration:
352.992238ms trace:
https://jaeger.dev.storj.io/trace/56af7b4e02fced30
FAIL (2026-02-25 20:30:17 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 353.012586ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
27.875597ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=cwDZmiw1J3F X-Amz-Request-Id=1897975F4A2EED82 X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 20:30:13 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/40e51195b657501a
FAIL (2026-02-25 20:30:13 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897975F4A2EED82</RequestId><HostId></HostId></Error>"
Duration: 27.890905ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
22.400959ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Wed, 25 Feb 2026 20:30:04 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Request-Id=Tb61u3bnZrP X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=1897975D1A66FC3F target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/1ce64701e9af3fb0
FAIL (2026-02-25 20:30:04 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897975D1A66FC3F</RequestId><HostId></HostId></Error>"
Duration: 22.412471ms
edge
gateway
vhost
bgp
ap1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [........XX..................................................] duration:
400.568238ms trace:
https://jaeger.dev.storj.io/trace/56af7b4e02fced30
FAIL (2026-02-25 20:29:56 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 400.594607ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [.........X..........................................X.......] duration:
2.454991459s trace:
https://jaeger.dev.storj.io/trace/71e948d4eec91061
FAIL (2026-02-25 20:29:53 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, Piece ID: NK3OUHGIGJIFK3YNYTXVPCXUAOCHU7LW7OLY5BGZMQCEU2QTIXPQ) context deadline exceeded; piecestore: (Node ID: 1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, Piece ID: LVU6MKTZAAREY46FOMONJ4XISBDO6DIVGBHW6UQMT6AJSDRO7G5Q) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: 52UIJMG3NQWYNNZTSRZQVSJ3IY7CQR4VDS5N3PUJ3PXK7QPXI2NA) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: PXR53Y6CJCXU32KQLN2WUQONSLTBMSPNPJROBEGVXN4ZFXXIZD5Q) context deadline exceeded; piecestore: (Node ID: 12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, Piece ID: 2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ) context deadline exceeded; piecestore: (Node ID: 1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, Piece ID: E6RRIRNNSLE7FBICBBAQEXPUXIYTPT3L2Y53IFKDI7SALSHDP7GA) context deadline exceeded; piecestore: (Node ID: 12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, Piece ID: LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: KMV3U75ZXM4I6J4KQ6NE7S52L52PNCMV2P43WHIRLB5BSTMEWFBA) context deadline exceeded; piecestore: (Node ID: 1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, Piece ID: UQ2URRBL2ZPKHJSPQVYEBYLJM7QQZ5GY6BAMYLEALKNUEPMIUFWA) context deadline exceeded; piecestore: (Node ID: 12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, Piece ID: OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: FC2RYMVA5LYJYNPRQO5TCSAHU6MEPD5S6HA7IMMFJKGVRT6R5QXA) context deadline exceeded; piecestore: (Node ID: 12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, Piece ID: OSYYOFUYXTPY56HUMHLENNMCHRDPRRJ3CA4GY6PUHGJ622GQ6NWQ) context deadline exceeded; piecestore: (Node ID: 1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, Piece ID: NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA) context deadline exceeded; piecestore: (Node ID: 1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, Piece ID: OXJN4M3XCEOOWC3JB3KL637UCLZJ6Z5E3WVEUNEHF7WJ2ZE6F7HA) context deadline exceeded; piecestore: (Node ID: 12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, Piece ID: 4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA) context deadline exceeded; piecestore: (Node ID: 12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, Piece ID: ZM2HOVINDTXULCTGLTNWPFKI6I27XQZCOGNE22QFH3TNMHWH3NAA) context deadline exceeded; piecestore: (Node ID: 12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, Piece ID: KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ) context deadline exceeded
======LOGS======
0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714112751 (192h16m25.853096965s) [noise=true , address=81.171.14.70:4040 , piece_id=VTGJTWIOPXCRD7432PER7PZO5NZYRKVCTAXPLDX3UNH7Q4ORJU7A, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714411960 (192h16m25.853396174s) [noise=true , address=185.167.204.205:4029 , piece_id=KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714734373 (192h16m25.853718587s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714833107 (192h16m25.853817321s) [noise=true , address=81.171.14.70:4033 , piece_id=3ESV63AA2EPW4DGL764CDZULGADNKRI3Z2SSKOTXXBFQZIDALGKQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715325467 (192h16m25.854309681s) [noise=true , address=81.171.14.70:4042 , piece_id=OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715342008 (192h16m25.854326222s) [noise=true , address=81.171.14.70:4041 , piece_id=LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715792569 (192h16m25.854776783s) [noise=true , address=185.167.204.206:4065 , piece_id=2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715842372 (192h16m25.854826587s) [noise=true , address=81.171.14.70:4048 , piece_id=4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.716371520 (192h16m25.855355735s) [noise=true , address=81.171.14.70:4046 , piece_id=NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:07.176030143 (192h16m26.315014346s) [upload=169053]: Next returned nil segment
Feb 25 20:25:07.176040030 (192h16m26.315024225s) [upload=169053]: Waiting for error group managing segments...
Feb 25 20:25:07.355043614 (192h16m26.494027828s) [noise=true , address=81.171.14.70:4039 , piece_id=NK3OUHGIGJIFK3YNYTXVPCXUAOCHU7LW7OLY5BGZMQCEU2QTIXPQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.365274838 (192h16m26.504259023s) [noise=true , address=89.149.201.147:4014 , piece_id=E6RRIRNNSLE7FBICBBAQEXPUXIYTPT3L2Y53IFKDI7SALSHDP7GA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.367225362 (192h16m26.506209576s) [noise=true , address=185.167.204.206:4040 , piece_id=K3IFUMLBFWII6ZXWBAPEPYYBY4OC2C6R2PYLBJ6JYN35QDZC7NKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.371128434 (192h16m26.510112618s) [noise=true , address=81.171.14.70:4033 , piece_id=3ESV63AA2EPW4DGL764CDZULGADNKRI3Z2SSKOTXXBFQZIDALGKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.374437836 (192h16m26.513422051s) [noise=true , address=81.171.14.70:4042 , piece_id=OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.391548321 (192h16m26.530532506s) [noise=true , address=81.171.14.70:4029 , piece_id=KMV3U75ZXM4I6J4KQ6NE7S52L52PNCMV2P43WHIRLB5BSTMEWFBA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.392215328 (192h16m26.531199543s) [noise=true , address=185.167.204.205:4027 , piece_id=EMCAH2W4KVXJNA5VRYHKTW7QMVB5KDY6D22NXI6J7SZPIDILZQ3A, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.392961462 (192h16m26.531945647s) [noise=true , address=81.171.14.70:4048 , piece_id=4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.398831849 (192h16m26.537816033s) [noise=true , address=81.171.14.70:4041 , piece_id=LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.399403016 (192h16m26.5383872s) [noise=true , address=185.167.204.205:4008 , piece_id=FC2RYMVA5LYJYNPRQO5TCSAHU6MEPD5S6HA7IMMFJKGVRT6R5QXA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.399854239 (192h16m26.538838423s) [noise=true , address=81.171.14.70:4046 , piece_id=NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.404371869 (192h16m26.543356093s) [noise=true , address=185.167.204.206:4060 , piece_id=OSYYOFUYXTPY56HUMHLENNMCHRDPRRJ3CA4GY6PUHGJ622GQ6NWQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.405487152 (192h16m26.544471377s) [noise=true , address=81.171.14.70:4025 , piece_id=XK76EA2CGQHTYGUYBGMST6GWZUPHLU6ESLFZKVDIS4JUSBOZWBOA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.410629299 (192h16m26.549613522s) [noise=true , address=185.167.204.205:4029 , piece_id=KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.410670746 (192h16m26.54965496s) [noise=true , address=185.167.204.205:4031 , piece_id=ZCA7B4GAY6NLK5MMEP4TFIHZPTB4KE7MCKUADFCGV5MSJRR6DFKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.411374772 (192h16m26.550358985s) [noise=true , address=185.167.204.205:4003 , piece_id=PXR53Y6CJCXU32KQLN2WUQONSLTBMSPNPJROBEGVXN4ZFXXIZD5Q, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.414774614 (192h16m26.553758838s) [noise=true , address=185.167.204.206:4057 , piece_id=UQ2URRBL2ZPKHJSPQVYEBYLJM7QQZ5GY6BAMYLEALKNUEPMIUFWA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.426466867 (192h16m26.565451081s) [noise=true , address=89.149.201.147:4012 , piece_id=LVU6MKTZAAREY46FOMONJ4XISBDO6DIVGBHW6UQMT6AJSDRO7G5Q, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.427104278 (192h16m26.566088492s) [noise=true , address=185.167.204.206:4065 , piece_id=2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.428092193 (192h16m26.567076408s) [noise=true , address=81.171.14.70:4040 , piece_id=VTGJTWIOPXCRD7432PER7PZO5NZYRKVCTAXPLDX3UNH7Q4ORJU7A, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.436098991 (192h16m26.575083215s) [noise=true , address=89.149.201.147:4017 , piece_id=OXJN4M3XCEOOWC3JB3KL637UCLZJ6Z5E3WVEUNEHF7WJ2ZE6F7HA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.436464915 (192h16m26.575449139s) [noise=true , address=89.149.201.147:4007 , piece_id=6YTZB4PC5LWOBK2W2XVX76VY62GQSNCFEMOYMNKBLBE5LSEEB7FQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.442990667 (192h16m26.581974881s) [noise=true , address=89.149.201.147:4006 , piece_id=BGTO5Q4A3UVVDW6T2F4G722LMZK6MUWTQT3KKYMQWT52Z746G4RQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.444432951 (192h16m26.583417166s) [noise=true , address=185.167.204.206:4049 , piece_id=XEQCFEH3EZUXGS3IYI5XKC2DAQXXIQ2SJN534VPBPLQ4XL4YMMNA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.448326675 (192h16m26.5873109s) [noise=true , address=185.167.204.205:4011 , piece_id=52UIJMG3NQWYNNZTSRZQVSJ3IY7CQR4VDS5N3PUJ3PXK7QPXI2NA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:26:05.522252363 (192h17m24.661236577s) [noise=true , address=89.149.201.147:4020 , piece_id=ZM2HOVINDTXULCTGLTNWPFKI6I27XQZCOGNE22QFH3TNMHWH3NAA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:26:05.522272842 (192h17m24.661257046s) [seg_pos={0 0}, upload=169053]: Satisfied cohort requirements after 26 pieces
Feb 25 20:26:05.522610733 (192h17m24.661594948s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: read tcp 5.161.89.252:45110->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 25 20:26:05.522623126 (192h17m24.66160733s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Long tail cancellation due to optimal threshold
Feb 25 20:26:05.522763870 (192h17m24.661748084s) [noise=true , address=89.149.201.147:4009 , piece_id=OIIRKZOFH6IENR73SYNK63YW7QM6QP3G7EUATUII3FW3DKG33PGQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: read tcp 5.161.89.252:12596->89.149.201.147:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 25 20:26:05.522785930 (192h17m24.661770144s) [noise=true , address=89.149.201.147:4009 , piece_id=OIIRKZOFH6IENR73SYNK63YW7QM6QP3G7EUATUII3FW3DKG33PGQ, seg_pos={0 0}, upload=169053]: Long tail cancellation due to optimal threshold
Feb 25 20:26:05.522806408 (192h17m24.661790612s) [seg_pos={0 0}, upload=169053]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Feb 25 20:26:05.522996834 (192h17m24.661981048s) [upload=169053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 25 20:26:05.523003857 (192h17m24.661988072s) [upload=169053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 25 20:26:05.685962135 (192h17m24.824946349s) [upload=169053]: Done uploading segments...
Feb 25 20:26:05.685982203 (192h17m24.824966427s) [upload=169053]: Upload finished. err: <nil>
Duration: 2.455014934s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
22.318014ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj X-Amz-Request-Id=18979759E6E8A565 X-Request-Id=AuCXxkXmnDc Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 20:29:50 GMT Accept-Ranges=bytes Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/7897894e9ee27a02
FAIL (2026-02-25 20:29:50 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18979759E6E8A565</RequestId><HostId></HostId></Error>"
Duration: 22.334344ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
24.301039ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Wed, 25 Feb 2026 20:29:42 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=1897975804D1DB1F X-Xss-Protection=1; mode=block Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=CUkpoVViXfy target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/7aa4b7b81ffc0084
FAIL (2026-02-25 20:29:42 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897975804D1DB1F</RequestId><HostId></HostId></Error>"
Duration: 24.319673ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.422413ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Content-Length=284 Content-Type=application/xml X-Amz-Request-Id=18979757B679C189 X-Request-Id=VGBNunej7rw Date=Wed, 25 Feb 2026 20:29:41 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/55b613c5d8e5d04e
FAIL (2026-02-25 20:29:41 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18979757B679C189</RequestId><HostId></HostId></Error>"
Duration: 9.44772ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........XX.................................................] duration:
378.802497ms trace:
https://jaeger.dev.storj.io/trace/56af7b4e02fced30
FAIL (2026-02-25 20:29:22 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 378.817144ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
64.381467ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Server=Storj X-Amz-Request-Id=18979752CB4A1A0C X-Request-Id=31giAD9UXnk Date=Wed, 25 Feb 2026 20:29:20 GMT Accept-Ranges=bytes Content-Length=274 Vary=Origin X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/4d92edfb1a461c38
FAIL (2026-02-25 20:29:20 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18979752CB4A1A0C</RequestId><HostId></HostId></Error>"
Duration: 64.398569ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
16.029848ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Server=Storj Vary=Origin X-Request-Id=C7cpt626nPq Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=189797519634CA7C X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 20:29:15 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/76c3380c88fc568b
FAIL (2026-02-25 20:29:15 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189797519634CA7C</RequestId><HostId></HostId></Error>"
Duration: 16.043572ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
24.779272ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin Date=Wed, 25 Feb 2026 20:29:12 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=189797511A1CADDA X-Request-Id=RpcEyEbwwfv X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Type=application/xml Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/50a77c1caadca7a
FAIL (2026-02-25 20:29:12 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189797511A1CADDA</RequestId><HostId></HostId></Error>"
Duration: 24.84196ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
23.186266ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Wed, 25 Feb 2026 20:29:09 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=189797504B1DD615 Server=Storj Vary=Origin X-Request-Id=Dc55p3CnwRx X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/64d054e29d615ae
FAIL (2026-02-25 20:29:09 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189797504B1DD615</RequestId><HostId></HostId></Error>"
Duration: 23.196326ms
edge
gateway
vhost
bgp
ap1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........XX................................................] duration:
358.225505ms trace:
https://jaeger.dev.storj.io/trace/56af7b4e02fced30
FAIL (2026-02-25 20:28:45 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 358.255782ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [..........X..........................................X......] duration:
3.148371707s trace:
https://jaeger.dev.storj.io/trace/71e948d4eec91061
FAIL (2026-02-25 20:28:41 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, Piece ID: NK3OUHGIGJIFK3YNYTXVPCXUAOCHU7LW7OLY5BGZMQCEU2QTIXPQ) context deadline exceeded; piecestore: (Node ID: 1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, Piece ID: LVU6MKTZAAREY46FOMONJ4XISBDO6DIVGBHW6UQMT6AJSDRO7G5Q) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: 52UIJMG3NQWYNNZTSRZQVSJ3IY7CQR4VDS5N3PUJ3PXK7QPXI2NA) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: PXR53Y6CJCXU32KQLN2WUQONSLTBMSPNPJROBEGVXN4ZFXXIZD5Q) context deadline exceeded; piecestore: (Node ID: 12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, Piece ID: 2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ) context deadline exceeded; piecestore: (Node ID: 1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, Piece ID: E6RRIRNNSLE7FBICBBAQEXPUXIYTPT3L2Y53IFKDI7SALSHDP7GA) context deadline exceeded; piecestore: (Node ID: 12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, Piece ID: LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: KMV3U75ZXM4I6J4KQ6NE7S52L52PNCMV2P43WHIRLB5BSTMEWFBA) context deadline exceeded; piecestore: (Node ID: 1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, Piece ID: UQ2URRBL2ZPKHJSPQVYEBYLJM7QQZ5GY6BAMYLEALKNUEPMIUFWA) context deadline exceeded; piecestore: (Node ID: 12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, Piece ID: OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: FC2RYMVA5LYJYNPRQO5TCSAHU6MEPD5S6HA7IMMFJKGVRT6R5QXA) context deadline exceeded; piecestore: (Node ID: 12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, Piece ID: OSYYOFUYXTPY56HUMHLENNMCHRDPRRJ3CA4GY6PUHGJ622GQ6NWQ) context deadline exceeded; piecestore: (Node ID: 1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, Piece ID: NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA) context deadline exceeded; piecestore: (Node ID: 1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, Piece ID: OXJN4M3XCEOOWC3JB3KL637UCLZJ6Z5E3WVEUNEHF7WJ2ZE6F7HA) context deadline exceeded; piecestore: (Node ID: 12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, Piece ID: 4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA) context deadline exceeded; piecestore: (Node ID: 12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, Piece ID: ZM2HOVINDTXULCTGLTNWPFKI6I27XQZCOGNE22QFH3TNMHWH3NAA) context deadline exceeded; piecestore: (Node ID: 12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, Piece ID: KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ) context deadline exceeded
======LOGS======
0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714112751 (192h16m25.853096965s) [noise=true , address=81.171.14.70:4040 , piece_id=VTGJTWIOPXCRD7432PER7PZO5NZYRKVCTAXPLDX3UNH7Q4ORJU7A, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714411960 (192h16m25.853396174s) [noise=true , address=185.167.204.205:4029 , piece_id=KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714734373 (192h16m25.853718587s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714833107 (192h16m25.853817321s) [noise=true , address=81.171.14.70:4033 , piece_id=3ESV63AA2EPW4DGL764CDZULGADNKRI3Z2SSKOTXXBFQZIDALGKQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715325467 (192h16m25.854309681s) [noise=true , address=81.171.14.70:4042 , piece_id=OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715342008 (192h16m25.854326222s) [noise=true , address=81.171.14.70:4041 , piece_id=LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715792569 (192h16m25.854776783s) [noise=true , address=185.167.204.206:4065 , piece_id=2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715842372 (192h16m25.854826587s) [noise=true , address=81.171.14.70:4048 , piece_id=4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.716371520 (192h16m25.855355735s) [noise=true , address=81.171.14.70:4046 , piece_id=NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:07.176030143 (192h16m26.315014346s) [upload=169053]: Next returned nil segment
Feb 25 20:25:07.176040030 (192h16m26.315024225s) [upload=169053]: Waiting for error group managing segments...
Feb 25 20:25:07.355043614 (192h16m26.494027828s) [noise=true , address=81.171.14.70:4039 , piece_id=NK3OUHGIGJIFK3YNYTXVPCXUAOCHU7LW7OLY5BGZMQCEU2QTIXPQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.365274838 (192h16m26.504259023s) [noise=true , address=89.149.201.147:4014 , piece_id=E6RRIRNNSLE7FBICBBAQEXPUXIYTPT3L2Y53IFKDI7SALSHDP7GA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.367225362 (192h16m26.506209576s) [noise=true , address=185.167.204.206:4040 , piece_id=K3IFUMLBFWII6ZXWBAPEPYYBY4OC2C6R2PYLBJ6JYN35QDZC7NKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.371128434 (192h16m26.510112618s) [noise=true , address=81.171.14.70:4033 , piece_id=3ESV63AA2EPW4DGL764CDZULGADNKRI3Z2SSKOTXXBFQZIDALGKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.374437836 (192h16m26.513422051s) [noise=true , address=81.171.14.70:4042 , piece_id=OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.391548321 (192h16m26.530532506s) [noise=true , address=81.171.14.70:4029 , piece_id=KMV3U75ZXM4I6J4KQ6NE7S52L52PNCMV2P43WHIRLB5BSTMEWFBA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.392215328 (192h16m26.531199543s) [noise=true , address=185.167.204.205:4027 , piece_id=EMCAH2W4KVXJNA5VRYHKTW7QMVB5KDY6D22NXI6J7SZPIDILZQ3A, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.392961462 (192h16m26.531945647s) [noise=true , address=81.171.14.70:4048 , piece_id=4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.398831849 (192h16m26.537816033s) [noise=true , address=81.171.14.70:4041 , piece_id=LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.399403016 (192h16m26.5383872s) [noise=true , address=185.167.204.205:4008 , piece_id=FC2RYMVA5LYJYNPRQO5TCSAHU6MEPD5S6HA7IMMFJKGVRT6R5QXA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.399854239 (192h16m26.538838423s) [noise=true , address=81.171.14.70:4046 , piece_id=NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.404371869 (192h16m26.543356093s) [noise=true , address=185.167.204.206:4060 , piece_id=OSYYOFUYXTPY56HUMHLENNMCHRDPRRJ3CA4GY6PUHGJ622GQ6NWQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.405487152 (192h16m26.544471377s) [noise=true , address=81.171.14.70:4025 , piece_id=XK76EA2CGQHTYGUYBGMST6GWZUPHLU6ESLFZKVDIS4JUSBOZWBOA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.410629299 (192h16m26.549613522s) [noise=true , address=185.167.204.205:4029 , piece_id=KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.410670746 (192h16m26.54965496s) [noise=true , address=185.167.204.205:4031 , piece_id=ZCA7B4GAY6NLK5MMEP4TFIHZPTB4KE7MCKUADFCGV5MSJRR6DFKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.411374772 (192h16m26.550358985s) [noise=true , address=185.167.204.205:4003 , piece_id=PXR53Y6CJCXU32KQLN2WUQONSLTBMSPNPJROBEGVXN4ZFXXIZD5Q, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.414774614 (192h16m26.553758838s) [noise=true , address=185.167.204.206:4057 , piece_id=UQ2URRBL2ZPKHJSPQVYEBYLJM7QQZ5GY6BAMYLEALKNUEPMIUFWA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.426466867 (192h16m26.565451081s) [noise=true , address=89.149.201.147:4012 , piece_id=LVU6MKTZAAREY46FOMONJ4XISBDO6DIVGBHW6UQMT6AJSDRO7G5Q, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.427104278 (192h16m26.566088492s) [noise=true , address=185.167.204.206:4065 , piece_id=2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.428092193 (192h16m26.567076408s) [noise=true , address=81.171.14.70:4040 , piece_id=VTGJTWIOPXCRD7432PER7PZO5NZYRKVCTAXPLDX3UNH7Q4ORJU7A, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.436098991 (192h16m26.575083215s) [noise=true , address=89.149.201.147:4017 , piece_id=OXJN4M3XCEOOWC3JB3KL637UCLZJ6Z5E3WVEUNEHF7WJ2ZE6F7HA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.436464915 (192h16m26.575449139s) [noise=true , address=89.149.201.147:4007 , piece_id=6YTZB4PC5LWOBK2W2XVX76VY62GQSNCFEMOYMNKBLBE5LSEEB7FQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.442990667 (192h16m26.581974881s) [noise=true , address=89.149.201.147:4006 , piece_id=BGTO5Q4A3UVVDW6T2F4G722LMZK6MUWTQT3KKYMQWT52Z746G4RQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.444432951 (192h16m26.583417166s) [noise=true , address=185.167.204.206:4049 , piece_id=XEQCFEH3EZUXGS3IYI5XKC2DAQXXIQ2SJN534VPBPLQ4XL4YMMNA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.448326675 (192h16m26.5873109s) [noise=true , address=185.167.204.205:4011 , piece_id=52UIJMG3NQWYNNZTSRZQVSJ3IY7CQR4VDS5N3PUJ3PXK7QPXI2NA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:26:05.522252363 (192h17m24.661236577s) [noise=true , address=89.149.201.147:4020 , piece_id=ZM2HOVINDTXULCTGLTNWPFKI6I27XQZCOGNE22QFH3TNMHWH3NAA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:26:05.522272842 (192h17m24.661257046s) [seg_pos={0 0}, upload=169053]: Satisfied cohort requirements after 26 pieces
Feb 25 20:26:05.522610733 (192h17m24.661594948s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: read tcp 5.161.89.252:45110->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 25 20:26:05.522623126 (192h17m24.66160733s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Long tail cancellation due to optimal threshold
Feb 25 20:26:05.522763870 (192h17m24.661748084s) [noise=true , address=89.149.201.147:4009 , piece_id=OIIRKZOFH6IENR73SYNK63YW7QM6QP3G7EUATUII3FW3DKG33PGQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: read tcp 5.161.89.252:12596->89.149.201.147:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 25 20:26:05.522785930 (192h17m24.661770144s) [noise=true , address=89.149.201.147:4009 , piece_id=OIIRKZOFH6IENR73SYNK63YW7QM6QP3G7EUATUII3FW3DKG33PGQ, seg_pos={0 0}, upload=169053]: Long tail cancellation due to optimal threshold
Feb 25 20:26:05.522806408 (192h17m24.661790612s) [seg_pos={0 0}, upload=169053]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Feb 25 20:26:05.522996834 (192h17m24.661981048s) [upload=169053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 25 20:26:05.523003857 (192h17m24.661988072s) [upload=169053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 25 20:26:05.685962135 (192h17m24.824946349s) [upload=169053]: Done uploading segments...
Feb 25 20:26:05.685982203 (192h17m24.824966427s) [upload=169053]: Upload finished. err: <nil>
Duration: 3.148398848s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
54.474952ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=189797482344E3D3 X-Request-Id=7it9BtMW3Xa X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 20:28:34 GMT Content-Type=application/xml Server=Storj Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/c34207ba7d44147
FAIL (2026-02-25 20:28:34 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189797482344E3D3</RequestId><HostId></HostId></Error>"
Duration: 54.496129ms
edge
gateway
vhost
bgp
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........XX...............................................] duration:
363.695325ms trace:
https://jaeger.dev.storj.io/trace/56af7b4e02fced30
FAIL (2026-02-25 20:28:30 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 363.712998ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
23.192147ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Server=Storj Vary=Origin Date=Wed, 25 Feb 2026 20:28:16 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18979744104AD384 X-Request-Id=KnsoyBvh7wc X-Xss-Protection=1; mode=block Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/13db38018f5cb441
FAIL (2026-02-25 20:28:16 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18979744104AD384</RequestId><HostId></HostId></Error>"
Duration: 23.211292ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
24.464835ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=18979743BD21EE49 X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 20:28:15 GMT Vary=Origin X-Request-Id=9XwNgGf1AUc target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/1297fa31968f0b84
FAIL (2026-02-25 20:28:15 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18979743BD21EE49</RequestId><HostId></HostId></Error>"
Duration: 24.486065ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [...........X..........................................X.....] duration:
2.29658232s trace:
https://jaeger.dev.storj.io/trace/71e948d4eec91061
FAIL (2026-02-25 20:28:14 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, Piece ID: NK3OUHGIGJIFK3YNYTXVPCXUAOCHU7LW7OLY5BGZMQCEU2QTIXPQ) context deadline exceeded; piecestore: (Node ID: 1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, Piece ID: LVU6MKTZAAREY46FOMONJ4XISBDO6DIVGBHW6UQMT6AJSDRO7G5Q) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: 52UIJMG3NQWYNNZTSRZQVSJ3IY7CQR4VDS5N3PUJ3PXK7QPXI2NA) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: PXR53Y6CJCXU32KQLN2WUQONSLTBMSPNPJROBEGVXN4ZFXXIZD5Q) context deadline exceeded; piecestore: (Node ID: 12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, Piece ID: 2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ) context deadline exceeded; piecestore: (Node ID: 1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, Piece ID: E6RRIRNNSLE7FBICBBAQEXPUXIYTPT3L2Y53IFKDI7SALSHDP7GA) context deadline exceeded; piecestore: (Node ID: 12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, Piece ID: LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: KMV3U75ZXM4I6J4KQ6NE7S52L52PNCMV2P43WHIRLB5BSTMEWFBA) context deadline exceeded; piecestore: (Node ID: 1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, Piece ID: UQ2URRBL2ZPKHJSPQVYEBYLJM7QQZ5GY6BAMYLEALKNUEPMIUFWA) context deadline exceeded; piecestore: (Node ID: 12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, Piece ID: OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: FC2RYMVA5LYJYNPRQO5TCSAHU6MEPD5S6HA7IMMFJKGVRT6R5QXA) context deadline exceeded; piecestore: (Node ID: 12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, Piece ID: OSYYOFUYXTPY56HUMHLENNMCHRDPRRJ3CA4GY6PUHGJ622GQ6NWQ) context deadline exceeded; piecestore: (Node ID: 1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, Piece ID: NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA) context deadline exceeded; piecestore: (Node ID: 1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, Piece ID: OXJN4M3XCEOOWC3JB3KL637UCLZJ6Z5E3WVEUNEHF7WJ2ZE6F7HA) context deadline exceeded; piecestore: (Node ID: 12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, Piece ID: 4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA) context deadline exceeded; piecestore: (Node ID: 12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, Piece ID: ZM2HOVINDTXULCTGLTNWPFKI6I27XQZCOGNE22QFH3TNMHWH3NAA) context deadline exceeded; piecestore: (Node ID: 12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, Piece ID: KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ) context deadline exceeded
======LOGS======
0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714112751 (192h16m25.853096965s) [noise=true , address=81.171.14.70:4040 , piece_id=VTGJTWIOPXCRD7432PER7PZO5NZYRKVCTAXPLDX3UNH7Q4ORJU7A, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714411960 (192h16m25.853396174s) [noise=true , address=185.167.204.205:4029 , piece_id=KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714734373 (192h16m25.853718587s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714833107 (192h16m25.853817321s) [noise=true , address=81.171.14.70:4033 , piece_id=3ESV63AA2EPW4DGL764CDZULGADNKRI3Z2SSKOTXXBFQZIDALGKQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715325467 (192h16m25.854309681s) [noise=true , address=81.171.14.70:4042 , piece_id=OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715342008 (192h16m25.854326222s) [noise=true , address=81.171.14.70:4041 , piece_id=LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715792569 (192h16m25.854776783s) [noise=true , address=185.167.204.206:4065 , piece_id=2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715842372 (192h16m25.854826587s) [noise=true , address=81.171.14.70:4048 , piece_id=4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.716371520 (192h16m25.855355735s) [noise=true , address=81.171.14.70:4046 , piece_id=NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:07.176030143 (192h16m26.315014346s) [upload=169053]: Next returned nil segment
Feb 25 20:25:07.176040030 (192h16m26.315024225s) [upload=169053]: Waiting for error group managing segments...
Feb 25 20:25:07.355043614 (192h16m26.494027828s) [noise=true , address=81.171.14.70:4039 , piece_id=NK3OUHGIGJIFK3YNYTXVPCXUAOCHU7LW7OLY5BGZMQCEU2QTIXPQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.365274838 (192h16m26.504259023s) [noise=true , address=89.149.201.147:4014 , piece_id=E6RRIRNNSLE7FBICBBAQEXPUXIYTPT3L2Y53IFKDI7SALSHDP7GA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.367225362 (192h16m26.506209576s) [noise=true , address=185.167.204.206:4040 , piece_id=K3IFUMLBFWII6ZXWBAPEPYYBY4OC2C6R2PYLBJ6JYN35QDZC7NKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.371128434 (192h16m26.510112618s) [noise=true , address=81.171.14.70:4033 , piece_id=3ESV63AA2EPW4DGL764CDZULGADNKRI3Z2SSKOTXXBFQZIDALGKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.374437836 (192h16m26.513422051s) [noise=true , address=81.171.14.70:4042 , piece_id=OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.391548321 (192h16m26.530532506s) [noise=true , address=81.171.14.70:4029 , piece_id=KMV3U75ZXM4I6J4KQ6NE7S52L52PNCMV2P43WHIRLB5BSTMEWFBA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.392215328 (192h16m26.531199543s) [noise=true , address=185.167.204.205:4027 , piece_id=EMCAH2W4KVXJNA5VRYHKTW7QMVB5KDY6D22NXI6J7SZPIDILZQ3A, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.392961462 (192h16m26.531945647s) [noise=true , address=81.171.14.70:4048 , piece_id=4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.398831849 (192h16m26.537816033s) [noise=true , address=81.171.14.70:4041 , piece_id=LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.399403016 (192h16m26.5383872s) [noise=true , address=185.167.204.205:4008 , piece_id=FC2RYMVA5LYJYNPRQO5TCSAHU6MEPD5S6HA7IMMFJKGVRT6R5QXA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.399854239 (192h16m26.538838423s) [noise=true , address=81.171.14.70:4046 , piece_id=NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.404371869 (192h16m26.543356093s) [noise=true , address=185.167.204.206:4060 , piece_id=OSYYOFUYXTPY56HUMHLENNMCHRDPRRJ3CA4GY6PUHGJ622GQ6NWQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.405487152 (192h16m26.544471377s) [noise=true , address=81.171.14.70:4025 , piece_id=XK76EA2CGQHTYGUYBGMST6GWZUPHLU6ESLFZKVDIS4JUSBOZWBOA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.410629299 (192h16m26.549613522s) [noise=true , address=185.167.204.205:4029 , piece_id=KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.410670746 (192h16m26.54965496s) [noise=true , address=185.167.204.205:4031 , piece_id=ZCA7B4GAY6NLK5MMEP4TFIHZPTB4KE7MCKUADFCGV5MSJRR6DFKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.411374772 (192h16m26.550358985s) [noise=true , address=185.167.204.205:4003 , piece_id=PXR53Y6CJCXU32KQLN2WUQONSLTBMSPNPJROBEGVXN4ZFXXIZD5Q, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.414774614 (192h16m26.553758838s) [noise=true , address=185.167.204.206:4057 , piece_id=UQ2URRBL2ZPKHJSPQVYEBYLJM7QQZ5GY6BAMYLEALKNUEPMIUFWA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.426466867 (192h16m26.565451081s) [noise=true , address=89.149.201.147:4012 , piece_id=LVU6MKTZAAREY46FOMONJ4XISBDO6DIVGBHW6UQMT6AJSDRO7G5Q, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.427104278 (192h16m26.566088492s) [noise=true , address=185.167.204.206:4065 , piece_id=2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.428092193 (192h16m26.567076408s) [noise=true , address=81.171.14.70:4040 , piece_id=VTGJTWIOPXCRD7432PER7PZO5NZYRKVCTAXPLDX3UNH7Q4ORJU7A, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.436098991 (192h16m26.575083215s) [noise=true , address=89.149.201.147:4017 , piece_id=OXJN4M3XCEOOWC3JB3KL637UCLZJ6Z5E3WVEUNEHF7WJ2ZE6F7HA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.436464915 (192h16m26.575449139s) [noise=true , address=89.149.201.147:4007 , piece_id=6YTZB4PC5LWOBK2W2XVX76VY62GQSNCFEMOYMNKBLBE5LSEEB7FQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.442990667 (192h16m26.581974881s) [noise=true , address=89.149.201.147:4006 , piece_id=BGTO5Q4A3UVVDW6T2F4G722LMZK6MUWTQT3KKYMQWT52Z746G4RQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.444432951 (192h16m26.583417166s) [noise=true , address=185.167.204.206:4049 , piece_id=XEQCFEH3EZUXGS3IYI5XKC2DAQXXIQ2SJN534VPBPLQ4XL4YMMNA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.448326675 (192h16m26.5873109s) [noise=true , address=185.167.204.205:4011 , piece_id=52UIJMG3NQWYNNZTSRZQVSJ3IY7CQR4VDS5N3PUJ3PXK7QPXI2NA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:26:05.522252363 (192h17m24.661236577s) [noise=true , address=89.149.201.147:4020 , piece_id=ZM2HOVINDTXULCTGLTNWPFKI6I27XQZCOGNE22QFH3TNMHWH3NAA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:26:05.522272842 (192h17m24.661257046s) [seg_pos={0 0}, upload=169053]: Satisfied cohort requirements after 26 pieces
Feb 25 20:26:05.522610733 (192h17m24.661594948s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: read tcp 5.161.89.252:45110->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 25 20:26:05.522623126 (192h17m24.66160733s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Long tail cancellation due to optimal threshold
Feb 25 20:26:05.522763870 (192h17m24.661748084s) [noise=true , address=89.149.201.147:4009 , piece_id=OIIRKZOFH6IENR73SYNK63YW7QM6QP3G7EUATUII3FW3DKG33PGQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: read tcp 5.161.89.252:12596->89.149.201.147:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 25 20:26:05.522785930 (192h17m24.661770144s) [noise=true , address=89.149.201.147:4009 , piece_id=OIIRKZOFH6IENR73SYNK63YW7QM6QP3G7EUATUII3FW3DKG33PGQ, seg_pos={0 0}, upload=169053]: Long tail cancellation due to optimal threshold
Feb 25 20:26:05.522806408 (192h17m24.661790612s) [seg_pos={0 0}, upload=169053]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Feb 25 20:26:05.522996834 (192h17m24.661981048s) [upload=169053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 25 20:26:05.523003857 (192h17m24.661988072s) [upload=169053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 25 20:26:05.685962135 (192h17m24.824946349s) [upload=169053]: Done uploading segments...
Feb 25 20:26:05.685982203 (192h17m24.824966427s) [upload=169053]: Upload finished. err: <nil>
Duration: 2.296602307s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
6.799592ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Security-Policy=block-all-mixed-content Server=Storj X-Request-Id=ESUQbbrmWjJ Accept-Ranges=bytes Content-Length=284 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1897974024A5F789 X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 20:28:00 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/1f5e4d1640b9e4ed
FAIL (2026-02-25 20:28:00 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897974024A5F789</RequestId><HostId></HostId></Error>"
Duration: 6.818078ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [............X..........................................X....] duration:
2.294461477s trace:
https://jaeger.dev.storj.io/trace/71e948d4eec91061
FAIL (2026-02-25 20:27:41 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, Piece ID: NK3OUHGIGJIFK3YNYTXVPCXUAOCHU7LW7OLY5BGZMQCEU2QTIXPQ) context deadline exceeded; piecestore: (Node ID: 1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, Piece ID: LVU6MKTZAAREY46FOMONJ4XISBDO6DIVGBHW6UQMT6AJSDRO7G5Q) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: 52UIJMG3NQWYNNZTSRZQVSJ3IY7CQR4VDS5N3PUJ3PXK7QPXI2NA) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: PXR53Y6CJCXU32KQLN2WUQONSLTBMSPNPJROBEGVXN4ZFXXIZD5Q) context deadline exceeded; piecestore: (Node ID: 12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, Piece ID: 2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ) context deadline exceeded; piecestore: (Node ID: 1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, Piece ID: E6RRIRNNSLE7FBICBBAQEXPUXIYTPT3L2Y53IFKDI7SALSHDP7GA) context deadline exceeded; piecestore: (Node ID: 12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, Piece ID: LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: KMV3U75ZXM4I6J4KQ6NE7S52L52PNCMV2P43WHIRLB5BSTMEWFBA) context deadline exceeded; piecestore: (Node ID: 1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, Piece ID: UQ2URRBL2ZPKHJSPQVYEBYLJM7QQZ5GY6BAMYLEALKNUEPMIUFWA) context deadline exceeded; piecestore: (Node ID: 12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, Piece ID: OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: FC2RYMVA5LYJYNPRQO5TCSAHU6MEPD5S6HA7IMMFJKGVRT6R5QXA) context deadline exceeded; piecestore: (Node ID: 12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, Piece ID: OSYYOFUYXTPY56HUMHLENNMCHRDPRRJ3CA4GY6PUHGJ622GQ6NWQ) context deadline exceeded; piecestore: (Node ID: 1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, Piece ID: NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA) context deadline exceeded; piecestore: (Node ID: 1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, Piece ID: OXJN4M3XCEOOWC3JB3KL637UCLZJ6Z5E3WVEUNEHF7WJ2ZE6F7HA) context deadline exceeded; piecestore: (Node ID: 12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, Piece ID: 4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA) context deadline exceeded; piecestore: (Node ID: 12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, Piece ID: ZM2HOVINDTXULCTGLTNWPFKI6I27XQZCOGNE22QFH3TNMHWH3NAA) context deadline exceeded; piecestore: (Node ID: 12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, Piece ID: KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ) context deadline exceeded
======LOGS======
0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714112751 (192h16m25.853096965s) [noise=true , address=81.171.14.70:4040 , piece_id=VTGJTWIOPXCRD7432PER7PZO5NZYRKVCTAXPLDX3UNH7Q4ORJU7A, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714411960 (192h16m25.853396174s) [noise=true , address=185.167.204.205:4029 , piece_id=KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714734373 (192h16m25.853718587s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714833107 (192h16m25.853817321s) [noise=true , address=81.171.14.70:4033 , piece_id=3ESV63AA2EPW4DGL764CDZULGADNKRI3Z2SSKOTXXBFQZIDALGKQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715325467 (192h16m25.854309681s) [noise=true , address=81.171.14.70:4042 , piece_id=OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715342008 (192h16m25.854326222s) [noise=true , address=81.171.14.70:4041 , piece_id=LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715792569 (192h16m25.854776783s) [noise=true , address=185.167.204.206:4065 , piece_id=2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715842372 (192h16m25.854826587s) [noise=true , address=81.171.14.70:4048 , piece_id=4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.716371520 (192h16m25.855355735s) [noise=true , address=81.171.14.70:4046 , piece_id=NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:07.176030143 (192h16m26.315014346s) [upload=169053]: Next returned nil segment
Feb 25 20:25:07.176040030 (192h16m26.315024225s) [upload=169053]: Waiting for error group managing segments...
Feb 25 20:25:07.355043614 (192h16m26.494027828s) [noise=true , address=81.171.14.70:4039 , piece_id=NK3OUHGIGJIFK3YNYTXVPCXUAOCHU7LW7OLY5BGZMQCEU2QTIXPQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.365274838 (192h16m26.504259023s) [noise=true , address=89.149.201.147:4014 , piece_id=E6RRIRNNSLE7FBICBBAQEXPUXIYTPT3L2Y53IFKDI7SALSHDP7GA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.367225362 (192h16m26.506209576s) [noise=true , address=185.167.204.206:4040 , piece_id=K3IFUMLBFWII6ZXWBAPEPYYBY4OC2C6R2PYLBJ6JYN35QDZC7NKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.371128434 (192h16m26.510112618s) [noise=true , address=81.171.14.70:4033 , piece_id=3ESV63AA2EPW4DGL764CDZULGADNKRI3Z2SSKOTXXBFQZIDALGKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.374437836 (192h16m26.513422051s) [noise=true , address=81.171.14.70:4042 , piece_id=OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.391548321 (192h16m26.530532506s) [noise=true , address=81.171.14.70:4029 , piece_id=KMV3U75ZXM4I6J4KQ6NE7S52L52PNCMV2P43WHIRLB5BSTMEWFBA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.392215328 (192h16m26.531199543s) [noise=true , address=185.167.204.205:4027 , piece_id=EMCAH2W4KVXJNA5VRYHKTW7QMVB5KDY6D22NXI6J7SZPIDILZQ3A, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.392961462 (192h16m26.531945647s) [noise=true , address=81.171.14.70:4048 , piece_id=4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.398831849 (192h16m26.537816033s) [noise=true , address=81.171.14.70:4041 , piece_id=LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.399403016 (192h16m26.5383872s) [noise=true , address=185.167.204.205:4008 , piece_id=FC2RYMVA5LYJYNPRQO5TCSAHU6MEPD5S6HA7IMMFJKGVRT6R5QXA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.399854239 (192h16m26.538838423s) [noise=true , address=81.171.14.70:4046 , piece_id=NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.404371869 (192h16m26.543356093s) [noise=true , address=185.167.204.206:4060 , piece_id=OSYYOFUYXTPY56HUMHLENNMCHRDPRRJ3CA4GY6PUHGJ622GQ6NWQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.405487152 (192h16m26.544471377s) [noise=true , address=81.171.14.70:4025 , piece_id=XK76EA2CGQHTYGUYBGMST6GWZUPHLU6ESLFZKVDIS4JUSBOZWBOA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.410629299 (192h16m26.549613522s) [noise=true , address=185.167.204.205:4029 , piece_id=KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.410670746 (192h16m26.54965496s) [noise=true , address=185.167.204.205:4031 , piece_id=ZCA7B4GAY6NLK5MMEP4TFIHZPTB4KE7MCKUADFCGV5MSJRR6DFKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.411374772 (192h16m26.550358985s) [noise=true , address=185.167.204.205:4003 , piece_id=PXR53Y6CJCXU32KQLN2WUQONSLTBMSPNPJROBEGVXN4ZFXXIZD5Q, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.414774614 (192h16m26.553758838s) [noise=true , address=185.167.204.206:4057 , piece_id=UQ2URRBL2ZPKHJSPQVYEBYLJM7QQZ5GY6BAMYLEALKNUEPMIUFWA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.426466867 (192h16m26.565451081s) [noise=true , address=89.149.201.147:4012 , piece_id=LVU6MKTZAAREY46FOMONJ4XISBDO6DIVGBHW6UQMT6AJSDRO7G5Q, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.427104278 (192h16m26.566088492s) [noise=true , address=185.167.204.206:4065 , piece_id=2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.428092193 (192h16m26.567076408s) [noise=true , address=81.171.14.70:4040 , piece_id=VTGJTWIOPXCRD7432PER7PZO5NZYRKVCTAXPLDX3UNH7Q4ORJU7A, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.436098991 (192h16m26.575083215s) [noise=true , address=89.149.201.147:4017 , piece_id=OXJN4M3XCEOOWC3JB3KL637UCLZJ6Z5E3WVEUNEHF7WJ2ZE6F7HA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.436464915 (192h16m26.575449139s) [noise=true , address=89.149.201.147:4007 , piece_id=6YTZB4PC5LWOBK2W2XVX76VY62GQSNCFEMOYMNKBLBE5LSEEB7FQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.442990667 (192h16m26.581974881s) [noise=true , address=89.149.201.147:4006 , piece_id=BGTO5Q4A3UVVDW6T2F4G722LMZK6MUWTQT3KKYMQWT52Z746G4RQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.444432951 (192h16m26.583417166s) [noise=true , address=185.167.204.206:4049 , piece_id=XEQCFEH3EZUXGS3IYI5XKC2DAQXXIQ2SJN534VPBPLQ4XL4YMMNA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.448326675 (192h16m26.5873109s) [noise=true , address=185.167.204.205:4011 , piece_id=52UIJMG3NQWYNNZTSRZQVSJ3IY7CQR4VDS5N3PUJ3PXK7QPXI2NA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:26:05.522252363 (192h17m24.661236577s) [noise=true , address=89.149.201.147:4020 , piece_id=ZM2HOVINDTXULCTGLTNWPFKI6I27XQZCOGNE22QFH3TNMHWH3NAA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:26:05.522272842 (192h17m24.661257046s) [seg_pos={0 0}, upload=169053]: Satisfied cohort requirements after 26 pieces
Feb 25 20:26:05.522610733 (192h17m24.661594948s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: read tcp 5.161.89.252:45110->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 25 20:26:05.522623126 (192h17m24.66160733s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Long tail cancellation due to optimal threshold
Feb 25 20:26:05.522763870 (192h17m24.661748084s) [noise=true , address=89.149.201.147:4009 , piece_id=OIIRKZOFH6IENR73SYNK63YW7QM6QP3G7EUATUII3FW3DKG33PGQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: read tcp 5.161.89.252:12596->89.149.201.147:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 25 20:26:05.522785930 (192h17m24.661770144s) [noise=true , address=89.149.201.147:4009 , piece_id=OIIRKZOFH6IENR73SYNK63YW7QM6QP3G7EUATUII3FW3DKG33PGQ, seg_pos={0 0}, upload=169053]: Long tail cancellation due to optimal threshold
Feb 25 20:26:05.522806408 (192h17m24.661790612s) [seg_pos={0 0}, upload=169053]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Feb 25 20:26:05.522996834 (192h17m24.661981048s) [upload=169053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 25 20:26:05.523003857 (192h17m24.661988072s) [upload=169053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 25 20:26:05.685962135 (192h17m24.824946349s) [upload=169053]: Done uploading segments...
Feb 25 20:26:05.685982203 (192h17m24.824966427s) [upload=169053]: Upload finished. err: <nil>
Duration: 2.294481395s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
24.180213ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Server=Storj Vary=Origin X-Request-Id=4koQwaNGi7C X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=1897973BDEB45754 Date=Wed, 25 Feb 2026 20:27:41 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/7e8744e895414b97
FAIL (2026-02-25 20:27:41 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897973BDEB45754</RequestId><HostId></HostId></Error>"
Duration: 24.196505ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
24.260664ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes X-Amz-Request-Id=1897973AFE9DFFE4 X-Request-Id=JuZuG5dopyN Date=Wed, 25 Feb 2026 20:27:38 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/6a02144256f74f71
FAIL (2026-02-25 20:27:38 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897973AFE9DFFE4</RequestId><HostId></HostId></Error>"
Duration: 24.278186ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
28.645916ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Request-Id=TGAh5XoGnuV Accept-Ranges=bytes Vary=Origin X-Amz-Request-Id=1897973ACBA7EE49 X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 20:27:37 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/451370500fe11f3b
FAIL (2026-02-25 20:27:37 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897973ACBA7EE49</RequestId><HostId></HostId></Error>"
Duration: 28.662818ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.245477ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Type=application/xml Vary=Origin X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 20:27:23 GMT Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=18979737A632C6FF X-Request-Id=Fkb1r8a4Qvg target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/33deabe34b7e5254
FAIL (2026-02-25 20:27:23 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18979737A632C6FF</RequestId><HostId></HostId></Error>"
Duration: 12.25807ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [............XX..............................................] duration:
357.785196ms trace:
https://jaeger.dev.storj.io/trace/56af7b4e02fced30
FAIL (2026-02-25 20:27:20 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 357.801875ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
23.271515ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Vary=Origin X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 20:27:10 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=18979734A7913CD8 X-Request-Id=PuUBEEqcPHf target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/308d8f6637f1c58c
FAIL (2026-02-25 20:27:10 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18979734A7913CD8</RequestId><HostId></HostId></Error>"
Duration: 23.288959ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
25.38262ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Vary=Origin X-Amz-Request-Id=18979732F8132528 X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Request-Id=6BFwZnrhRp2 Date=Wed, 25 Feb 2026 20:27:03 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/72ff5dfab05e8c2c
FAIL (2026-02-25 20:27:03 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18979732F8132528</RequestId><HostId></HostId></Error>"
Duration: 25.408288ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [.............X..........................................X...] duration:
2.302703303s trace:
https://jaeger.dev.storj.io/trace/71e948d4eec91061
FAIL (2026-02-25 20:26:47 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, Piece ID: NK3OUHGIGJIFK3YNYTXVPCXUAOCHU7LW7OLY5BGZMQCEU2QTIXPQ) context deadline exceeded; piecestore: (Node ID: 1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, Piece ID: LVU6MKTZAAREY46FOMONJ4XISBDO6DIVGBHW6UQMT6AJSDRO7G5Q) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: 52UIJMG3NQWYNNZTSRZQVSJ3IY7CQR4VDS5N3PUJ3PXK7QPXI2NA) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: PXR53Y6CJCXU32KQLN2WUQONSLTBMSPNPJROBEGVXN4ZFXXIZD5Q) context deadline exceeded; piecestore: (Node ID: 12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, Piece ID: 2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ) context deadline exceeded; piecestore: (Node ID: 1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, Piece ID: E6RRIRNNSLE7FBICBBAQEXPUXIYTPT3L2Y53IFKDI7SALSHDP7GA) context deadline exceeded; piecestore: (Node ID: 12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, Piece ID: LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: KMV3U75ZXM4I6J4KQ6NE7S52L52PNCMV2P43WHIRLB5BSTMEWFBA) context deadline exceeded; piecestore: (Node ID: 1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, Piece ID: UQ2URRBL2ZPKHJSPQVYEBYLJM7QQZ5GY6BAMYLEALKNUEPMIUFWA) context deadline exceeded; piecestore: (Node ID: 12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, Piece ID: OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: FC2RYMVA5LYJYNPRQO5TCSAHU6MEPD5S6HA7IMMFJKGVRT6R5QXA) context deadline exceeded; piecestore: (Node ID: 12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, Piece ID: OSYYOFUYXTPY56HUMHLENNMCHRDPRRJ3CA4GY6PUHGJ622GQ6NWQ) context deadline exceeded; piecestore: (Node ID: 1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, Piece ID: NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA) context deadline exceeded; piecestore: (Node ID: 1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, Piece ID: OXJN4M3XCEOOWC3JB3KL637UCLZJ6Z5E3WVEUNEHF7WJ2ZE6F7HA) context deadline exceeded; piecestore: (Node ID: 12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, Piece ID: 4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA) context deadline exceeded; piecestore: (Node ID: 12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, Piece ID: ZM2HOVINDTXULCTGLTNWPFKI6I27XQZCOGNE22QFH3TNMHWH3NAA) context deadline exceeded; piecestore: (Node ID: 12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, Piece ID: KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ) context deadline exceeded
======LOGS======
0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714112751 (192h16m25.853096965s) [noise=true , address=81.171.14.70:4040 , piece_id=VTGJTWIOPXCRD7432PER7PZO5NZYRKVCTAXPLDX3UNH7Q4ORJU7A, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714411960 (192h16m25.853396174s) [noise=true , address=185.167.204.205:4029 , piece_id=KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714734373 (192h16m25.853718587s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714833107 (192h16m25.853817321s) [noise=true , address=81.171.14.70:4033 , piece_id=3ESV63AA2EPW4DGL764CDZULGADNKRI3Z2SSKOTXXBFQZIDALGKQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715325467 (192h16m25.854309681s) [noise=true , address=81.171.14.70:4042 , piece_id=OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715342008 (192h16m25.854326222s) [noise=true , address=81.171.14.70:4041 , piece_id=LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715792569 (192h16m25.854776783s) [noise=true , address=185.167.204.206:4065 , piece_id=2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715842372 (192h16m25.854826587s) [noise=true , address=81.171.14.70:4048 , piece_id=4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.716371520 (192h16m25.855355735s) [noise=true , address=81.171.14.70:4046 , piece_id=NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:07.176030143 (192h16m26.315014346s) [upload=169053]: Next returned nil segment
Feb 25 20:25:07.176040030 (192h16m26.315024225s) [upload=169053]: Waiting for error group managing segments...
Feb 25 20:25:07.355043614 (192h16m26.494027828s) [noise=true , address=81.171.14.70:4039 , piece_id=NK3OUHGIGJIFK3YNYTXVPCXUAOCHU7LW7OLY5BGZMQCEU2QTIXPQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.365274838 (192h16m26.504259023s) [noise=true , address=89.149.201.147:4014 , piece_id=E6RRIRNNSLE7FBICBBAQEXPUXIYTPT3L2Y53IFKDI7SALSHDP7GA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.367225362 (192h16m26.506209576s) [noise=true , address=185.167.204.206:4040 , piece_id=K3IFUMLBFWII6ZXWBAPEPYYBY4OC2C6R2PYLBJ6JYN35QDZC7NKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.371128434 (192h16m26.510112618s) [noise=true , address=81.171.14.70:4033 , piece_id=3ESV63AA2EPW4DGL764CDZULGADNKRI3Z2SSKOTXXBFQZIDALGKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.374437836 (192h16m26.513422051s) [noise=true , address=81.171.14.70:4042 , piece_id=OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.391548321 (192h16m26.530532506s) [noise=true , address=81.171.14.70:4029 , piece_id=KMV3U75ZXM4I6J4KQ6NE7S52L52PNCMV2P43WHIRLB5BSTMEWFBA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.392215328 (192h16m26.531199543s) [noise=true , address=185.167.204.205:4027 , piece_id=EMCAH2W4KVXJNA5VRYHKTW7QMVB5KDY6D22NXI6J7SZPIDILZQ3A, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.392961462 (192h16m26.531945647s) [noise=true , address=81.171.14.70:4048 , piece_id=4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.398831849 (192h16m26.537816033s) [noise=true , address=81.171.14.70:4041 , piece_id=LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.399403016 (192h16m26.5383872s) [noise=true , address=185.167.204.205:4008 , piece_id=FC2RYMVA5LYJYNPRQO5TCSAHU6MEPD5S6HA7IMMFJKGVRT6R5QXA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.399854239 (192h16m26.538838423s) [noise=true , address=81.171.14.70:4046 , piece_id=NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.404371869 (192h16m26.543356093s) [noise=true , address=185.167.204.206:4060 , piece_id=OSYYOFUYXTPY56HUMHLENNMCHRDPRRJ3CA4GY6PUHGJ622GQ6NWQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.405487152 (192h16m26.544471377s) [noise=true , address=81.171.14.70:4025 , piece_id=XK76EA2CGQHTYGUYBGMST6GWZUPHLU6ESLFZKVDIS4JUSBOZWBOA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.410629299 (192h16m26.549613522s) [noise=true , address=185.167.204.205:4029 , piece_id=KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.410670746 (192h16m26.54965496s) [noise=true , address=185.167.204.205:4031 , piece_id=ZCA7B4GAY6NLK5MMEP4TFIHZPTB4KE7MCKUADFCGV5MSJRR6DFKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.411374772 (192h16m26.550358985s) [noise=true , address=185.167.204.205:4003 , piece_id=PXR53Y6CJCXU32KQLN2WUQONSLTBMSPNPJROBEGVXN4ZFXXIZD5Q, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.414774614 (192h16m26.553758838s) [noise=true , address=185.167.204.206:4057 , piece_id=UQ2URRBL2ZPKHJSPQVYEBYLJM7QQZ5GY6BAMYLEALKNUEPMIUFWA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.426466867 (192h16m26.565451081s) [noise=true , address=89.149.201.147:4012 , piece_id=LVU6MKTZAAREY46FOMONJ4XISBDO6DIVGBHW6UQMT6AJSDRO7G5Q, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.427104278 (192h16m26.566088492s) [noise=true , address=185.167.204.206:4065 , piece_id=2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.428092193 (192h16m26.567076408s) [noise=true , address=81.171.14.70:4040 , piece_id=VTGJTWIOPXCRD7432PER7PZO5NZYRKVCTAXPLDX3UNH7Q4ORJU7A, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.436098991 (192h16m26.575083215s) [noise=true , address=89.149.201.147:4017 , piece_id=OXJN4M3XCEOOWC3JB3KL637UCLZJ6Z5E3WVEUNEHF7WJ2ZE6F7HA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.436464915 (192h16m26.575449139s) [noise=true , address=89.149.201.147:4007 , piece_id=6YTZB4PC5LWOBK2W2XVX76VY62GQSNCFEMOYMNKBLBE5LSEEB7FQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.442990667 (192h16m26.581974881s) [noise=true , address=89.149.201.147:4006 , piece_id=BGTO5Q4A3UVVDW6T2F4G722LMZK6MUWTQT3KKYMQWT52Z746G4RQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.444432951 (192h16m26.583417166s) [noise=true , address=185.167.204.206:4049 , piece_id=XEQCFEH3EZUXGS3IYI5XKC2DAQXXIQ2SJN534VPBPLQ4XL4YMMNA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.448326675 (192h16m26.5873109s) [noise=true , address=185.167.204.205:4011 , piece_id=52UIJMG3NQWYNNZTSRZQVSJ3IY7CQR4VDS5N3PUJ3PXK7QPXI2NA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:26:05.522252363 (192h17m24.661236577s) [noise=true , address=89.149.201.147:4020 , piece_id=ZM2HOVINDTXULCTGLTNWPFKI6I27XQZCOGNE22QFH3TNMHWH3NAA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:26:05.522272842 (192h17m24.661257046s) [seg_pos={0 0}, upload=169053]: Satisfied cohort requirements after 26 pieces
Feb 25 20:26:05.522610733 (192h17m24.661594948s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: read tcp 5.161.89.252:45110->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 25 20:26:05.522623126 (192h17m24.66160733s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Long tail cancellation due to optimal threshold
Feb 25 20:26:05.522763870 (192h17m24.661748084s) [noise=true , address=89.149.201.147:4009 , piece_id=OIIRKZOFH6IENR73SYNK63YW7QM6QP3G7EUATUII3FW3DKG33PGQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: read tcp 5.161.89.252:12596->89.149.201.147:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 25 20:26:05.522785930 (192h17m24.661770144s) [noise=true , address=89.149.201.147:4009 , piece_id=OIIRKZOFH6IENR73SYNK63YW7QM6QP3G7EUATUII3FW3DKG33PGQ, seg_pos={0 0}, upload=169053]: Long tail cancellation due to optimal threshold
Feb 25 20:26:05.522806408 (192h17m24.661790612s) [seg_pos={0 0}, upload=169053]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Feb 25 20:26:05.522996834 (192h17m24.661981048s) [upload=169053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 25 20:26:05.523003857 (192h17m24.661988072s) [upload=169053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 25 20:26:05.685962135 (192h17m24.824946349s) [upload=169053]: Done uploading segments...
Feb 25 20:26:05.685982203 (192h17m24.824966427s) [upload=169053]: Upload finished. err: <nil>
Duration: 2.302724884s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.513668ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Wed, 25 Feb 2026 20:26:43 GMT Accept-Ranges=bytes Content-Length=274 Server=Storj Vary=Origin Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=1897972E460A73B6 X-Request-Id=KgG18PKvVg2 X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/3831e5ddb8e4c263
FAIL (2026-02-25 20:26:43 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897972E460A73B6</RequestId><HostId></HostId></Error>"
Duration: 29.531019ms
edge
gateway
vhost
bgp
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............XX.............................................] duration:
416.403374ms trace:
https://jaeger.dev.storj.io/trace/56af7b4e02fced30
FAIL (2026-02-25 20:26:42 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 416.419414ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.357791ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin Content-Length=284 X-Amz-Request-Id=1897972C414F02FF X-Request-Id=JuHmRe2k6qH X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 20:26:34 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/d7e9e30e5b7d4ee
FAIL (2026-02-25 20:26:34 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897972C414F02FF</RequestId><HostId></HostId></Error>"
Duration: 10.377709ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
24.852139ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=1897972BFA7D1943 X-Request-Id=RmdGSPpLn4p Date=Wed, 25 Feb 2026 20:26:33 GMT Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/1062da0ecc1982e
FAIL (2026-02-25 20:26:33 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897972BFA7D1943</RequestId><HostId></HostId></Error>"
Duration: 24.872937ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [..............X..........................................X..] duration:
2.269868343s trace:
https://jaeger.dev.storj.io/trace/71e948d4eec91061
FAIL (2026-02-25 20:26:25 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, Piece ID: NK3OUHGIGJIFK3YNYTXVPCXUAOCHU7LW7OLY5BGZMQCEU2QTIXPQ) context deadline exceeded; piecestore: (Node ID: 1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, Piece ID: LVU6MKTZAAREY46FOMONJ4XISBDO6DIVGBHW6UQMT6AJSDRO7G5Q) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: 52UIJMG3NQWYNNZTSRZQVSJ3IY7CQR4VDS5N3PUJ3PXK7QPXI2NA) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: PXR53Y6CJCXU32KQLN2WUQONSLTBMSPNPJROBEGVXN4ZFXXIZD5Q) context deadline exceeded; piecestore: (Node ID: 12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, Piece ID: 2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ) context deadline exceeded; piecestore: (Node ID: 1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, Piece ID: E6RRIRNNSLE7FBICBBAQEXPUXIYTPT3L2Y53IFKDI7SALSHDP7GA) context deadline exceeded; piecestore: (Node ID: 12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, Piece ID: LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: KMV3U75ZXM4I6J4KQ6NE7S52L52PNCMV2P43WHIRLB5BSTMEWFBA) context deadline exceeded; piecestore: (Node ID: 1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, Piece ID: UQ2URRBL2ZPKHJSPQVYEBYLJM7QQZ5GY6BAMYLEALKNUEPMIUFWA) context deadline exceeded; piecestore: (Node ID: 12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, Piece ID: OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: FC2RYMVA5LYJYNPRQO5TCSAHU6MEPD5S6HA7IMMFJKGVRT6R5QXA) context deadline exceeded; piecestore: (Node ID: 12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, Piece ID: OSYYOFUYXTPY56HUMHLENNMCHRDPRRJ3CA4GY6PUHGJ622GQ6NWQ) context deadline exceeded; piecestore: (Node ID: 1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, Piece ID: NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA) context deadline exceeded; piecestore: (Node ID: 1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, Piece ID: OXJN4M3XCEOOWC3JB3KL637UCLZJ6Z5E3WVEUNEHF7WJ2ZE6F7HA) context deadline exceeded; piecestore: (Node ID: 12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, Piece ID: 4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA) context deadline exceeded; piecestore: (Node ID: 12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, Piece ID: ZM2HOVINDTXULCTGLTNWPFKI6I27XQZCOGNE22QFH3TNMHWH3NAA) context deadline exceeded; piecestore: (Node ID: 12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, Piece ID: KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ) context deadline exceeded
======LOGS======
0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714112751 (192h16m25.853096965s) [noise=true , address=81.171.14.70:4040 , piece_id=VTGJTWIOPXCRD7432PER7PZO5NZYRKVCTAXPLDX3UNH7Q4ORJU7A, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714411960 (192h16m25.853396174s) [noise=true , address=185.167.204.205:4029 , piece_id=KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714734373 (192h16m25.853718587s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714833107 (192h16m25.853817321s) [noise=true , address=81.171.14.70:4033 , piece_id=3ESV63AA2EPW4DGL764CDZULGADNKRI3Z2SSKOTXXBFQZIDALGKQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715325467 (192h16m25.854309681s) [noise=true , address=81.171.14.70:4042 , piece_id=OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715342008 (192h16m25.854326222s) [noise=true , address=81.171.14.70:4041 , piece_id=LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715792569 (192h16m25.854776783s) [noise=true , address=185.167.204.206:4065 , piece_id=2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715842372 (192h16m25.854826587s) [noise=true , address=81.171.14.70:4048 , piece_id=4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.716371520 (192h16m25.855355735s) [noise=true , address=81.171.14.70:4046 , piece_id=NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:07.176030143 (192h16m26.315014346s) [upload=169053]: Next returned nil segment
Feb 25 20:25:07.176040030 (192h16m26.315024225s) [upload=169053]: Waiting for error group managing segments...
Feb 25 20:25:07.355043614 (192h16m26.494027828s) [noise=true , address=81.171.14.70:4039 , piece_id=NK3OUHGIGJIFK3YNYTXVPCXUAOCHU7LW7OLY5BGZMQCEU2QTIXPQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.365274838 (192h16m26.504259023s) [noise=true , address=89.149.201.147:4014 , piece_id=E6RRIRNNSLE7FBICBBAQEXPUXIYTPT3L2Y53IFKDI7SALSHDP7GA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.367225362 (192h16m26.506209576s) [noise=true , address=185.167.204.206:4040 , piece_id=K3IFUMLBFWII6ZXWBAPEPYYBY4OC2C6R2PYLBJ6JYN35QDZC7NKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.371128434 (192h16m26.510112618s) [noise=true , address=81.171.14.70:4033 , piece_id=3ESV63AA2EPW4DGL764CDZULGADNKRI3Z2SSKOTXXBFQZIDALGKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.374437836 (192h16m26.513422051s) [noise=true , address=81.171.14.70:4042 , piece_id=OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.391548321 (192h16m26.530532506s) [noise=true , address=81.171.14.70:4029 , piece_id=KMV3U75ZXM4I6J4KQ6NE7S52L52PNCMV2P43WHIRLB5BSTMEWFBA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.392215328 (192h16m26.531199543s) [noise=true , address=185.167.204.205:4027 , piece_id=EMCAH2W4KVXJNA5VRYHKTW7QMVB5KDY6D22NXI6J7SZPIDILZQ3A, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.392961462 (192h16m26.531945647s) [noise=true , address=81.171.14.70:4048 , piece_id=4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.398831849 (192h16m26.537816033s) [noise=true , address=81.171.14.70:4041 , piece_id=LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.399403016 (192h16m26.5383872s) [noise=true , address=185.167.204.205:4008 , piece_id=FC2RYMVA5LYJYNPRQO5TCSAHU6MEPD5S6HA7IMMFJKGVRT6R5QXA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.399854239 (192h16m26.538838423s) [noise=true , address=81.171.14.70:4046 , piece_id=NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.404371869 (192h16m26.543356093s) [noise=true , address=185.167.204.206:4060 , piece_id=OSYYOFUYXTPY56HUMHLENNMCHRDPRRJ3CA4GY6PUHGJ622GQ6NWQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.405487152 (192h16m26.544471377s) [noise=true , address=81.171.14.70:4025 , piece_id=XK76EA2CGQHTYGUYBGMST6GWZUPHLU6ESLFZKVDIS4JUSBOZWBOA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.410629299 (192h16m26.549613522s) [noise=true , address=185.167.204.205:4029 , piece_id=KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.410670746 (192h16m26.54965496s) [noise=true , address=185.167.204.205:4031 , piece_id=ZCA7B4GAY6NLK5MMEP4TFIHZPTB4KE7MCKUADFCGV5MSJRR6DFKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.411374772 (192h16m26.550358985s) [noise=true , address=185.167.204.205:4003 , piece_id=PXR53Y6CJCXU32KQLN2WUQONSLTBMSPNPJROBEGVXN4ZFXXIZD5Q, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.414774614 (192h16m26.553758838s) [noise=true , address=185.167.204.206:4057 , piece_id=UQ2URRBL2ZPKHJSPQVYEBYLJM7QQZ5GY6BAMYLEALKNUEPMIUFWA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.426466867 (192h16m26.565451081s) [noise=true , address=89.149.201.147:4012 , piece_id=LVU6MKTZAAREY46FOMONJ4XISBDO6DIVGBHW6UQMT6AJSDRO7G5Q, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.427104278 (192h16m26.566088492s) [noise=true , address=185.167.204.206:4065 , piece_id=2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.428092193 (192h16m26.567076408s) [noise=true , address=81.171.14.70:4040 , piece_id=VTGJTWIOPXCRD7432PER7PZO5NZYRKVCTAXPLDX3UNH7Q4ORJU7A, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.436098991 (192h16m26.575083215s) [noise=true , address=89.149.201.147:4017 , piece_id=OXJN4M3XCEOOWC3JB3KL637UCLZJ6Z5E3WVEUNEHF7WJ2ZE6F7HA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.436464915 (192h16m26.575449139s) [noise=true , address=89.149.201.147:4007 , piece_id=6YTZB4PC5LWOBK2W2XVX76VY62GQSNCFEMOYMNKBLBE5LSEEB7FQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.442990667 (192h16m26.581974881s) [noise=true , address=89.149.201.147:4006 , piece_id=BGTO5Q4A3UVVDW6T2F4G722LMZK6MUWTQT3KKYMQWT52Z746G4RQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.444432951 (192h16m26.583417166s) [noise=true , address=185.167.204.206:4049 , piece_id=XEQCFEH3EZUXGS3IYI5XKC2DAQXXIQ2SJN534VPBPLQ4XL4YMMNA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.448326675 (192h16m26.5873109s) [noise=true , address=185.167.204.205:4011 , piece_id=52UIJMG3NQWYNNZTSRZQVSJ3IY7CQR4VDS5N3PUJ3PXK7QPXI2NA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:26:05.522252363 (192h17m24.661236577s) [noise=true , address=89.149.201.147:4020 , piece_id=ZM2HOVINDTXULCTGLTNWPFKI6I27XQZCOGNE22QFH3TNMHWH3NAA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:26:05.522272842 (192h17m24.661257046s) [seg_pos={0 0}, upload=169053]: Satisfied cohort requirements after 26 pieces
Feb 25 20:26:05.522610733 (192h17m24.661594948s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: read tcp 5.161.89.252:45110->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 25 20:26:05.522623126 (192h17m24.66160733s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Long tail cancellation due to optimal threshold
Feb 25 20:26:05.522763870 (192h17m24.661748084s) [noise=true , address=89.149.201.147:4009 , piece_id=OIIRKZOFH6IENR73SYNK63YW7QM6QP3G7EUATUII3FW3DKG33PGQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: read tcp 5.161.89.252:12596->89.149.201.147:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 25 20:26:05.522785930 (192h17m24.661770144s) [noise=true , address=89.149.201.147:4009 , piece_id=OIIRKZOFH6IENR73SYNK63YW7QM6QP3G7EUATUII3FW3DKG33PGQ, seg_pos={0 0}, upload=169053]: Long tail cancellation due to optimal threshold
Feb 25 20:26:05.522806408 (192h17m24.661790612s) [seg_pos={0 0}, upload=169053]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Feb 25 20:26:05.522996834 (192h17m24.661981048s) [upload=169053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 25 20:26:05.523003857 (192h17m24.661988072s) [upload=169053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 25 20:26:05.685962135 (192h17m24.824946349s) [upload=169053]: Done uploading segments...
Feb 25 20:26:05.685982203 (192h17m24.824966427s) [upload=169053]: Upload finished. err: <nil>
Duration: 2.269895223s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
25.159643ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=18979727859C9240 X-Xss-Protection=1; mode=block X-Request-Id=TQPQSDcHD2X Date=Wed, 25 Feb 2026 20:26:14 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/23d13d7539724d32
FAIL (2026-02-25 20:26:14 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18979727859C9240</RequestId><HostId></HostId></Error>"
Duration: 25.175893ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [...............X..........................................X.] duration:
2.571562346s trace:
https://jaeger.dev.storj.io/trace/71e948d4eec91061
FAIL (2026-02-25 20:26:08 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, Piece ID: NK3OUHGIGJIFK3YNYTXVPCXUAOCHU7LW7OLY5BGZMQCEU2QTIXPQ) context deadline exceeded; piecestore: (Node ID: 1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, Piece ID: LVU6MKTZAAREY46FOMONJ4XISBDO6DIVGBHW6UQMT6AJSDRO7G5Q) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: 52UIJMG3NQWYNNZTSRZQVSJ3IY7CQR4VDS5N3PUJ3PXK7QPXI2NA) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: PXR53Y6CJCXU32KQLN2WUQONSLTBMSPNPJROBEGVXN4ZFXXIZD5Q) context deadline exceeded; piecestore: (Node ID: 12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, Piece ID: 2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ) context deadline exceeded; piecestore: (Node ID: 1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, Piece ID: E6RRIRNNSLE7FBICBBAQEXPUXIYTPT3L2Y53IFKDI7SALSHDP7GA) context deadline exceeded; piecestore: (Node ID: 12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, Piece ID: LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: KMV3U75ZXM4I6J4KQ6NE7S52L52PNCMV2P43WHIRLB5BSTMEWFBA) context deadline exceeded; piecestore: (Node ID: 1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, Piece ID: UQ2URRBL2ZPKHJSPQVYEBYLJM7QQZ5GY6BAMYLEALKNUEPMIUFWA) context deadline exceeded; piecestore: (Node ID: 12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, Piece ID: OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: FC2RYMVA5LYJYNPRQO5TCSAHU6MEPD5S6HA7IMMFJKGVRT6R5QXA) context deadline exceeded; piecestore: (Node ID: 12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, Piece ID: OSYYOFUYXTPY56HUMHLENNMCHRDPRRJ3CA4GY6PUHGJ622GQ6NWQ) context deadline exceeded; piecestore: (Node ID: 1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, Piece ID: NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA) context deadline exceeded; piecestore: (Node ID: 1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, Piece ID: OXJN4M3XCEOOWC3JB3KL637UCLZJ6Z5E3WVEUNEHF7WJ2ZE6F7HA) context deadline exceeded; piecestore: (Node ID: 12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, Piece ID: 4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA) context deadline exceeded; piecestore: (Node ID: 12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, Piece ID: ZM2HOVINDTXULCTGLTNWPFKI6I27XQZCOGNE22QFH3TNMHWH3NAA) context deadline exceeded; piecestore: (Node ID: 12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, Piece ID: KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ) context deadline exceeded
======LOGS======
0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714112751 (192h16m25.853096965s) [noise=true , address=81.171.14.70:4040 , piece_id=VTGJTWIOPXCRD7432PER7PZO5NZYRKVCTAXPLDX3UNH7Q4ORJU7A, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714411960 (192h16m25.853396174s) [noise=true , address=185.167.204.205:4029 , piece_id=KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714734373 (192h16m25.853718587s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714833107 (192h16m25.853817321s) [noise=true , address=81.171.14.70:4033 , piece_id=3ESV63AA2EPW4DGL764CDZULGADNKRI3Z2SSKOTXXBFQZIDALGKQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715325467 (192h16m25.854309681s) [noise=true , address=81.171.14.70:4042 , piece_id=OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715342008 (192h16m25.854326222s) [noise=true , address=81.171.14.70:4041 , piece_id=LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715792569 (192h16m25.854776783s) [noise=true , address=185.167.204.206:4065 , piece_id=2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715842372 (192h16m25.854826587s) [noise=true , address=81.171.14.70:4048 , piece_id=4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.716371520 (192h16m25.855355735s) [noise=true , address=81.171.14.70:4046 , piece_id=NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:07.176030143 (192h16m26.315014346s) [upload=169053]: Next returned nil segment
Feb 25 20:25:07.176040030 (192h16m26.315024225s) [upload=169053]: Waiting for error group managing segments...
Feb 25 20:25:07.355043614 (192h16m26.494027828s) [noise=true , address=81.171.14.70:4039 , piece_id=NK3OUHGIGJIFK3YNYTXVPCXUAOCHU7LW7OLY5BGZMQCEU2QTIXPQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.365274838 (192h16m26.504259023s) [noise=true , address=89.149.201.147:4014 , piece_id=E6RRIRNNSLE7FBICBBAQEXPUXIYTPT3L2Y53IFKDI7SALSHDP7GA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.367225362 (192h16m26.506209576s) [noise=true , address=185.167.204.206:4040 , piece_id=K3IFUMLBFWII6ZXWBAPEPYYBY4OC2C6R2PYLBJ6JYN35QDZC7NKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.371128434 (192h16m26.510112618s) [noise=true , address=81.171.14.70:4033 , piece_id=3ESV63AA2EPW4DGL764CDZULGADNKRI3Z2SSKOTXXBFQZIDALGKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.374437836 (192h16m26.513422051s) [noise=true , address=81.171.14.70:4042 , piece_id=OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.391548321 (192h16m26.530532506s) [noise=true , address=81.171.14.70:4029 , piece_id=KMV3U75ZXM4I6J4KQ6NE7S52L52PNCMV2P43WHIRLB5BSTMEWFBA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.392215328 (192h16m26.531199543s) [noise=true , address=185.167.204.205:4027 , piece_id=EMCAH2W4KVXJNA5VRYHKTW7QMVB5KDY6D22NXI6J7SZPIDILZQ3A, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.392961462 (192h16m26.531945647s) [noise=true , address=81.171.14.70:4048 , piece_id=4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.398831849 (192h16m26.537816033s) [noise=true , address=81.171.14.70:4041 , piece_id=LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.399403016 (192h16m26.5383872s) [noise=true , address=185.167.204.205:4008 , piece_id=FC2RYMVA5LYJYNPRQO5TCSAHU6MEPD5S6HA7IMMFJKGVRT6R5QXA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.399854239 (192h16m26.538838423s) [noise=true , address=81.171.14.70:4046 , piece_id=NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.404371869 (192h16m26.543356093s) [noise=true , address=185.167.204.206:4060 , piece_id=OSYYOFUYXTPY56HUMHLENNMCHRDPRRJ3CA4GY6PUHGJ622GQ6NWQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.405487152 (192h16m26.544471377s) [noise=true , address=81.171.14.70:4025 , piece_id=XK76EA2CGQHTYGUYBGMST6GWZUPHLU6ESLFZKVDIS4JUSBOZWBOA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.410629299 (192h16m26.549613522s) [noise=true , address=185.167.204.205:4029 , piece_id=KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.410670746 (192h16m26.54965496s) [noise=true , address=185.167.204.205:4031 , piece_id=ZCA7B4GAY6NLK5MMEP4TFIHZPTB4KE7MCKUADFCGV5MSJRR6DFKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.411374772 (192h16m26.550358985s) [noise=true , address=185.167.204.205:4003 , piece_id=PXR53Y6CJCXU32KQLN2WUQONSLTBMSPNPJROBEGVXN4ZFXXIZD5Q, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.414774614 (192h16m26.553758838s) [noise=true , address=185.167.204.206:4057 , piece_id=UQ2URRBL2ZPKHJSPQVYEBYLJM7QQZ5GY6BAMYLEALKNUEPMIUFWA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.426466867 (192h16m26.565451081s) [noise=true , address=89.149.201.147:4012 , piece_id=LVU6MKTZAAREY46FOMONJ4XISBDO6DIVGBHW6UQMT6AJSDRO7G5Q, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.427104278 (192h16m26.566088492s) [noise=true , address=185.167.204.206:4065 , piece_id=2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.428092193 (192h16m26.567076408s) [noise=true , address=81.171.14.70:4040 , piece_id=VTGJTWIOPXCRD7432PER7PZO5NZYRKVCTAXPLDX3UNH7Q4ORJU7A, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.436098991 (192h16m26.575083215s) [noise=true , address=89.149.201.147:4017 , piece_id=OXJN4M3XCEOOWC3JB3KL637UCLZJ6Z5E3WVEUNEHF7WJ2ZE6F7HA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.436464915 (192h16m26.575449139s) [noise=true , address=89.149.201.147:4007 , piece_id=6YTZB4PC5LWOBK2W2XVX76VY62GQSNCFEMOYMNKBLBE5LSEEB7FQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.442990667 (192h16m26.581974881s) [noise=true , address=89.149.201.147:4006 , piece_id=BGTO5Q4A3UVVDW6T2F4G722LMZK6MUWTQT3KKYMQWT52Z746G4RQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.444432951 (192h16m26.583417166s) [noise=true , address=185.167.204.206:4049 , piece_id=XEQCFEH3EZUXGS3IYI5XKC2DAQXXIQ2SJN534VPBPLQ4XL4YMMNA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.448326675 (192h16m26.5873109s) [noise=true , address=185.167.204.205:4011 , piece_id=52UIJMG3NQWYNNZTSRZQVSJ3IY7CQR4VDS5N3PUJ3PXK7QPXI2NA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:26:05.522252363 (192h17m24.661236577s) [noise=true , address=89.149.201.147:4020 , piece_id=ZM2HOVINDTXULCTGLTNWPFKI6I27XQZCOGNE22QFH3TNMHWH3NAA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:26:05.522272842 (192h17m24.661257046s) [seg_pos={0 0}, upload=169053]: Satisfied cohort requirements after 26 pieces
Feb 25 20:26:05.522610733 (192h17m24.661594948s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: read tcp 5.161.89.252:45110->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 25 20:26:05.522623126 (192h17m24.66160733s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Long tail cancellation due to optimal threshold
Feb 25 20:26:05.522763870 (192h17m24.661748084s) [noise=true , address=89.149.201.147:4009 , piece_id=OIIRKZOFH6IENR73SYNK63YW7QM6QP3G7EUATUII3FW3DKG33PGQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: read tcp 5.161.89.252:12596->89.149.201.147:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 25 20:26:05.522785930 (192h17m24.661770144s) [noise=true , address=89.149.201.147:4009 , piece_id=OIIRKZOFH6IENR73SYNK63YW7QM6QP3G7EUATUII3FW3DKG33PGQ, seg_pos={0 0}, upload=169053]: Long tail cancellation due to optimal threshold
Feb 25 20:26:05.522806408 (192h17m24.661790612s) [seg_pos={0 0}, upload=169053]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Feb 25 20:26:05.522996834 (192h17m24.661981048s) [upload=169053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 25 20:26:05.523003857 (192h17m24.661988072s) [upload=169053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 25 20:26:05.685962135 (192h17m24.824946349s) [upload=169053]: Done uploading segments...
Feb 25 20:26:05.685982203 (192h17m24.824966427s) [upload=169053]: Upload finished. err: <nil>
Duration: 2.571579326s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [................X..........................................X] duration:
1m0.002278448s trace:
https://jaeger.dev.storj.io/trace/71e948d4eec91061
FAIL (2026-02-25 20:26:06 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1qsAHeMX7hadREKwHeJGrLGBCVjc223xFbZ53943A2RvJnSVuC, Piece ID: NK3OUHGIGJIFK3YNYTXVPCXUAOCHU7LW7OLY5BGZMQCEU2QTIXPQ) context deadline exceeded; piecestore: (Node ID: 1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, Piece ID: LVU6MKTZAAREY46FOMONJ4XISBDO6DIVGBHW6UQMT6AJSDRO7G5Q) context deadline exceeded; piecestore: (Node ID: 12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, Piece ID: 52UIJMG3NQWYNNZTSRZQVSJ3IY7CQR4VDS5N3PUJ3PXK7QPXI2NA) context deadline exceeded; piecestore: (Node ID: 1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, Piece ID: PXR53Y6CJCXU32KQLN2WUQONSLTBMSPNPJROBEGVXN4ZFXXIZD5Q) context deadline exceeded; piecestore: (Node ID: 12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, Piece ID: 2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ) context deadline exceeded; piecestore: (Node ID: 1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, Piece ID: E6RRIRNNSLE7FBICBBAQEXPUXIYTPT3L2Y53IFKDI7SALSHDP7GA) context deadline exceeded; piecestore: (Node ID: 12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, Piece ID: LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ) context deadline exceeded; piecestore: (Node ID: 18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, Piece ID: KMV3U75ZXM4I6J4KQ6NE7S52L52PNCMV2P43WHIRLB5BSTMEWFBA) context deadline exceeded; piecestore: (Node ID: 1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, Piece ID: UQ2URRBL2ZPKHJSPQVYEBYLJM7QQZ5GY6BAMYLEALKNUEPMIUFWA) context deadline exceeded; piecestore: (Node ID: 12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, Piece ID: OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA) context deadline exceeded; piecestore: (Node ID: 12ZHTTaGQUTftxEULFqWbH6w1HnWA7PavHrXnvMCD947FxtmsrS, Piece ID: FC2RYMVA5LYJYNPRQO5TCSAHU6MEPD5S6HA7IMMFJKGVRT6R5QXA) context deadline exceeded; piecestore: (Node ID: 12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, Piece ID: OSYYOFUYXTPY56HUMHLENNMCHRDPRRJ3CA4GY6PUHGJ622GQ6NWQ) context deadline exceeded; piecestore: (Node ID: 1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, Piece ID: NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA) context deadline exceeded; piecestore: (Node ID: 1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, Piece ID: OXJN4M3XCEOOWC3JB3KL637UCLZJ6Z5E3WVEUNEHF7WJ2ZE6F7HA) context deadline exceeded; piecestore: (Node ID: 12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, Piece ID: 4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA) context deadline exceeded; piecestore: (Node ID: 12YeKHJH7CoouLFJYENJhzVLNkA32hJaqjLz3dXhr78eaSGtcic, Piece ID: ZM2HOVINDTXULCTGLTNWPFKI6I27XQZCOGNE22QFH3TNMHWH3NAA) context deadline exceeded; piecestore: (Node ID: 12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, Piece ID: KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ) context deadline exceeded
======LOGS======
0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714112751 (192h16m25.853096965s) [noise=true , address=81.171.14.70:4040 , piece_id=VTGJTWIOPXCRD7432PER7PZO5NZYRKVCTAXPLDX3UNH7Q4ORJU7A, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714411960 (192h16m25.853396174s) [noise=true , address=185.167.204.205:4029 , piece_id=KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714734373 (192h16m25.853718587s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.714833107 (192h16m25.853817321s) [noise=true , address=81.171.14.70:4033 , piece_id=3ESV63AA2EPW4DGL764CDZULGADNKRI3Z2SSKOTXXBFQZIDALGKQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715325467 (192h16m25.854309681s) [noise=true , address=81.171.14.70:4042 , piece_id=OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715342008 (192h16m25.854326222s) [noise=true , address=81.171.14.70:4041 , piece_id=LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715792569 (192h16m25.854776783s) [noise=true , address=185.167.204.206:4065 , piece_id=2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.715842372 (192h16m25.854826587s) [noise=true , address=81.171.14.70:4048 , piece_id=4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:06.716371520 (192h16m25.855355735s) [noise=true , address=81.171.14.70:4046 , piece_id=NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA, seg_pos={0 0}, upload=169053]: Uploading piece...
Feb 25 20:25:07.176030143 (192h16m26.315014346s) [upload=169053]: Next returned nil segment
Feb 25 20:25:07.176040030 (192h16m26.315024225s) [upload=169053]: Waiting for error group managing segments...
Feb 25 20:25:07.355043614 (192h16m26.494027828s) [noise=true , address=81.171.14.70:4039 , piece_id=NK3OUHGIGJIFK3YNYTXVPCXUAOCHU7LW7OLY5BGZMQCEU2QTIXPQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.365274838 (192h16m26.504259023s) [noise=true , address=89.149.201.147:4014 , piece_id=E6RRIRNNSLE7FBICBBAQEXPUXIYTPT3L2Y53IFKDI7SALSHDP7GA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.367225362 (192h16m26.506209576s) [noise=true , address=185.167.204.206:4040 , piece_id=K3IFUMLBFWII6ZXWBAPEPYYBY4OC2C6R2PYLBJ6JYN35QDZC7NKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.371128434 (192h16m26.510112618s) [noise=true , address=81.171.14.70:4033 , piece_id=3ESV63AA2EPW4DGL764CDZULGADNKRI3Z2SSKOTXXBFQZIDALGKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.374437836 (192h16m26.513422051s) [noise=true , address=81.171.14.70:4042 , piece_id=OUEHUS5KATZFCXQWP6MCCVU6PAGNXBWJMBIX4RNIT4CFUOIXQ5MA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.391548321 (192h16m26.530532506s) [noise=true , address=81.171.14.70:4029 , piece_id=KMV3U75ZXM4I6J4KQ6NE7S52L52PNCMV2P43WHIRLB5BSTMEWFBA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.392215328 (192h16m26.531199543s) [noise=true , address=185.167.204.205:4027 , piece_id=EMCAH2W4KVXJNA5VRYHKTW7QMVB5KDY6D22NXI6J7SZPIDILZQ3A, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.392961462 (192h16m26.531945647s) [noise=true , address=81.171.14.70:4048 , piece_id=4FK4PMFCWY4PCVUJM2W6TRWC7O7UACMZBR6UL4O4WPGA45KRB4HA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.398831849 (192h16m26.537816033s) [noise=true , address=81.171.14.70:4041 , piece_id=LAOOPOUFMJMXEOWNYCHRVSMY43LOE4SIOZJ2BYP53BHDIWHUQMYQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.399403016 (192h16m26.5383872s) [noise=true , address=185.167.204.205:4008 , piece_id=FC2RYMVA5LYJYNPRQO5TCSAHU6MEPD5S6HA7IMMFJKGVRT6R5QXA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.399854239 (192h16m26.538838423s) [noise=true , address=81.171.14.70:4046 , piece_id=NVZOODNW5MSWS2PEWEYPOUJYUJ426SGQX3CI73354FZSOBFJ5ENA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.404371869 (192h16m26.543356093s) [noise=true , address=185.167.204.206:4060 , piece_id=OSYYOFUYXTPY56HUMHLENNMCHRDPRRJ3CA4GY6PUHGJ622GQ6NWQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.405487152 (192h16m26.544471377s) [noise=true , address=81.171.14.70:4025 , piece_id=XK76EA2CGQHTYGUYBGMST6GWZUPHLU6ESLFZKVDIS4JUSBOZWBOA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.410629299 (192h16m26.549613522s) [noise=true , address=185.167.204.205:4029 , piece_id=KMUMVMGLACDZNY6YAWLWMJ4THLWRD2LUURY2VJXXTVVYXFGECYTQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.410670746 (192h16m26.54965496s) [noise=true , address=185.167.204.205:4031 , piece_id=ZCA7B4GAY6NLK5MMEP4TFIHZPTB4KE7MCKUADFCGV5MSJRR6DFKQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.411374772 (192h16m26.550358985s) [noise=true , address=185.167.204.205:4003 , piece_id=PXR53Y6CJCXU32KQLN2WUQONSLTBMSPNPJROBEGVXN4ZFXXIZD5Q, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.414774614 (192h16m26.553758838s) [noise=true , address=185.167.204.206:4057 , piece_id=UQ2URRBL2ZPKHJSPQVYEBYLJM7QQZ5GY6BAMYLEALKNUEPMIUFWA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.426466867 (192h16m26.565451081s) [noise=true , address=89.149.201.147:4012 , piece_id=LVU6MKTZAAREY46FOMONJ4XISBDO6DIVGBHW6UQMT6AJSDRO7G5Q, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.427104278 (192h16m26.566088492s) [noise=true , address=185.167.204.206:4065 , piece_id=2LCITKEMEIGOHMFBAMPSTU3LQVGM6TRGS6I4RLHNGYI6MRATZTGQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.428092193 (192h16m26.567076408s) [noise=true , address=81.171.14.70:4040 , piece_id=VTGJTWIOPXCRD7432PER7PZO5NZYRKVCTAXPLDX3UNH7Q4ORJU7A, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.436098991 (192h16m26.575083215s) [noise=true , address=89.149.201.147:4017 , piece_id=OXJN4M3XCEOOWC3JB3KL637UCLZJ6Z5E3WVEUNEHF7WJ2ZE6F7HA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.436464915 (192h16m26.575449139s) [noise=true , address=89.149.201.147:4007 , piece_id=6YTZB4PC5LWOBK2W2XVX76VY62GQSNCFEMOYMNKBLBE5LSEEB7FQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.442990667 (192h16m26.581974881s) [noise=true , address=89.149.201.147:4006 , piece_id=BGTO5Q4A3UVVDW6T2F4G722LMZK6MUWTQT3KKYMQWT52Z746G4RQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.444432951 (192h16m26.583417166s) [noise=true , address=185.167.204.206:4049 , piece_id=XEQCFEH3EZUXGS3IYI5XKC2DAQXXIQ2SJN534VPBPLQ4XL4YMMNA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:25:07.448326675 (192h16m26.5873109s) [noise=true , address=185.167.204.205:4011 , piece_id=52UIJMG3NQWYNNZTSRZQVSJ3IY7CQR4VDS5N3PUJ3PXK7QPXI2NA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:26:05.522252363 (192h17m24.661236577s) [noise=true , address=89.149.201.147:4020 , piece_id=ZM2HOVINDTXULCTGLTNWPFKI6I27XQZCOGNE22QFH3TNMHWH3NAA, seg_pos={0 0}, upload=169053]: Done uploading piece. err: <nil>
Feb 25 20:26:05.522272842 (192h17m24.661257046s) [seg_pos={0 0}, upload=169053]: Satisfied cohort requirements after 26 pieces
Feb 25 20:26:05.522610733 (192h17m24.661594948s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK): protocol: read tcp 5.161.89.252:45110->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 25 20:26:05.522623126 (192h17m24.66160733s) [noise=true , address=89.149.201.147:4005 , piece_id=5ULULAJUYSC2EKV5LCATFSJSXNWYF2JFEMAZXXSERWSYHYC4ZOIQ, seg_pos={0 0}, upload=169053]: Long tail cancellation due to optimal threshold
Feb 25 20:26:05.522763870 (192h17m24.661748084s) [noise=true , address=89.149.201.147:4009 , piece_id=OIIRKZOFH6IENR73SYNK63YW7QM6QP3G7EUATUII3FW3DKG33PGQ, seg_pos={0 0}, upload=169053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F): protocol: read tcp 5.161.89.252:12596->89.149.201.147:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 25 20:26:05.522785930 (192h17m24.661770144s) [noise=true , address=89.149.201.147:4009 , piece_id=OIIRKZOFH6IENR73SYNK63YW7QM6QP3G7EUATUII3FW3DKG33PGQ, seg_pos={0 0}, upload=169053]: Long tail cancellation due to optimal threshold
Feb 25 20:26:05.522806408 (192h17m24.661790612s) [seg_pos={0 0}, upload=169053]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Feb 25 20:26:05.522996834 (192h17m24.661981048s) [upload=169053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 25 20:26:05.523003857 (192h17m24.661988072s) [upload=169053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 25 20:26:05.685962135 (192h17m24.824946349s) [upload=169053]: Done uploading segments...
Feb 25 20:26:05.685982203 (192h17m24.824966427s) [upload=169053]: Upload finished. err: <nil>
Duration: 1m0.00229594s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............XX............................................] duration:
459.716929ms trace:
https://jaeger.dev.storj.io/trace/56af7b4e02fced30
FAIL (2026-02-25 20:26:05 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 459.789174ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
23.594769ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Request-Id=hjrFhatPtRH Content-Length=274 Server=Storj X-Amz-Request-Id=18979724B6F86598 X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 20:26:02 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/6e76652882fa72c8
FAIL (2026-02-25 20:26:02 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18979724B6F86598</RequestId><HostId></HostId></Error>"
Duration: 23.61125ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
17.312633ms remote:
"tcp:45.38.24.2:443" response headers:
X-Request-Id=EcuQLKeJrTq X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 20:25:57 GMT Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=189797238626F49C Accept-Ranges=bytes Content-Length=284 Content-Type=application/xml Server=Storj target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/8e6224e3f7d6e33
FAIL (2026-02-25 20:25:57 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189797238626F49C</RequestId><HostId></HostId></Error>"
Duration: 17.330457ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.452531ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=18979722E26F9B2C X-Request-Id=72izsSebu5X X-Xss-Protection=1; mode=block Content-Type=application/xml Date=Wed, 25 Feb 2026 20:25:54 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/1a1a36776a3add91
FAIL (2026-02-25 20:25:54 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18979722E26F9B2C</RequestId><HostId></HostId></Error>"
Duration: 30.474271ms
edge
gateway
vhost
bgp
ap1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............XX...........................................] duration:
348.026741ms trace:
https://jaeger.dev.storj.io/trace/56af7b4e02fced30
FAIL (2026-02-25 20:25:35 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 348.043724ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
27.791079ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1897971A26B7003E Date=Wed, 25 Feb 2026 20:25:16 GMT Accept-Ranges=bytes Server=Storj X-Request-Id=QiFHu4p7Rrs X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/42b8bcd322333fa1
FAIL (2026-02-25 20:25:16 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897971A26B7003E</RequestId><HostId></HostId></Error>"
Duration: 27.812508ms
edge
gateway
vhost
bgp
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [................XX..........................................] duration:
428.894051ms trace:
https://jaeger.dev.storj.io/trace/56af7b4e02fced30
FAIL (2026-02-25 20:25:12 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 428.915942ms
edge
gateway
us-select-1
|