Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 116995 reports (Page 1699 of 2340)
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..]
duration:
558.615477ms
FAIL (2025-08-19 04:26:08 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:34390->127.0.0.1:53: i/o timeout
Duration: 558.633832ms edge authservice http bgp eu1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..]
duration:
387.049301ms
FAIL (2025-08-19 04:26:05 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:26171->127.0.0.1:53: i/o timeout
Duration: 387.30466ms edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..]
duration:
925.346428ms
FAIL (2025-08-19 04:26:03 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 925.366735ms core uplink eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..]
duration:
200.356936ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-08-19 04:26:03 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41477->127.0.0.1:53: i/o timeout
Duration: 200.376984ms edge gateway vhost bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X]
duration:
1m0.021287935s
FAIL (2025-08-19 04:25:52 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 4)
======LOGS======
50h58m36.376872316s) [noise=true , address=77.90.31.19:4875     , piece_id=6KYO54BM55OFSVPRPTCLVE6Y5SUIA2APVIN6PUB4L2KSKDIBRBEA, seg_pos={0 0}, upload=261053]: Uploading piece...
Aug 19 04:24:55.645815001 (250h58m36.377082622s) [noise=true , address=79.127.219.38:4033   , piece_id=DF2UZDAFWOZRDWT4XG2LQWMF2O3U3A7JHCCVP7B5OGPWHANY45JA, seg_pos={0 0}, upload=261053]: Uploading piece...
Aug 19 04:24:55.646033853 (250h58m36.377301483s) [noise=true , address=104.36.82.44:4897    , piece_id=6YSN77C452C74XB2CAS34556SBH5VVHP3FHXMIOYGMJPU2ST5J4Q, seg_pos={0 0}, upload=261053]: Uploading piece...
Aug 19 04:24:55.646234250 (250h58m36.377501869s) [noise=true , address=104.36.82.11:4125    , piece_id=6JPU7VDWTSKCOCS23PSVPWV5K266663CG7ODIP4GTZTLEUAIWS4A, seg_pos={0 0}, upload=261053]: Uploading piece...
Aug 19 04:24:55.646440638 (250h58m36.377708268s) [noise=true , address=104.36.82.51:4073    , piece_id=VRX37JPDYT3TRBWU6WHQDSPXOZKDHLAF2FVH4Y5IZBJT345JDGGA, seg_pos={0 0}, upload=261053]: Uploading piece...
Aug 19 04:24:55.646647877 (250h58m36.377915497s) [noise=true , address=79.127.205.245:4220  , piece_id=TWUWQX275ZQLK7EY2T5XMPW7537DWZHUOTQDXWTVQIFEXTO5YENA, seg_pos={0 0}, upload=261053]: Uploading piece...
Aug 19 04:24:55.646851189 (250h58m36.378118819s) [noise=true , address=45.91.116.11:4120    , piece_id=XMBYT3EMWIC7V2J5WD5TJZDOMSA3PRBUQR6CDFSMPB54RC2V45TQ, seg_pos={0 0}, upload=261053]: Uploading piece...
Aug 19 04:24:55.647068878 (250h58m36.378336498s) [noise=true , address=104.36.82.60:4347    , piece_id=JZ4QYDJ4WCRT4QK6WMCKJF7WVJS53OHJXPXG3OPBBS4KRUWI6O2Q, seg_pos={0 0}, upload=261053]: Uploading piece...
Aug 19 04:24:55.647278953 (250h58m36.378546583s) [noise=true , address=45.91.116.7:4032     , piece_id=ICSKEHGGZYP5NPZHYPL6METRICZ6W7B7GFPEZP4OCT5Y6XJ6YULA, seg_pos={0 0}, upload=261053]: Uploading piece...
Aug 19 04:24:55.647480793 (250h58m36.378748423s) [noise=true , address=77.90.31.17:4804     , piece_id=44PUTW65ALN3UYZQ5XDFAYPITB4M535WG7BCZ7CNQJZA7EMF5ISA, seg_pos={0 0}, upload=261053]: Uploading piece...
Aug 19 04:24:55.649496393 (250h58m36.380764013s) [noise=true , address=45.91.116.6:4994     , piece_id=XLCRAXVPRZOHBP6CTFWLMCT6PBYHOJANDUDEBEYRMTF2ORPGJX5A, seg_pos={0 0}, upload=261053]: Uploading piece...
Aug 19 04:24:55.712711522 (250h58m36.443979152s) [upload=261053]: Next returned nil segment
Aug 19 04:24:55.712720959 (250h58m36.443988589s) [upload=261053]: Waiting for error group managing segments...
Aug 19 04:24:55.721242570 (250h58m36.45251021s) [noise=true , address=79.127.219.38:4033   , piece_id=DF2UZDAFWOZRDWT4XG2LQWMF2O3U3A7JHCCVP7B5OGPWHANY45JA, seg_pos={0 0}, upload=261053]: Done uploading piece. err: <nil>
Aug 19 04:24:55.721374118 (250h58m36.452641758s) [noise=true , address=79.127.219.48:4099   , piece_id=2FUB5IW6F2WXNX4BCCT4LVWCK4B645PMXFS2QA2RJJ7N67Q76DXA, seg_pos={0 0}, upload=261053]: Done uploading piece. err: <nil>
Aug 19 04:24:55.899011317 (250h58m36.630278968s) [noise=true , address=79.127.201.215:4360  , piece_id=3UW3HKBBQGVM6QFTII346TRS57OO2DX4DUM2FIUU4SG3D36WFA4A, seg_pos={0 0}, upload=261053]: Done uploading piece. err: <nil>
Aug 19 04:24:56.127807261 (250h58m36.859074891s) [noise=true , address=79.127.205.245:4220  , piece_id=TWUWQX275ZQLK7EY2T5XMPW7537DWZHUOTQDXWTVQIFEXTO5YENA, seg_pos={0 0}, upload=261053]: Done uploading piece. err: <nil>
Aug 19 04:25:52.507254162 (250h59m33.238521792s) [noise=true , address=104.36.82.44:4897    , piece_id=6YSN77C452C74XB2CAS34556SBH5VVHP3FHXMIOYGMJPU2ST5J4Q, seg_pos={0 0}, upload=261053]: Done uploading piece. err: ecclient: upload failed (node:1xZEzok8AN2SUW6wups5Qug2TndRgrwkK2XMFvXfRyZcXFZRbU, address:104.36.82.44:4897): protocol: rpc: dial tcp 104.36.82.44:4897: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:52.507296472 (250h59m33.238564102s) [noise=true , address=104.36.82.60:4347    , piece_id=JZ4QYDJ4WCRT4QK6WMCKJF7WVJS53OHJXPXG3OPBBS4KRUWI6O2Q, seg_pos={0 0}, upload=261053]: Done uploading piece. err: ecclient: upload failed (node:1CbCAPrrYNvhv8129X18ftZmajktekzBFMu5rMLYpHriJbN5PM, address:104.36.82.60:4347): protocol: rpc: dial tcp 104.36.82.60:4347: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:52.507313133 (250h59m33.238580763s) [noise=true , address=77.90.31.17:4804     , piece_id=44PUTW65ALN3UYZQ5XDFAYPITB4M535WG7BCZ7CNQJZA7EMF5ISA, seg_pos={0 0}, upload=261053]: Done uploading piece. err: ecclient: upload failed (node:168Tw7W69Tq9opDKhJ4cM8PGnzpxp9E9SxKbdVxJeF83pETqGx, address:77.90.31.17:4804): protocol: rpc: dial tcp 77.90.31.17:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:52.507326889 (250h59m33.238594519s) [noise=true , address=77.90.31.21:4900     , piece_id=ZOSDEPGFZXPQFQWXWG2OXZPHWQYUMEIODX2WO5WNJGUEUFWZ6T5A, seg_pos={0 0}, upload=261053]: Done uploading piece. err: ecclient: upload failed (node:129YE2Wd6LmDABJFaGVtYDwCHmStVDnPRCagD2cKPWA5PDTtZyh, address:77.90.31.21:4900): protocol: rpc: dial tcp 77.90.31.21:4900: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:52.507349943 (250h59m33.238617573s) [noise=true , address=104.36.82.5:4861     , piece_id=LDCAPZP3GVMC6PHTKEKL4RRYHJSAJIMM2VONEIXAP24V46CYQ2BQ, seg_pos={0 0}, upload=261053]: Done uploading piece. err: ecclient: upload failed (node:1SqXobRvE3NHfzYxdJ8sedJq3W9pQ6KpMLMiojUhpsCigeeNuS, address:104.36.82.5:4861): protocol: rpc: dial tcp 104.36.82.5:4861: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:52.507355313 (250h59m33.238622933s) [noise=true , address=77.90.31.10:4525     , piece_id=7HAT43WB45OLQDVUXFU2NMFVA2R4YRAFTOLHSDU4S2HUGI2AZTGQ, seg_pos={0 0}, upload=261053]: Done uploading piece. err: ecclient: upload failed (node:127uTYN8tB4A6G4jW2mFpBfp7p2ziDAMYnwJLNUHv4D7f15wZ5r, address:77.90.31.10:4525): protocol: rpc: dial tcp 77.90.31.10:4525: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:52.507381672 (250h59m33.238649303s) [noise=true , address=104.36.82.11:4125    , piece_id=6JPU7VDWTSKCOCS23PSVPWV5K266663CG7ODIP4GTZTLEUAIWS4A, seg_pos={0 0}, upload=261053]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:104.36.82.11:4125): protocol: rpc: dial tcp 104.36.82.11:4125: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:52.507407250 (250h59m33.23867488s) [noise=true , address=45.91.116.7:4032     , piece_id=ICSKEHGGZYP5NPZHYPL6METRICZ6W7B7GFPEZP4OCT5Y6XJ6YULA, seg_pos={0 0}, upload=261053]: Done uploading piece. err: ecclient: upload failed (node:14fc8QANkMVxxrHcXTWi1yyDhE2gz8BJNwRuvJNfX56TyQCWYZ, address:45.91.116.7:4032): protocol: write tcp 5.161.89.252:32402->45.91.116.7:4032: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:52.507410988 (250h59m33.238678618s) [noise=true , address=104.36.82.51:4073    , piece_id=VRX37JPDYT3TRBWU6WHQDSPXOZKDHLAF2FVH4Y5IZBJT345JDGGA, seg_pos={0 0}, upload=261053]: Done uploading piece. err: ecclient: upload failed (node:1kGo5nNz8GyroAGoMQ75xDo4pppWPVsW9f8trLCWH6CqVXWsmK, address:104.36.82.51:4073): protocol: rpc: dial tcp 104.36.82.51:4073: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:52.507440993 (250h59m33.238708614s) [noise=true , address=45.91.116.6:4994     , piece_id=XLCRAXVPRZOHBP6CTFWLMCT6PBYHOJANDUDEBEYRMTF2ORPGJX5A, seg_pos={0 0}, upload=261053]: Done uploading piece. err: ecclient: upload failed (node:13bDFHbqDxbPr7n4PTQYCXE151sUUFPkidaY1KBZSPcPBBAnFo, address:45.91.116.6:4994): protocol: rpc: dial tcp 45.91.116.6:4994: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:52.507471150 (250h59m33.238738781s) [noise=true , address=77.90.31.12:4605     , piece_id=XFNR63HLNLXS27WSCPXYCCXDLFEELHKFH267XJWNSQNZDF2M7XUQ, seg_pos={0 0}, upload=261053]: Done uploading piece. err: ecclient: upload failed (node:12V4Dj8k4kAnrS6GfSJvvDDPvyHTiJziufBCWWjNoPe1Yvc6M53, address:77.90.31.12:4605): protocol: write tcp 5.161.89.252:30002->77.90.31.12:4605: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:52.507476540 (250h59m33.23874417s) [noise=true , address=77.90.31.19:4875     , piece_id=6KYO54BM55OFSVPRPTCLVE6Y5SUIA2APVIN6PUB4L2KSKDIBRBEA, seg_pos={0 0}, upload=261053]: Done uploading piece. err: ecclient: upload failed (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn, address:77.90.31.19:4875): protocol: rpc: dial tcp 77.90.31.19:4875: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:52.507481259 (250h59m33.238748879s) [noise=true , address=104.36.82.23:4448    , piece_id=MW6N2TCWALDEXYMPIRW54J2DA2AJY5M2HQFZPGHMSBHO6ZT3ZM4Q, seg_pos={0 0}, upload=261053]: Done uploading piece. err: ecclient: upload failed (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i, address:104.36.82.23:4448): protocol: rpc: dial tcp 104.36.82.23:4448: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:52.507487721 (250h59m33.238755351s) [noise=true , address=45.91.116.11:4120    , piece_id=XMBYT3EMWIC7V2J5WD5TJZDOMSA3PRBUQR6CDFSMPB54RC2V45TQ, seg_pos={0 0}, upload=261053]: Done uploading piece. err: ecclient: upload failed (node:1y9H9KNVuhzdB1XAPiwzHsFWYR4SrgB8Eff9HY6q6jmsYMTst8, address:45.91.116.11:4120): protocol: rpc: dial tcp 45.91.116.11:4120: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:52.507533607 (250h59m33.238801237s) [seg_pos={0 0}, upload=261053]: Done waiting for segment. successful: 4 optimal: 14 errs: <nil>
Aug 19 04:25:52.527043028 (250h59m33.258310648s) [upload=261053]: Done uploading segments...
Aug 19 04:25:52.527065149 (250h59m33.258332779s) [upload=261053]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 4)
Duration: 1m0.021303885s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..]
duration:
130.788229ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
FAIL (2025-08-19 04:25:52 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41477->127.0.0.1:53: i/o timeout
Duration: 130.807355ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..]
duration:
4.6772503s
FAIL (2025-08-19 04:25:51 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 4.677274364s core uplink ap1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.]
duration:
14.808842ms
target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt
FAIL (2025-08-19 04:25:51 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp: lookup link.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:34965->127.0.0.1:53: i/o timeout
Duration: 14.825263ms edge linksharing us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X]
duration:
1m0.025357505s
FAIL (2025-08-19 04:25:48 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 2)
======LOGS======
Aug 19 04:24:53.942371039 (250h58m34.673638659s) [upload=261051]: Starting upload
Aug 19 04:24:53.942402548 (250h58m34.673670168s) [upload=261051]: Done starting upload
Aug 19 04:24:53.942621229 (250h58m34.673888859s) [upload=261051]: Uploading segments...
Aug 19 04:24:53.942655333 (250h58m34.673922963s) [upload=261051]: Got next segment. Inline: false
Aug 19 04:24:53.942683456 (250h58m34.673951086s) [upload=261051]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 04:24:53.942687653 (250h58m34.673955283s) [upload=261051]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 04:24:53.978280811 (250h58m34.709548431s) [seg_pos={0 0}, upload=261051]: Begin upload segment...
Aug 19 04:24:53.978307932 (250h58m34.709575552s) [seg_pos={0 0}, upload=261051]: Done begin upload segment.
Aug 19 04:24:53.978329182 (250h58m34.709596802s) [noise=true , address=77.90.31.11:4578     , piece_id=VHLMEUDCHMHVYQL4GBXNGR54J5XL4YACNUYYWQCPADCRZRNGFLHQ, seg_pos={0 0}, upload=261051]: Uploading piece...
Aug 19 04:24:53.978339551 (250h58m34.709607172s) [noise=true , address=45.91.116.4:4945     , piece_id=SOLUIBWMTPAQINU4YDFDW65QBT2KOCNBR6MPVHOJKN4VDQW47M5A, seg_pos={0 0}, upload=261051]: Uploading piece...
Aug 19 04:24:53.978423980 (250h58m34.70969161s) [noise=true , address=104.36.82.13:4218    , piece_id=52F6OUMOLSCXLJ6AMYOU65KMMRFYRNLQLLWJ6H6TK27ZHM4Q6C6Q, seg_pos={0 0}, upload=261051]: Uploading piece...
Aug 19 04:24:53.978658601 (250h58m34.709926231s) [noise=true , address=77.90.31.10:4547     , piece_id=BRKIPW57YB5M4AHLUWCWAR5UQXNOFC43YIGUCCO3ALDWFOZCNWWA, seg_pos={0 0}, upload=261051]: Uploading piece...
Aug 19 04:24:53.978683357 (250h58m34.709950977s) [noise=true , address=77.90.31.18:4828     , piece_id=RDU7KRMNWGFYGTJ4BQSCPHA3QWGTRECYQR2YVM3ZK3JMCD4W6L4A, seg_pos={0 0}, upload=261051]: Uploading piece...
Aug 19 04:24:53.978938106 (250h58m34.710205726s) [noise=true , address=79.127.219.38:4027   , piece_id=FXAHWSHPPBHXTUHQ4TS24N5ZSLK4RB7KDEZL3LHCG4OM72HGHZXA, seg_pos={0 0}, upload=261051]: Uploading piece...
Aug 19 04:24:53.978982370 (250h58m34.71025s) [noise=true , address=45.91.116.12:4230    , piece_id=N4IK5TAFRQZRBEYGDJBUISO34LOSFWAMORUA2XQYMTG6PTMABMUQ, seg_pos={0 0}, upload=261051]: Uploading piece...
Aug 19 04:24:53.979160465 (250h58m34.710428095s) [noise=true , address=104.36.82.44:4880    , piece_id=ZZO554K2MQMXDUCJOT6PWTH7TPEV3EFCS55QPQ2M3LNROMVHO4GQ, seg_pos={0 0}, upload=261051]: Uploading piece...
Aug 19 04:24:53.979254712 (250h58m34.710522342s) [noise=true , address=77.90.31.16:4767     , piece_id=EQAEJPY7C3DOCIJEX2UJNRDTT5FGGZUQYM2LEWPQQGB4ULVVYORQ, seg_pos={0 0}, upload=261051]: Uploading piece...
Aug 19 04:24:53.979400447 (250h58m34.710668077s) [noise=true , address=79.127.219.47:4062   , piece_id=WIA3XSGVFQZJDCU3M7Q3YPVWYSOFKLKHPCIVF4NIOODKCB6EVE7Q, seg_pos={0 0}, upload=261051]: Uploading piece...
Aug 19 04:24:53.979642591 (250h58m34.710910212s) [noise=true , address=104.36.82.10:4090    , piece_id=TXWDVX64A43OQ6CLROXVAFPSBPTG6WPRLOPPNFBCDDOKZBTXY5NQ, seg_pos={0 0}, upload=261051]: Uploading piece...
Aug 19 04:24:53.979864098 (250h58m34.711131728s) [noise=true , address=77.90.31.17:4774     , piece_id=GHV4PXTYUSAELOLX6DSFDRHFJ3CY75XXENPDKXDYUAFKGKCB7EYQ, seg_pos={0 0}, upload=261051]: Uploading piece...
Aug 19 04:24:53.980130408 (250h58m34.711398038s) [noise=true , address=104.36.82.58:4296    , piece_id=RD3KQGEMDZVEBE3X4JN7LY4PJJJIYYUMLJ2V7RKG2YOKHHAX7JBA, seg_pos={0 0}, upload=261051]: Uploading piece...
Aug 19 04:24:53.980385067 (250h58m34.711652687s) [noise=true , address=104.36.82.60:4339    , piece_id=JKZZQV6HABX4HBXTVBPDCWETUNMIDQPEW2PZIV2AAFVKYRG754CA, seg_pos={0 0}, upload=261051]: Uploading piece...
Aug 19 04:24:53.980644044 (250h58m34.711911674s) [noise=true , address=104.36.82.5:4848     , piece_id=6FXVZMEN3NRJRLODXBTCVZ2FTIKGD4MP7B7BLUNEFCLUMIUTG2TA, seg_pos={0 0}, upload=261051]: Uploading piece...
Aug 19 04:24:53.980893362 (250h58m34.712160992s) [noise=true , address=45.91.116.9:4283     , piece_id=2VPNPOHR2TG2ZIEU7TE5EUQP4XPKQD4RBBIKRYSJCCZHMRLF4DXQ, seg_pos={0 0}, upload=261051]: Uploading piece...
Aug 19 04:24:53.981263599 (250h58m34.712531229s) [noise=true , address=77.90.31.19:4857     , piece_id=DDKF3I6K4MY73CYS6U37ZEOXNWAS5HWAZA2SCHACTRHIGTYSJH5Q, seg_pos={0 0}, upload=261051]: Uploading piece...
Aug 19 04:24:53.981495294 (250h58m34.712762924s) [noise=true , address=77.90.31.15:4730     , piece_id=X6YKSQWTBMJLYWWX7I6BHPJV4A3G7P7TEUHXJYO4MKLSZPNBZXKA, seg_pos={0 0}, upload=261051]: Uploading piece...
Aug 19 04:24:54.047406021 (250h58m34.778673651s) [upload=261051]: Next returned nil segment
Aug 19 04:24:54.047416250 (250h58m34.77868388s) [upload=261051]: Waiting for error group managing segments...
Aug 19 04:24:54.056766950 (250h58m34.788034571s) [noise=true , address=79.127.219.38:4027   , piece_id=FXAHWSHPPBHXTUHQ4TS24N5ZSLK4RB7KDEZL3LHCG4OM72HGHZXA, seg_pos={0 0}, upload=261051]: Done uploading piece. err: <nil>
Aug 19 04:24:54.073799913 (250h58m34.805067543s) [noise=true , address=79.127.219.47:4062   , piece_id=WIA3XSGVFQZJDCU3M7Q3YPVWYSOFKLKHPCIVF4NIOODKCB6EVE7Q, seg_pos={0 0}, upload=261051]: Done uploading piece. err: <nil>
Aug 19 04:25:48.847788931 (250h59m29.57905658s) [noise=true , address=104.36.82.44:4880    , piece_id=ZZO554K2MQMXDUCJOT6PWTH7TPEV3EFCS55QPQ2M3LNROMVHO4GQ, seg_pos={0 0}, upload=261051]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:104.36.82.44:4880): protocol: rpc: dial tcp 104.36.82.44:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:48.847849825 (250h59m29.579117476s) [noise=true , address=104.36.82.5:4848     , piece_id=6FXVZMEN3NRJRLODXBTCVZ2FTIKGD4MP7B7BLUNEFCLUMIUTG2TA, seg_pos={0 0}, upload=261051]: Done uploading piece. err: ecclient: upload failed (node:1xvod7N8eEwunLDYWAvVUP1Cp1CdEr3quJUMG5kWyBrwzzr9vp, address:104.36.82.5:4848): protocol: rpc: dial tcp 104.36.82.5:4848: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:48.848090037 (250h59m29.579357688s) [noise=true , address=77.90.31.11:4578     , piece_id=VHLMEUDCHMHVYQL4GBXNGR54J5XL4YACNUYYWQCPADCRZRNGFLHQ, seg_pos={0 0}, upload=261051]: Done uploading piece. err: ecclient: upload failed (node:1m4M9WpEgS8BgLgQ2kwqzb6szQ2k4KMS3pv6DRQsEPS2ujPyLM, address:77.90.31.11:4578): protocol: rpc: dial tcp 77.90.31.11:4578: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:48.848162523 (250h59m29.579430174s) [noise=true , address=104.36.82.10:4090    , piece_id=TXWDVX64A43OQ6CLROXVAFPSBPTG6WPRLOPPNFBCDDOKZBTXY5NQ, seg_pos={0 0}, upload=261051]: Done uploading piece. err: ecclient: upload failed (node:12qSkJk9HUyQon3UP1AA8mRcqJbNdkKJh6cEUZoHLGNniqDvNqB, address:104.36.82.10:4090): protocol: rpc: dial tcp 104.36.82.10:4090: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:48.848225191 (250h59m29.579492851s) [noise=true , address=45.91.116.4:4945     , piece_id=SOLUIBWMTPAQINU4YDFDW65QBT2KOCNBR6MPVHOJKN4VDQW47M5A, seg_pos={0 0}, upload=261051]: Done uploading piece. err: ecclient: upload failed (node:122jQwynUC2VXPahPrWNSKvLvRpHwYYtW2uQ6Fa8saDLJBPxsB5, address:45.91.116.4:4945): protocol: rpc: dial tcp 45.91.116.4:4945: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:48.848262071 (250h59m29.579529721s) [noise=true , address=77.90.31.18:4828     , piece_id=RDU7KRMNWGFYGTJ4BQSCPHA3QWGTRECYQR2YVM3ZK3JMCD4W6L4A, seg_pos={0 0}, upload=261051]: Done uploading piece. err: ecclient: upload failed (node:1jwTDXPShXfNdfMx3UXi22gQphBpFre1MhRsHyjq6xRz4wwTr9, address:77.90.31.18:4828): protocol: rpc: dial tcp 77.90.31.18:4828: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:48.848278592 (250h59m29.579546242s) [noise=true , address=104.36.82.13:4218    , piece_id=52F6OUMOLSCXLJ6AMYOU65KMMRFYRNLQLLWJ6H6TK27ZHM4Q6C6Q, seg_pos={0 0}, upload=261051]: Done uploading piece. err: ecclient: upload failed (node:12mbzxg1BjmbXeHxGgheZmQoN91k8NgaAUUASPkJe3fEmS4eEkc, address:104.36.82.13:4218): protocol: rpc: dial tcp 104.36.82.13:4218: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:48.848328816 (250h59m29.579596466s) [noise=true , address=77.90.31.10:4547     , piece_id=BRKIPW57YB5M4AHLUWCWAR5UQXNOFC43YIGUCCO3ALDWFOZCNWWA, seg_pos={0 0}, upload=261051]: Done uploading piece. err: ecclient: upload failed (node:12hkdk6W2VmYLGra1GpBVJjkypiydor2f1LDjjGL2Kkb6fJqENZ, address:77.90.31.10:4547): protocol: rpc: dial tcp 77.90.31.10:4547: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:48.848353383 (250h59m29.579621032s) [noise=true , address=45.91.116.9:4283     , piece_id=2VPNPOHR2TG2ZIEU7TE5EUQP4XPKQD4RBBIKRYSJCCZHMRLF4DXQ, seg_pos={0 0}, upload=261051]: Done uploading piece. err: ecclient: upload failed (node:1bquxzprFQQwaeW4KbSR5i8CBP6XCcHAWPmAmoszcsLUWKKT5g, address:45.91.116.9:4283): protocol: rpc: dial tcp 45.91.116.9:4283: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:48.848412723 (250h59m29.579680374s) [noise=true , address=45.91.116.12:4230    , piece_id=N4IK5TAFRQZRBEYGDJBUISO34LOSFWAMORUA2XQYMTG6PTMABMUQ, seg_pos={0 0}, upload=261051]: Done uploading piece. err: ecclient: upload failed (node:127RqMv3h2jS5V4nVqPmi3BDwT9gdJBC93EvyA8VXf5w77yiAQP, address:45.91.116.12:4230): protocol: rpc: dial tcp 45.91.116.12:4230: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:48.848472917 (250h59m29.579740568s) [noise=true , address=77.90.31.15:4730     , piece_id=X6YKSQWTBMJLYWWX7I6BHPJV4A3G7P7TEUHXJYO4MKLSZPNBZXKA, seg_pos={0 0}, upload=261051]: Done uploading piece. err: ecclient: upload failed (node:1zF1SqsUdx5ikfqnG4SfeFukn8ZgX56sC7DGEPtPxZqEicws6o, address:77.90.31.15:4730): protocol: rpc: dial tcp 77.90.31.15:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:48.848503214 (250h59m29.579770864s) [noise=true , address=77.90.31.17:4774     , piece_id=GHV4PXTYUSAELOLX6DSFDRHFJ3CY75XXENPDKXDYUAFKGKCB7EYQ, seg_pos={0 0}, upload=261051]: Done uploading piece. err: ecclient: upload failed (node:12mZTv2q5zT1Za4DTcdFbUwWs1897vv9GXuLqPcnY3FaxTdGv3Y, address:77.90.31.17:4774): protocol: rpc: dial tcp 77.90.31.17:4774: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:48.848557916 (250h59m29.579825567s) [noise=true , address=104.36.82.60:4339    , piece_id=JKZZQV6HABX4HBXTVBPDCWETUNMIDQPEW2PZIV2AAFVKYRG754CA, seg_pos={0 0}, upload=261051]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:104.36.82.60:4339): protocol: rpc: dial tcp 104.36.82.60:4339: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:48.848595648 (250h59m29.579863297s) [noise=true , address=77.90.31.16:4767     , piece_id=EQAEJPY7C3DOCIJEX2UJNRDTT5FGGZUQYM2LEWPQQGB4ULVVYORQ, seg_pos={0 0}, upload=261051]: Done uploading piece. err: ecclient: upload failed (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK, address:77.90.31.16:4767): protocol: rpc: dial tcp 77.90.31.16:4767: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:48.848615936 (250h59m29.579883586s) [noise=true , address=104.36.82.58:4296    , piece_id=RD3KQGEMDZVEBE3X4JN7LY4PJJJIYYUMLJ2V7RKG2YOKHHAX7JBA, seg_pos={0 0}, upload=261051]: Done uploading piece. err: ecclient: upload failed (node:12nctdBBFSDaAV2c5PUbZW64K3v9CH3a49NSfTh6dta4DVxtqXA, address:104.36.82.58:4296): protocol: rpc: dial tcp 104.36.82.58:4296: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:48.848639750 (250h59m29.57990741s) [noise=true , address=77.90.31.19:4857     , piece_id=DDKF3I6K4MY73CYS6U37ZEOXNWAS5HWAZA2SCHACTRHIGTYSJH5Q, seg_pos={0 0}, upload=261051]: Done uploading piece. err: ecclient: upload failed (node:12i57FF97oEddYLZpNxSq5or9WLEquL8ZW1cVUuW4AThBbDqcCL, address:77.90.31.19:4857): protocol: write tcp 5.161.89.252:16746->77.90.31.19:4857: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:48.848675518 (250h59m29.579943168s) [seg_pos={0 0}, upload=261051]: Done waiting for segment. successful: 2 optimal: 14 errs: <nil>
Aug 19 04:25:48.870630746 (250h59m29.601898395s) [upload=261051]: Done uploading segments...
Aug 19 04:25:48.870663728 (250h59m29.601931377s) [upload=261051]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 2)
Duration: 1m0.02537637s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [..........................................................XX]
duration:
30.023646776s
FAIL (2025-08-19 04:25:45 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0)
======LOGS======
GM5VYXQ, seg_pos={0 0}, upload=261067]: Uploading piece...
Aug 19 04:25:15.800022611 (250h58m56.531290261s) [noise=true , address=77.90.31.10:4520     , piece_id=S63BULPS7O42QYQBQ3YHY2PZ2OJXFXZTT4PWILIN7BAAK7D25ZKA, seg_pos={0 0}, upload=261067]: Uploading piece...
Aug 19 04:25:15.800367620 (250h58m56.53163526s) [noise=true , address=45.91.116.11:4119    , piece_id=VEQHUC47POR3Q3Z6KLVYPVDQP43W64JJUUOHSLJBKQWD2WMWMWSQ, seg_pos={0 0}, upload=261067]: Uploading piece...
Aug 19 04:25:15.800771048 (250h58m56.532038699s) [noise=true , address=45.91.116.13:4155    , piece_id=BK7TOGG2YUBRAZP3ZIHQ37EUFKHQK7N55R5AQ3AHPCAC35SZTEWA, seg_pos={0 0}, upload=261067]: Uploading piece...
Aug 19 04:25:15.800828656 (250h58m56.532096296s) [noise=true , address=104.36.82.12:4151    , piece_id=AHK2TRL4XXDUMWXC6KUMLT776LCGIGSBQEU6UG4S2JOGDZHDGSEQ, seg_pos={0 0}, upload=261067]: Uploading piece...
Aug 19 04:25:15.801307557 (250h58m56.532575197s) [noise=true , address=104.36.82.16:4294    , piece_id=XV52N6BCGZRB3TS7WOZFTQBOCBX5257J3ZBYBRTC5CBGZBRAWSGQ, seg_pos={0 0}, upload=261067]: Uploading piece...
Aug 19 04:25:15.801698883 (250h58m56.532966532s) [noise=true , address=45.91.116.10:4083    , piece_id=7SGIPNHB3C4OVTCVJT3ME4OAMNDSN2RQMHDBYDTYDOK7D3PNUL5A, seg_pos={0 0}, upload=261067]: Uploading piece...
Aug 19 04:25:15.801767752 (250h58m56.533035391s) [noise=true , address=45.91.116.10:4082    , piece_id=ZMS6HJ2MUQQOHZGKBHBYLHCIGQ346253ALVUVSATLOA4DVDZWCXA, seg_pos={0 0}, upload=261067]: Uploading piece...
Aug 19 04:25:15.802275556 (250h58m56.533543206s) [noise=true , address=45.91.116.13:4154    , piece_id=XLTO6NBX2ARX3XUJ56X4LUJY4CP3JSKG3KRTNCGTW3CCO5BXP5AQ, seg_pos={0 0}, upload=261067]: Uploading piece...
Aug 19 04:25:15.804734840 (250h58m56.536002489s) [noise=true , address=45.91.116.8:4047     , piece_id=4ASK3XCLBQFA2E775J3MNMF3ZKFP52X3WKEW4T6DWAGUJ76GCATA, seg_pos={0 0}, upload=261067]: Uploading piece...
Aug 19 04:25:15.805341470 (250h58m56.53660911s) [noise=true , address=45.91.116.6:4975     , piece_id=VXZP3LB6725RAYC5CO2H3KOQVCJ3SY6KQGQQVTC3J5BK7EKV43DQ, seg_pos={0 0}, upload=261067]: Uploading piece...
Aug 19 04:25:15.805896033 (250h58m56.537163684s) [noise=true , address=45.91.116.9:4261     , piece_id=KYUUFNRM56ZI36YZPNA57YO37AA44UGD5N3XXE6OSOXKJ47RXC4Q, seg_pos={0 0}, upload=261067]: Uploading piece...
Aug 19 04:25:15.809734519 (250h58m56.541002169s) [noise=true , address=77.90.31.14:4662     , piece_id=OVFNJNJYPLABQOFGH5ZVVEAQFGBXW7NUKZ6KCU7XWM6YL3ZKOINA, seg_pos={0 0}, upload=261067]: Uploading piece...
Aug 19 04:25:45.745077147 (250h59m26.476344777s) [upload=261067]: Next segment err: context deadline exceeded
Aug 19 04:25:45.745721318 (250h59m26.476988948s) [noise=true , address=45.91.116.4:4937     , piece_id=CB6H4UDFP6GIUCXQWKB2YNA2CHJHP2DKPWUIEIOMOILS6ZESIO4A, seg_pos={0 0}, upload=261067]: Done uploading piece. err: ecclient: upload failed (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq, address:45.91.116.4:4937): protocol: rpc: dial tcp 45.91.116.4:4937: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:45.745736747 (250h59m26.477004367s) [noise=true , address=45.91.116.8:4047     , piece_id=4ASK3XCLBQFA2E775J3MNMF3ZKFP52X3WKEW4T6DWAGUJ76GCATA, seg_pos={0 0}, upload=261067]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:45.745759971 (250h59m26.47702759s) [noise=true , address=77.90.31.12:4589     , piece_id=DALZY7CNJVYSVGPHP42G2ZZKPDERSREEKNA4IJCL2KZSNGM5VYXQ, seg_pos={0 0}, upload=261067]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: rpc: dial tcp 77.90.31.12:4589: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:45.745771963 (250h59m26.477039593s) [noise=true , address=45.91.116.6:4975     , piece_id=VXZP3LB6725RAYC5CO2H3KOQVCJ3SY6KQGQQVTC3J5BK7EKV43DQ, seg_pos={0 0}, upload=261067]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: rpc: dial tcp 45.91.116.6:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:45.745792772 (250h59m26.477060392s) [noise=true , address=45.91.116.11:4119    , piece_id=VEQHUC47POR3Q3Z6KLVYPVDQP43W64JJUUOHSLJBKQWD2WMWMWSQ, seg_pos={0 0}, upload=261067]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: rpc: dial tcp 45.91.116.11:4119: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:45.745800266 (250h59m26.477067896s) [noise=true , address=77.90.31.14:4662     , piece_id=OVFNJNJYPLABQOFGH5ZVVEAQFGBXW7NUKZ6KCU7XWM6YL3ZKOINA, seg_pos={0 0}, upload=261067]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:45.745822248 (250h59m26.477089879s) [noise=true , address=104.36.82.16:4294    , piece_id=XV52N6BCGZRB3TS7WOZFTQBOCBX5257J3ZBYBRTC5CBGZBRAWSGQ, seg_pos={0 0}, upload=261067]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:104.36.82.16:4294): protocol: rpc: dial tcp 104.36.82.16:4294: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:45.745828880 (250h59m26.477096501s) [noise=true , address=45.91.116.12:4227    , piece_id=5GSZD752SJKPSIZNCODBXGDEAB24NBYUL223LJWZX7444MXMBTJA, seg_pos={0 0}, upload=261067]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:4227): protocol: rpc: dial tcp 45.91.116.12:4227: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:45.745850822 (250h59m26.477118452s) [noise=true , address=45.91.116.10:4083    , piece_id=7SGIPNHB3C4OVTCVJT3ME4OAMNDSN2RQMHDBYDTYDOK7D3PNUL5A, seg_pos={0 0}, upload=261067]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: rpc: dial tcp 45.91.116.10:4083: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:45.745857484 (250h59m26.477125114s) [noise=true , address=104.36.82.12:4151    , piece_id=AHK2TRL4XXDUMWXC6KUMLT776LCGIGSBQEU6UG4S2JOGDZHDGSEQ, seg_pos={0 0}, upload=261067]: Done uploading piece. err: ecclient: upload failed (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB, address:104.36.82.12:4151): protocol: rpc: dial tcp 104.36.82.12:4151: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:45.745884335 (250h59m26.477151955s) [noise=true , address=45.91.116.13:4154    , piece_id=XLTO6NBX2ARX3XUJ56X4LUJY4CP3JSKG3KRTNCGTW3CCO5BXP5AQ, seg_pos={0 0}, upload=261067]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: rpc: dial tcp 45.91.116.13:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:45.745909342 (250h59m26.477176962s) [noise=true , address=104.36.82.11:4113    , piece_id=NCLAHULYKIWQLRU7TDIJMJIW3T2JJ6Z2ZM2E6IK2LLYPTFS452MQ, seg_pos={0 0}, upload=261067]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:104.36.82.11:4113): protocol: rpc: dial tcp 104.36.82.11:4113: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:45.745913630 (250h59m26.47718126s) [noise=true , address=77.90.31.10:4520     , piece_id=S63BULPS7O42QYQBQ3YHY2PZ2OJXFXZTT4PWILIN7BAAK7D25ZKA, seg_pos={0 0}, upload=261067]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: rpc: dial tcp 77.90.31.10:4520: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:45.745957011 (250h59m26.477224641s) [noise=true , address=45.91.116.13:4155    , piece_id=BK7TOGG2YUBRAZP3ZIHQ37EUFKHQK7N55R5AQ3AHPCAC35SZTEWA, seg_pos={0 0}, upload=261067]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:33646->45.91.116.13:4155: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:45.745964585 (250h59m26.477232215s) [noise=true , address=45.91.116.9:4261     , piece_id=KYUUFNRM56ZI36YZPNA57YO37AA44UGD5N3XXE6OSOXKJ47RXC4Q, seg_pos={0 0}, upload=261067]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:22920->45.91.116.9:4261: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:45.745969014 (250h59m26.477236634s) [noise=true , address=45.91.116.10:4082    , piece_id=ZMS6HJ2MUQQOHZGKBHBYLHCIGQ346253ALVUVSATLOA4DVDZWCXA, seg_pos={0 0}, upload=261067]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: write tcp 5.161.89.252:26678->45.91.116.10:4082: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:45.745988500 (250h59m26.47725613s) [seg_pos={0 0}, upload=261067]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil>
Duration: 30.023665831s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.]
duration:
182.973673ms
FAIL (2025-08-19 04:25:37 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:26171->127.0.0.1:53: i/o timeout
Duration: 183.001736ms edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.]
duration:
1.11089517s
FAIL (2025-08-19 04:25:31 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:34390->127.0.0.1:53: i/o timeout
Duration: 1.110912883s edge authservice http bgp ap1
checkers.HTTP{"GET" "https://static.storj.io/dcs-satellites", ExpectedContent: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S"} failure (antiblip window 6/15): (http.dcs_satellites)
antiblip:
1 out of 15 is failed (threshold=6) [.............X.]
duration:
47.622343ms
target:
https://static.storj.io/dcs-satellites
FAIL (2025-08-19 04:25:24 UTC)
orbiter warning: Get "https://static.storj.io/dcs-satellites": dial tcp 34.120.119.150:443: i/o timeout
Duration: 47.644623ms core website
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.]
duration:
132.959084ms
FAIL (2025-08-19 04:25:23 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:26171->127.0.0.1:53: i/o timeout
Duration: 132.984641ms edge authservice http us-select-1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.]
duration:
613.386991ms
FAIL (2025-08-19 04:25:23 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:34390->127.0.0.1:53: i/o timeout
Duration: 613.418049ms edge authservice http bgp eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.]
duration:
1.640442716s
FAIL (2025-08-19 04:25:19 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:34390->127.0.0.1:53: i/o timeout
Duration: 1.640630228s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.]
duration:
123.431851ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
FAIL (2025-08-19 04:25:18 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41477->127.0.0.1:53: i/o timeout
Duration: 123.448652ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.]
duration:
5.023291246s
FAIL (2025-08-19 04:25:11 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 5.023312305s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X]
duration:
30.023583949s
FAIL (2025-08-19 04:25:10 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0)
======LOGS======
LZNMTUBHXFG6AUA, seg_pos={0 0}, upload=261054]: Uploading piece...
Aug 19 04:24:56.056383198 (250h58m36.787650848s) [noise=true , address=104.36.82.13:4185    , piece_id=W5UAUTTQWOG44767HMXZOQO2JSSXXWDREZHDX7IQLHEUQWBYHABQ, seg_pos={0 0}, upload=261054]: Uploading piece...
Aug 19 04:24:56.056506099 (250h58m36.787773749s) [noise=true , address=104.36.82.14:4222    , piece_id=EBJTX5P4MYSXIKSFNJMLH2JPLH6JFTXXWIV6JRJ2YCP4KESRNYLQ, seg_pos={0 0}, upload=261054]: Uploading piece...
Aug 19 04:24:56.056895460 (250h58m36.788163111s) [noise=true , address=77.90.31.18:4807     , piece_id=34RH2FHVIXL2CX6KJQANLLSWLG3RWISHA5LH2L3S65ISETBLPDQA, seg_pos={0 0}, upload=261054]: Uploading piece...
Aug 19 04:24:56.057092000 (250h58m36.78835965s) [noise=true , address=45.91.116.4:4939     , piece_id=T77HS4TC3WTN7376T4DIBVG3EXLD7XFIP56TM2ZN2NKSWGNSPVWQ, seg_pos={0 0}, upload=261054]: Uploading piece...
Aug 19 04:24:56.057440115 (250h58m36.788707765s) [noise=true , address=45.91.116.12:4226    , piece_id=RM43ZVUH7NB7C2Y3ECYPMBHJNLRNFTYOFWBCWDUQ6X5M35T2QPOA, seg_pos={0 0}, upload=261054]: Uploading piece...
Aug 19 04:24:56.057695666 (250h58m36.788963315s) [noise=true , address=45.91.116.7:4010     , piece_id=GUONYQAY6UFAQKUOSWOAMAIVQGXWA7FQGTRPMIPELYGLPDAPXSJA, seg_pos={0 0}, upload=261054]: Uploading piece...
Aug 19 04:24:56.057882847 (250h58m36.789150497s) [noise=true , address=45.91.116.8:4045     , piece_id=GWENQQSSTIWKFJEUKBVJEIDSA3KGNQD5FK47IGFUDOASHPYNVVSQ, seg_pos={0 0}, upload=261054]: Uploading piece...
Aug 19 04:24:56.058230231 (250h58m36.789497881s) [noise=true , address=104.36.82.3:4765     , piece_id=DXL3R3UWMNBW63SPUBP4FXFL4ZGG42N2PMHCQMUJYJLTCWMBJUKA, seg_pos={0 0}, upload=261054]: Uploading piece...
Aug 19 04:24:56.058433613 (250h58m36.789701262s) [noise=true , address=77.90.31.17:4771     , piece_id=BNFAMGFWVV5M3EA5BDJX5T77FIFOA66YWXN6R7KXOEQYZWQOYRAA, seg_pos={0 0}, upload=261054]: Uploading piece...
Aug 19 04:24:56.058718879 (250h58m36.789986529s) [noise=true , address=77.90.31.15:4699     , piece_id=T25T57TWMX3LG2BV62V7CXTKEOXV67NLUDXW5ABWGWPYIMRP5OLA, seg_pos={0 0}, upload=261054]: Uploading piece...
Aug 19 04:24:56.058879270 (250h58m36.79014692s) [noise=true , address=77.90.31.10:4520     , piece_id=6H3PGWC5AHBB5S5OPLOGZJTGJNZZJQK6IXZS6VHITNP3GHD6S52A, seg_pos={0 0}, upload=261054]: Uploading piece...
Aug 19 04:24:56.059260797 (250h58m36.790528448s) [noise=true , address=77.90.31.19:4843     , piece_id=DNPXPL5VXBUXWFMKV2IA6IZM5T4CHKTUCTD4O7RUZT27GRQZNGCQ, seg_pos={0 0}, upload=261054]: Uploading piece...
Aug 19 04:25:10.544576754 (250h58m51.275844395s) [upload=261054]: Next segment err: context deadline exceeded
Aug 19 04:25:10.545618694 (250h58m51.276886324s) [noise=true , address=77.90.31.14:4663     , piece_id=2WSGSN2Z46J6YKC6UWWMQFL5U7YWNZ4ZK376TJGYNL6GGWYNZNWQ, seg_pos={0 0}, upload=261054]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: rpc: dial tcp 77.90.31.14:4663: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:10.545657086 (250h58m51.276924716s) [noise=true , address=104.36.82.3:4765     , piece_id=DXL3R3UWMNBW63SPUBP4FXFL4ZGG42N2PMHCQMUJYJLTCWMBJUKA, seg_pos={0 0}, upload=261054]: Done uploading piece. err: ecclient: upload failed (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV, address:104.36.82.3:4765): protocol: rpc: dial tcp 104.36.82.3:4765: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:10.545690007 (250h58m51.276957648s) [noise=true , address=104.36.82.13:4185    , piece_id=W5UAUTTQWOG44767HMXZOQO2JSSXXWDREZHDX7IQLHEUQWBYHABQ, seg_pos={0 0}, upload=261054]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:104.36.82.13:4185): protocol: rpc: dial tcp 104.36.82.13:4185: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:10.545704084 (250h58m51.276971724s) [noise=true , address=77.90.31.17:4771     , piece_id=BNFAMGFWVV5M3EA5BDJX5T77FIFOA66YWXN6R7KXOEQYZWQOYRAA, seg_pos={0 0}, upload=261054]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: rpc: dial tcp 77.90.31.17:4771: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:10.545743578 (250h58m51.277011218s) [noise=true , address=77.90.31.15:4699     , piece_id=T25T57TWMX3LG2BV62V7CXTKEOXV67NLUDXW5ABWGWPYIMRP5OLA, seg_pos={0 0}, upload=261054]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: rpc: dial tcp 77.90.31.15:4699: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:10.545748047 (250h58m51.277015687s) [noise=true , address=77.90.31.18:4807     , piece_id=34RH2FHVIXL2CX6KJQANLLSWLG3RWISHA5LH2L3S65ISETBLPDQA, seg_pos={0 0}, upload=261054]: Done uploading piece. err: ecclient: upload failed (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS, address:77.90.31.18:4807): protocol: rpc: dial tcp 77.90.31.18:4807: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:10.545782491 (250h58m51.277050121s) [noise=true , address=77.90.31.21:4877     , piece_id=2DMHLFVVDFX67E6GKVN2U7BE5IZO6VWZ3TEJRJCZZ4KHPCGHHYBA, seg_pos={0 0}, upload=261054]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: rpc: dial tcp 77.90.31.21:4877: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:10.545806396 (250h58m51.277074026s) [noise=true , address=45.91.116.7:4010     , piece_id=GUONYQAY6UFAQKUOSWOAMAIVQGXWA7FQGTRPMIPELYGLPDAPXSJA, seg_pos={0 0}, upload=261054]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:10.545823238 (250h58m51.277090878s) [noise=true , address=104.36.82.14:4222    , piece_id=EBJTX5P4MYSXIKSFNJMLH2JPLH6JFTXXWIV6JRJ2YCP4KESRNYLQ, seg_pos={0 0}, upload=261054]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:104.36.82.14:4222): protocol: rpc: dial tcp 104.36.82.14:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:10.545873252 (250h58m51.277140892s) [noise=true , address=45.91.116.4:4939     , piece_id=T77HS4TC3WTN7376T4DIBVG3EXLD7XFIP56TM2ZN2NKSWGNSPVWQ, seg_pos={0 0}, upload=261054]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: rpc: dial tcp 45.91.116.4:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:10.545885535 (250h58m51.277153165s) [noise=true , address=77.90.31.19:4843     , piece_id=DNPXPL5VXBUXWFMKV2IA6IZM5T4CHKTUCTD4O7RUZT27GRQZNGCQ, seg_pos={0 0}, upload=261054]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: rpc: dial tcp 77.90.31.19:4843: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:10.545956408 (250h58m51.277224048s) [noise=true , address=45.91.116.5:4298     , piece_id=SVD2SQSRLQ5Q37DMHP6MJO5DVWRSVKS2QEIGFST6SVCQFB6WU4JA, seg_pos={0 0}, upload=261054]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: rpc: dial tcp 45.91.116.5:4298: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:10.545961989 (250h58m51.277229628s) [noise=true , address=45.91.116.8:4045     , piece_id=GWENQQSSTIWKFJEUKBVJEIDSA3KGNQD5FK47IGFUDOASHPYNVVSQ, seg_pos={0 0}, upload=261054]: Done uploading piece. err: ecclient: upload failed (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9, address:45.91.116.8:4045): protocol: write tcp 5.161.89.252:13586->45.91.116.8:4045: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:10.545993398 (250h58m51.277261028s) [noise=true , address=104.36.82.9:4006     , piece_id=BXZDCQ3CAWE6IPL4UM4GRHK4KYK5PMTF6O4DILZNMTUBHXFG6AUA, seg_pos={0 0}, upload=261054]: Done uploading piece. err: ecclient: upload failed (node:1ig3zGgKZUH8jwXEojp2A6tYGVFCL33PUDkhAbEjS6affBLtmc, address:104.36.82.9:4006): protocol: rpc: dial tcp 104.36.82.9:4006: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:10.546019086 (250h58m51.277286726s) [noise=true , address=77.90.31.10:4520     , piece_id=6H3PGWC5AHBB5S5OPLOGZJTGJNZZJQK6IXZS6VHITNP3GHD6S52A, seg_pos={0 0}, upload=261054]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 5.161.89.252:35530->77.90.31.10:4520: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:10.546033173 (250h58m51.277300814s) [noise=true , address=45.91.116.12:4226    , piece_id=RM43ZVUH7NB7C2Y3ECYPMBHJNLRNFTYOFWBCWDUQ6X5M35T2QPOA, seg_pos={0 0}, upload=261054]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 5.161.89.252:11600->45.91.116.12:4226: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 04:25:10.546062328 (250h58m51.277329958s) [seg_pos={0 0}, upload=261054]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil>
Duration: 30.023604257s core uplink us-select-1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.]
duration:
688.572123ms
target:
https://ap1.storj.io/login
FAIL (2025-08-19 04:25:06 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 35.213.185.92:443: i/o timeout
Duration: 688.588243ms core satellite ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.]
duration:
981.063589ms
FAIL (2025-08-19 04:25:00 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 981.082653ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X]
duration:
30.000903973s
FAIL (2025-08-19 04:24:59 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 30.00092414s core uplink eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.]
duration:
202.117183ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-08-19 04:24:58 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41477->127.0.0.1:53: i/o timeout
Duration: 202.138904ms edge gateway vhost bgp eu1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X]
duration:
30.001364901s
FAIL (2025-08-19 04:24:57 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 30.001382513s core uplink ap1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X]
duration:
30.001353174s
target:
https://ap1.storj.io/login
FAIL (2025-08-19 04:24:57 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 35.213.185.92:443: i/o timeout
Duration: 30.001391355s core satellite ap1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.]
duration:
427.677039ms
FAIL (2025-08-19 04:24:56 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:26171->127.0.0.1:53: i/o timeout
Duration: 427.695124ms edge gateway us-select-1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X]
duration:
10.000725907s
target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt
FAIL (2025-08-19 04:24:50 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp: lookup link.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:34965->127.0.0.1:53: i/o timeout
Duration: 10.000747167s edge linksharing us-select-1
checkers.HTTP{"GET" "https://static.storj.io/dcs-satellites", ExpectedContent: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S"} failure (antiblip window 6/15): (http.dcs_satellites)
antiblip:
1 out of 15 is failed (threshold=6) [..............X]
duration:
30.000433105s
target:
https://static.storj.io/dcs-satellites
FAIL (2025-08-19 04:24:46 UTC)
orbiter warning: Get "https://static.storj.io/dcs-satellites": dial tcp 34.120.119.150:443: i/o timeout
Duration: 30.000481695s core website
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X]
duration:
10.001915557s
FAIL (2025-08-19 04:24:32 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:26171->127.0.0.1:53: i/o timeout
Duration: 10.001939281s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X]
duration:
4.199939677s
FAIL (2025-08-19 04:24:32 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:26171->127.0.0.1:53: i/o timeout
Duration: 4.199964263s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X]
duration:
5.521589042s
FAIL (2025-08-19 04:24:32 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:26171->127.0.0.1:53: i/o timeout
Duration: 5.521865961s edge authservice http us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X]
duration:
5.940707363s
FAIL (2025-08-19 04:24:28 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:34390->127.0.0.1:53: i/o timeout
Duration: 5.940733361s core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X]
duration:
6.026752933s
FAIL (2025-08-19 04:24:28 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:34390->127.0.0.1:53: i/o timeout
Duration: 6.026768391s edge authservice http bgp eu1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X]
duration:
10.002633341s
FAIL (2025-08-19 04:24:28 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:34390->127.0.0.1:53: i/o timeout
Duration: 10.002649031s edge authservice http bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X]
duration:
10.001052082s
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
FAIL (2025-08-19 04:24:26 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41477->127.0.0.1:53: i/o timeout
Duration: 10.001088131s edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X]
duration:
7.904721135s
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-08-19 04:24:26 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41477->127.0.0.1:53: i/o timeout
Duration: 7.904749047s edge gateway vhost bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................]
duration:
141.088674ms
FAIL (2025-08-19 04:01:47 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 19 03:15:34.515421087 (249h49m15.246688748s) [upload=259864]: Starting upload
Aug 19 03:15:34.515492252 (249h49m15.246759902s) [upload=259864]: Done starting upload
Aug 19 03:15:34.515570098 (249h49m15.246837748s) [upload=259864]: Uploading segments...
Aug 19 03:15:34.515658344 (249h49m15.246925995s) [upload=259864]: Got next segment. Inline: true
Aug 19 03:15:34.515665928 (249h49m15.246933588s) [upload=259864]: Waiting for error group managing segments...
Aug 19 03:15:34.515718817 (249h49m15.246986468s) [upload=259864]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 03:15:34.515725010 (249h49m15.246992659s) [upload=259864]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 03:15:34.515728616 (249h49m15.246996276s) [upload=259864]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 03:15:34.518598415 (249h49m15.249866064s) [upload=259864]: Done uploading segments...
Aug 19 03:15:34.518611108 (249h49m15.249878758s) [upload=259864]: Upload finished. err: metaclient: Too Many Requests
Duration: 141.139348ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [XX..........................................................]
duration:
227.700464ms
FAIL (2025-08-19 04:00:41 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 19 03:15:34.515421087 (249h49m15.246688748s) [upload=259864]: Starting upload
Aug 19 03:15:34.515492252 (249h49m15.246759902s) [upload=259864]: Done starting upload
Aug 19 03:15:34.515570098 (249h49m15.246837748s) [upload=259864]: Uploading segments...
Aug 19 03:15:34.515658344 (249h49m15.246925995s) [upload=259864]: Got next segment. Inline: true
Aug 19 03:15:34.515665928 (249h49m15.246933588s) [upload=259864]: Waiting for error group managing segments...
Aug 19 03:15:34.515718817 (249h49m15.246986468s) [upload=259864]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 03:15:34.515725010 (249h49m15.246992659s) [upload=259864]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 03:15:34.515728616 (249h49m15.246996276s) [upload=259864]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 03:15:34.518598415 (249h49m15.249866064s) [upload=259864]: Done uploading segments...
Aug 19 03:15:34.518611108 (249h49m15.249878758s) [upload=259864]: Upload finished. err: metaclient: Too Many Requests
Duration: 227.71984ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [.XX.........................................................]
duration:
415.924902ms
FAIL (2025-08-19 04:00:02 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 19 03:15:34.515421087 (249h49m15.246688748s) [upload=259864]: Starting upload
Aug 19 03:15:34.515492252 (249h49m15.246759902s) [upload=259864]: Done starting upload
Aug 19 03:15:34.515570098 (249h49m15.246837748s) [upload=259864]: Uploading segments...
Aug 19 03:15:34.515658344 (249h49m15.246925995s) [upload=259864]: Got next segment. Inline: true
Aug 19 03:15:34.515665928 (249h49m15.246933588s) [upload=259864]: Waiting for error group managing segments...
Aug 19 03:15:34.515718817 (249h49m15.246986468s) [upload=259864]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 03:15:34.515725010 (249h49m15.246992659s) [upload=259864]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 03:15:34.515728616 (249h49m15.246996276s) [upload=259864]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 03:15:34.518598415 (249h49m15.249866064s) [upload=259864]: Done uploading segments...
Aug 19 03:15:34.518611108 (249h49m15.249878758s) [upload=259864]: Upload finished. err: metaclient: Too Many Requests
Duration: 415.957603ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [..XX........................................................]
duration:
130.529332ms
FAIL (2025-08-19 03:58:59 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 19 03:15:34.515421087 (249h49m15.246688748s) [upload=259864]: Starting upload
Aug 19 03:15:34.515492252 (249h49m15.246759902s) [upload=259864]: Done starting upload
Aug 19 03:15:34.515570098 (249h49m15.246837748s) [upload=259864]: Uploading segments...
Aug 19 03:15:34.515658344 (249h49m15.246925995s) [upload=259864]: Got next segment. Inline: true
Aug 19 03:15:34.515665928 (249h49m15.246933588s) [upload=259864]: Waiting for error group managing segments...
Aug 19 03:15:34.515718817 (249h49m15.246986468s) [upload=259864]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 03:15:34.515725010 (249h49m15.246992659s) [upload=259864]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 03:15:34.515728616 (249h49m15.246996276s) [upload=259864]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 03:15:34.518598415 (249h49m15.249866064s) [upload=259864]: Done uploading segments...
Aug 19 03:15:34.518611108 (249h49m15.249878758s) [upload=259864]: Upload finished. err: metaclient: Too Many Requests
Duration: 130.550683ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [...XX.......................................................]
duration:
156.733816ms
FAIL (2025-08-19 03:58:19 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 19 03:15:34.515421087 (249h49m15.246688748s) [upload=259864]: Starting upload
Aug 19 03:15:34.515492252 (249h49m15.246759902s) [upload=259864]: Done starting upload
Aug 19 03:15:34.515570098 (249h49m15.246837748s) [upload=259864]: Uploading segments...
Aug 19 03:15:34.515658344 (249h49m15.246925995s) [upload=259864]: Got next segment. Inline: true
Aug 19 03:15:34.515665928 (249h49m15.246933588s) [upload=259864]: Waiting for error group managing segments...
Aug 19 03:15:34.515718817 (249h49m15.246986468s) [upload=259864]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 03:15:34.515725010 (249h49m15.246992659s) [upload=259864]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 03:15:34.515728616 (249h49m15.246996276s) [upload=259864]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 03:15:34.518598415 (249h49m15.249866064s) [upload=259864]: Done uploading segments...
Aug 19 03:15:34.518611108 (249h49m15.249878758s) [upload=259864]: Upload finished. err: metaclient: Too Many Requests
Duration: 156.748324ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [....XX......................................................]
duration:
136.281327ms
FAIL (2025-08-19 03:57:17 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 19 03:15:34.515421087 (249h49m15.246688748s) [upload=259864]: Starting upload
Aug 19 03:15:34.515492252 (249h49m15.246759902s) [upload=259864]: Done starting upload
Aug 19 03:15:34.515570098 (249h49m15.246837748s) [upload=259864]: Uploading segments...
Aug 19 03:15:34.515658344 (249h49m15.246925995s) [upload=259864]: Got next segment. Inline: true
Aug 19 03:15:34.515665928 (249h49m15.246933588s) [upload=259864]: Waiting for error group managing segments...
Aug 19 03:15:34.515718817 (249h49m15.246986468s) [upload=259864]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 03:15:34.515725010 (249h49m15.246992659s) [upload=259864]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 03:15:34.515728616 (249h49m15.246996276s) [upload=259864]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 03:15:34.518598415 (249h49m15.249866064s) [upload=259864]: Done uploading segments...
Aug 19 03:15:34.518611108 (249h49m15.249878758s) [upload=259864]: Upload finished. err: metaclient: Too Many Requests
Duration: 136.307327ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [.....XX.....................................................]
duration:
160.541365ms
FAIL (2025-08-19 03:56:21 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 19 03:15:34.515421087 (249h49m15.246688748s) [upload=259864]: Starting upload
Aug 19 03:15:34.515492252 (249h49m15.246759902s) [upload=259864]: Done starting upload
Aug 19 03:15:34.515570098 (249h49m15.246837748s) [upload=259864]: Uploading segments...
Aug 19 03:15:34.515658344 (249h49m15.246925995s) [upload=259864]: Got next segment. Inline: true
Aug 19 03:15:34.515665928 (249h49m15.246933588s) [upload=259864]: Waiting for error group managing segments...
Aug 19 03:15:34.515718817 (249h49m15.246986468s) [upload=259864]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 03:15:34.515725010 (249h49m15.246992659s) [upload=259864]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 03:15:34.515728616 (249h49m15.246996276s) [upload=259864]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 03:15:34.518598415 (249h49m15.249866064s) [upload=259864]: Done uploading segments...
Aug 19 03:15:34.518611108 (249h49m15.249878758s) [upload=259864]: Upload finished. err: metaclient: Too Many Requests
Duration: 160.560581ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [......XX....................................................]
duration:
121.259052ms
FAIL (2025-08-19 03:55:37 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 19 03:15:34.515421087 (249h49m15.246688748s) [upload=259864]: Starting upload
Aug 19 03:15:34.515492252 (249h49m15.246759902s) [upload=259864]: Done starting upload
Aug 19 03:15:34.515570098 (249h49m15.246837748s) [upload=259864]: Uploading segments...
Aug 19 03:15:34.515658344 (249h49m15.246925995s) [upload=259864]: Got next segment. Inline: true
Aug 19 03:15:34.515665928 (249h49m15.246933588s) [upload=259864]: Waiting for error group managing segments...
Aug 19 03:15:34.515718817 (249h49m15.246986468s) [upload=259864]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 03:15:34.515725010 (249h49m15.246992659s) [upload=259864]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 03:15:34.515728616 (249h49m15.246996276s) [upload=259864]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 03:15:34.518598415 (249h49m15.249866064s) [upload=259864]: Done uploading segments...
Aug 19 03:15:34.518611108 (249h49m15.249878758s) [upload=259864]: Upload finished. err: metaclient: Too Many Requests
Duration: 121.278019ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [.......XX...................................................]
duration:
130.677321ms
FAIL (2025-08-19 03:54:55 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 19 03:15:34.515421087 (249h49m15.246688748s) [upload=259864]: Starting upload
Aug 19 03:15:34.515492252 (249h49m15.246759902s) [upload=259864]: Done starting upload
Aug 19 03:15:34.515570098 (249h49m15.246837748s) [upload=259864]: Uploading segments...
Aug 19 03:15:34.515658344 (249h49m15.246925995s) [upload=259864]: Got next segment. Inline: true
Aug 19 03:15:34.515665928 (249h49m15.246933588s) [upload=259864]: Waiting for error group managing segments...
Aug 19 03:15:34.515718817 (249h49m15.246986468s) [upload=259864]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 03:15:34.515725010 (249h49m15.246992659s) [upload=259864]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 03:15:34.515728616 (249h49m15.246996276s) [upload=259864]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 03:15:34.518598415 (249h49m15.249866064s) [upload=259864]: Done uploading segments...
Aug 19 03:15:34.518611108 (249h49m15.249878758s) [upload=259864]: Upload finished. err: metaclient: Too Many Requests
Duration: 130.697448ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [........XX..................................................]
duration:
359.956342ms
FAIL (2025-08-19 03:54:05 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 19 03:15:34.515421087 (249h49m15.246688748s) [upload=259864]: Starting upload
Aug 19 03:15:34.515492252 (249h49m15.246759902s) [upload=259864]: Done starting upload
Aug 19 03:15:34.515570098 (249h49m15.246837748s) [upload=259864]: Uploading segments...
Aug 19 03:15:34.515658344 (249h49m15.246925995s) [upload=259864]: Got next segment. Inline: true
Aug 19 03:15:34.515665928 (249h49m15.246933588s) [upload=259864]: Waiting for error group managing segments...
Aug 19 03:15:34.515718817 (249h49m15.246986468s) [upload=259864]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 03:15:34.515725010 (249h49m15.246992659s) [upload=259864]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 03:15:34.515728616 (249h49m15.246996276s) [upload=259864]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 03:15:34.518598415 (249h49m15.249866064s) [upload=259864]: Done uploading segments...
Aug 19 03:15:34.518611108 (249h49m15.249878758s) [upload=259864]: Upload finished. err: metaclient: Too Many Requests
Duration: 360.032095ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [.........XX.................................................]
duration:
146.915382ms
FAIL (2025-08-19 03:53:18 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 19 03:15:34.515421087 (249h49m15.246688748s) [upload=259864]: Starting upload
Aug 19 03:15:34.515492252 (249h49m15.246759902s) [upload=259864]: Done starting upload
Aug 19 03:15:34.515570098 (249h49m15.246837748s) [upload=259864]: Uploading segments...
Aug 19 03:15:34.515658344 (249h49m15.246925995s) [upload=259864]: Got next segment. Inline: true
Aug 19 03:15:34.515665928 (249h49m15.246933588s) [upload=259864]: Waiting for error group managing segments...
Aug 19 03:15:34.515718817 (249h49m15.246986468s) [upload=259864]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 03:15:34.515725010 (249h49m15.246992659s) [upload=259864]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 03:15:34.515728616 (249h49m15.246996276s) [upload=259864]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 03:15:34.518598415 (249h49m15.249866064s) [upload=259864]: Done uploading segments...
Aug 19 03:15:34.518611108 (249h49m15.249878758s) [upload=259864]: Upload finished. err: metaclient: Too Many Requests
Duration: 146.943645ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [..........XX................................................]
duration:
160.672199ms
FAIL (2025-08-19 03:52:13 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 19 03:15:34.515421087 (249h49m15.246688748s) [upload=259864]: Starting upload
Aug 19 03:15:34.515492252 (249h49m15.246759902s) [upload=259864]: Done starting upload
Aug 19 03:15:34.515570098 (249h49m15.246837748s) [upload=259864]: Uploading segments...
Aug 19 03:15:34.515658344 (249h49m15.246925995s) [upload=259864]: Got next segment. Inline: true
Aug 19 03:15:34.515665928 (249h49m15.246933588s) [upload=259864]: Waiting for error group managing segments...
Aug 19 03:15:34.515718817 (249h49m15.246986468s) [upload=259864]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 03:15:34.515725010 (249h49m15.246992659s) [upload=259864]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 03:15:34.515728616 (249h49m15.246996276s) [upload=259864]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 03:15:34.518598415 (249h49m15.249866064s) [upload=259864]: Done uploading segments...
Aug 19 03:15:34.518611108 (249h49m15.249878758s) [upload=259864]: Upload finished. err: metaclient: Too Many Requests
Duration: 160.698518ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [...........XX...............................................]
duration:
163.88605ms
FAIL (2025-08-19 03:51:38 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 19 03:15:34.515421087 (249h49m15.246688748s) [upload=259864]: Starting upload
Aug 19 03:15:34.515492252 (249h49m15.246759902s) [upload=259864]: Done starting upload
Aug 19 03:15:34.515570098 (249h49m15.246837748s) [upload=259864]: Uploading segments...
Aug 19 03:15:34.515658344 (249h49m15.246925995s) [upload=259864]: Got next segment. Inline: true
Aug 19 03:15:34.515665928 (249h49m15.246933588s) [upload=259864]: Waiting for error group managing segments...
Aug 19 03:15:34.515718817 (249h49m15.246986468s) [upload=259864]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 03:15:34.515725010 (249h49m15.246992659s) [upload=259864]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 03:15:34.515728616 (249h49m15.246996276s) [upload=259864]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 03:15:34.518598415 (249h49m15.249866064s) [upload=259864]: Done uploading segments...
Aug 19 03:15:34.518611108 (249h49m15.249878758s) [upload=259864]: Upload finished. err: metaclient: Too Many Requests
Duration: 163.930513ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [............XX..............................................]
duration:
129.929855ms
FAIL (2025-08-19 03:50:37 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 19 03:15:34.515421087 (249h49m15.246688748s) [upload=259864]: Starting upload
Aug 19 03:15:34.515492252 (249h49m15.246759902s) [upload=259864]: Done starting upload
Aug 19 03:15:34.515570098 (249h49m15.246837748s) [upload=259864]: Uploading segments...
Aug 19 03:15:34.515658344 (249h49m15.246925995s) [upload=259864]: Got next segment. Inline: true
Aug 19 03:15:34.515665928 (249h49m15.246933588s) [upload=259864]: Waiting for error group managing segments...
Aug 19 03:15:34.515718817 (249h49m15.246986468s) [upload=259864]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 03:15:34.515725010 (249h49m15.246992659s) [upload=259864]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 19 03:15:34.515728616 (249h49m15.246996276s) [upload=259864]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 03:15:34.518598415 (249h49m15.249866064s) [upload=259864]: Done uploading segments...
Aug 19 03:15:34.518611108 (249h49m15.249878758s) [upload=259864]: Upload finished. err: metaclient: Too Many Requests
Duration: 129.949722ms core uplink us-select-1 us1-placement-20 metainfo-projects