Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................................X........X................] duration:
498.591883ms
FAIL (2025-08-07 19:37:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== upload Aug 7 19:27:44.006467873 (3h0m57.593524104s) [upload=3111]: Uploading segments... Aug 7 19:27:44.006762594 (3h0m57.593818835s) [upload=3111]: Got next segment. Inline: false Aug 7 19:27:44.006802177 (3h0m57.593858418s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 19:27:44.006807697 (3h0m57.593863939s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 19:27:44.056805204 (3h0m57.643861445s) [seg_pos={0 0}, upload=3111]: Begin upload segment... Aug 7 19:27:44.056847824 (3h0m57.643904055s) [seg_pos={0 0}, upload=3111]: Done begin upload segment. Aug 7 19:27:44.056875095 (3h0m57.643931386s) [noise=true , address=104.36.82.43:4848 , piece_id=BBRVVYNYLMEDVZPFP2F4N5U2MTZDF4JPX2QMPLUYQ4CDKFFWKKPQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.056888329 (3h0m57.64394457s) [noise=true , address=104.36.82.12:4159 , piece_id=YA7AS3EQIYKWEA2NMDAZUJYPIE7G2NGS3HSDVFV2TH7EBHZFCFHQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.056930177 (3h0m57.643986419s) [noise=true , address=104.36.82.16:4303 , piece_id=LIGUJZKXUSDOAY6EBKFCDBSJQ4W2ZTYLS5ZRTMVZ4SB3IPOIRCAA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057326708 (3h0m57.644382949s) [noise=true , address=104.36.82.36:4652 , piece_id=OYDPP7KRAWZI5K3WGROJ7Z2RCW7RXGDQENOGSQJJHNYKNTRVICQQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057335624 (3h0m57.644391866s) [noise=true , address=104.36.82.62:4412 , piece_id=VTW7D5FWI57JQSXSXYVFSGP3DF6LAYY763QILC2L6FD7XOY2PWMA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057710634 (3h0m57.644766875s) [noise=true , address=45.91.116.10:4106 , piece_id=M434Q2FT2O6VAOMNW5OH5DO5GFQTJ2P4QZFIYWN6HHS3LDM5DZQA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057732425 (3h0m57.644788666s) [noise=true , address=104.36.82.60:4349 , piece_id=DW2C5CYLEL4BA6U3CDWN6VW6UJ5N5JE3TUD7MRTUQH5KFMMRD7AQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058048605 (3h0m57.645104846s) [noise=true , address=104.36.82.23:4462 , piece_id=4BTWSC6DSBHTSYQELVQWKAIJALQ7TLSZJA4VIDG4FXCKXJM6KPIA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058075335 (3h0m57.645131576s) [noise=true , address=104.36.82.14:4239 , piece_id=FWDFC254IVBP53YZXMJC74VU23YEONN45ZGO7TJGZ2VAIB5ZTV6A, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058376747 (3h0m57.645432978s) [noise=true , address=104.36.82.47:4532 , piece_id=4GBF3A2LT3TKURVNSPXY7KJNSIOAGLB2P3BCOUJJJBEDKDUFKOMA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058721150 (3h0m57.645777391s) [noise=true , address=104.36.82.8:4992 , piece_id=2R4DIYO5UQXJ56GRK6JA5J6BXWRASRUHF544M6MHDBC6NXAISTJA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059050325 (3h0m57.646106556s) [noise=true , address=104.36.82.55:4201 , piece_id=UCT3UZQGQJCXOBGPJVSFUI26CQYRS5YW3MEWLDZO32UAC56I2OHA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059376785 (3h0m57.646433016s) [noise=true , address=104.36.82.59:4311 , piece_id=TVNTDOMNUCJF4A3YFSXQIXJEAPLFN56HGPJ5DG4I43QVPLW4CZ6Q, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059723321 (3h0m57.646779552s) [noise=true , address=104.36.82.18:4398 , piece_id=GLBCIUKUYNUMCPG2KTKKXS4G26PCPM22QNYJZBQ7LL5DSRZBFYKQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060115413 (3h0m57.647171645s) [noise=true , address=104.36.82.44:4884 , piece_id=3HG77VZOMC7C2BFE2OOR4N7ZUI2R7V3MPTIBYY5BCDPOF2ZVWB3A, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060458384 (3h0m57.647514625s) [noise=true , address=79.127.201.215:4344 , piece_id=3X6ZPSPEPZYDICKWAHHMAIR4MTWPUVTZWMVDIPEKDDCNNB44SMWA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060821732 (3h0m57.647877973s) [noise=true , address=104.36.82.3:4785 , piece_id=ICT5THFHEBQQDELTJI44YTXKKOADC36QTG6PIZTQUK4YH5W6AZRQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.061179059 (3h0m57.64823529s) [noise=true , address=45.91.116.5:4309 , piece_id=2ZAQDU5E26KNU7Q3XQ5HDEECKY6MH7NEBHFNHUXNZQI73FGTVL3Q, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.193291120 (3h0m57.780347371s) [upload=3111]: Next returned nil segment Aug 7 19:27:44.193306900 (3h0m57.780363151s) [upload=3111]: Waiting for error group managing segments... Aug 7 19:27:44.209607597 (3h0m57.796663838s) [noise=true , address=104.36.82.43:4848 , piece_id=BBRVVYNYLMEDVZPFP2F4N5U2MTZDF4JPX2QMPLUYQ4CDKFFWKKPQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.211275410 (3h0m57.798331651s) [noise=true , address=104.36.82.47:4532 , piece_id=4GBF3A2LT3TKURVNSPXY7KJNSIOAGLB2P3BCOUJJJBEDKDUFKOMA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.217863949 (3h0m57.8049202s) [noise=true , address=104.36.82.60:4349 , piece_id=DW2C5CYLEL4BA6U3CDWN6VW6UJ5N5JE3TUD7MRTUQH5KFMMRD7AQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.219360643 (3h0m57.806416894s) [noise=true , address=104.36.82.59:4311 , piece_id=TVNTDOMNUCJF4A3YFSXQIXJEAPLFN56HGPJ5DG4I43QVPLW4CZ6Q, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.220779782 (3h0m57.807836022s) [noise=true , address=104.36.82.55:4201 , piece_id=UCT3UZQGQJCXOBGPJVSFUI26CQYRS5YW3MEWLDZO32UAC56I2OHA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.221735776 (3h0m57.808792018s) [noise=true , address=104.36.82.62:4412 , piece_id=VTW7D5FWI57JQSXSXYVFSGP3DF6LAYY763QILC2L6FD7XOY2PWMA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.224644716 (3h0m57.811700957s) [noise=true , address=45.91.116.10:4106 , piece_id=M434Q2FT2O6VAOMNW5OH5DO5GFQTJ2P4QZFIYWN6HHS3LDM5DZQA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.229617950 (3h0m57.816674191s) [noise=true , address=104.36.82.14:4239 , piece_id=FWDFC254IVBP53YZXMJC74VU23YEONN45ZGO7TJGZ2VAIB5ZTV6A, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.230697154 (3h0m57.817753395s) [noise=true , address=104.36.82.18:4398 , piece_id=GLBCIUKUYNUMCPG2KTKKXS4G26PCPM22QNYJZBQ7LL5DSRZBFYKQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.234957226 (3h0m57.822013468s) [noise=true , address=104.36.82.12:4159 , piece_id=YA7AS3EQIYKWEA2NMDAZUJYPIE7G2NGS3HSDVFV2TH7EBHZFCFHQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.237122999 (3h0m57.82417924s) [noise=true , address=45.91.116.5:4309 , piece_id=2ZAQDU5E26KNU7Q3XQ5HDEECKY6MH7NEBHFNHUXNZQI73FGTVL3Q, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.243298527 (3h0m57.830354768s) [noise=true , address=104.36.82.3:4785 , piece_id=ICT5THFHEBQQDELTJI44YTXKKOADC36QTG6PIZTQUK4YH5W6AZRQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.305437629 (3h0m57.892493871s) [noise=true , address=79.127.201.215:4344 , piece_id=3X6ZPSPEPZYDICKWAHHMAIR4MTWPUVTZWMVDIPEKDDCNNB44SMWA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.314176622 (3h0m57.901232863s) [noise=true , address=104.36.82.36:4652 , piece_id=OYDPP7KRAWZI5K3WGROJ7Z2RCW7RXGDQENOGSQJJHNYKNTRVICQQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.314225393 (3h0m57.901281635s) [seg_pos={0 0}, upload=3111]: Segment reached optimal threshold of 14 pieces. Aug 7 19:27:44.314403605 (3h0m57.901459847s) [noise=true , address=104.36.82.44:4884 , piece_id=3HG77VZOMC7C2BFE2OOR4N7ZUI2R7V3MPTIBYY5BCDPOF2ZVWB3A, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF Aug 7 19:27:44.314450183 (3h0m57.901506424s) [noise=true , address=104.36.82.16:4303 , piece_id=LIGUJZKXUSDOAY6EBKFCDBSJQ4W2ZTYLS5ZRTMVZ4SB3IPOIRCAA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ec4Xvp3nGRAm9BivLLTp6AVkMoz1i2AgXQdfQaAmNPLHWD4Yv): protocol: expected piece hash; context canceled; EOF Aug 7 19:27:44.314752737 (3h0m57.901808979s) [noise=true , address=104.36.82.23:4462 , piece_id=4BTWSC6DSBHTSYQELVQWKAIJALQ7TLSZJA4VIDG4FXCKXJM6KPIA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YirC8WVSoE1qrWGMmayNmCsDLxjUhggrgXL5unKtQjsfUkbMu): protocol: read tcp 5.161.89.252:19630->104.36.82.23:4462: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.314762766 (3h0m57.901819017s) [noise=true , address=104.36.82.8:4992 , piece_id=2R4DIYO5UQXJ56GRK6JA5J6BXWRASRUHF544M6MHDBC6NXAISTJA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hbt8HKTunpPKyAzH4XBwGQqTKzcgqPpoWwKZm9JMtaK8P7aVp): protocol: write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection; write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection Aug 7 19:27:44.314798644 (3h0m57.901854884s) [seg_pos={0 0}, upload=3111]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:27:44.314911785 (3h0m57.901968026s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 19:27:44.314941310 (3h0m57.901997561s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 19:27:44.620205884 (3h0m58.207262095s) [upload=3111]: Done uploading segments... Aug 7 19:27:44.620221594 (3h0m58.207277804s) [upload=3111]: Upload finished. err: <nil>
Duration: 498.720654ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................................X........X...............] duration:
462.963178ms
FAIL (2025-08-07 19:36:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== upload Aug 7 19:27:44.006467873 (3h0m57.593524104s) [upload=3111]: Uploading segments... Aug 7 19:27:44.006762594 (3h0m57.593818835s) [upload=3111]: Got next segment. Inline: false Aug 7 19:27:44.006802177 (3h0m57.593858418s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 19:27:44.006807697 (3h0m57.593863939s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 19:27:44.056805204 (3h0m57.643861445s) [seg_pos={0 0}, upload=3111]: Begin upload segment... Aug 7 19:27:44.056847824 (3h0m57.643904055s) [seg_pos={0 0}, upload=3111]: Done begin upload segment. Aug 7 19:27:44.056875095 (3h0m57.643931386s) [noise=true , address=104.36.82.43:4848 , piece_id=BBRVVYNYLMEDVZPFP2F4N5U2MTZDF4JPX2QMPLUYQ4CDKFFWKKPQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.056888329 (3h0m57.64394457s) [noise=true , address=104.36.82.12:4159 , piece_id=YA7AS3EQIYKWEA2NMDAZUJYPIE7G2NGS3HSDVFV2TH7EBHZFCFHQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.056930177 (3h0m57.643986419s) [noise=true , address=104.36.82.16:4303 , piece_id=LIGUJZKXUSDOAY6EBKFCDBSJQ4W2ZTYLS5ZRTMVZ4SB3IPOIRCAA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057326708 (3h0m57.644382949s) [noise=true , address=104.36.82.36:4652 , piece_id=OYDPP7KRAWZI5K3WGROJ7Z2RCW7RXGDQENOGSQJJHNYKNTRVICQQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057335624 (3h0m57.644391866s) [noise=true , address=104.36.82.62:4412 , piece_id=VTW7D5FWI57JQSXSXYVFSGP3DF6LAYY763QILC2L6FD7XOY2PWMA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057710634 (3h0m57.644766875s) [noise=true , address=45.91.116.10:4106 , piece_id=M434Q2FT2O6VAOMNW5OH5DO5GFQTJ2P4QZFIYWN6HHS3LDM5DZQA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057732425 (3h0m57.644788666s) [noise=true , address=104.36.82.60:4349 , piece_id=DW2C5CYLEL4BA6U3CDWN6VW6UJ5N5JE3TUD7MRTUQH5KFMMRD7AQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058048605 (3h0m57.645104846s) [noise=true , address=104.36.82.23:4462 , piece_id=4BTWSC6DSBHTSYQELVQWKAIJALQ7TLSZJA4VIDG4FXCKXJM6KPIA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058075335 (3h0m57.645131576s) [noise=true , address=104.36.82.14:4239 , piece_id=FWDFC254IVBP53YZXMJC74VU23YEONN45ZGO7TJGZ2VAIB5ZTV6A, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058376747 (3h0m57.645432978s) [noise=true , address=104.36.82.47:4532 , piece_id=4GBF3A2LT3TKURVNSPXY7KJNSIOAGLB2P3BCOUJJJBEDKDUFKOMA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058721150 (3h0m57.645777391s) [noise=true , address=104.36.82.8:4992 , piece_id=2R4DIYO5UQXJ56GRK6JA5J6BXWRASRUHF544M6MHDBC6NXAISTJA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059050325 (3h0m57.646106556s) [noise=true , address=104.36.82.55:4201 , piece_id=UCT3UZQGQJCXOBGPJVSFUI26CQYRS5YW3MEWLDZO32UAC56I2OHA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059376785 (3h0m57.646433016s) [noise=true , address=104.36.82.59:4311 , piece_id=TVNTDOMNUCJF4A3YFSXQIXJEAPLFN56HGPJ5DG4I43QVPLW4CZ6Q, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059723321 (3h0m57.646779552s) [noise=true , address=104.36.82.18:4398 , piece_id=GLBCIUKUYNUMCPG2KTKKXS4G26PCPM22QNYJZBQ7LL5DSRZBFYKQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060115413 (3h0m57.647171645s) [noise=true , address=104.36.82.44:4884 , piece_id=3HG77VZOMC7C2BFE2OOR4N7ZUI2R7V3MPTIBYY5BCDPOF2ZVWB3A, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060458384 (3h0m57.647514625s) [noise=true , address=79.127.201.215:4344 , piece_id=3X6ZPSPEPZYDICKWAHHMAIR4MTWPUVTZWMVDIPEKDDCNNB44SMWA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060821732 (3h0m57.647877973s) [noise=true , address=104.36.82.3:4785 , piece_id=ICT5THFHEBQQDELTJI44YTXKKOADC36QTG6PIZTQUK4YH5W6AZRQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.061179059 (3h0m57.64823529s) [noise=true , address=45.91.116.5:4309 , piece_id=2ZAQDU5E26KNU7Q3XQ5HDEECKY6MH7NEBHFNHUXNZQI73FGTVL3Q, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.193291120 (3h0m57.780347371s) [upload=3111]: Next returned nil segment Aug 7 19:27:44.193306900 (3h0m57.780363151s) [upload=3111]: Waiting for error group managing segments... Aug 7 19:27:44.209607597 (3h0m57.796663838s) [noise=true , address=104.36.82.43:4848 , piece_id=BBRVVYNYLMEDVZPFP2F4N5U2MTZDF4JPX2QMPLUYQ4CDKFFWKKPQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.211275410 (3h0m57.798331651s) [noise=true , address=104.36.82.47:4532 , piece_id=4GBF3A2LT3TKURVNSPXY7KJNSIOAGLB2P3BCOUJJJBEDKDUFKOMA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.217863949 (3h0m57.8049202s) [noise=true , address=104.36.82.60:4349 , piece_id=DW2C5CYLEL4BA6U3CDWN6VW6UJ5N5JE3TUD7MRTUQH5KFMMRD7AQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.219360643 (3h0m57.806416894s) [noise=true , address=104.36.82.59:4311 , piece_id=TVNTDOMNUCJF4A3YFSXQIXJEAPLFN56HGPJ5DG4I43QVPLW4CZ6Q, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.220779782 (3h0m57.807836022s) [noise=true , address=104.36.82.55:4201 , piece_id=UCT3UZQGQJCXOBGPJVSFUI26CQYRS5YW3MEWLDZO32UAC56I2OHA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.221735776 (3h0m57.808792018s) [noise=true , address=104.36.82.62:4412 , piece_id=VTW7D5FWI57JQSXSXYVFSGP3DF6LAYY763QILC2L6FD7XOY2PWMA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.224644716 (3h0m57.811700957s) [noise=true , address=45.91.116.10:4106 , piece_id=M434Q2FT2O6VAOMNW5OH5DO5GFQTJ2P4QZFIYWN6HHS3LDM5DZQA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.229617950 (3h0m57.816674191s) [noise=true , address=104.36.82.14:4239 , piece_id=FWDFC254IVBP53YZXMJC74VU23YEONN45ZGO7TJGZ2VAIB5ZTV6A, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.230697154 (3h0m57.817753395s) [noise=true , address=104.36.82.18:4398 , piece_id=GLBCIUKUYNUMCPG2KTKKXS4G26PCPM22QNYJZBQ7LL5DSRZBFYKQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.234957226 (3h0m57.822013468s) [noise=true , address=104.36.82.12:4159 , piece_id=YA7AS3EQIYKWEA2NMDAZUJYPIE7G2NGS3HSDVFV2TH7EBHZFCFHQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.237122999 (3h0m57.82417924s) [noise=true , address=45.91.116.5:4309 , piece_id=2ZAQDU5E26KNU7Q3XQ5HDEECKY6MH7NEBHFNHUXNZQI73FGTVL3Q, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.243298527 (3h0m57.830354768s) [noise=true , address=104.36.82.3:4785 , piece_id=ICT5THFHEBQQDELTJI44YTXKKOADC36QTG6PIZTQUK4YH5W6AZRQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.305437629 (3h0m57.892493871s) [noise=true , address=79.127.201.215:4344 , piece_id=3X6ZPSPEPZYDICKWAHHMAIR4MTWPUVTZWMVDIPEKDDCNNB44SMWA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.314176622 (3h0m57.901232863s) [noise=true , address=104.36.82.36:4652 , piece_id=OYDPP7KRAWZI5K3WGROJ7Z2RCW7RXGDQENOGSQJJHNYKNTRVICQQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.314225393 (3h0m57.901281635s) [seg_pos={0 0}, upload=3111]: Segment reached optimal threshold of 14 pieces. Aug 7 19:27:44.314403605 (3h0m57.901459847s) [noise=true , address=104.36.82.44:4884 , piece_id=3HG77VZOMC7C2BFE2OOR4N7ZUI2R7V3MPTIBYY5BCDPOF2ZVWB3A, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF Aug 7 19:27:44.314450183 (3h0m57.901506424s) [noise=true , address=104.36.82.16:4303 , piece_id=LIGUJZKXUSDOAY6EBKFCDBSJQ4W2ZTYLS5ZRTMVZ4SB3IPOIRCAA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ec4Xvp3nGRAm9BivLLTp6AVkMoz1i2AgXQdfQaAmNPLHWD4Yv): protocol: expected piece hash; context canceled; EOF Aug 7 19:27:44.314752737 (3h0m57.901808979s) [noise=true , address=104.36.82.23:4462 , piece_id=4BTWSC6DSBHTSYQELVQWKAIJALQ7TLSZJA4VIDG4FXCKXJM6KPIA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YirC8WVSoE1qrWGMmayNmCsDLxjUhggrgXL5unKtQjsfUkbMu): protocol: read tcp 5.161.89.252:19630->104.36.82.23:4462: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.314762766 (3h0m57.901819017s) [noise=true , address=104.36.82.8:4992 , piece_id=2R4DIYO5UQXJ56GRK6JA5J6BXWRASRUHF544M6MHDBC6NXAISTJA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hbt8HKTunpPKyAzH4XBwGQqTKzcgqPpoWwKZm9JMtaK8P7aVp): protocol: write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection; write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection Aug 7 19:27:44.314798644 (3h0m57.901854884s) [seg_pos={0 0}, upload=3111]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:27:44.314911785 (3h0m57.901968026s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 19:27:44.314941310 (3h0m57.901997561s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 19:27:44.620205884 (3h0m58.207262095s) [upload=3111]: Done uploading segments... Aug 7 19:27:44.620221594 (3h0m58.207277804s) [upload=3111]: Upload finished. err: <nil>
Duration: 462.987812ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................................X........X..............] duration:
662.226963ms
FAIL (2025-08-07 19:36:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== upload Aug 7 19:27:44.006467873 (3h0m57.593524104s) [upload=3111]: Uploading segments... Aug 7 19:27:44.006762594 (3h0m57.593818835s) [upload=3111]: Got next segment. Inline: false Aug 7 19:27:44.006802177 (3h0m57.593858418s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 19:27:44.006807697 (3h0m57.593863939s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 19:27:44.056805204 (3h0m57.643861445s) [seg_pos={0 0}, upload=3111]: Begin upload segment... Aug 7 19:27:44.056847824 (3h0m57.643904055s) [seg_pos={0 0}, upload=3111]: Done begin upload segment. Aug 7 19:27:44.056875095 (3h0m57.643931386s) [noise=true , address=104.36.82.43:4848 , piece_id=BBRVVYNYLMEDVZPFP2F4N5U2MTZDF4JPX2QMPLUYQ4CDKFFWKKPQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.056888329 (3h0m57.64394457s) [noise=true , address=104.36.82.12:4159 , piece_id=YA7AS3EQIYKWEA2NMDAZUJYPIE7G2NGS3HSDVFV2TH7EBHZFCFHQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.056930177 (3h0m57.643986419s) [noise=true , address=104.36.82.16:4303 , piece_id=LIGUJZKXUSDOAY6EBKFCDBSJQ4W2ZTYLS5ZRTMVZ4SB3IPOIRCAA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057326708 (3h0m57.644382949s) [noise=true , address=104.36.82.36:4652 , piece_id=OYDPP7KRAWZI5K3WGROJ7Z2RCW7RXGDQENOGSQJJHNYKNTRVICQQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057335624 (3h0m57.644391866s) [noise=true , address=104.36.82.62:4412 , piece_id=VTW7D5FWI57JQSXSXYVFSGP3DF6LAYY763QILC2L6FD7XOY2PWMA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057710634 (3h0m57.644766875s) [noise=true , address=45.91.116.10:4106 , piece_id=M434Q2FT2O6VAOMNW5OH5DO5GFQTJ2P4QZFIYWN6HHS3LDM5DZQA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057732425 (3h0m57.644788666s) [noise=true , address=104.36.82.60:4349 , piece_id=DW2C5CYLEL4BA6U3CDWN6VW6UJ5N5JE3TUD7MRTUQH5KFMMRD7AQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058048605 (3h0m57.645104846s) [noise=true , address=104.36.82.23:4462 , piece_id=4BTWSC6DSBHTSYQELVQWKAIJALQ7TLSZJA4VIDG4FXCKXJM6KPIA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058075335 (3h0m57.645131576s) [noise=true , address=104.36.82.14:4239 , piece_id=FWDFC254IVBP53YZXMJC74VU23YEONN45ZGO7TJGZ2VAIB5ZTV6A, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058376747 (3h0m57.645432978s) [noise=true , address=104.36.82.47:4532 , piece_id=4GBF3A2LT3TKURVNSPXY7KJNSIOAGLB2P3BCOUJJJBEDKDUFKOMA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058721150 (3h0m57.645777391s) [noise=true , address=104.36.82.8:4992 , piece_id=2R4DIYO5UQXJ56GRK6JA5J6BXWRASRUHF544M6MHDBC6NXAISTJA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059050325 (3h0m57.646106556s) [noise=true , address=104.36.82.55:4201 , piece_id=UCT3UZQGQJCXOBGPJVSFUI26CQYRS5YW3MEWLDZO32UAC56I2OHA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059376785 (3h0m57.646433016s) [noise=true , address=104.36.82.59:4311 , piece_id=TVNTDOMNUCJF4A3YFSXQIXJEAPLFN56HGPJ5DG4I43QVPLW4CZ6Q, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059723321 (3h0m57.646779552s) [noise=true , address=104.36.82.18:4398 , piece_id=GLBCIUKUYNUMCPG2KTKKXS4G26PCPM22QNYJZBQ7LL5DSRZBFYKQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060115413 (3h0m57.647171645s) [noise=true , address=104.36.82.44:4884 , piece_id=3HG77VZOMC7C2BFE2OOR4N7ZUI2R7V3MPTIBYY5BCDPOF2ZVWB3A, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060458384 (3h0m57.647514625s) [noise=true , address=79.127.201.215:4344 , piece_id=3X6ZPSPEPZYDICKWAHHMAIR4MTWPUVTZWMVDIPEKDDCNNB44SMWA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060821732 (3h0m57.647877973s) [noise=true , address=104.36.82.3:4785 , piece_id=ICT5THFHEBQQDELTJI44YTXKKOADC36QTG6PIZTQUK4YH5W6AZRQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.061179059 (3h0m57.64823529s) [noise=true , address=45.91.116.5:4309 , piece_id=2ZAQDU5E26KNU7Q3XQ5HDEECKY6MH7NEBHFNHUXNZQI73FGTVL3Q, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.193291120 (3h0m57.780347371s) [upload=3111]: Next returned nil segment Aug 7 19:27:44.193306900 (3h0m57.780363151s) [upload=3111]: Waiting for error group managing segments... Aug 7 19:27:44.209607597 (3h0m57.796663838s) [noise=true , address=104.36.82.43:4848 , piece_id=BBRVVYNYLMEDVZPFP2F4N5U2MTZDF4JPX2QMPLUYQ4CDKFFWKKPQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.211275410 (3h0m57.798331651s) [noise=true , address=104.36.82.47:4532 , piece_id=4GBF3A2LT3TKURVNSPXY7KJNSIOAGLB2P3BCOUJJJBEDKDUFKOMA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.217863949 (3h0m57.8049202s) [noise=true , address=104.36.82.60:4349 , piece_id=DW2C5CYLEL4BA6U3CDWN6VW6UJ5N5JE3TUD7MRTUQH5KFMMRD7AQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.219360643 (3h0m57.806416894s) [noise=true , address=104.36.82.59:4311 , piece_id=TVNTDOMNUCJF4A3YFSXQIXJEAPLFN56HGPJ5DG4I43QVPLW4CZ6Q, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.220779782 (3h0m57.807836022s) [noise=true , address=104.36.82.55:4201 , piece_id=UCT3UZQGQJCXOBGPJVSFUI26CQYRS5YW3MEWLDZO32UAC56I2OHA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.221735776 (3h0m57.808792018s) [noise=true , address=104.36.82.62:4412 , piece_id=VTW7D5FWI57JQSXSXYVFSGP3DF6LAYY763QILC2L6FD7XOY2PWMA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.224644716 (3h0m57.811700957s) [noise=true , address=45.91.116.10:4106 , piece_id=M434Q2FT2O6VAOMNW5OH5DO5GFQTJ2P4QZFIYWN6HHS3LDM5DZQA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.229617950 (3h0m57.816674191s) [noise=true , address=104.36.82.14:4239 , piece_id=FWDFC254IVBP53YZXMJC74VU23YEONN45ZGO7TJGZ2VAIB5ZTV6A, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.230697154 (3h0m57.817753395s) [noise=true , address=104.36.82.18:4398 , piece_id=GLBCIUKUYNUMCPG2KTKKXS4G26PCPM22QNYJZBQ7LL5DSRZBFYKQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.234957226 (3h0m57.822013468s) [noise=true , address=104.36.82.12:4159 , piece_id=YA7AS3EQIYKWEA2NMDAZUJYPIE7G2NGS3HSDVFV2TH7EBHZFCFHQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.237122999 (3h0m57.82417924s) [noise=true , address=45.91.116.5:4309 , piece_id=2ZAQDU5E26KNU7Q3XQ5HDEECKY6MH7NEBHFNHUXNZQI73FGTVL3Q, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.243298527 (3h0m57.830354768s) [noise=true , address=104.36.82.3:4785 , piece_id=ICT5THFHEBQQDELTJI44YTXKKOADC36QTG6PIZTQUK4YH5W6AZRQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.305437629 (3h0m57.892493871s) [noise=true , address=79.127.201.215:4344 , piece_id=3X6ZPSPEPZYDICKWAHHMAIR4MTWPUVTZWMVDIPEKDDCNNB44SMWA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.314176622 (3h0m57.901232863s) [noise=true , address=104.36.82.36:4652 , piece_id=OYDPP7KRAWZI5K3WGROJ7Z2RCW7RXGDQENOGSQJJHNYKNTRVICQQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.314225393 (3h0m57.901281635s) [seg_pos={0 0}, upload=3111]: Segment reached optimal threshold of 14 pieces. Aug 7 19:27:44.314403605 (3h0m57.901459847s) [noise=true , address=104.36.82.44:4884 , piece_id=3HG77VZOMC7C2BFE2OOR4N7ZUI2R7V3MPTIBYY5BCDPOF2ZVWB3A, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF Aug 7 19:27:44.314450183 (3h0m57.901506424s) [noise=true , address=104.36.82.16:4303 , piece_id=LIGUJZKXUSDOAY6EBKFCDBSJQ4W2ZTYLS5ZRTMVZ4SB3IPOIRCAA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ec4Xvp3nGRAm9BivLLTp6AVkMoz1i2AgXQdfQaAmNPLHWD4Yv): protocol: expected piece hash; context canceled; EOF Aug 7 19:27:44.314752737 (3h0m57.901808979s) [noise=true , address=104.36.82.23:4462 , piece_id=4BTWSC6DSBHTSYQELVQWKAIJALQ7TLSZJA4VIDG4FXCKXJM6KPIA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YirC8WVSoE1qrWGMmayNmCsDLxjUhggrgXL5unKtQjsfUkbMu): protocol: read tcp 5.161.89.252:19630->104.36.82.23:4462: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.314762766 (3h0m57.901819017s) [noise=true , address=104.36.82.8:4992 , piece_id=2R4DIYO5UQXJ56GRK6JA5J6BXWRASRUHF544M6MHDBC6NXAISTJA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hbt8HKTunpPKyAzH4XBwGQqTKzcgqPpoWwKZm9JMtaK8P7aVp): protocol: write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection; write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection Aug 7 19:27:44.314798644 (3h0m57.901854884s) [seg_pos={0 0}, upload=3111]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:27:44.314911785 (3h0m57.901968026s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 19:27:44.314941310 (3h0m57.901997561s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 19:27:44.620205884 (3h0m58.207262095s) [upload=3111]: Done uploading segments... Aug 7 19:27:44.620221594 (3h0m58.207277804s) [upload=3111]: Upload finished. err: <nil>
Duration: 662.252401ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X........X.............] duration:
510.850044ms
FAIL (2025-08-07 19:35:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== upload Aug 7 19:27:44.006467873 (3h0m57.593524104s) [upload=3111]: Uploading segments... Aug 7 19:27:44.006762594 (3h0m57.593818835s) [upload=3111]: Got next segment. Inline: false Aug 7 19:27:44.006802177 (3h0m57.593858418s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 19:27:44.006807697 (3h0m57.593863939s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 19:27:44.056805204 (3h0m57.643861445s) [seg_pos={0 0}, upload=3111]: Begin upload segment... Aug 7 19:27:44.056847824 (3h0m57.643904055s) [seg_pos={0 0}, upload=3111]: Done begin upload segment. Aug 7 19:27:44.056875095 (3h0m57.643931386s) [noise=true , address=104.36.82.43:4848 , piece_id=BBRVVYNYLMEDVZPFP2F4N5U2MTZDF4JPX2QMPLUYQ4CDKFFWKKPQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.056888329 (3h0m57.64394457s) [noise=true , address=104.36.82.12:4159 , piece_id=YA7AS3EQIYKWEA2NMDAZUJYPIE7G2NGS3HSDVFV2TH7EBHZFCFHQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.056930177 (3h0m57.643986419s) [noise=true , address=104.36.82.16:4303 , piece_id=LIGUJZKXUSDOAY6EBKFCDBSJQ4W2ZTYLS5ZRTMVZ4SB3IPOIRCAA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057326708 (3h0m57.644382949s) [noise=true , address=104.36.82.36:4652 , piece_id=OYDPP7KRAWZI5K3WGROJ7Z2RCW7RXGDQENOGSQJJHNYKNTRVICQQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057335624 (3h0m57.644391866s) [noise=true , address=104.36.82.62:4412 , piece_id=VTW7D5FWI57JQSXSXYVFSGP3DF6LAYY763QILC2L6FD7XOY2PWMA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057710634 (3h0m57.644766875s) [noise=true , address=45.91.116.10:4106 , piece_id=M434Q2FT2O6VAOMNW5OH5DO5GFQTJ2P4QZFIYWN6HHS3LDM5DZQA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057732425 (3h0m57.644788666s) [noise=true , address=104.36.82.60:4349 , piece_id=DW2C5CYLEL4BA6U3CDWN6VW6UJ5N5JE3TUD7MRTUQH5KFMMRD7AQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058048605 (3h0m57.645104846s) [noise=true , address=104.36.82.23:4462 , piece_id=4BTWSC6DSBHTSYQELVQWKAIJALQ7TLSZJA4VIDG4FXCKXJM6KPIA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058075335 (3h0m57.645131576s) [noise=true , address=104.36.82.14:4239 , piece_id=FWDFC254IVBP53YZXMJC74VU23YEONN45ZGO7TJGZ2VAIB5ZTV6A, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058376747 (3h0m57.645432978s) [noise=true , address=104.36.82.47:4532 , piece_id=4GBF3A2LT3TKURVNSPXY7KJNSIOAGLB2P3BCOUJJJBEDKDUFKOMA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058721150 (3h0m57.645777391s) [noise=true , address=104.36.82.8:4992 , piece_id=2R4DIYO5UQXJ56GRK6JA5J6BXWRASRUHF544M6MHDBC6NXAISTJA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059050325 (3h0m57.646106556s) [noise=true , address=104.36.82.55:4201 , piece_id=UCT3UZQGQJCXOBGPJVSFUI26CQYRS5YW3MEWLDZO32UAC56I2OHA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059376785 (3h0m57.646433016s) [noise=true , address=104.36.82.59:4311 , piece_id=TVNTDOMNUCJF4A3YFSXQIXJEAPLFN56HGPJ5DG4I43QVPLW4CZ6Q, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059723321 (3h0m57.646779552s) [noise=true , address=104.36.82.18:4398 , piece_id=GLBCIUKUYNUMCPG2KTKKXS4G26PCPM22QNYJZBQ7LL5DSRZBFYKQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060115413 (3h0m57.647171645s) [noise=true , address=104.36.82.44:4884 , piece_id=3HG77VZOMC7C2BFE2OOR4N7ZUI2R7V3MPTIBYY5BCDPOF2ZVWB3A, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060458384 (3h0m57.647514625s) [noise=true , address=79.127.201.215:4344 , piece_id=3X6ZPSPEPZYDICKWAHHMAIR4MTWPUVTZWMVDIPEKDDCNNB44SMWA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060821732 (3h0m57.647877973s) [noise=true , address=104.36.82.3:4785 , piece_id=ICT5THFHEBQQDELTJI44YTXKKOADC36QTG6PIZTQUK4YH5W6AZRQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.061179059 (3h0m57.64823529s) [noise=true , address=45.91.116.5:4309 , piece_id=2ZAQDU5E26KNU7Q3XQ5HDEECKY6MH7NEBHFNHUXNZQI73FGTVL3Q, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.193291120 (3h0m57.780347371s) [upload=3111]: Next returned nil segment Aug 7 19:27:44.193306900 (3h0m57.780363151s) [upload=3111]: Waiting for error group managing segments... Aug 7 19:27:44.209607597 (3h0m57.796663838s) [noise=true , address=104.36.82.43:4848 , piece_id=BBRVVYNYLMEDVZPFP2F4N5U2MTZDF4JPX2QMPLUYQ4CDKFFWKKPQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.211275410 (3h0m57.798331651s) [noise=true , address=104.36.82.47:4532 , piece_id=4GBF3A2LT3TKURVNSPXY7KJNSIOAGLB2P3BCOUJJJBEDKDUFKOMA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.217863949 (3h0m57.8049202s) [noise=true , address=104.36.82.60:4349 , piece_id=DW2C5CYLEL4BA6U3CDWN6VW6UJ5N5JE3TUD7MRTUQH5KFMMRD7AQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.219360643 (3h0m57.806416894s) [noise=true , address=104.36.82.59:4311 , piece_id=TVNTDOMNUCJF4A3YFSXQIXJEAPLFN56HGPJ5DG4I43QVPLW4CZ6Q, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.220779782 (3h0m57.807836022s) [noise=true , address=104.36.82.55:4201 , piece_id=UCT3UZQGQJCXOBGPJVSFUI26CQYRS5YW3MEWLDZO32UAC56I2OHA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.221735776 (3h0m57.808792018s) [noise=true , address=104.36.82.62:4412 , piece_id=VTW7D5FWI57JQSXSXYVFSGP3DF6LAYY763QILC2L6FD7XOY2PWMA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.224644716 (3h0m57.811700957s) [noise=true , address=45.91.116.10:4106 , piece_id=M434Q2FT2O6VAOMNW5OH5DO5GFQTJ2P4QZFIYWN6HHS3LDM5DZQA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.229617950 (3h0m57.816674191s) [noise=true , address=104.36.82.14:4239 , piece_id=FWDFC254IVBP53YZXMJC74VU23YEONN45ZGO7TJGZ2VAIB5ZTV6A, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.230697154 (3h0m57.817753395s) [noise=true , address=104.36.82.18:4398 , piece_id=GLBCIUKUYNUMCPG2KTKKXS4G26PCPM22QNYJZBQ7LL5DSRZBFYKQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.234957226 (3h0m57.822013468s) [noise=true , address=104.36.82.12:4159 , piece_id=YA7AS3EQIYKWEA2NMDAZUJYPIE7G2NGS3HSDVFV2TH7EBHZFCFHQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.237122999 (3h0m57.82417924s) [noise=true , address=45.91.116.5:4309 , piece_id=2ZAQDU5E26KNU7Q3XQ5HDEECKY6MH7NEBHFNHUXNZQI73FGTVL3Q, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.243298527 (3h0m57.830354768s) [noise=true , address=104.36.82.3:4785 , piece_id=ICT5THFHEBQQDELTJI44YTXKKOADC36QTG6PIZTQUK4YH5W6AZRQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.305437629 (3h0m57.892493871s) [noise=true , address=79.127.201.215:4344 , piece_id=3X6ZPSPEPZYDICKWAHHMAIR4MTWPUVTZWMVDIPEKDDCNNB44SMWA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.314176622 (3h0m57.901232863s) [noise=true , address=104.36.82.36:4652 , piece_id=OYDPP7KRAWZI5K3WGROJ7Z2RCW7RXGDQENOGSQJJHNYKNTRVICQQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.314225393 (3h0m57.901281635s) [seg_pos={0 0}, upload=3111]: Segment reached optimal threshold of 14 pieces. Aug 7 19:27:44.314403605 (3h0m57.901459847s) [noise=true , address=104.36.82.44:4884 , piece_id=3HG77VZOMC7C2BFE2OOR4N7ZUI2R7V3MPTIBYY5BCDPOF2ZVWB3A, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF Aug 7 19:27:44.314450183 (3h0m57.901506424s) [noise=true , address=104.36.82.16:4303 , piece_id=LIGUJZKXUSDOAY6EBKFCDBSJQ4W2ZTYLS5ZRTMVZ4SB3IPOIRCAA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ec4Xvp3nGRAm9BivLLTp6AVkMoz1i2AgXQdfQaAmNPLHWD4Yv): protocol: expected piece hash; context canceled; EOF Aug 7 19:27:44.314752737 (3h0m57.901808979s) [noise=true , address=104.36.82.23:4462 , piece_id=4BTWSC6DSBHTSYQELVQWKAIJALQ7TLSZJA4VIDG4FXCKXJM6KPIA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YirC8WVSoE1qrWGMmayNmCsDLxjUhggrgXL5unKtQjsfUkbMu): protocol: read tcp 5.161.89.252:19630->104.36.82.23:4462: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.314762766 (3h0m57.901819017s) [noise=true , address=104.36.82.8:4992 , piece_id=2R4DIYO5UQXJ56GRK6JA5J6BXWRASRUHF544M6MHDBC6NXAISTJA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hbt8HKTunpPKyAzH4XBwGQqTKzcgqPpoWwKZm9JMtaK8P7aVp): protocol: write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection; write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection Aug 7 19:27:44.314798644 (3h0m57.901854884s) [seg_pos={0 0}, upload=3111]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:27:44.314911785 (3h0m57.901968026s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 19:27:44.314941310 (3h0m57.901997561s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 19:27:44.620205884 (3h0m58.207262095s) [upload=3111]: Done uploading segments... Aug 7 19:27:44.620221594 (3h0m58.207277804s) [upload=3111]: Upload finished. err: <nil>
Duration: 510.86921ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................................X........X............] duration:
441.936317ms
FAIL (2025-08-07 19:35:17 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== upload Aug 7 19:27:44.006467873 (3h0m57.593524104s) [upload=3111]: Uploading segments... Aug 7 19:27:44.006762594 (3h0m57.593818835s) [upload=3111]: Got next segment. Inline: false Aug 7 19:27:44.006802177 (3h0m57.593858418s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 19:27:44.006807697 (3h0m57.593863939s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 19:27:44.056805204 (3h0m57.643861445s) [seg_pos={0 0}, upload=3111]: Begin upload segment... Aug 7 19:27:44.056847824 (3h0m57.643904055s) [seg_pos={0 0}, upload=3111]: Done begin upload segment. Aug 7 19:27:44.056875095 (3h0m57.643931386s) [noise=true , address=104.36.82.43:4848 , piece_id=BBRVVYNYLMEDVZPFP2F4N5U2MTZDF4JPX2QMPLUYQ4CDKFFWKKPQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.056888329 (3h0m57.64394457s) [noise=true , address=104.36.82.12:4159 , piece_id=YA7AS3EQIYKWEA2NMDAZUJYPIE7G2NGS3HSDVFV2TH7EBHZFCFHQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.056930177 (3h0m57.643986419s) [noise=true , address=104.36.82.16:4303 , piece_id=LIGUJZKXUSDOAY6EBKFCDBSJQ4W2ZTYLS5ZRTMVZ4SB3IPOIRCAA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057326708 (3h0m57.644382949s) [noise=true , address=104.36.82.36:4652 , piece_id=OYDPP7KRAWZI5K3WGROJ7Z2RCW7RXGDQENOGSQJJHNYKNTRVICQQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057335624 (3h0m57.644391866s) [noise=true , address=104.36.82.62:4412 , piece_id=VTW7D5FWI57JQSXSXYVFSGP3DF6LAYY763QILC2L6FD7XOY2PWMA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057710634 (3h0m57.644766875s) [noise=true , address=45.91.116.10:4106 , piece_id=M434Q2FT2O6VAOMNW5OH5DO5GFQTJ2P4QZFIYWN6HHS3LDM5DZQA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057732425 (3h0m57.644788666s) [noise=true , address=104.36.82.60:4349 , piece_id=DW2C5CYLEL4BA6U3CDWN6VW6UJ5N5JE3TUD7MRTUQH5KFMMRD7AQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058048605 (3h0m57.645104846s) [noise=true , address=104.36.82.23:4462 , piece_id=4BTWSC6DSBHTSYQELVQWKAIJALQ7TLSZJA4VIDG4FXCKXJM6KPIA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058075335 (3h0m57.645131576s) [noise=true , address=104.36.82.14:4239 , piece_id=FWDFC254IVBP53YZXMJC74VU23YEONN45ZGO7TJGZ2VAIB5ZTV6A, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058376747 (3h0m57.645432978s) [noise=true , address=104.36.82.47:4532 , piece_id=4GBF3A2LT3TKURVNSPXY7KJNSIOAGLB2P3BCOUJJJBEDKDUFKOMA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058721150 (3h0m57.645777391s) [noise=true , address=104.36.82.8:4992 , piece_id=2R4DIYO5UQXJ56GRK6JA5J6BXWRASRUHF544M6MHDBC6NXAISTJA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059050325 (3h0m57.646106556s) [noise=true , address=104.36.82.55:4201 , piece_id=UCT3UZQGQJCXOBGPJVSFUI26CQYRS5YW3MEWLDZO32UAC56I2OHA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059376785 (3h0m57.646433016s) [noise=true , address=104.36.82.59:4311 , piece_id=TVNTDOMNUCJF4A3YFSXQIXJEAPLFN56HGPJ5DG4I43QVPLW4CZ6Q, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059723321 (3h0m57.646779552s) [noise=true , address=104.36.82.18:4398 , piece_id=GLBCIUKUYNUMCPG2KTKKXS4G26PCPM22QNYJZBQ7LL5DSRZBFYKQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060115413 (3h0m57.647171645s) [noise=true , address=104.36.82.44:4884 , piece_id=3HG77VZOMC7C2BFE2OOR4N7ZUI2R7V3MPTIBYY5BCDPOF2ZVWB3A, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060458384 (3h0m57.647514625s) [noise=true , address=79.127.201.215:4344 , piece_id=3X6ZPSPEPZYDICKWAHHMAIR4MTWPUVTZWMVDIPEKDDCNNB44SMWA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060821732 (3h0m57.647877973s) [noise=true , address=104.36.82.3:4785 , piece_id=ICT5THFHEBQQDELTJI44YTXKKOADC36QTG6PIZTQUK4YH5W6AZRQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.061179059 (3h0m57.64823529s) [noise=true , address=45.91.116.5:4309 , piece_id=2ZAQDU5E26KNU7Q3XQ5HDEECKY6MH7NEBHFNHUXNZQI73FGTVL3Q, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.193291120 (3h0m57.780347371s) [upload=3111]: Next returned nil segment Aug 7 19:27:44.193306900 (3h0m57.780363151s) [upload=3111]: Waiting for error group managing segments... Aug 7 19:27:44.209607597 (3h0m57.796663838s) [noise=true , address=104.36.82.43:4848 , piece_id=BBRVVYNYLMEDVZPFP2F4N5U2MTZDF4JPX2QMPLUYQ4CDKFFWKKPQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.211275410 (3h0m57.798331651s) [noise=true , address=104.36.82.47:4532 , piece_id=4GBF3A2LT3TKURVNSPXY7KJNSIOAGLB2P3BCOUJJJBEDKDUFKOMA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.217863949 (3h0m57.8049202s) [noise=true , address=104.36.82.60:4349 , piece_id=DW2C5CYLEL4BA6U3CDWN6VW6UJ5N5JE3TUD7MRTUQH5KFMMRD7AQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.219360643 (3h0m57.806416894s) [noise=true , address=104.36.82.59:4311 , piece_id=TVNTDOMNUCJF4A3YFSXQIXJEAPLFN56HGPJ5DG4I43QVPLW4CZ6Q, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.220779782 (3h0m57.807836022s) [noise=true , address=104.36.82.55:4201 , piece_id=UCT3UZQGQJCXOBGPJVSFUI26CQYRS5YW3MEWLDZO32UAC56I2OHA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.221735776 (3h0m57.808792018s) [noise=true , address=104.36.82.62:4412 , piece_id=VTW7D5FWI57JQSXSXYVFSGP3DF6LAYY763QILC2L6FD7XOY2PWMA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.224644716 (3h0m57.811700957s) [noise=true , address=45.91.116.10:4106 , piece_id=M434Q2FT2O6VAOMNW5OH5DO5GFQTJ2P4QZFIYWN6HHS3LDM5DZQA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.229617950 (3h0m57.816674191s) [noise=true , address=104.36.82.14:4239 , piece_id=FWDFC254IVBP53YZXMJC74VU23YEONN45ZGO7TJGZ2VAIB5ZTV6A, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.230697154 (3h0m57.817753395s) [noise=true , address=104.36.82.18:4398 , piece_id=GLBCIUKUYNUMCPG2KTKKXS4G26PCPM22QNYJZBQ7LL5DSRZBFYKQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.234957226 (3h0m57.822013468s) [noise=true , address=104.36.82.12:4159 , piece_id=YA7AS3EQIYKWEA2NMDAZUJYPIE7G2NGS3HSDVFV2TH7EBHZFCFHQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.237122999 (3h0m57.82417924s) [noise=true , address=45.91.116.5:4309 , piece_id=2ZAQDU5E26KNU7Q3XQ5HDEECKY6MH7NEBHFNHUXNZQI73FGTVL3Q, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.243298527 (3h0m57.830354768s) [noise=true , address=104.36.82.3:4785 , piece_id=ICT5THFHEBQQDELTJI44YTXKKOADC36QTG6PIZTQUK4YH5W6AZRQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.305437629 (3h0m57.892493871s) [noise=true , address=79.127.201.215:4344 , piece_id=3X6ZPSPEPZYDICKWAHHMAIR4MTWPUVTZWMVDIPEKDDCNNB44SMWA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.314176622 (3h0m57.901232863s) [noise=true , address=104.36.82.36:4652 , piece_id=OYDPP7KRAWZI5K3WGROJ7Z2RCW7RXGDQENOGSQJJHNYKNTRVICQQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.314225393 (3h0m57.901281635s) [seg_pos={0 0}, upload=3111]: Segment reached optimal threshold of 14 pieces. Aug 7 19:27:44.314403605 (3h0m57.901459847s) [noise=true , address=104.36.82.44:4884 , piece_id=3HG77VZOMC7C2BFE2OOR4N7ZUI2R7V3MPTIBYY5BCDPOF2ZVWB3A, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF Aug 7 19:27:44.314450183 (3h0m57.901506424s) [noise=true , address=104.36.82.16:4303 , piece_id=LIGUJZKXUSDOAY6EBKFCDBSJQ4W2ZTYLS5ZRTMVZ4SB3IPOIRCAA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ec4Xvp3nGRAm9BivLLTp6AVkMoz1i2AgXQdfQaAmNPLHWD4Yv): protocol: expected piece hash; context canceled; EOF Aug 7 19:27:44.314752737 (3h0m57.901808979s) [noise=true , address=104.36.82.23:4462 , piece_id=4BTWSC6DSBHTSYQELVQWKAIJALQ7TLSZJA4VIDG4FXCKXJM6KPIA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YirC8WVSoE1qrWGMmayNmCsDLxjUhggrgXL5unKtQjsfUkbMu): protocol: read tcp 5.161.89.252:19630->104.36.82.23:4462: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.314762766 (3h0m57.901819017s) [noise=true , address=104.36.82.8:4992 , piece_id=2R4DIYO5UQXJ56GRK6JA5J6BXWRASRUHF544M6MHDBC6NXAISTJA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hbt8HKTunpPKyAzH4XBwGQqTKzcgqPpoWwKZm9JMtaK8P7aVp): protocol: write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection; write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection Aug 7 19:27:44.314798644 (3h0m57.901854884s) [seg_pos={0 0}, upload=3111]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:27:44.314911785 (3h0m57.901968026s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 19:27:44.314941310 (3h0m57.901997561s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 19:27:44.620205884 (3h0m58.207262095s) [upload=3111]: Done uploading segments... Aug 7 19:27:44.620221594 (3h0m58.207277804s) [upload=3111]: Upload finished. err: <nil>
Duration: 441.979416ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................................X........X...........] duration:
583.483026ms
FAIL (2025-08-07 19:34:45 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== upload Aug 7 19:27:44.006467873 (3h0m57.593524104s) [upload=3111]: Uploading segments... Aug 7 19:27:44.006762594 (3h0m57.593818835s) [upload=3111]: Got next segment. Inline: false Aug 7 19:27:44.006802177 (3h0m57.593858418s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 19:27:44.006807697 (3h0m57.593863939s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 19:27:44.056805204 (3h0m57.643861445s) [seg_pos={0 0}, upload=3111]: Begin upload segment... Aug 7 19:27:44.056847824 (3h0m57.643904055s) [seg_pos={0 0}, upload=3111]: Done begin upload segment. Aug 7 19:27:44.056875095 (3h0m57.643931386s) [noise=true , address=104.36.82.43:4848 , piece_id=BBRVVYNYLMEDVZPFP2F4N5U2MTZDF4JPX2QMPLUYQ4CDKFFWKKPQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.056888329 (3h0m57.64394457s) [noise=true , address=104.36.82.12:4159 , piece_id=YA7AS3EQIYKWEA2NMDAZUJYPIE7G2NGS3HSDVFV2TH7EBHZFCFHQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.056930177 (3h0m57.643986419s) [noise=true , address=104.36.82.16:4303 , piece_id=LIGUJZKXUSDOAY6EBKFCDBSJQ4W2ZTYLS5ZRTMVZ4SB3IPOIRCAA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057326708 (3h0m57.644382949s) [noise=true , address=104.36.82.36:4652 , piece_id=OYDPP7KRAWZI5K3WGROJ7Z2RCW7RXGDQENOGSQJJHNYKNTRVICQQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057335624 (3h0m57.644391866s) [noise=true , address=104.36.82.62:4412 , piece_id=VTW7D5FWI57JQSXSXYVFSGP3DF6LAYY763QILC2L6FD7XOY2PWMA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057710634 (3h0m57.644766875s) [noise=true , address=45.91.116.10:4106 , piece_id=M434Q2FT2O6VAOMNW5OH5DO5GFQTJ2P4QZFIYWN6HHS3LDM5DZQA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057732425 (3h0m57.644788666s) [noise=true , address=104.36.82.60:4349 , piece_id=DW2C5CYLEL4BA6U3CDWN6VW6UJ5N5JE3TUD7MRTUQH5KFMMRD7AQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058048605 (3h0m57.645104846s) [noise=true , address=104.36.82.23:4462 , piece_id=4BTWSC6DSBHTSYQELVQWKAIJALQ7TLSZJA4VIDG4FXCKXJM6KPIA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058075335 (3h0m57.645131576s) [noise=true , address=104.36.82.14:4239 , piece_id=FWDFC254IVBP53YZXMJC74VU23YEONN45ZGO7TJGZ2VAIB5ZTV6A, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058376747 (3h0m57.645432978s) [noise=true , address=104.36.82.47:4532 , piece_id=4GBF3A2LT3TKURVNSPXY7KJNSIOAGLB2P3BCOUJJJBEDKDUFKOMA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058721150 (3h0m57.645777391s) [noise=true , address=104.36.82.8:4992 , piece_id=2R4DIYO5UQXJ56GRK6JA5J6BXWRASRUHF544M6MHDBC6NXAISTJA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059050325 (3h0m57.646106556s) [noise=true , address=104.36.82.55:4201 , piece_id=UCT3UZQGQJCXOBGPJVSFUI26CQYRS5YW3MEWLDZO32UAC56I2OHA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059376785 (3h0m57.646433016s) [noise=true , address=104.36.82.59:4311 , piece_id=TVNTDOMNUCJF4A3YFSXQIXJEAPLFN56HGPJ5DG4I43QVPLW4CZ6Q, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059723321 (3h0m57.646779552s) [noise=true , address=104.36.82.18:4398 , piece_id=GLBCIUKUYNUMCPG2KTKKXS4G26PCPM22QNYJZBQ7LL5DSRZBFYKQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060115413 (3h0m57.647171645s) [noise=true , address=104.36.82.44:4884 , piece_id=3HG77VZOMC7C2BFE2OOR4N7ZUI2R7V3MPTIBYY5BCDPOF2ZVWB3A, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060458384 (3h0m57.647514625s) [noise=true , address=79.127.201.215:4344 , piece_id=3X6ZPSPEPZYDICKWAHHMAIR4MTWPUVTZWMVDIPEKDDCNNB44SMWA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060821732 (3h0m57.647877973s) [noise=true , address=104.36.82.3:4785 , piece_id=ICT5THFHEBQQDELTJI44YTXKKOADC36QTG6PIZTQUK4YH5W6AZRQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.061179059 (3h0m57.64823529s) [noise=true , address=45.91.116.5:4309 , piece_id=2ZAQDU5E26KNU7Q3XQ5HDEECKY6MH7NEBHFNHUXNZQI73FGTVL3Q, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.193291120 (3h0m57.780347371s) [upload=3111]: Next returned nil segment Aug 7 19:27:44.193306900 (3h0m57.780363151s) [upload=3111]: Waiting for error group managing segments... Aug 7 19:27:44.209607597 (3h0m57.796663838s) [noise=true , address=104.36.82.43:4848 , piece_id=BBRVVYNYLMEDVZPFP2F4N5U2MTZDF4JPX2QMPLUYQ4CDKFFWKKPQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.211275410 (3h0m57.798331651s) [noise=true , address=104.36.82.47:4532 , piece_id=4GBF3A2LT3TKURVNSPXY7KJNSIOAGLB2P3BCOUJJJBEDKDUFKOMA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.217863949 (3h0m57.8049202s) [noise=true , address=104.36.82.60:4349 , piece_id=DW2C5CYLEL4BA6U3CDWN6VW6UJ5N5JE3TUD7MRTUQH5KFMMRD7AQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.219360643 (3h0m57.806416894s) [noise=true , address=104.36.82.59:4311 , piece_id=TVNTDOMNUCJF4A3YFSXQIXJEAPLFN56HGPJ5DG4I43QVPLW4CZ6Q, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.220779782 (3h0m57.807836022s) [noise=true , address=104.36.82.55:4201 , piece_id=UCT3UZQGQJCXOBGPJVSFUI26CQYRS5YW3MEWLDZO32UAC56I2OHA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.221735776 (3h0m57.808792018s) [noise=true , address=104.36.82.62:4412 , piece_id=VTW7D5FWI57JQSXSXYVFSGP3DF6LAYY763QILC2L6FD7XOY2PWMA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.224644716 (3h0m57.811700957s) [noise=true , address=45.91.116.10:4106 , piece_id=M434Q2FT2O6VAOMNW5OH5DO5GFQTJ2P4QZFIYWN6HHS3LDM5DZQA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.229617950 (3h0m57.816674191s) [noise=true , address=104.36.82.14:4239 , piece_id=FWDFC254IVBP53YZXMJC74VU23YEONN45ZGO7TJGZ2VAIB5ZTV6A, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.230697154 (3h0m57.817753395s) [noise=true , address=104.36.82.18:4398 , piece_id=GLBCIUKUYNUMCPG2KTKKXS4G26PCPM22QNYJZBQ7LL5DSRZBFYKQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.234957226 (3h0m57.822013468s) [noise=true , address=104.36.82.12:4159 , piece_id=YA7AS3EQIYKWEA2NMDAZUJYPIE7G2NGS3HSDVFV2TH7EBHZFCFHQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.237122999 (3h0m57.82417924s) [noise=true , address=45.91.116.5:4309 , piece_id=2ZAQDU5E26KNU7Q3XQ5HDEECKY6MH7NEBHFNHUXNZQI73FGTVL3Q, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.243298527 (3h0m57.830354768s) [noise=true , address=104.36.82.3:4785 , piece_id=ICT5THFHEBQQDELTJI44YTXKKOADC36QTG6PIZTQUK4YH5W6AZRQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.305437629 (3h0m57.892493871s) [noise=true , address=79.127.201.215:4344 , piece_id=3X6ZPSPEPZYDICKWAHHMAIR4MTWPUVTZWMVDIPEKDDCNNB44SMWA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.314176622 (3h0m57.901232863s) [noise=true , address=104.36.82.36:4652 , piece_id=OYDPP7KRAWZI5K3WGROJ7Z2RCW7RXGDQENOGSQJJHNYKNTRVICQQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.314225393 (3h0m57.901281635s) [seg_pos={0 0}, upload=3111]: Segment reached optimal threshold of 14 pieces. Aug 7 19:27:44.314403605 (3h0m57.901459847s) [noise=true , address=104.36.82.44:4884 , piece_id=3HG77VZOMC7C2BFE2OOR4N7ZUI2R7V3MPTIBYY5BCDPOF2ZVWB3A, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF Aug 7 19:27:44.314450183 (3h0m57.901506424s) [noise=true , address=104.36.82.16:4303 , piece_id=LIGUJZKXUSDOAY6EBKFCDBSJQ4W2ZTYLS5ZRTMVZ4SB3IPOIRCAA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ec4Xvp3nGRAm9BivLLTp6AVkMoz1i2AgXQdfQaAmNPLHWD4Yv): protocol: expected piece hash; context canceled; EOF Aug 7 19:27:44.314752737 (3h0m57.901808979s) [noise=true , address=104.36.82.23:4462 , piece_id=4BTWSC6DSBHTSYQELVQWKAIJALQ7TLSZJA4VIDG4FXCKXJM6KPIA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YirC8WVSoE1qrWGMmayNmCsDLxjUhggrgXL5unKtQjsfUkbMu): protocol: read tcp 5.161.89.252:19630->104.36.82.23:4462: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.314762766 (3h0m57.901819017s) [noise=true , address=104.36.82.8:4992 , piece_id=2R4DIYO5UQXJ56GRK6JA5J6BXWRASRUHF544M6MHDBC6NXAISTJA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hbt8HKTunpPKyAzH4XBwGQqTKzcgqPpoWwKZm9JMtaK8P7aVp): protocol: write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection; write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection Aug 7 19:27:44.314798644 (3h0m57.901854884s) [seg_pos={0 0}, upload=3111]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:27:44.314911785 (3h0m57.901968026s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 19:27:44.314941310 (3h0m57.901997561s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 19:27:44.620205884 (3h0m58.207262095s) [upload=3111]: Done uploading segments... Aug 7 19:27:44.620221594 (3h0m58.207277804s) [upload=3111]: Upload finished. err: <nil>
Duration: 583.507904ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................................X........X..........] duration:
1.134088333s
FAIL (2025-08-07 19:34:17 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== upload Aug 7 19:27:44.006467873 (3h0m57.593524104s) [upload=3111]: Uploading segments... Aug 7 19:27:44.006762594 (3h0m57.593818835s) [upload=3111]: Got next segment. Inline: false Aug 7 19:27:44.006802177 (3h0m57.593858418s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 19:27:44.006807697 (3h0m57.593863939s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 19:27:44.056805204 (3h0m57.643861445s) [seg_pos={0 0}, upload=3111]: Begin upload segment... Aug 7 19:27:44.056847824 (3h0m57.643904055s) [seg_pos={0 0}, upload=3111]: Done begin upload segment. Aug 7 19:27:44.056875095 (3h0m57.643931386s) [noise=true , address=104.36.82.43:4848 , piece_id=BBRVVYNYLMEDVZPFP2F4N5U2MTZDF4JPX2QMPLUYQ4CDKFFWKKPQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.056888329 (3h0m57.64394457s) [noise=true , address=104.36.82.12:4159 , piece_id=YA7AS3EQIYKWEA2NMDAZUJYPIE7G2NGS3HSDVFV2TH7EBHZFCFHQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.056930177 (3h0m57.643986419s) [noise=true , address=104.36.82.16:4303 , piece_id=LIGUJZKXUSDOAY6EBKFCDBSJQ4W2ZTYLS5ZRTMVZ4SB3IPOIRCAA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057326708 (3h0m57.644382949s) [noise=true , address=104.36.82.36:4652 , piece_id=OYDPP7KRAWZI5K3WGROJ7Z2RCW7RXGDQENOGSQJJHNYKNTRVICQQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057335624 (3h0m57.644391866s) [noise=true , address=104.36.82.62:4412 , piece_id=VTW7D5FWI57JQSXSXYVFSGP3DF6LAYY763QILC2L6FD7XOY2PWMA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057710634 (3h0m57.644766875s) [noise=true , address=45.91.116.10:4106 , piece_id=M434Q2FT2O6VAOMNW5OH5DO5GFQTJ2P4QZFIYWN6HHS3LDM5DZQA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057732425 (3h0m57.644788666s) [noise=true , address=104.36.82.60:4349 , piece_id=DW2C5CYLEL4BA6U3CDWN6VW6UJ5N5JE3TUD7MRTUQH5KFMMRD7AQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058048605 (3h0m57.645104846s) [noise=true , address=104.36.82.23:4462 , piece_id=4BTWSC6DSBHTSYQELVQWKAIJALQ7TLSZJA4VIDG4FXCKXJM6KPIA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058075335 (3h0m57.645131576s) [noise=true , address=104.36.82.14:4239 , piece_id=FWDFC254IVBP53YZXMJC74VU23YEONN45ZGO7TJGZ2VAIB5ZTV6A, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058376747 (3h0m57.645432978s) [noise=true , address=104.36.82.47:4532 , piece_id=4GBF3A2LT3TKURVNSPXY7KJNSIOAGLB2P3BCOUJJJBEDKDUFKOMA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058721150 (3h0m57.645777391s) [noise=true , address=104.36.82.8:4992 , piece_id=2R4DIYO5UQXJ56GRK6JA5J6BXWRASRUHF544M6MHDBC6NXAISTJA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059050325 (3h0m57.646106556s) [noise=true , address=104.36.82.55:4201 , piece_id=UCT3UZQGQJCXOBGPJVSFUI26CQYRS5YW3MEWLDZO32UAC56I2OHA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059376785 (3h0m57.646433016s) [noise=true , address=104.36.82.59:4311 , piece_id=TVNTDOMNUCJF4A3YFSXQIXJEAPLFN56HGPJ5DG4I43QVPLW4CZ6Q, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059723321 (3h0m57.646779552s) [noise=true , address=104.36.82.18:4398 , piece_id=GLBCIUKUYNUMCPG2KTKKXS4G26PCPM22QNYJZBQ7LL5DSRZBFYKQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060115413 (3h0m57.647171645s) [noise=true , address=104.36.82.44:4884 , piece_id=3HG77VZOMC7C2BFE2OOR4N7ZUI2R7V3MPTIBYY5BCDPOF2ZVWB3A, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060458384 (3h0m57.647514625s) [noise=true , address=79.127.201.215:4344 , piece_id=3X6ZPSPEPZYDICKWAHHMAIR4MTWPUVTZWMVDIPEKDDCNNB44SMWA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060821732 (3h0m57.647877973s) [noise=true , address=104.36.82.3:4785 , piece_id=ICT5THFHEBQQDELTJI44YTXKKOADC36QTG6PIZTQUK4YH5W6AZRQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.061179059 (3h0m57.64823529s) [noise=true , address=45.91.116.5:4309 , piece_id=2ZAQDU5E26KNU7Q3XQ5HDEECKY6MH7NEBHFNHUXNZQI73FGTVL3Q, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.193291120 (3h0m57.780347371s) [upload=3111]: Next returned nil segment Aug 7 19:27:44.193306900 (3h0m57.780363151s) [upload=3111]: Waiting for error group managing segments... Aug 7 19:27:44.209607597 (3h0m57.796663838s) [noise=true , address=104.36.82.43:4848 , piece_id=BBRVVYNYLMEDVZPFP2F4N5U2MTZDF4JPX2QMPLUYQ4CDKFFWKKPQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.211275410 (3h0m57.798331651s) [noise=true , address=104.36.82.47:4532 , piece_id=4GBF3A2LT3TKURVNSPXY7KJNSIOAGLB2P3BCOUJJJBEDKDUFKOMA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.217863949 (3h0m57.8049202s) [noise=true , address=104.36.82.60:4349 , piece_id=DW2C5CYLEL4BA6U3CDWN6VW6UJ5N5JE3TUD7MRTUQH5KFMMRD7AQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.219360643 (3h0m57.806416894s) [noise=true , address=104.36.82.59:4311 , piece_id=TVNTDOMNUCJF4A3YFSXQIXJEAPLFN56HGPJ5DG4I43QVPLW4CZ6Q, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.220779782 (3h0m57.807836022s) [noise=true , address=104.36.82.55:4201 , piece_id=UCT3UZQGQJCXOBGPJVSFUI26CQYRS5YW3MEWLDZO32UAC56I2OHA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.221735776 (3h0m57.808792018s) [noise=true , address=104.36.82.62:4412 , piece_id=VTW7D5FWI57JQSXSXYVFSGP3DF6LAYY763QILC2L6FD7XOY2PWMA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.224644716 (3h0m57.811700957s) [noise=true , address=45.91.116.10:4106 , piece_id=M434Q2FT2O6VAOMNW5OH5DO5GFQTJ2P4QZFIYWN6HHS3LDM5DZQA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.229617950 (3h0m57.816674191s) [noise=true , address=104.36.82.14:4239 , piece_id=FWDFC254IVBP53YZXMJC74VU23YEONN45ZGO7TJGZ2VAIB5ZTV6A, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.230697154 (3h0m57.817753395s) [noise=true , address=104.36.82.18:4398 , piece_id=GLBCIUKUYNUMCPG2KTKKXS4G26PCPM22QNYJZBQ7LL5DSRZBFYKQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.234957226 (3h0m57.822013468s) [noise=true , address=104.36.82.12:4159 , piece_id=YA7AS3EQIYKWEA2NMDAZUJYPIE7G2NGS3HSDVFV2TH7EBHZFCFHQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.237122999 (3h0m57.82417924s) [noise=true , address=45.91.116.5:4309 , piece_id=2ZAQDU5E26KNU7Q3XQ5HDEECKY6MH7NEBHFNHUXNZQI73FGTVL3Q, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.243298527 (3h0m57.830354768s) [noise=true , address=104.36.82.3:4785 , piece_id=ICT5THFHEBQQDELTJI44YTXKKOADC36QTG6PIZTQUK4YH5W6AZRQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.305437629 (3h0m57.892493871s) [noise=true , address=79.127.201.215:4344 , piece_id=3X6ZPSPEPZYDICKWAHHMAIR4MTWPUVTZWMVDIPEKDDCNNB44SMWA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.314176622 (3h0m57.901232863s) [noise=true , address=104.36.82.36:4652 , piece_id=OYDPP7KRAWZI5K3WGROJ7Z2RCW7RXGDQENOGSQJJHNYKNTRVICQQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.314225393 (3h0m57.901281635s) [seg_pos={0 0}, upload=3111]: Segment reached optimal threshold of 14 pieces. Aug 7 19:27:44.314403605 (3h0m57.901459847s) [noise=true , address=104.36.82.44:4884 , piece_id=3HG77VZOMC7C2BFE2OOR4N7ZUI2R7V3MPTIBYY5BCDPOF2ZVWB3A, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF Aug 7 19:27:44.314450183 (3h0m57.901506424s) [noise=true , address=104.36.82.16:4303 , piece_id=LIGUJZKXUSDOAY6EBKFCDBSJQ4W2ZTYLS5ZRTMVZ4SB3IPOIRCAA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ec4Xvp3nGRAm9BivLLTp6AVkMoz1i2AgXQdfQaAmNPLHWD4Yv): protocol: expected piece hash; context canceled; EOF Aug 7 19:27:44.314752737 (3h0m57.901808979s) [noise=true , address=104.36.82.23:4462 , piece_id=4BTWSC6DSBHTSYQELVQWKAIJALQ7TLSZJA4VIDG4FXCKXJM6KPIA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YirC8WVSoE1qrWGMmayNmCsDLxjUhggrgXL5unKtQjsfUkbMu): protocol: read tcp 5.161.89.252:19630->104.36.82.23:4462: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.314762766 (3h0m57.901819017s) [noise=true , address=104.36.82.8:4992 , piece_id=2R4DIYO5UQXJ56GRK6JA5J6BXWRASRUHF544M6MHDBC6NXAISTJA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hbt8HKTunpPKyAzH4XBwGQqTKzcgqPpoWwKZm9JMtaK8P7aVp): protocol: write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection; write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection Aug 7 19:27:44.314798644 (3h0m57.901854884s) [seg_pos={0 0}, upload=3111]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:27:44.314911785 (3h0m57.901968026s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 19:27:44.314941310 (3h0m57.901997561s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 19:27:44.620205884 (3h0m58.207262095s) [upload=3111]: Done uploading segments... Aug 7 19:27:44.620221594 (3h0m58.207277804s) [upload=3111]: Upload finished. err: <nil>
Duration: 1.134120953s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................................X........X.........] duration:
422.419124ms
FAIL (2025-08-07 19:34:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== upload Aug 7 19:27:44.006467873 (3h0m57.593524104s) [upload=3111]: Uploading segments... Aug 7 19:27:44.006762594 (3h0m57.593818835s) [upload=3111]: Got next segment. Inline: false Aug 7 19:27:44.006802177 (3h0m57.593858418s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 19:27:44.006807697 (3h0m57.593863939s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 19:27:44.056805204 (3h0m57.643861445s) [seg_pos={0 0}, upload=3111]: Begin upload segment... Aug 7 19:27:44.056847824 (3h0m57.643904055s) [seg_pos={0 0}, upload=3111]: Done begin upload segment. Aug 7 19:27:44.056875095 (3h0m57.643931386s) [noise=true , address=104.36.82.43:4848 , piece_id=BBRVVYNYLMEDVZPFP2F4N5U2MTZDF4JPX2QMPLUYQ4CDKFFWKKPQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.056888329 (3h0m57.64394457s) [noise=true , address=104.36.82.12:4159 , piece_id=YA7AS3EQIYKWEA2NMDAZUJYPIE7G2NGS3HSDVFV2TH7EBHZFCFHQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.056930177 (3h0m57.643986419s) [noise=true , address=104.36.82.16:4303 , piece_id=LIGUJZKXUSDOAY6EBKFCDBSJQ4W2ZTYLS5ZRTMVZ4SB3IPOIRCAA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057326708 (3h0m57.644382949s) [noise=true , address=104.36.82.36:4652 , piece_id=OYDPP7KRAWZI5K3WGROJ7Z2RCW7RXGDQENOGSQJJHNYKNTRVICQQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057335624 (3h0m57.644391866s) [noise=true , address=104.36.82.62:4412 , piece_id=VTW7D5FWI57JQSXSXYVFSGP3DF6LAYY763QILC2L6FD7XOY2PWMA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057710634 (3h0m57.644766875s) [noise=true , address=45.91.116.10:4106 , piece_id=M434Q2FT2O6VAOMNW5OH5DO5GFQTJ2P4QZFIYWN6HHS3LDM5DZQA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057732425 (3h0m57.644788666s) [noise=true , address=104.36.82.60:4349 , piece_id=DW2C5CYLEL4BA6U3CDWN6VW6UJ5N5JE3TUD7MRTUQH5KFMMRD7AQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058048605 (3h0m57.645104846s) [noise=true , address=104.36.82.23:4462 , piece_id=4BTWSC6DSBHTSYQELVQWKAIJALQ7TLSZJA4VIDG4FXCKXJM6KPIA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058075335 (3h0m57.645131576s) [noise=true , address=104.36.82.14:4239 , piece_id=FWDFC254IVBP53YZXMJC74VU23YEONN45ZGO7TJGZ2VAIB5ZTV6A, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058376747 (3h0m57.645432978s) [noise=true , address=104.36.82.47:4532 , piece_id=4GBF3A2LT3TKURVNSPXY7KJNSIOAGLB2P3BCOUJJJBEDKDUFKOMA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058721150 (3h0m57.645777391s) [noise=true , address=104.36.82.8:4992 , piece_id=2R4DIYO5UQXJ56GRK6JA5J6BXWRASRUHF544M6MHDBC6NXAISTJA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059050325 (3h0m57.646106556s) [noise=true , address=104.36.82.55:4201 , piece_id=UCT3UZQGQJCXOBGPJVSFUI26CQYRS5YW3MEWLDZO32UAC56I2OHA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059376785 (3h0m57.646433016s) [noise=true , address=104.36.82.59:4311 , piece_id=TVNTDOMNUCJF4A3YFSXQIXJEAPLFN56HGPJ5DG4I43QVPLW4CZ6Q, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059723321 (3h0m57.646779552s) [noise=true , address=104.36.82.18:4398 , piece_id=GLBCIUKUYNUMCPG2KTKKXS4G26PCPM22QNYJZBQ7LL5DSRZBFYKQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060115413 (3h0m57.647171645s) [noise=true , address=104.36.82.44:4884 , piece_id=3HG77VZOMC7C2BFE2OOR4N7ZUI2R7V3MPTIBYY5BCDPOF2ZVWB3A, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060458384 (3h0m57.647514625s) [noise=true , address=79.127.201.215:4344 , piece_id=3X6ZPSPEPZYDICKWAHHMAIR4MTWPUVTZWMVDIPEKDDCNNB44SMWA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060821732 (3h0m57.647877973s) [noise=true , address=104.36.82.3:4785 , piece_id=ICT5THFHEBQQDELTJI44YTXKKOADC36QTG6PIZTQUK4YH5W6AZRQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.061179059 (3h0m57.64823529s) [noise=true , address=45.91.116.5:4309 , piece_id=2ZAQDU5E26KNU7Q3XQ5HDEECKY6MH7NEBHFNHUXNZQI73FGTVL3Q, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.193291120 (3h0m57.780347371s) [upload=3111]: Next returned nil segment Aug 7 19:27:44.193306900 (3h0m57.780363151s) [upload=3111]: Waiting for error group managing segments... Aug 7 19:27:44.209607597 (3h0m57.796663838s) [noise=true , address=104.36.82.43:4848 , piece_id=BBRVVYNYLMEDVZPFP2F4N5U2MTZDF4JPX2QMPLUYQ4CDKFFWKKPQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.211275410 (3h0m57.798331651s) [noise=true , address=104.36.82.47:4532 , piece_id=4GBF3A2LT3TKURVNSPXY7KJNSIOAGLB2P3BCOUJJJBEDKDUFKOMA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.217863949 (3h0m57.8049202s) [noise=true , address=104.36.82.60:4349 , piece_id=DW2C5CYLEL4BA6U3CDWN6VW6UJ5N5JE3TUD7MRTUQH5KFMMRD7AQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.219360643 (3h0m57.806416894s) [noise=true , address=104.36.82.59:4311 , piece_id=TVNTDOMNUCJF4A3YFSXQIXJEAPLFN56HGPJ5DG4I43QVPLW4CZ6Q, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.220779782 (3h0m57.807836022s) [noise=true , address=104.36.82.55:4201 , piece_id=UCT3UZQGQJCXOBGPJVSFUI26CQYRS5YW3MEWLDZO32UAC56I2OHA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.221735776 (3h0m57.808792018s) [noise=true , address=104.36.82.62:4412 , piece_id=VTW7D5FWI57JQSXSXYVFSGP3DF6LAYY763QILC2L6FD7XOY2PWMA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.224644716 (3h0m57.811700957s) [noise=true , address=45.91.116.10:4106 , piece_id=M434Q2FT2O6VAOMNW5OH5DO5GFQTJ2P4QZFIYWN6HHS3LDM5DZQA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.229617950 (3h0m57.816674191s) [noise=true , address=104.36.82.14:4239 , piece_id=FWDFC254IVBP53YZXMJC74VU23YEONN45ZGO7TJGZ2VAIB5ZTV6A, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.230697154 (3h0m57.817753395s) [noise=true , address=104.36.82.18:4398 , piece_id=GLBCIUKUYNUMCPG2KTKKXS4G26PCPM22QNYJZBQ7LL5DSRZBFYKQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.234957226 (3h0m57.822013468s) [noise=true , address=104.36.82.12:4159 , piece_id=YA7AS3EQIYKWEA2NMDAZUJYPIE7G2NGS3HSDVFV2TH7EBHZFCFHQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.237122999 (3h0m57.82417924s) [noise=true , address=45.91.116.5:4309 , piece_id=2ZAQDU5E26KNU7Q3XQ5HDEECKY6MH7NEBHFNHUXNZQI73FGTVL3Q, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.243298527 (3h0m57.830354768s) [noise=true , address=104.36.82.3:4785 , piece_id=ICT5THFHEBQQDELTJI44YTXKKOADC36QTG6PIZTQUK4YH5W6AZRQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.305437629 (3h0m57.892493871s) [noise=true , address=79.127.201.215:4344 , piece_id=3X6ZPSPEPZYDICKWAHHMAIR4MTWPUVTZWMVDIPEKDDCNNB44SMWA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.314176622 (3h0m57.901232863s) [noise=true , address=104.36.82.36:4652 , piece_id=OYDPP7KRAWZI5K3WGROJ7Z2RCW7RXGDQENOGSQJJHNYKNTRVICQQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.314225393 (3h0m57.901281635s) [seg_pos={0 0}, upload=3111]: Segment reached optimal threshold of 14 pieces. Aug 7 19:27:44.314403605 (3h0m57.901459847s) [noise=true , address=104.36.82.44:4884 , piece_id=3HG77VZOMC7C2BFE2OOR4N7ZUI2R7V3MPTIBYY5BCDPOF2ZVWB3A, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF Aug 7 19:27:44.314450183 (3h0m57.901506424s) [noise=true , address=104.36.82.16:4303 , piece_id=LIGUJZKXUSDOAY6EBKFCDBSJQ4W2ZTYLS5ZRTMVZ4SB3IPOIRCAA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ec4Xvp3nGRAm9BivLLTp6AVkMoz1i2AgXQdfQaAmNPLHWD4Yv): protocol: expected piece hash; context canceled; EOF Aug 7 19:27:44.314752737 (3h0m57.901808979s) [noise=true , address=104.36.82.23:4462 , piece_id=4BTWSC6DSBHTSYQELVQWKAIJALQ7TLSZJA4VIDG4FXCKXJM6KPIA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YirC8WVSoE1qrWGMmayNmCsDLxjUhggrgXL5unKtQjsfUkbMu): protocol: read tcp 5.161.89.252:19630->104.36.82.23:4462: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.314762766 (3h0m57.901819017s) [noise=true , address=104.36.82.8:4992 , piece_id=2R4DIYO5UQXJ56GRK6JA5J6BXWRASRUHF544M6MHDBC6NXAISTJA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hbt8HKTunpPKyAzH4XBwGQqTKzcgqPpoWwKZm9JMtaK8P7aVp): protocol: write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection; write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection Aug 7 19:27:44.314798644 (3h0m57.901854884s) [seg_pos={0 0}, upload=3111]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:27:44.314911785 (3h0m57.901968026s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 19:27:44.314941310 (3h0m57.901997561s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 19:27:44.620205884 (3h0m58.207262095s) [upload=3111]: Done uploading segments... Aug 7 19:27:44.620221594 (3h0m58.207277804s) [upload=3111]: Upload finished. err: <nil>
Duration: 422.439522ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................................X........X........] duration:
434.185641ms
FAIL (2025-08-07 19:33:25 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== upload Aug 7 19:27:44.006467873 (3h0m57.593524104s) [upload=3111]: Uploading segments... Aug 7 19:27:44.006762594 (3h0m57.593818835s) [upload=3111]: Got next segment. Inline: false Aug 7 19:27:44.006802177 (3h0m57.593858418s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 19:27:44.006807697 (3h0m57.593863939s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 19:27:44.056805204 (3h0m57.643861445s) [seg_pos={0 0}, upload=3111]: Begin upload segment... Aug 7 19:27:44.056847824 (3h0m57.643904055s) [seg_pos={0 0}, upload=3111]: Done begin upload segment. Aug 7 19:27:44.056875095 (3h0m57.643931386s) [noise=true , address=104.36.82.43:4848 , piece_id=BBRVVYNYLMEDVZPFP2F4N5U2MTZDF4JPX2QMPLUYQ4CDKFFWKKPQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.056888329 (3h0m57.64394457s) [noise=true , address=104.36.82.12:4159 , piece_id=YA7AS3EQIYKWEA2NMDAZUJYPIE7G2NGS3HSDVFV2TH7EBHZFCFHQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.056930177 (3h0m57.643986419s) [noise=true , address=104.36.82.16:4303 , piece_id=LIGUJZKXUSDOAY6EBKFCDBSJQ4W2ZTYLS5ZRTMVZ4SB3IPOIRCAA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057326708 (3h0m57.644382949s) [noise=true , address=104.36.82.36:4652 , piece_id=OYDPP7KRAWZI5K3WGROJ7Z2RCW7RXGDQENOGSQJJHNYKNTRVICQQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057335624 (3h0m57.644391866s) [noise=true , address=104.36.82.62:4412 , piece_id=VTW7D5FWI57JQSXSXYVFSGP3DF6LAYY763QILC2L6FD7XOY2PWMA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057710634 (3h0m57.644766875s) [noise=true , address=45.91.116.10:4106 , piece_id=M434Q2FT2O6VAOMNW5OH5DO5GFQTJ2P4QZFIYWN6HHS3LDM5DZQA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057732425 (3h0m57.644788666s) [noise=true , address=104.36.82.60:4349 , piece_id=DW2C5CYLEL4BA6U3CDWN6VW6UJ5N5JE3TUD7MRTUQH5KFMMRD7AQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058048605 (3h0m57.645104846s) [noise=true , address=104.36.82.23:4462 , piece_id=4BTWSC6DSBHTSYQELVQWKAIJALQ7TLSZJA4VIDG4FXCKXJM6KPIA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058075335 (3h0m57.645131576s) [noise=true , address=104.36.82.14:4239 , piece_id=FWDFC254IVBP53YZXMJC74VU23YEONN45ZGO7TJGZ2VAIB5ZTV6A, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058376747 (3h0m57.645432978s) [noise=true , address=104.36.82.47:4532 , piece_id=4GBF3A2LT3TKURVNSPXY7KJNSIOAGLB2P3BCOUJJJBEDKDUFKOMA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058721150 (3h0m57.645777391s) [noise=true , address=104.36.82.8:4992 , piece_id=2R4DIYO5UQXJ56GRK6JA5J6BXWRASRUHF544M6MHDBC6NXAISTJA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059050325 (3h0m57.646106556s) [noise=true , address=104.36.82.55:4201 , piece_id=UCT3UZQGQJCXOBGPJVSFUI26CQYRS5YW3MEWLDZO32UAC56I2OHA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059376785 (3h0m57.646433016s) [noise=true , address=104.36.82.59:4311 , piece_id=TVNTDOMNUCJF4A3YFSXQIXJEAPLFN56HGPJ5DG4I43QVPLW4CZ6Q, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059723321 (3h0m57.646779552s) [noise=true , address=104.36.82.18:4398 , piece_id=GLBCIUKUYNUMCPG2KTKKXS4G26PCPM22QNYJZBQ7LL5DSRZBFYKQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060115413 (3h0m57.647171645s) [noise=true , address=104.36.82.44:4884 , piece_id=3HG77VZOMC7C2BFE2OOR4N7ZUI2R7V3MPTIBYY5BCDPOF2ZVWB3A, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060458384 (3h0m57.647514625s) [noise=true , address=79.127.201.215:4344 , piece_id=3X6ZPSPEPZYDICKWAHHMAIR4MTWPUVTZWMVDIPEKDDCNNB44SMWA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060821732 (3h0m57.647877973s) [noise=true , address=104.36.82.3:4785 , piece_id=ICT5THFHEBQQDELTJI44YTXKKOADC36QTG6PIZTQUK4YH5W6AZRQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.061179059 (3h0m57.64823529s) [noise=true , address=45.91.116.5:4309 , piece_id=2ZAQDU5E26KNU7Q3XQ5HDEECKY6MH7NEBHFNHUXNZQI73FGTVL3Q, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.193291120 (3h0m57.780347371s) [upload=3111]: Next returned nil segment Aug 7 19:27:44.193306900 (3h0m57.780363151s) [upload=3111]: Waiting for error group managing segments... Aug 7 19:27:44.209607597 (3h0m57.796663838s) [noise=true , address=104.36.82.43:4848 , piece_id=BBRVVYNYLMEDVZPFP2F4N5U2MTZDF4JPX2QMPLUYQ4CDKFFWKKPQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.211275410 (3h0m57.798331651s) [noise=true , address=104.36.82.47:4532 , piece_id=4GBF3A2LT3TKURVNSPXY7KJNSIOAGLB2P3BCOUJJJBEDKDUFKOMA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.217863949 (3h0m57.8049202s) [noise=true , address=104.36.82.60:4349 , piece_id=DW2C5CYLEL4BA6U3CDWN6VW6UJ5N5JE3TUD7MRTUQH5KFMMRD7AQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.219360643 (3h0m57.806416894s) [noise=true , address=104.36.82.59:4311 , piece_id=TVNTDOMNUCJF4A3YFSXQIXJEAPLFN56HGPJ5DG4I43QVPLW4CZ6Q, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.220779782 (3h0m57.807836022s) [noise=true , address=104.36.82.55:4201 , piece_id=UCT3UZQGQJCXOBGPJVSFUI26CQYRS5YW3MEWLDZO32UAC56I2OHA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.221735776 (3h0m57.808792018s) [noise=true , address=104.36.82.62:4412 , piece_id=VTW7D5FWI57JQSXSXYVFSGP3DF6LAYY763QILC2L6FD7XOY2PWMA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.224644716 (3h0m57.811700957s) [noise=true , address=45.91.116.10:4106 , piece_id=M434Q2FT2O6VAOMNW5OH5DO5GFQTJ2P4QZFIYWN6HHS3LDM5DZQA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.229617950 (3h0m57.816674191s) [noise=true , address=104.36.82.14:4239 , piece_id=FWDFC254IVBP53YZXMJC74VU23YEONN45ZGO7TJGZ2VAIB5ZTV6A, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.230697154 (3h0m57.817753395s) [noise=true , address=104.36.82.18:4398 , piece_id=GLBCIUKUYNUMCPG2KTKKXS4G26PCPM22QNYJZBQ7LL5DSRZBFYKQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.234957226 (3h0m57.822013468s) [noise=true , address=104.36.82.12:4159 , piece_id=YA7AS3EQIYKWEA2NMDAZUJYPIE7G2NGS3HSDVFV2TH7EBHZFCFHQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.237122999 (3h0m57.82417924s) [noise=true , address=45.91.116.5:4309 , piece_id=2ZAQDU5E26KNU7Q3XQ5HDEECKY6MH7NEBHFNHUXNZQI73FGTVL3Q, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.243298527 (3h0m57.830354768s) [noise=true , address=104.36.82.3:4785 , piece_id=ICT5THFHEBQQDELTJI44YTXKKOADC36QTG6PIZTQUK4YH5W6AZRQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.305437629 (3h0m57.892493871s) [noise=true , address=79.127.201.215:4344 , piece_id=3X6ZPSPEPZYDICKWAHHMAIR4MTWPUVTZWMVDIPEKDDCNNB44SMWA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.314176622 (3h0m57.901232863s) [noise=true , address=104.36.82.36:4652 , piece_id=OYDPP7KRAWZI5K3WGROJ7Z2RCW7RXGDQENOGSQJJHNYKNTRVICQQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.314225393 (3h0m57.901281635s) [seg_pos={0 0}, upload=3111]: Segment reached optimal threshold of 14 pieces. Aug 7 19:27:44.314403605 (3h0m57.901459847s) [noise=true , address=104.36.82.44:4884 , piece_id=3HG77VZOMC7C2BFE2OOR4N7ZUI2R7V3MPTIBYY5BCDPOF2ZVWB3A, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF Aug 7 19:27:44.314450183 (3h0m57.901506424s) [noise=true , address=104.36.82.16:4303 , piece_id=LIGUJZKXUSDOAY6EBKFCDBSJQ4W2ZTYLS5ZRTMVZ4SB3IPOIRCAA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ec4Xvp3nGRAm9BivLLTp6AVkMoz1i2AgXQdfQaAmNPLHWD4Yv): protocol: expected piece hash; context canceled; EOF Aug 7 19:27:44.314752737 (3h0m57.901808979s) [noise=true , address=104.36.82.23:4462 , piece_id=4BTWSC6DSBHTSYQELVQWKAIJALQ7TLSZJA4VIDG4FXCKXJM6KPIA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YirC8WVSoE1qrWGMmayNmCsDLxjUhggrgXL5unKtQjsfUkbMu): protocol: read tcp 5.161.89.252:19630->104.36.82.23:4462: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.314762766 (3h0m57.901819017s) [noise=true , address=104.36.82.8:4992 , piece_id=2R4DIYO5UQXJ56GRK6JA5J6BXWRASRUHF544M6MHDBC6NXAISTJA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hbt8HKTunpPKyAzH4XBwGQqTKzcgqPpoWwKZm9JMtaK8P7aVp): protocol: write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection; write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection Aug 7 19:27:44.314798644 (3h0m57.901854884s) [seg_pos={0 0}, upload=3111]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:27:44.314911785 (3h0m57.901968026s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 19:27:44.314941310 (3h0m57.901997561s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 19:27:44.620205884 (3h0m58.207262095s) [upload=3111]: Done uploading segments... Aug 7 19:27:44.620221594 (3h0m58.207277804s) [upload=3111]: Upload finished. err: <nil>
Duration: 434.211629ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................................X........X.......] duration:
470.923085ms
FAIL (2025-08-07 19:32:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== upload Aug 7 19:27:44.006467873 (3h0m57.593524104s) [upload=3111]: Uploading segments... Aug 7 19:27:44.006762594 (3h0m57.593818835s) [upload=3111]: Got next segment. Inline: false Aug 7 19:27:44.006802177 (3h0m57.593858418s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 19:27:44.006807697 (3h0m57.593863939s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 19:27:44.056805204 (3h0m57.643861445s) [seg_pos={0 0}, upload=3111]: Begin upload segment... Aug 7 19:27:44.056847824 (3h0m57.643904055s) [seg_pos={0 0}, upload=3111]: Done begin upload segment. Aug 7 19:27:44.056875095 (3h0m57.643931386s) [noise=true , address=104.36.82.43:4848 , piece_id=BBRVVYNYLMEDVZPFP2F4N5U2MTZDF4JPX2QMPLUYQ4CDKFFWKKPQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.056888329 (3h0m57.64394457s) [noise=true , address=104.36.82.12:4159 , piece_id=YA7AS3EQIYKWEA2NMDAZUJYPIE7G2NGS3HSDVFV2TH7EBHZFCFHQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.056930177 (3h0m57.643986419s) [noise=true , address=104.36.82.16:4303 , piece_id=LIGUJZKXUSDOAY6EBKFCDBSJQ4W2ZTYLS5ZRTMVZ4SB3IPOIRCAA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057326708 (3h0m57.644382949s) [noise=true , address=104.36.82.36:4652 , piece_id=OYDPP7KRAWZI5K3WGROJ7Z2RCW7RXGDQENOGSQJJHNYKNTRVICQQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057335624 (3h0m57.644391866s) [noise=true , address=104.36.82.62:4412 , piece_id=VTW7D5FWI57JQSXSXYVFSGP3DF6LAYY763QILC2L6FD7XOY2PWMA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057710634 (3h0m57.644766875s) [noise=true , address=45.91.116.10:4106 , piece_id=M434Q2FT2O6VAOMNW5OH5DO5GFQTJ2P4QZFIYWN6HHS3LDM5DZQA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057732425 (3h0m57.644788666s) [noise=true , address=104.36.82.60:4349 , piece_id=DW2C5CYLEL4BA6U3CDWN6VW6UJ5N5JE3TUD7MRTUQH5KFMMRD7AQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058048605 (3h0m57.645104846s) [noise=true , address=104.36.82.23:4462 , piece_id=4BTWSC6DSBHTSYQELVQWKAIJALQ7TLSZJA4VIDG4FXCKXJM6KPIA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058075335 (3h0m57.645131576s) [noise=true , address=104.36.82.14:4239 , piece_id=FWDFC254IVBP53YZXMJC74VU23YEONN45ZGO7TJGZ2VAIB5ZTV6A, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058376747 (3h0m57.645432978s) [noise=true , address=104.36.82.47:4532 , piece_id=4GBF3A2LT3TKURVNSPXY7KJNSIOAGLB2P3BCOUJJJBEDKDUFKOMA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058721150 (3h0m57.645777391s) [noise=true , address=104.36.82.8:4992 , piece_id=2R4DIYO5UQXJ56GRK6JA5J6BXWRASRUHF544M6MHDBC6NXAISTJA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059050325 (3h0m57.646106556s) [noise=true , address=104.36.82.55:4201 , piece_id=UCT3UZQGQJCXOBGPJVSFUI26CQYRS5YW3MEWLDZO32UAC56I2OHA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059376785 (3h0m57.646433016s) [noise=true , address=104.36.82.59:4311 , piece_id=TVNTDOMNUCJF4A3YFSXQIXJEAPLFN56HGPJ5DG4I43QVPLW4CZ6Q, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059723321 (3h0m57.646779552s) [noise=true , address=104.36.82.18:4398 , piece_id=GLBCIUKUYNUMCPG2KTKKXS4G26PCPM22QNYJZBQ7LL5DSRZBFYKQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060115413 (3h0m57.647171645s) [noise=true , address=104.36.82.44:4884 , piece_id=3HG77VZOMC7C2BFE2OOR4N7ZUI2R7V3MPTIBYY5BCDPOF2ZVWB3A, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060458384 (3h0m57.647514625s) [noise=true , address=79.127.201.215:4344 , piece_id=3X6ZPSPEPZYDICKWAHHMAIR4MTWPUVTZWMVDIPEKDDCNNB44SMWA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060821732 (3h0m57.647877973s) [noise=true , address=104.36.82.3:4785 , piece_id=ICT5THFHEBQQDELTJI44YTXKKOADC36QTG6PIZTQUK4YH5W6AZRQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.061179059 (3h0m57.64823529s) [noise=true , address=45.91.116.5:4309 , piece_id=2ZAQDU5E26KNU7Q3XQ5HDEECKY6MH7NEBHFNHUXNZQI73FGTVL3Q, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.193291120 (3h0m57.780347371s) [upload=3111]: Next returned nil segment Aug 7 19:27:44.193306900 (3h0m57.780363151s) [upload=3111]: Waiting for error group managing segments... Aug 7 19:27:44.209607597 (3h0m57.796663838s) [noise=true , address=104.36.82.43:4848 , piece_id=BBRVVYNYLMEDVZPFP2F4N5U2MTZDF4JPX2QMPLUYQ4CDKFFWKKPQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.211275410 (3h0m57.798331651s) [noise=true , address=104.36.82.47:4532 , piece_id=4GBF3A2LT3TKURVNSPXY7KJNSIOAGLB2P3BCOUJJJBEDKDUFKOMA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.217863949 (3h0m57.8049202s) [noise=true , address=104.36.82.60:4349 , piece_id=DW2C5CYLEL4BA6U3CDWN6VW6UJ5N5JE3TUD7MRTUQH5KFMMRD7AQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.219360643 (3h0m57.806416894s) [noise=true , address=104.36.82.59:4311 , piece_id=TVNTDOMNUCJF4A3YFSXQIXJEAPLFN56HGPJ5DG4I43QVPLW4CZ6Q, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.220779782 (3h0m57.807836022s) [noise=true , address=104.36.82.55:4201 , piece_id=UCT3UZQGQJCXOBGPJVSFUI26CQYRS5YW3MEWLDZO32UAC56I2OHA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.221735776 (3h0m57.808792018s) [noise=true , address=104.36.82.62:4412 , piece_id=VTW7D5FWI57JQSXSXYVFSGP3DF6LAYY763QILC2L6FD7XOY2PWMA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.224644716 (3h0m57.811700957s) [noise=true , address=45.91.116.10:4106 , piece_id=M434Q2FT2O6VAOMNW5OH5DO5GFQTJ2P4QZFIYWN6HHS3LDM5DZQA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.229617950 (3h0m57.816674191s) [noise=true , address=104.36.82.14:4239 , piece_id=FWDFC254IVBP53YZXMJC74VU23YEONN45ZGO7TJGZ2VAIB5ZTV6A, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.230697154 (3h0m57.817753395s) [noise=true , address=104.36.82.18:4398 , piece_id=GLBCIUKUYNUMCPG2KTKKXS4G26PCPM22QNYJZBQ7LL5DSRZBFYKQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.234957226 (3h0m57.822013468s) [noise=true , address=104.36.82.12:4159 , piece_id=YA7AS3EQIYKWEA2NMDAZUJYPIE7G2NGS3HSDVFV2TH7EBHZFCFHQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.237122999 (3h0m57.82417924s) [noise=true , address=45.91.116.5:4309 , piece_id=2ZAQDU5E26KNU7Q3XQ5HDEECKY6MH7NEBHFNHUXNZQI73FGTVL3Q, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.243298527 (3h0m57.830354768s) [noise=true , address=104.36.82.3:4785 , piece_id=ICT5THFHEBQQDELTJI44YTXKKOADC36QTG6PIZTQUK4YH5W6AZRQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.305437629 (3h0m57.892493871s) [noise=true , address=79.127.201.215:4344 , piece_id=3X6ZPSPEPZYDICKWAHHMAIR4MTWPUVTZWMVDIPEKDDCNNB44SMWA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.314176622 (3h0m57.901232863s) [noise=true , address=104.36.82.36:4652 , piece_id=OYDPP7KRAWZI5K3WGROJ7Z2RCW7RXGDQENOGSQJJHNYKNTRVICQQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.314225393 (3h0m57.901281635s) [seg_pos={0 0}, upload=3111]: Segment reached optimal threshold of 14 pieces. Aug 7 19:27:44.314403605 (3h0m57.901459847s) [noise=true , address=104.36.82.44:4884 , piece_id=3HG77VZOMC7C2BFE2OOR4N7ZUI2R7V3MPTIBYY5BCDPOF2ZVWB3A, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF Aug 7 19:27:44.314450183 (3h0m57.901506424s) [noise=true , address=104.36.82.16:4303 , piece_id=LIGUJZKXUSDOAY6EBKFCDBSJQ4W2ZTYLS5ZRTMVZ4SB3IPOIRCAA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ec4Xvp3nGRAm9BivLLTp6AVkMoz1i2AgXQdfQaAmNPLHWD4Yv): protocol: expected piece hash; context canceled; EOF Aug 7 19:27:44.314752737 (3h0m57.901808979s) [noise=true , address=104.36.82.23:4462 , piece_id=4BTWSC6DSBHTSYQELVQWKAIJALQ7TLSZJA4VIDG4FXCKXJM6KPIA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YirC8WVSoE1qrWGMmayNmCsDLxjUhggrgXL5unKtQjsfUkbMu): protocol: read tcp 5.161.89.252:19630->104.36.82.23:4462: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.314762766 (3h0m57.901819017s) [noise=true , address=104.36.82.8:4992 , piece_id=2R4DIYO5UQXJ56GRK6JA5J6BXWRASRUHF544M6MHDBC6NXAISTJA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hbt8HKTunpPKyAzH4XBwGQqTKzcgqPpoWwKZm9JMtaK8P7aVp): protocol: write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection; write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection Aug 7 19:27:44.314798644 (3h0m57.901854884s) [seg_pos={0 0}, upload=3111]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:27:44.314911785 (3h0m57.901968026s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 19:27:44.314941310 (3h0m57.901997561s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 19:27:44.620205884 (3h0m58.207262095s) [upload=3111]: Done uploading segments... Aug 7 19:27:44.620221594 (3h0m58.207277804s) [upload=3111]: Upload finished. err: <nil>
Duration: 470.945546ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................................X........X......] duration:
997.339337ms
FAIL (2025-08-07 19:31:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== upload Aug 7 19:27:44.006467873 (3h0m57.593524104s) [upload=3111]: Uploading segments... Aug 7 19:27:44.006762594 (3h0m57.593818835s) [upload=3111]: Got next segment. Inline: false Aug 7 19:27:44.006802177 (3h0m57.593858418s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 19:27:44.006807697 (3h0m57.593863939s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 19:27:44.056805204 (3h0m57.643861445s) [seg_pos={0 0}, upload=3111]: Begin upload segment... Aug 7 19:27:44.056847824 (3h0m57.643904055s) [seg_pos={0 0}, upload=3111]: Done begin upload segment. Aug 7 19:27:44.056875095 (3h0m57.643931386s) [noise=true , address=104.36.82.43:4848 , piece_id=BBRVVYNYLMEDVZPFP2F4N5U2MTZDF4JPX2QMPLUYQ4CDKFFWKKPQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.056888329 (3h0m57.64394457s) [noise=true , address=104.36.82.12:4159 , piece_id=YA7AS3EQIYKWEA2NMDAZUJYPIE7G2NGS3HSDVFV2TH7EBHZFCFHQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.056930177 (3h0m57.643986419s) [noise=true , address=104.36.82.16:4303 , piece_id=LIGUJZKXUSDOAY6EBKFCDBSJQ4W2ZTYLS5ZRTMVZ4SB3IPOIRCAA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057326708 (3h0m57.644382949s) [noise=true , address=104.36.82.36:4652 , piece_id=OYDPP7KRAWZI5K3WGROJ7Z2RCW7RXGDQENOGSQJJHNYKNTRVICQQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057335624 (3h0m57.644391866s) [noise=true , address=104.36.82.62:4412 , piece_id=VTW7D5FWI57JQSXSXYVFSGP3DF6LAYY763QILC2L6FD7XOY2PWMA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057710634 (3h0m57.644766875s) [noise=true , address=45.91.116.10:4106 , piece_id=M434Q2FT2O6VAOMNW5OH5DO5GFQTJ2P4QZFIYWN6HHS3LDM5DZQA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057732425 (3h0m57.644788666s) [noise=true , address=104.36.82.60:4349 , piece_id=DW2C5CYLEL4BA6U3CDWN6VW6UJ5N5JE3TUD7MRTUQH5KFMMRD7AQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058048605 (3h0m57.645104846s) [noise=true , address=104.36.82.23:4462 , piece_id=4BTWSC6DSBHTSYQELVQWKAIJALQ7TLSZJA4VIDG4FXCKXJM6KPIA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058075335 (3h0m57.645131576s) [noise=true , address=104.36.82.14:4239 , piece_id=FWDFC254IVBP53YZXMJC74VU23YEONN45ZGO7TJGZ2VAIB5ZTV6A, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058376747 (3h0m57.645432978s) [noise=true , address=104.36.82.47:4532 , piece_id=4GBF3A2LT3TKURVNSPXY7KJNSIOAGLB2P3BCOUJJJBEDKDUFKOMA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058721150 (3h0m57.645777391s) [noise=true , address=104.36.82.8:4992 , piece_id=2R4DIYO5UQXJ56GRK6JA5J6BXWRASRUHF544M6MHDBC6NXAISTJA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059050325 (3h0m57.646106556s) [noise=true , address=104.36.82.55:4201 , piece_id=UCT3UZQGQJCXOBGPJVSFUI26CQYRS5YW3MEWLDZO32UAC56I2OHA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059376785 (3h0m57.646433016s) [noise=true , address=104.36.82.59:4311 , piece_id=TVNTDOMNUCJF4A3YFSXQIXJEAPLFN56HGPJ5DG4I43QVPLW4CZ6Q, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059723321 (3h0m57.646779552s) [noise=true , address=104.36.82.18:4398 , piece_id=GLBCIUKUYNUMCPG2KTKKXS4G26PCPM22QNYJZBQ7LL5DSRZBFYKQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060115413 (3h0m57.647171645s) [noise=true , address=104.36.82.44:4884 , piece_id=3HG77VZOMC7C2BFE2OOR4N7ZUI2R7V3MPTIBYY5BCDPOF2ZVWB3A, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060458384 (3h0m57.647514625s) [noise=true , address=79.127.201.215:4344 , piece_id=3X6ZPSPEPZYDICKWAHHMAIR4MTWPUVTZWMVDIPEKDDCNNB44SMWA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060821732 (3h0m57.647877973s) [noise=true , address=104.36.82.3:4785 , piece_id=ICT5THFHEBQQDELTJI44YTXKKOADC36QTG6PIZTQUK4YH5W6AZRQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.061179059 (3h0m57.64823529s) [noise=true , address=45.91.116.5:4309 , piece_id=2ZAQDU5E26KNU7Q3XQ5HDEECKY6MH7NEBHFNHUXNZQI73FGTVL3Q, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.193291120 (3h0m57.780347371s) [upload=3111]: Next returned nil segment Aug 7 19:27:44.193306900 (3h0m57.780363151s) [upload=3111]: Waiting for error group managing segments... Aug 7 19:27:44.209607597 (3h0m57.796663838s) [noise=true , address=104.36.82.43:4848 , piece_id=BBRVVYNYLMEDVZPFP2F4N5U2MTZDF4JPX2QMPLUYQ4CDKFFWKKPQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.211275410 (3h0m57.798331651s) [noise=true , address=104.36.82.47:4532 , piece_id=4GBF3A2LT3TKURVNSPXY7KJNSIOAGLB2P3BCOUJJJBEDKDUFKOMA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.217863949 (3h0m57.8049202s) [noise=true , address=104.36.82.60:4349 , piece_id=DW2C5CYLEL4BA6U3CDWN6VW6UJ5N5JE3TUD7MRTUQH5KFMMRD7AQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.219360643 (3h0m57.806416894s) [noise=true , address=104.36.82.59:4311 , piece_id=TVNTDOMNUCJF4A3YFSXQIXJEAPLFN56HGPJ5DG4I43QVPLW4CZ6Q, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.220779782 (3h0m57.807836022s) [noise=true , address=104.36.82.55:4201 , piece_id=UCT3UZQGQJCXOBGPJVSFUI26CQYRS5YW3MEWLDZO32UAC56I2OHA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.221735776 (3h0m57.808792018s) [noise=true , address=104.36.82.62:4412 , piece_id=VTW7D5FWI57JQSXSXYVFSGP3DF6LAYY763QILC2L6FD7XOY2PWMA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.224644716 (3h0m57.811700957s) [noise=true , address=45.91.116.10:4106 , piece_id=M434Q2FT2O6VAOMNW5OH5DO5GFQTJ2P4QZFIYWN6HHS3LDM5DZQA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.229617950 (3h0m57.816674191s) [noise=true , address=104.36.82.14:4239 , piece_id=FWDFC254IVBP53YZXMJC74VU23YEONN45ZGO7TJGZ2VAIB5ZTV6A, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.230697154 (3h0m57.817753395s) [noise=true , address=104.36.82.18:4398 , piece_id=GLBCIUKUYNUMCPG2KTKKXS4G26PCPM22QNYJZBQ7LL5DSRZBFYKQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.234957226 (3h0m57.822013468s) [noise=true , address=104.36.82.12:4159 , piece_id=YA7AS3EQIYKWEA2NMDAZUJYPIE7G2NGS3HSDVFV2TH7EBHZFCFHQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.237122999 (3h0m57.82417924s) [noise=true , address=45.91.116.5:4309 , piece_id=2ZAQDU5E26KNU7Q3XQ5HDEECKY6MH7NEBHFNHUXNZQI73FGTVL3Q, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.243298527 (3h0m57.830354768s) [noise=true , address=104.36.82.3:4785 , piece_id=ICT5THFHEBQQDELTJI44YTXKKOADC36QTG6PIZTQUK4YH5W6AZRQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.305437629 (3h0m57.892493871s) [noise=true , address=79.127.201.215:4344 , piece_id=3X6ZPSPEPZYDICKWAHHMAIR4MTWPUVTZWMVDIPEKDDCNNB44SMWA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.314176622 (3h0m57.901232863s) [noise=true , address=104.36.82.36:4652 , piece_id=OYDPP7KRAWZI5K3WGROJ7Z2RCW7RXGDQENOGSQJJHNYKNTRVICQQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.314225393 (3h0m57.901281635s) [seg_pos={0 0}, upload=3111]: Segment reached optimal threshold of 14 pieces. Aug 7 19:27:44.314403605 (3h0m57.901459847s) [noise=true , address=104.36.82.44:4884 , piece_id=3HG77VZOMC7C2BFE2OOR4N7ZUI2R7V3MPTIBYY5BCDPOF2ZVWB3A, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF Aug 7 19:27:44.314450183 (3h0m57.901506424s) [noise=true , address=104.36.82.16:4303 , piece_id=LIGUJZKXUSDOAY6EBKFCDBSJQ4W2ZTYLS5ZRTMVZ4SB3IPOIRCAA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ec4Xvp3nGRAm9BivLLTp6AVkMoz1i2AgXQdfQaAmNPLHWD4Yv): protocol: expected piece hash; context canceled; EOF Aug 7 19:27:44.314752737 (3h0m57.901808979s) [noise=true , address=104.36.82.23:4462 , piece_id=4BTWSC6DSBHTSYQELVQWKAIJALQ7TLSZJA4VIDG4FXCKXJM6KPIA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YirC8WVSoE1qrWGMmayNmCsDLxjUhggrgXL5unKtQjsfUkbMu): protocol: read tcp 5.161.89.252:19630->104.36.82.23:4462: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.314762766 (3h0m57.901819017s) [noise=true , address=104.36.82.8:4992 , piece_id=2R4DIYO5UQXJ56GRK6JA5J6BXWRASRUHF544M6MHDBC6NXAISTJA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hbt8HKTunpPKyAzH4XBwGQqTKzcgqPpoWwKZm9JMtaK8P7aVp): protocol: write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection; write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection Aug 7 19:27:44.314798644 (3h0m57.901854884s) [seg_pos={0 0}, upload=3111]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:27:44.314911785 (3h0m57.901968026s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 19:27:44.314941310 (3h0m57.901997561s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 19:27:44.620205884 (3h0m58.207262095s) [upload=3111]: Done uploading segments... Aug 7 19:27:44.620221594 (3h0m58.207277804s) [upload=3111]: Upload finished. err: <nil>
Duration: 997.358622ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................................X........X.....] duration:
524.226102ms
FAIL (2025-08-07 19:30:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== upload Aug 7 19:27:44.006467873 (3h0m57.593524104s) [upload=3111]: Uploading segments... Aug 7 19:27:44.006762594 (3h0m57.593818835s) [upload=3111]: Got next segment. Inline: false Aug 7 19:27:44.006802177 (3h0m57.593858418s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 19:27:44.006807697 (3h0m57.593863939s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 19:27:44.056805204 (3h0m57.643861445s) [seg_pos={0 0}, upload=3111]: Begin upload segment... Aug 7 19:27:44.056847824 (3h0m57.643904055s) [seg_pos={0 0}, upload=3111]: Done begin upload segment. Aug 7 19:27:44.056875095 (3h0m57.643931386s) [noise=true , address=104.36.82.43:4848 , piece_id=BBRVVYNYLMEDVZPFP2F4N5U2MTZDF4JPX2QMPLUYQ4CDKFFWKKPQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.056888329 (3h0m57.64394457s) [noise=true , address=104.36.82.12:4159 , piece_id=YA7AS3EQIYKWEA2NMDAZUJYPIE7G2NGS3HSDVFV2TH7EBHZFCFHQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.056930177 (3h0m57.643986419s) [noise=true , address=104.36.82.16:4303 , piece_id=LIGUJZKXUSDOAY6EBKFCDBSJQ4W2ZTYLS5ZRTMVZ4SB3IPOIRCAA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057326708 (3h0m57.644382949s) [noise=true , address=104.36.82.36:4652 , piece_id=OYDPP7KRAWZI5K3WGROJ7Z2RCW7RXGDQENOGSQJJHNYKNTRVICQQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057335624 (3h0m57.644391866s) [noise=true , address=104.36.82.62:4412 , piece_id=VTW7D5FWI57JQSXSXYVFSGP3DF6LAYY763QILC2L6FD7XOY2PWMA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057710634 (3h0m57.644766875s) [noise=true , address=45.91.116.10:4106 , piece_id=M434Q2FT2O6VAOMNW5OH5DO5GFQTJ2P4QZFIYWN6HHS3LDM5DZQA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057732425 (3h0m57.644788666s) [noise=true , address=104.36.82.60:4349 , piece_id=DW2C5CYLEL4BA6U3CDWN6VW6UJ5N5JE3TUD7MRTUQH5KFMMRD7AQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058048605 (3h0m57.645104846s) [noise=true , address=104.36.82.23:4462 , piece_id=4BTWSC6DSBHTSYQELVQWKAIJALQ7TLSZJA4VIDG4FXCKXJM6KPIA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058075335 (3h0m57.645131576s) [noise=true , address=104.36.82.14:4239 , piece_id=FWDFC254IVBP53YZXMJC74VU23YEONN45ZGO7TJGZ2VAIB5ZTV6A, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058376747 (3h0m57.645432978s) [noise=true , address=104.36.82.47:4532 , piece_id=4GBF3A2LT3TKURVNSPXY7KJNSIOAGLB2P3BCOUJJJBEDKDUFKOMA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058721150 (3h0m57.645777391s) [noise=true , address=104.36.82.8:4992 , piece_id=2R4DIYO5UQXJ56GRK6JA5J6BXWRASRUHF544M6MHDBC6NXAISTJA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059050325 (3h0m57.646106556s) [noise=true , address=104.36.82.55:4201 , piece_id=UCT3UZQGQJCXOBGPJVSFUI26CQYRS5YW3MEWLDZO32UAC56I2OHA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059376785 (3h0m57.646433016s) [noise=true , address=104.36.82.59:4311 , piece_id=TVNTDOMNUCJF4A3YFSXQIXJEAPLFN56HGPJ5DG4I43QVPLW4CZ6Q, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059723321 (3h0m57.646779552s) [noise=true , address=104.36.82.18:4398 , piece_id=GLBCIUKUYNUMCPG2KTKKXS4G26PCPM22QNYJZBQ7LL5DSRZBFYKQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060115413 (3h0m57.647171645s) [noise=true , address=104.36.82.44:4884 , piece_id=3HG77VZOMC7C2BFE2OOR4N7ZUI2R7V3MPTIBYY5BCDPOF2ZVWB3A, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060458384 (3h0m57.647514625s) [noise=true , address=79.127.201.215:4344 , piece_id=3X6ZPSPEPZYDICKWAHHMAIR4MTWPUVTZWMVDIPEKDDCNNB44SMWA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060821732 (3h0m57.647877973s) [noise=true , address=104.36.82.3:4785 , piece_id=ICT5THFHEBQQDELTJI44YTXKKOADC36QTG6PIZTQUK4YH5W6AZRQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.061179059 (3h0m57.64823529s) [noise=true , address=45.91.116.5:4309 , piece_id=2ZAQDU5E26KNU7Q3XQ5HDEECKY6MH7NEBHFNHUXNZQI73FGTVL3Q, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.193291120 (3h0m57.780347371s) [upload=3111]: Next returned nil segment Aug 7 19:27:44.193306900 (3h0m57.780363151s) [upload=3111]: Waiting for error group managing segments... Aug 7 19:27:44.209607597 (3h0m57.796663838s) [noise=true , address=104.36.82.43:4848 , piece_id=BBRVVYNYLMEDVZPFP2F4N5U2MTZDF4JPX2QMPLUYQ4CDKFFWKKPQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.211275410 (3h0m57.798331651s) [noise=true , address=104.36.82.47:4532 , piece_id=4GBF3A2LT3TKURVNSPXY7KJNSIOAGLB2P3BCOUJJJBEDKDUFKOMA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.217863949 (3h0m57.8049202s) [noise=true , address=104.36.82.60:4349 , piece_id=DW2C5CYLEL4BA6U3CDWN6VW6UJ5N5JE3TUD7MRTUQH5KFMMRD7AQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.219360643 (3h0m57.806416894s) [noise=true , address=104.36.82.59:4311 , piece_id=TVNTDOMNUCJF4A3YFSXQIXJEAPLFN56HGPJ5DG4I43QVPLW4CZ6Q, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.220779782 (3h0m57.807836022s) [noise=true , address=104.36.82.55:4201 , piece_id=UCT3UZQGQJCXOBGPJVSFUI26CQYRS5YW3MEWLDZO32UAC56I2OHA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.221735776 (3h0m57.808792018s) [noise=true , address=104.36.82.62:4412 , piece_id=VTW7D5FWI57JQSXSXYVFSGP3DF6LAYY763QILC2L6FD7XOY2PWMA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.224644716 (3h0m57.811700957s) [noise=true , address=45.91.116.10:4106 , piece_id=M434Q2FT2O6VAOMNW5OH5DO5GFQTJ2P4QZFIYWN6HHS3LDM5DZQA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.229617950 (3h0m57.816674191s) [noise=true , address=104.36.82.14:4239 , piece_id=FWDFC254IVBP53YZXMJC74VU23YEONN45ZGO7TJGZ2VAIB5ZTV6A, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.230697154 (3h0m57.817753395s) [noise=true , address=104.36.82.18:4398 , piece_id=GLBCIUKUYNUMCPG2KTKKXS4G26PCPM22QNYJZBQ7LL5DSRZBFYKQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.234957226 (3h0m57.822013468s) [noise=true , address=104.36.82.12:4159 , piece_id=YA7AS3EQIYKWEA2NMDAZUJYPIE7G2NGS3HSDVFV2TH7EBHZFCFHQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.237122999 (3h0m57.82417924s) [noise=true , address=45.91.116.5:4309 , piece_id=2ZAQDU5E26KNU7Q3XQ5HDEECKY6MH7NEBHFNHUXNZQI73FGTVL3Q, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.243298527 (3h0m57.830354768s) [noise=true , address=104.36.82.3:4785 , piece_id=ICT5THFHEBQQDELTJI44YTXKKOADC36QTG6PIZTQUK4YH5W6AZRQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.305437629 (3h0m57.892493871s) [noise=true , address=79.127.201.215:4344 , piece_id=3X6ZPSPEPZYDICKWAHHMAIR4MTWPUVTZWMVDIPEKDDCNNB44SMWA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.314176622 (3h0m57.901232863s) [noise=true , address=104.36.82.36:4652 , piece_id=OYDPP7KRAWZI5K3WGROJ7Z2RCW7RXGDQENOGSQJJHNYKNTRVICQQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.314225393 (3h0m57.901281635s) [seg_pos={0 0}, upload=3111]: Segment reached optimal threshold of 14 pieces. Aug 7 19:27:44.314403605 (3h0m57.901459847s) [noise=true , address=104.36.82.44:4884 , piece_id=3HG77VZOMC7C2BFE2OOR4N7ZUI2R7V3MPTIBYY5BCDPOF2ZVWB3A, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF Aug 7 19:27:44.314450183 (3h0m57.901506424s) [noise=true , address=104.36.82.16:4303 , piece_id=LIGUJZKXUSDOAY6EBKFCDBSJQ4W2ZTYLS5ZRTMVZ4SB3IPOIRCAA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ec4Xvp3nGRAm9BivLLTp6AVkMoz1i2AgXQdfQaAmNPLHWD4Yv): protocol: expected piece hash; context canceled; EOF Aug 7 19:27:44.314752737 (3h0m57.901808979s) [noise=true , address=104.36.82.23:4462 , piece_id=4BTWSC6DSBHTSYQELVQWKAIJALQ7TLSZJA4VIDG4FXCKXJM6KPIA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YirC8WVSoE1qrWGMmayNmCsDLxjUhggrgXL5unKtQjsfUkbMu): protocol: read tcp 5.161.89.252:19630->104.36.82.23:4462: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.314762766 (3h0m57.901819017s) [noise=true , address=104.36.82.8:4992 , piece_id=2R4DIYO5UQXJ56GRK6JA5J6BXWRASRUHF544M6MHDBC6NXAISTJA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hbt8HKTunpPKyAzH4XBwGQqTKzcgqPpoWwKZm9JMtaK8P7aVp): protocol: write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection; write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection Aug 7 19:27:44.314798644 (3h0m57.901854884s) [seg_pos={0 0}, upload=3111]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:27:44.314911785 (3h0m57.901968026s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 19:27:44.314941310 (3h0m57.901997561s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 19:27:44.620205884 (3h0m58.207262095s) [upload=3111]: Done uploading segments... Aug 7 19:27:44.620221594 (3h0m58.207277804s) [upload=3111]: Upload finished. err: <nil>
Duration: 524.254074ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................................X........X....] duration:
800.724544ms
FAIL (2025-08-07 19:29:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== upload Aug 7 19:27:44.006467873 (3h0m57.593524104s) [upload=3111]: Uploading segments... Aug 7 19:27:44.006762594 (3h0m57.593818835s) [upload=3111]: Got next segment. Inline: false Aug 7 19:27:44.006802177 (3h0m57.593858418s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 19:27:44.006807697 (3h0m57.593863939s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 19:27:44.056805204 (3h0m57.643861445s) [seg_pos={0 0}, upload=3111]: Begin upload segment... Aug 7 19:27:44.056847824 (3h0m57.643904055s) [seg_pos={0 0}, upload=3111]: Done begin upload segment. Aug 7 19:27:44.056875095 (3h0m57.643931386s) [noise=true , address=104.36.82.43:4848 , piece_id=BBRVVYNYLMEDVZPFP2F4N5U2MTZDF4JPX2QMPLUYQ4CDKFFWKKPQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.056888329 (3h0m57.64394457s) [noise=true , address=104.36.82.12:4159 , piece_id=YA7AS3EQIYKWEA2NMDAZUJYPIE7G2NGS3HSDVFV2TH7EBHZFCFHQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.056930177 (3h0m57.643986419s) [noise=true , address=104.36.82.16:4303 , piece_id=LIGUJZKXUSDOAY6EBKFCDBSJQ4W2ZTYLS5ZRTMVZ4SB3IPOIRCAA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057326708 (3h0m57.644382949s) [noise=true , address=104.36.82.36:4652 , piece_id=OYDPP7KRAWZI5K3WGROJ7Z2RCW7RXGDQENOGSQJJHNYKNTRVICQQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057335624 (3h0m57.644391866s) [noise=true , address=104.36.82.62:4412 , piece_id=VTW7D5FWI57JQSXSXYVFSGP3DF6LAYY763QILC2L6FD7XOY2PWMA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057710634 (3h0m57.644766875s) [noise=true , address=45.91.116.10:4106 , piece_id=M434Q2FT2O6VAOMNW5OH5DO5GFQTJ2P4QZFIYWN6HHS3LDM5DZQA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057732425 (3h0m57.644788666s) [noise=true , address=104.36.82.60:4349 , piece_id=DW2C5CYLEL4BA6U3CDWN6VW6UJ5N5JE3TUD7MRTUQH5KFMMRD7AQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058048605 (3h0m57.645104846s) [noise=true , address=104.36.82.23:4462 , piece_id=4BTWSC6DSBHTSYQELVQWKAIJALQ7TLSZJA4VIDG4FXCKXJM6KPIA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058075335 (3h0m57.645131576s) [noise=true , address=104.36.82.14:4239 , piece_id=FWDFC254IVBP53YZXMJC74VU23YEONN45ZGO7TJGZ2VAIB5ZTV6A, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058376747 (3h0m57.645432978s) [noise=true , address=104.36.82.47:4532 , piece_id=4GBF3A2LT3TKURVNSPXY7KJNSIOAGLB2P3BCOUJJJBEDKDUFKOMA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058721150 (3h0m57.645777391s) [noise=true , address=104.36.82.8:4992 , piece_id=2R4DIYO5UQXJ56GRK6JA5J6BXWRASRUHF544M6MHDBC6NXAISTJA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059050325 (3h0m57.646106556s) [noise=true , address=104.36.82.55:4201 , piece_id=UCT3UZQGQJCXOBGPJVSFUI26CQYRS5YW3MEWLDZO32UAC56I2OHA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059376785 (3h0m57.646433016s) [noise=true , address=104.36.82.59:4311 , piece_id=TVNTDOMNUCJF4A3YFSXQIXJEAPLFN56HGPJ5DG4I43QVPLW4CZ6Q, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059723321 (3h0m57.646779552s) [noise=true , address=104.36.82.18:4398 , piece_id=GLBCIUKUYNUMCPG2KTKKXS4G26PCPM22QNYJZBQ7LL5DSRZBFYKQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060115413 (3h0m57.647171645s) [noise=true , address=104.36.82.44:4884 , piece_id=3HG77VZOMC7C2BFE2OOR4N7ZUI2R7V3MPTIBYY5BCDPOF2ZVWB3A, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060458384 (3h0m57.647514625s) [noise=true , address=79.127.201.215:4344 , piece_id=3X6ZPSPEPZYDICKWAHHMAIR4MTWPUVTZWMVDIPEKDDCNNB44SMWA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060821732 (3h0m57.647877973s) [noise=true , address=104.36.82.3:4785 , piece_id=ICT5THFHEBQQDELTJI44YTXKKOADC36QTG6PIZTQUK4YH5W6AZRQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.061179059 (3h0m57.64823529s) [noise=true , address=45.91.116.5:4309 , piece_id=2ZAQDU5E26KNU7Q3XQ5HDEECKY6MH7NEBHFNHUXNZQI73FGTVL3Q, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.193291120 (3h0m57.780347371s) [upload=3111]: Next returned nil segment Aug 7 19:27:44.193306900 (3h0m57.780363151s) [upload=3111]: Waiting for error group managing segments... Aug 7 19:27:44.209607597 (3h0m57.796663838s) [noise=true , address=104.36.82.43:4848 , piece_id=BBRVVYNYLMEDVZPFP2F4N5U2MTZDF4JPX2QMPLUYQ4CDKFFWKKPQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.211275410 (3h0m57.798331651s) [noise=true , address=104.36.82.47:4532 , piece_id=4GBF3A2LT3TKURVNSPXY7KJNSIOAGLB2P3BCOUJJJBEDKDUFKOMA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.217863949 (3h0m57.8049202s) [noise=true , address=104.36.82.60:4349 , piece_id=DW2C5CYLEL4BA6U3CDWN6VW6UJ5N5JE3TUD7MRTUQH5KFMMRD7AQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.219360643 (3h0m57.806416894s) [noise=true , address=104.36.82.59:4311 , piece_id=TVNTDOMNUCJF4A3YFSXQIXJEAPLFN56HGPJ5DG4I43QVPLW4CZ6Q, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.220779782 (3h0m57.807836022s) [noise=true , address=104.36.82.55:4201 , piece_id=UCT3UZQGQJCXOBGPJVSFUI26CQYRS5YW3MEWLDZO32UAC56I2OHA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.221735776 (3h0m57.808792018s) [noise=true , address=104.36.82.62:4412 , piece_id=VTW7D5FWI57JQSXSXYVFSGP3DF6LAYY763QILC2L6FD7XOY2PWMA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.224644716 (3h0m57.811700957s) [noise=true , address=45.91.116.10:4106 , piece_id=M434Q2FT2O6VAOMNW5OH5DO5GFQTJ2P4QZFIYWN6HHS3LDM5DZQA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.229617950 (3h0m57.816674191s) [noise=true , address=104.36.82.14:4239 , piece_id=FWDFC254IVBP53YZXMJC74VU23YEONN45ZGO7TJGZ2VAIB5ZTV6A, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.230697154 (3h0m57.817753395s) [noise=true , address=104.36.82.18:4398 , piece_id=GLBCIUKUYNUMCPG2KTKKXS4G26PCPM22QNYJZBQ7LL5DSRZBFYKQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.234957226 (3h0m57.822013468s) [noise=true , address=104.36.82.12:4159 , piece_id=YA7AS3EQIYKWEA2NMDAZUJYPIE7G2NGS3HSDVFV2TH7EBHZFCFHQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.237122999 (3h0m57.82417924s) [noise=true , address=45.91.116.5:4309 , piece_id=2ZAQDU5E26KNU7Q3XQ5HDEECKY6MH7NEBHFNHUXNZQI73FGTVL3Q, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.243298527 (3h0m57.830354768s) [noise=true , address=104.36.82.3:4785 , piece_id=ICT5THFHEBQQDELTJI44YTXKKOADC36QTG6PIZTQUK4YH5W6AZRQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.305437629 (3h0m57.892493871s) [noise=true , address=79.127.201.215:4344 , piece_id=3X6ZPSPEPZYDICKWAHHMAIR4MTWPUVTZWMVDIPEKDDCNNB44SMWA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.314176622 (3h0m57.901232863s) [noise=true , address=104.36.82.36:4652 , piece_id=OYDPP7KRAWZI5K3WGROJ7Z2RCW7RXGDQENOGSQJJHNYKNTRVICQQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.314225393 (3h0m57.901281635s) [seg_pos={0 0}, upload=3111]: Segment reached optimal threshold of 14 pieces. Aug 7 19:27:44.314403605 (3h0m57.901459847s) [noise=true , address=104.36.82.44:4884 , piece_id=3HG77VZOMC7C2BFE2OOR4N7ZUI2R7V3MPTIBYY5BCDPOF2ZVWB3A, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF Aug 7 19:27:44.314450183 (3h0m57.901506424s) [noise=true , address=104.36.82.16:4303 , piece_id=LIGUJZKXUSDOAY6EBKFCDBSJQ4W2ZTYLS5ZRTMVZ4SB3IPOIRCAA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ec4Xvp3nGRAm9BivLLTp6AVkMoz1i2AgXQdfQaAmNPLHWD4Yv): protocol: expected piece hash; context canceled; EOF Aug 7 19:27:44.314752737 (3h0m57.901808979s) [noise=true , address=104.36.82.23:4462 , piece_id=4BTWSC6DSBHTSYQELVQWKAIJALQ7TLSZJA4VIDG4FXCKXJM6KPIA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YirC8WVSoE1qrWGMmayNmCsDLxjUhggrgXL5unKtQjsfUkbMu): protocol: read tcp 5.161.89.252:19630->104.36.82.23:4462: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.314762766 (3h0m57.901819017s) [noise=true , address=104.36.82.8:4992 , piece_id=2R4DIYO5UQXJ56GRK6JA5J6BXWRASRUHF544M6MHDBC6NXAISTJA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hbt8HKTunpPKyAzH4XBwGQqTKzcgqPpoWwKZm9JMtaK8P7aVp): protocol: write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection; write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection Aug 7 19:27:44.314798644 (3h0m57.901854884s) [seg_pos={0 0}, upload=3111]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:27:44.314911785 (3h0m57.901968026s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 19:27:44.314941310 (3h0m57.901997561s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 19:27:44.620205884 (3h0m58.207262095s) [upload=3111]: Done uploading segments... Aug 7 19:27:44.620221594 (3h0m58.207277804s) [upload=3111]: Upload finished. err: <nil>
Duration: 800.746135ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................................X........X...] duration:
466.166575ms
FAIL (2025-08-07 19:28:43 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== upload Aug 7 19:27:44.006467873 (3h0m57.593524104s) [upload=3111]: Uploading segments... Aug 7 19:27:44.006762594 (3h0m57.593818835s) [upload=3111]: Got next segment. Inline: false Aug 7 19:27:44.006802177 (3h0m57.593858418s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 19:27:44.006807697 (3h0m57.593863939s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 19:27:44.056805204 (3h0m57.643861445s) [seg_pos={0 0}, upload=3111]: Begin upload segment... Aug 7 19:27:44.056847824 (3h0m57.643904055s) [seg_pos={0 0}, upload=3111]: Done begin upload segment. Aug 7 19:27:44.056875095 (3h0m57.643931386s) [noise=true , address=104.36.82.43:4848 , piece_id=BBRVVYNYLMEDVZPFP2F4N5U2MTZDF4JPX2QMPLUYQ4CDKFFWKKPQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.056888329 (3h0m57.64394457s) [noise=true , address=104.36.82.12:4159 , piece_id=YA7AS3EQIYKWEA2NMDAZUJYPIE7G2NGS3HSDVFV2TH7EBHZFCFHQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.056930177 (3h0m57.643986419s) [noise=true , address=104.36.82.16:4303 , piece_id=LIGUJZKXUSDOAY6EBKFCDBSJQ4W2ZTYLS5ZRTMVZ4SB3IPOIRCAA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057326708 (3h0m57.644382949s) [noise=true , address=104.36.82.36:4652 , piece_id=OYDPP7KRAWZI5K3WGROJ7Z2RCW7RXGDQENOGSQJJHNYKNTRVICQQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057335624 (3h0m57.644391866s) [noise=true , address=104.36.82.62:4412 , piece_id=VTW7D5FWI57JQSXSXYVFSGP3DF6LAYY763QILC2L6FD7XOY2PWMA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057710634 (3h0m57.644766875s) [noise=true , address=45.91.116.10:4106 , piece_id=M434Q2FT2O6VAOMNW5OH5DO5GFQTJ2P4QZFIYWN6HHS3LDM5DZQA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057732425 (3h0m57.644788666s) [noise=true , address=104.36.82.60:4349 , piece_id=DW2C5CYLEL4BA6U3CDWN6VW6UJ5N5JE3TUD7MRTUQH5KFMMRD7AQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058048605 (3h0m57.645104846s) [noise=true , address=104.36.82.23:4462 , piece_id=4BTWSC6DSBHTSYQELVQWKAIJALQ7TLSZJA4VIDG4FXCKXJM6KPIA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058075335 (3h0m57.645131576s) [noise=true , address=104.36.82.14:4239 , piece_id=FWDFC254IVBP53YZXMJC74VU23YEONN45ZGO7TJGZ2VAIB5ZTV6A, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058376747 (3h0m57.645432978s) [noise=true , address=104.36.82.47:4532 , piece_id=4GBF3A2LT3TKURVNSPXY7KJNSIOAGLB2P3BCOUJJJBEDKDUFKOMA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058721150 (3h0m57.645777391s) [noise=true , address=104.36.82.8:4992 , piece_id=2R4DIYO5UQXJ56GRK6JA5J6BXWRASRUHF544M6MHDBC6NXAISTJA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059050325 (3h0m57.646106556s) [noise=true , address=104.36.82.55:4201 , piece_id=UCT3UZQGQJCXOBGPJVSFUI26CQYRS5YW3MEWLDZO32UAC56I2OHA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059376785 (3h0m57.646433016s) [noise=true , address=104.36.82.59:4311 , piece_id=TVNTDOMNUCJF4A3YFSXQIXJEAPLFN56HGPJ5DG4I43QVPLW4CZ6Q, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059723321 (3h0m57.646779552s) [noise=true , address=104.36.82.18:4398 , piece_id=GLBCIUKUYNUMCPG2KTKKXS4G26PCPM22QNYJZBQ7LL5DSRZBFYKQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060115413 (3h0m57.647171645s) [noise=true , address=104.36.82.44:4884 , piece_id=3HG77VZOMC7C2BFE2OOR4N7ZUI2R7V3MPTIBYY5BCDPOF2ZVWB3A, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060458384 (3h0m57.647514625s) [noise=true , address=79.127.201.215:4344 , piece_id=3X6ZPSPEPZYDICKWAHHMAIR4MTWPUVTZWMVDIPEKDDCNNB44SMWA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060821732 (3h0m57.647877973s) [noise=true , address=104.36.82.3:4785 , piece_id=ICT5THFHEBQQDELTJI44YTXKKOADC36QTG6PIZTQUK4YH5W6AZRQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.061179059 (3h0m57.64823529s) [noise=true , address=45.91.116.5:4309 , piece_id=2ZAQDU5E26KNU7Q3XQ5HDEECKY6MH7NEBHFNHUXNZQI73FGTVL3Q, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.193291120 (3h0m57.780347371s) [upload=3111]: Next returned nil segment Aug 7 19:27:44.193306900 (3h0m57.780363151s) [upload=3111]: Waiting for error group managing segments... Aug 7 19:27:44.209607597 (3h0m57.796663838s) [noise=true , address=104.36.82.43:4848 , piece_id=BBRVVYNYLMEDVZPFP2F4N5U2MTZDF4JPX2QMPLUYQ4CDKFFWKKPQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.211275410 (3h0m57.798331651s) [noise=true , address=104.36.82.47:4532 , piece_id=4GBF3A2LT3TKURVNSPXY7KJNSIOAGLB2P3BCOUJJJBEDKDUFKOMA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.217863949 (3h0m57.8049202s) [noise=true , address=104.36.82.60:4349 , piece_id=DW2C5CYLEL4BA6U3CDWN6VW6UJ5N5JE3TUD7MRTUQH5KFMMRD7AQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.219360643 (3h0m57.806416894s) [noise=true , address=104.36.82.59:4311 , piece_id=TVNTDOMNUCJF4A3YFSXQIXJEAPLFN56HGPJ5DG4I43QVPLW4CZ6Q, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.220779782 (3h0m57.807836022s) [noise=true , address=104.36.82.55:4201 , piece_id=UCT3UZQGQJCXOBGPJVSFUI26CQYRS5YW3MEWLDZO32UAC56I2OHA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.221735776 (3h0m57.808792018s) [noise=true , address=104.36.82.62:4412 , piece_id=VTW7D5FWI57JQSXSXYVFSGP3DF6LAYY763QILC2L6FD7XOY2PWMA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.224644716 (3h0m57.811700957s) [noise=true , address=45.91.116.10:4106 , piece_id=M434Q2FT2O6VAOMNW5OH5DO5GFQTJ2P4QZFIYWN6HHS3LDM5DZQA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.229617950 (3h0m57.816674191s) [noise=true , address=104.36.82.14:4239 , piece_id=FWDFC254IVBP53YZXMJC74VU23YEONN45ZGO7TJGZ2VAIB5ZTV6A, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.230697154 (3h0m57.817753395s) [noise=true , address=104.36.82.18:4398 , piece_id=GLBCIUKUYNUMCPG2KTKKXS4G26PCPM22QNYJZBQ7LL5DSRZBFYKQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.234957226 (3h0m57.822013468s) [noise=true , address=104.36.82.12:4159 , piece_id=YA7AS3EQIYKWEA2NMDAZUJYPIE7G2NGS3HSDVFV2TH7EBHZFCFHQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.237122999 (3h0m57.82417924s) [noise=true , address=45.91.116.5:4309 , piece_id=2ZAQDU5E26KNU7Q3XQ5HDEECKY6MH7NEBHFNHUXNZQI73FGTVL3Q, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.243298527 (3h0m57.830354768s) [noise=true , address=104.36.82.3:4785 , piece_id=ICT5THFHEBQQDELTJI44YTXKKOADC36QTG6PIZTQUK4YH5W6AZRQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.305437629 (3h0m57.892493871s) [noise=true , address=79.127.201.215:4344 , piece_id=3X6ZPSPEPZYDICKWAHHMAIR4MTWPUVTZWMVDIPEKDDCNNB44SMWA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.314176622 (3h0m57.901232863s) [noise=true , address=104.36.82.36:4652 , piece_id=OYDPP7KRAWZI5K3WGROJ7Z2RCW7RXGDQENOGSQJJHNYKNTRVICQQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.314225393 (3h0m57.901281635s) [seg_pos={0 0}, upload=3111]: Segment reached optimal threshold of 14 pieces. Aug 7 19:27:44.314403605 (3h0m57.901459847s) [noise=true , address=104.36.82.44:4884 , piece_id=3HG77VZOMC7C2BFE2OOR4N7ZUI2R7V3MPTIBYY5BCDPOF2ZVWB3A, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF Aug 7 19:27:44.314450183 (3h0m57.901506424s) [noise=true , address=104.36.82.16:4303 , piece_id=LIGUJZKXUSDOAY6EBKFCDBSJQ4W2ZTYLS5ZRTMVZ4SB3IPOIRCAA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ec4Xvp3nGRAm9BivLLTp6AVkMoz1i2AgXQdfQaAmNPLHWD4Yv): protocol: expected piece hash; context canceled; EOF Aug 7 19:27:44.314752737 (3h0m57.901808979s) [noise=true , address=104.36.82.23:4462 , piece_id=4BTWSC6DSBHTSYQELVQWKAIJALQ7TLSZJA4VIDG4FXCKXJM6KPIA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YirC8WVSoE1qrWGMmayNmCsDLxjUhggrgXL5unKtQjsfUkbMu): protocol: read tcp 5.161.89.252:19630->104.36.82.23:4462: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.314762766 (3h0m57.901819017s) [noise=true , address=104.36.82.8:4992 , piece_id=2R4DIYO5UQXJ56GRK6JA5J6BXWRASRUHF544M6MHDBC6NXAISTJA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hbt8HKTunpPKyAzH4XBwGQqTKzcgqPpoWwKZm9JMtaK8P7aVp): protocol: write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection; write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection Aug 7 19:27:44.314798644 (3h0m57.901854884s) [seg_pos={0 0}, upload=3111]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:27:44.314911785 (3h0m57.901968026s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 19:27:44.314941310 (3h0m57.901997561s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 19:27:44.620205884 (3h0m58.207262095s) [upload=3111]: Done uploading segments... Aug 7 19:27:44.620221594 (3h0m58.207277804s) [upload=3111]: Upload finished. err: <nil>
Duration: 466.188275ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................................................X........X..] duration:
528.710545ms
FAIL (2025-08-07 19:28:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== upload Aug 7 19:27:44.006467873 (3h0m57.593524104s) [upload=3111]: Uploading segments... Aug 7 19:27:44.006762594 (3h0m57.593818835s) [upload=3111]: Got next segment. Inline: false Aug 7 19:27:44.006802177 (3h0m57.593858418s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 19:27:44.006807697 (3h0m57.593863939s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 19:27:44.056805204 (3h0m57.643861445s) [seg_pos={0 0}, upload=3111]: Begin upload segment... Aug 7 19:27:44.056847824 (3h0m57.643904055s) [seg_pos={0 0}, upload=3111]: Done begin upload segment. Aug 7 19:27:44.056875095 (3h0m57.643931386s) [noise=true , address=104.36.82.43:4848 , piece_id=BBRVVYNYLMEDVZPFP2F4N5U2MTZDF4JPX2QMPLUYQ4CDKFFWKKPQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.056888329 (3h0m57.64394457s) [noise=true , address=104.36.82.12:4159 , piece_id=YA7AS3EQIYKWEA2NMDAZUJYPIE7G2NGS3HSDVFV2TH7EBHZFCFHQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.056930177 (3h0m57.643986419s) [noise=true , address=104.36.82.16:4303 , piece_id=LIGUJZKXUSDOAY6EBKFCDBSJQ4W2ZTYLS5ZRTMVZ4SB3IPOIRCAA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057326708 (3h0m57.644382949s) [noise=true , address=104.36.82.36:4652 , piece_id=OYDPP7KRAWZI5K3WGROJ7Z2RCW7RXGDQENOGSQJJHNYKNTRVICQQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057335624 (3h0m57.644391866s) [noise=true , address=104.36.82.62:4412 , piece_id=VTW7D5FWI57JQSXSXYVFSGP3DF6LAYY763QILC2L6FD7XOY2PWMA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057710634 (3h0m57.644766875s) [noise=true , address=45.91.116.10:4106 , piece_id=M434Q2FT2O6VAOMNW5OH5DO5GFQTJ2P4QZFIYWN6HHS3LDM5DZQA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057732425 (3h0m57.644788666s) [noise=true , address=104.36.82.60:4349 , piece_id=DW2C5CYLEL4BA6U3CDWN6VW6UJ5N5JE3TUD7MRTUQH5KFMMRD7AQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058048605 (3h0m57.645104846s) [noise=true , address=104.36.82.23:4462 , piece_id=4BTWSC6DSBHTSYQELVQWKAIJALQ7TLSZJA4VIDG4FXCKXJM6KPIA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058075335 (3h0m57.645131576s) [noise=true , address=104.36.82.14:4239 , piece_id=FWDFC254IVBP53YZXMJC74VU23YEONN45ZGO7TJGZ2VAIB5ZTV6A, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058376747 (3h0m57.645432978s) [noise=true , address=104.36.82.47:4532 , piece_id=4GBF3A2LT3TKURVNSPXY7KJNSIOAGLB2P3BCOUJJJBEDKDUFKOMA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058721150 (3h0m57.645777391s) [noise=true , address=104.36.82.8:4992 , piece_id=2R4DIYO5UQXJ56GRK6JA5J6BXWRASRUHF544M6MHDBC6NXAISTJA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059050325 (3h0m57.646106556s) [noise=true , address=104.36.82.55:4201 , piece_id=UCT3UZQGQJCXOBGPJVSFUI26CQYRS5YW3MEWLDZO32UAC56I2OHA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059376785 (3h0m57.646433016s) [noise=true , address=104.36.82.59:4311 , piece_id=TVNTDOMNUCJF4A3YFSXQIXJEAPLFN56HGPJ5DG4I43QVPLW4CZ6Q, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059723321 (3h0m57.646779552s) [noise=true , address=104.36.82.18:4398 , piece_id=GLBCIUKUYNUMCPG2KTKKXS4G26PCPM22QNYJZBQ7LL5DSRZBFYKQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060115413 (3h0m57.647171645s) [noise=true , address=104.36.82.44:4884 , piece_id=3HG77VZOMC7C2BFE2OOR4N7ZUI2R7V3MPTIBYY5BCDPOF2ZVWB3A, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060458384 (3h0m57.647514625s) [noise=true , address=79.127.201.215:4344 , piece_id=3X6ZPSPEPZYDICKWAHHMAIR4MTWPUVTZWMVDIPEKDDCNNB44SMWA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060821732 (3h0m57.647877973s) [noise=true , address=104.36.82.3:4785 , piece_id=ICT5THFHEBQQDELTJI44YTXKKOADC36QTG6PIZTQUK4YH5W6AZRQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.061179059 (3h0m57.64823529s) [noise=true , address=45.91.116.5:4309 , piece_id=2ZAQDU5E26KNU7Q3XQ5HDEECKY6MH7NEBHFNHUXNZQI73FGTVL3Q, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.193291120 (3h0m57.780347371s) [upload=3111]: Next returned nil segment Aug 7 19:27:44.193306900 (3h0m57.780363151s) [upload=3111]: Waiting for error group managing segments... Aug 7 19:27:44.209607597 (3h0m57.796663838s) [noise=true , address=104.36.82.43:4848 , piece_id=BBRVVYNYLMEDVZPFP2F4N5U2MTZDF4JPX2QMPLUYQ4CDKFFWKKPQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.211275410 (3h0m57.798331651s) [noise=true , address=104.36.82.47:4532 , piece_id=4GBF3A2LT3TKURVNSPXY7KJNSIOAGLB2P3BCOUJJJBEDKDUFKOMA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.217863949 (3h0m57.8049202s) [noise=true , address=104.36.82.60:4349 , piece_id=DW2C5CYLEL4BA6U3CDWN6VW6UJ5N5JE3TUD7MRTUQH5KFMMRD7AQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.219360643 (3h0m57.806416894s) [noise=true , address=104.36.82.59:4311 , piece_id=TVNTDOMNUCJF4A3YFSXQIXJEAPLFN56HGPJ5DG4I43QVPLW4CZ6Q, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.220779782 (3h0m57.807836022s) [noise=true , address=104.36.82.55:4201 , piece_id=UCT3UZQGQJCXOBGPJVSFUI26CQYRS5YW3MEWLDZO32UAC56I2OHA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.221735776 (3h0m57.808792018s) [noise=true , address=104.36.82.62:4412 , piece_id=VTW7D5FWI57JQSXSXYVFSGP3DF6LAYY763QILC2L6FD7XOY2PWMA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.224644716 (3h0m57.811700957s) [noise=true , address=45.91.116.10:4106 , piece_id=M434Q2FT2O6VAOMNW5OH5DO5GFQTJ2P4QZFIYWN6HHS3LDM5DZQA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.229617950 (3h0m57.816674191s) [noise=true , address=104.36.82.14:4239 , piece_id=FWDFC254IVBP53YZXMJC74VU23YEONN45ZGO7TJGZ2VAIB5ZTV6A, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.230697154 (3h0m57.817753395s) [noise=true , address=104.36.82.18:4398 , piece_id=GLBCIUKUYNUMCPG2KTKKXS4G26PCPM22QNYJZBQ7LL5DSRZBFYKQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.234957226 (3h0m57.822013468s) [noise=true , address=104.36.82.12:4159 , piece_id=YA7AS3EQIYKWEA2NMDAZUJYPIE7G2NGS3HSDVFV2TH7EBHZFCFHQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.237122999 (3h0m57.82417924s) [noise=true , address=45.91.116.5:4309 , piece_id=2ZAQDU5E26KNU7Q3XQ5HDEECKY6MH7NEBHFNHUXNZQI73FGTVL3Q, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.243298527 (3h0m57.830354768s) [noise=true , address=104.36.82.3:4785 , piece_id=ICT5THFHEBQQDELTJI44YTXKKOADC36QTG6PIZTQUK4YH5W6AZRQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.305437629 (3h0m57.892493871s) [noise=true , address=79.127.201.215:4344 , piece_id=3X6ZPSPEPZYDICKWAHHMAIR4MTWPUVTZWMVDIPEKDDCNNB44SMWA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.314176622 (3h0m57.901232863s) [noise=true , address=104.36.82.36:4652 , piece_id=OYDPP7KRAWZI5K3WGROJ7Z2RCW7RXGDQENOGSQJJHNYKNTRVICQQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.314225393 (3h0m57.901281635s) [seg_pos={0 0}, upload=3111]: Segment reached optimal threshold of 14 pieces. Aug 7 19:27:44.314403605 (3h0m57.901459847s) [noise=true , address=104.36.82.44:4884 , piece_id=3HG77VZOMC7C2BFE2OOR4N7ZUI2R7V3MPTIBYY5BCDPOF2ZVWB3A, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF Aug 7 19:27:44.314450183 (3h0m57.901506424s) [noise=true , address=104.36.82.16:4303 , piece_id=LIGUJZKXUSDOAY6EBKFCDBSJQ4W2ZTYLS5ZRTMVZ4SB3IPOIRCAA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ec4Xvp3nGRAm9BivLLTp6AVkMoz1i2AgXQdfQaAmNPLHWD4Yv): protocol: expected piece hash; context canceled; EOF Aug 7 19:27:44.314752737 (3h0m57.901808979s) [noise=true , address=104.36.82.23:4462 , piece_id=4BTWSC6DSBHTSYQELVQWKAIJALQ7TLSZJA4VIDG4FXCKXJM6KPIA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YirC8WVSoE1qrWGMmayNmCsDLxjUhggrgXL5unKtQjsfUkbMu): protocol: read tcp 5.161.89.252:19630->104.36.82.23:4462: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.314762766 (3h0m57.901819017s) [noise=true , address=104.36.82.8:4992 , piece_id=2R4DIYO5UQXJ56GRK6JA5J6BXWRASRUHF544M6MHDBC6NXAISTJA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hbt8HKTunpPKyAzH4XBwGQqTKzcgqPpoWwKZm9JMtaK8P7aVp): protocol: write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection; write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection Aug 7 19:27:44.314798644 (3h0m57.901854884s) [seg_pos={0 0}, upload=3111]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:27:44.314911785 (3h0m57.901968026s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 19:27:44.314941310 (3h0m57.901997561s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 19:27:44.620205884 (3h0m58.207262095s) [upload=3111]: Done uploading segments... Aug 7 19:27:44.620221594 (3h0m58.207277804s) [upload=3111]: Upload finished. err: <nil>
Duration: 528.736603ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................................................X........X.] duration:
791.068979ms
FAIL (2025-08-07 19:28:00 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== upload Aug 7 19:27:44.006467873 (3h0m57.593524104s) [upload=3111]: Uploading segments... Aug 7 19:27:44.006762594 (3h0m57.593818835s) [upload=3111]: Got next segment. Inline: false Aug 7 19:27:44.006802177 (3h0m57.593858418s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 19:27:44.006807697 (3h0m57.593863939s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 19:27:44.056805204 (3h0m57.643861445s) [seg_pos={0 0}, upload=3111]: Begin upload segment... Aug 7 19:27:44.056847824 (3h0m57.643904055s) [seg_pos={0 0}, upload=3111]: Done begin upload segment. Aug 7 19:27:44.056875095 (3h0m57.643931386s) [noise=true , address=104.36.82.43:4848 , piece_id=BBRVVYNYLMEDVZPFP2F4N5U2MTZDF4JPX2QMPLUYQ4CDKFFWKKPQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.056888329 (3h0m57.64394457s) [noise=true , address=104.36.82.12:4159 , piece_id=YA7AS3EQIYKWEA2NMDAZUJYPIE7G2NGS3HSDVFV2TH7EBHZFCFHQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.056930177 (3h0m57.643986419s) [noise=true , address=104.36.82.16:4303 , piece_id=LIGUJZKXUSDOAY6EBKFCDBSJQ4W2ZTYLS5ZRTMVZ4SB3IPOIRCAA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057326708 (3h0m57.644382949s) [noise=true , address=104.36.82.36:4652 , piece_id=OYDPP7KRAWZI5K3WGROJ7Z2RCW7RXGDQENOGSQJJHNYKNTRVICQQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057335624 (3h0m57.644391866s) [noise=true , address=104.36.82.62:4412 , piece_id=VTW7D5FWI57JQSXSXYVFSGP3DF6LAYY763QILC2L6FD7XOY2PWMA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057710634 (3h0m57.644766875s) [noise=true , address=45.91.116.10:4106 , piece_id=M434Q2FT2O6VAOMNW5OH5DO5GFQTJ2P4QZFIYWN6HHS3LDM5DZQA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057732425 (3h0m57.644788666s) [noise=true , address=104.36.82.60:4349 , piece_id=DW2C5CYLEL4BA6U3CDWN6VW6UJ5N5JE3TUD7MRTUQH5KFMMRD7AQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058048605 (3h0m57.645104846s) [noise=true , address=104.36.82.23:4462 , piece_id=4BTWSC6DSBHTSYQELVQWKAIJALQ7TLSZJA4VIDG4FXCKXJM6KPIA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058075335 (3h0m57.645131576s) [noise=true , address=104.36.82.14:4239 , piece_id=FWDFC254IVBP53YZXMJC74VU23YEONN45ZGO7TJGZ2VAIB5ZTV6A, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058376747 (3h0m57.645432978s) [noise=true , address=104.36.82.47:4532 , piece_id=4GBF3A2LT3TKURVNSPXY7KJNSIOAGLB2P3BCOUJJJBEDKDUFKOMA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058721150 (3h0m57.645777391s) [noise=true , address=104.36.82.8:4992 , piece_id=2R4DIYO5UQXJ56GRK6JA5J6BXWRASRUHF544M6MHDBC6NXAISTJA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059050325 (3h0m57.646106556s) [noise=true , address=104.36.82.55:4201 , piece_id=UCT3UZQGQJCXOBGPJVSFUI26CQYRS5YW3MEWLDZO32UAC56I2OHA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059376785 (3h0m57.646433016s) [noise=true , address=104.36.82.59:4311 , piece_id=TVNTDOMNUCJF4A3YFSXQIXJEAPLFN56HGPJ5DG4I43QVPLW4CZ6Q, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059723321 (3h0m57.646779552s) [noise=true , address=104.36.82.18:4398 , piece_id=GLBCIUKUYNUMCPG2KTKKXS4G26PCPM22QNYJZBQ7LL5DSRZBFYKQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060115413 (3h0m57.647171645s) [noise=true , address=104.36.82.44:4884 , piece_id=3HG77VZOMC7C2BFE2OOR4N7ZUI2R7V3MPTIBYY5BCDPOF2ZVWB3A, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060458384 (3h0m57.647514625s) [noise=true , address=79.127.201.215:4344 , piece_id=3X6ZPSPEPZYDICKWAHHMAIR4MTWPUVTZWMVDIPEKDDCNNB44SMWA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060821732 (3h0m57.647877973s) [noise=true , address=104.36.82.3:4785 , piece_id=ICT5THFHEBQQDELTJI44YTXKKOADC36QTG6PIZTQUK4YH5W6AZRQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.061179059 (3h0m57.64823529s) [noise=true , address=45.91.116.5:4309 , piece_id=2ZAQDU5E26KNU7Q3XQ5HDEECKY6MH7NEBHFNHUXNZQI73FGTVL3Q, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.193291120 (3h0m57.780347371s) [upload=3111]: Next returned nil segment Aug 7 19:27:44.193306900 (3h0m57.780363151s) [upload=3111]: Waiting for error group managing segments... Aug 7 19:27:44.209607597 (3h0m57.796663838s) [noise=true , address=104.36.82.43:4848 , piece_id=BBRVVYNYLMEDVZPFP2F4N5U2MTZDF4JPX2QMPLUYQ4CDKFFWKKPQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.211275410 (3h0m57.798331651s) [noise=true , address=104.36.82.47:4532 , piece_id=4GBF3A2LT3TKURVNSPXY7KJNSIOAGLB2P3BCOUJJJBEDKDUFKOMA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.217863949 (3h0m57.8049202s) [noise=true , address=104.36.82.60:4349 , piece_id=DW2C5CYLEL4BA6U3CDWN6VW6UJ5N5JE3TUD7MRTUQH5KFMMRD7AQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.219360643 (3h0m57.806416894s) [noise=true , address=104.36.82.59:4311 , piece_id=TVNTDOMNUCJF4A3YFSXQIXJEAPLFN56HGPJ5DG4I43QVPLW4CZ6Q, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.220779782 (3h0m57.807836022s) [noise=true , address=104.36.82.55:4201 , piece_id=UCT3UZQGQJCXOBGPJVSFUI26CQYRS5YW3MEWLDZO32UAC56I2OHA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.221735776 (3h0m57.808792018s) [noise=true , address=104.36.82.62:4412 , piece_id=VTW7D5FWI57JQSXSXYVFSGP3DF6LAYY763QILC2L6FD7XOY2PWMA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.224644716 (3h0m57.811700957s) [noise=true , address=45.91.116.10:4106 , piece_id=M434Q2FT2O6VAOMNW5OH5DO5GFQTJ2P4QZFIYWN6HHS3LDM5DZQA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.229617950 (3h0m57.816674191s) [noise=true , address=104.36.82.14:4239 , piece_id=FWDFC254IVBP53YZXMJC74VU23YEONN45ZGO7TJGZ2VAIB5ZTV6A, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.230697154 (3h0m57.817753395s) [noise=true , address=104.36.82.18:4398 , piece_id=GLBCIUKUYNUMCPG2KTKKXS4G26PCPM22QNYJZBQ7LL5DSRZBFYKQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.234957226 (3h0m57.822013468s) [noise=true , address=104.36.82.12:4159 , piece_id=YA7AS3EQIYKWEA2NMDAZUJYPIE7G2NGS3HSDVFV2TH7EBHZFCFHQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.237122999 (3h0m57.82417924s) [noise=true , address=45.91.116.5:4309 , piece_id=2ZAQDU5E26KNU7Q3XQ5HDEECKY6MH7NEBHFNHUXNZQI73FGTVL3Q, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.243298527 (3h0m57.830354768s) [noise=true , address=104.36.82.3:4785 , piece_id=ICT5THFHEBQQDELTJI44YTXKKOADC36QTG6PIZTQUK4YH5W6AZRQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.305437629 (3h0m57.892493871s) [noise=true , address=79.127.201.215:4344 , piece_id=3X6ZPSPEPZYDICKWAHHMAIR4MTWPUVTZWMVDIPEKDDCNNB44SMWA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.314176622 (3h0m57.901232863s) [noise=true , address=104.36.82.36:4652 , piece_id=OYDPP7KRAWZI5K3WGROJ7Z2RCW7RXGDQENOGSQJJHNYKNTRVICQQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.314225393 (3h0m57.901281635s) [seg_pos={0 0}, upload=3111]: Segment reached optimal threshold of 14 pieces. Aug 7 19:27:44.314403605 (3h0m57.901459847s) [noise=true , address=104.36.82.44:4884 , piece_id=3HG77VZOMC7C2BFE2OOR4N7ZUI2R7V3MPTIBYY5BCDPOF2ZVWB3A, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF Aug 7 19:27:44.314450183 (3h0m57.901506424s) [noise=true , address=104.36.82.16:4303 , piece_id=LIGUJZKXUSDOAY6EBKFCDBSJQ4W2ZTYLS5ZRTMVZ4SB3IPOIRCAA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ec4Xvp3nGRAm9BivLLTp6AVkMoz1i2AgXQdfQaAmNPLHWD4Yv): protocol: expected piece hash; context canceled; EOF Aug 7 19:27:44.314752737 (3h0m57.901808979s) [noise=true , address=104.36.82.23:4462 , piece_id=4BTWSC6DSBHTSYQELVQWKAIJALQ7TLSZJA4VIDG4FXCKXJM6KPIA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YirC8WVSoE1qrWGMmayNmCsDLxjUhggrgXL5unKtQjsfUkbMu): protocol: read tcp 5.161.89.252:19630->104.36.82.23:4462: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.314762766 (3h0m57.901819017s) [noise=true , address=104.36.82.8:4992 , piece_id=2R4DIYO5UQXJ56GRK6JA5J6BXWRASRUHF544M6MHDBC6NXAISTJA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hbt8HKTunpPKyAzH4XBwGQqTKzcgqPpoWwKZm9JMtaK8P7aVp): protocol: write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection; write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection Aug 7 19:27:44.314798644 (3h0m57.901854884s) [seg_pos={0 0}, upload=3111]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:27:44.314911785 (3h0m57.901968026s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 19:27:44.314941310 (3h0m57.901997561s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 19:27:44.620205884 (3h0m58.207262095s) [upload=3111]: Done uploading segments... Aug 7 19:27:44.620221594 (3h0m58.207277804s) [upload=3111]: Upload finished. err: <nil>
Duration: 791.092894ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................................................X........X] duration:
817.746808ms
FAIL (2025-08-07 19:27:44 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== upload Aug 7 19:27:44.006467873 (3h0m57.593524104s) [upload=3111]: Uploading segments... Aug 7 19:27:44.006762594 (3h0m57.593818835s) [upload=3111]: Got next segment. Inline: false Aug 7 19:27:44.006802177 (3h0m57.593858418s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 19:27:44.006807697 (3h0m57.593863939s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 19:27:44.056805204 (3h0m57.643861445s) [seg_pos={0 0}, upload=3111]: Begin upload segment... Aug 7 19:27:44.056847824 (3h0m57.643904055s) [seg_pos={0 0}, upload=3111]: Done begin upload segment. Aug 7 19:27:44.056875095 (3h0m57.643931386s) [noise=true , address=104.36.82.43:4848 , piece_id=BBRVVYNYLMEDVZPFP2F4N5U2MTZDF4JPX2QMPLUYQ4CDKFFWKKPQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.056888329 (3h0m57.64394457s) [noise=true , address=104.36.82.12:4159 , piece_id=YA7AS3EQIYKWEA2NMDAZUJYPIE7G2NGS3HSDVFV2TH7EBHZFCFHQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.056930177 (3h0m57.643986419s) [noise=true , address=104.36.82.16:4303 , piece_id=LIGUJZKXUSDOAY6EBKFCDBSJQ4W2ZTYLS5ZRTMVZ4SB3IPOIRCAA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057326708 (3h0m57.644382949s) [noise=true , address=104.36.82.36:4652 , piece_id=OYDPP7KRAWZI5K3WGROJ7Z2RCW7RXGDQENOGSQJJHNYKNTRVICQQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057335624 (3h0m57.644391866s) [noise=true , address=104.36.82.62:4412 , piece_id=VTW7D5FWI57JQSXSXYVFSGP3DF6LAYY763QILC2L6FD7XOY2PWMA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057710634 (3h0m57.644766875s) [noise=true , address=45.91.116.10:4106 , piece_id=M434Q2FT2O6VAOMNW5OH5DO5GFQTJ2P4QZFIYWN6HHS3LDM5DZQA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.057732425 (3h0m57.644788666s) [noise=true , address=104.36.82.60:4349 , piece_id=DW2C5CYLEL4BA6U3CDWN6VW6UJ5N5JE3TUD7MRTUQH5KFMMRD7AQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058048605 (3h0m57.645104846s) [noise=true , address=104.36.82.23:4462 , piece_id=4BTWSC6DSBHTSYQELVQWKAIJALQ7TLSZJA4VIDG4FXCKXJM6KPIA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058075335 (3h0m57.645131576s) [noise=true , address=104.36.82.14:4239 , piece_id=FWDFC254IVBP53YZXMJC74VU23YEONN45ZGO7TJGZ2VAIB5ZTV6A, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058376747 (3h0m57.645432978s) [noise=true , address=104.36.82.47:4532 , piece_id=4GBF3A2LT3TKURVNSPXY7KJNSIOAGLB2P3BCOUJJJBEDKDUFKOMA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.058721150 (3h0m57.645777391s) [noise=true , address=104.36.82.8:4992 , piece_id=2R4DIYO5UQXJ56GRK6JA5J6BXWRASRUHF544M6MHDBC6NXAISTJA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059050325 (3h0m57.646106556s) [noise=true , address=104.36.82.55:4201 , piece_id=UCT3UZQGQJCXOBGPJVSFUI26CQYRS5YW3MEWLDZO32UAC56I2OHA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059376785 (3h0m57.646433016s) [noise=true , address=104.36.82.59:4311 , piece_id=TVNTDOMNUCJF4A3YFSXQIXJEAPLFN56HGPJ5DG4I43QVPLW4CZ6Q, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.059723321 (3h0m57.646779552s) [noise=true , address=104.36.82.18:4398 , piece_id=GLBCIUKUYNUMCPG2KTKKXS4G26PCPM22QNYJZBQ7LL5DSRZBFYKQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060115413 (3h0m57.647171645s) [noise=true , address=104.36.82.44:4884 , piece_id=3HG77VZOMC7C2BFE2OOR4N7ZUI2R7V3MPTIBYY5BCDPOF2ZVWB3A, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060458384 (3h0m57.647514625s) [noise=true , address=79.127.201.215:4344 , piece_id=3X6ZPSPEPZYDICKWAHHMAIR4MTWPUVTZWMVDIPEKDDCNNB44SMWA, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.060821732 (3h0m57.647877973s) [noise=true , address=104.36.82.3:4785 , piece_id=ICT5THFHEBQQDELTJI44YTXKKOADC36QTG6PIZTQUK4YH5W6AZRQ, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.061179059 (3h0m57.64823529s) [noise=true , address=45.91.116.5:4309 , piece_id=2ZAQDU5E26KNU7Q3XQ5HDEECKY6MH7NEBHFNHUXNZQI73FGTVL3Q, seg_pos={0 0}, upload=3111]: Uploading piece... Aug 7 19:27:44.193291120 (3h0m57.780347371s) [upload=3111]: Next returned nil segment Aug 7 19:27:44.193306900 (3h0m57.780363151s) [upload=3111]: Waiting for error group managing segments... Aug 7 19:27:44.209607597 (3h0m57.796663838s) [noise=true , address=104.36.82.43:4848 , piece_id=BBRVVYNYLMEDVZPFP2F4N5U2MTZDF4JPX2QMPLUYQ4CDKFFWKKPQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.211275410 (3h0m57.798331651s) [noise=true , address=104.36.82.47:4532 , piece_id=4GBF3A2LT3TKURVNSPXY7KJNSIOAGLB2P3BCOUJJJBEDKDUFKOMA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.217863949 (3h0m57.8049202s) [noise=true , address=104.36.82.60:4349 , piece_id=DW2C5CYLEL4BA6U3CDWN6VW6UJ5N5JE3TUD7MRTUQH5KFMMRD7AQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.219360643 (3h0m57.806416894s) [noise=true , address=104.36.82.59:4311 , piece_id=TVNTDOMNUCJF4A3YFSXQIXJEAPLFN56HGPJ5DG4I43QVPLW4CZ6Q, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.220779782 (3h0m57.807836022s) [noise=true , address=104.36.82.55:4201 , piece_id=UCT3UZQGQJCXOBGPJVSFUI26CQYRS5YW3MEWLDZO32UAC56I2OHA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.221735776 (3h0m57.808792018s) [noise=true , address=104.36.82.62:4412 , piece_id=VTW7D5FWI57JQSXSXYVFSGP3DF6LAYY763QILC2L6FD7XOY2PWMA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.224644716 (3h0m57.811700957s) [noise=true , address=45.91.116.10:4106 , piece_id=M434Q2FT2O6VAOMNW5OH5DO5GFQTJ2P4QZFIYWN6HHS3LDM5DZQA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.229617950 (3h0m57.816674191s) [noise=true , address=104.36.82.14:4239 , piece_id=FWDFC254IVBP53YZXMJC74VU23YEONN45ZGO7TJGZ2VAIB5ZTV6A, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.230697154 (3h0m57.817753395s) [noise=true , address=104.36.82.18:4398 , piece_id=GLBCIUKUYNUMCPG2KTKKXS4G26PCPM22QNYJZBQ7LL5DSRZBFYKQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.234957226 (3h0m57.822013468s) [noise=true , address=104.36.82.12:4159 , piece_id=YA7AS3EQIYKWEA2NMDAZUJYPIE7G2NGS3HSDVFV2TH7EBHZFCFHQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.237122999 (3h0m57.82417924s) [noise=true , address=45.91.116.5:4309 , piece_id=2ZAQDU5E26KNU7Q3XQ5HDEECKY6MH7NEBHFNHUXNZQI73FGTVL3Q, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.243298527 (3h0m57.830354768s) [noise=true , address=104.36.82.3:4785 , piece_id=ICT5THFHEBQQDELTJI44YTXKKOADC36QTG6PIZTQUK4YH5W6AZRQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.305437629 (3h0m57.892493871s) [noise=true , address=79.127.201.215:4344 , piece_id=3X6ZPSPEPZYDICKWAHHMAIR4MTWPUVTZWMVDIPEKDDCNNB44SMWA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.314176622 (3h0m57.901232863s) [noise=true , address=104.36.82.36:4652 , piece_id=OYDPP7KRAWZI5K3WGROJ7Z2RCW7RXGDQENOGSQJJHNYKNTRVICQQ, seg_pos={0 0}, upload=3111]: Done uploading piece. err: <nil> Aug 7 19:27:44.314225393 (3h0m57.901281635s) [seg_pos={0 0}, upload=3111]: Segment reached optimal threshold of 14 pieces. Aug 7 19:27:44.314403605 (3h0m57.901459847s) [noise=true , address=104.36.82.44:4884 , piece_id=3HG77VZOMC7C2BFE2OOR4N7ZUI2R7V3MPTIBYY5BCDPOF2ZVWB3A, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG): protocol: expected piece hash; context canceled; EOF Aug 7 19:27:44.314450183 (3h0m57.901506424s) [noise=true , address=104.36.82.16:4303 , piece_id=LIGUJZKXUSDOAY6EBKFCDBSJQ4W2ZTYLS5ZRTMVZ4SB3IPOIRCAA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ec4Xvp3nGRAm9BivLLTp6AVkMoz1i2AgXQdfQaAmNPLHWD4Yv): protocol: expected piece hash; context canceled; EOF Aug 7 19:27:44.314752737 (3h0m57.901808979s) [noise=true , address=104.36.82.23:4462 , piece_id=4BTWSC6DSBHTSYQELVQWKAIJALQ7TLSZJA4VIDG4FXCKXJM6KPIA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YirC8WVSoE1qrWGMmayNmCsDLxjUhggrgXL5unKtQjsfUkbMu): protocol: read tcp 5.161.89.252:19630->104.36.82.23:4462: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.314762766 (3h0m57.901819017s) [noise=true , address=104.36.82.8:4992 , piece_id=2R4DIYO5UQXJ56GRK6JA5J6BXWRASRUHF544M6MHDBC6NXAISTJA, seg_pos={0 0}, upload=3111]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hbt8HKTunpPKyAzH4XBwGQqTKzcgqPpoWwKZm9JMtaK8P7aVp): protocol: write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection; write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24166->104.36.82.8:4992: use of closed network connection Aug 7 19:27:44.314798644 (3h0m57.901854884s) [seg_pos={0 0}, upload=3111]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:27:44.314911785 (3h0m57.901968026s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 19:27:44.314941310 (3h0m57.901997561s) [upload=3111]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 19:27:44.620205884 (3h0m58.207262095s) [upload=3111]: Done uploading segments... Aug 7 19:27:44.620221594 (3h0m58.207277804s) [upload=3111]: Upload finished. err: <nil>
Duration: 817.768788ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
797.189703ms
FAIL (2025-08-07 19:26:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== e , address=45.91.116.8:4074 , piece_id=U3IR34YDPBGPHSREJ6HPBP25U2AHBTR7QG2EQCVXLB2BEQDJ2IUQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.834929499 (2h54m26.42198574s) [noise=true , address=104.36.82.19:4410 , piece_id=PGCOTNPHPFNLKWADOOIPWJBVC4HV6Z2UO3ZGGDUNYM44CVXMNS5Q, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.835544266 (2h54m26.422600517s) [noise=true , address=104.36.82.43:4838 , piece_id=CIQYIOOPNBC5JTAQE4YS2PRJ2W73LY2YIAOQLZ2O4HRH6K4AV4VA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.835568541 (2h54m26.422624783s) [noise=true , address=104.36.82.15:4265 , piece_id=YC7IG46ROBWABU2OPNOOUXWT2656FI54ZQUZZFKTSZQQVQ3CI7HQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836002882 (2h54m26.423059123s) [noise=true , address=79.127.220.97:4363 , piece_id=IP2TZHQSJP7ZIFDSCI2XIGXFRQVM4LBT4WI26U6Y7NIWQLIADLFA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836020936 (2h54m26.423077177s) [noise=true , address=104.36.82.52:4093 , piece_id=RPTP7YNMQMENA6LQP4BHOEGSGMZXQNTCYHN3W3ARVDFIUQ7PF32Q, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836374136 (2h54m26.423430386s) [noise=true , address=79.127.220.98:4403 , piece_id=DIDPTCNW2X42QHLKZMYKQCCITBNE5K47NQIJ7WOBLRKAUGAOCZBQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836425150 (2h54m26.423481391s) [noise=true , address=45.91.116.5:4310 , piece_id=P7BV2NU2X4FBTDAS2VO4AFOBZUJRBMD5CTX25Y4AJAJFICZJIMLA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836747071 (2h54m26.423803312s) [noise=true , address=104.36.82.35:4594 , piece_id=RM4XVX3ORSDTVWGOZZN6LD7KJCDJVFYJUDUKP2L2UVSD4LALWIOQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836806001 (2h54m26.423862243s) [noise=true , address=104.36.82.45:4932 , piece_id=VM6KJQULAZI5ZMRILBEJFCTGMDESH4ERD3AGXE2GPGWOQXYQAYGQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837101683 (2h54m26.424157924s) [noise=true , address=45.91.116.13:4174 , piece_id=K23L54PQGXCD5CKLLGKDPKAF3YFJ6T2YIRTMC4GQYTJOQNWBYAZQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837189627 (2h54m26.424245878s) [noise=true , address=104.36.82.60:4344 , piece_id=PR7ILHVZ3GWDUBUTUKPB2QJ66X3KVLAIMW6DX3YISWKZQANIT34Q, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837459391 (2h54m26.424515632s) [noise=true , address=104.36.82.21:4486 , piece_id=JCG5AW7HVNO7SOEZPPCTVT7PD5VRRUBCFLQBCCFWIAZKFCX4FENA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837625821 (2h54m26.424682072s) [noise=true , address=104.36.82.46:4491 , piece_id=EJEBI7BULQUSMCBCEPYDAUPNUNDFUOLEBSMYKARPB6PSJO7LOOXA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837840142 (2h54m26.424896383s) [noise=true , address=64.49.13.139:4470 , piece_id=XSK3HH2LTPVVL7IMXRNL5NLIDANPYOJSAKIHWULQV7FJSVRXHP7Q, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.838021710 (2h54m26.425077952s) [noise=true , address=104.36.82.9:4030 , piece_id=W76RQ7UX4QB7IETXOVT4EM25DH7O4LNGAVGLSNQEVZX3XOTMYDOQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.838188782 (2h54m26.425245023s) [noise=true , address=64.49.13.27:4960 , piece_id=2D3W2VLXIEY26BZ6AZDR3SULF7S77LRKYIIGWIXDGOZZIEILVAMQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.838798421 (2h54m26.425854661s) [noise=true , address=104.36.82.39:4733 , piece_id=FKTPESZ7QABDL5ELY6KW3CEPS6474GPX7VFWGQPHN2LGDSUR6WVA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.971456729 (2h54m26.55851296s) [upload=2998]: Next returned nil segment Aug 7 19:21:12.971471597 (2h54m26.558527837s) [upload=2998]: Waiting for error group managing segments... Aug 7 19:21:12.984593159 (2h54m26.5716494s) [noise=true , address=45.91.116.8:4074 , piece_id=U3IR34YDPBGPHSREJ6HPBP25U2AHBTR7QG2EQCVXLB2BEQDJ2IUQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.985962215 (2h54m26.573018456s) [noise=true , address=104.36.82.60:4344 , piece_id=PR7ILHVZ3GWDUBUTUKPB2QJ66X3KVLAIMW6DX3YISWKZQANIT34Q, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.990378008 (2h54m26.577434249s) [noise=true , address=104.36.82.9:4030 , piece_id=W76RQ7UX4QB7IETXOVT4EM25DH7O4LNGAVGLSNQEVZX3XOTMYDOQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.995793868 (2h54m26.5828501s) [noise=true , address=104.36.82.39:4733 , piece_id=FKTPESZ7QABDL5ELY6KW3CEPS6474GPX7VFWGQPHN2LGDSUR6WVA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.996448801 (2h54m26.583505042s) [noise=true , address=45.91.116.5:4310 , piece_id=P7BV2NU2X4FBTDAS2VO4AFOBZUJRBMD5CTX25Y4AJAJFICZJIMLA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.997165077 (2h54m26.584221308s) [noise=true , address=45.91.116.13:4174 , piece_id=K23L54PQGXCD5CKLLGKDPKAF3YFJ6T2YIRTMC4GQYTJOQNWBYAZQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.997808920 (2h54m26.584865171s) [noise=true , address=104.36.82.35:4594 , piece_id=RM4XVX3ORSDTVWGOZZN6LD7KJCDJVFYJUDUKP2L2UVSD4LALWIOQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.999547955 (2h54m26.586604206s) [noise=true , address=104.36.82.46:4491 , piece_id=EJEBI7BULQUSMCBCEPYDAUPNUNDFUOLEBSMYKARPB6PSJO7LOOXA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.012312983 (2h54m26.599369194s) [noise=true , address=104.36.82.43:4838 , piece_id=CIQYIOOPNBC5JTAQE4YS2PRJ2W73LY2YIAOQLZ2O4HRH6K4AV4VA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.012903997 (2h54m26.599960238s) [noise=true , address=104.36.82.52:4093 , piece_id=RPTP7YNMQMENA6LQP4BHOEGSGMZXQNTCYHN3W3ARVDFIUQ7PF32Q, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.018321450 (2h54m26.605377671s) [noise=true , address=104.36.82.21:4486 , piece_id=JCG5AW7HVNO7SOEZPPCTVT7PD5VRRUBCFLQBCCFWIAZKFCX4FENA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.020563575 (2h54m26.607619816s) [noise=true , address=79.127.220.97:4363 , piece_id=IP2TZHQSJP7ZIFDSCI2XIGXFRQVM4LBT4WI26U6Y7NIWQLIADLFA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.043146098 (2h54m26.63020232s) [noise=true , address=104.36.82.19:4410 , piece_id=PGCOTNPHPFNLKWADOOIPWJBVC4HV6Z2UO3ZGGDUNYM44CVXMNS5Q, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.046871412 (2h54m26.633927654s) [noise=true , address=104.36.82.45:4932 , piece_id=VM6KJQULAZI5ZMRILBEJFCTGMDESH4ERD3AGXE2GPGWOQXYQAYGQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.046907620 (2h54m26.63396386s) [seg_pos={0 0}, upload=2998]: Segment reached optimal threshold of 14 pieces. Aug 7 19:21:13.047055916 (2h54m26.634112158s) [noise=true , address=79.127.220.98:4403 , piece_id=DIDPTCNW2X42QHLKZMYKQCCITBNE5K47NQIJ7WOBLRKAUGAOCZBQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q9k1NkgoSntisBrcMfPrumr7q432VZ2FgjEuYXBT8mxeFh1R3): protocol: expected piece hash; context canceled; EOF Aug 7 19:21:13.047189606 (2h54m26.634245827s) [noise=true , address=64.49.13.139:4470 , piece_id=XSK3HH2LTPVVL7IMXRNL5NLIDANPYOJSAKIHWULQV7FJSVRXHP7Q, seg_pos={0 0}, upload=2998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G4gW4QhXRDsfHcGvFr7qCpB49u9dYQPDXC4CuBZGwQUuFU7Fx): protocol: read tcp 5.161.89.252:53932->64.49.13.139:4470: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:21:13.047204073 (2h54m26.634260315s) [noise=true , address=104.36.82.15:4265 , piece_id=YC7IG46ROBWABU2OPNOOUXWT2656FI54ZQUZZFKTSZQQVQ3CI7HQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NscbwYiKarBdony9TwdccuEKg7f4VXEXerFfWmCiat4RKdXFi): protocol: expected piece hash; context canceled; EOF Aug 7 19:21:13.047277671 (2h54m26.634333892s) [noise=true , address=64.49.13.27:4960 , piece_id=2D3W2VLXIEY26BZ6AZDR3SULF7S77LRKYIIGWIXDGOZZIEILVAMQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: context canceled; context canceled Aug 7 19:21:13.047292819 (2h54m26.63434903s) [seg_pos={0 0}, upload=2998]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:21:13.047366076 (2h54m26.634422297s) [upload=2998]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 19:21:13.047370263 (2h54m26.634426474s) [upload=2998]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 19:21:13.101472814 (2h54m26.688529055s) [upload=2998]: Done uploading segments... Aug 7 19:21:13.101494615 (2h54m26.688550846s) [upload=2998]: Upload finished. err: <nil> Aug 7 19:21:53.105073588 (2h55m6.692129799s) [upload=3005]: Starting upload Aug 7 19:21:53.105114334 (2h55m6.692170545s) [upload=3005]: Done starting upload Aug 7 19:21:53.105186318 (2h55m6.692242539s) [upload=3005]: Uploading segments... Aug 7 19:21:53.105306674 (2h55m6.692362874s) [upload=3005]: Got next segment. Inline: false Aug 7 19:21:53.105336108 (2h55m6.692392319s) [upload=3005]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 19:21:53.105339203 (2h55m6.692395414s) [upload=3005]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 19:21:53.109033360 (2h55m6.696089581s) [upload=3005]: Next segment err: metaclient: Too Many Requests Aug 7 19:21:53.109049810 (2h55m6.696106022s) [upload=3005]: Done uploading segments... Aug 7 19:21:53.109064507 (2h55m6.696120728s) [upload=3005]: Upload finished. err: metaclient: Too Many Requests
Duration: 797.210622ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
488.709586ms
FAIL (2025-08-07 19:25:58 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== e , address=45.91.116.8:4074 , piece_id=U3IR34YDPBGPHSREJ6HPBP25U2AHBTR7QG2EQCVXLB2BEQDJ2IUQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.834929499 (2h54m26.42198574s) [noise=true , address=104.36.82.19:4410 , piece_id=PGCOTNPHPFNLKWADOOIPWJBVC4HV6Z2UO3ZGGDUNYM44CVXMNS5Q, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.835544266 (2h54m26.422600517s) [noise=true , address=104.36.82.43:4838 , piece_id=CIQYIOOPNBC5JTAQE4YS2PRJ2W73LY2YIAOQLZ2O4HRH6K4AV4VA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.835568541 (2h54m26.422624783s) [noise=true , address=104.36.82.15:4265 , piece_id=YC7IG46ROBWABU2OPNOOUXWT2656FI54ZQUZZFKTSZQQVQ3CI7HQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836002882 (2h54m26.423059123s) [noise=true , address=79.127.220.97:4363 , piece_id=IP2TZHQSJP7ZIFDSCI2XIGXFRQVM4LBT4WI26U6Y7NIWQLIADLFA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836020936 (2h54m26.423077177s) [noise=true , address=104.36.82.52:4093 , piece_id=RPTP7YNMQMENA6LQP4BHOEGSGMZXQNTCYHN3W3ARVDFIUQ7PF32Q, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836374136 (2h54m26.423430386s) [noise=true , address=79.127.220.98:4403 , piece_id=DIDPTCNW2X42QHLKZMYKQCCITBNE5K47NQIJ7WOBLRKAUGAOCZBQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836425150 (2h54m26.423481391s) [noise=true , address=45.91.116.5:4310 , piece_id=P7BV2NU2X4FBTDAS2VO4AFOBZUJRBMD5CTX25Y4AJAJFICZJIMLA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836747071 (2h54m26.423803312s) [noise=true , address=104.36.82.35:4594 , piece_id=RM4XVX3ORSDTVWGOZZN6LD7KJCDJVFYJUDUKP2L2UVSD4LALWIOQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836806001 (2h54m26.423862243s) [noise=true , address=104.36.82.45:4932 , piece_id=VM6KJQULAZI5ZMRILBEJFCTGMDESH4ERD3AGXE2GPGWOQXYQAYGQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837101683 (2h54m26.424157924s) [noise=true , address=45.91.116.13:4174 , piece_id=K23L54PQGXCD5CKLLGKDPKAF3YFJ6T2YIRTMC4GQYTJOQNWBYAZQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837189627 (2h54m26.424245878s) [noise=true , address=104.36.82.60:4344 , piece_id=PR7ILHVZ3GWDUBUTUKPB2QJ66X3KVLAIMW6DX3YISWKZQANIT34Q, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837459391 (2h54m26.424515632s) [noise=true , address=104.36.82.21:4486 , piece_id=JCG5AW7HVNO7SOEZPPCTVT7PD5VRRUBCFLQBCCFWIAZKFCX4FENA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837625821 (2h54m26.424682072s) [noise=true , address=104.36.82.46:4491 , piece_id=EJEBI7BULQUSMCBCEPYDAUPNUNDFUOLEBSMYKARPB6PSJO7LOOXA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837840142 (2h54m26.424896383s) [noise=true , address=64.49.13.139:4470 , piece_id=XSK3HH2LTPVVL7IMXRNL5NLIDANPYOJSAKIHWULQV7FJSVRXHP7Q, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.838021710 (2h54m26.425077952s) [noise=true , address=104.36.82.9:4030 , piece_id=W76RQ7UX4QB7IETXOVT4EM25DH7O4LNGAVGLSNQEVZX3XOTMYDOQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.838188782 (2h54m26.425245023s) [noise=true , address=64.49.13.27:4960 , piece_id=2D3W2VLXIEY26BZ6AZDR3SULF7S77LRKYIIGWIXDGOZZIEILVAMQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.838798421 (2h54m26.425854661s) [noise=true , address=104.36.82.39:4733 , piece_id=FKTPESZ7QABDL5ELY6KW3CEPS6474GPX7VFWGQPHN2LGDSUR6WVA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.971456729 (2h54m26.55851296s) [upload=2998]: Next returned nil segment Aug 7 19:21:12.971471597 (2h54m26.558527837s) [upload=2998]: Waiting for error group managing segments... Aug 7 19:21:12.984593159 (2h54m26.5716494s) [noise=true , address=45.91.116.8:4074 , piece_id=U3IR34YDPBGPHSREJ6HPBP25U2AHBTR7QG2EQCVXLB2BEQDJ2IUQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.985962215 (2h54m26.573018456s) [noise=true , address=104.36.82.60:4344 , piece_id=PR7ILHVZ3GWDUBUTUKPB2QJ66X3KVLAIMW6DX3YISWKZQANIT34Q, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.990378008 (2h54m26.577434249s) [noise=true , address=104.36.82.9:4030 , piece_id=W76RQ7UX4QB7IETXOVT4EM25DH7O4LNGAVGLSNQEVZX3XOTMYDOQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.995793868 (2h54m26.5828501s) [noise=true , address=104.36.82.39:4733 , piece_id=FKTPESZ7QABDL5ELY6KW3CEPS6474GPX7VFWGQPHN2LGDSUR6WVA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.996448801 (2h54m26.583505042s) [noise=true , address=45.91.116.5:4310 , piece_id=P7BV2NU2X4FBTDAS2VO4AFOBZUJRBMD5CTX25Y4AJAJFICZJIMLA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.997165077 (2h54m26.584221308s) [noise=true , address=45.91.116.13:4174 , piece_id=K23L54PQGXCD5CKLLGKDPKAF3YFJ6T2YIRTMC4GQYTJOQNWBYAZQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.997808920 (2h54m26.584865171s) [noise=true , address=104.36.82.35:4594 , piece_id=RM4XVX3ORSDTVWGOZZN6LD7KJCDJVFYJUDUKP2L2UVSD4LALWIOQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.999547955 (2h54m26.586604206s) [noise=true , address=104.36.82.46:4491 , piece_id=EJEBI7BULQUSMCBCEPYDAUPNUNDFUOLEBSMYKARPB6PSJO7LOOXA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.012312983 (2h54m26.599369194s) [noise=true , address=104.36.82.43:4838 , piece_id=CIQYIOOPNBC5JTAQE4YS2PRJ2W73LY2YIAOQLZ2O4HRH6K4AV4VA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.012903997 (2h54m26.599960238s) [noise=true , address=104.36.82.52:4093 , piece_id=RPTP7YNMQMENA6LQP4BHOEGSGMZXQNTCYHN3W3ARVDFIUQ7PF32Q, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.018321450 (2h54m26.605377671s) [noise=true , address=104.36.82.21:4486 , piece_id=JCG5AW7HVNO7SOEZPPCTVT7PD5VRRUBCFLQBCCFWIAZKFCX4FENA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.020563575 (2h54m26.607619816s) [noise=true , address=79.127.220.97:4363 , piece_id=IP2TZHQSJP7ZIFDSCI2XIGXFRQVM4LBT4WI26U6Y7NIWQLIADLFA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.043146098 (2h54m26.63020232s) [noise=true , address=104.36.82.19:4410 , piece_id=PGCOTNPHPFNLKWADOOIPWJBVC4HV6Z2UO3ZGGDUNYM44CVXMNS5Q, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.046871412 (2h54m26.633927654s) [noise=true , address=104.36.82.45:4932 , piece_id=VM6KJQULAZI5ZMRILBEJFCTGMDESH4ERD3AGXE2GPGWOQXYQAYGQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.046907620 (2h54m26.63396386s) [seg_pos={0 0}, upload=2998]: Segment reached optimal threshold of 14 pieces. Aug 7 19:21:13.047055916 (2h54m26.634112158s) [noise=true , address=79.127.220.98:4403 , piece_id=DIDPTCNW2X42QHLKZMYKQCCITBNE5K47NQIJ7WOBLRKAUGAOCZBQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q9k1NkgoSntisBrcMfPrumr7q432VZ2FgjEuYXBT8mxeFh1R3): protocol: expected piece hash; context canceled; EOF Aug 7 19:21:13.047189606 (2h54m26.634245827s) [noise=true , address=64.49.13.139:4470 , piece_id=XSK3HH2LTPVVL7IMXRNL5NLIDANPYOJSAKIHWULQV7FJSVRXHP7Q, seg_pos={0 0}, upload=2998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G4gW4QhXRDsfHcGvFr7qCpB49u9dYQPDXC4CuBZGwQUuFU7Fx): protocol: read tcp 5.161.89.252:53932->64.49.13.139:4470: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:21:13.047204073 (2h54m26.634260315s) [noise=true , address=104.36.82.15:4265 , piece_id=YC7IG46ROBWABU2OPNOOUXWT2656FI54ZQUZZFKTSZQQVQ3CI7HQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NscbwYiKarBdony9TwdccuEKg7f4VXEXerFfWmCiat4RKdXFi): protocol: expected piece hash; context canceled; EOF Aug 7 19:21:13.047277671 (2h54m26.634333892s) [noise=true , address=64.49.13.27:4960 , piece_id=2D3W2VLXIEY26BZ6AZDR3SULF7S77LRKYIIGWIXDGOZZIEILVAMQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: context canceled; context canceled Aug 7 19:21:13.047292819 (2h54m26.63434903s) [seg_pos={0 0}, upload=2998]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:21:13.047366076 (2h54m26.634422297s) [upload=2998]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 19:21:13.047370263 (2h54m26.634426474s) [upload=2998]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 19:21:13.101472814 (2h54m26.688529055s) [upload=2998]: Done uploading segments... Aug 7 19:21:13.101494615 (2h54m26.688550846s) [upload=2998]: Upload finished. err: <nil> Aug 7 19:21:53.105073588 (2h55m6.692129799s) [upload=3005]: Starting upload Aug 7 19:21:53.105114334 (2h55m6.692170545s) [upload=3005]: Done starting upload Aug 7 19:21:53.105186318 (2h55m6.692242539s) [upload=3005]: Uploading segments... Aug 7 19:21:53.105306674 (2h55m6.692362874s) [upload=3005]: Got next segment. Inline: false Aug 7 19:21:53.105336108 (2h55m6.692392319s) [upload=3005]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 19:21:53.105339203 (2h55m6.692395414s) [upload=3005]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 19:21:53.109033360 (2h55m6.696089581s) [upload=3005]: Next segment err: metaclient: Too Many Requests Aug 7 19:21:53.109049810 (2h55m6.696106022s) [upload=3005]: Done uploading segments... Aug 7 19:21:53.109064507 (2h55m6.696120728s) [upload=3005]: Upload finished. err: metaclient: Too Many Requests
Duration: 488.733912ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
393.311672ms
FAIL (2025-08-07 19:25:17 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== e , address=45.91.116.8:4074 , piece_id=U3IR34YDPBGPHSREJ6HPBP25U2AHBTR7QG2EQCVXLB2BEQDJ2IUQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.834929499 (2h54m26.42198574s) [noise=true , address=104.36.82.19:4410 , piece_id=PGCOTNPHPFNLKWADOOIPWJBVC4HV6Z2UO3ZGGDUNYM44CVXMNS5Q, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.835544266 (2h54m26.422600517s) [noise=true , address=104.36.82.43:4838 , piece_id=CIQYIOOPNBC5JTAQE4YS2PRJ2W73LY2YIAOQLZ2O4HRH6K4AV4VA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.835568541 (2h54m26.422624783s) [noise=true , address=104.36.82.15:4265 , piece_id=YC7IG46ROBWABU2OPNOOUXWT2656FI54ZQUZZFKTSZQQVQ3CI7HQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836002882 (2h54m26.423059123s) [noise=true , address=79.127.220.97:4363 , piece_id=IP2TZHQSJP7ZIFDSCI2XIGXFRQVM4LBT4WI26U6Y7NIWQLIADLFA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836020936 (2h54m26.423077177s) [noise=true , address=104.36.82.52:4093 , piece_id=RPTP7YNMQMENA6LQP4BHOEGSGMZXQNTCYHN3W3ARVDFIUQ7PF32Q, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836374136 (2h54m26.423430386s) [noise=true , address=79.127.220.98:4403 , piece_id=DIDPTCNW2X42QHLKZMYKQCCITBNE5K47NQIJ7WOBLRKAUGAOCZBQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836425150 (2h54m26.423481391s) [noise=true , address=45.91.116.5:4310 , piece_id=P7BV2NU2X4FBTDAS2VO4AFOBZUJRBMD5CTX25Y4AJAJFICZJIMLA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836747071 (2h54m26.423803312s) [noise=true , address=104.36.82.35:4594 , piece_id=RM4XVX3ORSDTVWGOZZN6LD7KJCDJVFYJUDUKP2L2UVSD4LALWIOQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836806001 (2h54m26.423862243s) [noise=true , address=104.36.82.45:4932 , piece_id=VM6KJQULAZI5ZMRILBEJFCTGMDESH4ERD3AGXE2GPGWOQXYQAYGQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837101683 (2h54m26.424157924s) [noise=true , address=45.91.116.13:4174 , piece_id=K23L54PQGXCD5CKLLGKDPKAF3YFJ6T2YIRTMC4GQYTJOQNWBYAZQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837189627 (2h54m26.424245878s) [noise=true , address=104.36.82.60:4344 , piece_id=PR7ILHVZ3GWDUBUTUKPB2QJ66X3KVLAIMW6DX3YISWKZQANIT34Q, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837459391 (2h54m26.424515632s) [noise=true , address=104.36.82.21:4486 , piece_id=JCG5AW7HVNO7SOEZPPCTVT7PD5VRRUBCFLQBCCFWIAZKFCX4FENA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837625821 (2h54m26.424682072s) [noise=true , address=104.36.82.46:4491 , piece_id=EJEBI7BULQUSMCBCEPYDAUPNUNDFUOLEBSMYKARPB6PSJO7LOOXA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837840142 (2h54m26.424896383s) [noise=true , address=64.49.13.139:4470 , piece_id=XSK3HH2LTPVVL7IMXRNL5NLIDANPYOJSAKIHWULQV7FJSVRXHP7Q, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.838021710 (2h54m26.425077952s) [noise=true , address=104.36.82.9:4030 , piece_id=W76RQ7UX4QB7IETXOVT4EM25DH7O4LNGAVGLSNQEVZX3XOTMYDOQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.838188782 (2h54m26.425245023s) [noise=true , address=64.49.13.27:4960 , piece_id=2D3W2VLXIEY26BZ6AZDR3SULF7S77LRKYIIGWIXDGOZZIEILVAMQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.838798421 (2h54m26.425854661s) [noise=true , address=104.36.82.39:4733 , piece_id=FKTPESZ7QABDL5ELY6KW3CEPS6474GPX7VFWGQPHN2LGDSUR6WVA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.971456729 (2h54m26.55851296s) [upload=2998]: Next returned nil segment Aug 7 19:21:12.971471597 (2h54m26.558527837s) [upload=2998]: Waiting for error group managing segments... Aug 7 19:21:12.984593159 (2h54m26.5716494s) [noise=true , address=45.91.116.8:4074 , piece_id=U3IR34YDPBGPHSREJ6HPBP25U2AHBTR7QG2EQCVXLB2BEQDJ2IUQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.985962215 (2h54m26.573018456s) [noise=true , address=104.36.82.60:4344 , piece_id=PR7ILHVZ3GWDUBUTUKPB2QJ66X3KVLAIMW6DX3YISWKZQANIT34Q, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.990378008 (2h54m26.577434249s) [noise=true , address=104.36.82.9:4030 , piece_id=W76RQ7UX4QB7IETXOVT4EM25DH7O4LNGAVGLSNQEVZX3XOTMYDOQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.995793868 (2h54m26.5828501s) [noise=true , address=104.36.82.39:4733 , piece_id=FKTPESZ7QABDL5ELY6KW3CEPS6474GPX7VFWGQPHN2LGDSUR6WVA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.996448801 (2h54m26.583505042s) [noise=true , address=45.91.116.5:4310 , piece_id=P7BV2NU2X4FBTDAS2VO4AFOBZUJRBMD5CTX25Y4AJAJFICZJIMLA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.997165077 (2h54m26.584221308s) [noise=true , address=45.91.116.13:4174 , piece_id=K23L54PQGXCD5CKLLGKDPKAF3YFJ6T2YIRTMC4GQYTJOQNWBYAZQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.997808920 (2h54m26.584865171s) [noise=true , address=104.36.82.35:4594 , piece_id=RM4XVX3ORSDTVWGOZZN6LD7KJCDJVFYJUDUKP2L2UVSD4LALWIOQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.999547955 (2h54m26.586604206s) [noise=true , address=104.36.82.46:4491 , piece_id=EJEBI7BULQUSMCBCEPYDAUPNUNDFUOLEBSMYKARPB6PSJO7LOOXA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.012312983 (2h54m26.599369194s) [noise=true , address=104.36.82.43:4838 , piece_id=CIQYIOOPNBC5JTAQE4YS2PRJ2W73LY2YIAOQLZ2O4HRH6K4AV4VA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.012903997 (2h54m26.599960238s) [noise=true , address=104.36.82.52:4093 , piece_id=RPTP7YNMQMENA6LQP4BHOEGSGMZXQNTCYHN3W3ARVDFIUQ7PF32Q, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.018321450 (2h54m26.605377671s) [noise=true , address=104.36.82.21:4486 , piece_id=JCG5AW7HVNO7SOEZPPCTVT7PD5VRRUBCFLQBCCFWIAZKFCX4FENA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.020563575 (2h54m26.607619816s) [noise=true , address=79.127.220.97:4363 , piece_id=IP2TZHQSJP7ZIFDSCI2XIGXFRQVM4LBT4WI26U6Y7NIWQLIADLFA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.043146098 (2h54m26.63020232s) [noise=true , address=104.36.82.19:4410 , piece_id=PGCOTNPHPFNLKWADOOIPWJBVC4HV6Z2UO3ZGGDUNYM44CVXMNS5Q, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.046871412 (2h54m26.633927654s) [noise=true , address=104.36.82.45:4932 , piece_id=VM6KJQULAZI5ZMRILBEJFCTGMDESH4ERD3AGXE2GPGWOQXYQAYGQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.046907620 (2h54m26.63396386s) [seg_pos={0 0}, upload=2998]: Segment reached optimal threshold of 14 pieces. Aug 7 19:21:13.047055916 (2h54m26.634112158s) [noise=true , address=79.127.220.98:4403 , piece_id=DIDPTCNW2X42QHLKZMYKQCCITBNE5K47NQIJ7WOBLRKAUGAOCZBQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q9k1NkgoSntisBrcMfPrumr7q432VZ2FgjEuYXBT8mxeFh1R3): protocol: expected piece hash; context canceled; EOF Aug 7 19:21:13.047189606 (2h54m26.634245827s) [noise=true , address=64.49.13.139:4470 , piece_id=XSK3HH2LTPVVL7IMXRNL5NLIDANPYOJSAKIHWULQV7FJSVRXHP7Q, seg_pos={0 0}, upload=2998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G4gW4QhXRDsfHcGvFr7qCpB49u9dYQPDXC4CuBZGwQUuFU7Fx): protocol: read tcp 5.161.89.252:53932->64.49.13.139:4470: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:21:13.047204073 (2h54m26.634260315s) [noise=true , address=104.36.82.15:4265 , piece_id=YC7IG46ROBWABU2OPNOOUXWT2656FI54ZQUZZFKTSZQQVQ3CI7HQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NscbwYiKarBdony9TwdccuEKg7f4VXEXerFfWmCiat4RKdXFi): protocol: expected piece hash; context canceled; EOF Aug 7 19:21:13.047277671 (2h54m26.634333892s) [noise=true , address=64.49.13.27:4960 , piece_id=2D3W2VLXIEY26BZ6AZDR3SULF7S77LRKYIIGWIXDGOZZIEILVAMQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: context canceled; context canceled Aug 7 19:21:13.047292819 (2h54m26.63434903s) [seg_pos={0 0}, upload=2998]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:21:13.047366076 (2h54m26.634422297s) [upload=2998]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 19:21:13.047370263 (2h54m26.634426474s) [upload=2998]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 19:21:13.101472814 (2h54m26.688529055s) [upload=2998]: Done uploading segments... Aug 7 19:21:13.101494615 (2h54m26.688550846s) [upload=2998]: Upload finished. err: <nil> Aug 7 19:21:53.105073588 (2h55m6.692129799s) [upload=3005]: Starting upload Aug 7 19:21:53.105114334 (2h55m6.692170545s) [upload=3005]: Done starting upload Aug 7 19:21:53.105186318 (2h55m6.692242539s) [upload=3005]: Uploading segments... Aug 7 19:21:53.105306674 (2h55m6.692362874s) [upload=3005]: Got next segment. Inline: false Aug 7 19:21:53.105336108 (2h55m6.692392319s) [upload=3005]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 19:21:53.105339203 (2h55m6.692395414s) [upload=3005]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 19:21:53.109033360 (2h55m6.696089581s) [upload=3005]: Next segment err: metaclient: Too Many Requests Aug 7 19:21:53.109049810 (2h55m6.696106022s) [upload=3005]: Done uploading segments... Aug 7 19:21:53.109064507 (2h55m6.696120728s) [upload=3005]: Upload finished. err: metaclient: Too Many Requests
Duration: 393.33236ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
441.250727ms
FAIL (2025-08-07 19:24:45 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== e , address=45.91.116.8:4074 , piece_id=U3IR34YDPBGPHSREJ6HPBP25U2AHBTR7QG2EQCVXLB2BEQDJ2IUQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.834929499 (2h54m26.42198574s) [noise=true , address=104.36.82.19:4410 , piece_id=PGCOTNPHPFNLKWADOOIPWJBVC4HV6Z2UO3ZGGDUNYM44CVXMNS5Q, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.835544266 (2h54m26.422600517s) [noise=true , address=104.36.82.43:4838 , piece_id=CIQYIOOPNBC5JTAQE4YS2PRJ2W73LY2YIAOQLZ2O4HRH6K4AV4VA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.835568541 (2h54m26.422624783s) [noise=true , address=104.36.82.15:4265 , piece_id=YC7IG46ROBWABU2OPNOOUXWT2656FI54ZQUZZFKTSZQQVQ3CI7HQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836002882 (2h54m26.423059123s) [noise=true , address=79.127.220.97:4363 , piece_id=IP2TZHQSJP7ZIFDSCI2XIGXFRQVM4LBT4WI26U6Y7NIWQLIADLFA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836020936 (2h54m26.423077177s) [noise=true , address=104.36.82.52:4093 , piece_id=RPTP7YNMQMENA6LQP4BHOEGSGMZXQNTCYHN3W3ARVDFIUQ7PF32Q, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836374136 (2h54m26.423430386s) [noise=true , address=79.127.220.98:4403 , piece_id=DIDPTCNW2X42QHLKZMYKQCCITBNE5K47NQIJ7WOBLRKAUGAOCZBQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836425150 (2h54m26.423481391s) [noise=true , address=45.91.116.5:4310 , piece_id=P7BV2NU2X4FBTDAS2VO4AFOBZUJRBMD5CTX25Y4AJAJFICZJIMLA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836747071 (2h54m26.423803312s) [noise=true , address=104.36.82.35:4594 , piece_id=RM4XVX3ORSDTVWGOZZN6LD7KJCDJVFYJUDUKP2L2UVSD4LALWIOQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836806001 (2h54m26.423862243s) [noise=true , address=104.36.82.45:4932 , piece_id=VM6KJQULAZI5ZMRILBEJFCTGMDESH4ERD3AGXE2GPGWOQXYQAYGQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837101683 (2h54m26.424157924s) [noise=true , address=45.91.116.13:4174 , piece_id=K23L54PQGXCD5CKLLGKDPKAF3YFJ6T2YIRTMC4GQYTJOQNWBYAZQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837189627 (2h54m26.424245878s) [noise=true , address=104.36.82.60:4344 , piece_id=PR7ILHVZ3GWDUBUTUKPB2QJ66X3KVLAIMW6DX3YISWKZQANIT34Q, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837459391 (2h54m26.424515632s) [noise=true , address=104.36.82.21:4486 , piece_id=JCG5AW7HVNO7SOEZPPCTVT7PD5VRRUBCFLQBCCFWIAZKFCX4FENA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837625821 (2h54m26.424682072s) [noise=true , address=104.36.82.46:4491 , piece_id=EJEBI7BULQUSMCBCEPYDAUPNUNDFUOLEBSMYKARPB6PSJO7LOOXA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837840142 (2h54m26.424896383s) [noise=true , address=64.49.13.139:4470 , piece_id=XSK3HH2LTPVVL7IMXRNL5NLIDANPYOJSAKIHWULQV7FJSVRXHP7Q, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.838021710 (2h54m26.425077952s) [noise=true , address=104.36.82.9:4030 , piece_id=W76RQ7UX4QB7IETXOVT4EM25DH7O4LNGAVGLSNQEVZX3XOTMYDOQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.838188782 (2h54m26.425245023s) [noise=true , address=64.49.13.27:4960 , piece_id=2D3W2VLXIEY26BZ6AZDR3SULF7S77LRKYIIGWIXDGOZZIEILVAMQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.838798421 (2h54m26.425854661s) [noise=true , address=104.36.82.39:4733 , piece_id=FKTPESZ7QABDL5ELY6KW3CEPS6474GPX7VFWGQPHN2LGDSUR6WVA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.971456729 (2h54m26.55851296s) [upload=2998]: Next returned nil segment Aug 7 19:21:12.971471597 (2h54m26.558527837s) [upload=2998]: Waiting for error group managing segments... Aug 7 19:21:12.984593159 (2h54m26.5716494s) [noise=true , address=45.91.116.8:4074 , piece_id=U3IR34YDPBGPHSREJ6HPBP25U2AHBTR7QG2EQCVXLB2BEQDJ2IUQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.985962215 (2h54m26.573018456s) [noise=true , address=104.36.82.60:4344 , piece_id=PR7ILHVZ3GWDUBUTUKPB2QJ66X3KVLAIMW6DX3YISWKZQANIT34Q, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.990378008 (2h54m26.577434249s) [noise=true , address=104.36.82.9:4030 , piece_id=W76RQ7UX4QB7IETXOVT4EM25DH7O4LNGAVGLSNQEVZX3XOTMYDOQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.995793868 (2h54m26.5828501s) [noise=true , address=104.36.82.39:4733 , piece_id=FKTPESZ7QABDL5ELY6KW3CEPS6474GPX7VFWGQPHN2LGDSUR6WVA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.996448801 (2h54m26.583505042s) [noise=true , address=45.91.116.5:4310 , piece_id=P7BV2NU2X4FBTDAS2VO4AFOBZUJRBMD5CTX25Y4AJAJFICZJIMLA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.997165077 (2h54m26.584221308s) [noise=true , address=45.91.116.13:4174 , piece_id=K23L54PQGXCD5CKLLGKDPKAF3YFJ6T2YIRTMC4GQYTJOQNWBYAZQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.997808920 (2h54m26.584865171s) [noise=true , address=104.36.82.35:4594 , piece_id=RM4XVX3ORSDTVWGOZZN6LD7KJCDJVFYJUDUKP2L2UVSD4LALWIOQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.999547955 (2h54m26.586604206s) [noise=true , address=104.36.82.46:4491 , piece_id=EJEBI7BULQUSMCBCEPYDAUPNUNDFUOLEBSMYKARPB6PSJO7LOOXA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.012312983 (2h54m26.599369194s) [noise=true , address=104.36.82.43:4838 , piece_id=CIQYIOOPNBC5JTAQE4YS2PRJ2W73LY2YIAOQLZ2O4HRH6K4AV4VA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.012903997 (2h54m26.599960238s) [noise=true , address=104.36.82.52:4093 , piece_id=RPTP7YNMQMENA6LQP4BHOEGSGMZXQNTCYHN3W3ARVDFIUQ7PF32Q, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.018321450 (2h54m26.605377671s) [noise=true , address=104.36.82.21:4486 , piece_id=JCG5AW7HVNO7SOEZPPCTVT7PD5VRRUBCFLQBCCFWIAZKFCX4FENA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.020563575 (2h54m26.607619816s) [noise=true , address=79.127.220.97:4363 , piece_id=IP2TZHQSJP7ZIFDSCI2XIGXFRQVM4LBT4WI26U6Y7NIWQLIADLFA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.043146098 (2h54m26.63020232s) [noise=true , address=104.36.82.19:4410 , piece_id=PGCOTNPHPFNLKWADOOIPWJBVC4HV6Z2UO3ZGGDUNYM44CVXMNS5Q, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.046871412 (2h54m26.633927654s) [noise=true , address=104.36.82.45:4932 , piece_id=VM6KJQULAZI5ZMRILBEJFCTGMDESH4ERD3AGXE2GPGWOQXYQAYGQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.046907620 (2h54m26.63396386s) [seg_pos={0 0}, upload=2998]: Segment reached optimal threshold of 14 pieces. Aug 7 19:21:13.047055916 (2h54m26.634112158s) [noise=true , address=79.127.220.98:4403 , piece_id=DIDPTCNW2X42QHLKZMYKQCCITBNE5K47NQIJ7WOBLRKAUGAOCZBQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q9k1NkgoSntisBrcMfPrumr7q432VZ2FgjEuYXBT8mxeFh1R3): protocol: expected piece hash; context canceled; EOF Aug 7 19:21:13.047189606 (2h54m26.634245827s) [noise=true , address=64.49.13.139:4470 , piece_id=XSK3HH2LTPVVL7IMXRNL5NLIDANPYOJSAKIHWULQV7FJSVRXHP7Q, seg_pos={0 0}, upload=2998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G4gW4QhXRDsfHcGvFr7qCpB49u9dYQPDXC4CuBZGwQUuFU7Fx): protocol: read tcp 5.161.89.252:53932->64.49.13.139:4470: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:21:13.047204073 (2h54m26.634260315s) [noise=true , address=104.36.82.15:4265 , piece_id=YC7IG46ROBWABU2OPNOOUXWT2656FI54ZQUZZFKTSZQQVQ3CI7HQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NscbwYiKarBdony9TwdccuEKg7f4VXEXerFfWmCiat4RKdXFi): protocol: expected piece hash; context canceled; EOF Aug 7 19:21:13.047277671 (2h54m26.634333892s) [noise=true , address=64.49.13.27:4960 , piece_id=2D3W2VLXIEY26BZ6AZDR3SULF7S77LRKYIIGWIXDGOZZIEILVAMQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: context canceled; context canceled Aug 7 19:21:13.047292819 (2h54m26.63434903s) [seg_pos={0 0}, upload=2998]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:21:13.047366076 (2h54m26.634422297s) [upload=2998]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 19:21:13.047370263 (2h54m26.634426474s) [upload=2998]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 19:21:13.101472814 (2h54m26.688529055s) [upload=2998]: Done uploading segments... Aug 7 19:21:13.101494615 (2h54m26.688550846s) [upload=2998]: Upload finished. err: <nil> Aug 7 19:21:53.105073588 (2h55m6.692129799s) [upload=3005]: Starting upload Aug 7 19:21:53.105114334 (2h55m6.692170545s) [upload=3005]: Done starting upload Aug 7 19:21:53.105186318 (2h55m6.692242539s) [upload=3005]: Uploading segments... Aug 7 19:21:53.105306674 (2h55m6.692362874s) [upload=3005]: Got next segment. Inline: false Aug 7 19:21:53.105336108 (2h55m6.692392319s) [upload=3005]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 19:21:53.105339203 (2h55m6.692395414s) [upload=3005]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 19:21:53.109033360 (2h55m6.696089581s) [upload=3005]: Next segment err: metaclient: Too Many Requests Aug 7 19:21:53.109049810 (2h55m6.696106022s) [upload=3005]: Done uploading segments... Aug 7 19:21:53.109064507 (2h55m6.696120728s) [upload=3005]: Upload finished. err: metaclient: Too Many Requests
Duration: 441.273058ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
458.514633ms
FAIL (2025-08-07 19:23:59 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== e , address=45.91.116.8:4074 , piece_id=U3IR34YDPBGPHSREJ6HPBP25U2AHBTR7QG2EQCVXLB2BEQDJ2IUQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.834929499 (2h54m26.42198574s) [noise=true , address=104.36.82.19:4410 , piece_id=PGCOTNPHPFNLKWADOOIPWJBVC4HV6Z2UO3ZGGDUNYM44CVXMNS5Q, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.835544266 (2h54m26.422600517s) [noise=true , address=104.36.82.43:4838 , piece_id=CIQYIOOPNBC5JTAQE4YS2PRJ2W73LY2YIAOQLZ2O4HRH6K4AV4VA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.835568541 (2h54m26.422624783s) [noise=true , address=104.36.82.15:4265 , piece_id=YC7IG46ROBWABU2OPNOOUXWT2656FI54ZQUZZFKTSZQQVQ3CI7HQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836002882 (2h54m26.423059123s) [noise=true , address=79.127.220.97:4363 , piece_id=IP2TZHQSJP7ZIFDSCI2XIGXFRQVM4LBT4WI26U6Y7NIWQLIADLFA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836020936 (2h54m26.423077177s) [noise=true , address=104.36.82.52:4093 , piece_id=RPTP7YNMQMENA6LQP4BHOEGSGMZXQNTCYHN3W3ARVDFIUQ7PF32Q, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836374136 (2h54m26.423430386s) [noise=true , address=79.127.220.98:4403 , piece_id=DIDPTCNW2X42QHLKZMYKQCCITBNE5K47NQIJ7WOBLRKAUGAOCZBQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836425150 (2h54m26.423481391s) [noise=true , address=45.91.116.5:4310 , piece_id=P7BV2NU2X4FBTDAS2VO4AFOBZUJRBMD5CTX25Y4AJAJFICZJIMLA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836747071 (2h54m26.423803312s) [noise=true , address=104.36.82.35:4594 , piece_id=RM4XVX3ORSDTVWGOZZN6LD7KJCDJVFYJUDUKP2L2UVSD4LALWIOQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836806001 (2h54m26.423862243s) [noise=true , address=104.36.82.45:4932 , piece_id=VM6KJQULAZI5ZMRILBEJFCTGMDESH4ERD3AGXE2GPGWOQXYQAYGQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837101683 (2h54m26.424157924s) [noise=true , address=45.91.116.13:4174 , piece_id=K23L54PQGXCD5CKLLGKDPKAF3YFJ6T2YIRTMC4GQYTJOQNWBYAZQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837189627 (2h54m26.424245878s) [noise=true , address=104.36.82.60:4344 , piece_id=PR7ILHVZ3GWDUBUTUKPB2QJ66X3KVLAIMW6DX3YISWKZQANIT34Q, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837459391 (2h54m26.424515632s) [noise=true , address=104.36.82.21:4486 , piece_id=JCG5AW7HVNO7SOEZPPCTVT7PD5VRRUBCFLQBCCFWIAZKFCX4FENA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837625821 (2h54m26.424682072s) [noise=true , address=104.36.82.46:4491 , piece_id=EJEBI7BULQUSMCBCEPYDAUPNUNDFUOLEBSMYKARPB6PSJO7LOOXA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837840142 (2h54m26.424896383s) [noise=true , address=64.49.13.139:4470 , piece_id=XSK3HH2LTPVVL7IMXRNL5NLIDANPYOJSAKIHWULQV7FJSVRXHP7Q, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.838021710 (2h54m26.425077952s) [noise=true , address=104.36.82.9:4030 , piece_id=W76RQ7UX4QB7IETXOVT4EM25DH7O4LNGAVGLSNQEVZX3XOTMYDOQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.838188782 (2h54m26.425245023s) [noise=true , address=64.49.13.27:4960 , piece_id=2D3W2VLXIEY26BZ6AZDR3SULF7S77LRKYIIGWIXDGOZZIEILVAMQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.838798421 (2h54m26.425854661s) [noise=true , address=104.36.82.39:4733 , piece_id=FKTPESZ7QABDL5ELY6KW3CEPS6474GPX7VFWGQPHN2LGDSUR6WVA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.971456729 (2h54m26.55851296s) [upload=2998]: Next returned nil segment Aug 7 19:21:12.971471597 (2h54m26.558527837s) [upload=2998]: Waiting for error group managing segments... Aug 7 19:21:12.984593159 (2h54m26.5716494s) [noise=true , address=45.91.116.8:4074 , piece_id=U3IR34YDPBGPHSREJ6HPBP25U2AHBTR7QG2EQCVXLB2BEQDJ2IUQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.985962215 (2h54m26.573018456s) [noise=true , address=104.36.82.60:4344 , piece_id=PR7ILHVZ3GWDUBUTUKPB2QJ66X3KVLAIMW6DX3YISWKZQANIT34Q, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.990378008 (2h54m26.577434249s) [noise=true , address=104.36.82.9:4030 , piece_id=W76RQ7UX4QB7IETXOVT4EM25DH7O4LNGAVGLSNQEVZX3XOTMYDOQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.995793868 (2h54m26.5828501s) [noise=true , address=104.36.82.39:4733 , piece_id=FKTPESZ7QABDL5ELY6KW3CEPS6474GPX7VFWGQPHN2LGDSUR6WVA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.996448801 (2h54m26.583505042s) [noise=true , address=45.91.116.5:4310 , piece_id=P7BV2NU2X4FBTDAS2VO4AFOBZUJRBMD5CTX25Y4AJAJFICZJIMLA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.997165077 (2h54m26.584221308s) [noise=true , address=45.91.116.13:4174 , piece_id=K23L54PQGXCD5CKLLGKDPKAF3YFJ6T2YIRTMC4GQYTJOQNWBYAZQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.997808920 (2h54m26.584865171s) [noise=true , address=104.36.82.35:4594 , piece_id=RM4XVX3ORSDTVWGOZZN6LD7KJCDJVFYJUDUKP2L2UVSD4LALWIOQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.999547955 (2h54m26.586604206s) [noise=true , address=104.36.82.46:4491 , piece_id=EJEBI7BULQUSMCBCEPYDAUPNUNDFUOLEBSMYKARPB6PSJO7LOOXA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.012312983 (2h54m26.599369194s) [noise=true , address=104.36.82.43:4838 , piece_id=CIQYIOOPNBC5JTAQE4YS2PRJ2W73LY2YIAOQLZ2O4HRH6K4AV4VA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.012903997 (2h54m26.599960238s) [noise=true , address=104.36.82.52:4093 , piece_id=RPTP7YNMQMENA6LQP4BHOEGSGMZXQNTCYHN3W3ARVDFIUQ7PF32Q, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.018321450 (2h54m26.605377671s) [noise=true , address=104.36.82.21:4486 , piece_id=JCG5AW7HVNO7SOEZPPCTVT7PD5VRRUBCFLQBCCFWIAZKFCX4FENA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.020563575 (2h54m26.607619816s) [noise=true , address=79.127.220.97:4363 , piece_id=IP2TZHQSJP7ZIFDSCI2XIGXFRQVM4LBT4WI26U6Y7NIWQLIADLFA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.043146098 (2h54m26.63020232s) [noise=true , address=104.36.82.19:4410 , piece_id=PGCOTNPHPFNLKWADOOIPWJBVC4HV6Z2UO3ZGGDUNYM44CVXMNS5Q, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.046871412 (2h54m26.633927654s) [noise=true , address=104.36.82.45:4932 , piece_id=VM6KJQULAZI5ZMRILBEJFCTGMDESH4ERD3AGXE2GPGWOQXYQAYGQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.046907620 (2h54m26.63396386s) [seg_pos={0 0}, upload=2998]: Segment reached optimal threshold of 14 pieces. Aug 7 19:21:13.047055916 (2h54m26.634112158s) [noise=true , address=79.127.220.98:4403 , piece_id=DIDPTCNW2X42QHLKZMYKQCCITBNE5K47NQIJ7WOBLRKAUGAOCZBQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q9k1NkgoSntisBrcMfPrumr7q432VZ2FgjEuYXBT8mxeFh1R3): protocol: expected piece hash; context canceled; EOF Aug 7 19:21:13.047189606 (2h54m26.634245827s) [noise=true , address=64.49.13.139:4470 , piece_id=XSK3HH2LTPVVL7IMXRNL5NLIDANPYOJSAKIHWULQV7FJSVRXHP7Q, seg_pos={0 0}, upload=2998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G4gW4QhXRDsfHcGvFr7qCpB49u9dYQPDXC4CuBZGwQUuFU7Fx): protocol: read tcp 5.161.89.252:53932->64.49.13.139:4470: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:21:13.047204073 (2h54m26.634260315s) [noise=true , address=104.36.82.15:4265 , piece_id=YC7IG46ROBWABU2OPNOOUXWT2656FI54ZQUZZFKTSZQQVQ3CI7HQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NscbwYiKarBdony9TwdccuEKg7f4VXEXerFfWmCiat4RKdXFi): protocol: expected piece hash; context canceled; EOF Aug 7 19:21:13.047277671 (2h54m26.634333892s) [noise=true , address=64.49.13.27:4960 , piece_id=2D3W2VLXIEY26BZ6AZDR3SULF7S77LRKYIIGWIXDGOZZIEILVAMQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: context canceled; context canceled Aug 7 19:21:13.047292819 (2h54m26.63434903s) [seg_pos={0 0}, upload=2998]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:21:13.047366076 (2h54m26.634422297s) [upload=2998]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 19:21:13.047370263 (2h54m26.634426474s) [upload=2998]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 19:21:13.101472814 (2h54m26.688529055s) [upload=2998]: Done uploading segments... Aug 7 19:21:13.101494615 (2h54m26.688550846s) [upload=2998]: Upload finished. err: <nil> Aug 7 19:21:53.105073588 (2h55m6.692129799s) [upload=3005]: Starting upload Aug 7 19:21:53.105114334 (2h55m6.692170545s) [upload=3005]: Done starting upload Aug 7 19:21:53.105186318 (2h55m6.692242539s) [upload=3005]: Uploading segments... Aug 7 19:21:53.105306674 (2h55m6.692362874s) [upload=3005]: Got next segment. Inline: false Aug 7 19:21:53.105336108 (2h55m6.692392319s) [upload=3005]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 19:21:53.105339203 (2h55m6.692395414s) [upload=3005]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 19:21:53.109033360 (2h55m6.696089581s) [upload=3005]: Next segment err: metaclient: Too Many Requests Aug 7 19:21:53.109049810 (2h55m6.696106022s) [upload=3005]: Done uploading segments... Aug 7 19:21:53.109064507 (2h55m6.696120728s) [upload=3005]: Upload finished. err: metaclient: Too Many Requests
Duration: 458.532636ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
489.896273ms
FAIL (2025-08-07 19:23:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== e , address=45.91.116.8:4074 , piece_id=U3IR34YDPBGPHSREJ6HPBP25U2AHBTR7QG2EQCVXLB2BEQDJ2IUQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.834929499 (2h54m26.42198574s) [noise=true , address=104.36.82.19:4410 , piece_id=PGCOTNPHPFNLKWADOOIPWJBVC4HV6Z2UO3ZGGDUNYM44CVXMNS5Q, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.835544266 (2h54m26.422600517s) [noise=true , address=104.36.82.43:4838 , piece_id=CIQYIOOPNBC5JTAQE4YS2PRJ2W73LY2YIAOQLZ2O4HRH6K4AV4VA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.835568541 (2h54m26.422624783s) [noise=true , address=104.36.82.15:4265 , piece_id=YC7IG46ROBWABU2OPNOOUXWT2656FI54ZQUZZFKTSZQQVQ3CI7HQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836002882 (2h54m26.423059123s) [noise=true , address=79.127.220.97:4363 , piece_id=IP2TZHQSJP7ZIFDSCI2XIGXFRQVM4LBT4WI26U6Y7NIWQLIADLFA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836020936 (2h54m26.423077177s) [noise=true , address=104.36.82.52:4093 , piece_id=RPTP7YNMQMENA6LQP4BHOEGSGMZXQNTCYHN3W3ARVDFIUQ7PF32Q, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836374136 (2h54m26.423430386s) [noise=true , address=79.127.220.98:4403 , piece_id=DIDPTCNW2X42QHLKZMYKQCCITBNE5K47NQIJ7WOBLRKAUGAOCZBQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836425150 (2h54m26.423481391s) [noise=true , address=45.91.116.5:4310 , piece_id=P7BV2NU2X4FBTDAS2VO4AFOBZUJRBMD5CTX25Y4AJAJFICZJIMLA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836747071 (2h54m26.423803312s) [noise=true , address=104.36.82.35:4594 , piece_id=RM4XVX3ORSDTVWGOZZN6LD7KJCDJVFYJUDUKP2L2UVSD4LALWIOQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836806001 (2h54m26.423862243s) [noise=true , address=104.36.82.45:4932 , piece_id=VM6KJQULAZI5ZMRILBEJFCTGMDESH4ERD3AGXE2GPGWOQXYQAYGQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837101683 (2h54m26.424157924s) [noise=true , address=45.91.116.13:4174 , piece_id=K23L54PQGXCD5CKLLGKDPKAF3YFJ6T2YIRTMC4GQYTJOQNWBYAZQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837189627 (2h54m26.424245878s) [noise=true , address=104.36.82.60:4344 , piece_id=PR7ILHVZ3GWDUBUTUKPB2QJ66X3KVLAIMW6DX3YISWKZQANIT34Q, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837459391 (2h54m26.424515632s) [noise=true , address=104.36.82.21:4486 , piece_id=JCG5AW7HVNO7SOEZPPCTVT7PD5VRRUBCFLQBCCFWIAZKFCX4FENA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837625821 (2h54m26.424682072s) [noise=true , address=104.36.82.46:4491 , piece_id=EJEBI7BULQUSMCBCEPYDAUPNUNDFUOLEBSMYKARPB6PSJO7LOOXA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837840142 (2h54m26.424896383s) [noise=true , address=64.49.13.139:4470 , piece_id=XSK3HH2LTPVVL7IMXRNL5NLIDANPYOJSAKIHWULQV7FJSVRXHP7Q, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.838021710 (2h54m26.425077952s) [noise=true , address=104.36.82.9:4030 , piece_id=W76RQ7UX4QB7IETXOVT4EM25DH7O4LNGAVGLSNQEVZX3XOTMYDOQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.838188782 (2h54m26.425245023s) [noise=true , address=64.49.13.27:4960 , piece_id=2D3W2VLXIEY26BZ6AZDR3SULF7S77LRKYIIGWIXDGOZZIEILVAMQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.838798421 (2h54m26.425854661s) [noise=true , address=104.36.82.39:4733 , piece_id=FKTPESZ7QABDL5ELY6KW3CEPS6474GPX7VFWGQPHN2LGDSUR6WVA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.971456729 (2h54m26.55851296s) [upload=2998]: Next returned nil segment Aug 7 19:21:12.971471597 (2h54m26.558527837s) [upload=2998]: Waiting for error group managing segments... Aug 7 19:21:12.984593159 (2h54m26.5716494s) [noise=true , address=45.91.116.8:4074 , piece_id=U3IR34YDPBGPHSREJ6HPBP25U2AHBTR7QG2EQCVXLB2BEQDJ2IUQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.985962215 (2h54m26.573018456s) [noise=true , address=104.36.82.60:4344 , piece_id=PR7ILHVZ3GWDUBUTUKPB2QJ66X3KVLAIMW6DX3YISWKZQANIT34Q, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.990378008 (2h54m26.577434249s) [noise=true , address=104.36.82.9:4030 , piece_id=W76RQ7UX4QB7IETXOVT4EM25DH7O4LNGAVGLSNQEVZX3XOTMYDOQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.995793868 (2h54m26.5828501s) [noise=true , address=104.36.82.39:4733 , piece_id=FKTPESZ7QABDL5ELY6KW3CEPS6474GPX7VFWGQPHN2LGDSUR6WVA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.996448801 (2h54m26.583505042s) [noise=true , address=45.91.116.5:4310 , piece_id=P7BV2NU2X4FBTDAS2VO4AFOBZUJRBMD5CTX25Y4AJAJFICZJIMLA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.997165077 (2h54m26.584221308s) [noise=true , address=45.91.116.13:4174 , piece_id=K23L54PQGXCD5CKLLGKDPKAF3YFJ6T2YIRTMC4GQYTJOQNWBYAZQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.997808920 (2h54m26.584865171s) [noise=true , address=104.36.82.35:4594 , piece_id=RM4XVX3ORSDTVWGOZZN6LD7KJCDJVFYJUDUKP2L2UVSD4LALWIOQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.999547955 (2h54m26.586604206s) [noise=true , address=104.36.82.46:4491 , piece_id=EJEBI7BULQUSMCBCEPYDAUPNUNDFUOLEBSMYKARPB6PSJO7LOOXA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.012312983 (2h54m26.599369194s) [noise=true , address=104.36.82.43:4838 , piece_id=CIQYIOOPNBC5JTAQE4YS2PRJ2W73LY2YIAOQLZ2O4HRH6K4AV4VA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.012903997 (2h54m26.599960238s) [noise=true , address=104.36.82.52:4093 , piece_id=RPTP7YNMQMENA6LQP4BHOEGSGMZXQNTCYHN3W3ARVDFIUQ7PF32Q, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.018321450 (2h54m26.605377671s) [noise=true , address=104.36.82.21:4486 , piece_id=JCG5AW7HVNO7SOEZPPCTVT7PD5VRRUBCFLQBCCFWIAZKFCX4FENA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.020563575 (2h54m26.607619816s) [noise=true , address=79.127.220.97:4363 , piece_id=IP2TZHQSJP7ZIFDSCI2XIGXFRQVM4LBT4WI26U6Y7NIWQLIADLFA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.043146098 (2h54m26.63020232s) [noise=true , address=104.36.82.19:4410 , piece_id=PGCOTNPHPFNLKWADOOIPWJBVC4HV6Z2UO3ZGGDUNYM44CVXMNS5Q, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.046871412 (2h54m26.633927654s) [noise=true , address=104.36.82.45:4932 , piece_id=VM6KJQULAZI5ZMRILBEJFCTGMDESH4ERD3AGXE2GPGWOQXYQAYGQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.046907620 (2h54m26.63396386s) [seg_pos={0 0}, upload=2998]: Segment reached optimal threshold of 14 pieces. Aug 7 19:21:13.047055916 (2h54m26.634112158s) [noise=true , address=79.127.220.98:4403 , piece_id=DIDPTCNW2X42QHLKZMYKQCCITBNE5K47NQIJ7WOBLRKAUGAOCZBQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q9k1NkgoSntisBrcMfPrumr7q432VZ2FgjEuYXBT8mxeFh1R3): protocol: expected piece hash; context canceled; EOF Aug 7 19:21:13.047189606 (2h54m26.634245827s) [noise=true , address=64.49.13.139:4470 , piece_id=XSK3HH2LTPVVL7IMXRNL5NLIDANPYOJSAKIHWULQV7FJSVRXHP7Q, seg_pos={0 0}, upload=2998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G4gW4QhXRDsfHcGvFr7qCpB49u9dYQPDXC4CuBZGwQUuFU7Fx): protocol: read tcp 5.161.89.252:53932->64.49.13.139:4470: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:21:13.047204073 (2h54m26.634260315s) [noise=true , address=104.36.82.15:4265 , piece_id=YC7IG46ROBWABU2OPNOOUXWT2656FI54ZQUZZFKTSZQQVQ3CI7HQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NscbwYiKarBdony9TwdccuEKg7f4VXEXerFfWmCiat4RKdXFi): protocol: expected piece hash; context canceled; EOF Aug 7 19:21:13.047277671 (2h54m26.634333892s) [noise=true , address=64.49.13.27:4960 , piece_id=2D3W2VLXIEY26BZ6AZDR3SULF7S77LRKYIIGWIXDGOZZIEILVAMQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: context canceled; context canceled Aug 7 19:21:13.047292819 (2h54m26.63434903s) [seg_pos={0 0}, upload=2998]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:21:13.047366076 (2h54m26.634422297s) [upload=2998]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 19:21:13.047370263 (2h54m26.634426474s) [upload=2998]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 19:21:13.101472814 (2h54m26.688529055s) [upload=2998]: Done uploading segments... Aug 7 19:21:13.101494615 (2h54m26.688550846s) [upload=2998]: Upload finished. err: <nil> Aug 7 19:21:53.105073588 (2h55m6.692129799s) [upload=3005]: Starting upload Aug 7 19:21:53.105114334 (2h55m6.692170545s) [upload=3005]: Done starting upload Aug 7 19:21:53.105186318 (2h55m6.692242539s) [upload=3005]: Uploading segments... Aug 7 19:21:53.105306674 (2h55m6.692362874s) [upload=3005]: Got next segment. Inline: false Aug 7 19:21:53.105336108 (2h55m6.692392319s) [upload=3005]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 19:21:53.105339203 (2h55m6.692395414s) [upload=3005]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 19:21:53.109033360 (2h55m6.696089581s) [upload=3005]: Next segment err: metaclient: Too Many Requests Aug 7 19:21:53.109049810 (2h55m6.696106022s) [upload=3005]: Done uploading segments... Aug 7 19:21:53.109064507 (2h55m6.696120728s) [upload=3005]: Upload finished. err: metaclient: Too Many Requests
Duration: 489.915948ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
484.574165ms
FAIL (2025-08-07 19:23:14 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== e , address=45.91.116.8:4074 , piece_id=U3IR34YDPBGPHSREJ6HPBP25U2AHBTR7QG2EQCVXLB2BEQDJ2IUQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.834929499 (2h54m26.42198574s) [noise=true , address=104.36.82.19:4410 , piece_id=PGCOTNPHPFNLKWADOOIPWJBVC4HV6Z2UO3ZGGDUNYM44CVXMNS5Q, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.835544266 (2h54m26.422600517s) [noise=true , address=104.36.82.43:4838 , piece_id=CIQYIOOPNBC5JTAQE4YS2PRJ2W73LY2YIAOQLZ2O4HRH6K4AV4VA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.835568541 (2h54m26.422624783s) [noise=true , address=104.36.82.15:4265 , piece_id=YC7IG46ROBWABU2OPNOOUXWT2656FI54ZQUZZFKTSZQQVQ3CI7HQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836002882 (2h54m26.423059123s) [noise=true , address=79.127.220.97:4363 , piece_id=IP2TZHQSJP7ZIFDSCI2XIGXFRQVM4LBT4WI26U6Y7NIWQLIADLFA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836020936 (2h54m26.423077177s) [noise=true , address=104.36.82.52:4093 , piece_id=RPTP7YNMQMENA6LQP4BHOEGSGMZXQNTCYHN3W3ARVDFIUQ7PF32Q, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836374136 (2h54m26.423430386s) [noise=true , address=79.127.220.98:4403 , piece_id=DIDPTCNW2X42QHLKZMYKQCCITBNE5K47NQIJ7WOBLRKAUGAOCZBQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836425150 (2h54m26.423481391s) [noise=true , address=45.91.116.5:4310 , piece_id=P7BV2NU2X4FBTDAS2VO4AFOBZUJRBMD5CTX25Y4AJAJFICZJIMLA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836747071 (2h54m26.423803312s) [noise=true , address=104.36.82.35:4594 , piece_id=RM4XVX3ORSDTVWGOZZN6LD7KJCDJVFYJUDUKP2L2UVSD4LALWIOQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836806001 (2h54m26.423862243s) [noise=true , address=104.36.82.45:4932 , piece_id=VM6KJQULAZI5ZMRILBEJFCTGMDESH4ERD3AGXE2GPGWOQXYQAYGQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837101683 (2h54m26.424157924s) [noise=true , address=45.91.116.13:4174 , piece_id=K23L54PQGXCD5CKLLGKDPKAF3YFJ6T2YIRTMC4GQYTJOQNWBYAZQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837189627 (2h54m26.424245878s) [noise=true , address=104.36.82.60:4344 , piece_id=PR7ILHVZ3GWDUBUTUKPB2QJ66X3KVLAIMW6DX3YISWKZQANIT34Q, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837459391 (2h54m26.424515632s) [noise=true , address=104.36.82.21:4486 , piece_id=JCG5AW7HVNO7SOEZPPCTVT7PD5VRRUBCFLQBCCFWIAZKFCX4FENA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837625821 (2h54m26.424682072s) [noise=true , address=104.36.82.46:4491 , piece_id=EJEBI7BULQUSMCBCEPYDAUPNUNDFUOLEBSMYKARPB6PSJO7LOOXA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837840142 (2h54m26.424896383s) [noise=true , address=64.49.13.139:4470 , piece_id=XSK3HH2LTPVVL7IMXRNL5NLIDANPYOJSAKIHWULQV7FJSVRXHP7Q, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.838021710 (2h54m26.425077952s) [noise=true , address=104.36.82.9:4030 , piece_id=W76RQ7UX4QB7IETXOVT4EM25DH7O4LNGAVGLSNQEVZX3XOTMYDOQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.838188782 (2h54m26.425245023s) [noise=true , address=64.49.13.27:4960 , piece_id=2D3W2VLXIEY26BZ6AZDR3SULF7S77LRKYIIGWIXDGOZZIEILVAMQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.838798421 (2h54m26.425854661s) [noise=true , address=104.36.82.39:4733 , piece_id=FKTPESZ7QABDL5ELY6KW3CEPS6474GPX7VFWGQPHN2LGDSUR6WVA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.971456729 (2h54m26.55851296s) [upload=2998]: Next returned nil segment Aug 7 19:21:12.971471597 (2h54m26.558527837s) [upload=2998]: Waiting for error group managing segments... Aug 7 19:21:12.984593159 (2h54m26.5716494s) [noise=true , address=45.91.116.8:4074 , piece_id=U3IR34YDPBGPHSREJ6HPBP25U2AHBTR7QG2EQCVXLB2BEQDJ2IUQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.985962215 (2h54m26.573018456s) [noise=true , address=104.36.82.60:4344 , piece_id=PR7ILHVZ3GWDUBUTUKPB2QJ66X3KVLAIMW6DX3YISWKZQANIT34Q, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.990378008 (2h54m26.577434249s) [noise=true , address=104.36.82.9:4030 , piece_id=W76RQ7UX4QB7IETXOVT4EM25DH7O4LNGAVGLSNQEVZX3XOTMYDOQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.995793868 (2h54m26.5828501s) [noise=true , address=104.36.82.39:4733 , piece_id=FKTPESZ7QABDL5ELY6KW3CEPS6474GPX7VFWGQPHN2LGDSUR6WVA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.996448801 (2h54m26.583505042s) [noise=true , address=45.91.116.5:4310 , piece_id=P7BV2NU2X4FBTDAS2VO4AFOBZUJRBMD5CTX25Y4AJAJFICZJIMLA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.997165077 (2h54m26.584221308s) [noise=true , address=45.91.116.13:4174 , piece_id=K23L54PQGXCD5CKLLGKDPKAF3YFJ6T2YIRTMC4GQYTJOQNWBYAZQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.997808920 (2h54m26.584865171s) [noise=true , address=104.36.82.35:4594 , piece_id=RM4XVX3ORSDTVWGOZZN6LD7KJCDJVFYJUDUKP2L2UVSD4LALWIOQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.999547955 (2h54m26.586604206s) [noise=true , address=104.36.82.46:4491 , piece_id=EJEBI7BULQUSMCBCEPYDAUPNUNDFUOLEBSMYKARPB6PSJO7LOOXA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.012312983 (2h54m26.599369194s) [noise=true , address=104.36.82.43:4838 , piece_id=CIQYIOOPNBC5JTAQE4YS2PRJ2W73LY2YIAOQLZ2O4HRH6K4AV4VA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.012903997 (2h54m26.599960238s) [noise=true , address=104.36.82.52:4093 , piece_id=RPTP7YNMQMENA6LQP4BHOEGSGMZXQNTCYHN3W3ARVDFIUQ7PF32Q, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.018321450 (2h54m26.605377671s) [noise=true , address=104.36.82.21:4486 , piece_id=JCG5AW7HVNO7SOEZPPCTVT7PD5VRRUBCFLQBCCFWIAZKFCX4FENA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.020563575 (2h54m26.607619816s) [noise=true , address=79.127.220.97:4363 , piece_id=IP2TZHQSJP7ZIFDSCI2XIGXFRQVM4LBT4WI26U6Y7NIWQLIADLFA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.043146098 (2h54m26.63020232s) [noise=true , address=104.36.82.19:4410 , piece_id=PGCOTNPHPFNLKWADOOIPWJBVC4HV6Z2UO3ZGGDUNYM44CVXMNS5Q, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.046871412 (2h54m26.633927654s) [noise=true , address=104.36.82.45:4932 , piece_id=VM6KJQULAZI5ZMRILBEJFCTGMDESH4ERD3AGXE2GPGWOQXYQAYGQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.046907620 (2h54m26.63396386s) [seg_pos={0 0}, upload=2998]: Segment reached optimal threshold of 14 pieces. Aug 7 19:21:13.047055916 (2h54m26.634112158s) [noise=true , address=79.127.220.98:4403 , piece_id=DIDPTCNW2X42QHLKZMYKQCCITBNE5K47NQIJ7WOBLRKAUGAOCZBQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q9k1NkgoSntisBrcMfPrumr7q432VZ2FgjEuYXBT8mxeFh1R3): protocol: expected piece hash; context canceled; EOF Aug 7 19:21:13.047189606 (2h54m26.634245827s) [noise=true , address=64.49.13.139:4470 , piece_id=XSK3HH2LTPVVL7IMXRNL5NLIDANPYOJSAKIHWULQV7FJSVRXHP7Q, seg_pos={0 0}, upload=2998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G4gW4QhXRDsfHcGvFr7qCpB49u9dYQPDXC4CuBZGwQUuFU7Fx): protocol: read tcp 5.161.89.252:53932->64.49.13.139:4470: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:21:13.047204073 (2h54m26.634260315s) [noise=true , address=104.36.82.15:4265 , piece_id=YC7IG46ROBWABU2OPNOOUXWT2656FI54ZQUZZFKTSZQQVQ3CI7HQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NscbwYiKarBdony9TwdccuEKg7f4VXEXerFfWmCiat4RKdXFi): protocol: expected piece hash; context canceled; EOF Aug 7 19:21:13.047277671 (2h54m26.634333892s) [noise=true , address=64.49.13.27:4960 , piece_id=2D3W2VLXIEY26BZ6AZDR3SULF7S77LRKYIIGWIXDGOZZIEILVAMQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: context canceled; context canceled Aug 7 19:21:13.047292819 (2h54m26.63434903s) [seg_pos={0 0}, upload=2998]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:21:13.047366076 (2h54m26.634422297s) [upload=2998]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 19:21:13.047370263 (2h54m26.634426474s) [upload=2998]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 19:21:13.101472814 (2h54m26.688529055s) [upload=2998]: Done uploading segments... Aug 7 19:21:13.101494615 (2h54m26.688550846s) [upload=2998]: Upload finished. err: <nil> Aug 7 19:21:53.105073588 (2h55m6.692129799s) [upload=3005]: Starting upload Aug 7 19:21:53.105114334 (2h55m6.692170545s) [upload=3005]: Done starting upload Aug 7 19:21:53.105186318 (2h55m6.692242539s) [upload=3005]: Uploading segments... Aug 7 19:21:53.105306674 (2h55m6.692362874s) [upload=3005]: Got next segment. Inline: false Aug 7 19:21:53.105336108 (2h55m6.692392319s) [upload=3005]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 19:21:53.105339203 (2h55m6.692395414s) [upload=3005]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 19:21:53.109033360 (2h55m6.696089581s) [upload=3005]: Next segment err: metaclient: Too Many Requests Aug 7 19:21:53.109049810 (2h55m6.696106022s) [upload=3005]: Done uploading segments... Aug 7 19:21:53.109064507 (2h55m6.696120728s) [upload=3005]: Upload finished. err: metaclient: Too Many Requests
Duration: 484.59241ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
438.301904ms
FAIL (2025-08-07 19:22:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== e , address=45.91.116.8:4074 , piece_id=U3IR34YDPBGPHSREJ6HPBP25U2AHBTR7QG2EQCVXLB2BEQDJ2IUQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.834929499 (2h54m26.42198574s) [noise=true , address=104.36.82.19:4410 , piece_id=PGCOTNPHPFNLKWADOOIPWJBVC4HV6Z2UO3ZGGDUNYM44CVXMNS5Q, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.835544266 (2h54m26.422600517s) [noise=true , address=104.36.82.43:4838 , piece_id=CIQYIOOPNBC5JTAQE4YS2PRJ2W73LY2YIAOQLZ2O4HRH6K4AV4VA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.835568541 (2h54m26.422624783s) [noise=true , address=104.36.82.15:4265 , piece_id=YC7IG46ROBWABU2OPNOOUXWT2656FI54ZQUZZFKTSZQQVQ3CI7HQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836002882 (2h54m26.423059123s) [noise=true , address=79.127.220.97:4363 , piece_id=IP2TZHQSJP7ZIFDSCI2XIGXFRQVM4LBT4WI26U6Y7NIWQLIADLFA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836020936 (2h54m26.423077177s) [noise=true , address=104.36.82.52:4093 , piece_id=RPTP7YNMQMENA6LQP4BHOEGSGMZXQNTCYHN3W3ARVDFIUQ7PF32Q, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836374136 (2h54m26.423430386s) [noise=true , address=79.127.220.98:4403 , piece_id=DIDPTCNW2X42QHLKZMYKQCCITBNE5K47NQIJ7WOBLRKAUGAOCZBQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836425150 (2h54m26.423481391s) [noise=true , address=45.91.116.5:4310 , piece_id=P7BV2NU2X4FBTDAS2VO4AFOBZUJRBMD5CTX25Y4AJAJFICZJIMLA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836747071 (2h54m26.423803312s) [noise=true , address=104.36.82.35:4594 , piece_id=RM4XVX3ORSDTVWGOZZN6LD7KJCDJVFYJUDUKP2L2UVSD4LALWIOQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836806001 (2h54m26.423862243s) [noise=true , address=104.36.82.45:4932 , piece_id=VM6KJQULAZI5ZMRILBEJFCTGMDESH4ERD3AGXE2GPGWOQXYQAYGQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837101683 (2h54m26.424157924s) [noise=true , address=45.91.116.13:4174 , piece_id=K23L54PQGXCD5CKLLGKDPKAF3YFJ6T2YIRTMC4GQYTJOQNWBYAZQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837189627 (2h54m26.424245878s) [noise=true , address=104.36.82.60:4344 , piece_id=PR7ILHVZ3GWDUBUTUKPB2QJ66X3KVLAIMW6DX3YISWKZQANIT34Q, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837459391 (2h54m26.424515632s) [noise=true , address=104.36.82.21:4486 , piece_id=JCG5AW7HVNO7SOEZPPCTVT7PD5VRRUBCFLQBCCFWIAZKFCX4FENA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837625821 (2h54m26.424682072s) [noise=true , address=104.36.82.46:4491 , piece_id=EJEBI7BULQUSMCBCEPYDAUPNUNDFUOLEBSMYKARPB6PSJO7LOOXA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837840142 (2h54m26.424896383s) [noise=true , address=64.49.13.139:4470 , piece_id=XSK3HH2LTPVVL7IMXRNL5NLIDANPYOJSAKIHWULQV7FJSVRXHP7Q, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.838021710 (2h54m26.425077952s) [noise=true , address=104.36.82.9:4030 , piece_id=W76RQ7UX4QB7IETXOVT4EM25DH7O4LNGAVGLSNQEVZX3XOTMYDOQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.838188782 (2h54m26.425245023s) [noise=true , address=64.49.13.27:4960 , piece_id=2D3W2VLXIEY26BZ6AZDR3SULF7S77LRKYIIGWIXDGOZZIEILVAMQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.838798421 (2h54m26.425854661s) [noise=true , address=104.36.82.39:4733 , piece_id=FKTPESZ7QABDL5ELY6KW3CEPS6474GPX7VFWGQPHN2LGDSUR6WVA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.971456729 (2h54m26.55851296s) [upload=2998]: Next returned nil segment Aug 7 19:21:12.971471597 (2h54m26.558527837s) [upload=2998]: Waiting for error group managing segments... Aug 7 19:21:12.984593159 (2h54m26.5716494s) [noise=true , address=45.91.116.8:4074 , piece_id=U3IR34YDPBGPHSREJ6HPBP25U2AHBTR7QG2EQCVXLB2BEQDJ2IUQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.985962215 (2h54m26.573018456s) [noise=true , address=104.36.82.60:4344 , piece_id=PR7ILHVZ3GWDUBUTUKPB2QJ66X3KVLAIMW6DX3YISWKZQANIT34Q, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.990378008 (2h54m26.577434249s) [noise=true , address=104.36.82.9:4030 , piece_id=W76RQ7UX4QB7IETXOVT4EM25DH7O4LNGAVGLSNQEVZX3XOTMYDOQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.995793868 (2h54m26.5828501s) [noise=true , address=104.36.82.39:4733 , piece_id=FKTPESZ7QABDL5ELY6KW3CEPS6474GPX7VFWGQPHN2LGDSUR6WVA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.996448801 (2h54m26.583505042s) [noise=true , address=45.91.116.5:4310 , piece_id=P7BV2NU2X4FBTDAS2VO4AFOBZUJRBMD5CTX25Y4AJAJFICZJIMLA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.997165077 (2h54m26.584221308s) [noise=true , address=45.91.116.13:4174 , piece_id=K23L54PQGXCD5CKLLGKDPKAF3YFJ6T2YIRTMC4GQYTJOQNWBYAZQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.997808920 (2h54m26.584865171s) [noise=true , address=104.36.82.35:4594 , piece_id=RM4XVX3ORSDTVWGOZZN6LD7KJCDJVFYJUDUKP2L2UVSD4LALWIOQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.999547955 (2h54m26.586604206s) [noise=true , address=104.36.82.46:4491 , piece_id=EJEBI7BULQUSMCBCEPYDAUPNUNDFUOLEBSMYKARPB6PSJO7LOOXA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.012312983 (2h54m26.599369194s) [noise=true , address=104.36.82.43:4838 , piece_id=CIQYIOOPNBC5JTAQE4YS2PRJ2W73LY2YIAOQLZ2O4HRH6K4AV4VA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.012903997 (2h54m26.599960238s) [noise=true , address=104.36.82.52:4093 , piece_id=RPTP7YNMQMENA6LQP4BHOEGSGMZXQNTCYHN3W3ARVDFIUQ7PF32Q, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.018321450 (2h54m26.605377671s) [noise=true , address=104.36.82.21:4486 , piece_id=JCG5AW7HVNO7SOEZPPCTVT7PD5VRRUBCFLQBCCFWIAZKFCX4FENA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.020563575 (2h54m26.607619816s) [noise=true , address=79.127.220.97:4363 , piece_id=IP2TZHQSJP7ZIFDSCI2XIGXFRQVM4LBT4WI26U6Y7NIWQLIADLFA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.043146098 (2h54m26.63020232s) [noise=true , address=104.36.82.19:4410 , piece_id=PGCOTNPHPFNLKWADOOIPWJBVC4HV6Z2UO3ZGGDUNYM44CVXMNS5Q, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.046871412 (2h54m26.633927654s) [noise=true , address=104.36.82.45:4932 , piece_id=VM6KJQULAZI5ZMRILBEJFCTGMDESH4ERD3AGXE2GPGWOQXYQAYGQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.046907620 (2h54m26.63396386s) [seg_pos={0 0}, upload=2998]: Segment reached optimal threshold of 14 pieces. Aug 7 19:21:13.047055916 (2h54m26.634112158s) [noise=true , address=79.127.220.98:4403 , piece_id=DIDPTCNW2X42QHLKZMYKQCCITBNE5K47NQIJ7WOBLRKAUGAOCZBQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q9k1NkgoSntisBrcMfPrumr7q432VZ2FgjEuYXBT8mxeFh1R3): protocol: expected piece hash; context canceled; EOF Aug 7 19:21:13.047189606 (2h54m26.634245827s) [noise=true , address=64.49.13.139:4470 , piece_id=XSK3HH2LTPVVL7IMXRNL5NLIDANPYOJSAKIHWULQV7FJSVRXHP7Q, seg_pos={0 0}, upload=2998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G4gW4QhXRDsfHcGvFr7qCpB49u9dYQPDXC4CuBZGwQUuFU7Fx): protocol: read tcp 5.161.89.252:53932->64.49.13.139:4470: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:21:13.047204073 (2h54m26.634260315s) [noise=true , address=104.36.82.15:4265 , piece_id=YC7IG46ROBWABU2OPNOOUXWT2656FI54ZQUZZFKTSZQQVQ3CI7HQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NscbwYiKarBdony9TwdccuEKg7f4VXEXerFfWmCiat4RKdXFi): protocol: expected piece hash; context canceled; EOF Aug 7 19:21:13.047277671 (2h54m26.634333892s) [noise=true , address=64.49.13.27:4960 , piece_id=2D3W2VLXIEY26BZ6AZDR3SULF7S77LRKYIIGWIXDGOZZIEILVAMQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: context canceled; context canceled Aug 7 19:21:13.047292819 (2h54m26.63434903s) [seg_pos={0 0}, upload=2998]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:21:13.047366076 (2h54m26.634422297s) [upload=2998]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 19:21:13.047370263 (2h54m26.634426474s) [upload=2998]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 19:21:13.101472814 (2h54m26.688529055s) [upload=2998]: Done uploading segments... Aug 7 19:21:13.101494615 (2h54m26.688550846s) [upload=2998]: Upload finished. err: <nil> Aug 7 19:21:53.105073588 (2h55m6.692129799s) [upload=3005]: Starting upload Aug 7 19:21:53.105114334 (2h55m6.692170545s) [upload=3005]: Done starting upload Aug 7 19:21:53.105186318 (2h55m6.692242539s) [upload=3005]: Uploading segments... Aug 7 19:21:53.105306674 (2h55m6.692362874s) [upload=3005]: Got next segment. Inline: false Aug 7 19:21:53.105336108 (2h55m6.692392319s) [upload=3005]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 19:21:53.105339203 (2h55m6.692395414s) [upload=3005]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 19:21:53.109033360 (2h55m6.696089581s) [upload=3005]: Next segment err: metaclient: Too Many Requests Aug 7 19:21:53.109049810 (2h55m6.696106022s) [upload=3005]: Done uploading segments... Aug 7 19:21:53.109064507 (2h55m6.696120728s) [upload=3005]: Upload finished. err: metaclient: Too Many Requests
Duration: 438.3268ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
17.448722ms
FAIL (2025-08-07 19:21:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== e , address=45.91.116.8:4074 , piece_id=U3IR34YDPBGPHSREJ6HPBP25U2AHBTR7QG2EQCVXLB2BEQDJ2IUQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.834929499 (2h54m26.42198574s) [noise=true , address=104.36.82.19:4410 , piece_id=PGCOTNPHPFNLKWADOOIPWJBVC4HV6Z2UO3ZGGDUNYM44CVXMNS5Q, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.835544266 (2h54m26.422600517s) [noise=true , address=104.36.82.43:4838 , piece_id=CIQYIOOPNBC5JTAQE4YS2PRJ2W73LY2YIAOQLZ2O4HRH6K4AV4VA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.835568541 (2h54m26.422624783s) [noise=true , address=104.36.82.15:4265 , piece_id=YC7IG46ROBWABU2OPNOOUXWT2656FI54ZQUZZFKTSZQQVQ3CI7HQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836002882 (2h54m26.423059123s) [noise=true , address=79.127.220.97:4363 , piece_id=IP2TZHQSJP7ZIFDSCI2XIGXFRQVM4LBT4WI26U6Y7NIWQLIADLFA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836020936 (2h54m26.423077177s) [noise=true , address=104.36.82.52:4093 , piece_id=RPTP7YNMQMENA6LQP4BHOEGSGMZXQNTCYHN3W3ARVDFIUQ7PF32Q, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836374136 (2h54m26.423430386s) [noise=true , address=79.127.220.98:4403 , piece_id=DIDPTCNW2X42QHLKZMYKQCCITBNE5K47NQIJ7WOBLRKAUGAOCZBQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836425150 (2h54m26.423481391s) [noise=true , address=45.91.116.5:4310 , piece_id=P7BV2NU2X4FBTDAS2VO4AFOBZUJRBMD5CTX25Y4AJAJFICZJIMLA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836747071 (2h54m26.423803312s) [noise=true , address=104.36.82.35:4594 , piece_id=RM4XVX3ORSDTVWGOZZN6LD7KJCDJVFYJUDUKP2L2UVSD4LALWIOQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.836806001 (2h54m26.423862243s) [noise=true , address=104.36.82.45:4932 , piece_id=VM6KJQULAZI5ZMRILBEJFCTGMDESH4ERD3AGXE2GPGWOQXYQAYGQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837101683 (2h54m26.424157924s) [noise=true , address=45.91.116.13:4174 , piece_id=K23L54PQGXCD5CKLLGKDPKAF3YFJ6T2YIRTMC4GQYTJOQNWBYAZQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837189627 (2h54m26.424245878s) [noise=true , address=104.36.82.60:4344 , piece_id=PR7ILHVZ3GWDUBUTUKPB2QJ66X3KVLAIMW6DX3YISWKZQANIT34Q, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837459391 (2h54m26.424515632s) [noise=true , address=104.36.82.21:4486 , piece_id=JCG5AW7HVNO7SOEZPPCTVT7PD5VRRUBCFLQBCCFWIAZKFCX4FENA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837625821 (2h54m26.424682072s) [noise=true , address=104.36.82.46:4491 , piece_id=EJEBI7BULQUSMCBCEPYDAUPNUNDFUOLEBSMYKARPB6PSJO7LOOXA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.837840142 (2h54m26.424896383s) [noise=true , address=64.49.13.139:4470 , piece_id=XSK3HH2LTPVVL7IMXRNL5NLIDANPYOJSAKIHWULQV7FJSVRXHP7Q, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.838021710 (2h54m26.425077952s) [noise=true , address=104.36.82.9:4030 , piece_id=W76RQ7UX4QB7IETXOVT4EM25DH7O4LNGAVGLSNQEVZX3XOTMYDOQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.838188782 (2h54m26.425245023s) [noise=true , address=64.49.13.27:4960 , piece_id=2D3W2VLXIEY26BZ6AZDR3SULF7S77LRKYIIGWIXDGOZZIEILVAMQ, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.838798421 (2h54m26.425854661s) [noise=true , address=104.36.82.39:4733 , piece_id=FKTPESZ7QABDL5ELY6KW3CEPS6474GPX7VFWGQPHN2LGDSUR6WVA, seg_pos={0 0}, upload=2998]: Uploading piece... Aug 7 19:21:12.971456729 (2h54m26.55851296s) [upload=2998]: Next returned nil segment Aug 7 19:21:12.971471597 (2h54m26.558527837s) [upload=2998]: Waiting for error group managing segments... Aug 7 19:21:12.984593159 (2h54m26.5716494s) [noise=true , address=45.91.116.8:4074 , piece_id=U3IR34YDPBGPHSREJ6HPBP25U2AHBTR7QG2EQCVXLB2BEQDJ2IUQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.985962215 (2h54m26.573018456s) [noise=true , address=104.36.82.60:4344 , piece_id=PR7ILHVZ3GWDUBUTUKPB2QJ66X3KVLAIMW6DX3YISWKZQANIT34Q, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.990378008 (2h54m26.577434249s) [noise=true , address=104.36.82.9:4030 , piece_id=W76RQ7UX4QB7IETXOVT4EM25DH7O4LNGAVGLSNQEVZX3XOTMYDOQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.995793868 (2h54m26.5828501s) [noise=true , address=104.36.82.39:4733 , piece_id=FKTPESZ7QABDL5ELY6KW3CEPS6474GPX7VFWGQPHN2LGDSUR6WVA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.996448801 (2h54m26.583505042s) [noise=true , address=45.91.116.5:4310 , piece_id=P7BV2NU2X4FBTDAS2VO4AFOBZUJRBMD5CTX25Y4AJAJFICZJIMLA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.997165077 (2h54m26.584221308s) [noise=true , address=45.91.116.13:4174 , piece_id=K23L54PQGXCD5CKLLGKDPKAF3YFJ6T2YIRTMC4GQYTJOQNWBYAZQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.997808920 (2h54m26.584865171s) [noise=true , address=104.36.82.35:4594 , piece_id=RM4XVX3ORSDTVWGOZZN6LD7KJCDJVFYJUDUKP2L2UVSD4LALWIOQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:12.999547955 (2h54m26.586604206s) [noise=true , address=104.36.82.46:4491 , piece_id=EJEBI7BULQUSMCBCEPYDAUPNUNDFUOLEBSMYKARPB6PSJO7LOOXA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.012312983 (2h54m26.599369194s) [noise=true , address=104.36.82.43:4838 , piece_id=CIQYIOOPNBC5JTAQE4YS2PRJ2W73LY2YIAOQLZ2O4HRH6K4AV4VA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.012903997 (2h54m26.599960238s) [noise=true , address=104.36.82.52:4093 , piece_id=RPTP7YNMQMENA6LQP4BHOEGSGMZXQNTCYHN3W3ARVDFIUQ7PF32Q, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.018321450 (2h54m26.605377671s) [noise=true , address=104.36.82.21:4486 , piece_id=JCG5AW7HVNO7SOEZPPCTVT7PD5VRRUBCFLQBCCFWIAZKFCX4FENA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.020563575 (2h54m26.607619816s) [noise=true , address=79.127.220.97:4363 , piece_id=IP2TZHQSJP7ZIFDSCI2XIGXFRQVM4LBT4WI26U6Y7NIWQLIADLFA, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.043146098 (2h54m26.63020232s) [noise=true , address=104.36.82.19:4410 , piece_id=PGCOTNPHPFNLKWADOOIPWJBVC4HV6Z2UO3ZGGDUNYM44CVXMNS5Q, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.046871412 (2h54m26.633927654s) [noise=true , address=104.36.82.45:4932 , piece_id=VM6KJQULAZI5ZMRILBEJFCTGMDESH4ERD3AGXE2GPGWOQXYQAYGQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: <nil> Aug 7 19:21:13.046907620 (2h54m26.63396386s) [seg_pos={0 0}, upload=2998]: Segment reached optimal threshold of 14 pieces. Aug 7 19:21:13.047055916 (2h54m26.634112158s) [noise=true , address=79.127.220.98:4403 , piece_id=DIDPTCNW2X42QHLKZMYKQCCITBNE5K47NQIJ7WOBLRKAUGAOCZBQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q9k1NkgoSntisBrcMfPrumr7q432VZ2FgjEuYXBT8mxeFh1R3): protocol: expected piece hash; context canceled; EOF Aug 7 19:21:13.047189606 (2h54m26.634245827s) [noise=true , address=64.49.13.139:4470 , piece_id=XSK3HH2LTPVVL7IMXRNL5NLIDANPYOJSAKIHWULQV7FJSVRXHP7Q, seg_pos={0 0}, upload=2998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1G4gW4QhXRDsfHcGvFr7qCpB49u9dYQPDXC4CuBZGwQUuFU7Fx): protocol: read tcp 5.161.89.252:53932->64.49.13.139:4470: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:21:13.047204073 (2h54m26.634260315s) [noise=true , address=104.36.82.15:4265 , piece_id=YC7IG46ROBWABU2OPNOOUXWT2656FI54ZQUZZFKTSZQQVQ3CI7HQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NscbwYiKarBdony9TwdccuEKg7f4VXEXerFfWmCiat4RKdXFi): protocol: expected piece hash; context canceled; EOF Aug 7 19:21:13.047277671 (2h54m26.634333892s) [noise=true , address=64.49.13.27:4960 , piece_id=2D3W2VLXIEY26BZ6AZDR3SULF7S77LRKYIIGWIXDGOZZIEILVAMQ, seg_pos={0 0}, upload=2998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: context canceled; context canceled Aug 7 19:21:13.047292819 (2h54m26.63434903s) [seg_pos={0 0}, upload=2998]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:21:13.047366076 (2h54m26.634422297s) [upload=2998]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 19:21:13.047370263 (2h54m26.634426474s) [upload=2998]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 19:21:13.101472814 (2h54m26.688529055s) [upload=2998]: Done uploading segments... Aug 7 19:21:13.101494615 (2h54m26.688550846s) [upload=2998]: Upload finished. err: <nil> Aug 7 19:21:53.105073588 (2h55m6.692129799s) [upload=3005]: Starting upload Aug 7 19:21:53.105114334 (2h55m6.692170545s) [upload=3005]: Done starting upload Aug 7 19:21:53.105186318 (2h55m6.692242539s) [upload=3005]: Uploading segments... Aug 7 19:21:53.105306674 (2h55m6.692362874s) [upload=3005]: Got next segment. Inline: false Aug 7 19:21:53.105336108 (2h55m6.692392319s) [upload=3005]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 19:21:53.105339203 (2h55m6.692395414s) [upload=3005]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 19:21:53.109033360 (2h55m6.696089581s) [upload=3005]: Next segment err: metaclient: Too Many Requests Aug 7 19:21:53.109049810 (2h55m6.696106022s) [upload=3005]: Done uploading segments... Aug 7 19:21:53.109064507 (2h55m6.696120728s) [upload=3005]: Upload finished. err: metaclient: Too Many Requests
Duration: 17.469101ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
989.725609ms
FAIL (2025-08-07 18:08:21 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== [upload=931]: Done uploading segments... Aug 7 17:21:25.105648412 (54m38.692704652s) [upload=931]: Upload finished. err: <nil> Aug 7 17:22:27.954675461 (55m41.541731711s) [upload=948]: Starting upload Aug 7 17:22:27.954748357 (55m41.541804597s) [upload=948]: Done starting upload Aug 7 17:22:27.954864343 (55m41.541920584s) [upload=948]: Uploading segments... Aug 7 17:22:27.955194700 (55m41.542250942s) [upload=948]: Got next segment. Inline: false Aug 7 17:22:27.955258680 (55m41.54231492s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 17:22:27.955266745 (55m41.542322986s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 17:22:28.014425116 (55m41.601481357s) [seg_pos={0 0}, upload=948]: Begin upload segment... Aug 7 17:22:28.014484175 (55m41.601540427s) [seg_pos={0 0}, upload=948]: Done begin upload segment. Aug 7 17:22:28.014514632 (55m41.601570874s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015001421 (55m41.602057663s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015369168 (55m41.602425409s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015726476 (55m41.602782716s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016143414 (55m41.603199654s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016505028 (55m41.60356128s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016855882 (55m41.603912124s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017225353 (55m41.604281593s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017622354 (55m41.604678595s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018005118 (55m41.605061369s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018357466 (55m41.605413707s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018721245 (55m41.605777486s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020116700 (55m41.60717294s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020493123 (55m41.607549363s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020862602 (55m41.607918844s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021233674 (55m41.608289915s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021605499 (55m41.60866174s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021979297 (55m41.609035538s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.143358585 (55m41.730414816s) [upload=948]: Next returned nil segment Aug 7 17:22:28.143372271 (55m41.730428492s) [upload=948]: Waiting for error group managing segments... Aug 7 17:22:28.152820927 (55m41.739877159s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.155768921 (55m41.742825152s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.157580522 (55m41.744636764s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159081795 (55m41.746138036s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159848245 (55m41.746904487s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.160800474 (55m41.747856715s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.163092181 (55m41.750148423s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.165617094 (55m41.752673336s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.167775504 (55m41.754831734s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.169584801 (55m41.756641042s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.172068949 (55m41.75912519s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.177127071 (55m41.764183312s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.181562120 (55m41.768618351s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187711157 (55m41.774767398s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187760881 (55m41.774817122s) [seg_pos={0 0}, upload=948]: Segment reached optimal threshold of 14 pieces. Aug 7 17:22:28.187996010 (55m41.77505225s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188103260 (55m41.775159501s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188190012 (55m41.775246252s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16zQVurJBdPm7NwqGkwFSb54iPePPjZxWaFQeVXabnZGfgWCR6): protocol: read tcp 5.161.89.252:59704->79.127.205.234:4597: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 17:22:28.188279178 (55m41.775335418s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 5.161.89.252:13570->64.49.13.140:4509: use of closed network connection; context canceled Aug 7 17:22:28.188314484 (55m41.775370725s) [seg_pos={0 0}, upload=948]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 17:22:28.188398000 (55m41.775454251s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 17:22:28.188404482 (55m41.775460723s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 17:22:28.308450431 (55m41.895506692s) [upload=948]: Done uploading segments... Aug 7 17:22:28.308469126 (55m41.895525367s) [upload=948]: Upload finished. err: <nil>
Duration: 989.749133ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
927.865427ms
FAIL (2025-08-07 18:07:10 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== [upload=931]: Done uploading segments... Aug 7 17:21:25.105648412 (54m38.692704652s) [upload=931]: Upload finished. err: <nil> Aug 7 17:22:27.954675461 (55m41.541731711s) [upload=948]: Starting upload Aug 7 17:22:27.954748357 (55m41.541804597s) [upload=948]: Done starting upload Aug 7 17:22:27.954864343 (55m41.541920584s) [upload=948]: Uploading segments... Aug 7 17:22:27.955194700 (55m41.542250942s) [upload=948]: Got next segment. Inline: false Aug 7 17:22:27.955258680 (55m41.54231492s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 17:22:27.955266745 (55m41.542322986s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 17:22:28.014425116 (55m41.601481357s) [seg_pos={0 0}, upload=948]: Begin upload segment... Aug 7 17:22:28.014484175 (55m41.601540427s) [seg_pos={0 0}, upload=948]: Done begin upload segment. Aug 7 17:22:28.014514632 (55m41.601570874s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015001421 (55m41.602057663s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015369168 (55m41.602425409s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015726476 (55m41.602782716s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016143414 (55m41.603199654s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016505028 (55m41.60356128s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016855882 (55m41.603912124s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017225353 (55m41.604281593s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017622354 (55m41.604678595s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018005118 (55m41.605061369s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018357466 (55m41.605413707s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018721245 (55m41.605777486s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020116700 (55m41.60717294s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020493123 (55m41.607549363s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020862602 (55m41.607918844s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021233674 (55m41.608289915s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021605499 (55m41.60866174s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021979297 (55m41.609035538s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.143358585 (55m41.730414816s) [upload=948]: Next returned nil segment Aug 7 17:22:28.143372271 (55m41.730428492s) [upload=948]: Waiting for error group managing segments... Aug 7 17:22:28.152820927 (55m41.739877159s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.155768921 (55m41.742825152s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.157580522 (55m41.744636764s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159081795 (55m41.746138036s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159848245 (55m41.746904487s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.160800474 (55m41.747856715s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.163092181 (55m41.750148423s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.165617094 (55m41.752673336s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.167775504 (55m41.754831734s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.169584801 (55m41.756641042s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.172068949 (55m41.75912519s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.177127071 (55m41.764183312s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.181562120 (55m41.768618351s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187711157 (55m41.774767398s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187760881 (55m41.774817122s) [seg_pos={0 0}, upload=948]: Segment reached optimal threshold of 14 pieces. Aug 7 17:22:28.187996010 (55m41.77505225s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188103260 (55m41.775159501s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188190012 (55m41.775246252s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16zQVurJBdPm7NwqGkwFSb54iPePPjZxWaFQeVXabnZGfgWCR6): protocol: read tcp 5.161.89.252:59704->79.127.205.234:4597: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 17:22:28.188279178 (55m41.775335418s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 5.161.89.252:13570->64.49.13.140:4509: use of closed network connection; context canceled Aug 7 17:22:28.188314484 (55m41.775370725s) [seg_pos={0 0}, upload=948]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 17:22:28.188398000 (55m41.775454251s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 17:22:28.188404482 (55m41.775460723s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 17:22:28.308450431 (55m41.895506692s) [upload=948]: Done uploading segments... Aug 7 17:22:28.308469126 (55m41.895525367s) [upload=948]: Upload finished. err: <nil>
Duration: 927.887528ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
486.204047ms
FAIL (2025-08-07 18:05:56 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== [upload=931]: Done uploading segments... Aug 7 17:21:25.105648412 (54m38.692704652s) [upload=931]: Upload finished. err: <nil> Aug 7 17:22:27.954675461 (55m41.541731711s) [upload=948]: Starting upload Aug 7 17:22:27.954748357 (55m41.541804597s) [upload=948]: Done starting upload Aug 7 17:22:27.954864343 (55m41.541920584s) [upload=948]: Uploading segments... Aug 7 17:22:27.955194700 (55m41.542250942s) [upload=948]: Got next segment. Inline: false Aug 7 17:22:27.955258680 (55m41.54231492s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 17:22:27.955266745 (55m41.542322986s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 17:22:28.014425116 (55m41.601481357s) [seg_pos={0 0}, upload=948]: Begin upload segment... Aug 7 17:22:28.014484175 (55m41.601540427s) [seg_pos={0 0}, upload=948]: Done begin upload segment. Aug 7 17:22:28.014514632 (55m41.601570874s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015001421 (55m41.602057663s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015369168 (55m41.602425409s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015726476 (55m41.602782716s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016143414 (55m41.603199654s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016505028 (55m41.60356128s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016855882 (55m41.603912124s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017225353 (55m41.604281593s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017622354 (55m41.604678595s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018005118 (55m41.605061369s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018357466 (55m41.605413707s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018721245 (55m41.605777486s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020116700 (55m41.60717294s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020493123 (55m41.607549363s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020862602 (55m41.607918844s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021233674 (55m41.608289915s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021605499 (55m41.60866174s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021979297 (55m41.609035538s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.143358585 (55m41.730414816s) [upload=948]: Next returned nil segment Aug 7 17:22:28.143372271 (55m41.730428492s) [upload=948]: Waiting for error group managing segments... Aug 7 17:22:28.152820927 (55m41.739877159s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.155768921 (55m41.742825152s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.157580522 (55m41.744636764s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159081795 (55m41.746138036s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159848245 (55m41.746904487s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.160800474 (55m41.747856715s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.163092181 (55m41.750148423s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.165617094 (55m41.752673336s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.167775504 (55m41.754831734s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.169584801 (55m41.756641042s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.172068949 (55m41.75912519s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.177127071 (55m41.764183312s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.181562120 (55m41.768618351s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187711157 (55m41.774767398s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187760881 (55m41.774817122s) [seg_pos={0 0}, upload=948]: Segment reached optimal threshold of 14 pieces. Aug 7 17:22:28.187996010 (55m41.77505225s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188103260 (55m41.775159501s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188190012 (55m41.775246252s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16zQVurJBdPm7NwqGkwFSb54iPePPjZxWaFQeVXabnZGfgWCR6): protocol: read tcp 5.161.89.252:59704->79.127.205.234:4597: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 17:22:28.188279178 (55m41.775335418s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 5.161.89.252:13570->64.49.13.140:4509: use of closed network connection; context canceled Aug 7 17:22:28.188314484 (55m41.775370725s) [seg_pos={0 0}, upload=948]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 17:22:28.188398000 (55m41.775454251s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 17:22:28.188404482 (55m41.775460723s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 17:22:28.308450431 (55m41.895506692s) [upload=948]: Done uploading segments... Aug 7 17:22:28.308469126 (55m41.895525367s) [upload=948]: Upload finished. err: <nil>
Duration: 486.261856ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
570.268366ms
FAIL (2025-08-07 18:05:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== [upload=931]: Done uploading segments... Aug 7 17:21:25.105648412 (54m38.692704652s) [upload=931]: Upload finished. err: <nil> Aug 7 17:22:27.954675461 (55m41.541731711s) [upload=948]: Starting upload Aug 7 17:22:27.954748357 (55m41.541804597s) [upload=948]: Done starting upload Aug 7 17:22:27.954864343 (55m41.541920584s) [upload=948]: Uploading segments... Aug 7 17:22:27.955194700 (55m41.542250942s) [upload=948]: Got next segment. Inline: false Aug 7 17:22:27.955258680 (55m41.54231492s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 17:22:27.955266745 (55m41.542322986s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 17:22:28.014425116 (55m41.601481357s) [seg_pos={0 0}, upload=948]: Begin upload segment... Aug 7 17:22:28.014484175 (55m41.601540427s) [seg_pos={0 0}, upload=948]: Done begin upload segment. Aug 7 17:22:28.014514632 (55m41.601570874s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015001421 (55m41.602057663s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015369168 (55m41.602425409s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015726476 (55m41.602782716s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016143414 (55m41.603199654s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016505028 (55m41.60356128s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016855882 (55m41.603912124s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017225353 (55m41.604281593s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017622354 (55m41.604678595s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018005118 (55m41.605061369s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018357466 (55m41.605413707s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018721245 (55m41.605777486s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020116700 (55m41.60717294s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020493123 (55m41.607549363s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020862602 (55m41.607918844s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021233674 (55m41.608289915s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021605499 (55m41.60866174s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021979297 (55m41.609035538s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.143358585 (55m41.730414816s) [upload=948]: Next returned nil segment Aug 7 17:22:28.143372271 (55m41.730428492s) [upload=948]: Waiting for error group managing segments... Aug 7 17:22:28.152820927 (55m41.739877159s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.155768921 (55m41.742825152s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.157580522 (55m41.744636764s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159081795 (55m41.746138036s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159848245 (55m41.746904487s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.160800474 (55m41.747856715s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.163092181 (55m41.750148423s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.165617094 (55m41.752673336s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.167775504 (55m41.754831734s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.169584801 (55m41.756641042s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.172068949 (55m41.75912519s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.177127071 (55m41.764183312s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.181562120 (55m41.768618351s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187711157 (55m41.774767398s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187760881 (55m41.774817122s) [seg_pos={0 0}, upload=948]: Segment reached optimal threshold of 14 pieces. Aug 7 17:22:28.187996010 (55m41.77505225s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188103260 (55m41.775159501s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188190012 (55m41.775246252s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16zQVurJBdPm7NwqGkwFSb54iPePPjZxWaFQeVXabnZGfgWCR6): protocol: read tcp 5.161.89.252:59704->79.127.205.234:4597: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 17:22:28.188279178 (55m41.775335418s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 5.161.89.252:13570->64.49.13.140:4509: use of closed network connection; context canceled Aug 7 17:22:28.188314484 (55m41.775370725s) [seg_pos={0 0}, upload=948]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 17:22:28.188398000 (55m41.775454251s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 17:22:28.188404482 (55m41.775460723s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 17:22:28.308450431 (55m41.895506692s) [upload=948]: Done uploading segments... Aug 7 17:22:28.308469126 (55m41.895525367s) [upload=948]: Upload finished. err: <nil>
Duration: 570.290255ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
520.383809ms
FAIL (2025-08-07 18:04:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== [upload=931]: Done uploading segments... Aug 7 17:21:25.105648412 (54m38.692704652s) [upload=931]: Upload finished. err: <nil> Aug 7 17:22:27.954675461 (55m41.541731711s) [upload=948]: Starting upload Aug 7 17:22:27.954748357 (55m41.541804597s) [upload=948]: Done starting upload Aug 7 17:22:27.954864343 (55m41.541920584s) [upload=948]: Uploading segments... Aug 7 17:22:27.955194700 (55m41.542250942s) [upload=948]: Got next segment. Inline: false Aug 7 17:22:27.955258680 (55m41.54231492s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 17:22:27.955266745 (55m41.542322986s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 17:22:28.014425116 (55m41.601481357s) [seg_pos={0 0}, upload=948]: Begin upload segment... Aug 7 17:22:28.014484175 (55m41.601540427s) [seg_pos={0 0}, upload=948]: Done begin upload segment. Aug 7 17:22:28.014514632 (55m41.601570874s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015001421 (55m41.602057663s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015369168 (55m41.602425409s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015726476 (55m41.602782716s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016143414 (55m41.603199654s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016505028 (55m41.60356128s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016855882 (55m41.603912124s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017225353 (55m41.604281593s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017622354 (55m41.604678595s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018005118 (55m41.605061369s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018357466 (55m41.605413707s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018721245 (55m41.605777486s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020116700 (55m41.60717294s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020493123 (55m41.607549363s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020862602 (55m41.607918844s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021233674 (55m41.608289915s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021605499 (55m41.60866174s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021979297 (55m41.609035538s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.143358585 (55m41.730414816s) [upload=948]: Next returned nil segment Aug 7 17:22:28.143372271 (55m41.730428492s) [upload=948]: Waiting for error group managing segments... Aug 7 17:22:28.152820927 (55m41.739877159s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.155768921 (55m41.742825152s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.157580522 (55m41.744636764s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159081795 (55m41.746138036s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159848245 (55m41.746904487s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.160800474 (55m41.747856715s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.163092181 (55m41.750148423s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.165617094 (55m41.752673336s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.167775504 (55m41.754831734s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.169584801 (55m41.756641042s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.172068949 (55m41.75912519s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.177127071 (55m41.764183312s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.181562120 (55m41.768618351s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187711157 (55m41.774767398s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187760881 (55m41.774817122s) [seg_pos={0 0}, upload=948]: Segment reached optimal threshold of 14 pieces. Aug 7 17:22:28.187996010 (55m41.77505225s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188103260 (55m41.775159501s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188190012 (55m41.775246252s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16zQVurJBdPm7NwqGkwFSb54iPePPjZxWaFQeVXabnZGfgWCR6): protocol: read tcp 5.161.89.252:59704->79.127.205.234:4597: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 17:22:28.188279178 (55m41.775335418s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 5.161.89.252:13570->64.49.13.140:4509: use of closed network connection; context canceled Aug 7 17:22:28.188314484 (55m41.775370725s) [seg_pos={0 0}, upload=948]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 17:22:28.188398000 (55m41.775454251s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 17:22:28.188404482 (55m41.775460723s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 17:22:28.308450431 (55m41.895506692s) [upload=948]: Done uploading segments... Aug 7 17:22:28.308469126 (55m41.895525367s) [upload=948]: Upload finished. err: <nil>
Duration: 520.410188ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
645.411087ms
FAIL (2025-08-07 18:03:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== [upload=931]: Done uploading segments... Aug 7 17:21:25.105648412 (54m38.692704652s) [upload=931]: Upload finished. err: <nil> Aug 7 17:22:27.954675461 (55m41.541731711s) [upload=948]: Starting upload Aug 7 17:22:27.954748357 (55m41.541804597s) [upload=948]: Done starting upload Aug 7 17:22:27.954864343 (55m41.541920584s) [upload=948]: Uploading segments... Aug 7 17:22:27.955194700 (55m41.542250942s) [upload=948]: Got next segment. Inline: false Aug 7 17:22:27.955258680 (55m41.54231492s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 17:22:27.955266745 (55m41.542322986s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 17:22:28.014425116 (55m41.601481357s) [seg_pos={0 0}, upload=948]: Begin upload segment... Aug 7 17:22:28.014484175 (55m41.601540427s) [seg_pos={0 0}, upload=948]: Done begin upload segment. Aug 7 17:22:28.014514632 (55m41.601570874s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015001421 (55m41.602057663s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015369168 (55m41.602425409s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015726476 (55m41.602782716s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016143414 (55m41.603199654s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016505028 (55m41.60356128s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016855882 (55m41.603912124s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017225353 (55m41.604281593s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017622354 (55m41.604678595s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018005118 (55m41.605061369s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018357466 (55m41.605413707s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018721245 (55m41.605777486s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020116700 (55m41.60717294s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020493123 (55m41.607549363s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020862602 (55m41.607918844s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021233674 (55m41.608289915s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021605499 (55m41.60866174s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021979297 (55m41.609035538s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.143358585 (55m41.730414816s) [upload=948]: Next returned nil segment Aug 7 17:22:28.143372271 (55m41.730428492s) [upload=948]: Waiting for error group managing segments... Aug 7 17:22:28.152820927 (55m41.739877159s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.155768921 (55m41.742825152s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.157580522 (55m41.744636764s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159081795 (55m41.746138036s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159848245 (55m41.746904487s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.160800474 (55m41.747856715s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.163092181 (55m41.750148423s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.165617094 (55m41.752673336s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.167775504 (55m41.754831734s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.169584801 (55m41.756641042s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.172068949 (55m41.75912519s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.177127071 (55m41.764183312s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.181562120 (55m41.768618351s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187711157 (55m41.774767398s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187760881 (55m41.774817122s) [seg_pos={0 0}, upload=948]: Segment reached optimal threshold of 14 pieces. Aug 7 17:22:28.187996010 (55m41.77505225s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188103260 (55m41.775159501s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188190012 (55m41.775246252s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16zQVurJBdPm7NwqGkwFSb54iPePPjZxWaFQeVXabnZGfgWCR6): protocol: read tcp 5.161.89.252:59704->79.127.205.234:4597: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 17:22:28.188279178 (55m41.775335418s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 5.161.89.252:13570->64.49.13.140:4509: use of closed network connection; context canceled Aug 7 17:22:28.188314484 (55m41.775370725s) [seg_pos={0 0}, upload=948]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 17:22:28.188398000 (55m41.775454251s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 17:22:28.188404482 (55m41.775460723s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 17:22:28.308450431 (55m41.895506692s) [upload=948]: Done uploading segments... Aug 7 17:22:28.308469126 (55m41.895525367s) [upload=948]: Upload finished. err: <nil>
Duration: 645.437286ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
2.187963725s
FAIL (2025-08-07 18:03:06 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== [upload=931]: Done uploading segments... Aug 7 17:21:25.105648412 (54m38.692704652s) [upload=931]: Upload finished. err: <nil> Aug 7 17:22:27.954675461 (55m41.541731711s) [upload=948]: Starting upload Aug 7 17:22:27.954748357 (55m41.541804597s) [upload=948]: Done starting upload Aug 7 17:22:27.954864343 (55m41.541920584s) [upload=948]: Uploading segments... Aug 7 17:22:27.955194700 (55m41.542250942s) [upload=948]: Got next segment. Inline: false Aug 7 17:22:27.955258680 (55m41.54231492s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 17:22:27.955266745 (55m41.542322986s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 17:22:28.014425116 (55m41.601481357s) [seg_pos={0 0}, upload=948]: Begin upload segment... Aug 7 17:22:28.014484175 (55m41.601540427s) [seg_pos={0 0}, upload=948]: Done begin upload segment. Aug 7 17:22:28.014514632 (55m41.601570874s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015001421 (55m41.602057663s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015369168 (55m41.602425409s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015726476 (55m41.602782716s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016143414 (55m41.603199654s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016505028 (55m41.60356128s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016855882 (55m41.603912124s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017225353 (55m41.604281593s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017622354 (55m41.604678595s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018005118 (55m41.605061369s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018357466 (55m41.605413707s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018721245 (55m41.605777486s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020116700 (55m41.60717294s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020493123 (55m41.607549363s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020862602 (55m41.607918844s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021233674 (55m41.608289915s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021605499 (55m41.60866174s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021979297 (55m41.609035538s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.143358585 (55m41.730414816s) [upload=948]: Next returned nil segment Aug 7 17:22:28.143372271 (55m41.730428492s) [upload=948]: Waiting for error group managing segments... Aug 7 17:22:28.152820927 (55m41.739877159s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.155768921 (55m41.742825152s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.157580522 (55m41.744636764s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159081795 (55m41.746138036s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159848245 (55m41.746904487s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.160800474 (55m41.747856715s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.163092181 (55m41.750148423s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.165617094 (55m41.752673336s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.167775504 (55m41.754831734s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.169584801 (55m41.756641042s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.172068949 (55m41.75912519s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.177127071 (55m41.764183312s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.181562120 (55m41.768618351s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187711157 (55m41.774767398s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187760881 (55m41.774817122s) [seg_pos={0 0}, upload=948]: Segment reached optimal threshold of 14 pieces. Aug 7 17:22:28.187996010 (55m41.77505225s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188103260 (55m41.775159501s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188190012 (55m41.775246252s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16zQVurJBdPm7NwqGkwFSb54iPePPjZxWaFQeVXabnZGfgWCR6): protocol: read tcp 5.161.89.252:59704->79.127.205.234:4597: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 17:22:28.188279178 (55m41.775335418s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 5.161.89.252:13570->64.49.13.140:4509: use of closed network connection; context canceled Aug 7 17:22:28.188314484 (55m41.775370725s) [seg_pos={0 0}, upload=948]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 17:22:28.188398000 (55m41.775454251s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 17:22:28.188404482 (55m41.775460723s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 17:22:28.308450431 (55m41.895506692s) [upload=948]: Done uploading segments... Aug 7 17:22:28.308469126 (55m41.895525367s) [upload=948]: Upload finished. err: <nil>
Duration: 2.187984082s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
390.485633ms
FAIL (2025-08-07 18:02:13 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== [upload=931]: Done uploading segments... Aug 7 17:21:25.105648412 (54m38.692704652s) [upload=931]: Upload finished. err: <nil> Aug 7 17:22:27.954675461 (55m41.541731711s) [upload=948]: Starting upload Aug 7 17:22:27.954748357 (55m41.541804597s) [upload=948]: Done starting upload Aug 7 17:22:27.954864343 (55m41.541920584s) [upload=948]: Uploading segments... Aug 7 17:22:27.955194700 (55m41.542250942s) [upload=948]: Got next segment. Inline: false Aug 7 17:22:27.955258680 (55m41.54231492s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 17:22:27.955266745 (55m41.542322986s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 17:22:28.014425116 (55m41.601481357s) [seg_pos={0 0}, upload=948]: Begin upload segment... Aug 7 17:22:28.014484175 (55m41.601540427s) [seg_pos={0 0}, upload=948]: Done begin upload segment. Aug 7 17:22:28.014514632 (55m41.601570874s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015001421 (55m41.602057663s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015369168 (55m41.602425409s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015726476 (55m41.602782716s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016143414 (55m41.603199654s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016505028 (55m41.60356128s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016855882 (55m41.603912124s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017225353 (55m41.604281593s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017622354 (55m41.604678595s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018005118 (55m41.605061369s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018357466 (55m41.605413707s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018721245 (55m41.605777486s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020116700 (55m41.60717294s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020493123 (55m41.607549363s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020862602 (55m41.607918844s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021233674 (55m41.608289915s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021605499 (55m41.60866174s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021979297 (55m41.609035538s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.143358585 (55m41.730414816s) [upload=948]: Next returned nil segment Aug 7 17:22:28.143372271 (55m41.730428492s) [upload=948]: Waiting for error group managing segments... Aug 7 17:22:28.152820927 (55m41.739877159s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.155768921 (55m41.742825152s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.157580522 (55m41.744636764s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159081795 (55m41.746138036s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159848245 (55m41.746904487s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.160800474 (55m41.747856715s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.163092181 (55m41.750148423s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.165617094 (55m41.752673336s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.167775504 (55m41.754831734s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.169584801 (55m41.756641042s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.172068949 (55m41.75912519s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.177127071 (55m41.764183312s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.181562120 (55m41.768618351s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187711157 (55m41.774767398s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187760881 (55m41.774817122s) [seg_pos={0 0}, upload=948]: Segment reached optimal threshold of 14 pieces. Aug 7 17:22:28.187996010 (55m41.77505225s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188103260 (55m41.775159501s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188190012 (55m41.775246252s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16zQVurJBdPm7NwqGkwFSb54iPePPjZxWaFQeVXabnZGfgWCR6): protocol: read tcp 5.161.89.252:59704->79.127.205.234:4597: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 17:22:28.188279178 (55m41.775335418s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 5.161.89.252:13570->64.49.13.140:4509: use of closed network connection; context canceled Aug 7 17:22:28.188314484 (55m41.775370725s) [seg_pos={0 0}, upload=948]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 17:22:28.188398000 (55m41.775454251s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 17:22:28.188404482 (55m41.775460723s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 17:22:28.308450431 (55m41.895506692s) [upload=948]: Done uploading segments... Aug 7 17:22:28.308469126 (55m41.895525367s) [upload=948]: Upload finished. err: <nil>
Duration: 390.505801ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
1.02101072s
FAIL (2025-08-07 18:01:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== [upload=931]: Done uploading segments... Aug 7 17:21:25.105648412 (54m38.692704652s) [upload=931]: Upload finished. err: <nil> Aug 7 17:22:27.954675461 (55m41.541731711s) [upload=948]: Starting upload Aug 7 17:22:27.954748357 (55m41.541804597s) [upload=948]: Done starting upload Aug 7 17:22:27.954864343 (55m41.541920584s) [upload=948]: Uploading segments... Aug 7 17:22:27.955194700 (55m41.542250942s) [upload=948]: Got next segment. Inline: false Aug 7 17:22:27.955258680 (55m41.54231492s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 17:22:27.955266745 (55m41.542322986s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 17:22:28.014425116 (55m41.601481357s) [seg_pos={0 0}, upload=948]: Begin upload segment... Aug 7 17:22:28.014484175 (55m41.601540427s) [seg_pos={0 0}, upload=948]: Done begin upload segment. Aug 7 17:22:28.014514632 (55m41.601570874s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015001421 (55m41.602057663s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015369168 (55m41.602425409s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015726476 (55m41.602782716s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016143414 (55m41.603199654s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016505028 (55m41.60356128s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016855882 (55m41.603912124s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017225353 (55m41.604281593s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017622354 (55m41.604678595s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018005118 (55m41.605061369s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018357466 (55m41.605413707s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018721245 (55m41.605777486s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020116700 (55m41.60717294s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020493123 (55m41.607549363s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020862602 (55m41.607918844s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021233674 (55m41.608289915s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021605499 (55m41.60866174s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021979297 (55m41.609035538s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.143358585 (55m41.730414816s) [upload=948]: Next returned nil segment Aug 7 17:22:28.143372271 (55m41.730428492s) [upload=948]: Waiting for error group managing segments... Aug 7 17:22:28.152820927 (55m41.739877159s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.155768921 (55m41.742825152s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.157580522 (55m41.744636764s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159081795 (55m41.746138036s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159848245 (55m41.746904487s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.160800474 (55m41.747856715s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.163092181 (55m41.750148423s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.165617094 (55m41.752673336s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.167775504 (55m41.754831734s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.169584801 (55m41.756641042s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.172068949 (55m41.75912519s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.177127071 (55m41.764183312s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.181562120 (55m41.768618351s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187711157 (55m41.774767398s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187760881 (55m41.774817122s) [seg_pos={0 0}, upload=948]: Segment reached optimal threshold of 14 pieces. Aug 7 17:22:28.187996010 (55m41.77505225s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188103260 (55m41.775159501s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188190012 (55m41.775246252s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16zQVurJBdPm7NwqGkwFSb54iPePPjZxWaFQeVXabnZGfgWCR6): protocol: read tcp 5.161.89.252:59704->79.127.205.234:4597: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 17:22:28.188279178 (55m41.775335418s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 5.161.89.252:13570->64.49.13.140:4509: use of closed network connection; context canceled Aug 7 17:22:28.188314484 (55m41.775370725s) [seg_pos={0 0}, upload=948]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 17:22:28.188398000 (55m41.775454251s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 17:22:28.188404482 (55m41.775460723s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 17:22:28.308450431 (55m41.895506692s) [upload=948]: Done uploading segments... Aug 7 17:22:28.308469126 (55m41.895525367s) [upload=948]: Upload finished. err: <nil>
Duration: 1.021035196s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
661.151155ms
FAIL (2025-08-07 18:00:50 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== [upload=931]: Done uploading segments... Aug 7 17:21:25.105648412 (54m38.692704652s) [upload=931]: Upload finished. err: <nil> Aug 7 17:22:27.954675461 (55m41.541731711s) [upload=948]: Starting upload Aug 7 17:22:27.954748357 (55m41.541804597s) [upload=948]: Done starting upload Aug 7 17:22:27.954864343 (55m41.541920584s) [upload=948]: Uploading segments... Aug 7 17:22:27.955194700 (55m41.542250942s) [upload=948]: Got next segment. Inline: false Aug 7 17:22:27.955258680 (55m41.54231492s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 17:22:27.955266745 (55m41.542322986s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 17:22:28.014425116 (55m41.601481357s) [seg_pos={0 0}, upload=948]: Begin upload segment... Aug 7 17:22:28.014484175 (55m41.601540427s) [seg_pos={0 0}, upload=948]: Done begin upload segment. Aug 7 17:22:28.014514632 (55m41.601570874s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015001421 (55m41.602057663s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015369168 (55m41.602425409s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015726476 (55m41.602782716s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016143414 (55m41.603199654s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016505028 (55m41.60356128s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016855882 (55m41.603912124s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017225353 (55m41.604281593s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017622354 (55m41.604678595s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018005118 (55m41.605061369s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018357466 (55m41.605413707s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018721245 (55m41.605777486s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020116700 (55m41.60717294s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020493123 (55m41.607549363s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020862602 (55m41.607918844s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021233674 (55m41.608289915s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021605499 (55m41.60866174s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021979297 (55m41.609035538s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.143358585 (55m41.730414816s) [upload=948]: Next returned nil segment Aug 7 17:22:28.143372271 (55m41.730428492s) [upload=948]: Waiting for error group managing segments... Aug 7 17:22:28.152820927 (55m41.739877159s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.155768921 (55m41.742825152s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.157580522 (55m41.744636764s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159081795 (55m41.746138036s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159848245 (55m41.746904487s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.160800474 (55m41.747856715s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.163092181 (55m41.750148423s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.165617094 (55m41.752673336s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.167775504 (55m41.754831734s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.169584801 (55m41.756641042s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.172068949 (55m41.75912519s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.177127071 (55m41.764183312s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.181562120 (55m41.768618351s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187711157 (55m41.774767398s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187760881 (55m41.774817122s) [seg_pos={0 0}, upload=948]: Segment reached optimal threshold of 14 pieces. Aug 7 17:22:28.187996010 (55m41.77505225s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188103260 (55m41.775159501s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188190012 (55m41.775246252s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16zQVurJBdPm7NwqGkwFSb54iPePPjZxWaFQeVXabnZGfgWCR6): protocol: read tcp 5.161.89.252:59704->79.127.205.234:4597: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 17:22:28.188279178 (55m41.775335418s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 5.161.89.252:13570->64.49.13.140:4509: use of closed network connection; context canceled Aug 7 17:22:28.188314484 (55m41.775370725s) [seg_pos={0 0}, upload=948]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 17:22:28.188398000 (55m41.775454251s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 17:22:28.188404482 (55m41.775460723s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 17:22:28.308450431 (55m41.895506692s) [upload=948]: Done uploading segments... Aug 7 17:22:28.308469126 (55m41.895525367s) [upload=948]: Upload finished. err: <nil>
Duration: 661.177214ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
548.983505ms
FAIL (2025-08-07 18:00:03 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== [upload=931]: Done uploading segments... Aug 7 17:21:25.105648412 (54m38.692704652s) [upload=931]: Upload finished. err: <nil> Aug 7 17:22:27.954675461 (55m41.541731711s) [upload=948]: Starting upload Aug 7 17:22:27.954748357 (55m41.541804597s) [upload=948]: Done starting upload Aug 7 17:22:27.954864343 (55m41.541920584s) [upload=948]: Uploading segments... Aug 7 17:22:27.955194700 (55m41.542250942s) [upload=948]: Got next segment. Inline: false Aug 7 17:22:27.955258680 (55m41.54231492s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 17:22:27.955266745 (55m41.542322986s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 17:22:28.014425116 (55m41.601481357s) [seg_pos={0 0}, upload=948]: Begin upload segment... Aug 7 17:22:28.014484175 (55m41.601540427s) [seg_pos={0 0}, upload=948]: Done begin upload segment. Aug 7 17:22:28.014514632 (55m41.601570874s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015001421 (55m41.602057663s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015369168 (55m41.602425409s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015726476 (55m41.602782716s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016143414 (55m41.603199654s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016505028 (55m41.60356128s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016855882 (55m41.603912124s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017225353 (55m41.604281593s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017622354 (55m41.604678595s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018005118 (55m41.605061369s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018357466 (55m41.605413707s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018721245 (55m41.605777486s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020116700 (55m41.60717294s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020493123 (55m41.607549363s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020862602 (55m41.607918844s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021233674 (55m41.608289915s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021605499 (55m41.60866174s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021979297 (55m41.609035538s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.143358585 (55m41.730414816s) [upload=948]: Next returned nil segment Aug 7 17:22:28.143372271 (55m41.730428492s) [upload=948]: Waiting for error group managing segments... Aug 7 17:22:28.152820927 (55m41.739877159s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.155768921 (55m41.742825152s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.157580522 (55m41.744636764s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159081795 (55m41.746138036s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159848245 (55m41.746904487s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.160800474 (55m41.747856715s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.163092181 (55m41.750148423s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.165617094 (55m41.752673336s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.167775504 (55m41.754831734s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.169584801 (55m41.756641042s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.172068949 (55m41.75912519s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.177127071 (55m41.764183312s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.181562120 (55m41.768618351s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187711157 (55m41.774767398s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187760881 (55m41.774817122s) [seg_pos={0 0}, upload=948]: Segment reached optimal threshold of 14 pieces. Aug 7 17:22:28.187996010 (55m41.77505225s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188103260 (55m41.775159501s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188190012 (55m41.775246252s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16zQVurJBdPm7NwqGkwFSb54iPePPjZxWaFQeVXabnZGfgWCR6): protocol: read tcp 5.161.89.252:59704->79.127.205.234:4597: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 17:22:28.188279178 (55m41.775335418s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 5.161.89.252:13570->64.49.13.140:4509: use of closed network connection; context canceled Aug 7 17:22:28.188314484 (55m41.775370725s) [seg_pos={0 0}, upload=948]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 17:22:28.188398000 (55m41.775454251s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 17:22:28.188404482 (55m41.775460723s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 17:22:28.308450431 (55m41.895506692s) [upload=948]: Done uploading segments... Aug 7 17:22:28.308469126 (55m41.895525367s) [upload=948]: Upload finished. err: <nil>
Duration: 549.010716ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
454.562173ms
FAIL (2025-08-07 17:59:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== [upload=931]: Done uploading segments... Aug 7 17:21:25.105648412 (54m38.692704652s) [upload=931]: Upload finished. err: <nil> Aug 7 17:22:27.954675461 (55m41.541731711s) [upload=948]: Starting upload Aug 7 17:22:27.954748357 (55m41.541804597s) [upload=948]: Done starting upload Aug 7 17:22:27.954864343 (55m41.541920584s) [upload=948]: Uploading segments... Aug 7 17:22:27.955194700 (55m41.542250942s) [upload=948]: Got next segment. Inline: false Aug 7 17:22:27.955258680 (55m41.54231492s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 17:22:27.955266745 (55m41.542322986s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 17:22:28.014425116 (55m41.601481357s) [seg_pos={0 0}, upload=948]: Begin upload segment... Aug 7 17:22:28.014484175 (55m41.601540427s) [seg_pos={0 0}, upload=948]: Done begin upload segment. Aug 7 17:22:28.014514632 (55m41.601570874s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015001421 (55m41.602057663s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015369168 (55m41.602425409s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015726476 (55m41.602782716s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016143414 (55m41.603199654s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016505028 (55m41.60356128s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016855882 (55m41.603912124s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017225353 (55m41.604281593s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017622354 (55m41.604678595s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018005118 (55m41.605061369s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018357466 (55m41.605413707s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018721245 (55m41.605777486s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020116700 (55m41.60717294s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020493123 (55m41.607549363s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020862602 (55m41.607918844s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021233674 (55m41.608289915s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021605499 (55m41.60866174s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021979297 (55m41.609035538s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.143358585 (55m41.730414816s) [upload=948]: Next returned nil segment Aug 7 17:22:28.143372271 (55m41.730428492s) [upload=948]: Waiting for error group managing segments... Aug 7 17:22:28.152820927 (55m41.739877159s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.155768921 (55m41.742825152s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.157580522 (55m41.744636764s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159081795 (55m41.746138036s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159848245 (55m41.746904487s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.160800474 (55m41.747856715s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.163092181 (55m41.750148423s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.165617094 (55m41.752673336s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.167775504 (55m41.754831734s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.169584801 (55m41.756641042s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.172068949 (55m41.75912519s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.177127071 (55m41.764183312s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.181562120 (55m41.768618351s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187711157 (55m41.774767398s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187760881 (55m41.774817122s) [seg_pos={0 0}, upload=948]: Segment reached optimal threshold of 14 pieces. Aug 7 17:22:28.187996010 (55m41.77505225s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188103260 (55m41.775159501s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188190012 (55m41.775246252s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16zQVurJBdPm7NwqGkwFSb54iPePPjZxWaFQeVXabnZGfgWCR6): protocol: read tcp 5.161.89.252:59704->79.127.205.234:4597: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 17:22:28.188279178 (55m41.775335418s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 5.161.89.252:13570->64.49.13.140:4509: use of closed network connection; context canceled Aug 7 17:22:28.188314484 (55m41.775370725s) [seg_pos={0 0}, upload=948]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 17:22:28.188398000 (55m41.775454251s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 17:22:28.188404482 (55m41.775460723s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 17:22:28.308450431 (55m41.895506692s) [upload=948]: Done uploading segments... Aug 7 17:22:28.308469126 (55m41.895525367s) [upload=948]: Upload finished. err: <nil>
Duration: 454.595095ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
484.084188ms
FAIL (2025-08-07 17:58:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== [upload=931]: Done uploading segments... Aug 7 17:21:25.105648412 (54m38.692704652s) [upload=931]: Upload finished. err: <nil> Aug 7 17:22:27.954675461 (55m41.541731711s) [upload=948]: Starting upload Aug 7 17:22:27.954748357 (55m41.541804597s) [upload=948]: Done starting upload Aug 7 17:22:27.954864343 (55m41.541920584s) [upload=948]: Uploading segments... Aug 7 17:22:27.955194700 (55m41.542250942s) [upload=948]: Got next segment. Inline: false Aug 7 17:22:27.955258680 (55m41.54231492s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 17:22:27.955266745 (55m41.542322986s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 17:22:28.014425116 (55m41.601481357s) [seg_pos={0 0}, upload=948]: Begin upload segment... Aug 7 17:22:28.014484175 (55m41.601540427s) [seg_pos={0 0}, upload=948]: Done begin upload segment. Aug 7 17:22:28.014514632 (55m41.601570874s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015001421 (55m41.602057663s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015369168 (55m41.602425409s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015726476 (55m41.602782716s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016143414 (55m41.603199654s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016505028 (55m41.60356128s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016855882 (55m41.603912124s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017225353 (55m41.604281593s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017622354 (55m41.604678595s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018005118 (55m41.605061369s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018357466 (55m41.605413707s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018721245 (55m41.605777486s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020116700 (55m41.60717294s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020493123 (55m41.607549363s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020862602 (55m41.607918844s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021233674 (55m41.608289915s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021605499 (55m41.60866174s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021979297 (55m41.609035538s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.143358585 (55m41.730414816s) [upload=948]: Next returned nil segment Aug 7 17:22:28.143372271 (55m41.730428492s) [upload=948]: Waiting for error group managing segments... Aug 7 17:22:28.152820927 (55m41.739877159s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.155768921 (55m41.742825152s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.157580522 (55m41.744636764s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159081795 (55m41.746138036s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159848245 (55m41.746904487s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.160800474 (55m41.747856715s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.163092181 (55m41.750148423s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.165617094 (55m41.752673336s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.167775504 (55m41.754831734s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.169584801 (55m41.756641042s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.172068949 (55m41.75912519s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.177127071 (55m41.764183312s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.181562120 (55m41.768618351s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187711157 (55m41.774767398s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187760881 (55m41.774817122s) [seg_pos={0 0}, upload=948]: Segment reached optimal threshold of 14 pieces. Aug 7 17:22:28.187996010 (55m41.77505225s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188103260 (55m41.775159501s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188190012 (55m41.775246252s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16zQVurJBdPm7NwqGkwFSb54iPePPjZxWaFQeVXabnZGfgWCR6): protocol: read tcp 5.161.89.252:59704->79.127.205.234:4597: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 17:22:28.188279178 (55m41.775335418s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 5.161.89.252:13570->64.49.13.140:4509: use of closed network connection; context canceled Aug 7 17:22:28.188314484 (55m41.775370725s) [seg_pos={0 0}, upload=948]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 17:22:28.188398000 (55m41.775454251s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 17:22:28.188404482 (55m41.775460723s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 17:22:28.308450431 (55m41.895506692s) [upload=948]: Done uploading segments... Aug 7 17:22:28.308469126 (55m41.895525367s) [upload=948]: Upload finished. err: <nil>
Duration: 484.113583ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
406.709958ms
FAIL (2025-08-07 17:58:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== [upload=931]: Done uploading segments... Aug 7 17:21:25.105648412 (54m38.692704652s) [upload=931]: Upload finished. err: <nil> Aug 7 17:22:27.954675461 (55m41.541731711s) [upload=948]: Starting upload Aug 7 17:22:27.954748357 (55m41.541804597s) [upload=948]: Done starting upload Aug 7 17:22:27.954864343 (55m41.541920584s) [upload=948]: Uploading segments... Aug 7 17:22:27.955194700 (55m41.542250942s) [upload=948]: Got next segment. Inline: false Aug 7 17:22:27.955258680 (55m41.54231492s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 17:22:27.955266745 (55m41.542322986s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 17:22:28.014425116 (55m41.601481357s) [seg_pos={0 0}, upload=948]: Begin upload segment... Aug 7 17:22:28.014484175 (55m41.601540427s) [seg_pos={0 0}, upload=948]: Done begin upload segment. Aug 7 17:22:28.014514632 (55m41.601570874s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015001421 (55m41.602057663s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015369168 (55m41.602425409s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015726476 (55m41.602782716s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016143414 (55m41.603199654s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016505028 (55m41.60356128s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016855882 (55m41.603912124s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017225353 (55m41.604281593s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017622354 (55m41.604678595s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018005118 (55m41.605061369s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018357466 (55m41.605413707s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018721245 (55m41.605777486s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020116700 (55m41.60717294s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020493123 (55m41.607549363s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020862602 (55m41.607918844s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021233674 (55m41.608289915s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021605499 (55m41.60866174s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021979297 (55m41.609035538s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.143358585 (55m41.730414816s) [upload=948]: Next returned nil segment Aug 7 17:22:28.143372271 (55m41.730428492s) [upload=948]: Waiting for error group managing segments... Aug 7 17:22:28.152820927 (55m41.739877159s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.155768921 (55m41.742825152s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.157580522 (55m41.744636764s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159081795 (55m41.746138036s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159848245 (55m41.746904487s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.160800474 (55m41.747856715s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.163092181 (55m41.750148423s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.165617094 (55m41.752673336s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.167775504 (55m41.754831734s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.169584801 (55m41.756641042s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.172068949 (55m41.75912519s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.177127071 (55m41.764183312s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.181562120 (55m41.768618351s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187711157 (55m41.774767398s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187760881 (55m41.774817122s) [seg_pos={0 0}, upload=948]: Segment reached optimal threshold of 14 pieces. Aug 7 17:22:28.187996010 (55m41.77505225s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188103260 (55m41.775159501s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188190012 (55m41.775246252s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16zQVurJBdPm7NwqGkwFSb54iPePPjZxWaFQeVXabnZGfgWCR6): protocol: read tcp 5.161.89.252:59704->79.127.205.234:4597: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 17:22:28.188279178 (55m41.775335418s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 5.161.89.252:13570->64.49.13.140:4509: use of closed network connection; context canceled Aug 7 17:22:28.188314484 (55m41.775370725s) [seg_pos={0 0}, upload=948]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 17:22:28.188398000 (55m41.775454251s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 17:22:28.188404482 (55m41.775460723s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 17:22:28.308450431 (55m41.895506692s) [upload=948]: Done uploading segments... Aug 7 17:22:28.308469126 (55m41.895525367s) [upload=948]: Upload finished. err: <nil>
Duration: 406.731507ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
508.655897ms
FAIL (2025-08-07 17:57:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== [upload=931]: Done uploading segments... Aug 7 17:21:25.105648412 (54m38.692704652s) [upload=931]: Upload finished. err: <nil> Aug 7 17:22:27.954675461 (55m41.541731711s) [upload=948]: Starting upload Aug 7 17:22:27.954748357 (55m41.541804597s) [upload=948]: Done starting upload Aug 7 17:22:27.954864343 (55m41.541920584s) [upload=948]: Uploading segments... Aug 7 17:22:27.955194700 (55m41.542250942s) [upload=948]: Got next segment. Inline: false Aug 7 17:22:27.955258680 (55m41.54231492s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 17:22:27.955266745 (55m41.542322986s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 17:22:28.014425116 (55m41.601481357s) [seg_pos={0 0}, upload=948]: Begin upload segment... Aug 7 17:22:28.014484175 (55m41.601540427s) [seg_pos={0 0}, upload=948]: Done begin upload segment. Aug 7 17:22:28.014514632 (55m41.601570874s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015001421 (55m41.602057663s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015369168 (55m41.602425409s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015726476 (55m41.602782716s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016143414 (55m41.603199654s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016505028 (55m41.60356128s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016855882 (55m41.603912124s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017225353 (55m41.604281593s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017622354 (55m41.604678595s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018005118 (55m41.605061369s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018357466 (55m41.605413707s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018721245 (55m41.605777486s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020116700 (55m41.60717294s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020493123 (55m41.607549363s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020862602 (55m41.607918844s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021233674 (55m41.608289915s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021605499 (55m41.60866174s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021979297 (55m41.609035538s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.143358585 (55m41.730414816s) [upload=948]: Next returned nil segment Aug 7 17:22:28.143372271 (55m41.730428492s) [upload=948]: Waiting for error group managing segments... Aug 7 17:22:28.152820927 (55m41.739877159s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.155768921 (55m41.742825152s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.157580522 (55m41.744636764s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159081795 (55m41.746138036s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159848245 (55m41.746904487s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.160800474 (55m41.747856715s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.163092181 (55m41.750148423s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.165617094 (55m41.752673336s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.167775504 (55m41.754831734s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.169584801 (55m41.756641042s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.172068949 (55m41.75912519s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.177127071 (55m41.764183312s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.181562120 (55m41.768618351s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187711157 (55m41.774767398s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187760881 (55m41.774817122s) [seg_pos={0 0}, upload=948]: Segment reached optimal threshold of 14 pieces. Aug 7 17:22:28.187996010 (55m41.77505225s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188103260 (55m41.775159501s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188190012 (55m41.775246252s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16zQVurJBdPm7NwqGkwFSb54iPePPjZxWaFQeVXabnZGfgWCR6): protocol: read tcp 5.161.89.252:59704->79.127.205.234:4597: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 17:22:28.188279178 (55m41.775335418s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 5.161.89.252:13570->64.49.13.140:4509: use of closed network connection; context canceled Aug 7 17:22:28.188314484 (55m41.775370725s) [seg_pos={0 0}, upload=948]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 17:22:28.188398000 (55m41.775454251s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 17:22:28.188404482 (55m41.775460723s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 17:22:28.308450431 (55m41.895506692s) [upload=948]: Done uploading segments... Aug 7 17:22:28.308469126 (55m41.895525367s) [upload=948]: Upload finished. err: <nil>
Duration: 508.682476ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
475.563967ms
FAIL (2025-08-07 17:55:58 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== [upload=931]: Done uploading segments... Aug 7 17:21:25.105648412 (54m38.692704652s) [upload=931]: Upload finished. err: <nil> Aug 7 17:22:27.954675461 (55m41.541731711s) [upload=948]: Starting upload Aug 7 17:22:27.954748357 (55m41.541804597s) [upload=948]: Done starting upload Aug 7 17:22:27.954864343 (55m41.541920584s) [upload=948]: Uploading segments... Aug 7 17:22:27.955194700 (55m41.542250942s) [upload=948]: Got next segment. Inline: false Aug 7 17:22:27.955258680 (55m41.54231492s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 17:22:27.955266745 (55m41.542322986s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 17:22:28.014425116 (55m41.601481357s) [seg_pos={0 0}, upload=948]: Begin upload segment... Aug 7 17:22:28.014484175 (55m41.601540427s) [seg_pos={0 0}, upload=948]: Done begin upload segment. Aug 7 17:22:28.014514632 (55m41.601570874s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015001421 (55m41.602057663s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015369168 (55m41.602425409s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015726476 (55m41.602782716s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016143414 (55m41.603199654s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016505028 (55m41.60356128s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016855882 (55m41.603912124s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017225353 (55m41.604281593s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017622354 (55m41.604678595s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018005118 (55m41.605061369s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018357466 (55m41.605413707s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018721245 (55m41.605777486s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020116700 (55m41.60717294s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020493123 (55m41.607549363s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020862602 (55m41.607918844s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021233674 (55m41.608289915s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021605499 (55m41.60866174s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021979297 (55m41.609035538s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.143358585 (55m41.730414816s) [upload=948]: Next returned nil segment Aug 7 17:22:28.143372271 (55m41.730428492s) [upload=948]: Waiting for error group managing segments... Aug 7 17:22:28.152820927 (55m41.739877159s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.155768921 (55m41.742825152s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.157580522 (55m41.744636764s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159081795 (55m41.746138036s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159848245 (55m41.746904487s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.160800474 (55m41.747856715s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.163092181 (55m41.750148423s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.165617094 (55m41.752673336s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.167775504 (55m41.754831734s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.169584801 (55m41.756641042s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.172068949 (55m41.75912519s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.177127071 (55m41.764183312s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.181562120 (55m41.768618351s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187711157 (55m41.774767398s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187760881 (55m41.774817122s) [seg_pos={0 0}, upload=948]: Segment reached optimal threshold of 14 pieces. Aug 7 17:22:28.187996010 (55m41.77505225s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188103260 (55m41.775159501s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188190012 (55m41.775246252s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16zQVurJBdPm7NwqGkwFSb54iPePPjZxWaFQeVXabnZGfgWCR6): protocol: read tcp 5.161.89.252:59704->79.127.205.234:4597: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 17:22:28.188279178 (55m41.775335418s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 5.161.89.252:13570->64.49.13.140:4509: use of closed network connection; context canceled Aug 7 17:22:28.188314484 (55m41.775370725s) [seg_pos={0 0}, upload=948]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 17:22:28.188398000 (55m41.775454251s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 17:22:28.188404482 (55m41.775460723s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 17:22:28.308450431 (55m41.895506692s) [upload=948]: Done uploading segments... Aug 7 17:22:28.308469126 (55m41.895525367s) [upload=948]: Upload finished. err: <nil>
Duration: 475.586079ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
542.114675ms
FAIL (2025-08-07 17:55:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== [upload=931]: Done uploading segments... Aug 7 17:21:25.105648412 (54m38.692704652s) [upload=931]: Upload finished. err: <nil> Aug 7 17:22:27.954675461 (55m41.541731711s) [upload=948]: Starting upload Aug 7 17:22:27.954748357 (55m41.541804597s) [upload=948]: Done starting upload Aug 7 17:22:27.954864343 (55m41.541920584s) [upload=948]: Uploading segments... Aug 7 17:22:27.955194700 (55m41.542250942s) [upload=948]: Got next segment. Inline: false Aug 7 17:22:27.955258680 (55m41.54231492s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 17:22:27.955266745 (55m41.542322986s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 17:22:28.014425116 (55m41.601481357s) [seg_pos={0 0}, upload=948]: Begin upload segment... Aug 7 17:22:28.014484175 (55m41.601540427s) [seg_pos={0 0}, upload=948]: Done begin upload segment. Aug 7 17:22:28.014514632 (55m41.601570874s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015001421 (55m41.602057663s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015369168 (55m41.602425409s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015726476 (55m41.602782716s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016143414 (55m41.603199654s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016505028 (55m41.60356128s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016855882 (55m41.603912124s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017225353 (55m41.604281593s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017622354 (55m41.604678595s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018005118 (55m41.605061369s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018357466 (55m41.605413707s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018721245 (55m41.605777486s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020116700 (55m41.60717294s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020493123 (55m41.607549363s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020862602 (55m41.607918844s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021233674 (55m41.608289915s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021605499 (55m41.60866174s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021979297 (55m41.609035538s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.143358585 (55m41.730414816s) [upload=948]: Next returned nil segment Aug 7 17:22:28.143372271 (55m41.730428492s) [upload=948]: Waiting for error group managing segments... Aug 7 17:22:28.152820927 (55m41.739877159s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.155768921 (55m41.742825152s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.157580522 (55m41.744636764s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159081795 (55m41.746138036s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159848245 (55m41.746904487s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.160800474 (55m41.747856715s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.163092181 (55m41.750148423s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.165617094 (55m41.752673336s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.167775504 (55m41.754831734s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.169584801 (55m41.756641042s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.172068949 (55m41.75912519s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.177127071 (55m41.764183312s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.181562120 (55m41.768618351s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187711157 (55m41.774767398s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187760881 (55m41.774817122s) [seg_pos={0 0}, upload=948]: Segment reached optimal threshold of 14 pieces. Aug 7 17:22:28.187996010 (55m41.77505225s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188103260 (55m41.775159501s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188190012 (55m41.775246252s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16zQVurJBdPm7NwqGkwFSb54iPePPjZxWaFQeVXabnZGfgWCR6): protocol: read tcp 5.161.89.252:59704->79.127.205.234:4597: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 17:22:28.188279178 (55m41.775335418s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 5.161.89.252:13570->64.49.13.140:4509: use of closed network connection; context canceled Aug 7 17:22:28.188314484 (55m41.775370725s) [seg_pos={0 0}, upload=948]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 17:22:28.188398000 (55m41.775454251s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 17:22:28.188404482 (55m41.775460723s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 17:22:28.308450431 (55m41.895506692s) [upload=948]: Done uploading segments... Aug 7 17:22:28.308469126 (55m41.895525367s) [upload=948]: Upload finished. err: <nil>
Duration: 542.144591ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
451.957735ms
FAIL (2025-08-07 17:54:57 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== [upload=931]: Done uploading segments... Aug 7 17:21:25.105648412 (54m38.692704652s) [upload=931]: Upload finished. err: <nil> Aug 7 17:22:27.954675461 (55m41.541731711s) [upload=948]: Starting upload Aug 7 17:22:27.954748357 (55m41.541804597s) [upload=948]: Done starting upload Aug 7 17:22:27.954864343 (55m41.541920584s) [upload=948]: Uploading segments... Aug 7 17:22:27.955194700 (55m41.542250942s) [upload=948]: Got next segment. Inline: false Aug 7 17:22:27.955258680 (55m41.54231492s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 17:22:27.955266745 (55m41.542322986s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 17:22:28.014425116 (55m41.601481357s) [seg_pos={0 0}, upload=948]: Begin upload segment... Aug 7 17:22:28.014484175 (55m41.601540427s) [seg_pos={0 0}, upload=948]: Done begin upload segment. Aug 7 17:22:28.014514632 (55m41.601570874s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015001421 (55m41.602057663s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015369168 (55m41.602425409s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015726476 (55m41.602782716s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016143414 (55m41.603199654s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016505028 (55m41.60356128s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016855882 (55m41.603912124s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017225353 (55m41.604281593s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017622354 (55m41.604678595s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018005118 (55m41.605061369s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018357466 (55m41.605413707s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018721245 (55m41.605777486s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020116700 (55m41.60717294s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020493123 (55m41.607549363s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020862602 (55m41.607918844s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021233674 (55m41.608289915s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021605499 (55m41.60866174s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021979297 (55m41.609035538s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.143358585 (55m41.730414816s) [upload=948]: Next returned nil segment Aug 7 17:22:28.143372271 (55m41.730428492s) [upload=948]: Waiting for error group managing segments... Aug 7 17:22:28.152820927 (55m41.739877159s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.155768921 (55m41.742825152s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.157580522 (55m41.744636764s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159081795 (55m41.746138036s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159848245 (55m41.746904487s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.160800474 (55m41.747856715s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.163092181 (55m41.750148423s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.165617094 (55m41.752673336s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.167775504 (55m41.754831734s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.169584801 (55m41.756641042s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.172068949 (55m41.75912519s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.177127071 (55m41.764183312s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.181562120 (55m41.768618351s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187711157 (55m41.774767398s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187760881 (55m41.774817122s) [seg_pos={0 0}, upload=948]: Segment reached optimal threshold of 14 pieces. Aug 7 17:22:28.187996010 (55m41.77505225s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188103260 (55m41.775159501s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188190012 (55m41.775246252s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16zQVurJBdPm7NwqGkwFSb54iPePPjZxWaFQeVXabnZGfgWCR6): protocol: read tcp 5.161.89.252:59704->79.127.205.234:4597: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 17:22:28.188279178 (55m41.775335418s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 5.161.89.252:13570->64.49.13.140:4509: use of closed network connection; context canceled Aug 7 17:22:28.188314484 (55m41.775370725s) [seg_pos={0 0}, upload=948]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 17:22:28.188398000 (55m41.775454251s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 17:22:28.188404482 (55m41.775460723s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 17:22:28.308450431 (55m41.895506692s) [upload=948]: Done uploading segments... Aug 7 17:22:28.308469126 (55m41.895525367s) [upload=948]: Upload finished. err: <nil>
Duration: 451.976479ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
1.80057664s
FAIL (2025-08-07 17:53:46 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== [upload=931]: Done uploading segments... Aug 7 17:21:25.105648412 (54m38.692704652s) [upload=931]: Upload finished. err: <nil> Aug 7 17:22:27.954675461 (55m41.541731711s) [upload=948]: Starting upload Aug 7 17:22:27.954748357 (55m41.541804597s) [upload=948]: Done starting upload Aug 7 17:22:27.954864343 (55m41.541920584s) [upload=948]: Uploading segments... Aug 7 17:22:27.955194700 (55m41.542250942s) [upload=948]: Got next segment. Inline: false Aug 7 17:22:27.955258680 (55m41.54231492s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 17:22:27.955266745 (55m41.542322986s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 17:22:28.014425116 (55m41.601481357s) [seg_pos={0 0}, upload=948]: Begin upload segment... Aug 7 17:22:28.014484175 (55m41.601540427s) [seg_pos={0 0}, upload=948]: Done begin upload segment. Aug 7 17:22:28.014514632 (55m41.601570874s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015001421 (55m41.602057663s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015369168 (55m41.602425409s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015726476 (55m41.602782716s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016143414 (55m41.603199654s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016505028 (55m41.60356128s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016855882 (55m41.603912124s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017225353 (55m41.604281593s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017622354 (55m41.604678595s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018005118 (55m41.605061369s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018357466 (55m41.605413707s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018721245 (55m41.605777486s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020116700 (55m41.60717294s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020493123 (55m41.607549363s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020862602 (55m41.607918844s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021233674 (55m41.608289915s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021605499 (55m41.60866174s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021979297 (55m41.609035538s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.143358585 (55m41.730414816s) [upload=948]: Next returned nil segment Aug 7 17:22:28.143372271 (55m41.730428492s) [upload=948]: Waiting for error group managing segments... Aug 7 17:22:28.152820927 (55m41.739877159s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.155768921 (55m41.742825152s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.157580522 (55m41.744636764s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159081795 (55m41.746138036s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159848245 (55m41.746904487s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.160800474 (55m41.747856715s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.163092181 (55m41.750148423s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.165617094 (55m41.752673336s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.167775504 (55m41.754831734s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.169584801 (55m41.756641042s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.172068949 (55m41.75912519s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.177127071 (55m41.764183312s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.181562120 (55m41.768618351s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187711157 (55m41.774767398s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187760881 (55m41.774817122s) [seg_pos={0 0}, upload=948]: Segment reached optimal threshold of 14 pieces. Aug 7 17:22:28.187996010 (55m41.77505225s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188103260 (55m41.775159501s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188190012 (55m41.775246252s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16zQVurJBdPm7NwqGkwFSb54iPePPjZxWaFQeVXabnZGfgWCR6): protocol: read tcp 5.161.89.252:59704->79.127.205.234:4597: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 17:22:28.188279178 (55m41.775335418s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 5.161.89.252:13570->64.49.13.140:4509: use of closed network connection; context canceled Aug 7 17:22:28.188314484 (55m41.775370725s) [seg_pos={0 0}, upload=948]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 17:22:28.188398000 (55m41.775454251s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 17:22:28.188404482 (55m41.775460723s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 17:22:28.308450431 (55m41.895506692s) [upload=948]: Done uploading segments... Aug 7 17:22:28.308469126 (55m41.895525367s) [upload=948]: Upload finished. err: <nil>
Duration: 1.800599893s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
913.282998ms
FAIL (2025-08-07 17:53:25 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== [upload=931]: Done uploading segments... Aug 7 17:21:25.105648412 (54m38.692704652s) [upload=931]: Upload finished. err: <nil> Aug 7 17:22:27.954675461 (55m41.541731711s) [upload=948]: Starting upload Aug 7 17:22:27.954748357 (55m41.541804597s) [upload=948]: Done starting upload Aug 7 17:22:27.954864343 (55m41.541920584s) [upload=948]: Uploading segments... Aug 7 17:22:27.955194700 (55m41.542250942s) [upload=948]: Got next segment. Inline: false Aug 7 17:22:27.955258680 (55m41.54231492s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 17:22:27.955266745 (55m41.542322986s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 17:22:28.014425116 (55m41.601481357s) [seg_pos={0 0}, upload=948]: Begin upload segment... Aug 7 17:22:28.014484175 (55m41.601540427s) [seg_pos={0 0}, upload=948]: Done begin upload segment. Aug 7 17:22:28.014514632 (55m41.601570874s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015001421 (55m41.602057663s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015369168 (55m41.602425409s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015726476 (55m41.602782716s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016143414 (55m41.603199654s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016505028 (55m41.60356128s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016855882 (55m41.603912124s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017225353 (55m41.604281593s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017622354 (55m41.604678595s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018005118 (55m41.605061369s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018357466 (55m41.605413707s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018721245 (55m41.605777486s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020116700 (55m41.60717294s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020493123 (55m41.607549363s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020862602 (55m41.607918844s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021233674 (55m41.608289915s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021605499 (55m41.60866174s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021979297 (55m41.609035538s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.143358585 (55m41.730414816s) [upload=948]: Next returned nil segment Aug 7 17:22:28.143372271 (55m41.730428492s) [upload=948]: Waiting for error group managing segments... Aug 7 17:22:28.152820927 (55m41.739877159s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.155768921 (55m41.742825152s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.157580522 (55m41.744636764s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159081795 (55m41.746138036s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159848245 (55m41.746904487s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.160800474 (55m41.747856715s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.163092181 (55m41.750148423s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.165617094 (55m41.752673336s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.167775504 (55m41.754831734s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.169584801 (55m41.756641042s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.172068949 (55m41.75912519s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.177127071 (55m41.764183312s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.181562120 (55m41.768618351s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187711157 (55m41.774767398s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187760881 (55m41.774817122s) [seg_pos={0 0}, upload=948]: Segment reached optimal threshold of 14 pieces. Aug 7 17:22:28.187996010 (55m41.77505225s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188103260 (55m41.775159501s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188190012 (55m41.775246252s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16zQVurJBdPm7NwqGkwFSb54iPePPjZxWaFQeVXabnZGfgWCR6): protocol: read tcp 5.161.89.252:59704->79.127.205.234:4597: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 17:22:28.188279178 (55m41.775335418s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 5.161.89.252:13570->64.49.13.140:4509: use of closed network connection; context canceled Aug 7 17:22:28.188314484 (55m41.775370725s) [seg_pos={0 0}, upload=948]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 17:22:28.188398000 (55m41.775454251s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 17:22:28.188404482 (55m41.775460723s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 17:22:28.308450431 (55m41.895506692s) [upload=948]: Done uploading segments... Aug 7 17:22:28.308469126 (55m41.895525367s) [upload=948]: Upload finished. err: <nil>
Duration: 913.308103ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
758.706921ms
FAIL (2025-08-07 17:52:45 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== [upload=931]: Done uploading segments... Aug 7 17:21:25.105648412 (54m38.692704652s) [upload=931]: Upload finished. err: <nil> Aug 7 17:22:27.954675461 (55m41.541731711s) [upload=948]: Starting upload Aug 7 17:22:27.954748357 (55m41.541804597s) [upload=948]: Done starting upload Aug 7 17:22:27.954864343 (55m41.541920584s) [upload=948]: Uploading segments... Aug 7 17:22:27.955194700 (55m41.542250942s) [upload=948]: Got next segment. Inline: false Aug 7 17:22:27.955258680 (55m41.54231492s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 17:22:27.955266745 (55m41.542322986s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 17:22:28.014425116 (55m41.601481357s) [seg_pos={0 0}, upload=948]: Begin upload segment... Aug 7 17:22:28.014484175 (55m41.601540427s) [seg_pos={0 0}, upload=948]: Done begin upload segment. Aug 7 17:22:28.014514632 (55m41.601570874s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015001421 (55m41.602057663s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015369168 (55m41.602425409s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015726476 (55m41.602782716s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016143414 (55m41.603199654s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016505028 (55m41.60356128s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016855882 (55m41.603912124s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017225353 (55m41.604281593s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017622354 (55m41.604678595s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018005118 (55m41.605061369s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018357466 (55m41.605413707s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018721245 (55m41.605777486s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020116700 (55m41.60717294s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020493123 (55m41.607549363s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020862602 (55m41.607918844s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021233674 (55m41.608289915s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021605499 (55m41.60866174s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021979297 (55m41.609035538s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.143358585 (55m41.730414816s) [upload=948]: Next returned nil segment Aug 7 17:22:28.143372271 (55m41.730428492s) [upload=948]: Waiting for error group managing segments... Aug 7 17:22:28.152820927 (55m41.739877159s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.155768921 (55m41.742825152s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.157580522 (55m41.744636764s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159081795 (55m41.746138036s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159848245 (55m41.746904487s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.160800474 (55m41.747856715s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.163092181 (55m41.750148423s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.165617094 (55m41.752673336s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.167775504 (55m41.754831734s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.169584801 (55m41.756641042s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.172068949 (55m41.75912519s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.177127071 (55m41.764183312s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.181562120 (55m41.768618351s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187711157 (55m41.774767398s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187760881 (55m41.774817122s) [seg_pos={0 0}, upload=948]: Segment reached optimal threshold of 14 pieces. Aug 7 17:22:28.187996010 (55m41.77505225s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188103260 (55m41.775159501s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188190012 (55m41.775246252s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16zQVurJBdPm7NwqGkwFSb54iPePPjZxWaFQeVXabnZGfgWCR6): protocol: read tcp 5.161.89.252:59704->79.127.205.234:4597: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 17:22:28.188279178 (55m41.775335418s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 5.161.89.252:13570->64.49.13.140:4509: use of closed network connection; context canceled Aug 7 17:22:28.188314484 (55m41.775370725s) [seg_pos={0 0}, upload=948]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 17:22:28.188398000 (55m41.775454251s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 17:22:28.188404482 (55m41.775460723s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 17:22:28.308450431 (55m41.895506692s) [upload=948]: Done uploading segments... Aug 7 17:22:28.308469126 (55m41.895525367s) [upload=948]: Upload finished. err: <nil>
Duration: 758.73307ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
443.122712ms
FAIL (2025-08-07 17:52:11 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== [upload=931]: Done uploading segments... Aug 7 17:21:25.105648412 (54m38.692704652s) [upload=931]: Upload finished. err: <nil> Aug 7 17:22:27.954675461 (55m41.541731711s) [upload=948]: Starting upload Aug 7 17:22:27.954748357 (55m41.541804597s) [upload=948]: Done starting upload Aug 7 17:22:27.954864343 (55m41.541920584s) [upload=948]: Uploading segments... Aug 7 17:22:27.955194700 (55m41.542250942s) [upload=948]: Got next segment. Inline: false Aug 7 17:22:27.955258680 (55m41.54231492s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 17:22:27.955266745 (55m41.542322986s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 17:22:28.014425116 (55m41.601481357s) [seg_pos={0 0}, upload=948]: Begin upload segment... Aug 7 17:22:28.014484175 (55m41.601540427s) [seg_pos={0 0}, upload=948]: Done begin upload segment. Aug 7 17:22:28.014514632 (55m41.601570874s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015001421 (55m41.602057663s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015369168 (55m41.602425409s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015726476 (55m41.602782716s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016143414 (55m41.603199654s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016505028 (55m41.60356128s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016855882 (55m41.603912124s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017225353 (55m41.604281593s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017622354 (55m41.604678595s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018005118 (55m41.605061369s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018357466 (55m41.605413707s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018721245 (55m41.605777486s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020116700 (55m41.60717294s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020493123 (55m41.607549363s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020862602 (55m41.607918844s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021233674 (55m41.608289915s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021605499 (55m41.60866174s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021979297 (55m41.609035538s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.143358585 (55m41.730414816s) [upload=948]: Next returned nil segment Aug 7 17:22:28.143372271 (55m41.730428492s) [upload=948]: Waiting for error group managing segments... Aug 7 17:22:28.152820927 (55m41.739877159s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.155768921 (55m41.742825152s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.157580522 (55m41.744636764s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159081795 (55m41.746138036s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159848245 (55m41.746904487s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.160800474 (55m41.747856715s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.163092181 (55m41.750148423s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.165617094 (55m41.752673336s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.167775504 (55m41.754831734s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.169584801 (55m41.756641042s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.172068949 (55m41.75912519s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.177127071 (55m41.764183312s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.181562120 (55m41.768618351s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187711157 (55m41.774767398s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187760881 (55m41.774817122s) [seg_pos={0 0}, upload=948]: Segment reached optimal threshold of 14 pieces. Aug 7 17:22:28.187996010 (55m41.77505225s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188103260 (55m41.775159501s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188190012 (55m41.775246252s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16zQVurJBdPm7NwqGkwFSb54iPePPjZxWaFQeVXabnZGfgWCR6): protocol: read tcp 5.161.89.252:59704->79.127.205.234:4597: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 17:22:28.188279178 (55m41.775335418s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 5.161.89.252:13570->64.49.13.140:4509: use of closed network connection; context canceled Aug 7 17:22:28.188314484 (55m41.775370725s) [seg_pos={0 0}, upload=948]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 17:22:28.188398000 (55m41.775454251s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 17:22:28.188404482 (55m41.775460723s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 17:22:28.308450431 (55m41.895506692s) [upload=948]: Done uploading segments... Aug 7 17:22:28.308469126 (55m41.895525367s) [upload=948]: Upload finished. err: <nil>
Duration: 443.170251ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
809.663761ms
FAIL (2025-08-07 17:51:06 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== [upload=931]: Done uploading segments... Aug 7 17:21:25.105648412 (54m38.692704652s) [upload=931]: Upload finished. err: <nil> Aug 7 17:22:27.954675461 (55m41.541731711s) [upload=948]: Starting upload Aug 7 17:22:27.954748357 (55m41.541804597s) [upload=948]: Done starting upload Aug 7 17:22:27.954864343 (55m41.541920584s) [upload=948]: Uploading segments... Aug 7 17:22:27.955194700 (55m41.542250942s) [upload=948]: Got next segment. Inline: false Aug 7 17:22:27.955258680 (55m41.54231492s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 17:22:27.955266745 (55m41.542322986s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 17:22:28.014425116 (55m41.601481357s) [seg_pos={0 0}, upload=948]: Begin upload segment... Aug 7 17:22:28.014484175 (55m41.601540427s) [seg_pos={0 0}, upload=948]: Done begin upload segment. Aug 7 17:22:28.014514632 (55m41.601570874s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015001421 (55m41.602057663s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015369168 (55m41.602425409s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015726476 (55m41.602782716s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016143414 (55m41.603199654s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016505028 (55m41.60356128s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016855882 (55m41.603912124s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017225353 (55m41.604281593s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017622354 (55m41.604678595s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018005118 (55m41.605061369s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018357466 (55m41.605413707s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018721245 (55m41.605777486s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020116700 (55m41.60717294s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020493123 (55m41.607549363s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020862602 (55m41.607918844s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021233674 (55m41.608289915s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021605499 (55m41.60866174s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021979297 (55m41.609035538s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.143358585 (55m41.730414816s) [upload=948]: Next returned nil segment Aug 7 17:22:28.143372271 (55m41.730428492s) [upload=948]: Waiting for error group managing segments... Aug 7 17:22:28.152820927 (55m41.739877159s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.155768921 (55m41.742825152s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.157580522 (55m41.744636764s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159081795 (55m41.746138036s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159848245 (55m41.746904487s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.160800474 (55m41.747856715s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.163092181 (55m41.750148423s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.165617094 (55m41.752673336s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.167775504 (55m41.754831734s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.169584801 (55m41.756641042s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.172068949 (55m41.75912519s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.177127071 (55m41.764183312s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.181562120 (55m41.768618351s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187711157 (55m41.774767398s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187760881 (55m41.774817122s) [seg_pos={0 0}, upload=948]: Segment reached optimal threshold of 14 pieces. Aug 7 17:22:28.187996010 (55m41.77505225s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188103260 (55m41.775159501s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188190012 (55m41.775246252s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16zQVurJBdPm7NwqGkwFSb54iPePPjZxWaFQeVXabnZGfgWCR6): protocol: read tcp 5.161.89.252:59704->79.127.205.234:4597: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 17:22:28.188279178 (55m41.775335418s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 5.161.89.252:13570->64.49.13.140:4509: use of closed network connection; context canceled Aug 7 17:22:28.188314484 (55m41.775370725s) [seg_pos={0 0}, upload=948]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 17:22:28.188398000 (55m41.775454251s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 17:22:28.188404482 (55m41.775460723s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 17:22:28.308450431 (55m41.895506692s) [upload=948]: Done uploading segments... Aug 7 17:22:28.308469126 (55m41.895525367s) [upload=948]: Upload finished. err: <nil>
Duration: 809.687836ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
605.533614ms
FAIL (2025-08-07 17:50:40 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== [upload=931]: Done uploading segments... Aug 7 17:21:25.105648412 (54m38.692704652s) [upload=931]: Upload finished. err: <nil> Aug 7 17:22:27.954675461 (55m41.541731711s) [upload=948]: Starting upload Aug 7 17:22:27.954748357 (55m41.541804597s) [upload=948]: Done starting upload Aug 7 17:22:27.954864343 (55m41.541920584s) [upload=948]: Uploading segments... Aug 7 17:22:27.955194700 (55m41.542250942s) [upload=948]: Got next segment. Inline: false Aug 7 17:22:27.955258680 (55m41.54231492s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 17:22:27.955266745 (55m41.542322986s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 7 17:22:28.014425116 (55m41.601481357s) [seg_pos={0 0}, upload=948]: Begin upload segment... Aug 7 17:22:28.014484175 (55m41.601540427s) [seg_pos={0 0}, upload=948]: Done begin upload segment. Aug 7 17:22:28.014514632 (55m41.601570874s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015001421 (55m41.602057663s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015369168 (55m41.602425409s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.015726476 (55m41.602782716s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016143414 (55m41.603199654s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016505028 (55m41.60356128s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.016855882 (55m41.603912124s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017225353 (55m41.604281593s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.017622354 (55m41.604678595s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018005118 (55m41.605061369s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018357466 (55m41.605413707s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.018721245 (55m41.605777486s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020116700 (55m41.60717294s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020493123 (55m41.607549363s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.020862602 (55m41.607918844s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021233674 (55m41.608289915s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021605499 (55m41.60866174s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.021979297 (55m41.609035538s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Uploading piece... Aug 7 17:22:28.143358585 (55m41.730414816s) [upload=948]: Next returned nil segment Aug 7 17:22:28.143372271 (55m41.730428492s) [upload=948]: Waiting for error group managing segments... Aug 7 17:22:28.152820927 (55m41.739877159s) [noise=true , address=45.91.116.6:4999 , piece_id=VBPXFF6GNJG3D3CCNEWH6BCE7YK4FXRTNUFAR6BKSAVWWIF2HBPA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.155768921 (55m41.742825152s) [noise=true , address=45.91.116.14:4197 , piece_id=HDDUO7SMX53QVQJSCGDV7AYZGL6OPPQ653WNX6EOAQWIPAS6GS6Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.157580522 (55m41.744636764s) [noise=true , address=104.36.82.61:4377 , piece_id=EDTV7FTUB3TMGQB3CE2GDCM3DKROJDXWI7277GJKMC25CNJBXA5Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159081795 (55m41.746138036s) [noise=true , address=104.36.82.22:4512 , piece_id=Z4T2ICZBDB2HFJ6HGLQTUBLDE72ZRMKOUY2FN5XPVW5MQMLTZ5XA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.159848245 (55m41.746904487s) [noise=true , address=104.36.82.37:4664 , piece_id=2IQKYEVLDZDYJCKZUVHBURXYUSSIGUAASZ4DUCKPHYYGOHOSRHZQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.160800474 (55m41.747856715s) [noise=true , address=45.91.116.5:4322 , piece_id=4ZJ7OVAGGUWJSDUYMYQCHFWR4QRX7IH5BGHVTZCZBQE7VIP3SSOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.163092181 (55m41.750148423s) [noise=true , address=104.36.82.46:4482 , piece_id=Z5GSPH6QWPOOGF7T64DGH2ALZ23IGVY4TNAOXII2MCWATFWHE4IA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.165617094 (55m41.752673336s) [noise=true , address=104.36.82.44:4878 , piece_id=F2VTCPT5DTLG4PQL2TGJZZQ66ID32I3TX5H6CRQ6XZIPKO6EOUIA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.167775504 (55m41.754831734s) [noise=true , address=104.36.82.60:4343 , piece_id=EEFUF4DTOSYT44YFM2NJFRYKAHUHTG47PHIJF55UMI3PVZ7NXPOQ, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.169584801 (55m41.756641042s) [noise=true , address=104.36.82.5:4850 , piece_id=2V4JX34C6NUZ5LOJTUUEPU44JSWACPEQXHMLAWJKCWIHVNK5OZOA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.172068949 (55m41.75912519s) [noise=true , address=104.36.82.16:4325 , piece_id=HODCIOTCSUJOBG7MM7XSMYPL5QO4NXINE4CXVHUOLRFLA7ZAO55A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.177127071 (55m41.764183312s) [noise=true , address=104.36.82.23:4455 , piece_id=TFGTJQGQOYZA74LWEQDKXYWAEQRMENY5ZSGLIUW6QPSHATGU6H5A, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.181562120 (55m41.768618351s) [noise=true , address=104.36.82.15:4270 , piece_id=FQ23I5HXQEET5JVQRMCLWNZFVHEEUG3GOMYM2AKQTIFCLCDFBKUA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187711157 (55m41.774767398s) [noise=true , address=104.36.82.52:4107 , piece_id=ZIFUXITG3ZFVDA7MV5QTSWSUKTFSWOA7A3NBL7CUHHJCTFSEW4VA, seg_pos={0 0}, upload=948]: Done uploading piece. err: <nil> Aug 7 17:22:28.187760881 (55m41.774817122s) [seg_pos={0 0}, upload=948]: Segment reached optimal threshold of 14 pieces. Aug 7 17:22:28.187996010 (55m41.77505225s) [noise=true , address=104.36.82.43:4837 , piece_id=74USG7XDKSCYGX5HLSHX2SLB4XV2RIBRCEDBCEH367DZ73WYI57Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188103260 (55m41.775159501s) [noise=true , address=104.36.82.4:4828 , piece_id=X7PXWYKMWE2EUH2K2OAVAW77VO27HP3M4OBPSFOT3SIUYCJEXUTA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF Aug 7 17:22:28.188190012 (55m41.775246252s) [noise=true , address=79.127.205.234:4597 , piece_id=OTJ5BQA4DGWHYNZ3G7KK4PV7HGO2QE5BBLRSTXUT4GMLA4OFLVXA, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16zQVurJBdPm7NwqGkwFSb54iPePPjZxWaFQeVXabnZGfgWCR6): protocol: read tcp 5.161.89.252:59704->79.127.205.234:4597: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 17:22:28.188279178 (55m41.775335418s) [noise=true , address=64.49.13.140:4509 , piece_id=PUOMLJJXCSH73J446N27K4ZPZLHJBKSLYMJ7EARWJPQWA7S63W2Q, seg_pos={0 0}, upload=948]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 5.161.89.252:13570->64.49.13.140:4509: use of closed network connection; context canceled Aug 7 17:22:28.188314484 (55m41.775370725s) [seg_pos={0 0}, upload=948]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 17:22:28.188398000 (55m41.775454251s) [upload=948]: Flush batch item: *pb.BatchRequestItem_SegmentCommit Aug 7 17:22:28.188404482 (55m41.775460723s) [upload=948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 17:22:28.308450431 (55m41.895506692s) [upload=948]: Done uploading segments... Aug 7 17:22:28.308469126 (55m41.895525367s) [upload=948]: Upload finished. err: <nil>
Duration: 605.550415ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|