Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
3 out of 15 is failed (threshold=6) [....XX........X] duration:
1.016163945s remote:
"tcp:18.211.166.153:443" response headers:
Date=Thu, 21 Aug 2025 17:14:05 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red target:
https://www.storj.io/
FAIL (2025-08-21 17:14:05 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 1.01620364s
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................X................X....................] duration:
2.029982668s
FAIL (2025-08-21 17:13:15 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 21 16:58:11.097765980 (311h31m51.82903362s) [upload=323881]: Starting upload
Aug 21 16:58:11.097816425 (311h31m51.829084066s) [upload=323881]: Done starting upload
Aug 21 16:58:11.097974212 (311h31m51.829241862s) [upload=323881]: Uploading segments...
Aug 21 16:58:11.098124976 (311h31m51.829392606s) [upload=323881]: Got next segment. Inline: false
Aug 21 16:58:11.098190559 (311h31m51.829458199s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 16:58:11.098198244 (311h31m51.829465904s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 16:58:11.186959668 (311h31m51.918227288s) [seg_pos={0 0}, upload=323881]: Begin upload segment...
Aug 21 16:58:11.187010914 (311h31m51.918278574s) [seg_pos={0 0}, upload=323881]: Done begin upload segment.
Aug 21 16:58:11.187041721 (311h31m51.918309351s) [noise=true , address=45.91.116.5:4312 , piece_id=QCY54KDIJ3SFLIE2X6KBQD2UIEWMGYBOL33JKFLWGXZGRTB42YQQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187059065 (311h31m51.918326695s) [noise=true , address=104.36.82.49:4012 , piece_id=CQSJDRQSYII2TZ4IXSILK3IN4WMGVOJEHPQJBPWPYII5HQ7G2B3A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187096966 (311h31m51.918364587s) [noise=true , address=104.36.82.7:4920 , piece_id=7LGSALS6MO7SEPNO5KGHKACZ6CSAMJMV2GYHYY6BBVGFOXHRLPSQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187499954 (311h31m51.918767574s) [noise=true , address=77.90.31.19:4851 , piece_id=YZ7SGALUQPTAHO5ZARMCVMADX5AGH6BQNCN5UTC74JPLPEWALEDQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187516114 (311h31m51.918783745s) [noise=true , address=104.36.82.9:4022 , piece_id=XHQFV3SHMAT7WOOWG6U5QRRO3VBLZUE2SV7N5N4IDWWB6MPAT7JA, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187870982 (311h31m51.919138612s) [noise=true , address=77.90.31.10:4548 , piece_id=3IWDAKTWMTSIYUHS4YSHUGNPZXYIOTCE523RYZCYL2FEW226R45A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187878215 (311h31m51.919145845s) [noise=true , address=77.90.31.13:4651 , piece_id=KVYWHATVMKX3WZB7UWCIPQ5TIXHLAO7TWECK4XRQDILQ4HOUSB3Q, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188266736 (311h31m51.919534356s) [noise=true , address=104.36.82.13:4209 , piece_id=AJ5OPQIYSANI4EFJQYTCSC4OYA2KV4PR23YNLROCLL62ZNT2CINQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188291242 (311h31m51.919558873s) [noise=true , address=77.90.31.15:4719 , piece_id=SQOIUIMMOLGQHURPXKR4E3SYUKDJDJNZ75Q4RXA3W2E4JOG5WXLQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188643465 (311h31m51.919911095s) [noise=true , address=104.36.82.14:4236 , piece_id=EOTHS7XHUD5YNTOQOVTFR6EIRGREL4VBL2KLS5LJVQJKTMRWWUVQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188658473 (311h31m51.919926103s) [noise=true , address=104.36.82.11:4118 , piece_id=MFWA4J22CPFE4HEYFXZISYJDAKWCF3HEYHVCYKSFQY5N27QT2O6A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188993774 (311h31m51.920261394s) [noise=true , address=77.90.31.18:4812 , piece_id=GRFZT75OBWQBGFZ3I3QYOGWHIFXJCZHKOGQOG34ZW6QG7BNBNGBQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189017548 (311h31m51.920285178s) [noise=true , address=77.90.31.11:4582 , piece_id=7I4O5F46N3EAAFKUSTBOA3DY5NF7PQHNILWM5GFZ5CEIGRZANDRQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189365152 (311h31m51.920632782s) [noise=true , address=79.127.205.234:4616 , piece_id=D3SSTIPP6BS4NL5IS3JTR6JTHG32VWVD6HIU27WB2HXRTI7SL4TQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189952657 (311h31m51.921220287s) [noise=true , address=104.36.82.45:4917 , piece_id=HHWHHUVVM76NSJNSFRSV5L2TJM7WABLPY3UMVM7CEZM44NKMXRHQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.190704210 (311h31m51.92197184s) [noise=true , address=45.91.116.11:4142 , piece_id=FTHDX3KRMQV2VPJA42JPTD5LDPAQCC6C2D6ODRZ7M4ZASZDJCSYA, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.191563527 (311h31m51.922831157s) [noise=true , address=45.91.116.11:4141 , piece_id=6OUW5WSYNG5GABS6BH3NNP3WRPYAK3SOVJDSXLMPICFMSNWD3O3Q, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.192590128 (311h31m51.923857758s) [noise=true , address=104.36.82.6:4907 , piece_id=ZVU2TK7PXTZBHLLU657Q5U5BS33QIIGR5WBBUE23LMRWNYSGIJEQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.292199435 (311h31m52.023467055s) [upload=323881]: Next returned nil segment
Aug 21 16:58:11.292208382 (311h31m52.023476002s) [upload=323881]: Waiting for error group managing segments...
Aug 21 16:58:11.305981536 (311h31m52.037249156s) [noise=true , address=104.36.82.11:4118 , piece_id=MFWA4J22CPFE4HEYFXZISYJDAKWCF3HEYHVCYKSFQY5N27QT2O6A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.317455457 (311h31m52.048723076s) [noise=true , address=77.90.31.11:4582 , piece_id=7I4O5F46N3EAAFKUSTBOA3DY5NF7PQHNILWM5GFZ5CEIGRZANDRQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.319650365 (311h31m52.050917985s) [noise=true , address=77.90.31.18:4812 , piece_id=GRFZT75OBWQBGFZ3I3QYOGWHIFXJCZHKOGQOG34ZW6QG7BNBNGBQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.320890678 (311h31m52.052158297s) [noise=true , address=104.36.82.49:4012 , piece_id=CQSJDRQSYII2TZ4IXSILK3IN4WMGVOJEHPQJBPWPYII5HQ7G2B3A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.325965804 (311h31m52.057233424s) [noise=true , address=77.90.31.15:4719 , piece_id=SQOIUIMMOLGQHURPXKR4E3SYUKDJDJNZ75Q4RXA3W2E4JOG5WXLQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.327860037 (311h31m52.059127667s) [noise=true , address=45.91.116.11:4142 , piece_id=FTHDX3KRMQV2VPJA42JPTD5LDPAQCC6C2D6ODRZ7M4ZASZDJCSYA, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.328132208 (311h31m52.059399828s) [noise=true , address=45.91.116.5:4312 , piece_id=QCY54KDIJ3SFLIE2X6KBQD2UIEWMGYBOL33JKFLWGXZGRTB42YQQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.330010401 (311h31m52.061278021s) [noise=true , address=77.90.31.10:4548 , piece_id=3IWDAKTWMTSIYUHS4YSHUGNPZXYIOTCE523RYZCYL2FEW226R45A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.335413914 (311h31m52.066681533s) [noise=true , address=77.90.31.13:4651 , piece_id=KVYWHATVMKX3WZB7UWCIPQ5TIXHLAO7TWECK4XRQDILQ4HOUSB3Q, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.341151935 (311h31m52.072419546s) [noise=true , address=104.36.82.9:4022 , piece_id=XHQFV3SHMAT7WOOWG6U5QRRO3VBLZUE2SV7N5N4IDWWB6MPAT7JA, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.348847890 (311h31m52.08011552s) [noise=true , address=104.36.82.6:4907 , piece_id=ZVU2TK7PXTZBHLLU657Q5U5BS33QIIGR5WBBUE23LMRWNYSGIJEQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.360184613 (311h31m52.091452233s) [noise=true , address=104.36.82.13:4209 , piece_id=AJ5OPQIYSANI4EFJQYTCSC4OYA2KV4PR23YNLROCLL62ZNT2CINQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.366983571 (311h31m52.098251201s) [noise=true , address=77.90.31.19:4851 , piece_id=YZ7SGALUQPTAHO5ZARMCVMADX5AGH6BQNCN5UTC74JPLPEWALEDQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.392521653 (311h31m52.123789274s) [noise=true , address=104.36.82.45:4917 , piece_id=HHWHHUVVM76NSJNSFRSV5L2TJM7WABLPY3UMVM7CEZM44NKMXRHQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.392540769 (311h31m52.123808399s) [seg_pos={0 0}, upload=323881]: Segment reached optimal threshold of 14 pieces.
Aug 21 16:58:11.392827879 (311h31m52.124095509s) [noise=true , address=104.36.82.14:4236 , piece_id=EOTHS7XHUD5YNTOQOVTFR6EIRGREL4VBL2KLS5LJVQJKTMRWWUVQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XaE29W27ym2RmuGdBvHeKcQZZEUbask1zsm9Bz8xLokZNGfcj): protocol: expected piece hash; context canceled; EOF
Aug 21 16:58:11.393068121 (311h31m52.124335742s) [noise=true , address=45.91.116.11:4141 , piece_id=6OUW5WSYNG5GABS6BH3NNP3WRPYAK3SOVJDSXLMPICFMSNWD3O3Q, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h1gxgVjoHUkjKXA5xhTowGKi9q6wZGyzg8eqKgMHqsxF1ut5P): protocol: write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection; write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection
Aug 21 16:58:11.393129707 (311h31m52.124397326s) [noise=true , address=79.127.205.234:4616 , piece_id=D3SSTIPP6BS4NL5IS3JTR6JTHG32VWVD6HIU27WB2HXRTI7SL4TQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuFfyFT8z7TwZZsBhMRPx8HtLBqELmEzxbbsuG9Ljg9KKz3rm): protocol: read tcp 5.161.89.252:61860->79.127.205.234:4616: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 16:58:11.393280721 (311h31m52.124548371s) [noise=true , address=104.36.82.7:4920 , piece_id=7LGSALS6MO7SEPNO5KGHKACZ6CSAMJMV2GYHYY6BBVGFOXHRLPSQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.393342206 (311h31m52.124609846s) [seg_pos={0 0}, upload=323881]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 21 16:58:11.393461841 (311h31m52.124729492s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 16:58:11.393467823 (311h31m52.124735463s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 16:58:11.446017719 (311h31m52.177285349s) [upload=323881]: Done uploading segments...
Aug 21 16:58:11.446031615 (311h31m52.177299245s) [upload=323881]: Upload finished. err: <nil>
Duration: 2.030007263s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
2 out of 15 is failed (threshold=6) [.....XX........] duration:
73.448113ms remote:
"tcp:54.243.86.28:443" response headers:
Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 17:08:04 GMT target:
https://www.storj.io/
FAIL (2025-08-21 17:12:49 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 73.472929ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................X................X...................] duration:
568.633932ms
FAIL (2025-08-21 17:12:23 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 21 16:58:11.097765980 (311h31m51.82903362s) [upload=323881]: Starting upload
Aug 21 16:58:11.097816425 (311h31m51.829084066s) [upload=323881]: Done starting upload
Aug 21 16:58:11.097974212 (311h31m51.829241862s) [upload=323881]: Uploading segments...
Aug 21 16:58:11.098124976 (311h31m51.829392606s) [upload=323881]: Got next segment. Inline: false
Aug 21 16:58:11.098190559 (311h31m51.829458199s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 16:58:11.098198244 (311h31m51.829465904s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 16:58:11.186959668 (311h31m51.918227288s) [seg_pos={0 0}, upload=323881]: Begin upload segment...
Aug 21 16:58:11.187010914 (311h31m51.918278574s) [seg_pos={0 0}, upload=323881]: Done begin upload segment.
Aug 21 16:58:11.187041721 (311h31m51.918309351s) [noise=true , address=45.91.116.5:4312 , piece_id=QCY54KDIJ3SFLIE2X6KBQD2UIEWMGYBOL33JKFLWGXZGRTB42YQQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187059065 (311h31m51.918326695s) [noise=true , address=104.36.82.49:4012 , piece_id=CQSJDRQSYII2TZ4IXSILK3IN4WMGVOJEHPQJBPWPYII5HQ7G2B3A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187096966 (311h31m51.918364587s) [noise=true , address=104.36.82.7:4920 , piece_id=7LGSALS6MO7SEPNO5KGHKACZ6CSAMJMV2GYHYY6BBVGFOXHRLPSQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187499954 (311h31m51.918767574s) [noise=true , address=77.90.31.19:4851 , piece_id=YZ7SGALUQPTAHO5ZARMCVMADX5AGH6BQNCN5UTC74JPLPEWALEDQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187516114 (311h31m51.918783745s) [noise=true , address=104.36.82.9:4022 , piece_id=XHQFV3SHMAT7WOOWG6U5QRRO3VBLZUE2SV7N5N4IDWWB6MPAT7JA, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187870982 (311h31m51.919138612s) [noise=true , address=77.90.31.10:4548 , piece_id=3IWDAKTWMTSIYUHS4YSHUGNPZXYIOTCE523RYZCYL2FEW226R45A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187878215 (311h31m51.919145845s) [noise=true , address=77.90.31.13:4651 , piece_id=KVYWHATVMKX3WZB7UWCIPQ5TIXHLAO7TWECK4XRQDILQ4HOUSB3Q, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188266736 (311h31m51.919534356s) [noise=true , address=104.36.82.13:4209 , piece_id=AJ5OPQIYSANI4EFJQYTCSC4OYA2KV4PR23YNLROCLL62ZNT2CINQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188291242 (311h31m51.919558873s) [noise=true , address=77.90.31.15:4719 , piece_id=SQOIUIMMOLGQHURPXKR4E3SYUKDJDJNZ75Q4RXA3W2E4JOG5WXLQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188643465 (311h31m51.919911095s) [noise=true , address=104.36.82.14:4236 , piece_id=EOTHS7XHUD5YNTOQOVTFR6EIRGREL4VBL2KLS5LJVQJKTMRWWUVQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188658473 (311h31m51.919926103s) [noise=true , address=104.36.82.11:4118 , piece_id=MFWA4J22CPFE4HEYFXZISYJDAKWCF3HEYHVCYKSFQY5N27QT2O6A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188993774 (311h31m51.920261394s) [noise=true , address=77.90.31.18:4812 , piece_id=GRFZT75OBWQBGFZ3I3QYOGWHIFXJCZHKOGQOG34ZW6QG7BNBNGBQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189017548 (311h31m51.920285178s) [noise=true , address=77.90.31.11:4582 , piece_id=7I4O5F46N3EAAFKUSTBOA3DY5NF7PQHNILWM5GFZ5CEIGRZANDRQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189365152 (311h31m51.920632782s) [noise=true , address=79.127.205.234:4616 , piece_id=D3SSTIPP6BS4NL5IS3JTR6JTHG32VWVD6HIU27WB2HXRTI7SL4TQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189952657 (311h31m51.921220287s) [noise=true , address=104.36.82.45:4917 , piece_id=HHWHHUVVM76NSJNSFRSV5L2TJM7WABLPY3UMVM7CEZM44NKMXRHQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.190704210 (311h31m51.92197184s) [noise=true , address=45.91.116.11:4142 , piece_id=FTHDX3KRMQV2VPJA42JPTD5LDPAQCC6C2D6ODRZ7M4ZASZDJCSYA, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.191563527 (311h31m51.922831157s) [noise=true , address=45.91.116.11:4141 , piece_id=6OUW5WSYNG5GABS6BH3NNP3WRPYAK3SOVJDSXLMPICFMSNWD3O3Q, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.192590128 (311h31m51.923857758s) [noise=true , address=104.36.82.6:4907 , piece_id=ZVU2TK7PXTZBHLLU657Q5U5BS33QIIGR5WBBUE23LMRWNYSGIJEQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.292199435 (311h31m52.023467055s) [upload=323881]: Next returned nil segment
Aug 21 16:58:11.292208382 (311h31m52.023476002s) [upload=323881]: Waiting for error group managing segments...
Aug 21 16:58:11.305981536 (311h31m52.037249156s) [noise=true , address=104.36.82.11:4118 , piece_id=MFWA4J22CPFE4HEYFXZISYJDAKWCF3HEYHVCYKSFQY5N27QT2O6A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.317455457 (311h31m52.048723076s) [noise=true , address=77.90.31.11:4582 , piece_id=7I4O5F46N3EAAFKUSTBOA3DY5NF7PQHNILWM5GFZ5CEIGRZANDRQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.319650365 (311h31m52.050917985s) [noise=true , address=77.90.31.18:4812 , piece_id=GRFZT75OBWQBGFZ3I3QYOGWHIFXJCZHKOGQOG34ZW6QG7BNBNGBQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.320890678 (311h31m52.052158297s) [noise=true , address=104.36.82.49:4012 , piece_id=CQSJDRQSYII2TZ4IXSILK3IN4WMGVOJEHPQJBPWPYII5HQ7G2B3A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.325965804 (311h31m52.057233424s) [noise=true , address=77.90.31.15:4719 , piece_id=SQOIUIMMOLGQHURPXKR4E3SYUKDJDJNZ75Q4RXA3W2E4JOG5WXLQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.327860037 (311h31m52.059127667s) [noise=true , address=45.91.116.11:4142 , piece_id=FTHDX3KRMQV2VPJA42JPTD5LDPAQCC6C2D6ODRZ7M4ZASZDJCSYA, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.328132208 (311h31m52.059399828s) [noise=true , address=45.91.116.5:4312 , piece_id=QCY54KDIJ3SFLIE2X6KBQD2UIEWMGYBOL33JKFLWGXZGRTB42YQQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.330010401 (311h31m52.061278021s) [noise=true , address=77.90.31.10:4548 , piece_id=3IWDAKTWMTSIYUHS4YSHUGNPZXYIOTCE523RYZCYL2FEW226R45A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.335413914 (311h31m52.066681533s) [noise=true , address=77.90.31.13:4651 , piece_id=KVYWHATVMKX3WZB7UWCIPQ5TIXHLAO7TWECK4XRQDILQ4HOUSB3Q, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.341151935 (311h31m52.072419546s) [noise=true , address=104.36.82.9:4022 , piece_id=XHQFV3SHMAT7WOOWG6U5QRRO3VBLZUE2SV7N5N4IDWWB6MPAT7JA, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.348847890 (311h31m52.08011552s) [noise=true , address=104.36.82.6:4907 , piece_id=ZVU2TK7PXTZBHLLU657Q5U5BS33QIIGR5WBBUE23LMRWNYSGIJEQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.360184613 (311h31m52.091452233s) [noise=true , address=104.36.82.13:4209 , piece_id=AJ5OPQIYSANI4EFJQYTCSC4OYA2KV4PR23YNLROCLL62ZNT2CINQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.366983571 (311h31m52.098251201s) [noise=true , address=77.90.31.19:4851 , piece_id=YZ7SGALUQPTAHO5ZARMCVMADX5AGH6BQNCN5UTC74JPLPEWALEDQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.392521653 (311h31m52.123789274s) [noise=true , address=104.36.82.45:4917 , piece_id=HHWHHUVVM76NSJNSFRSV5L2TJM7WABLPY3UMVM7CEZM44NKMXRHQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.392540769 (311h31m52.123808399s) [seg_pos={0 0}, upload=323881]: Segment reached optimal threshold of 14 pieces.
Aug 21 16:58:11.392827879 (311h31m52.124095509s) [noise=true , address=104.36.82.14:4236 , piece_id=EOTHS7XHUD5YNTOQOVTFR6EIRGREL4VBL2KLS5LJVQJKTMRWWUVQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XaE29W27ym2RmuGdBvHeKcQZZEUbask1zsm9Bz8xLokZNGfcj): protocol: expected piece hash; context canceled; EOF
Aug 21 16:58:11.393068121 (311h31m52.124335742s) [noise=true , address=45.91.116.11:4141 , piece_id=6OUW5WSYNG5GABS6BH3NNP3WRPYAK3SOVJDSXLMPICFMSNWD3O3Q, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h1gxgVjoHUkjKXA5xhTowGKi9q6wZGyzg8eqKgMHqsxF1ut5P): protocol: write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection; write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection
Aug 21 16:58:11.393129707 (311h31m52.124397326s) [noise=true , address=79.127.205.234:4616 , piece_id=D3SSTIPP6BS4NL5IS3JTR6JTHG32VWVD6HIU27WB2HXRTI7SL4TQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuFfyFT8z7TwZZsBhMRPx8HtLBqELmEzxbbsuG9Ljg9KKz3rm): protocol: read tcp 5.161.89.252:61860->79.127.205.234:4616: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 16:58:11.393280721 (311h31m52.124548371s) [noise=true , address=104.36.82.7:4920 , piece_id=7LGSALS6MO7SEPNO5KGHKACZ6CSAMJMV2GYHYY6BBVGFOXHRLPSQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.393342206 (311h31m52.124609846s) [seg_pos={0 0}, upload=323881]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 21 16:58:11.393461841 (311h31m52.124729492s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 16:58:11.393467823 (311h31m52.124735463s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 16:58:11.446017719 (311h31m52.177285349s) [upload=323881]: Done uploading segments...
Aug 21 16:58:11.446031615 (311h31m52.177299245s) [upload=323881]: Upload finished. err: <nil>
Duration: 568.658379ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
2 out of 15 is failed (threshold=6) [......XX.......] duration:
82.440948ms remote:
"tcp:54.243.86.28:443" response headers:
Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 17:08:04 GMT target:
https://www.storj.io/
FAIL (2025-08-21 17:11:46 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 82.453199ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................X................X..................] duration:
500.341054ms
FAIL (2025-08-21 17:11:43 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 21 16:58:11.097765980 (311h31m51.82903362s) [upload=323881]: Starting upload
Aug 21 16:58:11.097816425 (311h31m51.829084066s) [upload=323881]: Done starting upload
Aug 21 16:58:11.097974212 (311h31m51.829241862s) [upload=323881]: Uploading segments...
Aug 21 16:58:11.098124976 (311h31m51.829392606s) [upload=323881]: Got next segment. Inline: false
Aug 21 16:58:11.098190559 (311h31m51.829458199s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 16:58:11.098198244 (311h31m51.829465904s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 16:58:11.186959668 (311h31m51.918227288s) [seg_pos={0 0}, upload=323881]: Begin upload segment...
Aug 21 16:58:11.187010914 (311h31m51.918278574s) [seg_pos={0 0}, upload=323881]: Done begin upload segment.
Aug 21 16:58:11.187041721 (311h31m51.918309351s) [noise=true , address=45.91.116.5:4312 , piece_id=QCY54KDIJ3SFLIE2X6KBQD2UIEWMGYBOL33JKFLWGXZGRTB42YQQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187059065 (311h31m51.918326695s) [noise=true , address=104.36.82.49:4012 , piece_id=CQSJDRQSYII2TZ4IXSILK3IN4WMGVOJEHPQJBPWPYII5HQ7G2B3A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187096966 (311h31m51.918364587s) [noise=true , address=104.36.82.7:4920 , piece_id=7LGSALS6MO7SEPNO5KGHKACZ6CSAMJMV2GYHYY6BBVGFOXHRLPSQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187499954 (311h31m51.918767574s) [noise=true , address=77.90.31.19:4851 , piece_id=YZ7SGALUQPTAHO5ZARMCVMADX5AGH6BQNCN5UTC74JPLPEWALEDQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187516114 (311h31m51.918783745s) [noise=true , address=104.36.82.9:4022 , piece_id=XHQFV3SHMAT7WOOWG6U5QRRO3VBLZUE2SV7N5N4IDWWB6MPAT7JA, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187870982 (311h31m51.919138612s) [noise=true , address=77.90.31.10:4548 , piece_id=3IWDAKTWMTSIYUHS4YSHUGNPZXYIOTCE523RYZCYL2FEW226R45A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187878215 (311h31m51.919145845s) [noise=true , address=77.90.31.13:4651 , piece_id=KVYWHATVMKX3WZB7UWCIPQ5TIXHLAO7TWECK4XRQDILQ4HOUSB3Q, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188266736 (311h31m51.919534356s) [noise=true , address=104.36.82.13:4209 , piece_id=AJ5OPQIYSANI4EFJQYTCSC4OYA2KV4PR23YNLROCLL62ZNT2CINQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188291242 (311h31m51.919558873s) [noise=true , address=77.90.31.15:4719 , piece_id=SQOIUIMMOLGQHURPXKR4E3SYUKDJDJNZ75Q4RXA3W2E4JOG5WXLQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188643465 (311h31m51.919911095s) [noise=true , address=104.36.82.14:4236 , piece_id=EOTHS7XHUD5YNTOQOVTFR6EIRGREL4VBL2KLS5LJVQJKTMRWWUVQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188658473 (311h31m51.919926103s) [noise=true , address=104.36.82.11:4118 , piece_id=MFWA4J22CPFE4HEYFXZISYJDAKWCF3HEYHVCYKSFQY5N27QT2O6A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188993774 (311h31m51.920261394s) [noise=true , address=77.90.31.18:4812 , piece_id=GRFZT75OBWQBGFZ3I3QYOGWHIFXJCZHKOGQOG34ZW6QG7BNBNGBQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189017548 (311h31m51.920285178s) [noise=true , address=77.90.31.11:4582 , piece_id=7I4O5F46N3EAAFKUSTBOA3DY5NF7PQHNILWM5GFZ5CEIGRZANDRQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189365152 (311h31m51.920632782s) [noise=true , address=79.127.205.234:4616 , piece_id=D3SSTIPP6BS4NL5IS3JTR6JTHG32VWVD6HIU27WB2HXRTI7SL4TQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189952657 (311h31m51.921220287s) [noise=true , address=104.36.82.45:4917 , piece_id=HHWHHUVVM76NSJNSFRSV5L2TJM7WABLPY3UMVM7CEZM44NKMXRHQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.190704210 (311h31m51.92197184s) [noise=true , address=45.91.116.11:4142 , piece_id=FTHDX3KRMQV2VPJA42JPTD5LDPAQCC6C2D6ODRZ7M4ZASZDJCSYA, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.191563527 (311h31m51.922831157s) [noise=true , address=45.91.116.11:4141 , piece_id=6OUW5WSYNG5GABS6BH3NNP3WRPYAK3SOVJDSXLMPICFMSNWD3O3Q, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.192590128 (311h31m51.923857758s) [noise=true , address=104.36.82.6:4907 , piece_id=ZVU2TK7PXTZBHLLU657Q5U5BS33QIIGR5WBBUE23LMRWNYSGIJEQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.292199435 (311h31m52.023467055s) [upload=323881]: Next returned nil segment
Aug 21 16:58:11.292208382 (311h31m52.023476002s) [upload=323881]: Waiting for error group managing segments...
Aug 21 16:58:11.305981536 (311h31m52.037249156s) [noise=true , address=104.36.82.11:4118 , piece_id=MFWA4J22CPFE4HEYFXZISYJDAKWCF3HEYHVCYKSFQY5N27QT2O6A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.317455457 (311h31m52.048723076s) [noise=true , address=77.90.31.11:4582 , piece_id=7I4O5F46N3EAAFKUSTBOA3DY5NF7PQHNILWM5GFZ5CEIGRZANDRQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.319650365 (311h31m52.050917985s) [noise=true , address=77.90.31.18:4812 , piece_id=GRFZT75OBWQBGFZ3I3QYOGWHIFXJCZHKOGQOG34ZW6QG7BNBNGBQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.320890678 (311h31m52.052158297s) [noise=true , address=104.36.82.49:4012 , piece_id=CQSJDRQSYII2TZ4IXSILK3IN4WMGVOJEHPQJBPWPYII5HQ7G2B3A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.325965804 (311h31m52.057233424s) [noise=true , address=77.90.31.15:4719 , piece_id=SQOIUIMMOLGQHURPXKR4E3SYUKDJDJNZ75Q4RXA3W2E4JOG5WXLQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.327860037 (311h31m52.059127667s) [noise=true , address=45.91.116.11:4142 , piece_id=FTHDX3KRMQV2VPJA42JPTD5LDPAQCC6C2D6ODRZ7M4ZASZDJCSYA, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.328132208 (311h31m52.059399828s) [noise=true , address=45.91.116.5:4312 , piece_id=QCY54KDIJ3SFLIE2X6KBQD2UIEWMGYBOL33JKFLWGXZGRTB42YQQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.330010401 (311h31m52.061278021s) [noise=true , address=77.90.31.10:4548 , piece_id=3IWDAKTWMTSIYUHS4YSHUGNPZXYIOTCE523RYZCYL2FEW226R45A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.335413914 (311h31m52.066681533s) [noise=true , address=77.90.31.13:4651 , piece_id=KVYWHATVMKX3WZB7UWCIPQ5TIXHLAO7TWECK4XRQDILQ4HOUSB3Q, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.341151935 (311h31m52.072419546s) [noise=true , address=104.36.82.9:4022 , piece_id=XHQFV3SHMAT7WOOWG6U5QRRO3VBLZUE2SV7N5N4IDWWB6MPAT7JA, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.348847890 (311h31m52.08011552s) [noise=true , address=104.36.82.6:4907 , piece_id=ZVU2TK7PXTZBHLLU657Q5U5BS33QIIGR5WBBUE23LMRWNYSGIJEQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.360184613 (311h31m52.091452233s) [noise=true , address=104.36.82.13:4209 , piece_id=AJ5OPQIYSANI4EFJQYTCSC4OYA2KV4PR23YNLROCLL62ZNT2CINQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.366983571 (311h31m52.098251201s) [noise=true , address=77.90.31.19:4851 , piece_id=YZ7SGALUQPTAHO5ZARMCVMADX5AGH6BQNCN5UTC74JPLPEWALEDQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.392521653 (311h31m52.123789274s) [noise=true , address=104.36.82.45:4917 , piece_id=HHWHHUVVM76NSJNSFRSV5L2TJM7WABLPY3UMVM7CEZM44NKMXRHQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.392540769 (311h31m52.123808399s) [seg_pos={0 0}, upload=323881]: Segment reached optimal threshold of 14 pieces.
Aug 21 16:58:11.392827879 (311h31m52.124095509s) [noise=true , address=104.36.82.14:4236 , piece_id=EOTHS7XHUD5YNTOQOVTFR6EIRGREL4VBL2KLS5LJVQJKTMRWWUVQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XaE29W27ym2RmuGdBvHeKcQZZEUbask1zsm9Bz8xLokZNGfcj): protocol: expected piece hash; context canceled; EOF
Aug 21 16:58:11.393068121 (311h31m52.124335742s) [noise=true , address=45.91.116.11:4141 , piece_id=6OUW5WSYNG5GABS6BH3NNP3WRPYAK3SOVJDSXLMPICFMSNWD3O3Q, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h1gxgVjoHUkjKXA5xhTowGKi9q6wZGyzg8eqKgMHqsxF1ut5P): protocol: write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection; write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection
Aug 21 16:58:11.393129707 (311h31m52.124397326s) [noise=true , address=79.127.205.234:4616 , piece_id=D3SSTIPP6BS4NL5IS3JTR6JTHG32VWVD6HIU27WB2HXRTI7SL4TQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuFfyFT8z7TwZZsBhMRPx8HtLBqELmEzxbbsuG9Ljg9KKz3rm): protocol: read tcp 5.161.89.252:61860->79.127.205.234:4616: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 16:58:11.393280721 (311h31m52.124548371s) [noise=true , address=104.36.82.7:4920 , piece_id=7LGSALS6MO7SEPNO5KGHKACZ6CSAMJMV2GYHYY6BBVGFOXHRLPSQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.393342206 (311h31m52.124609846s) [seg_pos={0 0}, upload=323881]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 21 16:58:11.393461841 (311h31m52.124729492s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 16:58:11.393467823 (311h31m52.124735463s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 16:58:11.446017719 (311h31m52.177285349s) [upload=323881]: Done uploading segments...
Aug 21 16:58:11.446031615 (311h31m52.177299245s) [upload=323881]: Upload finished. err: <nil>
Duration: 500.38162ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
2 out of 15 is failed (threshold=6) [.......XX......] duration:
97.880466ms remote:
"tcp:54.243.86.28:443" response headers:
Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 17:08:04 GMT target:
https://www.storj.io/
FAIL (2025-08-21 17:11:28 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 97.899542ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................X................X.................] duration:
798.820487ms
FAIL (2025-08-21 17:11:17 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 21 16:58:11.097765980 (311h31m51.82903362s) [upload=323881]: Starting upload
Aug 21 16:58:11.097816425 (311h31m51.829084066s) [upload=323881]: Done starting upload
Aug 21 16:58:11.097974212 (311h31m51.829241862s) [upload=323881]: Uploading segments...
Aug 21 16:58:11.098124976 (311h31m51.829392606s) [upload=323881]: Got next segment. Inline: false
Aug 21 16:58:11.098190559 (311h31m51.829458199s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 16:58:11.098198244 (311h31m51.829465904s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 16:58:11.186959668 (311h31m51.918227288s) [seg_pos={0 0}, upload=323881]: Begin upload segment...
Aug 21 16:58:11.187010914 (311h31m51.918278574s) [seg_pos={0 0}, upload=323881]: Done begin upload segment.
Aug 21 16:58:11.187041721 (311h31m51.918309351s) [noise=true , address=45.91.116.5:4312 , piece_id=QCY54KDIJ3SFLIE2X6KBQD2UIEWMGYBOL33JKFLWGXZGRTB42YQQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187059065 (311h31m51.918326695s) [noise=true , address=104.36.82.49:4012 , piece_id=CQSJDRQSYII2TZ4IXSILK3IN4WMGVOJEHPQJBPWPYII5HQ7G2B3A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187096966 (311h31m51.918364587s) [noise=true , address=104.36.82.7:4920 , piece_id=7LGSALS6MO7SEPNO5KGHKACZ6CSAMJMV2GYHYY6BBVGFOXHRLPSQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187499954 (311h31m51.918767574s) [noise=true , address=77.90.31.19:4851 , piece_id=YZ7SGALUQPTAHO5ZARMCVMADX5AGH6BQNCN5UTC74JPLPEWALEDQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187516114 (311h31m51.918783745s) [noise=true , address=104.36.82.9:4022 , piece_id=XHQFV3SHMAT7WOOWG6U5QRRO3VBLZUE2SV7N5N4IDWWB6MPAT7JA, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187870982 (311h31m51.919138612s) [noise=true , address=77.90.31.10:4548 , piece_id=3IWDAKTWMTSIYUHS4YSHUGNPZXYIOTCE523RYZCYL2FEW226R45A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187878215 (311h31m51.919145845s) [noise=true , address=77.90.31.13:4651 , piece_id=KVYWHATVMKX3WZB7UWCIPQ5TIXHLAO7TWECK4XRQDILQ4HOUSB3Q, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188266736 (311h31m51.919534356s) [noise=true , address=104.36.82.13:4209 , piece_id=AJ5OPQIYSANI4EFJQYTCSC4OYA2KV4PR23YNLROCLL62ZNT2CINQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188291242 (311h31m51.919558873s) [noise=true , address=77.90.31.15:4719 , piece_id=SQOIUIMMOLGQHURPXKR4E3SYUKDJDJNZ75Q4RXA3W2E4JOG5WXLQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188643465 (311h31m51.919911095s) [noise=true , address=104.36.82.14:4236 , piece_id=EOTHS7XHUD5YNTOQOVTFR6EIRGREL4VBL2KLS5LJVQJKTMRWWUVQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188658473 (311h31m51.919926103s) [noise=true , address=104.36.82.11:4118 , piece_id=MFWA4J22CPFE4HEYFXZISYJDAKWCF3HEYHVCYKSFQY5N27QT2O6A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188993774 (311h31m51.920261394s) [noise=true , address=77.90.31.18:4812 , piece_id=GRFZT75OBWQBGFZ3I3QYOGWHIFXJCZHKOGQOG34ZW6QG7BNBNGBQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189017548 (311h31m51.920285178s) [noise=true , address=77.90.31.11:4582 , piece_id=7I4O5F46N3EAAFKUSTBOA3DY5NF7PQHNILWM5GFZ5CEIGRZANDRQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189365152 (311h31m51.920632782s) [noise=true , address=79.127.205.234:4616 , piece_id=D3SSTIPP6BS4NL5IS3JTR6JTHG32VWVD6HIU27WB2HXRTI7SL4TQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189952657 (311h31m51.921220287s) [noise=true , address=104.36.82.45:4917 , piece_id=HHWHHUVVM76NSJNSFRSV5L2TJM7WABLPY3UMVM7CEZM44NKMXRHQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.190704210 (311h31m51.92197184s) [noise=true , address=45.91.116.11:4142 , piece_id=FTHDX3KRMQV2VPJA42JPTD5LDPAQCC6C2D6ODRZ7M4ZASZDJCSYA, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.191563527 (311h31m51.922831157s) [noise=true , address=45.91.116.11:4141 , piece_id=6OUW5WSYNG5GABS6BH3NNP3WRPYAK3SOVJDSXLMPICFMSNWD3O3Q, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.192590128 (311h31m51.923857758s) [noise=true , address=104.36.82.6:4907 , piece_id=ZVU2TK7PXTZBHLLU657Q5U5BS33QIIGR5WBBUE23LMRWNYSGIJEQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.292199435 (311h31m52.023467055s) [upload=323881]: Next returned nil segment
Aug 21 16:58:11.292208382 (311h31m52.023476002s) [upload=323881]: Waiting for error group managing segments...
Aug 21 16:58:11.305981536 (311h31m52.037249156s) [noise=true , address=104.36.82.11:4118 , piece_id=MFWA4J22CPFE4HEYFXZISYJDAKWCF3HEYHVCYKSFQY5N27QT2O6A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.317455457 (311h31m52.048723076s) [noise=true , address=77.90.31.11:4582 , piece_id=7I4O5F46N3EAAFKUSTBOA3DY5NF7PQHNILWM5GFZ5CEIGRZANDRQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.319650365 (311h31m52.050917985s) [noise=true , address=77.90.31.18:4812 , piece_id=GRFZT75OBWQBGFZ3I3QYOGWHIFXJCZHKOGQOG34ZW6QG7BNBNGBQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.320890678 (311h31m52.052158297s) [noise=true , address=104.36.82.49:4012 , piece_id=CQSJDRQSYII2TZ4IXSILK3IN4WMGVOJEHPQJBPWPYII5HQ7G2B3A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.325965804 (311h31m52.057233424s) [noise=true , address=77.90.31.15:4719 , piece_id=SQOIUIMMOLGQHURPXKR4E3SYUKDJDJNZ75Q4RXA3W2E4JOG5WXLQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.327860037 (311h31m52.059127667s) [noise=true , address=45.91.116.11:4142 , piece_id=FTHDX3KRMQV2VPJA42JPTD5LDPAQCC6C2D6ODRZ7M4ZASZDJCSYA, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.328132208 (311h31m52.059399828s) [noise=true , address=45.91.116.5:4312 , piece_id=QCY54KDIJ3SFLIE2X6KBQD2UIEWMGYBOL33JKFLWGXZGRTB42YQQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.330010401 (311h31m52.061278021s) [noise=true , address=77.90.31.10:4548 , piece_id=3IWDAKTWMTSIYUHS4YSHUGNPZXYIOTCE523RYZCYL2FEW226R45A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.335413914 (311h31m52.066681533s) [noise=true , address=77.90.31.13:4651 , piece_id=KVYWHATVMKX3WZB7UWCIPQ5TIXHLAO7TWECK4XRQDILQ4HOUSB3Q, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.341151935 (311h31m52.072419546s) [noise=true , address=104.36.82.9:4022 , piece_id=XHQFV3SHMAT7WOOWG6U5QRRO3VBLZUE2SV7N5N4IDWWB6MPAT7JA, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.348847890 (311h31m52.08011552s) [noise=true , address=104.36.82.6:4907 , piece_id=ZVU2TK7PXTZBHLLU657Q5U5BS33QIIGR5WBBUE23LMRWNYSGIJEQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.360184613 (311h31m52.091452233s) [noise=true , address=104.36.82.13:4209 , piece_id=AJ5OPQIYSANI4EFJQYTCSC4OYA2KV4PR23YNLROCLL62ZNT2CINQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.366983571 (311h31m52.098251201s) [noise=true , address=77.90.31.19:4851 , piece_id=YZ7SGALUQPTAHO5ZARMCVMADX5AGH6BQNCN5UTC74JPLPEWALEDQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.392521653 (311h31m52.123789274s) [noise=true , address=104.36.82.45:4917 , piece_id=HHWHHUVVM76NSJNSFRSV5L2TJM7WABLPY3UMVM7CEZM44NKMXRHQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.392540769 (311h31m52.123808399s) [seg_pos={0 0}, upload=323881]: Segment reached optimal threshold of 14 pieces.
Aug 21 16:58:11.392827879 (311h31m52.124095509s) [noise=true , address=104.36.82.14:4236 , piece_id=EOTHS7XHUD5YNTOQOVTFR6EIRGREL4VBL2KLS5LJVQJKTMRWWUVQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XaE29W27ym2RmuGdBvHeKcQZZEUbask1zsm9Bz8xLokZNGfcj): protocol: expected piece hash; context canceled; EOF
Aug 21 16:58:11.393068121 (311h31m52.124335742s) [noise=true , address=45.91.116.11:4141 , piece_id=6OUW5WSYNG5GABS6BH3NNP3WRPYAK3SOVJDSXLMPICFMSNWD3O3Q, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h1gxgVjoHUkjKXA5xhTowGKi9q6wZGyzg8eqKgMHqsxF1ut5P): protocol: write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection; write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection
Aug 21 16:58:11.393129707 (311h31m52.124397326s) [noise=true , address=79.127.205.234:4616 , piece_id=D3SSTIPP6BS4NL5IS3JTR6JTHG32VWVD6HIU27WB2HXRTI7SL4TQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuFfyFT8z7TwZZsBhMRPx8HtLBqELmEzxbbsuG9Ljg9KKz3rm): protocol: read tcp 5.161.89.252:61860->79.127.205.234:4616: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 16:58:11.393280721 (311h31m52.124548371s) [noise=true , address=104.36.82.7:4920 , piece_id=7LGSALS6MO7SEPNO5KGHKACZ6CSAMJMV2GYHYY6BBVGFOXHRLPSQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.393342206 (311h31m52.124609846s) [seg_pos={0 0}, upload=323881]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 21 16:58:11.393461841 (311h31m52.124729492s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 16:58:11.393467823 (311h31m52.124735463s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 16:58:11.446017719 (311h31m52.177285349s) [upload=323881]: Done uploading segments...
Aug 21 16:58:11.446031615 (311h31m52.177299245s) [upload=323881]: Upload finished. err: <nil>
Duration: 798.840305ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
2 out of 15 is failed (threshold=6) [........XX.....] duration:
76.316609ms remote:
"tcp:54.243.86.28:443" response headers:
Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 17:08:04 GMT target:
https://www.storj.io/
FAIL (2025-08-21 17:11:03 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 76.343169ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................X................X................] duration:
493.218899ms
FAIL (2025-08-21 17:10:36 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 21 16:58:11.097765980 (311h31m51.82903362s) [upload=323881]: Starting upload
Aug 21 16:58:11.097816425 (311h31m51.829084066s) [upload=323881]: Done starting upload
Aug 21 16:58:11.097974212 (311h31m51.829241862s) [upload=323881]: Uploading segments...
Aug 21 16:58:11.098124976 (311h31m51.829392606s) [upload=323881]: Got next segment. Inline: false
Aug 21 16:58:11.098190559 (311h31m51.829458199s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 16:58:11.098198244 (311h31m51.829465904s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 16:58:11.186959668 (311h31m51.918227288s) [seg_pos={0 0}, upload=323881]: Begin upload segment...
Aug 21 16:58:11.187010914 (311h31m51.918278574s) [seg_pos={0 0}, upload=323881]: Done begin upload segment.
Aug 21 16:58:11.187041721 (311h31m51.918309351s) [noise=true , address=45.91.116.5:4312 , piece_id=QCY54KDIJ3SFLIE2X6KBQD2UIEWMGYBOL33JKFLWGXZGRTB42YQQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187059065 (311h31m51.918326695s) [noise=true , address=104.36.82.49:4012 , piece_id=CQSJDRQSYII2TZ4IXSILK3IN4WMGVOJEHPQJBPWPYII5HQ7G2B3A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187096966 (311h31m51.918364587s) [noise=true , address=104.36.82.7:4920 , piece_id=7LGSALS6MO7SEPNO5KGHKACZ6CSAMJMV2GYHYY6BBVGFOXHRLPSQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187499954 (311h31m51.918767574s) [noise=true , address=77.90.31.19:4851 , piece_id=YZ7SGALUQPTAHO5ZARMCVMADX5AGH6BQNCN5UTC74JPLPEWALEDQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187516114 (311h31m51.918783745s) [noise=true , address=104.36.82.9:4022 , piece_id=XHQFV3SHMAT7WOOWG6U5QRRO3VBLZUE2SV7N5N4IDWWB6MPAT7JA, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187870982 (311h31m51.919138612s) [noise=true , address=77.90.31.10:4548 , piece_id=3IWDAKTWMTSIYUHS4YSHUGNPZXYIOTCE523RYZCYL2FEW226R45A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187878215 (311h31m51.919145845s) [noise=true , address=77.90.31.13:4651 , piece_id=KVYWHATVMKX3WZB7UWCIPQ5TIXHLAO7TWECK4XRQDILQ4HOUSB3Q, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188266736 (311h31m51.919534356s) [noise=true , address=104.36.82.13:4209 , piece_id=AJ5OPQIYSANI4EFJQYTCSC4OYA2KV4PR23YNLROCLL62ZNT2CINQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188291242 (311h31m51.919558873s) [noise=true , address=77.90.31.15:4719 , piece_id=SQOIUIMMOLGQHURPXKR4E3SYUKDJDJNZ75Q4RXA3W2E4JOG5WXLQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188643465 (311h31m51.919911095s) [noise=true , address=104.36.82.14:4236 , piece_id=EOTHS7XHUD5YNTOQOVTFR6EIRGREL4VBL2KLS5LJVQJKTMRWWUVQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188658473 (311h31m51.919926103s) [noise=true , address=104.36.82.11:4118 , piece_id=MFWA4J22CPFE4HEYFXZISYJDAKWCF3HEYHVCYKSFQY5N27QT2O6A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188993774 (311h31m51.920261394s) [noise=true , address=77.90.31.18:4812 , piece_id=GRFZT75OBWQBGFZ3I3QYOGWHIFXJCZHKOGQOG34ZW6QG7BNBNGBQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189017548 (311h31m51.920285178s) [noise=true , address=77.90.31.11:4582 , piece_id=7I4O5F46N3EAAFKUSTBOA3DY5NF7PQHNILWM5GFZ5CEIGRZANDRQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189365152 (311h31m51.920632782s) [noise=true , address=79.127.205.234:4616 , piece_id=D3SSTIPP6BS4NL5IS3JTR6JTHG32VWVD6HIU27WB2HXRTI7SL4TQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189952657 (311h31m51.921220287s) [noise=true , address=104.36.82.45:4917 , piece_id=HHWHHUVVM76NSJNSFRSV5L2TJM7WABLPY3UMVM7CEZM44NKMXRHQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.190704210 (311h31m51.92197184s) [noise=true , address=45.91.116.11:4142 , piece_id=FTHDX3KRMQV2VPJA42JPTD5LDPAQCC6C2D6ODRZ7M4ZASZDJCSYA, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.191563527 (311h31m51.922831157s) [noise=true , address=45.91.116.11:4141 , piece_id=6OUW5WSYNG5GABS6BH3NNP3WRPYAK3SOVJDSXLMPICFMSNWD3O3Q, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.192590128 (311h31m51.923857758s) [noise=true , address=104.36.82.6:4907 , piece_id=ZVU2TK7PXTZBHLLU657Q5U5BS33QIIGR5WBBUE23LMRWNYSGIJEQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.292199435 (311h31m52.023467055s) [upload=323881]: Next returned nil segment
Aug 21 16:58:11.292208382 (311h31m52.023476002s) [upload=323881]: Waiting for error group managing segments...
Aug 21 16:58:11.305981536 (311h31m52.037249156s) [noise=true , address=104.36.82.11:4118 , piece_id=MFWA4J22CPFE4HEYFXZISYJDAKWCF3HEYHVCYKSFQY5N27QT2O6A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.317455457 (311h31m52.048723076s) [noise=true , address=77.90.31.11:4582 , piece_id=7I4O5F46N3EAAFKUSTBOA3DY5NF7PQHNILWM5GFZ5CEIGRZANDRQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.319650365 (311h31m52.050917985s) [noise=true , address=77.90.31.18:4812 , piece_id=GRFZT75OBWQBGFZ3I3QYOGWHIFXJCZHKOGQOG34ZW6QG7BNBNGBQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.320890678 (311h31m52.052158297s) [noise=true , address=104.36.82.49:4012 , piece_id=CQSJDRQSYII2TZ4IXSILK3IN4WMGVOJEHPQJBPWPYII5HQ7G2B3A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.325965804 (311h31m52.057233424s) [noise=true , address=77.90.31.15:4719 , piece_id=SQOIUIMMOLGQHURPXKR4E3SYUKDJDJNZ75Q4RXA3W2E4JOG5WXLQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.327860037 (311h31m52.059127667s) [noise=true , address=45.91.116.11:4142 , piece_id=FTHDX3KRMQV2VPJA42JPTD5LDPAQCC6C2D6ODRZ7M4ZASZDJCSYA, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.328132208 (311h31m52.059399828s) [noise=true , address=45.91.116.5:4312 , piece_id=QCY54KDIJ3SFLIE2X6KBQD2UIEWMGYBOL33JKFLWGXZGRTB42YQQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.330010401 (311h31m52.061278021s) [noise=true , address=77.90.31.10:4548 , piece_id=3IWDAKTWMTSIYUHS4YSHUGNPZXYIOTCE523RYZCYL2FEW226R45A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.335413914 (311h31m52.066681533s) [noise=true , address=77.90.31.13:4651 , piece_id=KVYWHATVMKX3WZB7UWCIPQ5TIXHLAO7TWECK4XRQDILQ4HOUSB3Q, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.341151935 (311h31m52.072419546s) [noise=true , address=104.36.82.9:4022 , piece_id=XHQFV3SHMAT7WOOWG6U5QRRO3VBLZUE2SV7N5N4IDWWB6MPAT7JA, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.348847890 (311h31m52.08011552s) [noise=true , address=104.36.82.6:4907 , piece_id=ZVU2TK7PXTZBHLLU657Q5U5BS33QIIGR5WBBUE23LMRWNYSGIJEQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.360184613 (311h31m52.091452233s) [noise=true , address=104.36.82.13:4209 , piece_id=AJ5OPQIYSANI4EFJQYTCSC4OYA2KV4PR23YNLROCLL62ZNT2CINQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.366983571 (311h31m52.098251201s) [noise=true , address=77.90.31.19:4851 , piece_id=YZ7SGALUQPTAHO5ZARMCVMADX5AGH6BQNCN5UTC74JPLPEWALEDQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.392521653 (311h31m52.123789274s) [noise=true , address=104.36.82.45:4917 , piece_id=HHWHHUVVM76NSJNSFRSV5L2TJM7WABLPY3UMVM7CEZM44NKMXRHQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.392540769 (311h31m52.123808399s) [seg_pos={0 0}, upload=323881]: Segment reached optimal threshold of 14 pieces.
Aug 21 16:58:11.392827879 (311h31m52.124095509s) [noise=true , address=104.36.82.14:4236 , piece_id=EOTHS7XHUD5YNTOQOVTFR6EIRGREL4VBL2KLS5LJVQJKTMRWWUVQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XaE29W27ym2RmuGdBvHeKcQZZEUbask1zsm9Bz8xLokZNGfcj): protocol: expected piece hash; context canceled; EOF
Aug 21 16:58:11.393068121 (311h31m52.124335742s) [noise=true , address=45.91.116.11:4141 , piece_id=6OUW5WSYNG5GABS6BH3NNP3WRPYAK3SOVJDSXLMPICFMSNWD3O3Q, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h1gxgVjoHUkjKXA5xhTowGKi9q6wZGyzg8eqKgMHqsxF1ut5P): protocol: write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection; write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection
Aug 21 16:58:11.393129707 (311h31m52.124397326s) [noise=true , address=79.127.205.234:4616 , piece_id=D3SSTIPP6BS4NL5IS3JTR6JTHG32VWVD6HIU27WB2HXRTI7SL4TQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuFfyFT8z7TwZZsBhMRPx8HtLBqELmEzxbbsuG9Ljg9KKz3rm): protocol: read tcp 5.161.89.252:61860->79.127.205.234:4616: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 16:58:11.393280721 (311h31m52.124548371s) [noise=true , address=104.36.82.7:4920 , piece_id=7LGSALS6MO7SEPNO5KGHKACZ6CSAMJMV2GYHYY6BBVGFOXHRLPSQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.393342206 (311h31m52.124609846s) [seg_pos={0 0}, upload=323881]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 21 16:58:11.393461841 (311h31m52.124729492s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 16:58:11.393467823 (311h31m52.124735463s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 16:58:11.446017719 (311h31m52.177285349s) [upload=323881]: Done uploading segments...
Aug 21 16:58:11.446031615 (311h31m52.177299245s) [upload=323881]: Upload finished. err: <nil>
Duration: 493.30913ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
2 out of 15 is failed (threshold=6) [.........XX....] duration:
97.125245ms remote:
"tcp:54.243.86.28:443" response headers:
Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 17:08:04 GMT target:
https://www.storj.io/
FAIL (2025-08-21 17:10:09 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 97.141806ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................X................X...............] duration:
1.816274331s
FAIL (2025-08-21 17:09:51 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 21 16:58:11.097765980 (311h31m51.82903362s) [upload=323881]: Starting upload
Aug 21 16:58:11.097816425 (311h31m51.829084066s) [upload=323881]: Done starting upload
Aug 21 16:58:11.097974212 (311h31m51.829241862s) [upload=323881]: Uploading segments...
Aug 21 16:58:11.098124976 (311h31m51.829392606s) [upload=323881]: Got next segment. Inline: false
Aug 21 16:58:11.098190559 (311h31m51.829458199s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 16:58:11.098198244 (311h31m51.829465904s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 16:58:11.186959668 (311h31m51.918227288s) [seg_pos={0 0}, upload=323881]: Begin upload segment...
Aug 21 16:58:11.187010914 (311h31m51.918278574s) [seg_pos={0 0}, upload=323881]: Done begin upload segment.
Aug 21 16:58:11.187041721 (311h31m51.918309351s) [noise=true , address=45.91.116.5:4312 , piece_id=QCY54KDIJ3SFLIE2X6KBQD2UIEWMGYBOL33JKFLWGXZGRTB42YQQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187059065 (311h31m51.918326695s) [noise=true , address=104.36.82.49:4012 , piece_id=CQSJDRQSYII2TZ4IXSILK3IN4WMGVOJEHPQJBPWPYII5HQ7G2B3A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187096966 (311h31m51.918364587s) [noise=true , address=104.36.82.7:4920 , piece_id=7LGSALS6MO7SEPNO5KGHKACZ6CSAMJMV2GYHYY6BBVGFOXHRLPSQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187499954 (311h31m51.918767574s) [noise=true , address=77.90.31.19:4851 , piece_id=YZ7SGALUQPTAHO5ZARMCVMADX5AGH6BQNCN5UTC74JPLPEWALEDQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187516114 (311h31m51.918783745s) [noise=true , address=104.36.82.9:4022 , piece_id=XHQFV3SHMAT7WOOWG6U5QRRO3VBLZUE2SV7N5N4IDWWB6MPAT7JA, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187870982 (311h31m51.919138612s) [noise=true , address=77.90.31.10:4548 , piece_id=3IWDAKTWMTSIYUHS4YSHUGNPZXYIOTCE523RYZCYL2FEW226R45A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187878215 (311h31m51.919145845s) [noise=true , address=77.90.31.13:4651 , piece_id=KVYWHATVMKX3WZB7UWCIPQ5TIXHLAO7TWECK4XRQDILQ4HOUSB3Q, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188266736 (311h31m51.919534356s) [noise=true , address=104.36.82.13:4209 , piece_id=AJ5OPQIYSANI4EFJQYTCSC4OYA2KV4PR23YNLROCLL62ZNT2CINQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188291242 (311h31m51.919558873s) [noise=true , address=77.90.31.15:4719 , piece_id=SQOIUIMMOLGQHURPXKR4E3SYUKDJDJNZ75Q4RXA3W2E4JOG5WXLQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188643465 (311h31m51.919911095s) [noise=true , address=104.36.82.14:4236 , piece_id=EOTHS7XHUD5YNTOQOVTFR6EIRGREL4VBL2KLS5LJVQJKTMRWWUVQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188658473 (311h31m51.919926103s) [noise=true , address=104.36.82.11:4118 , piece_id=MFWA4J22CPFE4HEYFXZISYJDAKWCF3HEYHVCYKSFQY5N27QT2O6A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188993774 (311h31m51.920261394s) [noise=true , address=77.90.31.18:4812 , piece_id=GRFZT75OBWQBGFZ3I3QYOGWHIFXJCZHKOGQOG34ZW6QG7BNBNGBQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189017548 (311h31m51.920285178s) [noise=true , address=77.90.31.11:4582 , piece_id=7I4O5F46N3EAAFKUSTBOA3DY5NF7PQHNILWM5GFZ5CEIGRZANDRQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189365152 (311h31m51.920632782s) [noise=true , address=79.127.205.234:4616 , piece_id=D3SSTIPP6BS4NL5IS3JTR6JTHG32VWVD6HIU27WB2HXRTI7SL4TQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189952657 (311h31m51.921220287s) [noise=true , address=104.36.82.45:4917 , piece_id=HHWHHUVVM76NSJNSFRSV5L2TJM7WABLPY3UMVM7CEZM44NKMXRHQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.190704210 (311h31m51.92197184s) [noise=true , address=45.91.116.11:4142 , piece_id=FTHDX3KRMQV2VPJA42JPTD5LDPAQCC6C2D6ODRZ7M4ZASZDJCSYA, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.191563527 (311h31m51.922831157s) [noise=true , address=45.91.116.11:4141 , piece_id=6OUW5WSYNG5GABS6BH3NNP3WRPYAK3SOVJDSXLMPICFMSNWD3O3Q, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.192590128 (311h31m51.923857758s) [noise=true , address=104.36.82.6:4907 , piece_id=ZVU2TK7PXTZBHLLU657Q5U5BS33QIIGR5WBBUE23LMRWNYSGIJEQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.292199435 (311h31m52.023467055s) [upload=323881]: Next returned nil segment
Aug 21 16:58:11.292208382 (311h31m52.023476002s) [upload=323881]: Waiting for error group managing segments...
Aug 21 16:58:11.305981536 (311h31m52.037249156s) [noise=true , address=104.36.82.11:4118 , piece_id=MFWA4J22CPFE4HEYFXZISYJDAKWCF3HEYHVCYKSFQY5N27QT2O6A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.317455457 (311h31m52.048723076s) [noise=true , address=77.90.31.11:4582 , piece_id=7I4O5F46N3EAAFKUSTBOA3DY5NF7PQHNILWM5GFZ5CEIGRZANDRQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.319650365 (311h31m52.050917985s) [noise=true , address=77.90.31.18:4812 , piece_id=GRFZT75OBWQBGFZ3I3QYOGWHIFXJCZHKOGQOG34ZW6QG7BNBNGBQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.320890678 (311h31m52.052158297s) [noise=true , address=104.36.82.49:4012 , piece_id=CQSJDRQSYII2TZ4IXSILK3IN4WMGVOJEHPQJBPWPYII5HQ7G2B3A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.325965804 (311h31m52.057233424s) [noise=true , address=77.90.31.15:4719 , piece_id=SQOIUIMMOLGQHURPXKR4E3SYUKDJDJNZ75Q4RXA3W2E4JOG5WXLQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.327860037 (311h31m52.059127667s) [noise=true , address=45.91.116.11:4142 , piece_id=FTHDX3KRMQV2VPJA42JPTD5LDPAQCC6C2D6ODRZ7M4ZASZDJCSYA, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.328132208 (311h31m52.059399828s) [noise=true , address=45.91.116.5:4312 , piece_id=QCY54KDIJ3SFLIE2X6KBQD2UIEWMGYBOL33JKFLWGXZGRTB42YQQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.330010401 (311h31m52.061278021s) [noise=true , address=77.90.31.10:4548 , piece_id=3IWDAKTWMTSIYUHS4YSHUGNPZXYIOTCE523RYZCYL2FEW226R45A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.335413914 (311h31m52.066681533s) [noise=true , address=77.90.31.13:4651 , piece_id=KVYWHATVMKX3WZB7UWCIPQ5TIXHLAO7TWECK4XRQDILQ4HOUSB3Q, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.341151935 (311h31m52.072419546s) [noise=true , address=104.36.82.9:4022 , piece_id=XHQFV3SHMAT7WOOWG6U5QRRO3VBLZUE2SV7N5N4IDWWB6MPAT7JA, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.348847890 (311h31m52.08011552s) [noise=true , address=104.36.82.6:4907 , piece_id=ZVU2TK7PXTZBHLLU657Q5U5BS33QIIGR5WBBUE23LMRWNYSGIJEQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.360184613 (311h31m52.091452233s) [noise=true , address=104.36.82.13:4209 , piece_id=AJ5OPQIYSANI4EFJQYTCSC4OYA2KV4PR23YNLROCLL62ZNT2CINQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.366983571 (311h31m52.098251201s) [noise=true , address=77.90.31.19:4851 , piece_id=YZ7SGALUQPTAHO5ZARMCVMADX5AGH6BQNCN5UTC74JPLPEWALEDQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.392521653 (311h31m52.123789274s) [noise=true , address=104.36.82.45:4917 , piece_id=HHWHHUVVM76NSJNSFRSV5L2TJM7WABLPY3UMVM7CEZM44NKMXRHQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.392540769 (311h31m52.123808399s) [seg_pos={0 0}, upload=323881]: Segment reached optimal threshold of 14 pieces.
Aug 21 16:58:11.392827879 (311h31m52.124095509s) [noise=true , address=104.36.82.14:4236 , piece_id=EOTHS7XHUD5YNTOQOVTFR6EIRGREL4VBL2KLS5LJVQJKTMRWWUVQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XaE29W27ym2RmuGdBvHeKcQZZEUbask1zsm9Bz8xLokZNGfcj): protocol: expected piece hash; context canceled; EOF
Aug 21 16:58:11.393068121 (311h31m52.124335742s) [noise=true , address=45.91.116.11:4141 , piece_id=6OUW5WSYNG5GABS6BH3NNP3WRPYAK3SOVJDSXLMPICFMSNWD3O3Q, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h1gxgVjoHUkjKXA5xhTowGKi9q6wZGyzg8eqKgMHqsxF1ut5P): protocol: write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection; write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection
Aug 21 16:58:11.393129707 (311h31m52.124397326s) [noise=true , address=79.127.205.234:4616 , piece_id=D3SSTIPP6BS4NL5IS3JTR6JTHG32VWVD6HIU27WB2HXRTI7SL4TQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuFfyFT8z7TwZZsBhMRPx8HtLBqELmEzxbbsuG9Ljg9KKz3rm): protocol: read tcp 5.161.89.252:61860->79.127.205.234:4616: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 16:58:11.393280721 (311h31m52.124548371s) [noise=true , address=104.36.82.7:4920 , piece_id=7LGSALS6MO7SEPNO5KGHKACZ6CSAMJMV2GYHYY6BBVGFOXHRLPSQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.393342206 (311h31m52.124609846s) [seg_pos={0 0}, upload=323881]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 21 16:58:11.393461841 (311h31m52.124729492s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 16:58:11.393467823 (311h31m52.124735463s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 16:58:11.446017719 (311h31m52.177285349s) [upload=323881]: Done uploading segments...
Aug 21 16:58:11.446031615 (311h31m52.177299245s) [upload=323881]: Upload finished. err: <nil>
Duration: 1.816301562s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
2 out of 15 is failed (threshold=6) [..........XX...] duration:
70.525899ms remote:
"tcp:54.243.86.28:443" response headers:
Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 17:08:04 GMT target:
https://www.storj.io/
FAIL (2025-08-21 17:09:44 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 70.544766ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
2 out of 15 is failed (threshold=6) [...........XX..] duration:
361.340214ms remote:
"tcp:54.243.86.28:443" response headers:
Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 17:08:04 GMT target:
https://www.storj.io/
FAIL (2025-08-21 17:09:27 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 361.360763ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
2 out of 15 is failed (threshold=6) [............XX.] duration:
79.778802ms remote:
"tcp:54.243.86.28:443" response headers:
Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 17:08:04 GMT target:
https://www.storj.io/
FAIL (2025-08-21 17:09:12 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 79.792156ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................X................X..............] duration:
1.759599828s
FAIL (2025-08-21 17:09:05 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 21 16:58:11.097765980 (311h31m51.82903362s) [upload=323881]: Starting upload
Aug 21 16:58:11.097816425 (311h31m51.829084066s) [upload=323881]: Done starting upload
Aug 21 16:58:11.097974212 (311h31m51.829241862s) [upload=323881]: Uploading segments...
Aug 21 16:58:11.098124976 (311h31m51.829392606s) [upload=323881]: Got next segment. Inline: false
Aug 21 16:58:11.098190559 (311h31m51.829458199s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 16:58:11.098198244 (311h31m51.829465904s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 16:58:11.186959668 (311h31m51.918227288s) [seg_pos={0 0}, upload=323881]: Begin upload segment...
Aug 21 16:58:11.187010914 (311h31m51.918278574s) [seg_pos={0 0}, upload=323881]: Done begin upload segment.
Aug 21 16:58:11.187041721 (311h31m51.918309351s) [noise=true , address=45.91.116.5:4312 , piece_id=QCY54KDIJ3SFLIE2X6KBQD2UIEWMGYBOL33JKFLWGXZGRTB42YQQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187059065 (311h31m51.918326695s) [noise=true , address=104.36.82.49:4012 , piece_id=CQSJDRQSYII2TZ4IXSILK3IN4WMGVOJEHPQJBPWPYII5HQ7G2B3A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187096966 (311h31m51.918364587s) [noise=true , address=104.36.82.7:4920 , piece_id=7LGSALS6MO7SEPNO5KGHKACZ6CSAMJMV2GYHYY6BBVGFOXHRLPSQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187499954 (311h31m51.918767574s) [noise=true , address=77.90.31.19:4851 , piece_id=YZ7SGALUQPTAHO5ZARMCVMADX5AGH6BQNCN5UTC74JPLPEWALEDQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187516114 (311h31m51.918783745s) [noise=true , address=104.36.82.9:4022 , piece_id=XHQFV3SHMAT7WOOWG6U5QRRO3VBLZUE2SV7N5N4IDWWB6MPAT7JA, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187870982 (311h31m51.919138612s) [noise=true , address=77.90.31.10:4548 , piece_id=3IWDAKTWMTSIYUHS4YSHUGNPZXYIOTCE523RYZCYL2FEW226R45A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187878215 (311h31m51.919145845s) [noise=true , address=77.90.31.13:4651 , piece_id=KVYWHATVMKX3WZB7UWCIPQ5TIXHLAO7TWECK4XRQDILQ4HOUSB3Q, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188266736 (311h31m51.919534356s) [noise=true , address=104.36.82.13:4209 , piece_id=AJ5OPQIYSANI4EFJQYTCSC4OYA2KV4PR23YNLROCLL62ZNT2CINQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188291242 (311h31m51.919558873s) [noise=true , address=77.90.31.15:4719 , piece_id=SQOIUIMMOLGQHURPXKR4E3SYUKDJDJNZ75Q4RXA3W2E4JOG5WXLQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188643465 (311h31m51.919911095s) [noise=true , address=104.36.82.14:4236 , piece_id=EOTHS7XHUD5YNTOQOVTFR6EIRGREL4VBL2KLS5LJVQJKTMRWWUVQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188658473 (311h31m51.919926103s) [noise=true , address=104.36.82.11:4118 , piece_id=MFWA4J22CPFE4HEYFXZISYJDAKWCF3HEYHVCYKSFQY5N27QT2O6A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188993774 (311h31m51.920261394s) [noise=true , address=77.90.31.18:4812 , piece_id=GRFZT75OBWQBGFZ3I3QYOGWHIFXJCZHKOGQOG34ZW6QG7BNBNGBQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189017548 (311h31m51.920285178s) [noise=true , address=77.90.31.11:4582 , piece_id=7I4O5F46N3EAAFKUSTBOA3DY5NF7PQHNILWM5GFZ5CEIGRZANDRQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189365152 (311h31m51.920632782s) [noise=true , address=79.127.205.234:4616 , piece_id=D3SSTIPP6BS4NL5IS3JTR6JTHG32VWVD6HIU27WB2HXRTI7SL4TQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189952657 (311h31m51.921220287s) [noise=true , address=104.36.82.45:4917 , piece_id=HHWHHUVVM76NSJNSFRSV5L2TJM7WABLPY3UMVM7CEZM44NKMXRHQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.190704210 (311h31m51.92197184s) [noise=true , address=45.91.116.11:4142 , piece_id=FTHDX3KRMQV2VPJA42JPTD5LDPAQCC6C2D6ODRZ7M4ZASZDJCSYA, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.191563527 (311h31m51.922831157s) [noise=true , address=45.91.116.11:4141 , piece_id=6OUW5WSYNG5GABS6BH3NNP3WRPYAK3SOVJDSXLMPICFMSNWD3O3Q, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.192590128 (311h31m51.923857758s) [noise=true , address=104.36.82.6:4907 , piece_id=ZVU2TK7PXTZBHLLU657Q5U5BS33QIIGR5WBBUE23LMRWNYSGIJEQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.292199435 (311h31m52.023467055s) [upload=323881]: Next returned nil segment
Aug 21 16:58:11.292208382 (311h31m52.023476002s) [upload=323881]: Waiting for error group managing segments...
Aug 21 16:58:11.305981536 (311h31m52.037249156s) [noise=true , address=104.36.82.11:4118 , piece_id=MFWA4J22CPFE4HEYFXZISYJDAKWCF3HEYHVCYKSFQY5N27QT2O6A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.317455457 (311h31m52.048723076s) [noise=true , address=77.90.31.11:4582 , piece_id=7I4O5F46N3EAAFKUSTBOA3DY5NF7PQHNILWM5GFZ5CEIGRZANDRQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.319650365 (311h31m52.050917985s) [noise=true , address=77.90.31.18:4812 , piece_id=GRFZT75OBWQBGFZ3I3QYOGWHIFXJCZHKOGQOG34ZW6QG7BNBNGBQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.320890678 (311h31m52.052158297s) [noise=true , address=104.36.82.49:4012 , piece_id=CQSJDRQSYII2TZ4IXSILK3IN4WMGVOJEHPQJBPWPYII5HQ7G2B3A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.325965804 (311h31m52.057233424s) [noise=true , address=77.90.31.15:4719 , piece_id=SQOIUIMMOLGQHURPXKR4E3SYUKDJDJNZ75Q4RXA3W2E4JOG5WXLQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.327860037 (311h31m52.059127667s) [noise=true , address=45.91.116.11:4142 , piece_id=FTHDX3KRMQV2VPJA42JPTD5LDPAQCC6C2D6ODRZ7M4ZASZDJCSYA, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.328132208 (311h31m52.059399828s) [noise=true , address=45.91.116.5:4312 , piece_id=QCY54KDIJ3SFLIE2X6KBQD2UIEWMGYBOL33JKFLWGXZGRTB42YQQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.330010401 (311h31m52.061278021s) [noise=true , address=77.90.31.10:4548 , piece_id=3IWDAKTWMTSIYUHS4YSHUGNPZXYIOTCE523RYZCYL2FEW226R45A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.335413914 (311h31m52.066681533s) [noise=true , address=77.90.31.13:4651 , piece_id=KVYWHATVMKX3WZB7UWCIPQ5TIXHLAO7TWECK4XRQDILQ4HOUSB3Q, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.341151935 (311h31m52.072419546s) [noise=true , address=104.36.82.9:4022 , piece_id=XHQFV3SHMAT7WOOWG6U5QRRO3VBLZUE2SV7N5N4IDWWB6MPAT7JA, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.348847890 (311h31m52.08011552s) [noise=true , address=104.36.82.6:4907 , piece_id=ZVU2TK7PXTZBHLLU657Q5U5BS33QIIGR5WBBUE23LMRWNYSGIJEQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.360184613 (311h31m52.091452233s) [noise=true , address=104.36.82.13:4209 , piece_id=AJ5OPQIYSANI4EFJQYTCSC4OYA2KV4PR23YNLROCLL62ZNT2CINQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.366983571 (311h31m52.098251201s) [noise=true , address=77.90.31.19:4851 , piece_id=YZ7SGALUQPTAHO5ZARMCVMADX5AGH6BQNCN5UTC74JPLPEWALEDQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.392521653 (311h31m52.123789274s) [noise=true , address=104.36.82.45:4917 , piece_id=HHWHHUVVM76NSJNSFRSV5L2TJM7WABLPY3UMVM7CEZM44NKMXRHQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.392540769 (311h31m52.123808399s) [seg_pos={0 0}, upload=323881]: Segment reached optimal threshold of 14 pieces.
Aug 21 16:58:11.392827879 (311h31m52.124095509s) [noise=true , address=104.36.82.14:4236 , piece_id=EOTHS7XHUD5YNTOQOVTFR6EIRGREL4VBL2KLS5LJVQJKTMRWWUVQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XaE29W27ym2RmuGdBvHeKcQZZEUbask1zsm9Bz8xLokZNGfcj): protocol: expected piece hash; context canceled; EOF
Aug 21 16:58:11.393068121 (311h31m52.124335742s) [noise=true , address=45.91.116.11:4141 , piece_id=6OUW5WSYNG5GABS6BH3NNP3WRPYAK3SOVJDSXLMPICFMSNWD3O3Q, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h1gxgVjoHUkjKXA5xhTowGKi9q6wZGyzg8eqKgMHqsxF1ut5P): protocol: write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection; write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection
Aug 21 16:58:11.393129707 (311h31m52.124397326s) [noise=true , address=79.127.205.234:4616 , piece_id=D3SSTIPP6BS4NL5IS3JTR6JTHG32VWVD6HIU27WB2HXRTI7SL4TQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuFfyFT8z7TwZZsBhMRPx8HtLBqELmEzxbbsuG9Ljg9KKz3rm): protocol: read tcp 5.161.89.252:61860->79.127.205.234:4616: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 16:58:11.393280721 (311h31m52.124548371s) [noise=true , address=104.36.82.7:4920 , piece_id=7LGSALS6MO7SEPNO5KGHKACZ6CSAMJMV2GYHYY6BBVGFOXHRLPSQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.393342206 (311h31m52.124609846s) [seg_pos={0 0}, upload=323881]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 21 16:58:11.393461841 (311h31m52.124729492s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 16:58:11.393467823 (311h31m52.124735463s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 16:58:11.446017719 (311h31m52.177285349s) [upload=323881]: Done uploading segments...
Aug 21 16:58:11.446031615 (311h31m52.177299245s) [upload=323881]: Upload finished. err: <nil>
Duration: 1.759623152s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................X................X.............] duration:
1.334814585s
FAIL (2025-08-21 17:08:35 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 21 16:58:11.097765980 (311h31m51.82903362s) [upload=323881]: Starting upload
Aug 21 16:58:11.097816425 (311h31m51.829084066s) [upload=323881]: Done starting upload
Aug 21 16:58:11.097974212 (311h31m51.829241862s) [upload=323881]: Uploading segments...
Aug 21 16:58:11.098124976 (311h31m51.829392606s) [upload=323881]: Got next segment. Inline: false
Aug 21 16:58:11.098190559 (311h31m51.829458199s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 16:58:11.098198244 (311h31m51.829465904s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 16:58:11.186959668 (311h31m51.918227288s) [seg_pos={0 0}, upload=323881]: Begin upload segment...
Aug 21 16:58:11.187010914 (311h31m51.918278574s) [seg_pos={0 0}, upload=323881]: Done begin upload segment.
Aug 21 16:58:11.187041721 (311h31m51.918309351s) [noise=true , address=45.91.116.5:4312 , piece_id=QCY54KDIJ3SFLIE2X6KBQD2UIEWMGYBOL33JKFLWGXZGRTB42YQQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187059065 (311h31m51.918326695s) [noise=true , address=104.36.82.49:4012 , piece_id=CQSJDRQSYII2TZ4IXSILK3IN4WMGVOJEHPQJBPWPYII5HQ7G2B3A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187096966 (311h31m51.918364587s) [noise=true , address=104.36.82.7:4920 , piece_id=7LGSALS6MO7SEPNO5KGHKACZ6CSAMJMV2GYHYY6BBVGFOXHRLPSQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187499954 (311h31m51.918767574s) [noise=true , address=77.90.31.19:4851 , piece_id=YZ7SGALUQPTAHO5ZARMCVMADX5AGH6BQNCN5UTC74JPLPEWALEDQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187516114 (311h31m51.918783745s) [noise=true , address=104.36.82.9:4022 , piece_id=XHQFV3SHMAT7WOOWG6U5QRRO3VBLZUE2SV7N5N4IDWWB6MPAT7JA, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187870982 (311h31m51.919138612s) [noise=true , address=77.90.31.10:4548 , piece_id=3IWDAKTWMTSIYUHS4YSHUGNPZXYIOTCE523RYZCYL2FEW226R45A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187878215 (311h31m51.919145845s) [noise=true , address=77.90.31.13:4651 , piece_id=KVYWHATVMKX3WZB7UWCIPQ5TIXHLAO7TWECK4XRQDILQ4HOUSB3Q, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188266736 (311h31m51.919534356s) [noise=true , address=104.36.82.13:4209 , piece_id=AJ5OPQIYSANI4EFJQYTCSC4OYA2KV4PR23YNLROCLL62ZNT2CINQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188291242 (311h31m51.919558873s) [noise=true , address=77.90.31.15:4719 , piece_id=SQOIUIMMOLGQHURPXKR4E3SYUKDJDJNZ75Q4RXA3W2E4JOG5WXLQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188643465 (311h31m51.919911095s) [noise=true , address=104.36.82.14:4236 , piece_id=EOTHS7XHUD5YNTOQOVTFR6EIRGREL4VBL2KLS5LJVQJKTMRWWUVQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188658473 (311h31m51.919926103s) [noise=true , address=104.36.82.11:4118 , piece_id=MFWA4J22CPFE4HEYFXZISYJDAKWCF3HEYHVCYKSFQY5N27QT2O6A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188993774 (311h31m51.920261394s) [noise=true , address=77.90.31.18:4812 , piece_id=GRFZT75OBWQBGFZ3I3QYOGWHIFXJCZHKOGQOG34ZW6QG7BNBNGBQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189017548 (311h31m51.920285178s) [noise=true , address=77.90.31.11:4582 , piece_id=7I4O5F46N3EAAFKUSTBOA3DY5NF7PQHNILWM5GFZ5CEIGRZANDRQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189365152 (311h31m51.920632782s) [noise=true , address=79.127.205.234:4616 , piece_id=D3SSTIPP6BS4NL5IS3JTR6JTHG32VWVD6HIU27WB2HXRTI7SL4TQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189952657 (311h31m51.921220287s) [noise=true , address=104.36.82.45:4917 , piece_id=HHWHHUVVM76NSJNSFRSV5L2TJM7WABLPY3UMVM7CEZM44NKMXRHQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.190704210 (311h31m51.92197184s) [noise=true , address=45.91.116.11:4142 , piece_id=FTHDX3KRMQV2VPJA42JPTD5LDPAQCC6C2D6ODRZ7M4ZASZDJCSYA, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.191563527 (311h31m51.922831157s) [noise=true , address=45.91.116.11:4141 , piece_id=6OUW5WSYNG5GABS6BH3NNP3WRPYAK3SOVJDSXLMPICFMSNWD3O3Q, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.192590128 (311h31m51.923857758s) [noise=true , address=104.36.82.6:4907 , piece_id=ZVU2TK7PXTZBHLLU657Q5U5BS33QIIGR5WBBUE23LMRWNYSGIJEQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.292199435 (311h31m52.023467055s) [upload=323881]: Next returned nil segment
Aug 21 16:58:11.292208382 (311h31m52.023476002s) [upload=323881]: Waiting for error group managing segments...
Aug 21 16:58:11.305981536 (311h31m52.037249156s) [noise=true , address=104.36.82.11:4118 , piece_id=MFWA4J22CPFE4HEYFXZISYJDAKWCF3HEYHVCYKSFQY5N27QT2O6A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.317455457 (311h31m52.048723076s) [noise=true , address=77.90.31.11:4582 , piece_id=7I4O5F46N3EAAFKUSTBOA3DY5NF7PQHNILWM5GFZ5CEIGRZANDRQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.319650365 (311h31m52.050917985s) [noise=true , address=77.90.31.18:4812 , piece_id=GRFZT75OBWQBGFZ3I3QYOGWHIFXJCZHKOGQOG34ZW6QG7BNBNGBQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.320890678 (311h31m52.052158297s) [noise=true , address=104.36.82.49:4012 , piece_id=CQSJDRQSYII2TZ4IXSILK3IN4WMGVOJEHPQJBPWPYII5HQ7G2B3A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.325965804 (311h31m52.057233424s) [noise=true , address=77.90.31.15:4719 , piece_id=SQOIUIMMOLGQHURPXKR4E3SYUKDJDJNZ75Q4RXA3W2E4JOG5WXLQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.327860037 (311h31m52.059127667s) [noise=true , address=45.91.116.11:4142 , piece_id=FTHDX3KRMQV2VPJA42JPTD5LDPAQCC6C2D6ODRZ7M4ZASZDJCSYA, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.328132208 (311h31m52.059399828s) [noise=true , address=45.91.116.5:4312 , piece_id=QCY54KDIJ3SFLIE2X6KBQD2UIEWMGYBOL33JKFLWGXZGRTB42YQQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.330010401 (311h31m52.061278021s) [noise=true , address=77.90.31.10:4548 , piece_id=3IWDAKTWMTSIYUHS4YSHUGNPZXYIOTCE523RYZCYL2FEW226R45A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.335413914 (311h31m52.066681533s) [noise=true , address=77.90.31.13:4651 , piece_id=KVYWHATVMKX3WZB7UWCIPQ5TIXHLAO7TWECK4XRQDILQ4HOUSB3Q, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.341151935 (311h31m52.072419546s) [noise=true , address=104.36.82.9:4022 , piece_id=XHQFV3SHMAT7WOOWG6U5QRRO3VBLZUE2SV7N5N4IDWWB6MPAT7JA, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.348847890 (311h31m52.08011552s) [noise=true , address=104.36.82.6:4907 , piece_id=ZVU2TK7PXTZBHLLU657Q5U5BS33QIIGR5WBBUE23LMRWNYSGIJEQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.360184613 (311h31m52.091452233s) [noise=true , address=104.36.82.13:4209 , piece_id=AJ5OPQIYSANI4EFJQYTCSC4OYA2KV4PR23YNLROCLL62ZNT2CINQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.366983571 (311h31m52.098251201s) [noise=true , address=77.90.31.19:4851 , piece_id=YZ7SGALUQPTAHO5ZARMCVMADX5AGH6BQNCN5UTC74JPLPEWALEDQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.392521653 (311h31m52.123789274s) [noise=true , address=104.36.82.45:4917 , piece_id=HHWHHUVVM76NSJNSFRSV5L2TJM7WABLPY3UMVM7CEZM44NKMXRHQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.392540769 (311h31m52.123808399s) [seg_pos={0 0}, upload=323881]: Segment reached optimal threshold of 14 pieces.
Aug 21 16:58:11.392827879 (311h31m52.124095509s) [noise=true , address=104.36.82.14:4236 , piece_id=EOTHS7XHUD5YNTOQOVTFR6EIRGREL4VBL2KLS5LJVQJKTMRWWUVQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XaE29W27ym2RmuGdBvHeKcQZZEUbask1zsm9Bz8xLokZNGfcj): protocol: expected piece hash; context canceled; EOF
Aug 21 16:58:11.393068121 (311h31m52.124335742s) [noise=true , address=45.91.116.11:4141 , piece_id=6OUW5WSYNG5GABS6BH3NNP3WRPYAK3SOVJDSXLMPICFMSNWD3O3Q, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h1gxgVjoHUkjKXA5xhTowGKi9q6wZGyzg8eqKgMHqsxF1ut5P): protocol: write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection; write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection
Aug 21 16:58:11.393129707 (311h31m52.124397326s) [noise=true , address=79.127.205.234:4616 , piece_id=D3SSTIPP6BS4NL5IS3JTR6JTHG32VWVD6HIU27WB2HXRTI7SL4TQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuFfyFT8z7TwZZsBhMRPx8HtLBqELmEzxbbsuG9Ljg9KKz3rm): protocol: read tcp 5.161.89.252:61860->79.127.205.234:4616: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 16:58:11.393280721 (311h31m52.124548371s) [noise=true , address=104.36.82.7:4920 , piece_id=7LGSALS6MO7SEPNO5KGHKACZ6CSAMJMV2GYHYY6BBVGFOXHRLPSQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.393342206 (311h31m52.124609846s) [seg_pos={0 0}, upload=323881]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 21 16:58:11.393461841 (311h31m52.124729492s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 16:58:11.393467823 (311h31m52.124735463s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 16:58:11.446017719 (311h31m52.177285349s) [upload=323881]: Done uploading segments...
Aug 21 16:58:11.446031615 (311h31m52.177299245s) [upload=323881]: Upload finished. err: <nil>
Duration: 1.334835073s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
2 out of 15 is failed (threshold=6) [.............XX] duration:
1.030167189s remote:
"tcp:54.243.86.28:443" response headers:
Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 17:08:04 GMT target:
https://www.storj.io/
FAIL (2025-08-21 17:08:04 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 1.030182227s
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [..............X] duration:
1.015576656s remote:
"tcp:18.211.166.153:443" response headers:
X-Cluster-Name=us-east-1-prod-hosting-red Date=Thu, 21 Aug 2025 17:07:35 GMT Content-Type=text/html Content-Length=164 target:
https://www.storj.io/
FAIL (2025-08-21 17:07:35 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 1.015717421s
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................X................X............] duration:
1.267599345s
FAIL (2025-08-21 17:07:27 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 21 16:58:11.097765980 (311h31m51.82903362s) [upload=323881]: Starting upload
Aug 21 16:58:11.097816425 (311h31m51.829084066s) [upload=323881]: Done starting upload
Aug 21 16:58:11.097974212 (311h31m51.829241862s) [upload=323881]: Uploading segments...
Aug 21 16:58:11.098124976 (311h31m51.829392606s) [upload=323881]: Got next segment. Inline: false
Aug 21 16:58:11.098190559 (311h31m51.829458199s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 16:58:11.098198244 (311h31m51.829465904s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 16:58:11.186959668 (311h31m51.918227288s) [seg_pos={0 0}, upload=323881]: Begin upload segment...
Aug 21 16:58:11.187010914 (311h31m51.918278574s) [seg_pos={0 0}, upload=323881]: Done begin upload segment.
Aug 21 16:58:11.187041721 (311h31m51.918309351s) [noise=true , address=45.91.116.5:4312 , piece_id=QCY54KDIJ3SFLIE2X6KBQD2UIEWMGYBOL33JKFLWGXZGRTB42YQQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187059065 (311h31m51.918326695s) [noise=true , address=104.36.82.49:4012 , piece_id=CQSJDRQSYII2TZ4IXSILK3IN4WMGVOJEHPQJBPWPYII5HQ7G2B3A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187096966 (311h31m51.918364587s) [noise=true , address=104.36.82.7:4920 , piece_id=7LGSALS6MO7SEPNO5KGHKACZ6CSAMJMV2GYHYY6BBVGFOXHRLPSQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187499954 (311h31m51.918767574s) [noise=true , address=77.90.31.19:4851 , piece_id=YZ7SGALUQPTAHO5ZARMCVMADX5AGH6BQNCN5UTC74JPLPEWALEDQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187516114 (311h31m51.918783745s) [noise=true , address=104.36.82.9:4022 , piece_id=XHQFV3SHMAT7WOOWG6U5QRRO3VBLZUE2SV7N5N4IDWWB6MPAT7JA, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187870982 (311h31m51.919138612s) [noise=true , address=77.90.31.10:4548 , piece_id=3IWDAKTWMTSIYUHS4YSHUGNPZXYIOTCE523RYZCYL2FEW226R45A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187878215 (311h31m51.919145845s) [noise=true , address=77.90.31.13:4651 , piece_id=KVYWHATVMKX3WZB7UWCIPQ5TIXHLAO7TWECK4XRQDILQ4HOUSB3Q, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188266736 (311h31m51.919534356s) [noise=true , address=104.36.82.13:4209 , piece_id=AJ5OPQIYSANI4EFJQYTCSC4OYA2KV4PR23YNLROCLL62ZNT2CINQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188291242 (311h31m51.919558873s) [noise=true , address=77.90.31.15:4719 , piece_id=SQOIUIMMOLGQHURPXKR4E3SYUKDJDJNZ75Q4RXA3W2E4JOG5WXLQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188643465 (311h31m51.919911095s) [noise=true , address=104.36.82.14:4236 , piece_id=EOTHS7XHUD5YNTOQOVTFR6EIRGREL4VBL2KLS5LJVQJKTMRWWUVQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188658473 (311h31m51.919926103s) [noise=true , address=104.36.82.11:4118 , piece_id=MFWA4J22CPFE4HEYFXZISYJDAKWCF3HEYHVCYKSFQY5N27QT2O6A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188993774 (311h31m51.920261394s) [noise=true , address=77.90.31.18:4812 , piece_id=GRFZT75OBWQBGFZ3I3QYOGWHIFXJCZHKOGQOG34ZW6QG7BNBNGBQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189017548 (311h31m51.920285178s) [noise=true , address=77.90.31.11:4582 , piece_id=7I4O5F46N3EAAFKUSTBOA3DY5NF7PQHNILWM5GFZ5CEIGRZANDRQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189365152 (311h31m51.920632782s) [noise=true , address=79.127.205.234:4616 , piece_id=D3SSTIPP6BS4NL5IS3JTR6JTHG32VWVD6HIU27WB2HXRTI7SL4TQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189952657 (311h31m51.921220287s) [noise=true , address=104.36.82.45:4917 , piece_id=HHWHHUVVM76NSJNSFRSV5L2TJM7WABLPY3UMVM7CEZM44NKMXRHQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.190704210 (311h31m51.92197184s) [noise=true , address=45.91.116.11:4142 , piece_id=FTHDX3KRMQV2VPJA42JPTD5LDPAQCC6C2D6ODRZ7M4ZASZDJCSYA, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.191563527 (311h31m51.922831157s) [noise=true , address=45.91.116.11:4141 , piece_id=6OUW5WSYNG5GABS6BH3NNP3WRPYAK3SOVJDSXLMPICFMSNWD3O3Q, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.192590128 (311h31m51.923857758s) [noise=true , address=104.36.82.6:4907 , piece_id=ZVU2TK7PXTZBHLLU657Q5U5BS33QIIGR5WBBUE23LMRWNYSGIJEQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.292199435 (311h31m52.023467055s) [upload=323881]: Next returned nil segment
Aug 21 16:58:11.292208382 (311h31m52.023476002s) [upload=323881]: Waiting for error group managing segments...
Aug 21 16:58:11.305981536 (311h31m52.037249156s) [noise=true , address=104.36.82.11:4118 , piece_id=MFWA4J22CPFE4HEYFXZISYJDAKWCF3HEYHVCYKSFQY5N27QT2O6A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.317455457 (311h31m52.048723076s) [noise=true , address=77.90.31.11:4582 , piece_id=7I4O5F46N3EAAFKUSTBOA3DY5NF7PQHNILWM5GFZ5CEIGRZANDRQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.319650365 (311h31m52.050917985s) [noise=true , address=77.90.31.18:4812 , piece_id=GRFZT75OBWQBGFZ3I3QYOGWHIFXJCZHKOGQOG34ZW6QG7BNBNGBQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.320890678 (311h31m52.052158297s) [noise=true , address=104.36.82.49:4012 , piece_id=CQSJDRQSYII2TZ4IXSILK3IN4WMGVOJEHPQJBPWPYII5HQ7G2B3A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.325965804 (311h31m52.057233424s) [noise=true , address=77.90.31.15:4719 , piece_id=SQOIUIMMOLGQHURPXKR4E3SYUKDJDJNZ75Q4RXA3W2E4JOG5WXLQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.327860037 (311h31m52.059127667s) [noise=true , address=45.91.116.11:4142 , piece_id=FTHDX3KRMQV2VPJA42JPTD5LDPAQCC6C2D6ODRZ7M4ZASZDJCSYA, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.328132208 (311h31m52.059399828s) [noise=true , address=45.91.116.5:4312 , piece_id=QCY54KDIJ3SFLIE2X6KBQD2UIEWMGYBOL33JKFLWGXZGRTB42YQQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.330010401 (311h31m52.061278021s) [noise=true , address=77.90.31.10:4548 , piece_id=3IWDAKTWMTSIYUHS4YSHUGNPZXYIOTCE523RYZCYL2FEW226R45A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.335413914 (311h31m52.066681533s) [noise=true , address=77.90.31.13:4651 , piece_id=KVYWHATVMKX3WZB7UWCIPQ5TIXHLAO7TWECK4XRQDILQ4HOUSB3Q, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.341151935 (311h31m52.072419546s) [noise=true , address=104.36.82.9:4022 , piece_id=XHQFV3SHMAT7WOOWG6U5QRRO3VBLZUE2SV7N5N4IDWWB6MPAT7JA, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.348847890 (311h31m52.08011552s) [noise=true , address=104.36.82.6:4907 , piece_id=ZVU2TK7PXTZBHLLU657Q5U5BS33QIIGR5WBBUE23LMRWNYSGIJEQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.360184613 (311h31m52.091452233s) [noise=true , address=104.36.82.13:4209 , piece_id=AJ5OPQIYSANI4EFJQYTCSC4OYA2KV4PR23YNLROCLL62ZNT2CINQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.366983571 (311h31m52.098251201s) [noise=true , address=77.90.31.19:4851 , piece_id=YZ7SGALUQPTAHO5ZARMCVMADX5AGH6BQNCN5UTC74JPLPEWALEDQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.392521653 (311h31m52.123789274s) [noise=true , address=104.36.82.45:4917 , piece_id=HHWHHUVVM76NSJNSFRSV5L2TJM7WABLPY3UMVM7CEZM44NKMXRHQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.392540769 (311h31m52.123808399s) [seg_pos={0 0}, upload=323881]: Segment reached optimal threshold of 14 pieces.
Aug 21 16:58:11.392827879 (311h31m52.124095509s) [noise=true , address=104.36.82.14:4236 , piece_id=EOTHS7XHUD5YNTOQOVTFR6EIRGREL4VBL2KLS5LJVQJKTMRWWUVQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XaE29W27ym2RmuGdBvHeKcQZZEUbask1zsm9Bz8xLokZNGfcj): protocol: expected piece hash; context canceled; EOF
Aug 21 16:58:11.393068121 (311h31m52.124335742s) [noise=true , address=45.91.116.11:4141 , piece_id=6OUW5WSYNG5GABS6BH3NNP3WRPYAK3SOVJDSXLMPICFMSNWD3O3Q, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h1gxgVjoHUkjKXA5xhTowGKi9q6wZGyzg8eqKgMHqsxF1ut5P): protocol: write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection; write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection
Aug 21 16:58:11.393129707 (311h31m52.124397326s) [noise=true , address=79.127.205.234:4616 , piece_id=D3SSTIPP6BS4NL5IS3JTR6JTHG32VWVD6HIU27WB2HXRTI7SL4TQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuFfyFT8z7TwZZsBhMRPx8HtLBqELmEzxbbsuG9Ljg9KKz3rm): protocol: read tcp 5.161.89.252:61860->79.127.205.234:4616: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 16:58:11.393280721 (311h31m52.124548371s) [noise=true , address=104.36.82.7:4920 , piece_id=7LGSALS6MO7SEPNO5KGHKACZ6CSAMJMV2GYHYY6BBVGFOXHRLPSQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.393342206 (311h31m52.124609846s) [seg_pos={0 0}, upload=323881]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 21 16:58:11.393461841 (311h31m52.124729492s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 16:58:11.393467823 (311h31m52.124735463s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 16:58:11.446017719 (311h31m52.177285349s) [upload=323881]: Done uploading segments...
Aug 21 16:58:11.446031615 (311h31m52.177299245s) [upload=323881]: Upload finished. err: <nil>
Duration: 1.267622068s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................X................X...........] duration:
2.433771254s
FAIL (2025-08-21 17:06:45 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 21 16:58:11.097765980 (311h31m51.82903362s) [upload=323881]: Starting upload
Aug 21 16:58:11.097816425 (311h31m51.829084066s) [upload=323881]: Done starting upload
Aug 21 16:58:11.097974212 (311h31m51.829241862s) [upload=323881]: Uploading segments...
Aug 21 16:58:11.098124976 (311h31m51.829392606s) [upload=323881]: Got next segment. Inline: false
Aug 21 16:58:11.098190559 (311h31m51.829458199s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 16:58:11.098198244 (311h31m51.829465904s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 16:58:11.186959668 (311h31m51.918227288s) [seg_pos={0 0}, upload=323881]: Begin upload segment...
Aug 21 16:58:11.187010914 (311h31m51.918278574s) [seg_pos={0 0}, upload=323881]: Done begin upload segment.
Aug 21 16:58:11.187041721 (311h31m51.918309351s) [noise=true , address=45.91.116.5:4312 , piece_id=QCY54KDIJ3SFLIE2X6KBQD2UIEWMGYBOL33JKFLWGXZGRTB42YQQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187059065 (311h31m51.918326695s) [noise=true , address=104.36.82.49:4012 , piece_id=CQSJDRQSYII2TZ4IXSILK3IN4WMGVOJEHPQJBPWPYII5HQ7G2B3A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187096966 (311h31m51.918364587s) [noise=true , address=104.36.82.7:4920 , piece_id=7LGSALS6MO7SEPNO5KGHKACZ6CSAMJMV2GYHYY6BBVGFOXHRLPSQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187499954 (311h31m51.918767574s) [noise=true , address=77.90.31.19:4851 , piece_id=YZ7SGALUQPTAHO5ZARMCVMADX5AGH6BQNCN5UTC74JPLPEWALEDQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187516114 (311h31m51.918783745s) [noise=true , address=104.36.82.9:4022 , piece_id=XHQFV3SHMAT7WOOWG6U5QRRO3VBLZUE2SV7N5N4IDWWB6MPAT7JA, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187870982 (311h31m51.919138612s) [noise=true , address=77.90.31.10:4548 , piece_id=3IWDAKTWMTSIYUHS4YSHUGNPZXYIOTCE523RYZCYL2FEW226R45A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187878215 (311h31m51.919145845s) [noise=true , address=77.90.31.13:4651 , piece_id=KVYWHATVMKX3WZB7UWCIPQ5TIXHLAO7TWECK4XRQDILQ4HOUSB3Q, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188266736 (311h31m51.919534356s) [noise=true , address=104.36.82.13:4209 , piece_id=AJ5OPQIYSANI4EFJQYTCSC4OYA2KV4PR23YNLROCLL62ZNT2CINQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188291242 (311h31m51.919558873s) [noise=true , address=77.90.31.15:4719 , piece_id=SQOIUIMMOLGQHURPXKR4E3SYUKDJDJNZ75Q4RXA3W2E4JOG5WXLQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188643465 (311h31m51.919911095s) [noise=true , address=104.36.82.14:4236 , piece_id=EOTHS7XHUD5YNTOQOVTFR6EIRGREL4VBL2KLS5LJVQJKTMRWWUVQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188658473 (311h31m51.919926103s) [noise=true , address=104.36.82.11:4118 , piece_id=MFWA4J22CPFE4HEYFXZISYJDAKWCF3HEYHVCYKSFQY5N27QT2O6A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188993774 (311h31m51.920261394s) [noise=true , address=77.90.31.18:4812 , piece_id=GRFZT75OBWQBGFZ3I3QYOGWHIFXJCZHKOGQOG34ZW6QG7BNBNGBQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189017548 (311h31m51.920285178s) [noise=true , address=77.90.31.11:4582 , piece_id=7I4O5F46N3EAAFKUSTBOA3DY5NF7PQHNILWM5GFZ5CEIGRZANDRQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189365152 (311h31m51.920632782s) [noise=true , address=79.127.205.234:4616 , piece_id=D3SSTIPP6BS4NL5IS3JTR6JTHG32VWVD6HIU27WB2HXRTI7SL4TQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189952657 (311h31m51.921220287s) [noise=true , address=104.36.82.45:4917 , piece_id=HHWHHUVVM76NSJNSFRSV5L2TJM7WABLPY3UMVM7CEZM44NKMXRHQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.190704210 (311h31m51.92197184s) [noise=true , address=45.91.116.11:4142 , piece_id=FTHDX3KRMQV2VPJA42JPTD5LDPAQCC6C2D6ODRZ7M4ZASZDJCSYA, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.191563527 (311h31m51.922831157s) [noise=true , address=45.91.116.11:4141 , piece_id=6OUW5WSYNG5GABS6BH3NNP3WRPYAK3SOVJDSXLMPICFMSNWD3O3Q, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.192590128 (311h31m51.923857758s) [noise=true , address=104.36.82.6:4907 , piece_id=ZVU2TK7PXTZBHLLU657Q5U5BS33QIIGR5WBBUE23LMRWNYSGIJEQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.292199435 (311h31m52.023467055s) [upload=323881]: Next returned nil segment
Aug 21 16:58:11.292208382 (311h31m52.023476002s) [upload=323881]: Waiting for error group managing segments...
Aug 21 16:58:11.305981536 (311h31m52.037249156s) [noise=true , address=104.36.82.11:4118 , piece_id=MFWA4J22CPFE4HEYFXZISYJDAKWCF3HEYHVCYKSFQY5N27QT2O6A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.317455457 (311h31m52.048723076s) [noise=true , address=77.90.31.11:4582 , piece_id=7I4O5F46N3EAAFKUSTBOA3DY5NF7PQHNILWM5GFZ5CEIGRZANDRQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.319650365 (311h31m52.050917985s) [noise=true , address=77.90.31.18:4812 , piece_id=GRFZT75OBWQBGFZ3I3QYOGWHIFXJCZHKOGQOG34ZW6QG7BNBNGBQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.320890678 (311h31m52.052158297s) [noise=true , address=104.36.82.49:4012 , piece_id=CQSJDRQSYII2TZ4IXSILK3IN4WMGVOJEHPQJBPWPYII5HQ7G2B3A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.325965804 (311h31m52.057233424s) [noise=true , address=77.90.31.15:4719 , piece_id=SQOIUIMMOLGQHURPXKR4E3SYUKDJDJNZ75Q4RXA3W2E4JOG5WXLQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.327860037 (311h31m52.059127667s) [noise=true , address=45.91.116.11:4142 , piece_id=FTHDX3KRMQV2VPJA42JPTD5LDPAQCC6C2D6ODRZ7M4ZASZDJCSYA, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.328132208 (311h31m52.059399828s) [noise=true , address=45.91.116.5:4312 , piece_id=QCY54KDIJ3SFLIE2X6KBQD2UIEWMGYBOL33JKFLWGXZGRTB42YQQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.330010401 (311h31m52.061278021s) [noise=true , address=77.90.31.10:4548 , piece_id=3IWDAKTWMTSIYUHS4YSHUGNPZXYIOTCE523RYZCYL2FEW226R45A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.335413914 (311h31m52.066681533s) [noise=true , address=77.90.31.13:4651 , piece_id=KVYWHATVMKX3WZB7UWCIPQ5TIXHLAO7TWECK4XRQDILQ4HOUSB3Q, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.341151935 (311h31m52.072419546s) [noise=true , address=104.36.82.9:4022 , piece_id=XHQFV3SHMAT7WOOWG6U5QRRO3VBLZUE2SV7N5N4IDWWB6MPAT7JA, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.348847890 (311h31m52.08011552s) [noise=true , address=104.36.82.6:4907 , piece_id=ZVU2TK7PXTZBHLLU657Q5U5BS33QIIGR5WBBUE23LMRWNYSGIJEQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.360184613 (311h31m52.091452233s) [noise=true , address=104.36.82.13:4209 , piece_id=AJ5OPQIYSANI4EFJQYTCSC4OYA2KV4PR23YNLROCLL62ZNT2CINQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.366983571 (311h31m52.098251201s) [noise=true , address=77.90.31.19:4851 , piece_id=YZ7SGALUQPTAHO5ZARMCVMADX5AGH6BQNCN5UTC74JPLPEWALEDQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.392521653 (311h31m52.123789274s) [noise=true , address=104.36.82.45:4917 , piece_id=HHWHHUVVM76NSJNSFRSV5L2TJM7WABLPY3UMVM7CEZM44NKMXRHQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.392540769 (311h31m52.123808399s) [seg_pos={0 0}, upload=323881]: Segment reached optimal threshold of 14 pieces.
Aug 21 16:58:11.392827879 (311h31m52.124095509s) [noise=true , address=104.36.82.14:4236 , piece_id=EOTHS7XHUD5YNTOQOVTFR6EIRGREL4VBL2KLS5LJVQJKTMRWWUVQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XaE29W27ym2RmuGdBvHeKcQZZEUbask1zsm9Bz8xLokZNGfcj): protocol: expected piece hash; context canceled; EOF
Aug 21 16:58:11.393068121 (311h31m52.124335742s) [noise=true , address=45.91.116.11:4141 , piece_id=6OUW5WSYNG5GABS6BH3NNP3WRPYAK3SOVJDSXLMPICFMSNWD3O3Q, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h1gxgVjoHUkjKXA5xhTowGKi9q6wZGyzg8eqKgMHqsxF1ut5P): protocol: write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection; write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection
Aug 21 16:58:11.393129707 (311h31m52.124397326s) [noise=true , address=79.127.205.234:4616 , piece_id=D3SSTIPP6BS4NL5IS3JTR6JTHG32VWVD6HIU27WB2HXRTI7SL4TQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuFfyFT8z7TwZZsBhMRPx8HtLBqELmEzxbbsuG9Ljg9KKz3rm): protocol: read tcp 5.161.89.252:61860->79.127.205.234:4616: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 16:58:11.393280721 (311h31m52.124548371s) [noise=true , address=104.36.82.7:4920 , piece_id=7LGSALS6MO7SEPNO5KGHKACZ6CSAMJMV2GYHYY6BBVGFOXHRLPSQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.393342206 (311h31m52.124609846s) [seg_pos={0 0}, upload=323881]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 21 16:58:11.393461841 (311h31m52.124729492s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 16:58:11.393467823 (311h31m52.124735463s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 16:58:11.446017719 (311h31m52.177285349s) [upload=323881]: Done uploading segments...
Aug 21 16:58:11.446031615 (311h31m52.177299245s) [upload=323881]: Upload finished. err: <nil>
Duration: 2.43382236s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................................X................X..........] duration:
644.483565ms
FAIL (2025-08-21 17:05:38 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 21 16:58:11.097765980 (311h31m51.82903362s) [upload=323881]: Starting upload
Aug 21 16:58:11.097816425 (311h31m51.829084066s) [upload=323881]: Done starting upload
Aug 21 16:58:11.097974212 (311h31m51.829241862s) [upload=323881]: Uploading segments...
Aug 21 16:58:11.098124976 (311h31m51.829392606s) [upload=323881]: Got next segment. Inline: false
Aug 21 16:58:11.098190559 (311h31m51.829458199s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 16:58:11.098198244 (311h31m51.829465904s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 16:58:11.186959668 (311h31m51.918227288s) [seg_pos={0 0}, upload=323881]: Begin upload segment...
Aug 21 16:58:11.187010914 (311h31m51.918278574s) [seg_pos={0 0}, upload=323881]: Done begin upload segment.
Aug 21 16:58:11.187041721 (311h31m51.918309351s) [noise=true , address=45.91.116.5:4312 , piece_id=QCY54KDIJ3SFLIE2X6KBQD2UIEWMGYBOL33JKFLWGXZGRTB42YQQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187059065 (311h31m51.918326695s) [noise=true , address=104.36.82.49:4012 , piece_id=CQSJDRQSYII2TZ4IXSILK3IN4WMGVOJEHPQJBPWPYII5HQ7G2B3A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187096966 (311h31m51.918364587s) [noise=true , address=104.36.82.7:4920 , piece_id=7LGSALS6MO7SEPNO5KGHKACZ6CSAMJMV2GYHYY6BBVGFOXHRLPSQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187499954 (311h31m51.918767574s) [noise=true , address=77.90.31.19:4851 , piece_id=YZ7SGALUQPTAHO5ZARMCVMADX5AGH6BQNCN5UTC74JPLPEWALEDQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187516114 (311h31m51.918783745s) [noise=true , address=104.36.82.9:4022 , piece_id=XHQFV3SHMAT7WOOWG6U5QRRO3VBLZUE2SV7N5N4IDWWB6MPAT7JA, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187870982 (311h31m51.919138612s) [noise=true , address=77.90.31.10:4548 , piece_id=3IWDAKTWMTSIYUHS4YSHUGNPZXYIOTCE523RYZCYL2FEW226R45A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187878215 (311h31m51.919145845s) [noise=true , address=77.90.31.13:4651 , piece_id=KVYWHATVMKX3WZB7UWCIPQ5TIXHLAO7TWECK4XRQDILQ4HOUSB3Q, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188266736 (311h31m51.919534356s) [noise=true , address=104.36.82.13:4209 , piece_id=AJ5OPQIYSANI4EFJQYTCSC4OYA2KV4PR23YNLROCLL62ZNT2CINQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188291242 (311h31m51.919558873s) [noise=true , address=77.90.31.15:4719 , piece_id=SQOIUIMMOLGQHURPXKR4E3SYUKDJDJNZ75Q4RXA3W2E4JOG5WXLQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188643465 (311h31m51.919911095s) [noise=true , address=104.36.82.14:4236 , piece_id=EOTHS7XHUD5YNTOQOVTFR6EIRGREL4VBL2KLS5LJVQJKTMRWWUVQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188658473 (311h31m51.919926103s) [noise=true , address=104.36.82.11:4118 , piece_id=MFWA4J22CPFE4HEYFXZISYJDAKWCF3HEYHVCYKSFQY5N27QT2O6A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188993774 (311h31m51.920261394s) [noise=true , address=77.90.31.18:4812 , piece_id=GRFZT75OBWQBGFZ3I3QYOGWHIFXJCZHKOGQOG34ZW6QG7BNBNGBQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189017548 (311h31m51.920285178s) [noise=true , address=77.90.31.11:4582 , piece_id=7I4O5F46N3EAAFKUSTBOA3DY5NF7PQHNILWM5GFZ5CEIGRZANDRQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189365152 (311h31m51.920632782s) [noise=true , address=79.127.205.234:4616 , piece_id=D3SSTIPP6BS4NL5IS3JTR6JTHG32VWVD6HIU27WB2HXRTI7SL4TQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189952657 (311h31m51.921220287s) [noise=true , address=104.36.82.45:4917 , piece_id=HHWHHUVVM76NSJNSFRSV5L2TJM7WABLPY3UMVM7CEZM44NKMXRHQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.190704210 (311h31m51.92197184s) [noise=true , address=45.91.116.11:4142 , piece_id=FTHDX3KRMQV2VPJA42JPTD5LDPAQCC6C2D6ODRZ7M4ZASZDJCSYA, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.191563527 (311h31m51.922831157s) [noise=true , address=45.91.116.11:4141 , piece_id=6OUW5WSYNG5GABS6BH3NNP3WRPYAK3SOVJDSXLMPICFMSNWD3O3Q, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.192590128 (311h31m51.923857758s) [noise=true , address=104.36.82.6:4907 , piece_id=ZVU2TK7PXTZBHLLU657Q5U5BS33QIIGR5WBBUE23LMRWNYSGIJEQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.292199435 (311h31m52.023467055s) [upload=323881]: Next returned nil segment
Aug 21 16:58:11.292208382 (311h31m52.023476002s) [upload=323881]: Waiting for error group managing segments...
Aug 21 16:58:11.305981536 (311h31m52.037249156s) [noise=true , address=104.36.82.11:4118 , piece_id=MFWA4J22CPFE4HEYFXZISYJDAKWCF3HEYHVCYKSFQY5N27QT2O6A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.317455457 (311h31m52.048723076s) [noise=true , address=77.90.31.11:4582 , piece_id=7I4O5F46N3EAAFKUSTBOA3DY5NF7PQHNILWM5GFZ5CEIGRZANDRQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.319650365 (311h31m52.050917985s) [noise=true , address=77.90.31.18:4812 , piece_id=GRFZT75OBWQBGFZ3I3QYOGWHIFXJCZHKOGQOG34ZW6QG7BNBNGBQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.320890678 (311h31m52.052158297s) [noise=true , address=104.36.82.49:4012 , piece_id=CQSJDRQSYII2TZ4IXSILK3IN4WMGVOJEHPQJBPWPYII5HQ7G2B3A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.325965804 (311h31m52.057233424s) [noise=true , address=77.90.31.15:4719 , piece_id=SQOIUIMMOLGQHURPXKR4E3SYUKDJDJNZ75Q4RXA3W2E4JOG5WXLQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.327860037 (311h31m52.059127667s) [noise=true , address=45.91.116.11:4142 , piece_id=FTHDX3KRMQV2VPJA42JPTD5LDPAQCC6C2D6ODRZ7M4ZASZDJCSYA, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.328132208 (311h31m52.059399828s) [noise=true , address=45.91.116.5:4312 , piece_id=QCY54KDIJ3SFLIE2X6KBQD2UIEWMGYBOL33JKFLWGXZGRTB42YQQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.330010401 (311h31m52.061278021s) [noise=true , address=77.90.31.10:4548 , piece_id=3IWDAKTWMTSIYUHS4YSHUGNPZXYIOTCE523RYZCYL2FEW226R45A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.335413914 (311h31m52.066681533s) [noise=true , address=77.90.31.13:4651 , piece_id=KVYWHATVMKX3WZB7UWCIPQ5TIXHLAO7TWECK4XRQDILQ4HOUSB3Q, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.341151935 (311h31m52.072419546s) [noise=true , address=104.36.82.9:4022 , piece_id=XHQFV3SHMAT7WOOWG6U5QRRO3VBLZUE2SV7N5N4IDWWB6MPAT7JA, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.348847890 (311h31m52.08011552s) [noise=true , address=104.36.82.6:4907 , piece_id=ZVU2TK7PXTZBHLLU657Q5U5BS33QIIGR5WBBUE23LMRWNYSGIJEQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.360184613 (311h31m52.091452233s) [noise=true , address=104.36.82.13:4209 , piece_id=AJ5OPQIYSANI4EFJQYTCSC4OYA2KV4PR23YNLROCLL62ZNT2CINQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.366983571 (311h31m52.098251201s) [noise=true , address=77.90.31.19:4851 , piece_id=YZ7SGALUQPTAHO5ZARMCVMADX5AGH6BQNCN5UTC74JPLPEWALEDQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.392521653 (311h31m52.123789274s) [noise=true , address=104.36.82.45:4917 , piece_id=HHWHHUVVM76NSJNSFRSV5L2TJM7WABLPY3UMVM7CEZM44NKMXRHQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.392540769 (311h31m52.123808399s) [seg_pos={0 0}, upload=323881]: Segment reached optimal threshold of 14 pieces.
Aug 21 16:58:11.392827879 (311h31m52.124095509s) [noise=true , address=104.36.82.14:4236 , piece_id=EOTHS7XHUD5YNTOQOVTFR6EIRGREL4VBL2KLS5LJVQJKTMRWWUVQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XaE29W27ym2RmuGdBvHeKcQZZEUbask1zsm9Bz8xLokZNGfcj): protocol: expected piece hash; context canceled; EOF
Aug 21 16:58:11.393068121 (311h31m52.124335742s) [noise=true , address=45.91.116.11:4141 , piece_id=6OUW5WSYNG5GABS6BH3NNP3WRPYAK3SOVJDSXLMPICFMSNWD3O3Q, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h1gxgVjoHUkjKXA5xhTowGKi9q6wZGyzg8eqKgMHqsxF1ut5P): protocol: write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection; write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection
Aug 21 16:58:11.393129707 (311h31m52.124397326s) [noise=true , address=79.127.205.234:4616 , piece_id=D3SSTIPP6BS4NL5IS3JTR6JTHG32VWVD6HIU27WB2HXRTI7SL4TQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuFfyFT8z7TwZZsBhMRPx8HtLBqELmEzxbbsuG9Ljg9KKz3rm): protocol: read tcp 5.161.89.252:61860->79.127.205.234:4616: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 16:58:11.393280721 (311h31m52.124548371s) [noise=true , address=104.36.82.7:4920 , piece_id=7LGSALS6MO7SEPNO5KGHKACZ6CSAMJMV2GYHYY6BBVGFOXHRLPSQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.393342206 (311h31m52.124609846s) [seg_pos={0 0}, upload=323881]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 21 16:58:11.393461841 (311h31m52.124729492s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 16:58:11.393467823 (311h31m52.124735463s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 16:58:11.446017719 (311h31m52.177285349s) [upload=323881]: Done uploading segments...
Aug 21 16:58:11.446031615 (311h31m52.177299245s) [upload=323881]: Upload finished. err: <nil>
Duration: 644.504865ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................................X................X.........] duration:
1.206519996s
FAIL (2025-08-21 17:04:40 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 21 16:58:11.097765980 (311h31m51.82903362s) [upload=323881]: Starting upload
Aug 21 16:58:11.097816425 (311h31m51.829084066s) [upload=323881]: Done starting upload
Aug 21 16:58:11.097974212 (311h31m51.829241862s) [upload=323881]: Uploading segments...
Aug 21 16:58:11.098124976 (311h31m51.829392606s) [upload=323881]: Got next segment. Inline: false
Aug 21 16:58:11.098190559 (311h31m51.829458199s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 16:58:11.098198244 (311h31m51.829465904s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 16:58:11.186959668 (311h31m51.918227288s) [seg_pos={0 0}, upload=323881]: Begin upload segment...
Aug 21 16:58:11.187010914 (311h31m51.918278574s) [seg_pos={0 0}, upload=323881]: Done begin upload segment.
Aug 21 16:58:11.187041721 (311h31m51.918309351s) [noise=true , address=45.91.116.5:4312 , piece_id=QCY54KDIJ3SFLIE2X6KBQD2UIEWMGYBOL33JKFLWGXZGRTB42YQQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187059065 (311h31m51.918326695s) [noise=true , address=104.36.82.49:4012 , piece_id=CQSJDRQSYII2TZ4IXSILK3IN4WMGVOJEHPQJBPWPYII5HQ7G2B3A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187096966 (311h31m51.918364587s) [noise=true , address=104.36.82.7:4920 , piece_id=7LGSALS6MO7SEPNO5KGHKACZ6CSAMJMV2GYHYY6BBVGFOXHRLPSQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187499954 (311h31m51.918767574s) [noise=true , address=77.90.31.19:4851 , piece_id=YZ7SGALUQPTAHO5ZARMCVMADX5AGH6BQNCN5UTC74JPLPEWALEDQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187516114 (311h31m51.918783745s) [noise=true , address=104.36.82.9:4022 , piece_id=XHQFV3SHMAT7WOOWG6U5QRRO3VBLZUE2SV7N5N4IDWWB6MPAT7JA, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187870982 (311h31m51.919138612s) [noise=true , address=77.90.31.10:4548 , piece_id=3IWDAKTWMTSIYUHS4YSHUGNPZXYIOTCE523RYZCYL2FEW226R45A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187878215 (311h31m51.919145845s) [noise=true , address=77.90.31.13:4651 , piece_id=KVYWHATVMKX3WZB7UWCIPQ5TIXHLAO7TWECK4XRQDILQ4HOUSB3Q, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188266736 (311h31m51.919534356s) [noise=true , address=104.36.82.13:4209 , piece_id=AJ5OPQIYSANI4EFJQYTCSC4OYA2KV4PR23YNLROCLL62ZNT2CINQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188291242 (311h31m51.919558873s) [noise=true , address=77.90.31.15:4719 , piece_id=SQOIUIMMOLGQHURPXKR4E3SYUKDJDJNZ75Q4RXA3W2E4JOG5WXLQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188643465 (311h31m51.919911095s) [noise=true , address=104.36.82.14:4236 , piece_id=EOTHS7XHUD5YNTOQOVTFR6EIRGREL4VBL2KLS5LJVQJKTMRWWUVQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188658473 (311h31m51.919926103s) [noise=true , address=104.36.82.11:4118 , piece_id=MFWA4J22CPFE4HEYFXZISYJDAKWCF3HEYHVCYKSFQY5N27QT2O6A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188993774 (311h31m51.920261394s) [noise=true , address=77.90.31.18:4812 , piece_id=GRFZT75OBWQBGFZ3I3QYOGWHIFXJCZHKOGQOG34ZW6QG7BNBNGBQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189017548 (311h31m51.920285178s) [noise=true , address=77.90.31.11:4582 , piece_id=7I4O5F46N3EAAFKUSTBOA3DY5NF7PQHNILWM5GFZ5CEIGRZANDRQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189365152 (311h31m51.920632782s) [noise=true , address=79.127.205.234:4616 , piece_id=D3SSTIPP6BS4NL5IS3JTR6JTHG32VWVD6HIU27WB2HXRTI7SL4TQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189952657 (311h31m51.921220287s) [noise=true , address=104.36.82.45:4917 , piece_id=HHWHHUVVM76NSJNSFRSV5L2TJM7WABLPY3UMVM7CEZM44NKMXRHQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.190704210 (311h31m51.92197184s) [noise=true , address=45.91.116.11:4142 , piece_id=FTHDX3KRMQV2VPJA42JPTD5LDPAQCC6C2D6ODRZ7M4ZASZDJCSYA, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.191563527 (311h31m51.922831157s) [noise=true , address=45.91.116.11:4141 , piece_id=6OUW5WSYNG5GABS6BH3NNP3WRPYAK3SOVJDSXLMPICFMSNWD3O3Q, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.192590128 (311h31m51.923857758s) [noise=true , address=104.36.82.6:4907 , piece_id=ZVU2TK7PXTZBHLLU657Q5U5BS33QIIGR5WBBUE23LMRWNYSGIJEQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.292199435 (311h31m52.023467055s) [upload=323881]: Next returned nil segment
Aug 21 16:58:11.292208382 (311h31m52.023476002s) [upload=323881]: Waiting for error group managing segments...
Aug 21 16:58:11.305981536 (311h31m52.037249156s) [noise=true , address=104.36.82.11:4118 , piece_id=MFWA4J22CPFE4HEYFXZISYJDAKWCF3HEYHVCYKSFQY5N27QT2O6A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.317455457 (311h31m52.048723076s) [noise=true , address=77.90.31.11:4582 , piece_id=7I4O5F46N3EAAFKUSTBOA3DY5NF7PQHNILWM5GFZ5CEIGRZANDRQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.319650365 (311h31m52.050917985s) [noise=true , address=77.90.31.18:4812 , piece_id=GRFZT75OBWQBGFZ3I3QYOGWHIFXJCZHKOGQOG34ZW6QG7BNBNGBQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.320890678 (311h31m52.052158297s) [noise=true , address=104.36.82.49:4012 , piece_id=CQSJDRQSYII2TZ4IXSILK3IN4WMGVOJEHPQJBPWPYII5HQ7G2B3A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.325965804 (311h31m52.057233424s) [noise=true , address=77.90.31.15:4719 , piece_id=SQOIUIMMOLGQHURPXKR4E3SYUKDJDJNZ75Q4RXA3W2E4JOG5WXLQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.327860037 (311h31m52.059127667s) [noise=true , address=45.91.116.11:4142 , piece_id=FTHDX3KRMQV2VPJA42JPTD5LDPAQCC6C2D6ODRZ7M4ZASZDJCSYA, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.328132208 (311h31m52.059399828s) [noise=true , address=45.91.116.5:4312 , piece_id=QCY54KDIJ3SFLIE2X6KBQD2UIEWMGYBOL33JKFLWGXZGRTB42YQQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.330010401 (311h31m52.061278021s) [noise=true , address=77.90.31.10:4548 , piece_id=3IWDAKTWMTSIYUHS4YSHUGNPZXYIOTCE523RYZCYL2FEW226R45A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.335413914 (311h31m52.066681533s) [noise=true , address=77.90.31.13:4651 , piece_id=KVYWHATVMKX3WZB7UWCIPQ5TIXHLAO7TWECK4XRQDILQ4HOUSB3Q, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.341151935 (311h31m52.072419546s) [noise=true , address=104.36.82.9:4022 , piece_id=XHQFV3SHMAT7WOOWG6U5QRRO3VBLZUE2SV7N5N4IDWWB6MPAT7JA, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.348847890 (311h31m52.08011552s) [noise=true , address=104.36.82.6:4907 , piece_id=ZVU2TK7PXTZBHLLU657Q5U5BS33QIIGR5WBBUE23LMRWNYSGIJEQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.360184613 (311h31m52.091452233s) [noise=true , address=104.36.82.13:4209 , piece_id=AJ5OPQIYSANI4EFJQYTCSC4OYA2KV4PR23YNLROCLL62ZNT2CINQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.366983571 (311h31m52.098251201s) [noise=true , address=77.90.31.19:4851 , piece_id=YZ7SGALUQPTAHO5ZARMCVMADX5AGH6BQNCN5UTC74JPLPEWALEDQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.392521653 (311h31m52.123789274s) [noise=true , address=104.36.82.45:4917 , piece_id=HHWHHUVVM76NSJNSFRSV5L2TJM7WABLPY3UMVM7CEZM44NKMXRHQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.392540769 (311h31m52.123808399s) [seg_pos={0 0}, upload=323881]: Segment reached optimal threshold of 14 pieces.
Aug 21 16:58:11.392827879 (311h31m52.124095509s) [noise=true , address=104.36.82.14:4236 , piece_id=EOTHS7XHUD5YNTOQOVTFR6EIRGREL4VBL2KLS5LJVQJKTMRWWUVQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XaE29W27ym2RmuGdBvHeKcQZZEUbask1zsm9Bz8xLokZNGfcj): protocol: expected piece hash; context canceled; EOF
Aug 21 16:58:11.393068121 (311h31m52.124335742s) [noise=true , address=45.91.116.11:4141 , piece_id=6OUW5WSYNG5GABS6BH3NNP3WRPYAK3SOVJDSXLMPICFMSNWD3O3Q, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h1gxgVjoHUkjKXA5xhTowGKi9q6wZGyzg8eqKgMHqsxF1ut5P): protocol: write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection; write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection
Aug 21 16:58:11.393129707 (311h31m52.124397326s) [noise=true , address=79.127.205.234:4616 , piece_id=D3SSTIPP6BS4NL5IS3JTR6JTHG32VWVD6HIU27WB2HXRTI7SL4TQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuFfyFT8z7TwZZsBhMRPx8HtLBqELmEzxbbsuG9Ljg9KKz3rm): protocol: read tcp 5.161.89.252:61860->79.127.205.234:4616: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 16:58:11.393280721 (311h31m52.124548371s) [noise=true , address=104.36.82.7:4920 , piece_id=7LGSALS6MO7SEPNO5KGHKACZ6CSAMJMV2GYHYY6BBVGFOXHRLPSQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.393342206 (311h31m52.124609846s) [seg_pos={0 0}, upload=323881]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 21 16:58:11.393461841 (311h31m52.124729492s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 16:58:11.393467823 (311h31m52.124735463s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 16:58:11.446017719 (311h31m52.177285349s) [upload=323881]: Done uploading segments...
Aug 21 16:58:11.446031615 (311h31m52.177299245s) [upload=323881]: Upload finished. err: <nil>
Duration: 1.206543943s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................................X................X........] duration:
497.634702ms
FAIL (2025-08-21 17:04:12 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 21 16:58:11.097765980 (311h31m51.82903362s) [upload=323881]: Starting upload
Aug 21 16:58:11.097816425 (311h31m51.829084066s) [upload=323881]: Done starting upload
Aug 21 16:58:11.097974212 (311h31m51.829241862s) [upload=323881]: Uploading segments...
Aug 21 16:58:11.098124976 (311h31m51.829392606s) [upload=323881]: Got next segment. Inline: false
Aug 21 16:58:11.098190559 (311h31m51.829458199s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 16:58:11.098198244 (311h31m51.829465904s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 16:58:11.186959668 (311h31m51.918227288s) [seg_pos={0 0}, upload=323881]: Begin upload segment...
Aug 21 16:58:11.187010914 (311h31m51.918278574s) [seg_pos={0 0}, upload=323881]: Done begin upload segment.
Aug 21 16:58:11.187041721 (311h31m51.918309351s) [noise=true , address=45.91.116.5:4312 , piece_id=QCY54KDIJ3SFLIE2X6KBQD2UIEWMGYBOL33JKFLWGXZGRTB42YQQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187059065 (311h31m51.918326695s) [noise=true , address=104.36.82.49:4012 , piece_id=CQSJDRQSYII2TZ4IXSILK3IN4WMGVOJEHPQJBPWPYII5HQ7G2B3A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187096966 (311h31m51.918364587s) [noise=true , address=104.36.82.7:4920 , piece_id=7LGSALS6MO7SEPNO5KGHKACZ6CSAMJMV2GYHYY6BBVGFOXHRLPSQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187499954 (311h31m51.918767574s) [noise=true , address=77.90.31.19:4851 , piece_id=YZ7SGALUQPTAHO5ZARMCVMADX5AGH6BQNCN5UTC74JPLPEWALEDQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187516114 (311h31m51.918783745s) [noise=true , address=104.36.82.9:4022 , piece_id=XHQFV3SHMAT7WOOWG6U5QRRO3VBLZUE2SV7N5N4IDWWB6MPAT7JA, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187870982 (311h31m51.919138612s) [noise=true , address=77.90.31.10:4548 , piece_id=3IWDAKTWMTSIYUHS4YSHUGNPZXYIOTCE523RYZCYL2FEW226R45A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187878215 (311h31m51.919145845s) [noise=true , address=77.90.31.13:4651 , piece_id=KVYWHATVMKX3WZB7UWCIPQ5TIXHLAO7TWECK4XRQDILQ4HOUSB3Q, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188266736 (311h31m51.919534356s) [noise=true , address=104.36.82.13:4209 , piece_id=AJ5OPQIYSANI4EFJQYTCSC4OYA2KV4PR23YNLROCLL62ZNT2CINQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188291242 (311h31m51.919558873s) [noise=true , address=77.90.31.15:4719 , piece_id=SQOIUIMMOLGQHURPXKR4E3SYUKDJDJNZ75Q4RXA3W2E4JOG5WXLQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188643465 (311h31m51.919911095s) [noise=true , address=104.36.82.14:4236 , piece_id=EOTHS7XHUD5YNTOQOVTFR6EIRGREL4VBL2KLS5LJVQJKTMRWWUVQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188658473 (311h31m51.919926103s) [noise=true , address=104.36.82.11:4118 , piece_id=MFWA4J22CPFE4HEYFXZISYJDAKWCF3HEYHVCYKSFQY5N27QT2O6A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188993774 (311h31m51.920261394s) [noise=true , address=77.90.31.18:4812 , piece_id=GRFZT75OBWQBGFZ3I3QYOGWHIFXJCZHKOGQOG34ZW6QG7BNBNGBQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189017548 (311h31m51.920285178s) [noise=true , address=77.90.31.11:4582 , piece_id=7I4O5F46N3EAAFKUSTBOA3DY5NF7PQHNILWM5GFZ5CEIGRZANDRQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189365152 (311h31m51.920632782s) [noise=true , address=79.127.205.234:4616 , piece_id=D3SSTIPP6BS4NL5IS3JTR6JTHG32VWVD6HIU27WB2HXRTI7SL4TQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189952657 (311h31m51.921220287s) [noise=true , address=104.36.82.45:4917 , piece_id=HHWHHUVVM76NSJNSFRSV5L2TJM7WABLPY3UMVM7CEZM44NKMXRHQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.190704210 (311h31m51.92197184s) [noise=true , address=45.91.116.11:4142 , piece_id=FTHDX3KRMQV2VPJA42JPTD5LDPAQCC6C2D6ODRZ7M4ZASZDJCSYA, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.191563527 (311h31m51.922831157s) [noise=true , address=45.91.116.11:4141 , piece_id=6OUW5WSYNG5GABS6BH3NNP3WRPYAK3SOVJDSXLMPICFMSNWD3O3Q, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.192590128 (311h31m51.923857758s) [noise=true , address=104.36.82.6:4907 , piece_id=ZVU2TK7PXTZBHLLU657Q5U5BS33QIIGR5WBBUE23LMRWNYSGIJEQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.292199435 (311h31m52.023467055s) [upload=323881]: Next returned nil segment
Aug 21 16:58:11.292208382 (311h31m52.023476002s) [upload=323881]: Waiting for error group managing segments...
Aug 21 16:58:11.305981536 (311h31m52.037249156s) [noise=true , address=104.36.82.11:4118 , piece_id=MFWA4J22CPFE4HEYFXZISYJDAKWCF3HEYHVCYKSFQY5N27QT2O6A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.317455457 (311h31m52.048723076s) [noise=true , address=77.90.31.11:4582 , piece_id=7I4O5F46N3EAAFKUSTBOA3DY5NF7PQHNILWM5GFZ5CEIGRZANDRQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.319650365 (311h31m52.050917985s) [noise=true , address=77.90.31.18:4812 , piece_id=GRFZT75OBWQBGFZ3I3QYOGWHIFXJCZHKOGQOG34ZW6QG7BNBNGBQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.320890678 (311h31m52.052158297s) [noise=true , address=104.36.82.49:4012 , piece_id=CQSJDRQSYII2TZ4IXSILK3IN4WMGVOJEHPQJBPWPYII5HQ7G2B3A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.325965804 (311h31m52.057233424s) [noise=true , address=77.90.31.15:4719 , piece_id=SQOIUIMMOLGQHURPXKR4E3SYUKDJDJNZ75Q4RXA3W2E4JOG5WXLQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.327860037 (311h31m52.059127667s) [noise=true , address=45.91.116.11:4142 , piece_id=FTHDX3KRMQV2VPJA42JPTD5LDPAQCC6C2D6ODRZ7M4ZASZDJCSYA, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.328132208 (311h31m52.059399828s) [noise=true , address=45.91.116.5:4312 , piece_id=QCY54KDIJ3SFLIE2X6KBQD2UIEWMGYBOL33JKFLWGXZGRTB42YQQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.330010401 (311h31m52.061278021s) [noise=true , address=77.90.31.10:4548 , piece_id=3IWDAKTWMTSIYUHS4YSHUGNPZXYIOTCE523RYZCYL2FEW226R45A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.335413914 (311h31m52.066681533s) [noise=true , address=77.90.31.13:4651 , piece_id=KVYWHATVMKX3WZB7UWCIPQ5TIXHLAO7TWECK4XRQDILQ4HOUSB3Q, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.341151935 (311h31m52.072419546s) [noise=true , address=104.36.82.9:4022 , piece_id=XHQFV3SHMAT7WOOWG6U5QRRO3VBLZUE2SV7N5N4IDWWB6MPAT7JA, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.348847890 (311h31m52.08011552s) [noise=true , address=104.36.82.6:4907 , piece_id=ZVU2TK7PXTZBHLLU657Q5U5BS33QIIGR5WBBUE23LMRWNYSGIJEQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.360184613 (311h31m52.091452233s) [noise=true , address=104.36.82.13:4209 , piece_id=AJ5OPQIYSANI4EFJQYTCSC4OYA2KV4PR23YNLROCLL62ZNT2CINQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.366983571 (311h31m52.098251201s) [noise=true , address=77.90.31.19:4851 , piece_id=YZ7SGALUQPTAHO5ZARMCVMADX5AGH6BQNCN5UTC74JPLPEWALEDQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.392521653 (311h31m52.123789274s) [noise=true , address=104.36.82.45:4917 , piece_id=HHWHHUVVM76NSJNSFRSV5L2TJM7WABLPY3UMVM7CEZM44NKMXRHQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.392540769 (311h31m52.123808399s) [seg_pos={0 0}, upload=323881]: Segment reached optimal threshold of 14 pieces.
Aug 21 16:58:11.392827879 (311h31m52.124095509s) [noise=true , address=104.36.82.14:4236 , piece_id=EOTHS7XHUD5YNTOQOVTFR6EIRGREL4VBL2KLS5LJVQJKTMRWWUVQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XaE29W27ym2RmuGdBvHeKcQZZEUbask1zsm9Bz8xLokZNGfcj): protocol: expected piece hash; context canceled; EOF
Aug 21 16:58:11.393068121 (311h31m52.124335742s) [noise=true , address=45.91.116.11:4141 , piece_id=6OUW5WSYNG5GABS6BH3NNP3WRPYAK3SOVJDSXLMPICFMSNWD3O3Q, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h1gxgVjoHUkjKXA5xhTowGKi9q6wZGyzg8eqKgMHqsxF1ut5P): protocol: write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection; write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection
Aug 21 16:58:11.393129707 (311h31m52.124397326s) [noise=true , address=79.127.205.234:4616 , piece_id=D3SSTIPP6BS4NL5IS3JTR6JTHG32VWVD6HIU27WB2HXRTI7SL4TQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuFfyFT8z7TwZZsBhMRPx8HtLBqELmEzxbbsuG9Ljg9KKz3rm): protocol: read tcp 5.161.89.252:61860->79.127.205.234:4616: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 16:58:11.393280721 (311h31m52.124548371s) [noise=true , address=104.36.82.7:4920 , piece_id=7LGSALS6MO7SEPNO5KGHKACZ6CSAMJMV2GYHYY6BBVGFOXHRLPSQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.393342206 (311h31m52.124609846s) [seg_pos={0 0}, upload=323881]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 21 16:58:11.393461841 (311h31m52.124729492s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 16:58:11.393467823 (311h31m52.124735463s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 16:58:11.446017719 (311h31m52.177285349s) [upload=323881]: Done uploading segments...
Aug 21 16:58:11.446031615 (311h31m52.177299245s) [upload=323881]: Upload finished. err: <nil>
Duration: 497.655332ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................................X................X.......] duration:
453.467721ms
FAIL (2025-08-21 17:03:06 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 21 16:58:11.097765980 (311h31m51.82903362s) [upload=323881]: Starting upload
Aug 21 16:58:11.097816425 (311h31m51.829084066s) [upload=323881]: Done starting upload
Aug 21 16:58:11.097974212 (311h31m51.829241862s) [upload=323881]: Uploading segments...
Aug 21 16:58:11.098124976 (311h31m51.829392606s) [upload=323881]: Got next segment. Inline: false
Aug 21 16:58:11.098190559 (311h31m51.829458199s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 16:58:11.098198244 (311h31m51.829465904s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 16:58:11.186959668 (311h31m51.918227288s) [seg_pos={0 0}, upload=323881]: Begin upload segment...
Aug 21 16:58:11.187010914 (311h31m51.918278574s) [seg_pos={0 0}, upload=323881]: Done begin upload segment.
Aug 21 16:58:11.187041721 (311h31m51.918309351s) [noise=true , address=45.91.116.5:4312 , piece_id=QCY54KDIJ3SFLIE2X6KBQD2UIEWMGYBOL33JKFLWGXZGRTB42YQQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187059065 (311h31m51.918326695s) [noise=true , address=104.36.82.49:4012 , piece_id=CQSJDRQSYII2TZ4IXSILK3IN4WMGVOJEHPQJBPWPYII5HQ7G2B3A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187096966 (311h31m51.918364587s) [noise=true , address=104.36.82.7:4920 , piece_id=7LGSALS6MO7SEPNO5KGHKACZ6CSAMJMV2GYHYY6BBVGFOXHRLPSQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187499954 (311h31m51.918767574s) [noise=true , address=77.90.31.19:4851 , piece_id=YZ7SGALUQPTAHO5ZARMCVMADX5AGH6BQNCN5UTC74JPLPEWALEDQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187516114 (311h31m51.918783745s) [noise=true , address=104.36.82.9:4022 , piece_id=XHQFV3SHMAT7WOOWG6U5QRRO3VBLZUE2SV7N5N4IDWWB6MPAT7JA, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187870982 (311h31m51.919138612s) [noise=true , address=77.90.31.10:4548 , piece_id=3IWDAKTWMTSIYUHS4YSHUGNPZXYIOTCE523RYZCYL2FEW226R45A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187878215 (311h31m51.919145845s) [noise=true , address=77.90.31.13:4651 , piece_id=KVYWHATVMKX3WZB7UWCIPQ5TIXHLAO7TWECK4XRQDILQ4HOUSB3Q, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188266736 (311h31m51.919534356s) [noise=true , address=104.36.82.13:4209 , piece_id=AJ5OPQIYSANI4EFJQYTCSC4OYA2KV4PR23YNLROCLL62ZNT2CINQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188291242 (311h31m51.919558873s) [noise=true , address=77.90.31.15:4719 , piece_id=SQOIUIMMOLGQHURPXKR4E3SYUKDJDJNZ75Q4RXA3W2E4JOG5WXLQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188643465 (311h31m51.919911095s) [noise=true , address=104.36.82.14:4236 , piece_id=EOTHS7XHUD5YNTOQOVTFR6EIRGREL4VBL2KLS5LJVQJKTMRWWUVQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188658473 (311h31m51.919926103s) [noise=true , address=104.36.82.11:4118 , piece_id=MFWA4J22CPFE4HEYFXZISYJDAKWCF3HEYHVCYKSFQY5N27QT2O6A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188993774 (311h31m51.920261394s) [noise=true , address=77.90.31.18:4812 , piece_id=GRFZT75OBWQBGFZ3I3QYOGWHIFXJCZHKOGQOG34ZW6QG7BNBNGBQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189017548 (311h31m51.920285178s) [noise=true , address=77.90.31.11:4582 , piece_id=7I4O5F46N3EAAFKUSTBOA3DY5NF7PQHNILWM5GFZ5CEIGRZANDRQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189365152 (311h31m51.920632782s) [noise=true , address=79.127.205.234:4616 , piece_id=D3SSTIPP6BS4NL5IS3JTR6JTHG32VWVD6HIU27WB2HXRTI7SL4TQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189952657 (311h31m51.921220287s) [noise=true , address=104.36.82.45:4917 , piece_id=HHWHHUVVM76NSJNSFRSV5L2TJM7WABLPY3UMVM7CEZM44NKMXRHQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.190704210 (311h31m51.92197184s) [noise=true , address=45.91.116.11:4142 , piece_id=FTHDX3KRMQV2VPJA42JPTD5LDPAQCC6C2D6ODRZ7M4ZASZDJCSYA, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.191563527 (311h31m51.922831157s) [noise=true , address=45.91.116.11:4141 , piece_id=6OUW5WSYNG5GABS6BH3NNP3WRPYAK3SOVJDSXLMPICFMSNWD3O3Q, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.192590128 (311h31m51.923857758s) [noise=true , address=104.36.82.6:4907 , piece_id=ZVU2TK7PXTZBHLLU657Q5U5BS33QIIGR5WBBUE23LMRWNYSGIJEQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.292199435 (311h31m52.023467055s) [upload=323881]: Next returned nil segment
Aug 21 16:58:11.292208382 (311h31m52.023476002s) [upload=323881]: Waiting for error group managing segments...
Aug 21 16:58:11.305981536 (311h31m52.037249156s) [noise=true , address=104.36.82.11:4118 , piece_id=MFWA4J22CPFE4HEYFXZISYJDAKWCF3HEYHVCYKSFQY5N27QT2O6A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.317455457 (311h31m52.048723076s) [noise=true , address=77.90.31.11:4582 , piece_id=7I4O5F46N3EAAFKUSTBOA3DY5NF7PQHNILWM5GFZ5CEIGRZANDRQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.319650365 (311h31m52.050917985s) [noise=true , address=77.90.31.18:4812 , piece_id=GRFZT75OBWQBGFZ3I3QYOGWHIFXJCZHKOGQOG34ZW6QG7BNBNGBQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.320890678 (311h31m52.052158297s) [noise=true , address=104.36.82.49:4012 , piece_id=CQSJDRQSYII2TZ4IXSILK3IN4WMGVOJEHPQJBPWPYII5HQ7G2B3A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.325965804 (311h31m52.057233424s) [noise=true , address=77.90.31.15:4719 , piece_id=SQOIUIMMOLGQHURPXKR4E3SYUKDJDJNZ75Q4RXA3W2E4JOG5WXLQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.327860037 (311h31m52.059127667s) [noise=true , address=45.91.116.11:4142 , piece_id=FTHDX3KRMQV2VPJA42JPTD5LDPAQCC6C2D6ODRZ7M4ZASZDJCSYA, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.328132208 (311h31m52.059399828s) [noise=true , address=45.91.116.5:4312 , piece_id=QCY54KDIJ3SFLIE2X6KBQD2UIEWMGYBOL33JKFLWGXZGRTB42YQQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.330010401 (311h31m52.061278021s) [noise=true , address=77.90.31.10:4548 , piece_id=3IWDAKTWMTSIYUHS4YSHUGNPZXYIOTCE523RYZCYL2FEW226R45A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.335413914 (311h31m52.066681533s) [noise=true , address=77.90.31.13:4651 , piece_id=KVYWHATVMKX3WZB7UWCIPQ5TIXHLAO7TWECK4XRQDILQ4HOUSB3Q, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.341151935 (311h31m52.072419546s) [noise=true , address=104.36.82.9:4022 , piece_id=XHQFV3SHMAT7WOOWG6U5QRRO3VBLZUE2SV7N5N4IDWWB6MPAT7JA, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.348847890 (311h31m52.08011552s) [noise=true , address=104.36.82.6:4907 , piece_id=ZVU2TK7PXTZBHLLU657Q5U5BS33QIIGR5WBBUE23LMRWNYSGIJEQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.360184613 (311h31m52.091452233s) [noise=true , address=104.36.82.13:4209 , piece_id=AJ5OPQIYSANI4EFJQYTCSC4OYA2KV4PR23YNLROCLL62ZNT2CINQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.366983571 (311h31m52.098251201s) [noise=true , address=77.90.31.19:4851 , piece_id=YZ7SGALUQPTAHO5ZARMCVMADX5AGH6BQNCN5UTC74JPLPEWALEDQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.392521653 (311h31m52.123789274s) [noise=true , address=104.36.82.45:4917 , piece_id=HHWHHUVVM76NSJNSFRSV5L2TJM7WABLPY3UMVM7CEZM44NKMXRHQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.392540769 (311h31m52.123808399s) [seg_pos={0 0}, upload=323881]: Segment reached optimal threshold of 14 pieces.
Aug 21 16:58:11.392827879 (311h31m52.124095509s) [noise=true , address=104.36.82.14:4236 , piece_id=EOTHS7XHUD5YNTOQOVTFR6EIRGREL4VBL2KLS5LJVQJKTMRWWUVQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XaE29W27ym2RmuGdBvHeKcQZZEUbask1zsm9Bz8xLokZNGfcj): protocol: expected piece hash; context canceled; EOF
Aug 21 16:58:11.393068121 (311h31m52.124335742s) [noise=true , address=45.91.116.11:4141 , piece_id=6OUW5WSYNG5GABS6BH3NNP3WRPYAK3SOVJDSXLMPICFMSNWD3O3Q, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h1gxgVjoHUkjKXA5xhTowGKi9q6wZGyzg8eqKgMHqsxF1ut5P): protocol: write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection; write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection
Aug 21 16:58:11.393129707 (311h31m52.124397326s) [noise=true , address=79.127.205.234:4616 , piece_id=D3SSTIPP6BS4NL5IS3JTR6JTHG32VWVD6HIU27WB2HXRTI7SL4TQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuFfyFT8z7TwZZsBhMRPx8HtLBqELmEzxbbsuG9Ljg9KKz3rm): protocol: read tcp 5.161.89.252:61860->79.127.205.234:4616: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 16:58:11.393280721 (311h31m52.124548371s) [noise=true , address=104.36.82.7:4920 , piece_id=7LGSALS6MO7SEPNO5KGHKACZ6CSAMJMV2GYHYY6BBVGFOXHRLPSQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.393342206 (311h31m52.124609846s) [seg_pos={0 0}, upload=323881]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 21 16:58:11.393461841 (311h31m52.124729492s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 16:58:11.393467823 (311h31m52.124735463s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 16:58:11.446017719 (311h31m52.177285349s) [upload=323881]: Done uploading segments...
Aug 21 16:58:11.446031615 (311h31m52.177299245s) [upload=323881]: Upload finished. err: <nil>
Duration: 453.50462ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................................X................X......] duration:
2.008339634s
FAIL (2025-08-21 17:02:50 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 21 16:58:11.097765980 (311h31m51.82903362s) [upload=323881]: Starting upload
Aug 21 16:58:11.097816425 (311h31m51.829084066s) [upload=323881]: Done starting upload
Aug 21 16:58:11.097974212 (311h31m51.829241862s) [upload=323881]: Uploading segments...
Aug 21 16:58:11.098124976 (311h31m51.829392606s) [upload=323881]: Got next segment. Inline: false
Aug 21 16:58:11.098190559 (311h31m51.829458199s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 16:58:11.098198244 (311h31m51.829465904s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 16:58:11.186959668 (311h31m51.918227288s) [seg_pos={0 0}, upload=323881]: Begin upload segment...
Aug 21 16:58:11.187010914 (311h31m51.918278574s) [seg_pos={0 0}, upload=323881]: Done begin upload segment.
Aug 21 16:58:11.187041721 (311h31m51.918309351s) [noise=true , address=45.91.116.5:4312 , piece_id=QCY54KDIJ3SFLIE2X6KBQD2UIEWMGYBOL33JKFLWGXZGRTB42YQQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187059065 (311h31m51.918326695s) [noise=true , address=104.36.82.49:4012 , piece_id=CQSJDRQSYII2TZ4IXSILK3IN4WMGVOJEHPQJBPWPYII5HQ7G2B3A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187096966 (311h31m51.918364587s) [noise=true , address=104.36.82.7:4920 , piece_id=7LGSALS6MO7SEPNO5KGHKACZ6CSAMJMV2GYHYY6BBVGFOXHRLPSQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187499954 (311h31m51.918767574s) [noise=true , address=77.90.31.19:4851 , piece_id=YZ7SGALUQPTAHO5ZARMCVMADX5AGH6BQNCN5UTC74JPLPEWALEDQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187516114 (311h31m51.918783745s) [noise=true , address=104.36.82.9:4022 , piece_id=XHQFV3SHMAT7WOOWG6U5QRRO3VBLZUE2SV7N5N4IDWWB6MPAT7JA, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187870982 (311h31m51.919138612s) [noise=true , address=77.90.31.10:4548 , piece_id=3IWDAKTWMTSIYUHS4YSHUGNPZXYIOTCE523RYZCYL2FEW226R45A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187878215 (311h31m51.919145845s) [noise=true , address=77.90.31.13:4651 , piece_id=KVYWHATVMKX3WZB7UWCIPQ5TIXHLAO7TWECK4XRQDILQ4HOUSB3Q, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188266736 (311h31m51.919534356s) [noise=true , address=104.36.82.13:4209 , piece_id=AJ5OPQIYSANI4EFJQYTCSC4OYA2KV4PR23YNLROCLL62ZNT2CINQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188291242 (311h31m51.919558873s) [noise=true , address=77.90.31.15:4719 , piece_id=SQOIUIMMOLGQHURPXKR4E3SYUKDJDJNZ75Q4RXA3W2E4JOG5WXLQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188643465 (311h31m51.919911095s) [noise=true , address=104.36.82.14:4236 , piece_id=EOTHS7XHUD5YNTOQOVTFR6EIRGREL4VBL2KLS5LJVQJKTMRWWUVQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188658473 (311h31m51.919926103s) [noise=true , address=104.36.82.11:4118 , piece_id=MFWA4J22CPFE4HEYFXZISYJDAKWCF3HEYHVCYKSFQY5N27QT2O6A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188993774 (311h31m51.920261394s) [noise=true , address=77.90.31.18:4812 , piece_id=GRFZT75OBWQBGFZ3I3QYOGWHIFXJCZHKOGQOG34ZW6QG7BNBNGBQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189017548 (311h31m51.920285178s) [noise=true , address=77.90.31.11:4582 , piece_id=7I4O5F46N3EAAFKUSTBOA3DY5NF7PQHNILWM5GFZ5CEIGRZANDRQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189365152 (311h31m51.920632782s) [noise=true , address=79.127.205.234:4616 , piece_id=D3SSTIPP6BS4NL5IS3JTR6JTHG32VWVD6HIU27WB2HXRTI7SL4TQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189952657 (311h31m51.921220287s) [noise=true , address=104.36.82.45:4917 , piece_id=HHWHHUVVM76NSJNSFRSV5L2TJM7WABLPY3UMVM7CEZM44NKMXRHQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.190704210 (311h31m51.92197184s) [noise=true , address=45.91.116.11:4142 , piece_id=FTHDX3KRMQV2VPJA42JPTD5LDPAQCC6C2D6ODRZ7M4ZASZDJCSYA, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.191563527 (311h31m51.922831157s) [noise=true , address=45.91.116.11:4141 , piece_id=6OUW5WSYNG5GABS6BH3NNP3WRPYAK3SOVJDSXLMPICFMSNWD3O3Q, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.192590128 (311h31m51.923857758s) [noise=true , address=104.36.82.6:4907 , piece_id=ZVU2TK7PXTZBHLLU657Q5U5BS33QIIGR5WBBUE23LMRWNYSGIJEQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.292199435 (311h31m52.023467055s) [upload=323881]: Next returned nil segment
Aug 21 16:58:11.292208382 (311h31m52.023476002s) [upload=323881]: Waiting for error group managing segments...
Aug 21 16:58:11.305981536 (311h31m52.037249156s) [noise=true , address=104.36.82.11:4118 , piece_id=MFWA4J22CPFE4HEYFXZISYJDAKWCF3HEYHVCYKSFQY5N27QT2O6A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.317455457 (311h31m52.048723076s) [noise=true , address=77.90.31.11:4582 , piece_id=7I4O5F46N3EAAFKUSTBOA3DY5NF7PQHNILWM5GFZ5CEIGRZANDRQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.319650365 (311h31m52.050917985s) [noise=true , address=77.90.31.18:4812 , piece_id=GRFZT75OBWQBGFZ3I3QYOGWHIFXJCZHKOGQOG34ZW6QG7BNBNGBQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.320890678 (311h31m52.052158297s) [noise=true , address=104.36.82.49:4012 , piece_id=CQSJDRQSYII2TZ4IXSILK3IN4WMGVOJEHPQJBPWPYII5HQ7G2B3A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.325965804 (311h31m52.057233424s) [noise=true , address=77.90.31.15:4719 , piece_id=SQOIUIMMOLGQHURPXKR4E3SYUKDJDJNZ75Q4RXA3W2E4JOG5WXLQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.327860037 (311h31m52.059127667s) [noise=true , address=45.91.116.11:4142 , piece_id=FTHDX3KRMQV2VPJA42JPTD5LDPAQCC6C2D6ODRZ7M4ZASZDJCSYA, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.328132208 (311h31m52.059399828s) [noise=true , address=45.91.116.5:4312 , piece_id=QCY54KDIJ3SFLIE2X6KBQD2UIEWMGYBOL33JKFLWGXZGRTB42YQQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.330010401 (311h31m52.061278021s) [noise=true , address=77.90.31.10:4548 , piece_id=3IWDAKTWMTSIYUHS4YSHUGNPZXYIOTCE523RYZCYL2FEW226R45A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.335413914 (311h31m52.066681533s) [noise=true , address=77.90.31.13:4651 , piece_id=KVYWHATVMKX3WZB7UWCIPQ5TIXHLAO7TWECK4XRQDILQ4HOUSB3Q, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.341151935 (311h31m52.072419546s) [noise=true , address=104.36.82.9:4022 , piece_id=XHQFV3SHMAT7WOOWG6U5QRRO3VBLZUE2SV7N5N4IDWWB6MPAT7JA, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.348847890 (311h31m52.08011552s) [noise=true , address=104.36.82.6:4907 , piece_id=ZVU2TK7PXTZBHLLU657Q5U5BS33QIIGR5WBBUE23LMRWNYSGIJEQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.360184613 (311h31m52.091452233s) [noise=true , address=104.36.82.13:4209 , piece_id=AJ5OPQIYSANI4EFJQYTCSC4OYA2KV4PR23YNLROCLL62ZNT2CINQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.366983571 (311h31m52.098251201s) [noise=true , address=77.90.31.19:4851 , piece_id=YZ7SGALUQPTAHO5ZARMCVMADX5AGH6BQNCN5UTC74JPLPEWALEDQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.392521653 (311h31m52.123789274s) [noise=true , address=104.36.82.45:4917 , piece_id=HHWHHUVVM76NSJNSFRSV5L2TJM7WABLPY3UMVM7CEZM44NKMXRHQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.392540769 (311h31m52.123808399s) [seg_pos={0 0}, upload=323881]: Segment reached optimal threshold of 14 pieces.
Aug 21 16:58:11.392827879 (311h31m52.124095509s) [noise=true , address=104.36.82.14:4236 , piece_id=EOTHS7XHUD5YNTOQOVTFR6EIRGREL4VBL2KLS5LJVQJKTMRWWUVQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XaE29W27ym2RmuGdBvHeKcQZZEUbask1zsm9Bz8xLokZNGfcj): protocol: expected piece hash; context canceled; EOF
Aug 21 16:58:11.393068121 (311h31m52.124335742s) [noise=true , address=45.91.116.11:4141 , piece_id=6OUW5WSYNG5GABS6BH3NNP3WRPYAK3SOVJDSXLMPICFMSNWD3O3Q, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h1gxgVjoHUkjKXA5xhTowGKi9q6wZGyzg8eqKgMHqsxF1ut5P): protocol: write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection; write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection
Aug 21 16:58:11.393129707 (311h31m52.124397326s) [noise=true , address=79.127.205.234:4616 , piece_id=D3SSTIPP6BS4NL5IS3JTR6JTHG32VWVD6HIU27WB2HXRTI7SL4TQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuFfyFT8z7TwZZsBhMRPx8HtLBqELmEzxbbsuG9Ljg9KKz3rm): protocol: read tcp 5.161.89.252:61860->79.127.205.234:4616: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 16:58:11.393280721 (311h31m52.124548371s) [noise=true , address=104.36.82.7:4920 , piece_id=7LGSALS6MO7SEPNO5KGHKACZ6CSAMJMV2GYHYY6BBVGFOXHRLPSQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.393342206 (311h31m52.124609846s) [seg_pos={0 0}, upload=323881]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 21 16:58:11.393461841 (311h31m52.124729492s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 16:58:11.393467823 (311h31m52.124735463s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 16:58:11.446017719 (311h31m52.177285349s) [upload=323881]: Done uploading segments...
Aug 21 16:58:11.446031615 (311h31m52.177299245s) [upload=323881]: Upload finished. err: <nil>
Duration: 2.008371384s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X................X.....] duration:
680.144419ms
FAIL (2025-08-21 17:01:45 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 21 16:58:11.097765980 (311h31m51.82903362s) [upload=323881]: Starting upload
Aug 21 16:58:11.097816425 (311h31m51.829084066s) [upload=323881]: Done starting upload
Aug 21 16:58:11.097974212 (311h31m51.829241862s) [upload=323881]: Uploading segments...
Aug 21 16:58:11.098124976 (311h31m51.829392606s) [upload=323881]: Got next segment. Inline: false
Aug 21 16:58:11.098190559 (311h31m51.829458199s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 16:58:11.098198244 (311h31m51.829465904s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 16:58:11.186959668 (311h31m51.918227288s) [seg_pos={0 0}, upload=323881]: Begin upload segment...
Aug 21 16:58:11.187010914 (311h31m51.918278574s) [seg_pos={0 0}, upload=323881]: Done begin upload segment.
Aug 21 16:58:11.187041721 (311h31m51.918309351s) [noise=true , address=45.91.116.5:4312 , piece_id=QCY54KDIJ3SFLIE2X6KBQD2UIEWMGYBOL33JKFLWGXZGRTB42YQQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187059065 (311h31m51.918326695s) [noise=true , address=104.36.82.49:4012 , piece_id=CQSJDRQSYII2TZ4IXSILK3IN4WMGVOJEHPQJBPWPYII5HQ7G2B3A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187096966 (311h31m51.918364587s) [noise=true , address=104.36.82.7:4920 , piece_id=7LGSALS6MO7SEPNO5KGHKACZ6CSAMJMV2GYHYY6BBVGFOXHRLPSQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187499954 (311h31m51.918767574s) [noise=true , address=77.90.31.19:4851 , piece_id=YZ7SGALUQPTAHO5ZARMCVMADX5AGH6BQNCN5UTC74JPLPEWALEDQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187516114 (311h31m51.918783745s) [noise=true , address=104.36.82.9:4022 , piece_id=XHQFV3SHMAT7WOOWG6U5QRRO3VBLZUE2SV7N5N4IDWWB6MPAT7JA, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187870982 (311h31m51.919138612s) [noise=true , address=77.90.31.10:4548 , piece_id=3IWDAKTWMTSIYUHS4YSHUGNPZXYIOTCE523RYZCYL2FEW226R45A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187878215 (311h31m51.919145845s) [noise=true , address=77.90.31.13:4651 , piece_id=KVYWHATVMKX3WZB7UWCIPQ5TIXHLAO7TWECK4XRQDILQ4HOUSB3Q, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188266736 (311h31m51.919534356s) [noise=true , address=104.36.82.13:4209 , piece_id=AJ5OPQIYSANI4EFJQYTCSC4OYA2KV4PR23YNLROCLL62ZNT2CINQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188291242 (311h31m51.919558873s) [noise=true , address=77.90.31.15:4719 , piece_id=SQOIUIMMOLGQHURPXKR4E3SYUKDJDJNZ75Q4RXA3W2E4JOG5WXLQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188643465 (311h31m51.919911095s) [noise=true , address=104.36.82.14:4236 , piece_id=EOTHS7XHUD5YNTOQOVTFR6EIRGREL4VBL2KLS5LJVQJKTMRWWUVQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188658473 (311h31m51.919926103s) [noise=true , address=104.36.82.11:4118 , piece_id=MFWA4J22CPFE4HEYFXZISYJDAKWCF3HEYHVCYKSFQY5N27QT2O6A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188993774 (311h31m51.920261394s) [noise=true , address=77.90.31.18:4812 , piece_id=GRFZT75OBWQBGFZ3I3QYOGWHIFXJCZHKOGQOG34ZW6QG7BNBNGBQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189017548 (311h31m51.920285178s) [noise=true , address=77.90.31.11:4582 , piece_id=7I4O5F46N3EAAFKUSTBOA3DY5NF7PQHNILWM5GFZ5CEIGRZANDRQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189365152 (311h31m51.920632782s) [noise=true , address=79.127.205.234:4616 , piece_id=D3SSTIPP6BS4NL5IS3JTR6JTHG32VWVD6HIU27WB2HXRTI7SL4TQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189952657 (311h31m51.921220287s) [noise=true , address=104.36.82.45:4917 , piece_id=HHWHHUVVM76NSJNSFRSV5L2TJM7WABLPY3UMVM7CEZM44NKMXRHQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.190704210 (311h31m51.92197184s) [noise=true , address=45.91.116.11:4142 , piece_id=FTHDX3KRMQV2VPJA42JPTD5LDPAQCC6C2D6ODRZ7M4ZASZDJCSYA, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.191563527 (311h31m51.922831157s) [noise=true , address=45.91.116.11:4141 , piece_id=6OUW5WSYNG5GABS6BH3NNP3WRPYAK3SOVJDSXLMPICFMSNWD3O3Q, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.192590128 (311h31m51.923857758s) [noise=true , address=104.36.82.6:4907 , piece_id=ZVU2TK7PXTZBHLLU657Q5U5BS33QIIGR5WBBUE23LMRWNYSGIJEQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.292199435 (311h31m52.023467055s) [upload=323881]: Next returned nil segment
Aug 21 16:58:11.292208382 (311h31m52.023476002s) [upload=323881]: Waiting for error group managing segments...
Aug 21 16:58:11.305981536 (311h31m52.037249156s) [noise=true , address=104.36.82.11:4118 , piece_id=MFWA4J22CPFE4HEYFXZISYJDAKWCF3HEYHVCYKSFQY5N27QT2O6A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.317455457 (311h31m52.048723076s) [noise=true , address=77.90.31.11:4582 , piece_id=7I4O5F46N3EAAFKUSTBOA3DY5NF7PQHNILWM5GFZ5CEIGRZANDRQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.319650365 (311h31m52.050917985s) [noise=true , address=77.90.31.18:4812 , piece_id=GRFZT75OBWQBGFZ3I3QYOGWHIFXJCZHKOGQOG34ZW6QG7BNBNGBQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.320890678 (311h31m52.052158297s) [noise=true , address=104.36.82.49:4012 , piece_id=CQSJDRQSYII2TZ4IXSILK3IN4WMGVOJEHPQJBPWPYII5HQ7G2B3A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.325965804 (311h31m52.057233424s) [noise=true , address=77.90.31.15:4719 , piece_id=SQOIUIMMOLGQHURPXKR4E3SYUKDJDJNZ75Q4RXA3W2E4JOG5WXLQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.327860037 (311h31m52.059127667s) [noise=true , address=45.91.116.11:4142 , piece_id=FTHDX3KRMQV2VPJA42JPTD5LDPAQCC6C2D6ODRZ7M4ZASZDJCSYA, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.328132208 (311h31m52.059399828s) [noise=true , address=45.91.116.5:4312 , piece_id=QCY54KDIJ3SFLIE2X6KBQD2UIEWMGYBOL33JKFLWGXZGRTB42YQQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.330010401 (311h31m52.061278021s) [noise=true , address=77.90.31.10:4548 , piece_id=3IWDAKTWMTSIYUHS4YSHUGNPZXYIOTCE523RYZCYL2FEW226R45A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.335413914 (311h31m52.066681533s) [noise=true , address=77.90.31.13:4651 , piece_id=KVYWHATVMKX3WZB7UWCIPQ5TIXHLAO7TWECK4XRQDILQ4HOUSB3Q, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.341151935 (311h31m52.072419546s) [noise=true , address=104.36.82.9:4022 , piece_id=XHQFV3SHMAT7WOOWG6U5QRRO3VBLZUE2SV7N5N4IDWWB6MPAT7JA, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.348847890 (311h31m52.08011552s) [noise=true , address=104.36.82.6:4907 , piece_id=ZVU2TK7PXTZBHLLU657Q5U5BS33QIIGR5WBBUE23LMRWNYSGIJEQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.360184613 (311h31m52.091452233s) [noise=true , address=104.36.82.13:4209 , piece_id=AJ5OPQIYSANI4EFJQYTCSC4OYA2KV4PR23YNLROCLL62ZNT2CINQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.366983571 (311h31m52.098251201s) [noise=true , address=77.90.31.19:4851 , piece_id=YZ7SGALUQPTAHO5ZARMCVMADX5AGH6BQNCN5UTC74JPLPEWALEDQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.392521653 (311h31m52.123789274s) [noise=true , address=104.36.82.45:4917 , piece_id=HHWHHUVVM76NSJNSFRSV5L2TJM7WABLPY3UMVM7CEZM44NKMXRHQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.392540769 (311h31m52.123808399s) [seg_pos={0 0}, upload=323881]: Segment reached optimal threshold of 14 pieces.
Aug 21 16:58:11.392827879 (311h31m52.124095509s) [noise=true , address=104.36.82.14:4236 , piece_id=EOTHS7XHUD5YNTOQOVTFR6EIRGREL4VBL2KLS5LJVQJKTMRWWUVQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XaE29W27ym2RmuGdBvHeKcQZZEUbask1zsm9Bz8xLokZNGfcj): protocol: expected piece hash; context canceled; EOF
Aug 21 16:58:11.393068121 (311h31m52.124335742s) [noise=true , address=45.91.116.11:4141 , piece_id=6OUW5WSYNG5GABS6BH3NNP3WRPYAK3SOVJDSXLMPICFMSNWD3O3Q, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h1gxgVjoHUkjKXA5xhTowGKi9q6wZGyzg8eqKgMHqsxF1ut5P): protocol: write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection; write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection
Aug 21 16:58:11.393129707 (311h31m52.124397326s) [noise=true , address=79.127.205.234:4616 , piece_id=D3SSTIPP6BS4NL5IS3JTR6JTHG32VWVD6HIU27WB2HXRTI7SL4TQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuFfyFT8z7TwZZsBhMRPx8HtLBqELmEzxbbsuG9Ljg9KKz3rm): protocol: read tcp 5.161.89.252:61860->79.127.205.234:4616: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 16:58:11.393280721 (311h31m52.124548371s) [noise=true , address=104.36.82.7:4920 , piece_id=7LGSALS6MO7SEPNO5KGHKACZ6CSAMJMV2GYHYY6BBVGFOXHRLPSQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.393342206 (311h31m52.124609846s) [seg_pos={0 0}, upload=323881]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 21 16:58:11.393461841 (311h31m52.124729492s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 16:58:11.393467823 (311h31m52.124735463s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 16:58:11.446017719 (311h31m52.177285349s) [upload=323881]: Done uploading segments...
Aug 21 16:58:11.446031615 (311h31m52.177299245s) [upload=323881]: Upload finished. err: <nil>
Duration: 680.171629ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................................X................X....] duration:
1.86801083s
FAIL (2025-08-21 17:01:06 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 21 16:58:11.097765980 (311h31m51.82903362s) [upload=323881]: Starting upload
Aug 21 16:58:11.097816425 (311h31m51.829084066s) [upload=323881]: Done starting upload
Aug 21 16:58:11.097974212 (311h31m51.829241862s) [upload=323881]: Uploading segments...
Aug 21 16:58:11.098124976 (311h31m51.829392606s) [upload=323881]: Got next segment. Inline: false
Aug 21 16:58:11.098190559 (311h31m51.829458199s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 16:58:11.098198244 (311h31m51.829465904s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 16:58:11.186959668 (311h31m51.918227288s) [seg_pos={0 0}, upload=323881]: Begin upload segment...
Aug 21 16:58:11.187010914 (311h31m51.918278574s) [seg_pos={0 0}, upload=323881]: Done begin upload segment.
Aug 21 16:58:11.187041721 (311h31m51.918309351s) [noise=true , address=45.91.116.5:4312 , piece_id=QCY54KDIJ3SFLIE2X6KBQD2UIEWMGYBOL33JKFLWGXZGRTB42YQQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187059065 (311h31m51.918326695s) [noise=true , address=104.36.82.49:4012 , piece_id=CQSJDRQSYII2TZ4IXSILK3IN4WMGVOJEHPQJBPWPYII5HQ7G2B3A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187096966 (311h31m51.918364587s) [noise=true , address=104.36.82.7:4920 , piece_id=7LGSALS6MO7SEPNO5KGHKACZ6CSAMJMV2GYHYY6BBVGFOXHRLPSQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187499954 (311h31m51.918767574s) [noise=true , address=77.90.31.19:4851 , piece_id=YZ7SGALUQPTAHO5ZARMCVMADX5AGH6BQNCN5UTC74JPLPEWALEDQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187516114 (311h31m51.918783745s) [noise=true , address=104.36.82.9:4022 , piece_id=XHQFV3SHMAT7WOOWG6U5QRRO3VBLZUE2SV7N5N4IDWWB6MPAT7JA, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187870982 (311h31m51.919138612s) [noise=true , address=77.90.31.10:4548 , piece_id=3IWDAKTWMTSIYUHS4YSHUGNPZXYIOTCE523RYZCYL2FEW226R45A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187878215 (311h31m51.919145845s) [noise=true , address=77.90.31.13:4651 , piece_id=KVYWHATVMKX3WZB7UWCIPQ5TIXHLAO7TWECK4XRQDILQ4HOUSB3Q, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188266736 (311h31m51.919534356s) [noise=true , address=104.36.82.13:4209 , piece_id=AJ5OPQIYSANI4EFJQYTCSC4OYA2KV4PR23YNLROCLL62ZNT2CINQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188291242 (311h31m51.919558873s) [noise=true , address=77.90.31.15:4719 , piece_id=SQOIUIMMOLGQHURPXKR4E3SYUKDJDJNZ75Q4RXA3W2E4JOG5WXLQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188643465 (311h31m51.919911095s) [noise=true , address=104.36.82.14:4236 , piece_id=EOTHS7XHUD5YNTOQOVTFR6EIRGREL4VBL2KLS5LJVQJKTMRWWUVQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188658473 (311h31m51.919926103s) [noise=true , address=104.36.82.11:4118 , piece_id=MFWA4J22CPFE4HEYFXZISYJDAKWCF3HEYHVCYKSFQY5N27QT2O6A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188993774 (311h31m51.920261394s) [noise=true , address=77.90.31.18:4812 , piece_id=GRFZT75OBWQBGFZ3I3QYOGWHIFXJCZHKOGQOG34ZW6QG7BNBNGBQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189017548 (311h31m51.920285178s) [noise=true , address=77.90.31.11:4582 , piece_id=7I4O5F46N3EAAFKUSTBOA3DY5NF7PQHNILWM5GFZ5CEIGRZANDRQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189365152 (311h31m51.920632782s) [noise=true , address=79.127.205.234:4616 , piece_id=D3SSTIPP6BS4NL5IS3JTR6JTHG32VWVD6HIU27WB2HXRTI7SL4TQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189952657 (311h31m51.921220287s) [noise=true , address=104.36.82.45:4917 , piece_id=HHWHHUVVM76NSJNSFRSV5L2TJM7WABLPY3UMVM7CEZM44NKMXRHQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.190704210 (311h31m51.92197184s) [noise=true , address=45.91.116.11:4142 , piece_id=FTHDX3KRMQV2VPJA42JPTD5LDPAQCC6C2D6ODRZ7M4ZASZDJCSYA, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.191563527 (311h31m51.922831157s) [noise=true , address=45.91.116.11:4141 , piece_id=6OUW5WSYNG5GABS6BH3NNP3WRPYAK3SOVJDSXLMPICFMSNWD3O3Q, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.192590128 (311h31m51.923857758s) [noise=true , address=104.36.82.6:4907 , piece_id=ZVU2TK7PXTZBHLLU657Q5U5BS33QIIGR5WBBUE23LMRWNYSGIJEQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.292199435 (311h31m52.023467055s) [upload=323881]: Next returned nil segment
Aug 21 16:58:11.292208382 (311h31m52.023476002s) [upload=323881]: Waiting for error group managing segments...
Aug 21 16:58:11.305981536 (311h31m52.037249156s) [noise=true , address=104.36.82.11:4118 , piece_id=MFWA4J22CPFE4HEYFXZISYJDAKWCF3HEYHVCYKSFQY5N27QT2O6A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.317455457 (311h31m52.048723076s) [noise=true , address=77.90.31.11:4582 , piece_id=7I4O5F46N3EAAFKUSTBOA3DY5NF7PQHNILWM5GFZ5CEIGRZANDRQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.319650365 (311h31m52.050917985s) [noise=true , address=77.90.31.18:4812 , piece_id=GRFZT75OBWQBGFZ3I3QYOGWHIFXJCZHKOGQOG34ZW6QG7BNBNGBQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.320890678 (311h31m52.052158297s) [noise=true , address=104.36.82.49:4012 , piece_id=CQSJDRQSYII2TZ4IXSILK3IN4WMGVOJEHPQJBPWPYII5HQ7G2B3A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.325965804 (311h31m52.057233424s) [noise=true , address=77.90.31.15:4719 , piece_id=SQOIUIMMOLGQHURPXKR4E3SYUKDJDJNZ75Q4RXA3W2E4JOG5WXLQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.327860037 (311h31m52.059127667s) [noise=true , address=45.91.116.11:4142 , piece_id=FTHDX3KRMQV2VPJA42JPTD5LDPAQCC6C2D6ODRZ7M4ZASZDJCSYA, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.328132208 (311h31m52.059399828s) [noise=true , address=45.91.116.5:4312 , piece_id=QCY54KDIJ3SFLIE2X6KBQD2UIEWMGYBOL33JKFLWGXZGRTB42YQQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.330010401 (311h31m52.061278021s) [noise=true , address=77.90.31.10:4548 , piece_id=3IWDAKTWMTSIYUHS4YSHUGNPZXYIOTCE523RYZCYL2FEW226R45A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.335413914 (311h31m52.066681533s) [noise=true , address=77.90.31.13:4651 , piece_id=KVYWHATVMKX3WZB7UWCIPQ5TIXHLAO7TWECK4XRQDILQ4HOUSB3Q, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.341151935 (311h31m52.072419546s) [noise=true , address=104.36.82.9:4022 , piece_id=XHQFV3SHMAT7WOOWG6U5QRRO3VBLZUE2SV7N5N4IDWWB6MPAT7JA, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.348847890 (311h31m52.08011552s) [noise=true , address=104.36.82.6:4907 , piece_id=ZVU2TK7PXTZBHLLU657Q5U5BS33QIIGR5WBBUE23LMRWNYSGIJEQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.360184613 (311h31m52.091452233s) [noise=true , address=104.36.82.13:4209 , piece_id=AJ5OPQIYSANI4EFJQYTCSC4OYA2KV4PR23YNLROCLL62ZNT2CINQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.366983571 (311h31m52.098251201s) [noise=true , address=77.90.31.19:4851 , piece_id=YZ7SGALUQPTAHO5ZARMCVMADX5AGH6BQNCN5UTC74JPLPEWALEDQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.392521653 (311h31m52.123789274s) [noise=true , address=104.36.82.45:4917 , piece_id=HHWHHUVVM76NSJNSFRSV5L2TJM7WABLPY3UMVM7CEZM44NKMXRHQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.392540769 (311h31m52.123808399s) [seg_pos={0 0}, upload=323881]: Segment reached optimal threshold of 14 pieces.
Aug 21 16:58:11.392827879 (311h31m52.124095509s) [noise=true , address=104.36.82.14:4236 , piece_id=EOTHS7XHUD5YNTOQOVTFR6EIRGREL4VBL2KLS5LJVQJKTMRWWUVQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XaE29W27ym2RmuGdBvHeKcQZZEUbask1zsm9Bz8xLokZNGfcj): protocol: expected piece hash; context canceled; EOF
Aug 21 16:58:11.393068121 (311h31m52.124335742s) [noise=true , address=45.91.116.11:4141 , piece_id=6OUW5WSYNG5GABS6BH3NNP3WRPYAK3SOVJDSXLMPICFMSNWD3O3Q, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h1gxgVjoHUkjKXA5xhTowGKi9q6wZGyzg8eqKgMHqsxF1ut5P): protocol: write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection; write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection
Aug 21 16:58:11.393129707 (311h31m52.124397326s) [noise=true , address=79.127.205.234:4616 , piece_id=D3SSTIPP6BS4NL5IS3JTR6JTHG32VWVD6HIU27WB2HXRTI7SL4TQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuFfyFT8z7TwZZsBhMRPx8HtLBqELmEzxbbsuG9Ljg9KKz3rm): protocol: read tcp 5.161.89.252:61860->79.127.205.234:4616: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 16:58:11.393280721 (311h31m52.124548371s) [noise=true , address=104.36.82.7:4920 , piece_id=7LGSALS6MO7SEPNO5KGHKACZ6CSAMJMV2GYHYY6BBVGFOXHRLPSQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.393342206 (311h31m52.124609846s) [seg_pos={0 0}, upload=323881]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 21 16:58:11.393461841 (311h31m52.124729492s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 16:58:11.393467823 (311h31m52.124735463s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 16:58:11.446017719 (311h31m52.177285349s) [upload=323881]: Done uploading segments...
Aug 21 16:58:11.446031615 (311h31m52.177299245s) [upload=323881]: Upload finished. err: <nil>
Duration: 1.868029224s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................................X................X...] duration:
1.326394956s
FAIL (2025-08-21 17:00:17 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 21 16:58:11.097765980 (311h31m51.82903362s) [upload=323881]: Starting upload
Aug 21 16:58:11.097816425 (311h31m51.829084066s) [upload=323881]: Done starting upload
Aug 21 16:58:11.097974212 (311h31m51.829241862s) [upload=323881]: Uploading segments...
Aug 21 16:58:11.098124976 (311h31m51.829392606s) [upload=323881]: Got next segment. Inline: false
Aug 21 16:58:11.098190559 (311h31m51.829458199s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 16:58:11.098198244 (311h31m51.829465904s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 16:58:11.186959668 (311h31m51.918227288s) [seg_pos={0 0}, upload=323881]: Begin upload segment...
Aug 21 16:58:11.187010914 (311h31m51.918278574s) [seg_pos={0 0}, upload=323881]: Done begin upload segment.
Aug 21 16:58:11.187041721 (311h31m51.918309351s) [noise=true , address=45.91.116.5:4312 , piece_id=QCY54KDIJ3SFLIE2X6KBQD2UIEWMGYBOL33JKFLWGXZGRTB42YQQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187059065 (311h31m51.918326695s) [noise=true , address=104.36.82.49:4012 , piece_id=CQSJDRQSYII2TZ4IXSILK3IN4WMGVOJEHPQJBPWPYII5HQ7G2B3A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187096966 (311h31m51.918364587s) [noise=true , address=104.36.82.7:4920 , piece_id=7LGSALS6MO7SEPNO5KGHKACZ6CSAMJMV2GYHYY6BBVGFOXHRLPSQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187499954 (311h31m51.918767574s) [noise=true , address=77.90.31.19:4851 , piece_id=YZ7SGALUQPTAHO5ZARMCVMADX5AGH6BQNCN5UTC74JPLPEWALEDQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187516114 (311h31m51.918783745s) [noise=true , address=104.36.82.9:4022 , piece_id=XHQFV3SHMAT7WOOWG6U5QRRO3VBLZUE2SV7N5N4IDWWB6MPAT7JA, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187870982 (311h31m51.919138612s) [noise=true , address=77.90.31.10:4548 , piece_id=3IWDAKTWMTSIYUHS4YSHUGNPZXYIOTCE523RYZCYL2FEW226R45A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187878215 (311h31m51.919145845s) [noise=true , address=77.90.31.13:4651 , piece_id=KVYWHATVMKX3WZB7UWCIPQ5TIXHLAO7TWECK4XRQDILQ4HOUSB3Q, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188266736 (311h31m51.919534356s) [noise=true , address=104.36.82.13:4209 , piece_id=AJ5OPQIYSANI4EFJQYTCSC4OYA2KV4PR23YNLROCLL62ZNT2CINQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188291242 (311h31m51.919558873s) [noise=true , address=77.90.31.15:4719 , piece_id=SQOIUIMMOLGQHURPXKR4E3SYUKDJDJNZ75Q4RXA3W2E4JOG5WXLQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188643465 (311h31m51.919911095s) [noise=true , address=104.36.82.14:4236 , piece_id=EOTHS7XHUD5YNTOQOVTFR6EIRGREL4VBL2KLS5LJVQJKTMRWWUVQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188658473 (311h31m51.919926103s) [noise=true , address=104.36.82.11:4118 , piece_id=MFWA4J22CPFE4HEYFXZISYJDAKWCF3HEYHVCYKSFQY5N27QT2O6A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188993774 (311h31m51.920261394s) [noise=true , address=77.90.31.18:4812 , piece_id=GRFZT75OBWQBGFZ3I3QYOGWHIFXJCZHKOGQOG34ZW6QG7BNBNGBQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189017548 (311h31m51.920285178s) [noise=true , address=77.90.31.11:4582 , piece_id=7I4O5F46N3EAAFKUSTBOA3DY5NF7PQHNILWM5GFZ5CEIGRZANDRQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189365152 (311h31m51.920632782s) [noise=true , address=79.127.205.234:4616 , piece_id=D3SSTIPP6BS4NL5IS3JTR6JTHG32VWVD6HIU27WB2HXRTI7SL4TQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189952657 (311h31m51.921220287s) [noise=true , address=104.36.82.45:4917 , piece_id=HHWHHUVVM76NSJNSFRSV5L2TJM7WABLPY3UMVM7CEZM44NKMXRHQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.190704210 (311h31m51.92197184s) [noise=true , address=45.91.116.11:4142 , piece_id=FTHDX3KRMQV2VPJA42JPTD5LDPAQCC6C2D6ODRZ7M4ZASZDJCSYA, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.191563527 (311h31m51.922831157s) [noise=true , address=45.91.116.11:4141 , piece_id=6OUW5WSYNG5GABS6BH3NNP3WRPYAK3SOVJDSXLMPICFMSNWD3O3Q, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.192590128 (311h31m51.923857758s) [noise=true , address=104.36.82.6:4907 , piece_id=ZVU2TK7PXTZBHLLU657Q5U5BS33QIIGR5WBBUE23LMRWNYSGIJEQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.292199435 (311h31m52.023467055s) [upload=323881]: Next returned nil segment
Aug 21 16:58:11.292208382 (311h31m52.023476002s) [upload=323881]: Waiting for error group managing segments...
Aug 21 16:58:11.305981536 (311h31m52.037249156s) [noise=true , address=104.36.82.11:4118 , piece_id=MFWA4J22CPFE4HEYFXZISYJDAKWCF3HEYHVCYKSFQY5N27QT2O6A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.317455457 (311h31m52.048723076s) [noise=true , address=77.90.31.11:4582 , piece_id=7I4O5F46N3EAAFKUSTBOA3DY5NF7PQHNILWM5GFZ5CEIGRZANDRQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.319650365 (311h31m52.050917985s) [noise=true , address=77.90.31.18:4812 , piece_id=GRFZT75OBWQBGFZ3I3QYOGWHIFXJCZHKOGQOG34ZW6QG7BNBNGBQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.320890678 (311h31m52.052158297s) [noise=true , address=104.36.82.49:4012 , piece_id=CQSJDRQSYII2TZ4IXSILK3IN4WMGVOJEHPQJBPWPYII5HQ7G2B3A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.325965804 (311h31m52.057233424s) [noise=true , address=77.90.31.15:4719 , piece_id=SQOIUIMMOLGQHURPXKR4E3SYUKDJDJNZ75Q4RXA3W2E4JOG5WXLQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.327860037 (311h31m52.059127667s) [noise=true , address=45.91.116.11:4142 , piece_id=FTHDX3KRMQV2VPJA42JPTD5LDPAQCC6C2D6ODRZ7M4ZASZDJCSYA, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.328132208 (311h31m52.059399828s) [noise=true , address=45.91.116.5:4312 , piece_id=QCY54KDIJ3SFLIE2X6KBQD2UIEWMGYBOL33JKFLWGXZGRTB42YQQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.330010401 (311h31m52.061278021s) [noise=true , address=77.90.31.10:4548 , piece_id=3IWDAKTWMTSIYUHS4YSHUGNPZXYIOTCE523RYZCYL2FEW226R45A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.335413914 (311h31m52.066681533s) [noise=true , address=77.90.31.13:4651 , piece_id=KVYWHATVMKX3WZB7UWCIPQ5TIXHLAO7TWECK4XRQDILQ4HOUSB3Q, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.341151935 (311h31m52.072419546s) [noise=true , address=104.36.82.9:4022 , piece_id=XHQFV3SHMAT7WOOWG6U5QRRO3VBLZUE2SV7N5N4IDWWB6MPAT7JA, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.348847890 (311h31m52.08011552s) [noise=true , address=104.36.82.6:4907 , piece_id=ZVU2TK7PXTZBHLLU657Q5U5BS33QIIGR5WBBUE23LMRWNYSGIJEQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.360184613 (311h31m52.091452233s) [noise=true , address=104.36.82.13:4209 , piece_id=AJ5OPQIYSANI4EFJQYTCSC4OYA2KV4PR23YNLROCLL62ZNT2CINQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.366983571 (311h31m52.098251201s) [noise=true , address=77.90.31.19:4851 , piece_id=YZ7SGALUQPTAHO5ZARMCVMADX5AGH6BQNCN5UTC74JPLPEWALEDQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.392521653 (311h31m52.123789274s) [noise=true , address=104.36.82.45:4917 , piece_id=HHWHHUVVM76NSJNSFRSV5L2TJM7WABLPY3UMVM7CEZM44NKMXRHQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.392540769 (311h31m52.123808399s) [seg_pos={0 0}, upload=323881]: Segment reached optimal threshold of 14 pieces.
Aug 21 16:58:11.392827879 (311h31m52.124095509s) [noise=true , address=104.36.82.14:4236 , piece_id=EOTHS7XHUD5YNTOQOVTFR6EIRGREL4VBL2KLS5LJVQJKTMRWWUVQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XaE29W27ym2RmuGdBvHeKcQZZEUbask1zsm9Bz8xLokZNGfcj): protocol: expected piece hash; context canceled; EOF
Aug 21 16:58:11.393068121 (311h31m52.124335742s) [noise=true , address=45.91.116.11:4141 , piece_id=6OUW5WSYNG5GABS6BH3NNP3WRPYAK3SOVJDSXLMPICFMSNWD3O3Q, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h1gxgVjoHUkjKXA5xhTowGKi9q6wZGyzg8eqKgMHqsxF1ut5P): protocol: write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection; write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection
Aug 21 16:58:11.393129707 (311h31m52.124397326s) [noise=true , address=79.127.205.234:4616 , piece_id=D3SSTIPP6BS4NL5IS3JTR6JTHG32VWVD6HIU27WB2HXRTI7SL4TQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuFfyFT8z7TwZZsBhMRPx8HtLBqELmEzxbbsuG9Ljg9KKz3rm): protocol: read tcp 5.161.89.252:61860->79.127.205.234:4616: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 16:58:11.393280721 (311h31m52.124548371s) [noise=true , address=104.36.82.7:4920 , piece_id=7LGSALS6MO7SEPNO5KGHKACZ6CSAMJMV2GYHYY6BBVGFOXHRLPSQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.393342206 (311h31m52.124609846s) [seg_pos={0 0}, upload=323881]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 21 16:58:11.393461841 (311h31m52.124729492s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 16:58:11.393467823 (311h31m52.124735463s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 16:58:11.446017719 (311h31m52.177285349s) [upload=323881]: Done uploading segments...
Aug 21 16:58:11.446031615 (311h31m52.177299245s) [upload=323881]: Upload finished. err: <nil>
Duration: 1.326409573s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................................X................X..] duration:
449.566923ms
FAIL (2025-08-21 16:59:45 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 21 16:58:11.097765980 (311h31m51.82903362s) [upload=323881]: Starting upload
Aug 21 16:58:11.097816425 (311h31m51.829084066s) [upload=323881]: Done starting upload
Aug 21 16:58:11.097974212 (311h31m51.829241862s) [upload=323881]: Uploading segments...
Aug 21 16:58:11.098124976 (311h31m51.829392606s) [upload=323881]: Got next segment. Inline: false
Aug 21 16:58:11.098190559 (311h31m51.829458199s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 16:58:11.098198244 (311h31m51.829465904s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 16:58:11.186959668 (311h31m51.918227288s) [seg_pos={0 0}, upload=323881]: Begin upload segment...
Aug 21 16:58:11.187010914 (311h31m51.918278574s) [seg_pos={0 0}, upload=323881]: Done begin upload segment.
Aug 21 16:58:11.187041721 (311h31m51.918309351s) [noise=true , address=45.91.116.5:4312 , piece_id=QCY54KDIJ3SFLIE2X6KBQD2UIEWMGYBOL33JKFLWGXZGRTB42YQQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187059065 (311h31m51.918326695s) [noise=true , address=104.36.82.49:4012 , piece_id=CQSJDRQSYII2TZ4IXSILK3IN4WMGVOJEHPQJBPWPYII5HQ7G2B3A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187096966 (311h31m51.918364587s) [noise=true , address=104.36.82.7:4920 , piece_id=7LGSALS6MO7SEPNO5KGHKACZ6CSAMJMV2GYHYY6BBVGFOXHRLPSQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187499954 (311h31m51.918767574s) [noise=true , address=77.90.31.19:4851 , piece_id=YZ7SGALUQPTAHO5ZARMCVMADX5AGH6BQNCN5UTC74JPLPEWALEDQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187516114 (311h31m51.918783745s) [noise=true , address=104.36.82.9:4022 , piece_id=XHQFV3SHMAT7WOOWG6U5QRRO3VBLZUE2SV7N5N4IDWWB6MPAT7JA, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187870982 (311h31m51.919138612s) [noise=true , address=77.90.31.10:4548 , piece_id=3IWDAKTWMTSIYUHS4YSHUGNPZXYIOTCE523RYZCYL2FEW226R45A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187878215 (311h31m51.919145845s) [noise=true , address=77.90.31.13:4651 , piece_id=KVYWHATVMKX3WZB7UWCIPQ5TIXHLAO7TWECK4XRQDILQ4HOUSB3Q, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188266736 (311h31m51.919534356s) [noise=true , address=104.36.82.13:4209 , piece_id=AJ5OPQIYSANI4EFJQYTCSC4OYA2KV4PR23YNLROCLL62ZNT2CINQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188291242 (311h31m51.919558873s) [noise=true , address=77.90.31.15:4719 , piece_id=SQOIUIMMOLGQHURPXKR4E3SYUKDJDJNZ75Q4RXA3W2E4JOG5WXLQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188643465 (311h31m51.919911095s) [noise=true , address=104.36.82.14:4236 , piece_id=EOTHS7XHUD5YNTOQOVTFR6EIRGREL4VBL2KLS5LJVQJKTMRWWUVQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188658473 (311h31m51.919926103s) [noise=true , address=104.36.82.11:4118 , piece_id=MFWA4J22CPFE4HEYFXZISYJDAKWCF3HEYHVCYKSFQY5N27QT2O6A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188993774 (311h31m51.920261394s) [noise=true , address=77.90.31.18:4812 , piece_id=GRFZT75OBWQBGFZ3I3QYOGWHIFXJCZHKOGQOG34ZW6QG7BNBNGBQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189017548 (311h31m51.920285178s) [noise=true , address=77.90.31.11:4582 , piece_id=7I4O5F46N3EAAFKUSTBOA3DY5NF7PQHNILWM5GFZ5CEIGRZANDRQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189365152 (311h31m51.920632782s) [noise=true , address=79.127.205.234:4616 , piece_id=D3SSTIPP6BS4NL5IS3JTR6JTHG32VWVD6HIU27WB2HXRTI7SL4TQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189952657 (311h31m51.921220287s) [noise=true , address=104.36.82.45:4917 , piece_id=HHWHHUVVM76NSJNSFRSV5L2TJM7WABLPY3UMVM7CEZM44NKMXRHQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.190704210 (311h31m51.92197184s) [noise=true , address=45.91.116.11:4142 , piece_id=FTHDX3KRMQV2VPJA42JPTD5LDPAQCC6C2D6ODRZ7M4ZASZDJCSYA, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.191563527 (311h31m51.922831157s) [noise=true , address=45.91.116.11:4141 , piece_id=6OUW5WSYNG5GABS6BH3NNP3WRPYAK3SOVJDSXLMPICFMSNWD3O3Q, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.192590128 (311h31m51.923857758s) [noise=true , address=104.36.82.6:4907 , piece_id=ZVU2TK7PXTZBHLLU657Q5U5BS33QIIGR5WBBUE23LMRWNYSGIJEQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.292199435 (311h31m52.023467055s) [upload=323881]: Next returned nil segment
Aug 21 16:58:11.292208382 (311h31m52.023476002s) [upload=323881]: Waiting for error group managing segments...
Aug 21 16:58:11.305981536 (311h31m52.037249156s) [noise=true , address=104.36.82.11:4118 , piece_id=MFWA4J22CPFE4HEYFXZISYJDAKWCF3HEYHVCYKSFQY5N27QT2O6A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.317455457 (311h31m52.048723076s) [noise=true , address=77.90.31.11:4582 , piece_id=7I4O5F46N3EAAFKUSTBOA3DY5NF7PQHNILWM5GFZ5CEIGRZANDRQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.319650365 (311h31m52.050917985s) [noise=true , address=77.90.31.18:4812 , piece_id=GRFZT75OBWQBGFZ3I3QYOGWHIFXJCZHKOGQOG34ZW6QG7BNBNGBQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.320890678 (311h31m52.052158297s) [noise=true , address=104.36.82.49:4012 , piece_id=CQSJDRQSYII2TZ4IXSILK3IN4WMGVOJEHPQJBPWPYII5HQ7G2B3A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.325965804 (311h31m52.057233424s) [noise=true , address=77.90.31.15:4719 , piece_id=SQOIUIMMOLGQHURPXKR4E3SYUKDJDJNZ75Q4RXA3W2E4JOG5WXLQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.327860037 (311h31m52.059127667s) [noise=true , address=45.91.116.11:4142 , piece_id=FTHDX3KRMQV2VPJA42JPTD5LDPAQCC6C2D6ODRZ7M4ZASZDJCSYA, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.328132208 (311h31m52.059399828s) [noise=true , address=45.91.116.5:4312 , piece_id=QCY54KDIJ3SFLIE2X6KBQD2UIEWMGYBOL33JKFLWGXZGRTB42YQQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.330010401 (311h31m52.061278021s) [noise=true , address=77.90.31.10:4548 , piece_id=3IWDAKTWMTSIYUHS4YSHUGNPZXYIOTCE523RYZCYL2FEW226R45A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.335413914 (311h31m52.066681533s) [noise=true , address=77.90.31.13:4651 , piece_id=KVYWHATVMKX3WZB7UWCIPQ5TIXHLAO7TWECK4XRQDILQ4HOUSB3Q, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.341151935 (311h31m52.072419546s) [noise=true , address=104.36.82.9:4022 , piece_id=XHQFV3SHMAT7WOOWG6U5QRRO3VBLZUE2SV7N5N4IDWWB6MPAT7JA, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.348847890 (311h31m52.08011552s) [noise=true , address=104.36.82.6:4907 , piece_id=ZVU2TK7PXTZBHLLU657Q5U5BS33QIIGR5WBBUE23LMRWNYSGIJEQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.360184613 (311h31m52.091452233s) [noise=true , address=104.36.82.13:4209 , piece_id=AJ5OPQIYSANI4EFJQYTCSC4OYA2KV4PR23YNLROCLL62ZNT2CINQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.366983571 (311h31m52.098251201s) [noise=true , address=77.90.31.19:4851 , piece_id=YZ7SGALUQPTAHO5ZARMCVMADX5AGH6BQNCN5UTC74JPLPEWALEDQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.392521653 (311h31m52.123789274s) [noise=true , address=104.36.82.45:4917 , piece_id=HHWHHUVVM76NSJNSFRSV5L2TJM7WABLPY3UMVM7CEZM44NKMXRHQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.392540769 (311h31m52.123808399s) [seg_pos={0 0}, upload=323881]: Segment reached optimal threshold of 14 pieces.
Aug 21 16:58:11.392827879 (311h31m52.124095509s) [noise=true , address=104.36.82.14:4236 , piece_id=EOTHS7XHUD5YNTOQOVTFR6EIRGREL4VBL2KLS5LJVQJKTMRWWUVQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XaE29W27ym2RmuGdBvHeKcQZZEUbask1zsm9Bz8xLokZNGfcj): protocol: expected piece hash; context canceled; EOF
Aug 21 16:58:11.393068121 (311h31m52.124335742s) [noise=true , address=45.91.116.11:4141 , piece_id=6OUW5WSYNG5GABS6BH3NNP3WRPYAK3SOVJDSXLMPICFMSNWD3O3Q, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h1gxgVjoHUkjKXA5xhTowGKi9q6wZGyzg8eqKgMHqsxF1ut5P): protocol: write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection; write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection
Aug 21 16:58:11.393129707 (311h31m52.124397326s) [noise=true , address=79.127.205.234:4616 , piece_id=D3SSTIPP6BS4NL5IS3JTR6JTHG32VWVD6HIU27WB2HXRTI7SL4TQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuFfyFT8z7TwZZsBhMRPx8HtLBqELmEzxbbsuG9Ljg9KKz3rm): protocol: read tcp 5.161.89.252:61860->79.127.205.234:4616: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 16:58:11.393280721 (311h31m52.124548371s) [noise=true , address=104.36.82.7:4920 , piece_id=7LGSALS6MO7SEPNO5KGHKACZ6CSAMJMV2GYHYY6BBVGFOXHRLPSQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.393342206 (311h31m52.124609846s) [seg_pos={0 0}, upload=323881]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 21 16:58:11.393461841 (311h31m52.124729492s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 16:58:11.393467823 (311h31m52.124735463s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 16:58:11.446017719 (311h31m52.177285349s) [upload=323881]: Done uploading segments...
Aug 21 16:58:11.446031615 (311h31m52.177299245s) [upload=323881]: Upload finished. err: <nil>
Duration: 449.590668ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................................X................X.] duration:
1.138201088s
FAIL (2025-08-21 16:59:20 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 21 16:58:11.097765980 (311h31m51.82903362s) [upload=323881]: Starting upload
Aug 21 16:58:11.097816425 (311h31m51.829084066s) [upload=323881]: Done starting upload
Aug 21 16:58:11.097974212 (311h31m51.829241862s) [upload=323881]: Uploading segments...
Aug 21 16:58:11.098124976 (311h31m51.829392606s) [upload=323881]: Got next segment. Inline: false
Aug 21 16:58:11.098190559 (311h31m51.829458199s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 16:58:11.098198244 (311h31m51.829465904s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 16:58:11.186959668 (311h31m51.918227288s) [seg_pos={0 0}, upload=323881]: Begin upload segment...
Aug 21 16:58:11.187010914 (311h31m51.918278574s) [seg_pos={0 0}, upload=323881]: Done begin upload segment.
Aug 21 16:58:11.187041721 (311h31m51.918309351s) [noise=true , address=45.91.116.5:4312 , piece_id=QCY54KDIJ3SFLIE2X6KBQD2UIEWMGYBOL33JKFLWGXZGRTB42YQQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187059065 (311h31m51.918326695s) [noise=true , address=104.36.82.49:4012 , piece_id=CQSJDRQSYII2TZ4IXSILK3IN4WMGVOJEHPQJBPWPYII5HQ7G2B3A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187096966 (311h31m51.918364587s) [noise=true , address=104.36.82.7:4920 , piece_id=7LGSALS6MO7SEPNO5KGHKACZ6CSAMJMV2GYHYY6BBVGFOXHRLPSQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187499954 (311h31m51.918767574s) [noise=true , address=77.90.31.19:4851 , piece_id=YZ7SGALUQPTAHO5ZARMCVMADX5AGH6BQNCN5UTC74JPLPEWALEDQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187516114 (311h31m51.918783745s) [noise=true , address=104.36.82.9:4022 , piece_id=XHQFV3SHMAT7WOOWG6U5QRRO3VBLZUE2SV7N5N4IDWWB6MPAT7JA, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187870982 (311h31m51.919138612s) [noise=true , address=77.90.31.10:4548 , piece_id=3IWDAKTWMTSIYUHS4YSHUGNPZXYIOTCE523RYZCYL2FEW226R45A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187878215 (311h31m51.919145845s) [noise=true , address=77.90.31.13:4651 , piece_id=KVYWHATVMKX3WZB7UWCIPQ5TIXHLAO7TWECK4XRQDILQ4HOUSB3Q, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188266736 (311h31m51.919534356s) [noise=true , address=104.36.82.13:4209 , piece_id=AJ5OPQIYSANI4EFJQYTCSC4OYA2KV4PR23YNLROCLL62ZNT2CINQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188291242 (311h31m51.919558873s) [noise=true , address=77.90.31.15:4719 , piece_id=SQOIUIMMOLGQHURPXKR4E3SYUKDJDJNZ75Q4RXA3W2E4JOG5WXLQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188643465 (311h31m51.919911095s) [noise=true , address=104.36.82.14:4236 , piece_id=EOTHS7XHUD5YNTOQOVTFR6EIRGREL4VBL2KLS5LJVQJKTMRWWUVQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188658473 (311h31m51.919926103s) [noise=true , address=104.36.82.11:4118 , piece_id=MFWA4J22CPFE4HEYFXZISYJDAKWCF3HEYHVCYKSFQY5N27QT2O6A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188993774 (311h31m51.920261394s) [noise=true , address=77.90.31.18:4812 , piece_id=GRFZT75OBWQBGFZ3I3QYOGWHIFXJCZHKOGQOG34ZW6QG7BNBNGBQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189017548 (311h31m51.920285178s) [noise=true , address=77.90.31.11:4582 , piece_id=7I4O5F46N3EAAFKUSTBOA3DY5NF7PQHNILWM5GFZ5CEIGRZANDRQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189365152 (311h31m51.920632782s) [noise=true , address=79.127.205.234:4616 , piece_id=D3SSTIPP6BS4NL5IS3JTR6JTHG32VWVD6HIU27WB2HXRTI7SL4TQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189952657 (311h31m51.921220287s) [noise=true , address=104.36.82.45:4917 , piece_id=HHWHHUVVM76NSJNSFRSV5L2TJM7WABLPY3UMVM7CEZM44NKMXRHQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.190704210 (311h31m51.92197184s) [noise=true , address=45.91.116.11:4142 , piece_id=FTHDX3KRMQV2VPJA42JPTD5LDPAQCC6C2D6ODRZ7M4ZASZDJCSYA, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.191563527 (311h31m51.922831157s) [noise=true , address=45.91.116.11:4141 , piece_id=6OUW5WSYNG5GABS6BH3NNP3WRPYAK3SOVJDSXLMPICFMSNWD3O3Q, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.192590128 (311h31m51.923857758s) [noise=true , address=104.36.82.6:4907 , piece_id=ZVU2TK7PXTZBHLLU657Q5U5BS33QIIGR5WBBUE23LMRWNYSGIJEQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.292199435 (311h31m52.023467055s) [upload=323881]: Next returned nil segment
Aug 21 16:58:11.292208382 (311h31m52.023476002s) [upload=323881]: Waiting for error group managing segments...
Aug 21 16:58:11.305981536 (311h31m52.037249156s) [noise=true , address=104.36.82.11:4118 , piece_id=MFWA4J22CPFE4HEYFXZISYJDAKWCF3HEYHVCYKSFQY5N27QT2O6A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.317455457 (311h31m52.048723076s) [noise=true , address=77.90.31.11:4582 , piece_id=7I4O5F46N3EAAFKUSTBOA3DY5NF7PQHNILWM5GFZ5CEIGRZANDRQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.319650365 (311h31m52.050917985s) [noise=true , address=77.90.31.18:4812 , piece_id=GRFZT75OBWQBGFZ3I3QYOGWHIFXJCZHKOGQOG34ZW6QG7BNBNGBQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.320890678 (311h31m52.052158297s) [noise=true , address=104.36.82.49:4012 , piece_id=CQSJDRQSYII2TZ4IXSILK3IN4WMGVOJEHPQJBPWPYII5HQ7G2B3A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.325965804 (311h31m52.057233424s) [noise=true , address=77.90.31.15:4719 , piece_id=SQOIUIMMOLGQHURPXKR4E3SYUKDJDJNZ75Q4RXA3W2E4JOG5WXLQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.327860037 (311h31m52.059127667s) [noise=true , address=45.91.116.11:4142 , piece_id=FTHDX3KRMQV2VPJA42JPTD5LDPAQCC6C2D6ODRZ7M4ZASZDJCSYA, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.328132208 (311h31m52.059399828s) [noise=true , address=45.91.116.5:4312 , piece_id=QCY54KDIJ3SFLIE2X6KBQD2UIEWMGYBOL33JKFLWGXZGRTB42YQQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.330010401 (311h31m52.061278021s) [noise=true , address=77.90.31.10:4548 , piece_id=3IWDAKTWMTSIYUHS4YSHUGNPZXYIOTCE523RYZCYL2FEW226R45A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.335413914 (311h31m52.066681533s) [noise=true , address=77.90.31.13:4651 , piece_id=KVYWHATVMKX3WZB7UWCIPQ5TIXHLAO7TWECK4XRQDILQ4HOUSB3Q, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.341151935 (311h31m52.072419546s) [noise=true , address=104.36.82.9:4022 , piece_id=XHQFV3SHMAT7WOOWG6U5QRRO3VBLZUE2SV7N5N4IDWWB6MPAT7JA, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.348847890 (311h31m52.08011552s) [noise=true , address=104.36.82.6:4907 , piece_id=ZVU2TK7PXTZBHLLU657Q5U5BS33QIIGR5WBBUE23LMRWNYSGIJEQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.360184613 (311h31m52.091452233s) [noise=true , address=104.36.82.13:4209 , piece_id=AJ5OPQIYSANI4EFJQYTCSC4OYA2KV4PR23YNLROCLL62ZNT2CINQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.366983571 (311h31m52.098251201s) [noise=true , address=77.90.31.19:4851 , piece_id=YZ7SGALUQPTAHO5ZARMCVMADX5AGH6BQNCN5UTC74JPLPEWALEDQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.392521653 (311h31m52.123789274s) [noise=true , address=104.36.82.45:4917 , piece_id=HHWHHUVVM76NSJNSFRSV5L2TJM7WABLPY3UMVM7CEZM44NKMXRHQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.392540769 (311h31m52.123808399s) [seg_pos={0 0}, upload=323881]: Segment reached optimal threshold of 14 pieces.
Aug 21 16:58:11.392827879 (311h31m52.124095509s) [noise=true , address=104.36.82.14:4236 , piece_id=EOTHS7XHUD5YNTOQOVTFR6EIRGREL4VBL2KLS5LJVQJKTMRWWUVQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XaE29W27ym2RmuGdBvHeKcQZZEUbask1zsm9Bz8xLokZNGfcj): protocol: expected piece hash; context canceled; EOF
Aug 21 16:58:11.393068121 (311h31m52.124335742s) [noise=true , address=45.91.116.11:4141 , piece_id=6OUW5WSYNG5GABS6BH3NNP3WRPYAK3SOVJDSXLMPICFMSNWD3O3Q, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h1gxgVjoHUkjKXA5xhTowGKi9q6wZGyzg8eqKgMHqsxF1ut5P): protocol: write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection; write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection
Aug 21 16:58:11.393129707 (311h31m52.124397326s) [noise=true , address=79.127.205.234:4616 , piece_id=D3SSTIPP6BS4NL5IS3JTR6JTHG32VWVD6HIU27WB2HXRTI7SL4TQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuFfyFT8z7TwZZsBhMRPx8HtLBqELmEzxbbsuG9Ljg9KKz3rm): protocol: read tcp 5.161.89.252:61860->79.127.205.234:4616: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 16:58:11.393280721 (311h31m52.124548371s) [noise=true , address=104.36.82.7:4920 , piece_id=7LGSALS6MO7SEPNO5KGHKACZ6CSAMJMV2GYHYY6BBVGFOXHRLPSQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.393342206 (311h31m52.124609846s) [seg_pos={0 0}, upload=323881]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 21 16:58:11.393461841 (311h31m52.124729492s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 16:58:11.393467823 (311h31m52.124735463s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 16:58:11.446017719 (311h31m52.177285349s) [upload=323881]: Done uploading segments...
Aug 21 16:58:11.446031615 (311h31m52.177299245s) [upload=323881]: Upload finished. err: <nil>
Duration: 1.13822251s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................................X................X] duration:
447.519091ms
FAIL (2025-08-21 16:58:11 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 21 16:58:11.097765980 (311h31m51.82903362s) [upload=323881]: Starting upload
Aug 21 16:58:11.097816425 (311h31m51.829084066s) [upload=323881]: Done starting upload
Aug 21 16:58:11.097974212 (311h31m51.829241862s) [upload=323881]: Uploading segments...
Aug 21 16:58:11.098124976 (311h31m51.829392606s) [upload=323881]: Got next segment. Inline: false
Aug 21 16:58:11.098190559 (311h31m51.829458199s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 16:58:11.098198244 (311h31m51.829465904s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 16:58:11.186959668 (311h31m51.918227288s) [seg_pos={0 0}, upload=323881]: Begin upload segment...
Aug 21 16:58:11.187010914 (311h31m51.918278574s) [seg_pos={0 0}, upload=323881]: Done begin upload segment.
Aug 21 16:58:11.187041721 (311h31m51.918309351s) [noise=true , address=45.91.116.5:4312 , piece_id=QCY54KDIJ3SFLIE2X6KBQD2UIEWMGYBOL33JKFLWGXZGRTB42YQQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187059065 (311h31m51.918326695s) [noise=true , address=104.36.82.49:4012 , piece_id=CQSJDRQSYII2TZ4IXSILK3IN4WMGVOJEHPQJBPWPYII5HQ7G2B3A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187096966 (311h31m51.918364587s) [noise=true , address=104.36.82.7:4920 , piece_id=7LGSALS6MO7SEPNO5KGHKACZ6CSAMJMV2GYHYY6BBVGFOXHRLPSQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187499954 (311h31m51.918767574s) [noise=true , address=77.90.31.19:4851 , piece_id=YZ7SGALUQPTAHO5ZARMCVMADX5AGH6BQNCN5UTC74JPLPEWALEDQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187516114 (311h31m51.918783745s) [noise=true , address=104.36.82.9:4022 , piece_id=XHQFV3SHMAT7WOOWG6U5QRRO3VBLZUE2SV7N5N4IDWWB6MPAT7JA, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187870982 (311h31m51.919138612s) [noise=true , address=77.90.31.10:4548 , piece_id=3IWDAKTWMTSIYUHS4YSHUGNPZXYIOTCE523RYZCYL2FEW226R45A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.187878215 (311h31m51.919145845s) [noise=true , address=77.90.31.13:4651 , piece_id=KVYWHATVMKX3WZB7UWCIPQ5TIXHLAO7TWECK4XRQDILQ4HOUSB3Q, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188266736 (311h31m51.919534356s) [noise=true , address=104.36.82.13:4209 , piece_id=AJ5OPQIYSANI4EFJQYTCSC4OYA2KV4PR23YNLROCLL62ZNT2CINQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188291242 (311h31m51.919558873s) [noise=true , address=77.90.31.15:4719 , piece_id=SQOIUIMMOLGQHURPXKR4E3SYUKDJDJNZ75Q4RXA3W2E4JOG5WXLQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188643465 (311h31m51.919911095s) [noise=true , address=104.36.82.14:4236 , piece_id=EOTHS7XHUD5YNTOQOVTFR6EIRGREL4VBL2KLS5LJVQJKTMRWWUVQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188658473 (311h31m51.919926103s) [noise=true , address=104.36.82.11:4118 , piece_id=MFWA4J22CPFE4HEYFXZISYJDAKWCF3HEYHVCYKSFQY5N27QT2O6A, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.188993774 (311h31m51.920261394s) [noise=true , address=77.90.31.18:4812 , piece_id=GRFZT75OBWQBGFZ3I3QYOGWHIFXJCZHKOGQOG34ZW6QG7BNBNGBQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189017548 (311h31m51.920285178s) [noise=true , address=77.90.31.11:4582 , piece_id=7I4O5F46N3EAAFKUSTBOA3DY5NF7PQHNILWM5GFZ5CEIGRZANDRQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189365152 (311h31m51.920632782s) [noise=true , address=79.127.205.234:4616 , piece_id=D3SSTIPP6BS4NL5IS3JTR6JTHG32VWVD6HIU27WB2HXRTI7SL4TQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.189952657 (311h31m51.921220287s) [noise=true , address=104.36.82.45:4917 , piece_id=HHWHHUVVM76NSJNSFRSV5L2TJM7WABLPY3UMVM7CEZM44NKMXRHQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.190704210 (311h31m51.92197184s) [noise=true , address=45.91.116.11:4142 , piece_id=FTHDX3KRMQV2VPJA42JPTD5LDPAQCC6C2D6ODRZ7M4ZASZDJCSYA, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.191563527 (311h31m51.922831157s) [noise=true , address=45.91.116.11:4141 , piece_id=6OUW5WSYNG5GABS6BH3NNP3WRPYAK3SOVJDSXLMPICFMSNWD3O3Q, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.192590128 (311h31m51.923857758s) [noise=true , address=104.36.82.6:4907 , piece_id=ZVU2TK7PXTZBHLLU657Q5U5BS33QIIGR5WBBUE23LMRWNYSGIJEQ, seg_pos={0 0}, upload=323881]: Uploading piece...
Aug 21 16:58:11.292199435 (311h31m52.023467055s) [upload=323881]: Next returned nil segment
Aug 21 16:58:11.292208382 (311h31m52.023476002s) [upload=323881]: Waiting for error group managing segments...
Aug 21 16:58:11.305981536 (311h31m52.037249156s) [noise=true , address=104.36.82.11:4118 , piece_id=MFWA4J22CPFE4HEYFXZISYJDAKWCF3HEYHVCYKSFQY5N27QT2O6A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.317455457 (311h31m52.048723076s) [noise=true , address=77.90.31.11:4582 , piece_id=7I4O5F46N3EAAFKUSTBOA3DY5NF7PQHNILWM5GFZ5CEIGRZANDRQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.319650365 (311h31m52.050917985s) [noise=true , address=77.90.31.18:4812 , piece_id=GRFZT75OBWQBGFZ3I3QYOGWHIFXJCZHKOGQOG34ZW6QG7BNBNGBQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.320890678 (311h31m52.052158297s) [noise=true , address=104.36.82.49:4012 , piece_id=CQSJDRQSYII2TZ4IXSILK3IN4WMGVOJEHPQJBPWPYII5HQ7G2B3A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.325965804 (311h31m52.057233424s) [noise=true , address=77.90.31.15:4719 , piece_id=SQOIUIMMOLGQHURPXKR4E3SYUKDJDJNZ75Q4RXA3W2E4JOG5WXLQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.327860037 (311h31m52.059127667s) [noise=true , address=45.91.116.11:4142 , piece_id=FTHDX3KRMQV2VPJA42JPTD5LDPAQCC6C2D6ODRZ7M4ZASZDJCSYA, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.328132208 (311h31m52.059399828s) [noise=true , address=45.91.116.5:4312 , piece_id=QCY54KDIJ3SFLIE2X6KBQD2UIEWMGYBOL33JKFLWGXZGRTB42YQQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.330010401 (311h31m52.061278021s) [noise=true , address=77.90.31.10:4548 , piece_id=3IWDAKTWMTSIYUHS4YSHUGNPZXYIOTCE523RYZCYL2FEW226R45A, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.335413914 (311h31m52.066681533s) [noise=true , address=77.90.31.13:4651 , piece_id=KVYWHATVMKX3WZB7UWCIPQ5TIXHLAO7TWECK4XRQDILQ4HOUSB3Q, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.341151935 (311h31m52.072419546s) [noise=true , address=104.36.82.9:4022 , piece_id=XHQFV3SHMAT7WOOWG6U5QRRO3VBLZUE2SV7N5N4IDWWB6MPAT7JA, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.348847890 (311h31m52.08011552s) [noise=true , address=104.36.82.6:4907 , piece_id=ZVU2TK7PXTZBHLLU657Q5U5BS33QIIGR5WBBUE23LMRWNYSGIJEQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.360184613 (311h31m52.091452233s) [noise=true , address=104.36.82.13:4209 , piece_id=AJ5OPQIYSANI4EFJQYTCSC4OYA2KV4PR23YNLROCLL62ZNT2CINQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.366983571 (311h31m52.098251201s) [noise=true , address=77.90.31.19:4851 , piece_id=YZ7SGALUQPTAHO5ZARMCVMADX5AGH6BQNCN5UTC74JPLPEWALEDQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.392521653 (311h31m52.123789274s) [noise=true , address=104.36.82.45:4917 , piece_id=HHWHHUVVM76NSJNSFRSV5L2TJM7WABLPY3UMVM7CEZM44NKMXRHQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.392540769 (311h31m52.123808399s) [seg_pos={0 0}, upload=323881]: Segment reached optimal threshold of 14 pieces.
Aug 21 16:58:11.392827879 (311h31m52.124095509s) [noise=true , address=104.36.82.14:4236 , piece_id=EOTHS7XHUD5YNTOQOVTFR6EIRGREL4VBL2KLS5LJVQJKTMRWWUVQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XaE29W27ym2RmuGdBvHeKcQZZEUbask1zsm9Bz8xLokZNGfcj): protocol: expected piece hash; context canceled; EOF
Aug 21 16:58:11.393068121 (311h31m52.124335742s) [noise=true , address=45.91.116.11:4141 , piece_id=6OUW5WSYNG5GABS6BH3NNP3WRPYAK3SOVJDSXLMPICFMSNWD3O3Q, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h1gxgVjoHUkjKXA5xhTowGKi9q6wZGyzg8eqKgMHqsxF1ut5P): protocol: write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection; write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:47570->45.91.116.11:4141: use of closed network connection
Aug 21 16:58:11.393129707 (311h31m52.124397326s) [noise=true , address=79.127.205.234:4616 , piece_id=D3SSTIPP6BS4NL5IS3JTR6JTHG32VWVD6HIU27WB2HXRTI7SL4TQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PuFfyFT8z7TwZZsBhMRPx8HtLBqELmEzxbbsuG9Ljg9KKz3rm): protocol: read tcp 5.161.89.252:61860->79.127.205.234:4616: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 16:58:11.393280721 (311h31m52.124548371s) [noise=true , address=104.36.82.7:4920 , piece_id=7LGSALS6MO7SEPNO5KGHKACZ6CSAMJMV2GYHYY6BBVGFOXHRLPSQ, seg_pos={0 0}, upload=323881]: Done uploading piece. err: <nil>
Aug 21 16:58:11.393342206 (311h31m52.124609846s) [seg_pos={0 0}, upload=323881]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 21 16:58:11.393461841 (311h31m52.124729492s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 16:58:11.393467823 (311h31m52.124735463s) [upload=323881]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 16:58:11.446017719 (311h31m52.177285349s) [upload=323881]: Done uploading segments...
Aug 21 16:58:11.446031615 (311h31m52.177299245s) [upload=323881]: Upload finished. err: <nil>
Duration: 447.549951ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
537.716338ms
FAIL (2025-08-21 16:57:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 16:45:42.818925122 (311h19m23.550192741s) [upload=323674]: Starting upload Aug 21 16:45:42.818950720 (311h19m23.55021834s) [upload=323674]: Done starting upload Aug 21 16:45:42.819181344 (311h19m23.550448964s) [upload=323674]: Uploading segments... Aug 21 16:45:42.819224044 (311h19m23.550491664s) [upload=323674]: Got next segment. Inline: false Aug 21 16:45:42.819254120 (311h19m23.550521741s) [upload=323674]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 16:45:42.819257296 (311h19m23.550524916s) [upload=323674]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 16:45:42.860400833 (311h19m23.591668453s) [upload=323674]: Next segment err: metaclient: Too Many Requests Aug 21 16:45:42.860462950 (311h19m23.591730581s) [upload=323674]: Done uploading segments... Aug 21 16:45:42.860480593 (311h19m23.591748223s) [upload=323674]: Upload finished. err: metaclient: Too Many Requests
Duration: 537.744241ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
2.069800451s
FAIL (2025-08-21 16:57:00 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 16:45:42.818925122 (311h19m23.550192741s) [upload=323674]: Starting upload Aug 21 16:45:42.818950720 (311h19m23.55021834s) [upload=323674]: Done starting upload Aug 21 16:45:42.819181344 (311h19m23.550448964s) [upload=323674]: Uploading segments... Aug 21 16:45:42.819224044 (311h19m23.550491664s) [upload=323674]: Got next segment. Inline: false Aug 21 16:45:42.819254120 (311h19m23.550521741s) [upload=323674]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 16:45:42.819257296 (311h19m23.550524916s) [upload=323674]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 16:45:42.860400833 (311h19m23.591668453s) [upload=323674]: Next segment err: metaclient: Too Many Requests Aug 21 16:45:42.860462950 (311h19m23.591730581s) [upload=323674]: Done uploading segments... Aug 21 16:45:42.860480593 (311h19m23.591748223s) [upload=323674]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.069822553s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [X..............] duration:
86.853465ms remote:
"tcp:34.202.203.47:443" response headers:
Date=Thu, 21 Aug 2025 16:45:17 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red target:
https://www.storj.io/
FAIL (2025-08-21 16:56:59 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 86.86651ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
1.457545771s
FAIL (2025-08-21 16:56:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 16:45:42.818925122 (311h19m23.550192741s) [upload=323674]: Starting upload Aug 21 16:45:42.818950720 (311h19m23.55021834s) [upload=323674]: Done starting upload Aug 21 16:45:42.819181344 (311h19m23.550448964s) [upload=323674]: Uploading segments... Aug 21 16:45:42.819224044 (311h19m23.550491664s) [upload=323674]: Got next segment. Inline: false Aug 21 16:45:42.819254120 (311h19m23.550521741s) [upload=323674]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 16:45:42.819257296 (311h19m23.550524916s) [upload=323674]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 16:45:42.860400833 (311h19m23.591668453s) [upload=323674]: Next segment err: metaclient: Too Many Requests Aug 21 16:45:42.860462950 (311h19m23.591730581s) [upload=323674]: Done uploading segments... Aug 21 16:45:42.860480593 (311h19m23.591748223s) [upload=323674]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.457562753s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [.X.............] duration:
62.82294ms remote:
"tcp:34.202.203.47:443" response headers:
Date=Thu, 21 Aug 2025 16:45:17 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red target:
https://www.storj.io/
FAIL (2025-08-21 16:55:49 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 62.841404ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
1.466609277s
FAIL (2025-08-21 16:55:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 16:45:42.818925122 (311h19m23.550192741s) [upload=323674]: Starting upload Aug 21 16:45:42.818950720 (311h19m23.55021834s) [upload=323674]: Done starting upload Aug 21 16:45:42.819181344 (311h19m23.550448964s) [upload=323674]: Uploading segments... Aug 21 16:45:42.819224044 (311h19m23.550491664s) [upload=323674]: Got next segment. Inline: false Aug 21 16:45:42.819254120 (311h19m23.550521741s) [upload=323674]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 16:45:42.819257296 (311h19m23.550524916s) [upload=323674]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 16:45:42.860400833 (311h19m23.591668453s) [upload=323674]: Next segment err: metaclient: Too Many Requests Aug 21 16:45:42.860462950 (311h19m23.591730581s) [upload=323674]: Done uploading segments... Aug 21 16:45:42.860480593 (311h19m23.591748223s) [upload=323674]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.466627251s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [..X............] duration:
196.400524ms remote:
"tcp:34.202.203.47:443" response headers:
Date=Thu, 21 Aug 2025 16:45:17 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red target:
https://www.storj.io/
FAIL (2025-08-21 16:54:53 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 196.426143ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
1.585630386s
FAIL (2025-08-21 16:54:44 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 16:45:42.818925122 (311h19m23.550192741s) [upload=323674]: Starting upload Aug 21 16:45:42.818950720 (311h19m23.55021834s) [upload=323674]: Done starting upload Aug 21 16:45:42.819181344 (311h19m23.550448964s) [upload=323674]: Uploading segments... Aug 21 16:45:42.819224044 (311h19m23.550491664s) [upload=323674]: Got next segment. Inline: false Aug 21 16:45:42.819254120 (311h19m23.550521741s) [upload=323674]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 16:45:42.819257296 (311h19m23.550524916s) [upload=323674]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 16:45:42.860400833 (311h19m23.591668453s) [upload=323674]: Next segment err: metaclient: Too Many Requests Aug 21 16:45:42.860462950 (311h19m23.591730581s) [upload=323674]: Done uploading segments... Aug 21 16:45:42.860480593 (311h19m23.591748223s) [upload=323674]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.585659349s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
443.536702ms
FAIL (2025-08-21 16:54:17 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 16:45:42.818925122 (311h19m23.550192741s) [upload=323674]: Starting upload Aug 21 16:45:42.818950720 (311h19m23.55021834s) [upload=323674]: Done starting upload Aug 21 16:45:42.819181344 (311h19m23.550448964s) [upload=323674]: Uploading segments... Aug 21 16:45:42.819224044 (311h19m23.550491664s) [upload=323674]: Got next segment. Inline: false Aug 21 16:45:42.819254120 (311h19m23.550521741s) [upload=323674]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 16:45:42.819257296 (311h19m23.550524916s) [upload=323674]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 16:45:42.860400833 (311h19m23.591668453s) [upload=323674]: Next segment err: metaclient: Too Many Requests Aug 21 16:45:42.860462950 (311h19m23.591730581s) [upload=323674]: Done uploading segments... Aug 21 16:45:42.860480593 (311h19m23.591748223s) [upload=323674]: Upload finished. err: metaclient: Too Many Requests
Duration: 443.561158ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
2.347428319s
FAIL (2025-08-21 16:53:46 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 16:45:42.818925122 (311h19m23.550192741s) [upload=323674]: Starting upload Aug 21 16:45:42.818950720 (311h19m23.55021834s) [upload=323674]: Done starting upload Aug 21 16:45:42.819181344 (311h19m23.550448964s) [upload=323674]: Uploading segments... Aug 21 16:45:42.819224044 (311h19m23.550491664s) [upload=323674]: Got next segment. Inline: false Aug 21 16:45:42.819254120 (311h19m23.550521741s) [upload=323674]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 16:45:42.819257296 (311h19m23.550524916s) [upload=323674]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 16:45:42.860400833 (311h19m23.591668453s) [upload=323674]: Next segment err: metaclient: Too Many Requests Aug 21 16:45:42.860462950 (311h19m23.591730581s) [upload=323674]: Done uploading segments... Aug 21 16:45:42.860480593 (311h19m23.591748223s) [upload=323674]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.347446785s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [...X...........] duration:
737.348919ms remote:
"tcp:34.202.203.47:443" response headers:
Date=Thu, 21 Aug 2025 16:45:17 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red target:
https://www.storj.io/
FAIL (2025-08-21 16:53:45 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 737.370469ms
core
website
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [....X..........] duration:
86.012714ms remote:
"tcp:34.202.203.47:443" response headers:
Date=Thu, 21 Aug 2025 16:45:17 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red target:
https://www.storj.io/
FAIL (2025-08-21 16:52:50 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 86.034215ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [X.................................................X.........] duration:
1.283115748s
FAIL (2025-08-21 16:52:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 16:45:42.818925122 (311h19m23.550192741s) [upload=323674]: Starting upload Aug 21 16:45:42.818950720 (311h19m23.55021834s) [upload=323674]: Done starting upload Aug 21 16:45:42.819181344 (311h19m23.550448964s) [upload=323674]: Uploading segments... Aug 21 16:45:42.819224044 (311h19m23.550491664s) [upload=323674]: Got next segment. Inline: false Aug 21 16:45:42.819254120 (311h19m23.550521741s) [upload=323674]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 16:45:42.819257296 (311h19m23.550524916s) [upload=323674]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 16:45:42.860400833 (311h19m23.591668453s) [upload=323674]: Next segment err: metaclient: Too Many Requests Aug 21 16:45:42.860462950 (311h19m23.591730581s) [upload=323674]: Done uploading segments... Aug 21 16:45:42.860480593 (311h19m23.591748223s) [upload=323674]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.283138181s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
1 out of 15 is failed (threshold=6) [.....X.........] duration:
120.627037ms remote:
"tcp:34.202.203.47:443" response headers:
Date=Thu, 21 Aug 2025 16:45:17 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red target:
https://www.storj.io/
FAIL (2025-08-21 16:52:06 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 120.653376ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X.................................................X........] duration:
611.613538ms
FAIL (2025-08-21 16:51:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 16:45:42.818925122 (311h19m23.550192741s) [upload=323674]: Starting upload Aug 21 16:45:42.818950720 (311h19m23.55021834s) [upload=323674]: Done starting upload Aug 21 16:45:42.819181344 (311h19m23.550448964s) [upload=323674]: Uploading segments... Aug 21 16:45:42.819224044 (311h19m23.550491664s) [upload=323674]: Got next segment. Inline: false Aug 21 16:45:42.819254120 (311h19m23.550521741s) [upload=323674]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 16:45:42.819257296 (311h19m23.550524916s) [upload=323674]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 16:45:42.860400833 (311h19m23.591668453s) [upload=323674]: Next segment err: metaclient: Too Many Requests Aug 21 16:45:42.860462950 (311h19m23.591730581s) [upload=323674]: Done uploading segments... Aug 21 16:45:42.860480593 (311h19m23.591748223s) [upload=323674]: Upload finished. err: metaclient: Too Many Requests
Duration: 611.637012ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
2 out of 15 is failed (threshold=6) [X.....X........] duration:
76.818277ms remote:
"tcp:34.202.203.47:443" response headers:
Date=Thu, 21 Aug 2025 16:45:17 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red target:
https://www.storj.io/
FAIL (2025-08-21 16:50:59 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 76.903827ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X.................................................X.......] duration:
970.642673ms
FAIL (2025-08-21 16:50:35 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 16:45:42.818925122 (311h19m23.550192741s) [upload=323674]: Starting upload Aug 21 16:45:42.818950720 (311h19m23.55021834s) [upload=323674]: Done starting upload Aug 21 16:45:42.819181344 (311h19m23.550448964s) [upload=323674]: Uploading segments... Aug 21 16:45:42.819224044 (311h19m23.550491664s) [upload=323674]: Got next segment. Inline: false Aug 21 16:45:42.819254120 (311h19m23.550521741s) [upload=323674]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 16:45:42.819257296 (311h19m23.550524916s) [upload=323674]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 16:45:42.860400833 (311h19m23.591668453s) [upload=323674]: Next segment err: metaclient: Too Many Requests Aug 21 16:45:42.860462950 (311h19m23.591730581s) [upload=323674]: Done uploading segments... Aug 21 16:45:42.860480593 (311h19m23.591748223s) [upload=323674]: Upload finished. err: metaclient: Too Many Requests
Duration: 970.662961ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
2 out of 15 is failed (threshold=6) [.X.....X.......] duration:
99.317104ms remote:
"tcp:34.202.203.47:443" response headers:
Date=Thu, 21 Aug 2025 16:45:17 GMT Content-Type=text/html Content-Length=164 X-Cluster-Name=us-east-1-prod-hosting-red target:
https://www.storj.io/
FAIL (2025-08-21 16:50:03 UTC)
orbiter warning: unexpected status code "504 Gateway Time-out" "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>openresty</center>\r\n</body>\r\n</html>\r\n"
Duration: 99.329828ms
core
website
|