RError.com

RError.com Logo RError.com Logo

RError.com Navigation

  • 主页

Mobile menu

Close
  • 主页
  • 系统&网络
    • 热门问题
    • 最新问题
    • 标签
  • Ubuntu
    • 热门问题
    • 最新问题
    • 标签
  • 帮助
主页 / user-694588

HeAVeN's questions

Martin Hope
HeAVeN
Asked: 2025-04-22 21:37:54 +0000 UTC

从 ASP.NET 和 Docker 上的分散系统下载文件时出现问题

  • 6

我正在 Docker 容器中的 ASP.NET 上创建分布式分散数据存储系统。使用 Chord (DHT)。在节点之间保存文件可以正常工作 - 它们被分发和存储。尝试从节点上传(下载)文件时出现此问题。我无法从日志中找出问题所在。错误可能出在哪里?

日志:

2025-04-21 15:28:36 2025-04-21 12:28:36 warn: DistributedSystems_Lab4.WorkerController[0] Запрос на скачивание файла Дикая природа Амазонки.mp4
2025-04-21 15:28:36 2025-04-21 12:28:36 info: System.Net.Http.HttpClient.Default.LogicalHandler[100] Start processing HTTP request GET http://worker4:5004/store/%D0%94%D0%B8%D0%BA%D0%B0%D1%8F%20%D0%BF%D1%80%D0%B8%D1%80%D0%BE%D0%B4%D0%B0%20%D0%90%D0%BC%D0%B0%D0%B7%D0%BE%D0%BD%D0%BA%D0%B8.mp4_part_0
2025-04-21 15:28:36 2025-04-21 12:28:36 info: System.Net.Http.HttpClient.Default.ClientHandler[100] Sending HTTP request GET http://worker4:5004/store/%D0%94%D0%B8%D0%BA%D0%B0%D1%8F%20%D0%BF%D1%80%D0%B8%D1%80%D0%BE%D0%B4%D0%B0%20%D0%90%D0%BC%D0%B0%D0%B7%D0%BE%D0%BD%D0%BA%D0%B8.mp4_part_0
2025-04-21 15:28:36 2025-04-21 12:28:36 info: System.Net.Http.HttpClient.Default.ClientHandler[101] Received HTTP response headers after 61.7462ms - 400
2025-04-21 15:28:36 2025-04-21 12:28:36 info: System.Net.Http.HttpClient.Default.LogicalHandler[101] End processing HTTP request after 62.0256ms - 400
2025-04-21 15:28:36 2025-04-21 12:28:36 warn: DistributedSystems_Lab4.WorkerController[0] Не удалось скачать блок Дикая природа Амазонки.mp4_part_0 с http://worker4:5004

代码:

docker-compose.yml:

services:
 
  worker1:
    container_name: worker1
    image: myapp
    environment:
      - NodeRole=worker
      - ASPNETCORE_URLS=http://+:5001
    ports:
      - "5001:5001"
    networks:
      - app_net
    volumes:
      - worker1_storage:/app/storage
      - metadata-volume:/app/metadata_storage
    deploy:
      restart_policy:
        condition: on-failure
 
  worker2:
    container_name: worker2
    image: myapp
    environment:
      - NodeRole=worker
      - ASPNETCORE_URLS=http://+:5002
    ports:
      - "5002:5002"
    networks:
      - app_net
    volumes:
      - worker2_storage:/app/storage
      - metadata-volume:/app/metadata_storage
    deploy:
      restart_policy:
        condition: on-failure
 
  worker3:
    container_name: worker3
    image: myapp
    environment:
      - NodeRole=worker
      - ASPNETCORE_URLS=http://+:5003
    ports:
      - "5003:5003"
    networks:
      - app_net
    volumes:
      - worker3_storage:/app/storage
      - metadata-volume:/app/metadata_storage
    deploy:
      restart_policy:
        condition: on-failure

  worker4:
    container_name: worker4
    image: myapp
    environment:
      - NodeRole=worker
      - ASPNETCORE_URLS=http://+:5004
    ports:
      - "5004:5004"
    networks:
      - app_net
    volumes:
      - worker4_storage:/app/storage
      - metadata-volume:/app/metadata_storage
    deploy:
      restart_policy:
        condition: on-failure

  worker5:
    container_name: worker5
    image: myapp
    environment:
      - NodeRole=worker
      - ASPNETCORE_URLS=http://+:5005
    ports:
      - "5005:5005"
    networks:
      - app_net
    volumes:
      - worker5_storage:/app/storage
      - metadata-volume:/app/metadata_storage
    deploy:
      restart_policy:
        condition: on-failure
 
networks:
  app_net:
    driver: bridge
 
volumes:
  metadata-volume:
    driver: local
  worker1_storage:
  worker2_storage:
  worker3_storage:
  worker4_storage:
  worker5_storage:  

ChordNode.cs:

using DistributedSystems_Lab4;

public class ChordNode
{
    public int Id { get; }
    public string Url { get; }
    public ChordNode? Successor { get; set; }
    public ChordNode? Predecessor { get; set; }
    public List<FingerEntry> FingerTable { get; set; }

    public ChordNode(int id, string url)
    {
        Id = id;
        Url = url;
        FingerTable = new List<FingerEntry>();
    }

    public override string ToString() => $"{Url} ({Id})";
}

ChordRing.cs:

using DistributedSystems_Lab4;
using System.Security.Cryptography;
using System.Text;

public class ChordRing
{
    private readonly List<ChordNode> nodes = new();
    private readonly int m = 32;

    public void InitializeFingerTables()
    {
        foreach (var node in nodes)
        {
            for (int i = 0; i < m; i++)
            {
                int start = (node.Id + (int)Math.Pow(2, i)) % (int)Math.Pow(2, m);
                node.FingerTable.Add(new FingerEntry { Start = start, Node = FindNodeForFingerTable(start) });
            }
        }
    }

    private ChordNode FindNodeForFingerTable(int start)
    {
        foreach (var node in nodes)
        {
            if (node.Id >= start)
                return node;
        }
        return nodes.First();
    }
    public void AddNode(string url)
    {
        int id = Hash(url);
        if (nodes.Any(n => n.Id == id)) return;

        var newNode = new ChordNode(id, url);
        nodes.Add(newNode);
        nodes.Sort((a, b) => a.Id.CompareTo(b.Id));
        UpdateLinks();
    }

    public void RemoveNode(string url)
    {
        nodes.RemoveAll(n => n.Url == url);
        UpdateLinks();
    }

    private void UpdateLinks()
    {
        int count = nodes.Count;
        for (int i = 0; i < count; i++)
        {
            var current = nodes[i];
            current.Successor = nodes[(i + 1) % count];
            current.Predecessor = nodes[(i - 1 + count) % count];
        }
    }

    public ChordNode FindResponsibleNode(string key)
    {
        int keyHash = Hash(key);

        foreach (var node in nodes.OrderBy(n => n.Id))
        {
            if (keyHash <= node.Id)
                return node;
        }

        return nodes.First(); // Если хеш больше всех — вернем первого (кольцо)
    }

    public static int Hash(string input)
    {
        using var sha1 = SHA1.Create();
        var hash = sha1.ComputeHash(Encoding.UTF8.GetBytes(input));
        return Math.Abs(BitConverter.ToInt32(hash, 0));
    }

    public IEnumerable<ChordNode> GetAllNodes() => nodes;
}
FingerEntry.cs:

namespace DistributedSystems_Lab4
{
    public class FingerEntry
    {
        public int Start { get; set; }
        public ChordNode? Node { get; set; }
    }
}

键值控制器.cs:

using Microsoft.AspNetCore.Http;
using Microsoft.AspNetCore.Mvc;
using Microsoft.Extensions.Logging;
using System.IO;
using System.Threading.Tasks;

namespace DistributedSystems_Lab4
{
    [ApiController]
    [Route("store")]
    public class KeyValueController : ControllerBase
    {
        private readonly WorkerFileStorageService service;
        private readonly ILogger logger;

        public KeyValueController(WorkerFileStorageService service, ILogger<KeyValueController> logger)
        {
            this.service = service;
            this.logger = logger;
        }

        [HttpPut("{key}")]
        public async Task<IActionResult> Store(string key, IFormFile file)
        {
            if (file == null || file.Length == 0)
            {
                logger.LogWarning("Файл не передан или пуст. partName: {partName}", file.FileName);
                return BadRequest("Файл не передан или пуст.");
            }

            logger.LogInformation("Получен запрос на сохранение файла: {FileName} с размером {FileSize} для части: {PartName}",
                file.FileName, file.Length, file.FileName);

            try
            {
                await service.SaveBlockAsync(file.FileName, file);

                service.metadataService.SaveFileName(key, file.FileName);

                logger.LogInformation("Файл {FileName} успешно сохранен.", file.FileName);
                return Ok();
            }
            catch (Exception ex)
            {
                logger.LogError(ex, "Ошибка при сохранении файла {FileName} для части: {PartName}", file.FileName, file.FileName);
                return StatusCode(500, "Ошибка при сохранении файла.");
            }
        }

        [HttpGet("{key}")]
        public async Task<IActionResult> Get(string partName)
        {
            var stream = await service.GetBlockAsync(partName);
            if (stream == null) return NotFound();

            return File(stream, "application/octet-stream", partName);
        }

        [HttpHead("{key}")]
        public IActionResult Exists(string key)
        {
            return service.HasBlock(key) ? Ok() : NotFound();
        }

        [HttpDelete("{key}")]
        public IActionResult Delete(string key)
        {
            return service.DeleteBlock(key) ? Ok() : NotFound();
        }
    }
}

元数据服务.cs:

using Newtonsoft.Json;

public class MetadataService
{
    private readonly string metadataPath = "/app/metadata_storage/"; 

    private Dictionary<string, string> fileNames = new();
    private Dictionary<string, List<(string partName, string WorkerUrl)>> fileMetadata = new();

    public MetadataService()
    {
        if (!Directory.Exists(metadataPath))
        {
            Directory.CreateDirectory(metadataPath);
        }

        LoadMetadata();
    }

    public void SaveFileName(string key, string fileName)
    {
        fileNames[key] = fileName;
        SaveMetadata();
    }

    public void SaveFileMetadata(string key, List<(string partName, string WorkerUrl)> metadata)
    {
        fileMetadata[key] = metadata;
        SaveMetadata();
    }

    public string GetFileName(string key)
    {
        return fileNames.ContainsKey(key) ? fileNames[key] : null;
    }

    public List<(string partName, string WorkerUrl)> GetFileMetadata(string key)
    {
        return fileMetadata.ContainsKey(key) ? fileMetadata[key] : null;
    }

    public void DeleteFileMetadata(string key)
    {
        if (fileMetadata.ContainsKey(key))
        {
            fileMetadata.Remove(key);
            fileNames.Remove(key);
            SaveMetadata();
        }
    }

    private void SaveMetadata()
    {
        if (!Directory.Exists(metadataPath))
        {
            Directory.CreateDirectory(metadataPath);
        }

        var filePath = Path.Combine(metadataPath, "metadata.json");

        var metadata = new
        {
            Files = fileNames,
            Metadata = fileMetadata
        };

        var json = JsonConvert.SerializeObject(metadata, Formatting.Indented);
        File.WriteAllText(filePath, json);
    }

    private void LoadMetadata()
    {
        var filePath = Path.Combine(metadataPath, "metadata.json");

        if (File.Exists(filePath))
        {
            var json = File.ReadAllText(filePath);
            var metadata = JsonConvert.DeserializeObject<dynamic>(json);

            if (metadata?.Files != null)
                fileNames = JsonConvert.DeserializeObject<Dictionary<string, string>>(metadata.Files.ToString());

            if (metadata?.Metadata != null)
                fileMetadata = JsonConvert.DeserializeObject<Dictionary<string, List<(string partName, string WorkerUrl)>>>(metadata.Metadata.ToString());
        }
    }

    public bool KeyExists(string key)
    {
        if (fileNames[key] != null)
            return true;
        else return false;
    }
}

程序.cs:

using DistributedSystems_Lab4;
using Microsoft.AspNetCore.Builder;
using Microsoft.AspNetCore.DataProtection;
using Microsoft.AspNetCore.Hosting;
using Microsoft.AspNetCore.Http;
using Microsoft.AspNetCore.Http.Features;
using Microsoft.Extensions.DependencyInjection;
using Microsoft.Extensions.Hosting;
using Microsoft.Extensions.Logging;
using System;

var builder = WebApplication.CreateBuilder(args);

builder.Logging.ClearProviders();
builder.Logging.AddSimpleConsole(options =>
{
    options.IncludeScopes = false; 
    options.SingleLine = true;    
    options.TimestampFormat = "yyyy-MM-dd HH:mm:ss ";  
});

builder.Services.AddMvc();
builder.Services.Configure<Microsoft.AspNetCore.Http.Features.FormOptions>(options =>
{
    options.MultipartBodyLengthLimit = 10L * 1024 * 1024 * 1024; // 10GB
});

builder.WebHost.ConfigureKestrel(serverOptions =>
{
    serverOptions.Limits.MaxRequestBodySize = 10L * 1024 * 1024 * 1024; // 10GB
});

builder.Services.Configure<FormOptions>(o =>
{
    o.MultipartBodyLengthLimit = 10L * 1024 * 1024 * 1024; // 50 MB
});
builder.Services.AddControllers();
builder.Services.AddHttpClient();
builder.Services.AddSingleton<HttpClient>();
builder.Services.AddSingleton<WorkerFileStorageService>();
builder.Services.AddSingleton<ChordNode>();
builder.Services.AddSingleton<ChordRing>();
builder.Services.AddSingleton<FingerEntry>();
builder.Services.AddSingleton<KeyValueController>();
builder.Services.AddSingleton<MetadataService>(); 

var app = builder.Build();

app.Logger.LogInformation("Start");

app.MapGet("/", () => Results.Redirect("/index.html"));

app.UseStaticFiles();

app.UseRouting();
app.UseAuthorization();
app.MapControllers();

app.Run();

WorkerController.cs:

using Microsoft.AspNetCore.Mvc;
using Microsoft.Extensions.Logging;
using System.IO;
using System.Net.Http;
using System.Threading.Tasks;
using System.Linq;
using System.Collections.Generic;
using System;

namespace DistributedSystems_Lab4
{
    [Route("api/worker")]
    [ApiController]
    public class WorkerController : ControllerBase
    {
        private readonly WorkerFileStorageService workerStorage;
        private readonly ILogger logger;
        private readonly MetadataService metadataService;
        private readonly IHttpClientFactory httpClientFactory;

        public WorkerController(
            WorkerFileStorageService workerStorage,
            ILogger<WorkerController> logger,
            MetadataService metadataService,
            IHttpClientFactory httpClientFactory)
        {
            this.workerStorage = workerStorage;
            this.logger = logger;
            this.metadataService = metadataService;
            this.httpClientFactory = httpClientFactory;
        }

        [HttpPut("save/{key}")]
        public async Task<IActionResult> Save(string key, [FromForm] IFormFile file)
        {
            if (file == null || file.Length == 0)
                return BadRequest("Файл не передан или пуст.");

            const int blockSize = 5 * 1024 * 1024;
            List<(string blockName, string WorkerUrl)> metadata = new();
            var chord = workerStorage.getChordRing();

            using var stream = file.OpenReadStream();
            int index = 0;
            byte[] buffer = new byte[blockSize];
            int bytesRead;

            while ((bytesRead = await stream.ReadAsync(buffer, 0, buffer.Length)) > 0)
            {
                var partName = $"{file.FileName}_part_{index}";
                var node = chord.FindResponsibleNode(partName);

                var client = httpClientFactory.CreateClient();
                using var content = new MultipartFormDataContent();
                using var blockStream = new MemoryStream(buffer, 0, bytesRead);

                // Гарантируем, что поток начинает чтение с первого байта
                blockStream.Position = 0;

                content.Add(new StreamContent(blockStream), "file", partName);

                var response = await client.PutAsync($"{node.Url}/store/{key}", content);
                if (response.IsSuccessStatusCode)
                {
                    metadata.Add((partName, node.Url));
                    logger.LogInformation($"Блок {index} успешно сохранен на {node.Url}");
                }
                else
                {
                    logger.LogWarning($"Не удалось сохранить блок {index} на {node.Url}. Код ответа: {response.StatusCode}");
                }

                index++;
            }

            if (metadata.Count == index)
            {
                try
                {
                    metadataService.SaveFileName(key, file.FileName);
                    metadataService.SaveFileMetadata(key, metadata);
                    logger.LogInformation($"Метаданные для файла {key} успешно сохранены.");
                }
                catch (Exception ex)
                {
                    logger.LogError($"Ошибка при сохранении метаданных для файла {key}: {ex.Message}");
                    return StatusCode(500, "Ошибка при сохранении метаданных.");
                }
            }

            return Ok("Файл сохранён.");
        }



        [HttpGet("download/{key}")]
        public async Task<IActionResult> Download(string key)
        {
            string fileName = metadataService.GetFileName(key);
            logger.LogWarning($"Запрос на скачивание файла {fileName}");
            var parts = metadataService.GetFileMetadata(key);
            if (parts == null || parts.Count == 0)
                return NotFound("Файл не найден.");

            var client = httpClientFactory.CreateClient();
            var memoryStream = new MemoryStream();

            foreach (var (partName, url) in parts.OrderBy(p => p.partName))
            {
                var response = await client.GetAsync($"{url}/store/{partName}");
                if (!response.IsSuccessStatusCode)
                {
                    logger.LogWarning($"Не удалось скачать блок {partName} с {url}");
                    continue;
                }

                var blockStream = await response.Content.ReadAsStreamAsync();
                await blockStream.CopyToAsync(memoryStream);
            }

            memoryStream.Position = 0;
            return File(memoryStream, "application/octet-stream", fileName);
        }

        [HttpGet("has/{key}")]
        public IActionResult HasBlock(string key)
        {
            bool exists = metadataService.KeyExists(key);
            if (exists)
            {
                logger.LogInformation($"Блок с ключом {key} существует.");
                return Ok($"Блок с ключом {key} существует.");
            }
            else
            {
                logger.LogInformation($"Блок с ключом {key} не найден.");
                return NotFound($"Блок с ключом {key} не найден.");
            }
        }

        [HttpDelete("delete/{key}")]
        public async Task<IActionResult> Delete(string key)
        {
            var parts = metadataService.GetFileMetadata(key);
            if (parts == null || parts.Count == 0)
                return NotFound("Файл не найден.");

            var client = httpClientFactory.CreateClient();
            bool allDeleted = true;

            foreach (var (part, url) in parts)
            {
                var response = await client.DeleteAsync($"{url}/store/{key}_part_{part}");
                if (!response.IsSuccessStatusCode)
                {
                    logger.LogWarning($"Не удалось удалить блок: {key}_part_{part} на {url}");
                    allDeleted = false;
                }
                else
                {
                    logger.LogInformation($"Блок {key}_part_{part} успешно удалён с {url}");
                }
            }

            try
            {
                metadataService.DeleteFileMetadata(key);
                logger.LogInformation($"Метаданные для файла {key} успешно удалены.");
            }
            catch (Exception ex)
            {
                logger.LogError($"Ошибка при удалении метаданных для файла {key}: {ex.Message}");
                return StatusCode(500, "Ошибка при удалении метаданных.");
            }

            return allDeleted ? Ok("Файл удалён.") : StatusCode(500, "Удаление выполнено частично.");
        }

        [HttpGet("listFiles")]
        public IActionResult ListFiles()
        {
            var files = workerStorage.ListAllKeys();
            return Ok(files);
        }
    }
    }

WorkerFileStorageService.cs:

using DistributedSystems_Lab4;

public class WorkerFileStorageService
{
    private readonly ILogger logger;
    private readonly HttpClient httpClient;
    private readonly ChordRing chordRing;
    public readonly MetadataService metadataService;
    private readonly string storagePath = "/app/storage/";

    public WorkerFileStorageService(
        HttpClient httpClient,
        ILogger<WorkerFileStorageService> logger,
        MetadataService metadataService)
    {
        this.httpClient = httpClient;
        this.logger = logger;
        this.chordRing = new ChordRing();
        this.metadataService = metadataService;

        if (!Directory.Exists(storagePath))
            Directory.CreateDirectory(storagePath);

        InitializeChordRing();
    }

    public ChordRing getChordRing()
    {
        return chordRing;
    }

    private void InitializeChordRing()
    {
        var nodeUrls = new[]
        {
            "http://worker1:5001",
            "http://worker2:5002",
            "http://worker3:5003",
            "http://worker4:5004",
            "http://worker5:5005"
        };

        foreach (var url in nodeUrls)
        {
            chordRing.AddNode(url);
            logger.LogInformation($"Добавлен узел в ChordRing: {url}");
        }

        chordRing.InitializeFingerTables();
    }

    public async Task SaveBlockAsync(string partName, IFormFile file)
    {
        var path = Path.Combine(storagePath, partName);
        using var stream = new FileStream(path, FileMode.Create);
        await file.CopyToAsync(stream);

        logger.LogInformation($"Блок {partName} сохранён локально.");
    }

    public async Task<Stream?> GetBlockAsync(string partName)
    {
        var path = Path.Combine(storagePath, partName);
        if (!File.Exists(path))
        {
            logger.LogWarning($"Файл {partName} не найден");
            return null;
        }

        return new FileStream(path, FileMode.Open, FileAccess.Read);
    }

    public bool DeleteBlock(string key)
    {
        var path = Path.Combine(storagePath, key);
        if (!File.Exists(path)) return false;

        try
        {
            File.Delete(path);
            logger.LogInformation($"Блок {key} успешно удалён");
            return true;
        }
        catch (Exception ex)
        {
            logger.LogError($"Ошибка при удалении блока {key}: {ex.Message}");
            return false;
        }
    }
    public bool HasBlock(string key)
    {
        return File.Exists(Path.Combine(storagePath, key));
    }
    public List<string> ListAllKeys()
    {
        var files = Directory.GetFiles(storagePath)
                             .Select(Path.GetFileName)
                             .Where(name => !string.IsNullOrEmpty(name))
                             .ToList();

        return files!;
    }
}
c#
  • 1 个回答
  • 35 Views
Martin Hope
HeAVeN
Asked: 2025-03-06 16:37:42 +0000 UTC

分布式系统中主节点与工作节点之间的连接错误

  • 4

我正在 ASP.NET 和 Docker 上建立一个分布式系统,计算给定范围内的素数。我有一个中央主节点和 3 个工作节点,我为它们提供了一些计算范围。我无法连接到他们。我遇到了连接错误。有什么问题?来自浏览器的日志:

Sending request: 
Object { start: "1", end: "500" }
​
end: "500"
​
start: "1"
​
<prototype>: Object { … }
index.html:27:21
Data: 
Object { error: "Internal Server Error", logs: (6) […] }
​
error: "Internal Server Error"
​
logs: Array(6) [ "Start processing request on master", "Received request: start=1, end=500", "Assigning worker 1: 1 - 167", … ]
​​
0: "Start processing request on master"
​​
1: "Received request: start=1, end=500"
​​
2: "Assigning worker 1: 1 - 167"
​​
3: "Assigning worker 2: 167 - 333"
​​
4: "Assigning worker 3: 333 - 500"
​​
5: "Error: System.Net.Http.HttpRequestException: Connection refused (worker1:8081)\n ---> System.Net.Sockets.SocketException (111): Connection refused\n   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)\n   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token)\n   at System.Net.Sockets.Socket.<ConnectAsync>g__WaitForConnectWithCancellation|285_0(AwaitableSocketAsyncEventArgs saea, ValueTask connectTask, CancellationToken cancellationToken)\n   at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken)\n   --- End of inner exception stack trace ---\n   at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken)\n   at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)\n   at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)\n   at System.Net.Http.HttpConnectionPool.AddHttp11ConnectionAsync(QueueItem queueItem)\n   at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationToken cancellationToken)\n   at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)\n   at System.Net.Http.DiagnosticsHandler.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)\n   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken)\n   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)\n   at Program.<<Main>$>g__SendToWorker|0_3(Int32 workerIndex, BigInteger start, BigInteger end) in /src/Program.cs:line 122\n   at Program.<>c.<<<Main>$>b__0_1>d.MoveNext() in /src/Program.cs:line 51"
​​
length: 6
​​
<prototype>: Array []
​
<prototype>: Object { … }
index.html:37:25
Uncaught (in promise) TypeError: data.Primes is undefined
    <anonymous> http://localhost:8080/index.html:38
index.html:38:32

​

index.html(位于 wwwroot 中):

<!DOCTYPE html>
<html lang="en">
<head>
    <meta charset="UTF-8">
    <meta name="viewport" content="width=device-width, initial-scale=1.0">
    <title>Prime Number Finder</title>
</head>
<body>
    <h1>Prime Number Finder</h1>
    <form id="primeForm">
        <label for="start">Start:</label>
        <input type="number" id="start" name="start" required>
        <label for="end">End:</label>
        <input type="number" id="end" name="end" required>
        <button type="submit">Find Primes</button>
    </form>

    <div id="result"></div>

    <script>
        document.getElementById('primeForm').addEventListener('submit', async function (event) {
            event.preventDefault();

            const start = parseInt(document.getElementById('start').value, 10);  // Преобразуем в число
            const end = parseInt(document.getElementById('end').value, 10);  // Преобразуем в число

            console.log("Sending request:", { start, end });  // Лог запроса

            const response = await fetch("/api/master/start", {
                method: "POST",
                headers: { "Content-Type": "application/json" },
                body: JSON.stringify({ start: start, end: end })  // Передаем числа, а не строки
            });

            if (response.ok) {
                const data = await response.json();
                console.log("Data:", data);
                const primes = data.Primes.join(', ');
                document.getElementById('result').innerText = 'Primes: ' + primes;
            } else {
                document.getElementById('result').innerText = 'Error retrieving primes.';
            }
        });

    </script>
</body>
</html>

Dockerfile:

FROM mcr.microsoft.com/dotnet/aspnet:8.0 AS base
WORKDIR /app
EXPOSE 80

FROM mcr.microsoft.com/dotnet/sdk:8.0 AS build
WORKDIR /src
COPY ["DistributedSystems_Lab1.csproj", ""]
RUN dotnet restore "./DistributedSystems_Lab1.csproj"
COPY . .
RUN dotnet publish "DistributedSystems_Lab1.csproj" -c Release -o /app/publish

FROM base AS final
WORKDIR /app
COPY --from=build /app/publish .
ENTRYPOINT ["dotnet", "DistributedSystems_Lab1.dll"]

Docker-compose.yml:

services:
  master:
    container_name: master
    image: my_app:latest
    environment:
      - ROLE=master
    ports:
      - "8080:8080"
    networks:
      - app_net
    deploy:
      replicas: 1
      restart_policy:
        condition: on-failure
    depends_on:
      - worker1
      - worker2
      - worker3

  worker1:
    container_name: worker1
    image: my_app:latest
    environment:
      - ROLE=worker
    networks:
      - app_net
    ports:
      - "8081:8080"  
    deploy:
      restart_policy:
        condition: on-failure

  worker2:
    container_name: worker2
    image: my_app:latest
    environment:
      - ROLE=worker
    networks:
      - app_net
    ports:
      - "8082:8080"  
    deploy:
      restart_policy:
        condition: on-failure

  worker3:
    container_name: worker3
    image: my_app:latest
    environment:
      - ROLE=worker
    networks:
      - app_net
    ports:
      - "8083:8080"  
    deploy:
      restart_policy:
        condition: on-failure

networks:
  app_net:
    driver: bridge

PrimalityTest.cs:

using System.Numerics;

namespace DistributedSystems_Lab1
{
    public static class PrimalityTest
    {
        // Проверка числа на простоту
        public static bool IsPrime(BigInteger number)
        {
            if (number < 2) return false;

            // Вычисление целочисленного квадратного корня числа
            BigInteger sqrt = Sqrt(number);
            for (BigInteger i = 2; i <= sqrt; i++)
            {
                if (number % i == 0) return false;
            }

            return true;
        }

        // Функция для вычисления целочисленного квадратного корня BigInteger
        public static BigInteger Sqrt(BigInteger value)
        {
            if (value < 0) throw new ArgumentException("value must be non-negative");

            BigInteger x = value;
            BigInteger y = (x + 1) / 2;

            // Итеративный метод Ньютона для приближения
            while (y < x)
            {
                x = y;
                y = (x + value / x) / 2;
            }

            return x;
        }
    }
}

PrimeCheckRequest.cs:

namespace DistributedSystems_Lab1
{
    public class PrimeCheckRequest
    {
        public BigInteger Start { get; set; }
        public BigInteger End { get; set; }
    }
}

PrimeCheckResponse.cs:

 namespace DistributedSystems_Lab1
{
    public class PrimeCheckResponse
    {
        public List<string> Primes { get; set; } = new();
    }
}

PrimeController.cs:

namespace DistributedSystems_Lab1
{
    using Microsoft.AspNetCore.Mvc;
    using System.Collections.Generic;
    using System.Numerics;

    [ApiController]
    [Route("api/[controller]")]
    public class PrimeController : ControllerBase
    {
        [HttpPost("check")]
        public ActionResult<PrimeCheckResponse> CheckPrimes([FromBody] PrimeCheckRequest request)
        {
            BigInteger start = BigInteger.Parse(request.Start);
            BigInteger end = BigInteger.Parse(request.End);
            List<string> primes = new();

            for (BigInteger i = start; i <= end; i++)
            {
                if (PrimalityTest.IsPrime(i))
                {
                    primes.Add(i.ToString());
                }
            }

            return new PrimeCheckResponse { Primes = primes };
        }
    }
}

程序.cs:

using DistributedSystems_Lab1;
using Microsoft.AspNetCore.Builder;
using Microsoft.AspNetCore.Http;
using Microsoft.Extensions.Hosting;
using System.Net.Http.Json;
using System.Numerics;
using System.Text.Json;

var builder = WebApplication.CreateBuilder(args);
var app = builder.Build();

string role = Environment.GetEnvironmentVariable("ROLE") ?? "worker";

if (role == "master")
{
    app.UseStaticFiles(); // Разрешает отдавать статические файлы
    app.MapGet("/", () => Results.Redirect("/index.html")); // Перенаправляем на страницу с формой

    // Эндпоинт для старта вычислений простых чисел
    app.MapPost("/api/master/start", async (HttpContext context) =>
    {
        List<string> logs = new();
        logs.Add("Start processing request on master");

        try
        {
            var request = await context.Request.ReadFromJsonAsync<PrimeCheckRequest>();
            if (request == null)
            {
                logs.Add("Invalid request received");
                return Results.Json(new { Error = "Invalid request", Logs = logs });
            }

            BigInteger start = request.Start;  // Теперь это уже BigInteger
            BigInteger end = request.End;

            int workerCount = 3;
            BigInteger step = (end - start) / workerCount;
            List<Task<(List<string> primes, List<string> workerLogs)>> tasks = new();

            logs.Add($"Received request: start={start}, end={end}");

            for (int i = 0; i < workerCount; i++)
            {
                BigInteger subStart = start + i * step;
                BigInteger subEnd = (i == workerCount - 1) ? end : subStart + step;

                logs.Add($"Assigning worker {i + 1}: {subStart} - {subEnd}");
                tasks.Add(SendToWorker(i, subStart, subEnd));
            }

            var results = await Task.WhenAll(tasks);
            var primes = results.SelectMany(x => x.primes).ToList();
            logs.AddRange(results.SelectMany(x => x.workerLogs));

            logs.Add("End processing request on master");
            return Results.Json(new { Primes = primes, Logs = logs });
        }
        catch (Exception ex)
        {
            logs.Add($"Error: {ex}");
            return Results.Json(new { Error = "Internal Server Error", Logs = logs });
        }
    });


}
else
{
    // Эндпоинт для обработки вычислений простых чисел на воркере
    app.MapPost("/api/worker/check", async (HttpContext context) =>
    {
        List<string> logs = new();
        logs.Add("Worker processing started");

        var request = await context.Request.ReadFromJsonAsync<PrimeCheckRequest>();
        if (request == null)
        {
            logs.Add("Invalid request received");
            logs.Add("Worker processing finished with error");
            return Results.Json(new { Error = "Invalid request", Logs = logs });
        }

        BigInteger start = BigInteger.Parse(request.Start.ToString());
        BigInteger end = BigInteger.Parse(request.End.ToString());
        List<string> primes = new();

        logs.Add($"Worker received: start={start}, end={end}");

        for (BigInteger i = start; i <= end; i++)
        {
            if (PrimalityTest.IsPrime(i))
            {
                primes.Add(i.ToString());
            }
        }

        logs.Add($"Worker found primes: {string.Join(", ", primes)}");
        logs.Add("Worker processing finished");

        return Results.Json(new { Primes = primes, Logs = logs });
    });

}

app.Run();

// Отправка задания на воркер
static async Task<(List<string> primes, List<string> workerLogs)> SendToWorker(int workerIndex, BigInteger start, BigInteger end)
{
    using var client = new HttpClient();
    var workerUrls = new[]
    {
        "http://worker1:8081",
        "http://worker2:8082",
        "http://worker3:8083"
    };

    List<string> logs = new();
    string workerUrl = workerUrls[workerIndex % workerUrls.Length];

    logs.Add($"Start sending request to {workerUrl}: start={start}, end={end}");

    var response = await client.PostAsJsonAsync($"{workerUrl}/api/worker/check", new PrimeCheckRequest
    {
        Start = start,
        End = end
    });

    if (!response.IsSuccessStatusCode)
    {
        logs.Add($"Worker request failed: {response.StatusCode}");
        logs.Add($"End sending request to {workerUrl}");
        return (new List<string>(), logs);
    }

    var result = await response.Content.ReadFromJsonAsync<PrimeCheckResponse>();
    logs.Add($"Worker {workerUrl} returned: {string.Join(", ", result?.Primes ?? new List<string>())}");
    logs.Add($"End sending request to {workerUrl}");

    return (result?.Primes ?? new List<string>(), logs);
}
c#
  • 1 个回答
  • 43 Views

Sidebar

Stats

  • 问题 10021
  • Answers 30001
  • 最佳答案 8000
  • 用户 6900
  • 常问
  • 回答
  • Marko Smith

    我看不懂措辞

    • 1 个回答
  • Marko Smith

    请求的模块“del”不提供名为“default”的导出

    • 3 个回答
  • Marko Smith

    "!+tab" 在 HTML 的 vs 代码中不起作用

    • 5 个回答
  • Marko Smith

    我正在尝试解决“猜词”的问题。Python

    • 2 个回答
  • Marko Smith

    可以使用哪些命令将当前指针移动到指定的提交而不更改工作目录中的文件?

    • 1 个回答
  • Marko Smith

    Python解析野莓

    • 1 个回答
  • Marko Smith

    问题:“警告:检查最新版本的 pip 时出错。”

    • 2 个回答
  • Marko Smith

    帮助编写一个用值填充变量的循环。解决这个问题

    • 2 个回答
  • Marko Smith

    尽管依赖数组为空,但在渲染上调用了 2 次 useEffect

    • 2 个回答
  • Marko Smith

    数据不通过 Telegram.WebApp.sendData 发送

    • 1 个回答
  • Martin Hope
    Alexandr_TT 2020年新年大赛! 2020-12-20 18:20:21 +0000 UTC
  • Martin Hope
    Alexandr_TT 圣诞树动画 2020-12-23 00:38:08 +0000 UTC
  • Martin Hope
    Air 究竟是什么标识了网站访问者? 2020-11-03 15:49:20 +0000 UTC
  • Martin Hope
    Qwertiy 号码显示 9223372036854775807 2020-07-11 18:16:49 +0000 UTC
  • Martin Hope
    user216109 如何为黑客设下陷阱,或充分击退攻击? 2020-05-10 02:22:52 +0000 UTC
  • Martin Hope
    Qwertiy 并变成3个无穷大 2020-11-06 07:15:57 +0000 UTC
  • Martin Hope
    koks_rs 什么是样板代码? 2020-10-27 15:43:19 +0000 UTC
  • Martin Hope
    Sirop4ik 向 git 提交发布的正确方法是什么? 2020-10-05 00:02:00 +0000 UTC
  • Martin Hope
    faoxis 为什么在这么多示例中函数都称为 foo? 2020-08-15 04:42:49 +0000 UTC
  • Martin Hope
    Pavel Mayorov 如何从事件或回调函数中返回值?或者至少等他们完成。 2020-08-11 16:49:28 +0000 UTC

热门标签

javascript python java php c# c++ html android jquery mysql

Explore

  • 主页
  • 问题
    • 热门问题
    • 最新问题
  • 标签
  • 帮助

Footer

RError.com

关于我们

  • 关于我们
  • 联系我们

Legal Stuff

  • Privacy Policy

帮助

© 2023 RError.com All Rights Reserve   沪ICP备12040472号-5