RError.com

RError.com Logo RError.com Logo

RError.com Navigation

  • 主页

Mobile menu

Close
  • 主页
  • 系统&网络
    • 热门问题
    • 最新问题
    • 标签
  • Ubuntu
    • 热门问题
    • 最新问题
    • 标签
  • 帮助
主页 / 问题 / 1141475
Accepted
BERTOLDO
BERTOLDO
Asked:2020-06-16 03:56:51 +0000 UTC2020-06-16 03:56:51 +0000 UTC 2020-06-16 03:56:51 +0000 UTC

如何从awk中的字段中提取特定片段?

  • 772

有一个名为 PROXY.1.log 的日志文件,需要确定 10 个服务器($7 字段中的服务器名称)从中接收到的信息量最大($5 字段中的信息量)

服务器名称有时会重复,因此您需要确定每个服务器的信息总量,然后显示信息最多的 10 个服务器。

代理服务器的log-a文件条目的结构:

965332284.687 126107 10.1.6.0 TCP_MISS/503 1061 GET ftp://ftp.ruhr-uni-bochum.de/.subdisc3/local/winnt/2000/fixes/usa/sp1/sp1network.exe alex DIRECT/ftp.ruhr-uni-bochum.de -
965332324.957 126090 10.1.6.0 TCP_MISS/503 1033 GET ftp://ftp.ism.ru/pub/drivers/software/microsoft/win2000/sp1network.exe alex DIRECT/ftp.ism.ru -
965332336.987 129098 10.1.6.0 TCP_MISS/503 1033 GET ftp://ftp.ism.ru/pub/drivers/software/microsoft/win2000/sp1network.exe alex DIRECT/ftp.ism.ru -
965332348.015 239306 10.1.6.0 TCP_MISS/504 1066 GET http://mschus.www.conxion.com/download/win2000platform/sp/sp1/nt5/en-us/sp1network.exe alex DIRECT/mschus.www.conxion.com -
965332373.817 123096 10.1.6.0 TCP_MISS/503 1033 GET ftp://ftp.ism.ru/pub/drivers/software/microsoft/win2000/sp1network.exe alex DIRECT/ftp.ism.ru -
965332377.837 129099 10.1.6.0 TCP_MISS/503 1033 GET ftp://ftp.ism.ru/pub/drivers/software/microsoft/win2000/sp1network.exe alex DIRECT/ftp.ism.ru -
965332411.365 237443 10.1.6.0 TCP_MISS/504 1048 GET ftp://ftp.darmstadt.gmd.de/pub/pc/Win2k/microsoft/fixes/sp1/en/sp1network.exe alex DIRECT/ftp.darmstadt.gmd.de -
965332439.117 150093 10.1.6.0 TCP_MISS/503 1065 GET http://mschus.www.conxion.com/download/win2000platform/sp/sp1/nt5/en-us/sp1network.exe alex DIRECT/mschus.www.conxion.com -
965332470.987 132093 10.1.6.0 TCP_MISS/503 1065 GET http://mschus.www.conxion.com/download/win2000platform/sp/sp1/nt5/en-us/sp1network.exe alex DIRECT/mschus.www.conxion.com -
965332472.967 132089 10.1.6.0 TCP_MISS/503 1065 GET http://mschus.www.conxion.com/download/win2000platform/sp/sp1/nt5/en-us/sp1network.exe alex DIRECT/mschus.www.conxion.com -
965332483.137 219058 10.1.6.0 TCP_MISS/503 1033 GET ftp://ftp.ism.ru/pub/drivers/software/microsoft/win2000/sp1network.exe alex DIRECT/ftp.ism.ru -
965332490.137 192090 10.1.6.0 TCP_MISS/503 1065 GET http://mschus.www.conxion.com/download/win2000platform/sp/sp1/nt5/en-us/sp1network.exe alex DIRECT/mschus.www.conxion.com -
965332514.167 125964 10.1.6.0 TCP_MISS/503 1061 GET ftp://ftp.ruhr-uni-bochum.de/.subdisc3/local/winnt/2000/fixes/usa/sp1/sp1network.exe alex DIRECT/ftp.ruhr-uni-bochum.de -
965332528.157 173922 10.1.6.0 TCP_MISS/503 1065 GET http://mschus.www.conxion.com/download/win2000platform/sp/sp1/nt5/en-us/sp1network.exe alex DIRECT/mschus.www.conxion.com -
965332532.458 153276 10.1.6.0 TCP_MISS/503 1039 GET ftp://ftp.hu-berlin.de/pub/windows/fixes/w2000/sp1/english/sp1network.exe alex DIRECT/ftp.hu-berlin.de -
965332554.127 123093 10.1.6.0 TCP_MISS/503 1033 GET ftp://ftp.ism.ru/pub/drivers/software/microsoft/win2000/sp1network.exe alex DIRECT/ftp.ism.ru -
965332555.157 126095 10.1.6.0 TCP_MISS/503 1033 GET ftp://ftp.ism.ru/pub/drivers/software/microsoft/win2000/sp1network.exe alex DIRECT/ftp.ism.ru -
965332588.327 143873 10.1.6.0 TCP_MISS/504 1034 GET ftp://ftp.ism.ru/pub/drivers/software/microsoft/win2000/sp1network.exe alex DIRECT/ftp.ism.ru -
965332592.437 123099 10.1.6.0 TCP_MISS/503 1033 GET ftp://ftp.ism.ru/pub/drivers/software/microsoft/win2000/sp1network.exe alex DIRECT/ftp.ism.ru -
965332607.457 129096 10.1.6.0 TCP_MISS/503 1033 GET ftp://ftp.ism.ru/pub/drivers/software/microsoft/win2000/sp1network.exe alex DIRECT/ftp.ism.ru -
965332651.327 132098 10.1.6.0 TCP_MISS/503 1065 GET http://mschus.www.conxion.com/download/win2000platform/sp/sp1/nt5/en-us/sp1network.exe alex DIRECT/mschus.www.conxion.com -
965332653.297 132095 10.1.6.0 TCP_MISS/503 1065 GET http://mschus.www.conxion.com/download/win2000platform/sp/sp1/nt5/en-us/sp1network.exe alex DIRECT/mschus.www.conxion.com -
965332706.337 146843 10.1.6.0 TCP_MISS/503 1065 GET http://mschus.www.conxion.com/download/win2000platform/sp/sp1/nt5/en-us/sp1network.exe alex DIRECT/mschus.www.conxion.com -
965332714.477 179843 10.1.6.0 TCP_MISS/503 1065 GET http://mschus.www.conxion.com/download/win2000platform/sp/sp1/nt5/en-us/sp1network.exe alex DIRECT/mschus.www.conxion.com -
965332734.467 123099 10.1.6.0 TCP_MISS/503 1047 GET ftp://ftp.darmstadt.gmd.de/pub/pc/Win2k/microsoft/fixes/sp1/en/sp1network.exe alex DIRECT/ftp.darmstadt.gmd.de -
965332735.477 126090 10.1.6.0 TCP_MISS/503 1039 GET ftp://ftp.mathematik.uni-marburg.de/pub/mirror/w2ksp/en-us/sp1network.exe alex DIRECT/ftp.mathematik.uni-marburg.de -
965332760.215 191697 10.1.6.0 TCP_MISS/504 1066 GET http://mschus.www.conxion.com/download/win2000platform/sp/sp1/nt5/en-us/sp1network.exe alex DIRECT/mschus.www.conxion.com -
965332775.457 125723 10.1.6.0 TCP_MISS/503 1033 GET ftp://ftp.ism.ru/pub/drivers/software/microsoft/win2000/sp1network.exe alex DIRECT/ftp.ism.ru -
965332784.647 125972 10.1.6.0 TCP_MISS/503 1033 GET ftp://ftp.ism.ru/pub/drivers/software/microsoft/win2000/sp1network.exe alex DIRECT/ftp.ism.ru -
965332822.637 123042 10.1.6.0 TCP_MISS/503 1033 GET ftp://ftp.ism.ru/pub/drivers/software/microsoft/win2000/sp1network.exe alex DIRECT/ftp.ism.ru -
965332824.627 123101 10.1.6.0 TCP_MISS/503 1033 GET ftp://ftp.ism.ru/pub/drivers/software/microsoft/win2000/sp1network.exe alex DIRECT/ftp.ism.ru -
965332855.798 140926 10.1.6.0 TCP_MISS/503 1033 GET ftp://ftp.ism.ru/pub/drivers/software/microsoft/win2000/sp1network.exe alex DIRECT/ftp.ism.ru -
965332862.907 123097 10.1.6.0 TCP_MISS/503 1065 GET http://mschus.www.conxion.com/download/win2000platform/sp/sp1/nt5/en-us/sp1network.exe alex DIRECT/mschus.www.conxion.com -
965332864.135 239427 10.1.6.0 TCP_MISS/504 1040 GET ftp://ftp.hu-berlin.de/pub/windows/fixes/w2000/sp1/english/sp1network.exe alex DIRECT/ftp.hu-berlin.de -
965332895.307 146475 10.1.6.0 TCP_MISS/503 1065 GET http://mschus.www.conxion.com/download/win2000platform/sp/sp1/nt5/en-us/sp1network.exe alex DIRECT/mschus.www.conxion.com -
965332923.787 132098 10.1.6.0 TCP_MISS/503 1065 GET http://mschus.www.conxion.com/download/win2000platform/sp/sp1/nt5/en-us/sp1network.exe alex DIRECT/mschus.www.conxion.com -
965332933.797 144096 10.1.6.0 TCP_MISS/503 1065 GET http://mschus.www.conxion.com/download/win2000platform/sp/sp1/nt5/en-us/sp1network.exe alex DIRECT/mschus.www.conxion.com -
965332953.057 123091 10.1.6.0 TCP_MISS/503 1061 GET ftp://ftp.ruhr-uni-bochum.de/.subdisc3/local/winnt/2000/fixes/usa/sp1/sp1network.exe alex DIRECT/ftp.ruhr-uni-bochum.de -
965333004.947 123096 10.1.6.0 TCP_MISS/503 1033 GET ftp://ftp.ism.ru/pub/drivers/software/microsoft/win2000/sp1network.exe alex DIRECT/ftp.ism.ru -
965333005.947 126089 10.1.6.0 TCP_MISS/503 1033 GET ftp://ftp.ism.ru/pub/drivers/software/microsoft/win2000/sp1network.exe alex DIRECT/ftp.ism.ru -
965333015.078 176088 10.1.6.0 TCP_MISS/503 1039 GET ftp://ftp.mathematik.uni-marburg.de/pub/mirror/w2ksp/en-us/sp1network.exe alex DIRECT/ftp.mathematik.uni-marburg.de -
965333021.078 216044 10.1.6.0 TCP_MISS/503 1065 GET http://mschus.www.conxion.com/download/win2000platform/sp/sp1/nt5/en-us/sp1network.exe alex DIRECT/mschus.www.conxion.com -
965333030.077 134888 10.1.6.0 TCP_MISS/503 1033 GET ftp://ftp.ism.ru/pub/drivers/software/microsoft/win2000/sp1network.exe alex DIRECT/ftp.ism.ru -
965333043.217 123092 10.1.6.0 TCP_MISS/503 1033 GET ftp://ftp.ism.ru/pub/drivers/software/microsoft/win2000/sp1network.exe alex DIRECT/ftp.ism.ru -
965333055.167 125943 10.1.6.0 TCP_MISS/503 1033 GET ftp://ftp.ism.ru/pub/drivers/software/microsoft/win2000/sp1network.exe alex DIRECT/ftp.ism.ru -
965333104.097 132089 10.1.6.0 TCP_MISS/503 1065 GET http://mschus.www.conxion.com/download/win2000platform/sp/sp1/nt5/en-us/sp1network.exe alex DIRECT/mschus.www.conxion.com -
965333132.057 146711 10.1.6.0 TCP_MISS/503 1065 GET http://mschus.www.conxion.com/download/win2000platform/sp/sp1/nt5/en-us/sp1network.exe alex DIRECT/mschus.www.conxion.com -
965333157.207 146925 10.1.6.0 TCP_MISS/503 1065 GET http://mschus.www.conxion.com/download/win2000platform/sp/sp1/nt5/en-us/sp1network.exe alex DIRECT/mschus.www.conxion.com -
965333162.107 192030 10.1.6.0 TCP_MISS/503 1065 GET http://mschus.www.conxion.com/download/win2000platform/sp/sp1/nt5/en-us/sp1network.exe alex DIRECT/mschus.www.conxion.com -
965333185.257 123091 10.1.6.0 TCP_MISS/503 1039 GET ftp://ftp.hu-berlin.de/pub/windows/fixes/w2000/sp1/english/sp1network.exe alex DIRECT/ftp.hu-berlin.de -
965333201.428 141255 10.1.6.0 TCP_MISS/503 1047 GET ftp://ftp.darmstadt.gmd.de/pub/pc/Win2k/microsoft/fixes/sp1/en/sp1network.exe alex DIRECT/ftp.darmstadt.gmd.de -
965333211.397 192092 10.1.6.0 TCP_MISS/503 1065 GET http://mschus.www.conxion.com/download/win2000platform/sp/sp1/nt5/en-us/sp1network.exe alex DIRECT/mschus.www.conxion.com -
965333226.557 126062 10.1.6.0 TCP_MISS/503 1033 GET ftp://ftp.ism.ru/pub/drivers/software/microsoft/win2000/sp1network.exe alex DIRECT/ftp.ism.ru -
965333264.427 188923 10.1.6.0 TCP_MISS/504 1062 GET ftp://ftp.ruhr-uni-bochum.de/.subdisc3/local/winnt/2000/fixes/usa/sp1/sp1network.exe alex DIRECT/ftp.ruhr-uni-bochum.de -
965333279.428 129098 10.1.6.0 TCP_MISS/503 1033 GET ftp://ftp.ism.ru/pub/drivers/software/microsoft/win2000/sp1network.exe alex DIRECT/ftp.ism.ru -
965333281.417 129095 10.1.6.0 TCP_MISS/503 1033 GET ftp://ftp.ism.ru/pub/drivers/software/microsoft/win2000/sp1network.exe alex DIRECT/ftp.ism.ru -
965333291.517 125857 10.1.6.0 TCP_MISS/503 1033 GET ftp://ftp.ism.ru/pub/drivers/software/microsoft/win2000/sp1network.exe alex DIRECT/ftp.ism.ru -

$1 - 请求时间;

$5 是以字节为单位传输的数据量;

$6 - 请求类型;

$7 - 请求的资源;

$8 - 用户名;

这是代码本身:

function idx_of_max(a) {
i_max = 0;
for (i in a) {
    if (a[i] > a[i_max]) {
        i_max = i;
    }
}
return i_max;
}

{
    servers[$7] += $5;
}

END {
for (n = 1; n <= 10; n++) {
        srv = idx_of_max(servers);
        if (!srv) {
           break;
        }
        print n ": " srv " = " servers[srv];
        delete servers[srv];
    }
}

这是发生的事情

这里的问题是:有 必要指定服务器的名称。

也就是说,结果应该是这样的: 在此处输入图像描述

怎么做?

linux
  • 2 2 个回答
  • 10 Views

2 个回答

  • Voted
  1. Best Answer
    Ainar-G
    2020-06-16T05:15:26Z2020-06-16T05:15:26Z

    使用功能sub:

    {
        sub(/^[a-z]+:\/\//, "", $7);
        sub(/\/.*$/, "", $7);
        servers[$7] += $5;
    }
    
    • 3
  2. MiniMax
    2020-06-17T06:51:50Z2020-06-17T06:51:50Z

    你gawk可以像这样解决你的问题:

    gawk '
    {
        split($7, server, "/")          # Разбиваем URL по "/" символу
        server_name = server[3]         # Доменное имя должно в ячейке №3
    
        servers[server_name] += $5
    }
    END {
        # Устанавливаем порядок выдачи элементов массива циклом "for in"
        # "@val_num_desc" расшифровывается как:
        # val   = value 
        # num   = number 
        # desc  = descended
        # То есть - сортируй по значениям (а не по индексам) в убывающем порядке,
        # сравнивая значения как числа
        PROCINFO["sorted_in"] = "@val_num_desc"
        
        for (srv in servers) {
            printf("%d: %s = %d\n", ++num, srv, servers[srv])
            if (num >= 10)
                break
        }
    }' input.txt
    

    输出(用于问题的样本数据)

    1: ftp.ism.ru = 15496
    2: mschus.www.conxion.com = 12782
    3: ftp.ruhr-uni-bochum.de = 2122
    4: ftp.darmstadt.gmd.de = 2095
    5: ftp.hu-berlin.de = 2079
    6: ftp.mathematik.uni-marburg.de = 1039
    
    • 0

相关问题

  • 如果 fuser -k number/tcp 没有帮助,如何在 Debian 中释放端口?

  • Ubuntu。startx 不起作用。黑屏

  • --syn 在 iptables 中有什么作用?

  • 为什么需要iso格式?

  • C程序中没有密码的sudo

Sidebar

Stats

  • 问题 10021
  • Answers 30001
  • 最佳答案 8000
  • 用户 6900
  • 常问
  • 回答
  • Marko Smith

    如何从列表中打印最大元素(str 类型)的长度?

    • 2 个回答
  • Marko Smith

    如何在 PyQT5 中清除 QFrame 的内容

    • 1 个回答
  • Marko Smith

    如何将具有特定字符的字符串拆分为两个不同的列表?

    • 2 个回答
  • Marko Smith

    导航栏活动元素

    • 1 个回答
  • Marko Smith

    是否可以将文本放入数组中?[关闭]

    • 1 个回答
  • Marko Smith

    如何一次用多个分隔符拆分字符串?

    • 1 个回答
  • Marko Smith

    如何通过 ClassPath 创建 InputStream?

    • 2 个回答
  • Marko Smith

    在一个查询中连接多个表

    • 1 个回答
  • Marko Smith

    对列表列表中的所有值求和

    • 3 个回答
  • Marko Smith

    如何对齐 string.Format 中的列?

    • 1 个回答
  • Martin Hope
    Alexandr_TT 2020年新年大赛! 2020-12-20 18:20:21 +0000 UTC
  • Martin Hope
    Alexandr_TT 圣诞树动画 2020-12-23 00:38:08 +0000 UTC
  • Martin Hope
    Air 究竟是什么标识了网站访问者? 2020-11-03 15:49:20 +0000 UTC
  • Martin Hope
    Qwertiy 号码显示 9223372036854775807 2020-07-11 18:16:49 +0000 UTC
  • Martin Hope
    user216109 如何为黑客设下陷阱,或充分击退攻击? 2020-05-10 02:22:52 +0000 UTC
  • Martin Hope
    Qwertiy 并变成3个无穷大 2020-11-06 07:15:57 +0000 UTC
  • Martin Hope
    koks_rs 什么是样板代码? 2020-10-27 15:43:19 +0000 UTC
  • Martin Hope
    Sirop4ik 向 git 提交发布的正确方法是什么? 2020-10-05 00:02:00 +0000 UTC
  • Martin Hope
    faoxis 为什么在这么多示例中函数都称为 foo? 2020-08-15 04:42:49 +0000 UTC
  • Martin Hope
    Pavel Mayorov 如何从事件或回调函数中返回值?或者至少等他们完成。 2020-08-11 16:49:28 +0000 UTC

热门标签

javascript python java php c# c++ html android jquery mysql

Explore

  • 主页
  • 问题
    • 热门问题
    • 最新问题
  • 标签
  • 帮助

Footer

RError.com

关于我们

  • 关于我们
  • 联系我们

Legal Stuff

  • Privacy Policy

帮助

© 2023 RError.com All Rights Reserve   沪ICP备12040472号-5