Lupinhos Home

Willkommen Gast Infos ein-/ausblenden
Willkommen Gast! Um Beiträge zu verfassen musst Du registriert sein. Benutzername: Passwort: An mich erinnern

Forum » HardlinkBackup - Deutsch » Allgemeine Diskussion » Geschwindigkeit

Seiten: Erster << 3 4 5 [6] 7 8

Autor	Thema:Geschwindigkeit

dstockm

Anfänger
Beiträge: 31
Permalink

Re: Geschwindigkeit am January 13, 2018, 03:02
Zitat

Hier meine Ergebnisse.
Jeweils
intern: ohne, mit MD5 und SHA256 (Core i5-4570 von HDD auf SSD)
LAN: ohne, mit MD5 und SHA256 (Pentium G4600 mit HDD)

Warum ist der Geschwindigkeitsunterschied zwischen intern und LAN bei SHA256 so deutlich?
Als würden sich die limitierenden Faktoren ergänzen. Die 125 MB/s SHA256 intern müssten mein LAN doch vollkommen ausreizen können.

(Ich habe intern auch umgekehrt getestet SSD-->HDD, macht aber kaum einen Unterschied, wenn man die geringere max. Schreibleistung der HDD berücksichtigt).

C:\Users\Dirk\Downloads\SpeedTest>speedtest.exe Z:\ Y:\ 2GB
SpeedTest Version 3.0.0 (Build 11)
[02:16:40.42] INF: Running test with a 2,00 GB random file at Z:\, copied to Y:\
[02:16:40.44] INF: Create a big random file of 2,00 GB
[02:16:59.99] INF: Big file created in 19 Sekunden (104,85 MB/s)
[02:16:59.99] INF: Copy file "Z:\gguworhz.zz5" to "Y:\" - using File.Copy (first time)
[02:17:12.52] INF: File copied with File.Copy in 12 Sekunden (163,51 MB/s)
[02:17:12.83] INF: Copy file "Z:\gguworhz.zz5" to "Y:\" - using File.Copy (second time - this counts!)
[02:17:17.05] INF: File copied with File.Copy in 04.212 Sekunden (486,21 MB/s)
[02:17:17.33] INF: Copy file "Z:\gguworhz.zz5" to "Y:\" - using CopyFileCore, 64,0 KB buffer
[02:17:23.27] INF: File copied in 05.929 Sekunden (345,38 MB/s)
[02:17:23.27] INF: Copy file "Z:\gguworhz.zz5" to "Y:\" - using CopyFileCore, 80,0 KB buffer
[02:17:42.49] INF: File copied in 19 Sekunden (106,56 MB/s)
[02:17:42.49] INF: Copy file "Z:\gguworhz.zz5" to "Y:\" - using CopyFileCore, 128 KB buffer
[02:18:01.20] INF: File copied in 18 Sekunden (109,46 MB/s)
[02:18:01.20] INF: Copy file "Z:\gguworhz.zz5" to "Y:\" - using CopyFileCore, 256 KB buffer
[02:18:20.09] INF: File copied in 18 Sekunden (108,41 MB/s)
[02:18:20.09] INF: Copy file "Z:\gguworhz.zz5" to "Y:\" - using CopyFileCore, 2,00 MB buffer
[02:18:38.63] INF: File copied in 18 Sekunden (110,57 MB/s)
[02:18:38.63] INF: Copy file "Z:\gguworhz.zz5" to "Y:\" - using CopyFileCore, 8,00 MB buffer
[02:18:57.13] INF: File copied in 18 Sekunden (110,67 MB/s)
[02:18:57.13] INF: Copy file "Z:\gguworhz.zz5" to "Y:\" - using CopyFileCore, 16,0 MB buffer
[02:19:19.57] INF: File copied in 22 Sekunden (91,21 MB/s)
[02:19:19.76] WRN: Best result is 71,03 % of File.Copy with 345,38 MB/s and 64,0 KB buffer size

C:\Users\Dirk\Downloads\SpeedTest>speedtest.exe Z:\ Y:\ 2GB MD5
SpeedTest Version 3.0.0 (Build 11)
[02:45:13.80] INF: Running test with a 2,00 GB random file at Z:\, copied to Y:\ using hash algorithm MD5
[02:45:13.81] INF: Create a big random file of 2,00 GB
[02:45:33.38] INF: Big file created in 19 Sekunden (105,11 MB/s)
[02:45:33.38] INF: Copy file "Z:\hkrhxndl.os2" to "Y:\" - using File.Copy (first time)
[02:45:36.78] INF: File copied with File.Copy in 03.401 Sekunden (602,15 MB/s)
[02:45:37.07] INF: Copy file "Z:\hkrhxndl.os2" to "Y:\" - using File.Copy (second time - this counts!)
[02:45:41.75] INF: File copied with File.Copy in 04.678 Sekunden (437,72 MB/s)
[02:45:42.03] INF: Copy file "Z:\hkrhxndl.os2" to "Y:\" - using CopyFileCore, 64,0 KB buffer, hash MD5
[02:45:51.52] INF: File copied in 9 Sekunden (215,79 MB/s), hash="F5E7FEF4BBC6593E5C6AAFC5F3EF1D51"
[02:45:51.52] INF: Copy file "Z:\hkrhxndl.os2" to "Y:\" - using CopyFileCore, 80,0 KB buffer, hash MD5
[02:46:10.58] INF: File copied in 19 Sekunden (107,41 MB/s), hash="F5E7FEF4BBC6593E5C6AAFC5F3EF1D51"
[02:46:10.58] INF: Copy file "Z:\hkrhxndl.os2" to "Y:\" - using CopyFileCore, 128 KB buffer, hash MD5
[02:46:29.20] INF: File copied in 18 Sekunden (110,10 MB/s), hash="F5E7FEF4BBC6593E5C6AAFC5F3EF1D51"
[02:46:29.20] INF: Copy file "Z:\hkrhxndl.os2" to "Y:\" - using CopyFileCore, 256 KB buffer, hash MD5
[02:46:47.70] INF: File copied in 18 Sekunden (110,69 MB/s), hash="F5E7FEF4BBC6593E5C6AAFC5F3EF1D51"
[02:46:47.70] INF: Copy file "Z:\hkrhxndl.os2" to "Y:\" - using CopyFileCore, 2,00 MB buffer, hash MD5
[02:47:06.48] INF: File copied in 18 Sekunden (108,96 MB/s), hash="F5E7FEF4BBC6593E5C6AAFC5F3EF1D51"
[02:47:06.48] INF: Copy file "Z:\hkrhxndl.os2" to "Y:\" - using CopyFileCore, 8,00 MB buffer, hash MD5
[02:47:24.95] INF: File copied in 18 Sekunden (110,95 MB/s), hash="F5E7FEF4BBC6593E5C6AAFC5F3EF1D51"
[02:47:24.95] INF: Copy file "Z:\hkrhxndl.os2" to "Y:\" - using CopyFileCore, 16,0 MB buffer, hash MD5
[02:47:43.40] INF: File copied in 18 Sekunden (110,98 MB/s), hash="F5E7FEF4BBC6593E5C6AAFC5F3EF1D51"
[02:47:43.59] WRN: Best result is 49,30 % of File.Copy with 215,79 MB/s and 64,0 KB buffer size

C:\Users\Dirk\Downloads\SpeedTest>speedtest.exe Z:\ Y:\ 2GB SHA256
SpeedTest Version 3.0.0 (Build 11)
[02:19:53.56] INF: Running test with a 2,00 GB random file at Z:\, copied to Y:\ using hash algorithm SHA256
[02:19:53.58] INF: Create a big random file of 2,00 GB
[02:20:13.28] INF: Big file created in 19 Sekunden (104,26 MB/s)
[02:20:13.30] INF: Copy file "Z:\u4t1jyo3.od0" to "Y:\" - using File.Copy (first time)
[02:20:16.83] INF: File copied with File.Copy in 03.537 Sekunden (578,91 MB/s)
[02:20:17.14] INF: Copy file "Z:\u4t1jyo3.od0" to "Y:\" - using File.Copy (second time - this counts!)
[02:20:21.12] INF: File copied with File.Copy in 03.972 Sekunden (515,49 MB/s)
[02:20:21.42] INF: Copy file "Z:\u4t1jyo3.od0" to "Y:\" - using CopyFileCore, 64,0 KB buffer, hash SHA256
[02:20:37.75] INF: File copied in 16 Sekunden (125,48 MB/s), hash="8B4C17235CD70FA68204ADE29591A225E344BC692314822E50AD8E436436F13E"
[02:20:37.75] INF: Copy file "Z:\u4t1jyo3.od0" to "Y:\" - using CopyFileCore, 80,0 KB buffer, hash SHA256
[02:20:58.30] INF: File copied in 20 Sekunden (99,71 MB/s), hash="8B4C17235CD70FA68204ADE29591A225E344BC692314822E50AD8E436436F13E"
[02:20:58.30] INF: Copy file "Z:\u4t1jyo3.od0" to "Y:\" - using CopyFileCore, 128 KB buffer, hash SHA256
[02:21:17.30] INF: File copied in 19 Sekunden (107,71 MB/s), hash="8B4C17235CD70FA68204ADE29591A225E344BC692314822E50AD8E436436F13E"
[02:21:17.31] INF: Copy file "Z:\u4t1jyo3.od0" to "Y:\" - using CopyFileCore, 256 KB buffer, hash SHA256
[02:21:36.36] INF: File copied in 19 Sekunden (107,50 MB/s), hash="8B4C17235CD70FA68204ADE29591A225E344BC692314822E50AD8E436436F13E"
[02:21:36.36] INF: Copy file "Z:\u4t1jyo3.od0" to "Y:\" - using CopyFileCore, 2,00 MB buffer, hash SHA256
[02:21:55.08] INF: File copied in 18 Sekunden (109,41 MB/s), hash="8B4C17235CD70FA68204ADE29591A225E344BC692314822E50AD8E436436F13E"
[02:21:55.08] INF: Copy file "Z:\u4t1jyo3.od0" to "Y:\" - using CopyFileCore, 8,00 MB buffer, hash SHA256
[02:22:14.18] INF: File copied in 19 Sekunden (107,22 MB/s), hash="8B4C17235CD70FA68204ADE29591A225E344BC692314822E50AD8E436436F13E"
[02:22:14.18] INF: Copy file "Z:\u4t1jyo3.od0" to "Y:\" - using CopyFileCore, 16,0 MB buffer, hash SHA256
[02:22:33.70] INF: File copied in 19 Sekunden (104,91 MB/s), hash="8B4C17235CD70FA68204ADE29591A225E344BC692314822E50AD8E436436F13E"
[02:22:33.88] WRN: Best result is 24,34 % of File.Copy with 125,48 MB/s and 64,0 KB buffer size

C:\Users\Dirk\Downloads\SpeedTest>speedtest.exe Z:\ \\NAS\Daten\ 2GB
SpeedTest Version 3.0.0 (Build 11)
[01:58:56.88] INF: Running test with a 2,00 GB random file at Z:\, copied to \\NAS\Daten\
[01:58:56.88] INF: Create a big random file of 2,00 GB
[01:59:16.51] INF: Big file created in 19 Sekunden (104,73 MB/s)
[01:59:16.51] INF: Copy file "Z:\0h1mx0yn.oqi" to "\\NAS\Daten\" - using File.Copy (first time)
[01:59:44.45] INF: File copied with File.Copy in 27 Sekunden (73,32 MB/s)
[01:59:44.73] INF: Copy file "Z:\0h1mx0yn.oqi" to "\\NAS\Daten\" - using File.Copy (second time - this counts!)
[02:00:03.00] INF: File copied with File.Copy in 18 Sekunden (112,12 MB/s)
[02:00:03.17] INF: Copy file "Z:\0h1mx0yn.oqi" to "\\NAS\Daten\" - using CopyFileCore, 64,0 KB buffer
[02:00:59.01] INF: File copied in 55 Sekunden (36,68 MB/s)
[02:00:59.01] INF: Copy file "Z:\0h1mx0yn.oqi" to "\\NAS\Daten\" - using CopyFileCore, 80,0 KB buffer
[02:01:45.41] INF: File copied in 46 Sekunden (44,13 MB/s)
[02:01:45.41] INF: Copy file "Z:\0h1mx0yn.oqi" to "\\NAS\Daten\" - using CopyFileCore, 128 KB buffer
[02:02:23.41] INF: File copied in 38 Sekunden (53,89 MB/s)
[02:02:23.41] INF: Copy file "Z:\0h1mx0yn.oqi" to "\\NAS\Daten\" - using CopyFileCore, 256 KB buffer
[02:02:52.41] INF: File copied in 29 Sekunden (70,60 MB/s)
[02:02:52.43] INF: Copy file "Z:\0h1mx0yn.oqi" to "\\NAS\Daten\" - using CopyFileCore, 2,00 MB buffer
[02:03:17.73] INF: File copied in 25 Sekunden (80,94 MB/s)
[02:03:17.73] INF: Copy file "Z:\0h1mx0yn.oqi" to "\\NAS\Daten\" - using CopyFileCore, 8,00 MB buffer
[02:03:44.21] INF: File copied in 26 Sekunden (77,35 MB/s)
[02:03:44.21] INF: Copy file "Z:\0h1mx0yn.oqi" to "\\NAS\Daten\" - using CopyFileCore, 16,0 MB buffer
[02:04:08.67] INF: File copied in 24 Sekunden (83,71 MB/s)
[02:04:08.84] WRN: Best result is 74,66 % of File.Copy with 83,71 MB/s and 16,0 MB buffer size

C:\Users\Dirk\Downloads\SpeedTest>speedtest.exe Z:\ \\NAS\Daten\ 2GB MD5
SpeedTest Version 3.0.0 (Build 11)
[02:39:01.06] INF: Running test with a 2,00 GB random file at Z:\, copied to \\NAS\Daten\ using hash algorithm MD5
[02:39:01.06] INF: Create a big random file of 2,00 GB
[02:39:20.53] INF: Big file created in 19 Sekunden (105,32 MB/s)
[02:39:20.53] INF: Copy file "Z:\b3pns2q3.mim" to "\\NAS\Daten\" - using File.Copy (first time)
[02:39:39.17] INF: File copied with File.Copy in 18 Sekunden (109,82 MB/s)
[02:39:39.42] INF: Copy file "Z:\b3pns2q3.mim" to "\\NAS\Daten\" - using File.Copy (second time - this counts!)
[02:39:57.70] INF: File copied with File.Copy in 18 Sekunden (112,00 MB/s)
[02:39:57.88] INF: Copy file "Z:\b3pns2q3.mim" to "\\NAS\Daten\" - using CopyFileCore, 64,0 KB buffer, hash MD5
[02:40:53.69] INF: File copied in 55 Sekunden (36,69 MB/s), hash="82056EFADC5EDB160C31B4B8C3878785"
[02:40:53.69] INF: Copy file "Z:\b3pns2q3.mim" to "\\NAS\Daten\" - using CopyFileCore, 80,0 KB buffer, hash MD5
[02:41:40.93] INF: File copied in 47 Sekunden (43,35 MB/s), hash="82056EFADC5EDB160C31B4B8C3878785"
[02:41:40.93] INF: Copy file "Z:\b3pns2q3.mim" to "\\NAS\Daten\" - using CopyFileCore, 128 KB buffer, hash MD5
[02:42:25.72] INF: File copied in 44 Sekunden (45,73 MB/s), hash="82056EFADC5EDB160C31B4B8C3878785"
[02:42:25.72] INF: Copy file "Z:\b3pns2q3.mim" to "\\NAS\Daten\" - using CopyFileCore, 256 KB buffer, hash MD5
[02:42:56.16] INF: File copied in 30 Sekunden (67,27 MB/s), hash="82056EFADC5EDB160C31B4B8C3878785"
[02:42:56.16] INF: Copy file "Z:\b3pns2q3.mim" to "\\NAS\Daten\" - using CopyFileCore, 2,00 MB buffer, hash MD5
[02:43:28.00] INF: File copied in 31 Sekunden (64,31 MB/s), hash="82056EFADC5EDB160C31B4B8C3878785"
[02:43:28.00] INF: Copy file "Z:\b3pns2q3.mim" to "\\NAS\Daten\" - using CopyFileCore, 8,00 MB buffer, hash MD5
[02:44:01.52] INF: File copied in 33 Sekunden (61,09 MB/s), hash="82056EFADC5EDB160C31B4B8C3878785"
[02:44:01.52] INF: Copy file "Z:\b3pns2q3.mim" to "\\NAS\Daten\" - using CopyFileCore, 16,0 MB buffer, hash MD5
[02:44:29.98] INF: File copied in 28 Sekunden (71,99 MB/s), hash="82056EFADC5EDB160C31B4B8C3878785"
[02:44:30.15] WRN: Best result is 64,28 % of File.Copy with 71,99 MB/s and 16,0 MB buffer size

C:\Users\Dirk\Downloads\SpeedTest>speedtest.exe Z:\ \\NAS\Daten\ 2GB SHA256
SpeedTest Version 3.0.0 (Build 11)
[02:08:24.99] INF: Running test with a 2,00 GB random file at Z:\, copied to \\NAS\Daten\ using hash algorithm SHA256
[02:08:25.00] INF: Create a big random file of 2,00 GB
[02:08:44.83] INF: Big file created in 19 Sekunden (103,63 MB/s)
[02:08:44.85] INF: Copy file "Z:\4pxiudfa.blh" to "\\NAS\Daten\" - using File.Copy (first time)
[02:09:03.44] INF: File copied with File.Copy in 18 Sekunden (110,13 MB/s)
[02:09:03.66] INF: Copy file "Z:\4pxiudfa.blh" to "\\NAS\Daten\" - using File.Copy (second time - this counts!)
[02:09:21.93] INF: File copied with File.Copy in 18 Sekunden (112,09 MB/s)
[02:09:22.10] INF: Copy file "Z:\4pxiudfa.blh" to "\\NAS\Daten\" - using CopyFileCore, 64,0 KB buffer, hash SHA256
[02:10:13.01] INF: File copied in 50 Sekunden (40,24 MB/s), hash="0D723C1DA56570977B33E46F061977D0477EA474A7A7E5DB1FF3706171FECDB6"
[02:10:13.01] INF: Copy file "Z:\4pxiudfa.blh" to "\\NAS\Daten\" - using CopyFileCore, 80,0 KB buffer, hash SHA256
[02:11:09.58] INF: File copied in 56 Sekunden (36,20 MB/s), hash="0D723C1DA56570977B33E46F061977D0477EA474A7A7E5DB1FF3706171FECDB6"
[02:11:09.58] INF: Copy file "Z:\4pxiudfa.blh" to "\\NAS\Daten\" - using CopyFileCore, 128 KB buffer, hash SHA256
[02:12:10.50] INF: File copied in 01:00 Minuten (33,61 MB/s), hash="0D723C1DA56570977B33E46F061977D0477EA474A7A7E5DB1FF3706171FECDB6"
[02:12:10.50] INF: Copy file "Z:\4pxiudfa.blh" to "\\NAS\Daten\" - using CopyFileCore, 256 KB buffer, hash SHA256
[02:12:54.12] INF: File copied in 43 Sekunden (46,95 MB/s), hash="0D723C1DA56570977B33E46F061977D0477EA474A7A7E5DB1FF3706171FECDB6"
[02:12:54.12] INF: Copy file "Z:\4pxiudfa.blh" to "\\NAS\Daten\" - using CopyFileCore, 2,00 MB buffer, hash SHA256
[02:13:35.09] INF: File copied in 40 Sekunden (49,98 MB/s), hash="0D723C1DA56570977B33E46F061977D0477EA474A7A7E5DB1FF3706171FECDB6"
[02:13:35.10] INF: Copy file "Z:\4pxiudfa.blh" to "\\NAS\Daten\" - using CopyFileCore, 8,00 MB buffer, hash SHA256
[02:14:22.73] INF: File copied in 47 Sekunden (43,00 MB/s), hash="0D723C1DA56570977B33E46F061977D0477EA474A7A7E5DB1FF3706171FECDB6"
[02:14:22.73] INF: Copy file "Z:\4pxiudfa.blh" to "\\NAS\Daten\" - using CopyFileCore, 16,0 MB buffer, hash SHA256
[02:15:07.77] INF: File copied in 45 Sekunden (45,46 MB/s), hash="0D723C1DA56570977B33E46F061977D0477EA474A7A7E5DB1FF3706171FECDB6"
[02:15:07.94] WRN: Best result is 44,59 % of File.Copy with 49,98 MB/s and 2,00 MB buffer size

dstockm

Anfänger
Beiträge: 31
Permalink

Re: Geschwindigkeit am January 13, 2018, 03:32
Zitat

Und nun noch zwei Tests auf dem Pentium G4600 ausgeführt.
Der ist übers LAN in der Tat etwas schneller.

Intern sehr ähnlich. Interessanter Weise ist hier das File.Copy intern viel langsamer als auf dem i5 (210 MB/s vs. 515 MB/s). Vielleicht die andere SSD.

lokal (auch hier von HDD-->SSD)
C:\Users\Dirk>\\server\Downloads\Speedtest\Speedtest.exe E:\ C:\tmp\ 2GB SHA256
SpeedTest Version 3.0.0 (Build 11)
[03:24:50.41] INF: Running test with a 2,00 GB random file at E:\, copied to C:\tmp\ using hash algorithm SHA256
[03:24:50.47] INF: Create a big random file of 2,00 GB
[03:25:08.14] INF: Big file created in 17 Sekunden (116,22 MB/s)
[03:25:08.14] INF: Copy file "E:\rfefhpko.v4y" to "C:\tmp\" - using File.Copy (first time)
[03:25:15.51] INF: File copied with File.Copy in 7 Sekunden (277,93 MB/s)
[03:25:15.66] INF: Copy file "E:\rfefhpko.v4y" to "C:\tmp\" - using File.Copy (second time - this counts!)
[03:25:25.42] INF: File copied with File.Copy in 9 Sekunden (209,93 MB/s)
[03:25:25.55] INF: Copy file "E:\rfefhpko.v4y" to "C:\tmp\" - using CopyFileCore, 64,0 KB buffer, hash SHA256
[03:25:43.18] INF: File copied in 17 Sekunden (116,13 MB/s), hash="F08C4DEA055434CB1AD008DB98F9A7F09FF519544332012947A8F509758F6401"
[03:25:43.18] INF: Copy file "E:\rfefhpko.v4y" to "C:\tmp\" - using CopyFileCore, 80,0 KB buffer, hash SHA256
[03:26:01.28] INF: File copied in 18 Sekunden (113,20 MB/s), hash="F08C4DEA055434CB1AD008DB98F9A7F09FF519544332012947A8F509758F6401"
[03:26:01.28] INF: Copy file "E:\rfefhpko.v4y" to "C:\tmp\" - using CopyFileCore, 128 KB buffer, hash SHA256
[03:26:18.55] INF: File copied in 17 Sekunden (118,56 MB/s), hash="F08C4DEA055434CB1AD008DB98F9A7F09FF519544332012947A8F509758F6401"
[03:26:18.55] INF: Copy file "E:\rfefhpko.v4y" to "C:\tmp\" - using CopyFileCore, 256 KB buffer, hash SHA256
[03:26:32.65] INF: File copied in 14 Sekunden (145,26 MB/s), hash="F08C4DEA055434CB1AD008DB98F9A7F09FF519544332012947A8F509758F6401"
[03:26:32.65] INF: Copy file "E:\rfefhpko.v4y" to "C:\tmp\" - using CopyFileCore, 2,00 MB buffer, hash SHA256
[03:26:45.09] INF: File copied in 12 Sekunden (164,67 MB/s), hash="F08C4DEA055434CB1AD008DB98F9A7F09FF519544332012947A8F509758F6401"
[03:26:45.09] INF: Copy file "E:\rfefhpko.v4y" to "C:\tmp\" - using CopyFileCore, 8,00 MB buffer, hash SHA256
[03:26:58.73] INF: File copied in 13 Sekunden (150,16 MB/s), hash="F08C4DEA055434CB1AD008DB98F9A7F09FF519544332012947A8F509758F6401"
[03:26:58.73] INF: Copy file "E:\rfefhpko.v4y" to "C:\tmp\" - using CopyFileCore, 16,0 MB buffer, hash SHA256
[03:27:11.23] INF: File copied in 12 Sekunden (163,82 MB/s), hash="F08C4DEA055434CB1AD008DB98F9A7F09FF519544332012947A8F509758F6401"
[03:27:11.35] WRN: Best result is 78,44 % of File.Copy with 164,67 MB/s and 2,00 MB buffer size

LAN
C:\Users\Dirk>\\server\Downloads\Speedtest\Speedtest.exe E:\ \\server\Daten\ 2GB SHA256
SpeedTest Version 3.0.0 (Build 11)
[03:11:16.10] INF: Running test with a 2,00 GB random file at E:\, copied to \\server\Daten\ using hash algorithm SHA256
[03:11:16.17] INF: Create a big random file of 2,00 GB
[03:11:33.76] INF: Big file created in 17 Sekunden (117,00 MB/s)
[03:11:33.76] INF: Copy file "E:\2i1uhggt.zmo" to "\\server\Daten\" - using File.Copy (first time)
[03:11:56.81] INF: File copied with File.Copy in 23 Sekunden (88,86 MB/s)
[03:11:57.24] INF: Copy file "E:\2i1uhggt.zmo" to "\\server\Daten\" - using File.Copy (second time - this counts!)
[03:12:15.64] INF: File copied with File.Copy in 18 Sekunden (111,33 MB/s)
[03:12:15.96] INF: Copy file "E:\2i1uhggt.zmo" to "\\server\Daten\" - using CopyFileCore, 64,0 KB buffer, hash SHA256
[03:13:04.98] INF: File copied in 49 Sekunden (41,78 MB/s), hash="4870B7ED77F023F99A27FF6DEF48AFE7DB882099DFB8A3F6FEA4FBFED57B4425"
[03:13:04.98] INF: Copy file "E:\2i1uhggt.zmo" to "\\server\Daten\" - using CopyFileCore, 80,0 KB buffer, hash SHA256
[03:13:54.12] INF: File copied in 49 Sekunden (41,68 MB/s), hash="4870B7ED77F023F99A27FF6DEF48AFE7DB882099DFB8A3F6FEA4FBFED57B4425"
[03:13:54.12] INF: Copy file "E:\2i1uhggt.zmo" to "\\server\Daten\" - using CopyFileCore, 128 KB buffer, hash SHA256
[03:14:39.66] INF: File copied in 45 Sekunden (44,98 MB/s), hash="4870B7ED77F023F99A27FF6DEF48AFE7DB882099DFB8A3F6FEA4FBFED57B4425"
[03:14:39.66] INF: Copy file "E:\2i1uhggt.zmo" to "\\server\Daten\" - using CopyFileCore, 256 KB buffer, hash SHA256
[03:15:17.37] INF: File copied in 37 Sekunden (54,30 MB/s), hash="4870B7ED77F023F99A27FF6DEF48AFE7DB882099DFB8A3F6FEA4FBFED57B4425"
[03:15:17.37] INF: Copy file "E:\2i1uhggt.zmo" to "\\server\Daten\" - using CopyFileCore, 2,00 MB buffer, hash SHA256
[03:15:50.02] INF: File copied in 32 Sekunden (62,73 MB/s), hash="4870B7ED77F023F99A27FF6DEF48AFE7DB882099DFB8A3F6FEA4FBFED57B4425"
[03:15:50.02] INF: Copy file "E:\2i1uhggt.zmo" to "\\server\Daten\" - using CopyFileCore, 8,00 MB buffer, hash SHA256
[03:16:24.60] INF: File copied in 34 Sekunden (59,22 MB/s), hash="4870B7ED77F023F99A27FF6DEF48AFE7DB882099DFB8A3F6FEA4FBFED57B4425"
[03:16:24.61] INF: Copy file "E:\2i1uhggt.zmo" to "\\server\Daten\" - using CopyFileCore, 16,0 MB buffer, hash SHA256
[03:16:58.07] INF: File copied in 33 Sekunden (61,20 MB/s), hash="4870B7ED77F023F99A27FF6DEF48AFE7DB882099DFB8A3F6FEA4FBFED57B4425"
[03:16:58.41] WRN: Best result is 56,34 % of File.Copy with 62,73 MB/s and 2,00 MB buffer size

tim_s007

Neuling
Beiträge: 20
Permalink

Re: Geschwindigkeit am January 13, 2018, 10:12
Zitat

weitere Ergebnisse mit MD5 und ganz ohne

Energieoptionen: Höchstleistung

C:\Speedtest>SpeedTest.exe D:\Temp Q:\Temp 4GB
SpeedTest Version 3.0.0 (Build 5)
[09:25:04.38] INF: Running test with a 4,00 GB random file at D:\Temp, copied to Q:\Temp
[09:25:05.15] INF: Create a big random file of 4,00 GB
[09:25:50.29] INF: Big file created in 44 Sekunden (92,13 MB/s)
[09:25:50.30] INF: Copy file "D:\Temp\z0cad0tn.svu" to "Q:\Temp" - using File.Copy (first time)
[09:26:08.57] INF: File copied with File.Copy in 18 Sekunden (224,30 MB/s)
[09:26:09.13] INF: Copy file "D:\Temp\z0cad0tn.svu" to "Q:\Temp" - using File.Copy (second time - this counts!)
[09:26:25.44] INF: File copied with File.Copy in 16 Sekunden (251,15 MB/s)
[09:26:26.05] INF: Copy file "D:\Temp\z0cad0tn.svu" to "Q:\Temp" - using CopyFileCore, 64,0 KB buffer
[09:26:48.16] INF: File copied in 22 Sekunden (185,18 MB/s)
[09:26:48.16] INF: Copy file "D:\Temp\z0cad0tn.svu" to "Q:\Temp" - using CopyFileCore, 80,0 KB buffer
[09:27:17.90] INF: File copied in 29 Sekunden (137,80 MB/s)
[09:27:17.90] INF: Copy file "D:\Temp\z0cad0tn.svu" to "Q:\Temp" - using CopyFileCore, 128 KB buffer
[09:27:37.35] INF: File copied in 19 Sekunden (210,58 MB/s)
[09:27:37.35] INF: Copy file "D:\Temp\z0cad0tn.svu" to "Q:\Temp" - using CopyFileCore, 256 KB buffer
[09:27:55.01] INF: File copied in 17 Sekunden (231,77 MB/s)
[09:27:55.01] INF: Copy file "D:\Temp\z0cad0tn.svu" to "Q:\Temp" - using CopyFileCore, 2,00 MB buffer
[09:28:13.99] INF: File copied in 18 Sekunden (215,87 MB/s)
[09:28:13.99] INF: Copy file "D:\Temp\z0cad0tn.svu" to "Q:\Temp" - using CopyFileCore, 8,00 MB buffer
[09:28:32.25] INF: File copied in 18 Sekunden (224,27 MB/s)
[09:28:32.25] INF: Copy file "D:\Temp\z0cad0tn.svu" to "Q:\Temp" - using CopyFileCore, 16,0 MB buffer
[09:28:50.05] INF: File copied in 17 Sekunden (230,13 MB/s)
[09:28:50.61] WRN: Best result is 92,28 % of File.Copy with 231,77 MB/s and 256 KB buffer size

Energieoptionen: Höchstleistung

C:\Speedtest>SpeedTest.exe D:\Temp Q:\Temp 4GB MD5
SpeedTest Version 3.0.0 (Build 5)
[09:29:31.53] INF: Running test with a 4,00 GB random file at D:\Temp, copied to Q:\Temp using hash algorithm MD5
[09:29:31.54] INF: Create a big random file of 4,00 GB
[09:30:16.00] INF: Big file created in 44 Sekunden (92,17 MB/s)
[09:30:16.00] INF: Copy file "D:\Temp\dpek2tdz.j2j" to "Q:\Temp" - using File.Copy (first time)
[09:30:35.72] INF: File copied with File.Copy in 19 Sekunden (207,71 MB/s)
[09:30:36.35] INF: Copy file "D:\Temp\dpek2tdz.j2j" to "Q:\Temp" - using File.Copy (second time - this counts!)
[09:30:53.73] INF: File copied with File.Copy in 17 Sekunden (235,64 MB/s)
[09:30:54.52] INF: Copy file "D:\Temp\dpek2tdz.j2j" to "Q:\Temp" - using CopyFileCore, 64,0 KB buffer, hash MD5
[09:31:17.01] INF: File copied in 22 Sekunden (182,09 MB/s), hash="2B7100C409DE462154FF7AE735326317"
[09:31:17.01] INF: Copy file "D:\Temp\dpek2tdz.j2j" to "Q:\Temp" - using CopyFileCore, 80,0 KB buffer, hash MD5
[09:31:45.14] INF: File copied in 28 Sekunden (145,67 MB/s), hash="2B7100C409DE462154FF7AE735326317"
[09:31:45.14] INF: Copy file "D:\Temp\dpek2tdz.j2j" to "Q:\Temp" - using CopyFileCore, 128 KB buffer, hash MD5
[09:32:02.97] INF: File copied in 17 Sekunden (229,60 MB/s), hash="2B7100C409DE462154FF7AE735326317"
[09:32:02.97] INF: Copy file "D:\Temp\dpek2tdz.j2j" to "Q:\Temp" - using CopyFileCore, 256 KB buffer, hash MD5
[09:32:22.10] INF: File copied in 19 Sekunden (214,17 MB/s), hash="2B7100C409DE462154FF7AE735326317"
[09:32:22.10] INF: Copy file "D:\Temp\dpek2tdz.j2j" to "Q:\Temp" - using CopyFileCore, 2,00 MB buffer, hash MD5
[09:32:39.21] INF: File copied in 17 Sekunden (239,35 MB/s), hash="2B7100C409DE462154FF7AE735326317"
[09:32:39.21] INF: Copy file "D:\Temp\dpek2tdz.j2j" to "Q:\Temp" - using CopyFileCore, 8,00 MB buffer, hash MD5
[09:32:56.45] INF: File copied in 17 Sekunden (237,61 MB/s), hash="2B7100C409DE462154FF7AE735326317"
[09:32:56.45] INF: Copy file "D:\Temp\dpek2tdz.j2j" to "Q:\Temp" - using CopyFileCore, 16,0 MB buffer, hash MD5
[09:33:13.39] INF: File copied in 16 Sekunden (241,90 MB/s), hash="2B7100C409DE462154FF7AE735326317"
[09:33:14.07] WRN: Best result is 102,65 % of File.Copy with 241,90 MB/s and 16,0 MB buffer size

Energieoptionen: Energiesparen

C:\Speedtest>SpeedTest.exe D:\Temp Q:\Temp 4GB
SpeedTest Version 3.0.0 (Build 5)
[09:38:31.34] INF: Running test with a 4,00 GB random file at D:\Temp, copied to Q:\Temp
[09:38:32.61] INF: Create a big random file of 4,00 GB
[09:40:02.52] INF: Big file created in 01:28 Minuten (46,14 MB/s)
[09:40:02.54] INF: Copy file "D:\Temp\w4nog3cl.jkj" to "Q:\Temp" - using File.Copy (first time)
[09:40:21.84] INF: File copied with File.Copy in 19 Sekunden (212,18 MB/s)
[09:40:22.57] INF: Copy file "D:\Temp\w4nog3cl.jkj" to "Q:\Temp" - using File.Copy (second time - this counts!)
[09:40:41.62] INF: File copied with File.Copy in 19 Sekunden (215,10 MB/s)
[09:40:42.33] INF: Copy file "D:\Temp\w4nog3cl.jkj" to "Q:\Temp" - using CopyFileCore, 64,0 KB buffer
[09:41:14.52] INF: File copied in 32 Sekunden (127,23 MB/s)
[09:41:14.52] INF: Copy file "D:\Temp\w4nog3cl.jkj" to "Q:\Temp" - using CopyFileCore, 80,0 KB buffer
[09:41:51.53] INF: File copied in 37 Sekunden (110,68 MB/s)
[09:41:51.53] INF: Copy file "D:\Temp\w4nog3cl.jkj" to "Q:\Temp" - using CopyFileCore, 128 KB buffer
[09:42:15.79] INF: File copied in 24 Sekunden (168,79 MB/s)
[09:42:15.79] INF: Copy file "D:\Temp\w4nog3cl.jkj" to "Q:\Temp" - using CopyFileCore, 256 KB buffer
[09:42:38.33] INF: File copied in 22 Sekunden (181,70 MB/s)
[09:42:38.33] INF: Copy file "D:\Temp\w4nog3cl.jkj" to "Q:\Temp" - using CopyFileCore, 2,00 MB buffer
[09:42:57.95] INF: File copied in 19 Sekunden (208,76 MB/s)
[09:42:57.95] INF: Copy file "D:\Temp\w4nog3cl.jkj" to "Q:\Temp" - using CopyFileCore, 8,00 MB buffer
[09:43:16.62] INF: File copied in 18 Sekunden (219,43 MB/s)
[09:43:16.62] INF: Copy file "D:\Temp\w4nog3cl.jkj" to "Q:\Temp" - using CopyFileCore, 16,0 MB buffer
[09:43:34.68] INF: File copied in 18 Sekunden (226,86 MB/s)
[09:43:35.33] WRN: Best result is 105,47 % of File.Copy with 226,86 MB/s and 16,0 MB buffer size

Energieoptionen: Energiesparen

C:\Speedtest>SpeedTest.exe D:\Temp Q:\Temp 4GB MD5
SpeedTest Version 3.0.0 (Build 5)
[09:44:36.93] INF: Running test with a 4,00 GB random file at D:\Temp, copied to Q:\Temp using hash algorithm MD5
[09:44:36.96] INF: Create a big random file of 4,00 GB
[09:46:06.16] INF: Big file created in 01:29 Minuten (45,94 MB/s)
[09:46:06.16] INF: Copy file "D:\Temp\cfdfhycv.aje" to "Q:\Temp" - using File.Copy (first time)
[09:46:22.64] INF: File copied with File.Copy in 16 Sekunden (248,77 MB/s)
[09:46:23.37] INF: Copy file "D:\Temp\cfdfhycv.aje" to "Q:\Temp" - using File.Copy (second time - this counts!)
[09:46:38.84] INF: File copied with File.Copy in 15 Sekunden (264,80 MB/s)
[09:46:39.69] INF: Copy file "D:\Temp\cfdfhycv.aje" to "Q:\Temp" - using CopyFileCore, 64,0 KB buffer, hash MD5
[09:47:13.31] INF: File copied in 33 Sekunden (121,82 MB/s), hash="15EBB912AB3423981B9DC1721387ACFA"
[09:47:13.31] INF: Copy file "D:\Temp\cfdfhycv.aje" to "Q:\Temp" - using CopyFileCore, 80,0 KB buffer, hash MD5
[09:47:54.38] INF: File copied in 41 Sekunden (99,74 MB/s), hash="15EBB912AB3423981B9DC1721387ACFA"
[09:47:54.38] INF: Copy file "D:\Temp\cfdfhycv.aje" to "Q:\Temp" - using CopyFileCore, 128 KB buffer, hash MD5
[09:48:22.09] INF: File copied in 27 Sekunden (147,85 MB/s), hash="15EBB912AB3423981B9DC1721387ACFA"
[09:48:22.09] INF: Copy file "D:\Temp\cfdfhycv.aje" to "Q:\Temp" - using CopyFileCore, 256 KB buffer, hash MD5
[09:48:48.28] INF: File copied in 26 Sekunden (156,37 MB/s), hash="15EBB912AB3423981B9DC1721387ACFA"
[09:48:48.28] INF: Copy file "D:\Temp\cfdfhycv.aje" to "Q:\Temp" - using CopyFileCore, 2,00 MB buffer, hash MD5
[09:49:11.67] INF: File copied in 23 Sekunden (175,08 MB/s), hash="15EBB912AB3423981B9DC1721387ACFA"
[09:49:11.67] INF: Copy file "D:\Temp\cfdfhycv.aje" to "Q:\Temp" - using CopyFileCore, 8,00 MB buffer, hash MD5
[09:49:35.67] INF: File copied in 23 Sekunden (170,74 MB/s), hash="15EBB912AB3423981B9DC1721387ACFA"
[09:49:35.67] INF: Copy file "D:\Temp\cfdfhycv.aje" to "Q:\Temp" - using CopyFileCore, 16,0 MB buffer, hash MD5
[09:49:58.60] INF: File copied in 22 Sekunden (178,61 MB/s), hash="15EBB912AB3423981B9DC1721387ACFA"
[09:49:59.23] WRN: Best result is 67,45 % of File.Copy with 178,61 MB/s and 16,0 MB buffer size

lupinho

Administrator
Beiträge: 713
Permalink

Re: Geschwindigkeit am January 13, 2018, 13:30
Zitat

Interessant wäre noch zu wissen, was das für Zielverzeichnisse (und Quellverzeichnisse) sind, mit denen ihr getestet habt.
@dstockm: Auffällig ist, dass bei Dir 64KB Puffergröße bei Y: ideal ist, während bei den meisten anderen Tests große Puffer mit 8 oder 16MB performanter sind. Was für ein Laufwerk ist denn "Y"?

dstockm

Anfänger
Beiträge: 31
Permalink

Re: Geschwindigkeit am January 13, 2018, 13:39
Zitat

Also:

Arbeits-PC ist der i5 (Netzwerkname "server")
Y: ist eine Partition auf einer SSD: Samsung evo 840 512GB
Z: ist eine WD Red 4TB (Freigabename \\server\Daten, bei dem Test Pentium --> i5)

Das NAS ist der Pentium (Netzwerkname "NAS")
C: ist eine SSD: 128 GB Intel SSD 600 (die hatte ich nur genutzt bei dem "intern" Test auf dem Pentium C:\tmp)
E: ist eine Seagate IronWolf 10TB (Freigabename \\NAS\Daten, bei dem Test i5 --> Pentium )

dstockm

Anfänger
Beiträge: 31
Permalink

Re: Geschwindigkeit am January 13, 2018, 13:45
Zitat

Bei den Werten muss auf jeden Fall irgend eine Art Cache im Spiel gewesen sein. Die Quelle Z: WD Red dürfte wohl kaum das hier schaffen:
[02:17:12.83] INF: Copy file "Z:\gguworhz.zz5" to "Y:\" - using File.Copy (second time - this counts!)
[02:17:17.05] INF: File copied with File.Copy in 04.212 Sekunden (486,21 MB/s)

dstockm

Anfänger
Beiträge: 31
Permalink

Re: Geschwindigkeit am January 13, 2018, 13:50
Zitat

Auch der "gute" 64 KB-Wert dürfte ohne Cache nicht möglich sein:
[02:17:17.33] INF: Copy file "Z:\gguworhz.zz5" to "Y:\" - using CopyFileCore, 64,0 KB buffer
[02:17:23.27] INF: File copied in 05.929 Sekunden (345,38 MB/s)

lupinho

Administrator
Beiträge: 713
Permalink

Re: Geschwindigkeit am January 13, 2018, 13:54
Zitat

Klar, Caches sind haufenweise im Spiel. Das macht es ja so unvorhersehbar. Insofern macht es Sinn auch mal größere Dateien zu testen.

dstockm

Anfänger
Beiträge: 31
Permalink

Re: Geschwindigkeit am January 13, 2018, 14:08
Zitat

Der Vorteil des Chaches geht bei den Durchläufen mit Checksum aber weitgehend verloren. Die obigen Werte waren ohne Prüfsumme,
die mit SHA256 sehen realistischer (i.S.v. was die Laufwerke hergeben) aus:
[02:20:17.14] INF: Copy file "Z:\u4t1jyo3.od0" to "Y:\" - using File.Copy (second time - this counts!)
[02:20:21.12] INF: File copied with File.Copy in 03.972 Sekunden (515,49 MB/s)
[02:20:21.42] INF: Copy file "Z:\u4t1jyo3.od0" to "Y:\" - using CopyFileCore, 64,0 KB buffer, hash SHA256
[02:20:37.75] INF: File copied in 16 Sekunden (125,48 MB/s), hash="8B4C17235CD70FA68204ADE29591A225E344BC692314822E50AD8E436436F13E"

Auch wenn man sieht, dass die CPU Einfluss hat, so zeigen meine internen Kopiervorgänge doch, dass diese nicht der Flaschenhals zu sein scheint. Der schlechteste Wert intern liegt bei SHA256 und 80 kB bei 99 MB/s.

Ich habe in beiden Rechnern 16 GB RAM. Da müsste ich wohl noch deutlich größere Dateien benutzen um die Caches auszuschließen. Aber diese "Phantasie-Werte" kann man ja relativ leicht erkennen.

Mir stellt sich vor allem die Frage, warum die Werte mit Prüfsummenberechnung so starkt vom ~~Ziellaufwerk~~ Netzlaufwerk abhängen und erst dann unter der theoretisch erreichbaren physischen Übertragsungsrate liegen.

hdo

Neuling
Beiträge: 4
Permalink

Re: Geschwindigkeit am January 14, 2018, 00:46
Zitat

Die Verwendung von unbuffered I/O erscheint mir fragwürdig. Disk I/O kann nur schnell werden, wenn mit Puffern gearbeitet wird. I/O Subsysteme arbeiten gerne mit vollen Pages (ansonsten müssen ggf. Sektoren mehrfach geschrieben werden), hohen Queue Tiefen (gerade bei SANs und professionellen Storage Systemen). Auch die read-ahead Heuristiken, der I/O-Scheduler und NCQ braucht natürlich Puffer. Es erschließt sich mir nicht, wie unbuffered I/O in diesem Kontext helfen könnte. Die FS-Caches und I/O Pfade der Betriebssysteme sind hoch optimiert, die sollte man IMHO einfach so verwenden und arbeiten lassen.

Eine multi-threaded Variante von SHA ist nicht möglich, da es blockbasiert arbeitet und die Transformation jedes Blockes für die Berechnung des nächsten benötigt wird. Die Performance von Hash-Funktionen ist aber generell sehr von der konkreten CPU abhängig. SHA-512 kann z.B. durchaus auf machen Systemen deutlich schneller sein als SHA-256.

MD5 Kollisionen künstlich zu provozieren ist möglich, mit echten Daten aber immer noch extremst unwahrscheinlich. Ich sehe nicht wirklich welchen Vorteil hier die Verwendung von SHA-256 bringt.

Um performant die Frage zu beantworten, ob Dateien oder Blöcke identisch sind, gibt es spezielle für diesen Zweck entwickelte nicht-kryptografische Hash-Verfahren wie SpookyHash oder MurmurHash. Diese verwendet unter anderem auch die exzellente Software Snapraid für genau diesen Zweck.

Für SpookyHash ist mir kein .NET Wrapper bekannt, ein .NET Port von MurmurHash ist hier verfügbar:

https://github.com/darrenkopp/murmurhash-net
https://github.com/aappleby/smhasher
http://burtleburtle.net/bob/hash/spooky.html
http://www.snapraid.it/

Wäre es meine Software, würde ich folgendes tun:
* SHA-256 durch murmurhash ersetzten.
* Kompromisslos die Async APIs in .NET/AlphaFS verwenden, und damit den Kernel IO Requests über IOCPs regeln lassen.
* ~~Mich von XML als Serializer verabschieden und Flatbuf oder Protobuf~~ sqlite verwenden, um die Hashs zu persistieren. XML ist bulky, langsam und ineffizient.

Die IO Tests weiter oben bitte alle mit Dateigrößen ab dem 10-fachen des verfügbaren Arbeitsspeichers wiederholen (8GB RAM -> 80GB Testfile) oder vor jedem Lauf zumindest die Caches über RAMMap (https://docs.microsoft.com/de-de/sysinternals/downloads/rammap) leeren:

Ist ein Linux basiertes NAS involviert bitte hier ebenfalls die Caches über sync && echo 1 > /proc/sys/vm/drop_caches vor jedem Lauf leeren.

Seiten: Erster << 3 4 5 [6] 7 8

Mingle Forum by cartpauj
Version: 1.0.34 ; Die Seite wurde geladen in: 0.089 Sekunden.

Willkommen Gast