[LINUX] I made it thinking "My virtual machine router can't be this fast"

Overview

This article is the title of @ tnishinaga's "My virtual machine router can't be this slow / KernelVM online 1" It will be a homage. Please note that we do not consider security or anything else because it is like "I should compromise and move as it is".

~~ (I'll tell you first) ~~ Summary

No matter how much VirtIO is enabled, the speed may not increase if the overhead or the OS installed on the VM is different.

Trigger

From "Previously written desire"

It's about time to become enthusiastic about virtualization and to be interested in "IPv6 IPoE", but I can't afford the hardware budget and the demand for feature phones is also high. It's declining, and the people around me are saying, "What? New hardware? Infrastructure? It would be nice if we could make the Internet, but I'm pretty reluctant to spend money (ry", but someday I'll introduce a new mackerel and "use it now." I would like to take on the challenge of "virtualizing the PC router that is being used" (when?

bought

I bought it with Yahoo Auction and a certain Naughty benefit.

• NEC Express5800 / S70 Type RB (@ Yahoo Auction)
  • CPU: Xeon X3430
• Memory: 9 [GB]
  • GPU: Quadro FX570
  • HDD: 320[GB]
• Gigabit LAN card, Broadcom BCM5751 Genuine board [^ bcm5751] x2 (@ amazon.co.jp)

The total cost is about 30,000 yen, but it is cheaper and has a higher grade than the Cerelon PC router built 12 years ago.

setup

• Everyone loves CentOS 7 x86_64 to Express5800
• I don't have to do anything with the global IPv6 address attached to the VM host, so I only attach it to the local host.
• Build a router as a guest on the VM
• In the spirit of "Well, some overhead can't be helped"
• Since the line is equivalent to "FLET'S Hikari Next Gigaline Type", it is almost enough if the upper limit of "FLET'S Hikari Next High Speed Type" is 200 [Mbps] or more.
• For the time being, FreeBSD for PPPoE exchange, Debian for IPoE exchange
• Both FreeBSD was good, but I wanted to play with IPoE lines quickly, and firewall rules are rolling on the net for Linux
• As I wrote in the final summary, I finally disabled VirtIO for FreeBSD and made it e1000e.
• Bridge is OpenvSwitch
• Macvtap was fine, but I couldn't find an example of "I tried to connect FLET'S directly to OpenvSwitch" ~~ It seemed interesting, so I chose OpenvSwitch ~~

Network configuration / measurement conditions

The measurement site used:

• iperf.scottlinux.com @ iperf3
• SPEED TEST Powered by RBB SPEED TEST @ Browser iperf3 measured the throughput for 10 seconds.

Measurement result

When I enabled VirtIO on a FreeBSD VM and interacted with the outside world with PPPoE, the result was that the down speed was high but the up speed was not high. Other than that, I wonder if it's a good place However, if I happen to run ookla's speed test on FreeBSD, it seems that the speed of up will come out, so I guess that something is wrong with the firewall (PF) ~ ~ I do not need ~ ~ I guess ... ~~ Anyway, I decided to use e1000e instead of VirtIO to make the tea muddy, and decided to make a v4 over v6 router. You can use it with v4 PPPoE.

Summary

No matter how much VirtIO is enabled, the speed may not increase if the overhead or the OS installed in the VM is different.

bonus

I searched for and used a public iperf server that does not use VPS or public cloud services, but honestly I found it in Japan, so can anyone do it? (While looking at the i-measures I saw on SoftEther and JANOG from a distance

[^ bcm5751]: I compromised because it was a little expensive for Intel NIC due to the additional HDD. ~~ "I don't like crabs ... I don't like crabs ...!" "BroadCom !!" ~~