[PYTHON] I want to automatically operate Chrome on Windows from a virtual machine (ubuntu) started using Vagrant

Thing you want to do

Remotely access Chrome on the host (Windows 10 running the virtual machine) from Selenium (python) on the virtual machine (ubuntu) started using Vagrant.

environment

Virtual machine side

• ubuntu(64bit) 18.04.5(LTS)
• python 3.8.0
• selenium 3.141.0

Host side

• virtual box 6.1.16
• vagrant 2.2.14
• chromedriver 87.0.4280.88

Problematic operation

Premise

• The vagrantfile has been set in advance, and the virtual machine has been started by vagrant up.
• There is a python execution environment on the connected virtual machine (ubuntu), and necessary libraries (selenium etc.) are installed.
• The driver (chrome driver this time) required for automatic browser operation with selenium is installed.

operation

1. 1. Run the following code in Windows Power Shell on the host (with chromedriver in the current directory)

.\chromedriver.exe --port=4444

2. 2. Execute the following python code on vagrant.

test.py

from selenium.webdriver import Chrome, ChromeOptions, Remote

options = ChromeOptions()
driver = Remote('http://10.0.2.2:4444', options=options)
#Omitted below

3. 3. The following error is output

Traceback (most recent call last):
  File "test.py", line 4, in <module>
    driver = Remote('http://10.0.2.2:4444', options=options)
#Omission
  File "/home/vagrant/scraping/lib/python3.8/site-packages/selenium/webdriver/remote/errorhandler.py", line 
208, in check_response
    raise exception_class(value)
selenium.common.exceptions.WebDriverException: Message: Host header or origin header is specified and is not whitelisted or localhost.

In addition, the following log is spit out in the chrome driver running on the host side.

[1610458155.162][SEVERE]: Rejecting request with host: 10.0.2.2:4444. origin is

Cause

The chromedriver default settings only allow local connections.

Countermeasures

To allow connections from remote hosts, run chromedriver You can add --allowed-ips to the command.

.\chromedriver.exe --port=4444  --allowed-ips

If you execute the python code on the virtual machine again while the chrome driver is running on the host side, you can automatically operate Chrome on Windows from ubuntu on the virtual machine!

reference

The method introduced is described in the official chromedriver documentation.

• It also mentions security considerations. https://chromedriver.chromium.org/security-considerations

Knowledge about Selenium is available at https://www.selenium.dev/documentation/ja/