How to set a user agent in Selenium?

Setting the User Agent in Selenium is a relatively straightforward process that helps simulate different browser environments during web automation testing. Below, I will provide detailed explanations with practical code examples.

Steps to Set User Agent in Selenium

1. Import Necessary Libraries: First, ensure that you have installed the Selenium library and the corresponding WebDriver. Here, we use Chrome and Firefox as examples.

2. Configure WebDriver: Next, configure the User Agent when launching the browser using WebDriver options.

Example: Chrome Browser

For Chrome browser, we can use webdriver.ChromeOptions() to set the User Agent:

python
from selenium import webdriver

# Set the User Agent string
user_agent = "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.36"

# Create a Chrome options object
options = webdriver.ChromeOptions()
# Add the User Agent setting
options.add_argument(f'user-agent={user_agent}')

# Initialize WebDriver
driver = webdriver.Chrome(options=options)

# Access a webpage
driver.get("http://www.whatsmyuseragent.org/")

Example: Firefox Browser

For Firefox browser, we can use webdriver.FirefoxOptions() to set the User Agent:

python
from selenium import webdriver

# Set the User Agent string
user_agent = "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/14.0.3 Safari/605.1.15"

# Create a Firefox options object
options = webdriver.FirefoxOptions()
# Add the User Agent setting
options.set_preference("general.useragent.override", user_agent)

# Initialize WebDriver
driver = webdriver.Firefox(options=options)

# Access a webpage
driver.get("http://www.whatsmyuseragent.org/")

Important Notes

• When setting the User Agent, ensure that you use a string that matches the simulated browser environment.
• Besides the User Agent, you can also set other browser configurations, such as disabling images or JavaScript, to optimize automation testing performance.

Through the above steps and examples, you can easily set the User Agent when using Selenium for automation testing. This not only helps test how websites perform in different browser environments but can also be used in web scraping to simulate different client accesses.