Scripted Authentication Login Script Steps
You can configure sites that require a multi-step login process via the new Login Script Steps interface.
An example of a site that would need a Scripted Login for authentication:
Crawler starts at the Start URL given in the site.
Crawler is redirected to the login page because the site is only available to authenticated users.
On the first login page, the username is entered, and a button is selected to proceed.
On the second login page, the password is entered, and a Submit or Validate button is selected to continue.
The crawler is then authenticated and returned to the site's Start URL to begin the crawl.
When Script is chosen for the Authentication Method, the first step always needs to be Go to URL, even if it is the same as the Start URL for the site.
The Login script steps dropdown offers the following options:
Click
Fill field
Go to URL
Type
Wait for milliseconds
Wait for selector
Wait for URL
More information in the Crawling Behind a Login article.
If you have questions, please reach out to our DubBot Support team via email at help@dubbot.com or through the blue chat bubble in the lower-right corner of your screen. We are here to help!