We Keep Coding

Selenium function returns empty list using selenium C#

I've written this function in C# using Selenium. I first locate the specification tab, then I locate the "spec_line" classes, and then want to locate the title and description in it. I see while debugging that it has found six elements to loop over (which is correct), in the title and description are always filled with elements too. When I want the text out of it using ".Text" is seems to be empty however.
Can someone see the problem why it hasn't any values? second question is how can you debug this, for now if I saw an an element in the variable and got the text out of it it always worked, now I'm stuck.
URL I want to scrape: https://www.moss-europe.co.uk/gaiter-gear-lever-rubber-bhh2049.html
function
public List<string[]> GetModel(IWebDriver driver)
{
IWebElement parentElement = driver.FindElement(By.CssSelector("body > div.wrapper > div > div.page-border > div.main.col1-layout > div.col-main > div.product-view > div > ul > li:nth-child(2) > ul"));
IReadOnlyCollection<IWebElement> lines = parentElement.FindElements(By.ClassName("spec_line"));
List<string[]> modelDetails = new List<string[]>();
foreach (IWebElement line in lines)
{
IWebElement title = line.FindElement(By.ClassName("spec_title"));
IWebElement description = line.FindElement(By.ClassName("spec_desc"));
string[] detail = { title.Text, description.Text };
modelDetails.Add(detail);
}
return modelDetails;
}
I tried to debug it and saw that all the variables are filled with elements, I know for sure that there's text in it.

You need to click first on specification tab in order these elements to be visible
driver.FindElement(By.XPath("//*[normalize-space(text()) = 'specification']")).Click();
For a more robust solution you could use the SeleniumExtras.WaitHelpers nuget package, this will give you access to a bunch of helper expected conditions methods.
For the same scenario using some waiting methods:
// The model you need to store the values
record Model(string Title, string Description)
{
public override string ToString()
{
return $"{Title}: {Description}";
}
}
using OpenQA.Selenium;
using OpenQA.Selenium.Chrome;
using OpenQA.Selenium.Support.UI;
using SeleniumExtras.WaitHelpers;
const string Url = #"https://www.moss-europe.co.uk/gaiter-gear-lever-rubber-bhh2049.html";
using var driver = new ChromeDriver();
// Setup your `wait`
var wait = new WebDriverWait(driver, TimeSpan.FromSeconds(20))
{
PollingInterval = TimeSpan.FromMilliseconds(250)
};
driver.Navigate().GoToUrl(Url);
// Wait for the tab to be visible and then click
wait
.Until(ExpectedConditions.ElementIsVisible(By.XPath("//*[normalize-space(text()) = 'specification']")))
.Click();
var models = new List<Model>();
// Wait for all lines with elements to be visible
var lines = wait.Until(ExpectedConditions.VisibilityOfAllElementsLocatedBy(By.ClassName("spec_line")));
foreach (var line in lines)
{
var title = line.FindElement(By.ClassName("spec_title")).Text;
var description = line.FindElement(By.ClassName("spec_desc")).Text;
models.Add(new Model(title, description));
}
// Just to demo the results
foreach (var mod in models)
{
Console.WriteLine(mod);
}

Why i am getting this error when trying to get the search results panel that contains the link for each result?

I'm getting a lot of errors trying to do this simple app with Selenium and C#
I just want to make an application (in windows application or console application) that opens a browser, enter the google page, search for "APPLES" and bring the first 5 results, using selenium.
This is the code i'm using :
IWebDriver driver = new ChromeDriver();
driver.Navigate().GoToUrl("http://google.com");
driver.Manage().Timeouts().ImplicitWait = TimeSpan.FromSeconds(10);
//IWebElement element = driver.FindElement(By.Id("gbqfq"));
driver.FindElement(By.Name("q")).SendKeys("apples");
//element.SendKeys("apples");
// Get the search results panel that contains the link for each result.
IWebElement resultsPanel = driver.FindElement(By.Id("search"));
// Get all the links only contained within the search result panel.
ReadOnlyCollection<IWebElement> searchResults = resultsPanel.FindElements(By.XPath(".//a"));
// Print the text for every link in the search results.
int resultCNT = 1;
foreach (IWebElement result in searchResults)
{
if (resultCNT <= 5)
{
Console.WriteLine(result.Text);
}
else
{
break;
}
resultCNT++;
}
I'm getting a error that it can not find element search:
OpenQA.Selenium.NoSuchElementException: 'no such element: Unable to locate element: {"method":"css selector","selector":"#search"}

This should do what you need:
IWebDriver driver = new ChromeDriver();
driver.Navigate().GoToUrl("http://google.com");
driver.Manage().Timeouts().ImplicitWait = TimeSpan.FromSeconds(10);
driver.FindElement(By.Name("q")).SendKeys("apples");
// Click on the Search button
driver.FindElement(By.Name("btnK")).Click();
// Use a Css Selector to go down to the actual element, in this case <a>
var results = driver.FindElements(By.CssSelector("#rso > div > div > div.r > a"));
foreach (var item in results)
{
//Extract the page title and the url from the result
var title = item.FindElement(By.TagName("h3")).Text;
var url = item.GetProperty("href");
Console.WriteLine($"{title} | {url}");
}
In short, you had this error because you were not searching for the proper element in the page.

Howto to execute onclick of each tag table (tr) with Webdriver Selenium C#

I have a html table with onclick on the tr tag. This "click" send me to a new web page, and then I need to go back to previous page and continue to the next "tr click".
Until now, I achieve to execute the first onclick, then when I go back, Selenium give me this error.
stale element reference: element is not attached to the page document
The code I have
IWebElement table = driver.FindElement(By.Name("pg_table"));
IReadOnlyCollection<IWebElement> rows = table.FindElements(By.XPath(".//tr[#onclick]"));
IJavaScriptExecutor js = (IJavaScriptExecutor)driver;
int rowCurrent = 0;
foreach (IWebElement row in rows)
{
js.ExecuteScript($"arguments[{rowCurrent}].click();", row);
var wait = new WebDriverWait(driver, TimeSpan.FromSeconds(10));
wait.Until(ExpectedConditions.ElementIsVisible(By.XPath("/html/body")));
//retreive data from the new page....
Thread.Sleep(1000);
driver.Navigate().Back();
++rowCurrent;
}
Can you help me.
Thanks in advance.

I solve this with this, first I get all the onclick javascript in a list
List<string> linksPbds = new List<string>();
IWebElement table = driver.FindElement(By.Name("pg_table"));
IReadOnlyCollection<IWebElement> rows = table.FindElements(By.XPath(".//tr[#onclick]"));
foreach (IWebElement row in rows)
{
linksPbds.Add(row.GetAttribute("onclick"));
}
then I iterate each member of the list and execute the javascript
foreach (var link in links)
{
js.ExecuteScript(link);
var airlineCode = driver.FindElement(By.XPath("/html/body/form/table[1]/tbody/tr[2]/td[1]")).Text;
.... other html element
}
I don´t know if ths is best approach , but this work for me.

C#+Selenium web scraping

I want to scrape some data from https://zakup.sk.kz.
First, I initialize my browser:
IWebDriver browser = new ChromeDriver();
browser.Navigate().GoToUrl("https://zakup.sk.kz/#/ext?tabs=lot&adst=PUBLISHED&lst=PUBLISHED&page=1");
After, I click to the frame:
IWebElement click = browser.FindElement(By.ClassName("m-found-item__num"));
click.Click();
In this frame exist data that I want to scrape (I found abs path):
IWebElement tru = browser.FindElement(By.XPath("/html[1]/body[1]/ngb-modal-window[1]/div[1]/div[1]/sk-main-dialog[1]/div[2]/div[6]/div[1]/div[1]/div[7]"));
Console.WriteLine(tru.Text);
After this, I need to switch to the next frame with the same structure, and scrape data:
IWebElement next = browser.FindElement(By.XPath("//div[contains(#class, 'm-modal__arrow')]"));
next.Click();
IWebElement tru2 = browser.FindElement(By.XPath("/html[1]/body[1]/ngb-modal-window[1]/div[1]/div[1]/sk-main-dialog[1]/div[2]/div[6]/div[1]/div[1]/div[7]"));
Console.WriteLine(tru2.Text);
But Selenium not found tru2, I don't know why, because every frame has the same structure? Tell me please, what should I do?

when you click the next arrow the current element will be deleted and added after Ajax request finished, here you need WebDriverWait
IWebElement next = browser.FindElement(By.XPath("//div[contains(#class, 'm-modal__arrow')]"));
next.Click();
// wait max 15 seconds
IWait wait = new WebDriverWait(browser, TimeSpan.FromSeconds(15))
IWebElement tru2 = wait.Until(browser => browser.FindElement(By.XPath("(//div[#class="m-infoblock__layout"])[7]")));
Console.WriteLine(tru2.Text);
note that I use Xpath
(//div[#class="m-infoblock__layout"])[7]

How can I use click event on multiple page in the same test cases on Selenium and C#

How can I use click event on multiple page in the same test cases on Selenium and C#
For example:
Go to Google Homepage.
Search the resulting Test
Click on the Search button,
The user gets Redirected to the Searched Result page, but when I am trying to select any link it showing error.
public void opengoogle()
{
ChromeOptions option = new ChromeOptions();
option.AddArgument("--headless");
ChromeDriver wd = new ChromeDriver(option);
try
{
wd.Navigate().GoToUrl("https://www.google.co.in/");
Thread.Sleep(2000);
wd.FindElement(By.CssSelector("#lst-ib")).Click();
Thread.Sleep(2000);
wd.FindElement(By.CssSelector("#lst-ib")).Click();
wd.FindElement(By.CssSelector("#lst-ib")).Clear();
wd.FindElement(By.CssSelector("#lst-ib")).SendKeys("Test");
wd.FindElement(By.CssSelector("#lst-ib")).Submit();
}
finally { }

public void TestMethod1()
{
ChromeOptions option = new ChromeOptions();
option.AddArgument("--headless");
ChromeDriver webDriver = new ChromeDriver(option);
try
{
webDriver.Navigate().GoToUrl("https://www.google.lk/");
WebDriverWait wait = new WebDriverWait(webDriver, new TimeSpan(0, 0, 0, 30));
IWebElement searchTextField= wait.Until(ExpectedConditions.ElementToBeClickable(By.Id("lst-ib")));
searchTextField.SendKeys("Test");
IWebElement searchButton = wait.Until(ExpectedConditions.ElementToBeClickable(By.CssSelector(".lsb")));
searchButton.Click();
wait.Until(ExpectedConditions.TitleContains("Test"));
IWebElement searchResultLink= wait.Until(ExpectedConditions.ElementToBeClickable(By.CssSelector("a[href='http://www.speedtest.net/']")));
searchResultLink.Click();
}
finally { }
}
You can try above code.
It explains following process.
First move to Google search page.
Insert "Test" in to search text field.
Then click on Google search button.
After Navigate to search results page, click on "www.speedtest.net" link.

You can try out this code:
ChromeOptions option = new ChromeOptions();
option.AddArgument("--headless");
ChromeDriver wd = new ChromeDriver(option);
wd.Navigate().GoToUrl("https://www.google.co.in/");
WebDriverWait wait = new WebDriverWait(driver, TimeSpan.FromMinutes(1));
wait.Until(ExpectedConditions.ElementToBeClickable(By.Name("q")));
wd.FindElement(By.Name("q")).SendKeys("Test"+Keys.RETURN);
wait.Until(ExpectedConditions.VisibilityOfElementLocated(By.CssSelector("a[href='http://www.speedtest.net/']")));
driver.FindElement(By.CssSelector("a[href='http://www.speedtest.net/']")).Click();
P.S :
1. I'm not good in C# though I've tried to convert a java code to C#. Hope this will be helpful for you.
2. This will always open the speedtest.net website. If you want something else, you can have it by replacing the cssSelector which I have written.