Got empty list with Beautiful Soup and SeleniumHow do I check if a list is empty?Finding the index of an item given a list containing it in PythonDifference between append vs. extend list methods in PythonHow to make a flat list out of list of lists?How do I get the number of elements in a list in Python?How do I concatenate two lists in Python?How to clone or copy a list?How do I list all files of a directory?How to read a file line-by-line into a list?Python Beautiful Soup how to JSON decode to `dict`?
How can "mimic phobia" be cured or prevented?
Customize circled numbers
How do ground effect vehicles perform turns?
Freedom of speech and where it applies
How much character growth crosses the line into breaking the character
Do Legal Documents Require Signing In Standard Pen Colors?
Can I rely on this github repository files?
Can a significant change in incentives void an employment contract?
Does the Mind Blank spell prevent the target from being frightened?
Why has "pence" been used in this sentence, not "pences"?
Journal losing indexing services
Indicating multiple different modes of speech (fantasy language or telepathy)
How do I implement a file system driver driver in Linux?
Why is Arduino resetting while driving motors?
A social experiment. What is the worst that can happen?
On a tidally locked planet, would time be quantized?
Why does Async/Await work properly when the loop is inside the async function and not the other way around?
Find last 3 digits of this monster number
Transformation of random variables and joint distributions
Query about absorption line spectra
What does the Rambam mean when he says that the planets have souls?
Some numbers are more equivalent than others
Diode in opposite direction?
How do I extrude a face to a single vertex
Got empty list with Beautiful Soup and Selenium
How do I check if a list is empty?Finding the index of an item given a list containing it in PythonDifference between append vs. extend list methods in PythonHow to make a flat list out of list of lists?How do I get the number of elements in a list in Python?How do I concatenate two lists in Python?How to clone or copy a list?How do I list all files of a directory?How to read a file line-by-line into a list?Python Beautiful Soup how to JSON decode to `dict`?
https://www.rottentomatoes.com/m/the_lord_of_the_rings_the_return_of_the_king
I want to get TOMATOMETER and AUDIENCE SCORE from that website,
but got an empty list.
soup = BeautifulSoup(html, 'html.parser')
notices = soup.select('#tomato_meter_link > span.mop-ratings-wrap__percentage')
python selenium web-scraping beautifulsoup screen-scraping
edited Mar 8 at 8:12
QHarr
36.1k82144
asked Mar 7 at 9:36
RyanRyan
82
add a comment |
https://www.rottentomatoes.com/m/the_lord_of_the_rings_the_return_of_the_king
I want to get TOMATOMETER and AUDIENCE SCORE from that website,
but got an empty list.
soup = BeautifulSoup(html, 'html.parser')
notices = soup.select('#tomato_meter_link > span.mop-ratings-wrap__percentage')
python selenium web-scraping beautifulsoup screen-scraping
edited Mar 8 at 8:12
QHarr
36.1k82144
asked Mar 7 at 9:36
RyanRyan
82
You mean93%and86%?
– DirtyBit
Mar 7 at 9:39
OrReviews Counted: 272, User Ratings: 34,679,279?
– DirtyBit
Mar 7 at 9:45
add a comment |
https://www.rottentomatoes.com/m/the_lord_of_the_rings_the_return_of_the_king
I want to get TOMATOMETER and AUDIENCE SCORE from that website,
but got an empty list.
soup = BeautifulSoup(html, 'html.parser')
notices = soup.select('#tomato_meter_link > span.mop-ratings-wrap__percentage')
python selenium web-scraping beautifulsoup screen-scraping
edited Mar 8 at 8:12
QHarr
36.1k82144
asked Mar 7 at 9:36
RyanRyan
82
https://www.rottentomatoes.com/m/the_lord_of_the_rings_the_return_of_the_king
I want to get TOMATOMETER and AUDIENCE SCORE from that website,
but got an empty list.
soup = BeautifulSoup(html, 'html.parser')
notices = soup.select('#tomato_meter_link > span.mop-ratings-wrap__percentage')
python selenium web-scraping beautifulsoup screen-scraping
python selenium web-scraping beautifulsoup screen-scraping
edited Mar 8 at 8:12
QHarr
36.1k82144
asked Mar 7 at 9:36
RyanRyan
82
edited Mar 8 at 8:12
QHarr
36.1k82144
asked Mar 7 at 9:36
RyanRyan
82
edited Mar 8 at 8:12
QHarr
36.1k82144
edited Mar 8 at 8:12
QHarr
36.1k82144
edited Mar 8 at 8:12
QHarr
36.1k82144
36.1k82144
asked Mar 7 at 9:36
RyanRyan
82
asked Mar 7 at 9:36
RyanRyan
82
asked Mar 7 at 9:36
RyanRyan
82
82
You mean93%and86%?
– DirtyBit
Mar 7 at 9:39
OrReviews Counted: 272, User Ratings: 34,679,279?
– DirtyBit
Mar 7 at 9:45
add a comment |
You mean93%and86%?
– DirtyBit
Mar 7 at 9:39
OrReviews Counted: 272, User Ratings: 34,679,279?
– DirtyBit
Mar 7 at 9:45
You mean
93% and 86%?– DirtyBit
Mar 7 at 9:39
You mean
93% and 86%?– DirtyBit
Mar 7 at 9:39
Or
Reviews Counted: 272, User Ratings: 34,679,279?– DirtyBit
Mar 7 at 9:45
Or
Reviews Counted: 272, User Ratings: 34,679,279?– DirtyBit
Mar 7 at 9:45
add a comment |
2 Answers
2
active
oldest
votes
You can use last-child selector for span type with the parent class. This is using BeautifulSoup 4.7.1
import requests
from bs4 import BeautifulSoup
res = requests.get('https://www.rottentomatoes.com/m/the_lord_of_the_rings_the_return_of_the_king')
soup = bs(res.content, 'lxml')
ratings = [item.text.strip() for item in soup.select('h1.mop-ratings-wrap__score span:last-child')]
print(ratings)
answered Mar 8 at 8:11
QHarrQHarr
36.1k82144
1
Thx , :) I already solved as selenium function
– Ryan
Mar 12 at 11:46
add a comment |
Your code works well
>>> from bs4 import BeautifulSoup
>>> html = requests.get('https://www.rottentomatoes.com/m/the_lord_of_the_rings_the_return_of_the_king').text
>>> soup = BeautifulSoup(html, 'html.parser')
>>> notices = soup.select('#tomato_meter_link > span.mop-ratings-wrap__percentage')
>>> notices
[<span class="mop-ratings-wrap__percentage">93%</span>]
How did you get html variable?
answered Mar 7 at 10:22
nmb.tennmb.ten
96811115
add a comment |
Your Answer
StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55040443%2fgot-empty-list-with-beautiful-soup-and-selenium%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
2 Answers
2
active
oldest
votes
2 Answers
2
active
oldest
votes
active
oldest
votes
active
oldest
votes
You can use last-child selector for span type with the parent class. This is using BeautifulSoup 4.7.1
import requests
from bs4 import BeautifulSoup
res = requests.get('https://www.rottentomatoes.com/m/the_lord_of_the_rings_the_return_of_the_king')
soup = bs(res.content, 'lxml')
ratings = [item.text.strip() for item in soup.select('h1.mop-ratings-wrap__score span:last-child')]
print(ratings)
answered Mar 8 at 8:11
QHarrQHarr
36.1k82144
1
Thx , :) I already solved as selenium function
– Ryan
Mar 12 at 11:46
add a comment |
You can use last-child selector for span type with the parent class. This is using BeautifulSoup 4.7.1
import requests
from bs4 import BeautifulSoup
res = requests.get('https://www.rottentomatoes.com/m/the_lord_of_the_rings_the_return_of_the_king')
soup = bs(res.content, 'lxml')
ratings = [item.text.strip() for item in soup.select('h1.mop-ratings-wrap__score span:last-child')]
print(ratings)
answered Mar 8 at 8:11
QHarrQHarr
36.1k82144
1
Thx , :) I already solved as selenium function
– Ryan
Mar 12 at 11:46
add a comment |
You can use last-child selector for span type with the parent class. This is using BeautifulSoup 4.7.1
import requests
from bs4 import BeautifulSoup
res = requests.get('https://www.rottentomatoes.com/m/the_lord_of_the_rings_the_return_of_the_king')
soup = bs(res.content, 'lxml')
ratings = [item.text.strip() for item in soup.select('h1.mop-ratings-wrap__score span:last-child')]
print(ratings)
answered Mar 8 at 8:11
QHarrQHarr
36.1k82144
You can use last-child selector for span type with the parent class. This is using BeautifulSoup 4.7.1
import requests
from bs4 import BeautifulSoup
res = requests.get('https://www.rottentomatoes.com/m/the_lord_of_the_rings_the_return_of_the_king')
soup = bs(res.content, 'lxml')
ratings = [item.text.strip() for item in soup.select('h1.mop-ratings-wrap__score span:last-child')]
print(ratings)
answered Mar 8 at 8:11
QHarrQHarr
36.1k82144
answered Mar 8 at 8:11
QHarrQHarr
36.1k82144
answered Mar 8 at 8:11
QHarrQHarr
36.1k82144
answered Mar 8 at 8:11
QHarrQHarr
36.1k82144
36.1k82144
1
Thx , :) I already solved as selenium function
– Ryan
Mar 12 at 11:46
add a comment |
1
Thx , :) I already solved as selenium function
– Ryan
Mar 12 at 11:46
1
1
Thx , :) I already solved as selenium function
– Ryan
Mar 12 at 11:46
Thx , :) I already solved as selenium function
– Ryan
Mar 12 at 11:46
add a comment |
Your code works well
>>> from bs4 import BeautifulSoup
>>> html = requests.get('https://www.rottentomatoes.com/m/the_lord_of_the_rings_the_return_of_the_king').text
>>> soup = BeautifulSoup(html, 'html.parser')
>>> notices = soup.select('#tomato_meter_link > span.mop-ratings-wrap__percentage')
>>> notices
[<span class="mop-ratings-wrap__percentage">93%</span>]
How did you get html variable?
answered Mar 7 at 10:22
nmb.tennmb.ten
96811115
add a comment |
Your code works well
>>> from bs4 import BeautifulSoup
>>> html = requests.get('https://www.rottentomatoes.com/m/the_lord_of_the_rings_the_return_of_the_king').text
>>> soup = BeautifulSoup(html, 'html.parser')
>>> notices = soup.select('#tomato_meter_link > span.mop-ratings-wrap__percentage')
>>> notices
[<span class="mop-ratings-wrap__percentage">93%</span>]
How did you get html variable?
answered Mar 7 at 10:22
nmb.tennmb.ten
96811115
add a comment |
Your code works well
>>> from bs4 import BeautifulSoup
>>> html = requests.get('https://www.rottentomatoes.com/m/the_lord_of_the_rings_the_return_of_the_king').text
>>> soup = BeautifulSoup(html, 'html.parser')
>>> notices = soup.select('#tomato_meter_link > span.mop-ratings-wrap__percentage')
>>> notices
[<span class="mop-ratings-wrap__percentage">93%</span>]
How did you get html variable?
answered Mar 7 at 10:22
nmb.tennmb.ten
96811115
Your code works well
>>> from bs4 import BeautifulSoup
>>> html = requests.get('https://www.rottentomatoes.com/m/the_lord_of_the_rings_the_return_of_the_king').text
>>> soup = BeautifulSoup(html, 'html.parser')
>>> notices = soup.select('#tomato_meter_link > span.mop-ratings-wrap__percentage')
>>> notices
[<span class="mop-ratings-wrap__percentage">93%</span>]
How did you get html variable?
answered Mar 7 at 10:22
nmb.tennmb.ten
96811115
answered Mar 7 at 10:22
nmb.tennmb.ten
96811115
answered Mar 7 at 10:22
nmb.tennmb.ten
96811115
answered Mar 7 at 10:22
nmb.tennmb.ten
96811115
96811115
add a comment |
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55040443%2fgot-empty-list-with-beautiful-soup-and-selenium%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
You mean
93%and86%?– DirtyBit
Mar 7 at 9:39
Or
Reviews Counted: 272, User Ratings: 34,679,279?– DirtyBit
Mar 7 at 9:45