Python Web Scraping - Should I use Selenium, Beautiful Soup or Scrapy? [2020]

177,718
0
Publicado 2020-02-29
In this video, you’ll learn the pros and cons of the three Python web scraping frameworks you should know - beautiful soup, selenium, and scrapy. I’ll also give you scenarios of when a certain framework is more effective than the others. Let’s jump in.

⭐ Kite is a free AI-powered coding assistant that will help you code faster and smarter. The Kite plugin integrates with all the top editors and IDEs to give you smart completions and documentation while you’re typing. We made this YouTube channel and Kite to help you be more productive: kite.com/download/?utm_medium=referral&utm_source=…

JOIN our online community of people who want to level up their developer skills ►
www.facebook.com/groups/505658083720291/

Subscribe ► youtube.com/c/KiteHQ?sub_confirmation=1
Twitter ►twitter.com/kitehq

***************************************
Additional Python Resources

Web Scraping with Cats! ►
   • Python Scrapy Tutorial - Cats & Spide...  

6 Python Tips and Tricks YOU Should Know ►
   • 6 Python Tips and Tricks YOU Should Know  

Best IDEs for Python ►
   • Best IDEs for Python  

***************************************
Be sure to subscribe for tutorials, project breakdowns and more!
youtube.com/c/KiteHQ?sub_confirmation=1

STAY TUNED:
Kite ► kite.com/
YouTube ►    / @kitehq  

Todos los comentarios (21)
  • @aabergkvist
    Beautiful Soup + User Friendly + Easy to Learn & Master - Requires Dependencies - Inefficient Scrapy + Efficient + Portability - Not User Friendly Selenium + Versatile + Works well with Javascript - Not Meant to be a Web Scraper - Inefficient
  • For my use case using Selenium is perfect because I hate dealing with pesky buttons on dynamic webpage.
  • @homeheart1276
    Well done, Sir. You just made it into my "0. Top Resources" Bookmark folder...the competition to get in there is insane and your roommates are very few and far between. It's not what you did in this video per se, it is HOW you did it. Concise, clear, to the point, and not made artificially long to improve your YouTube revenue. Make sure you are advertising to entrepreneurs and I.T. professionals; we have little time (or patience). Thanks again! Well done.
  • @sozno4222
    Great job on this video. I love how precise it is.
  • @bluesdog88
    Great tutorial, thanks for the insight, you saved me a lot of reading ;)
  • @aydencraig9542
    Thank you for video! I'm going to check out your web scraping tutorials now!
  • Love this quick video summary. content is perfect and I got exactly what I came for. Some tiny constructive feedback on the delivery would be to speak about them in the same order throughout. 0:39 - Selenium, BS, Scrapy main content - BS, Selenium, Scrapy (best order in my opinion) summary (4:34) - BS, Scrapy, Selenium Keep up the great work!
  • @stanlukash33
    Appreciate this video man. Lots of stuff clarified.
  • HI, Firstly I want to congratulate you on your new youtube channel and hope that it will be as successful as your product. You are putting in great content, and the dev community really appreciates the hard work. As a future video idea, I would like to suggest "Design Patterns". This would cater to python enthusiasts falling in both ends of the spectrum. Thanks, Cheers!
  • @airmanfair
    I actually downloaded kite as per your suggestion and am using it now with jupyterlab. It's pretty neat!
  • @daviyokogawa4237
    Your video was so easy to understand and help me a lot to know which way to go
  • @KiteHQ
    Let us know what topic we should cover next!
  • @saurabhbhambry
    Great video! Love how it's concise and to the point. Quick question, can Scrapy be used for scraping sites that use Javascript for dynamic loading too? Or is Selenium the only choice for such a scenario?
  • Thank you for making this video! I'm glad I watched this first before starting to build a scraper.