Web Scraping with AIOHTTP and Python
John Watson Rooney
View ChannelAbout
Let's learn about Python, web scraping and API's!
Latest Posts
Video Description
AIOHttp is a client and server side library for Python 3.6 and above that enables us to create http requests asynchronously. It’s fully featured allowing sessions, cookies, custom headers, and everything else you’d expect to see - so naturally I thought it would be a useful tool to share for creating more advanced web scrapers. When we are scraping data from the web the chances are we will need to make multiple requests to the server to extract the information we are after, given that each of these requests takes time we find that our code is effectively sat waiting for the response from the server before making the next. This slows the process right down. In its simplest form AIOHTTP allows us to use the Python asyncio library to send vast numbers of requests in a short amount of time, letting us create faster and more efficient web scrapers. Support Me: # Patreon: https://www.patreon.com/johnwatsonrooney (NEW) # Gear Used: https://jhnwr.com/gear/ (NEW) # Amazon US: https://amzn.to/2OzqL1M # Amazon UK: https://amzn.to/2OYuMwo # Hosting: Digital Ocean: https://m.do.co/c/c7c90f161ff6 ------------------------------------- Disclaimer: These are affiliate links and as an Amazon Associate I earn from qualifying purchases ------------------------------------- #Timestamps 00:00 Intro 01:17 Docs 02:12 Demo Code 03:54 Web Scraper 09:38 HTML from each page 10:00 Parse HTML 12:10 Expanding Discussion 13:21 Outro
Upgrade Your Camera Kit
AI-recommended products based on this video

EMEET C960 Webcam with Tripod, 1080P Webcam with Microphone, Adjustable Height Mini Tripod, C960 Web Camera with Privacy Cover, Plug & Play with Stand for Zoom/Skype/YouTube/FaceTime

ANKER 737 Power Bank, 24,000mAh 3-Port Laptop Portable Charger with 140W Fast Charging, Smart Display, for Outdoor Work, Compatible with iPhone 16/15/14 Series, Vision Pro, Samsung, MacBook, and More

Anker iPhone 16 Charger, 2-Pack 20W Fast USB C Charger Block, for iPhone 16/16 Pro Max/15 Series/iPad Pro and More (White, 2 Pack & 2 Cable)

Anker Power Bank(PowerCore 10K),Compact Travel-Ready 10,000mAh Battery Pack with PowerIQ Charging Technology,5V/3A High-Speed Charging for iPhone,iPad,and More (USB-C Input and Output(Black),1pack) ClimatePartner certified









