Use requests to download csv file into python

Any help would be appreciated. I have attached part of the dataframe below. From your example, namely Yahoo Finance, you can copy the Historical data link and call it in Pandas. Check that they match ;. If you can see the raw csv contents directly in url, just pass the url in pd.

This is probably the difficult part, you will need to get cookies before actually downloading the CSV file, more info here , here and here. Once you create the proper URL with the cookie, you can download it with:. If you apply the following to the dataframe it will place each of the documents in an np.

Not in a dataframe I'm unsure of how to get there. But this will give you access to all the files and its only a matter of putting them in a df. Stack Overflow for Teams — Collaborate and share knowledge with a private group. Create a free Team What is Teams? Collectives on Stack Overflow. Learn more. Download a csv from url and make it a dataframe python pandas Ask Question. Asked 3 years ago. Active 9 months ago.

Stack Overflow for Teams — Collaborate and share knowledge with a private group. Create a free Team What is Teams? Collectives on Stack Overflow. Learn more. Asked 5 years, 9 months ago. Active 3 months ago. Viewed k times. Here is my code: import csv import requests with requests. Session as s: s. I tried different method to deal with the download: This will give the the csv file in one string: print download. Improve this question. Add a comment. Active Oldest Votes. Improve this answer. Community Bot 1 1 1 silver badge.

Is it necessary to read the entire thing into memory? This seems non-scaleable. The Aelfinn The Aelfinn I had to also import codecs and wrap the r. Thanks IrvinH. On Python 3. Best answer! Works great with latest version of Python. To support the widest audience, it should work with all currently-deployed versions of Python, not just the latest So, this is one way to obtain useful data.

After that, however, you still need to analyze it. That said, if you want to strengthen your analytical skillset, check out our complete Data Science program. It is designed to help you develop all in-demand competencies for a data scientist or a data analyst job.

Nikola Pulev is a University of Cambridge graduate, a data science practitioner, and instructor at Data Science. Career Track Certificate Course Certificate. Nikola Pulev. Learn data science with industry experts Try For Free.

We Think you'll also like. Learn data science with industry experts Comprehensive training, exams, certificates. Find your dream job.