tarifa Posted April 8, 2020 Share Posted April 8, 2020 hi there - good day Casual print() to sys.stout - instead of storing the data on the machine that is what i want to do. I am currently setting up ATOM and VSCode to work with python. Whilst doing so i have some scripts that help me in the setup the important thing is - i am currently figuging out where the editor store the results ..!? import requests from bs4 import BeautifulSoup import pandas as pd def Main(urls): with requests.Session() as req: allin = [] for url in urls: r = req.get(url) soup = BeautifulSoup(r.content, 'html.parser') target = soup.find( "dl", class_="c-description-list c-description-list--striped") names = [item.text for item in target.findAll("dt")] names.append("url") data = [item.get_text(strip=True) for item in target.findAll("dd")] data.append(url) allin.append(data) df = pd.DataFrame(allin, columns=names) df.to_csv("data.csv", index=False) urls = ['https://www2.daad.de/deutschland/studienangebote/international-programmes/en/detail/4722/', 'https://www2.daad.de/deutschland/studienangebote/international-programmes/en/detail/6318/'] Main(urls) Besides this : besides the question of storge i also can try to print the results on Teminal yes i do not want to write this into a file - i want to print this out on terminal so i guess that i need to use sys.stout... - i have learned that Casual print() should do it in case to run like so i want to pipe output on the terminal import sys sys.stdout = open(' data.csv(', 'w') and then in my terminal window do tail -f /data.csv is this correct!? but the issue is that i do not know where ATOM does store this !? neither where VsCode does store the results. look forward to heaer from you Link to comment https://www.neowin.net/forum/topic/1394096-casual-print-to-sysstout-instead-of-storing-the-data-on-the-machine/ Share on other sites More sharing options...
Question
tarifa
hi there - good day
Casual print() to sys.stout - instead of storing the data on the machine that is what i want to do.
I am currently setting up ATOM and VSCode to work with python.
Whilst doing so i have some scripts that help me in the setup
the important thing is - i am currently figuging out where the editor store the results ..!?
import requests from bs4 import BeautifulSoup import pandas as pd def Main(urls): with requests.Session() as req: allin = [] for url in urls: r = req.get(url) soup = BeautifulSoup(r.content, 'html.parser') target = soup.find( "dl", class_="c-description-list c-description-list--striped") names = [item.text for item in target.findAll("dt")] names.append("url") data = [item.get_text(strip=True) for item in target.findAll("dd")] data.append(url) allin.append(data) df = pd.DataFrame(allin, columns=names) df.to_csv("data.csv", index=False) urls = ['https://www2.daad.de/deutschland/studienangebote/international-programmes/en/detail/4722/', 'https://www2.daad.de/deutschland/studienangebote/international-programmes/en/detail/6318/'] Main(urls)
Besides this : besides the question of storge i also can try to print the results on Teminal
yes i do not want to write this into a file - i want to print this out on terminal
so i guess that i need to use sys.stout...
- i have learned that Casual print() should do it in case to run like so i want to pipe output on the terminal
import sys sys.stdout = open(' data.csv(', 'w') and then in my terminal window do tail -f /data.csv
is this correct!?
but the issue is that i do not know where ATOM does store this !?
neither where VsCode does store the results.
look forward to heaer from you
Link to comment
https://www.neowin.net/forum/topic/1394096-casual-print-to-sysstout-instead-of-storing-the-data-on-the-machine/Share on other sites
0 answers to this question
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now